I'm new to wordpress also, and just had to solve that same problem.
I had to do two things to get the author to appear. First, under "Users", I had to create a profile for myself with my name. Then, on the "write" page, where you create a post, you have to select the author from the drop down menu there.
That was the easy part.
I believe (and I don't have the theme editor window open, so you might have to dig a little deeper) I just had to edit the "single post" template. The character string "!--" and "--" are tags that make something a comment. I just deleted those two bits from the code that was there, and the author name appeared.
Right now, that line on my "single post" theme runs like this:
<h4><?php the_time('F jS, Y') ?> by <?php the_author() ?> · #comments"><?php comments_number('No Comments', '1 Comment', '% Comments'); ?></h4>
Hope that helps.