I have 1 problem from assignment #4 solved and typeset and another solved in my head.

It took some reading of the textbook but I solved one problem and type set it now. I used our lectures on transient states and recurrent states and then the theorem about this in the book and solved the first problem. I also used the text book to solve another problem but have not actually calculated the solution yet or typeset this problem yet. For both problems the answers are in the back of the book but I still need to show in my answers how to get to the answers in the back of the book.