Browsing the shelves is a great way to find books! You will find a good collection of books about Japanese language learning on the second floor of the library in the PL501 - PL699 section.
To find books and e-books in Japanese, use the advanced search on LibrarySearch, select Library Catalog, then filter by Japanese language.