You can do the basic HTTP access authentication from advance rest client as follows:
Add the Authorization header:
Header Forms --> ADD HEADER --> Begin typing in Authorization.

Add the basic auth info by clicking on the Edit (pencil) button on the right.
A form to fill credentials will pop up: 
Advanced REST Client will take care of encoding