San Luis Obispo is 30 minutes south of Paso Robles. You should definitely add it to your itinerary as a side trip or as you drive to or from Paso Robles. Here is what I found and recommend:
Apple Farm Restaurant & Bakery: At 2015 Monterey St, this restaurant, right out of the 70s in terms of decor, is a good place for lunch. I had a very good Asian chicken salad before heading downtown to explore. It is part of the Apple Farm Inn which has a number of lodging options.
Friends recommend the kitchy Madonna Inn where you can stay in themed rooms, eat at the Copper Cafe and enjoy their bakery.
I recently read about the opening of a new hotel, the Hotel San Luis Obispo, a modern, urban resort with beautiful, contemporary rooms, a spa and two bars and two restaurants. It is owned by the same group that has the Hotel Healdsburg, h2hotel and the Harmon Guesthouse in Healdsburgh. I will definitely stay there on my next trip to the area.
The downtown area has some interesting restaurants, galleries and shops to explore. I really liked the cafes along the river and seeing the historic buildings.
Mission San Luis Obispo de Tolosa: Located in the center of downtown, this is one of the famous California Missions founded by Fr. Junipero Serra. The Mission in San Luis Obispo was founded in 1772 and restored fully in 1930s. The church is well-worth the visit.
San Luis Obispo Museum of Art: Located at 1010 Broad St., this is a small art museum that has exhibitions with a mix of painting, sculpture, fine craft, printmaking and photography in three galleries. Keep your eyes open for public art in the downtown area and throughout other parts of the city.
South of San Luis Obispo is the Edna Valley where you will find close to 13 wineries to explore.