Its not an apartment building and it doesnt look like office building either. Does anyone know what is it?

-Formerly a grain elevator, this building was reconfigured into office space in 1986.

from emporis.com

was a grain storage silo.
Built too strong to knock down easily.
Top is (was ?) private residence
Silos may now be storage, possibly microfilm.

This may not still be true, I am basing this on memories of late 60's or early 70's.
60-70-memory ... rarely used in same sentence. LOL

Back in the early 80's, an architect/designer bought it and converted the top into a living space. He planted vines that trailed down the sides of the building. Eventually, he got bored of living there, sold it and moved to a private island in the Schuylkill (I kid you not).

Sounds like a cool story. Do you have the guy's name?

Sadly, I can't remember. There was an article about him in the Inquirer (probably a Sunday edition) back around the time that he moved out of the Granary (late 1980's). If you're really interested, you could search the back editions of the Inquirer at a library and you'll find it.

I remember as much as I do because I was fascinated by that building when I was young. When the guy was living there, it didn't have as many windows as it does now. He had a roof garden and had vines trailing down the sides of the building for several stories.

This article might be of some interest.

Interesting. A friend of mine worked at Granary Associates about 6 years ago and gave me a tour of the place. If you had a work station on the ground floor you actually had to go upstairs to use the restroom because that floor is below the level of the city sanitary sewer system.
It would be great if they could get a tenant who could utilize that viaduct right-of-way.

The granary was the headquarters of granary associates, an architecturer firm until recently, the 1st, 2nd and top floors were ohhice space, the rest of the building was hollow

When I lived on Shamokin (there were row houses where that parking lot is behind the Granary, and I lived in one of them), around 1975-76 it was a discotheque.