Following closely on the heels of Moose, Holding Inside the Sun was Greg's second solo release and again featured all-original material written while Greg was living in Burlington, Vermont and Fayetteville, Arkansas. Greg's approach on this album was to use more acoustic sounds and decrease the orchestration of his songs, while still presenting the listener with a rich aural experience. As on Moose, Greg sequenced all the drum parts using samples.
Holding Inside the Sun was originally distributed by MP3.com and wasn't commercially available until it was re-worked and released in 2024 in a combined package with the material from Moose.