Of course, these buses should be accessible from Horten and other cities along E18 as well... Which means you can take one of the ferries, and then jump on a bus. There might be some booking rules, I'm not sure.

I might be stupid to ask, but... You have checked with https://www.welcomeair.com/ right? They fly from Gothenburg to Kristiansand app. four times a week.