If you're happy with it, go for it. Back in the 1980s, that's basically what they said when most commercial wine was filtered through asbestos. Unknown to many, the wine industry was one of the last to clean up the asbestos in its act.
One of the chief sources of carrageenan is "Irish moss," which is actually a red algae. Carrageenan is 55% of Irish moss. See:
http://en.wikipedia.org/wiki/Chondrus_crispus
Here is the derivative carrageenan link:
http://en.wikipedia.org/wiki/Carrageenan
Article:
http://www.drweil.com/drw/u/QAA401181/Is-Carrageenan-Safe.html
Research paper:
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1242073/
See the selected references in that paper for additional applicable research papers.
I would note that carrageenan is being removed from cosmetics and supplements by reputable companies so fast it will make your head spin.
I've also been told that research shows chitosan won't cause shellfish reactions, but I know that to be untrue by experience. And behold, there is a clinical trial underway:
https://clinicaltrials.gov/ct2/show/NCT02151279