Not really because you need to define the level of harmfulness. Almost all drugs are harmful to some extent, but for some reason people are more worried about vaccines than drugs, perhaps because they come in a needle
Let's say they found out a drug tomorrow that can cure ME/CFS in 90% of people in a single dose, but it also has some aluminum or uranium (pick whatever harmful substance) in it. If the concentration of that harmful substance was low enough, I bet almost everyone on this forum would be queuing up for that drug.
Speaking of vaccine risks, aluminum isn't the main concern with a new vaccine, there are far bigger (potential) risks. For example, a component in the H1N1 vaccine caused a small minority of young adults to develop narcolepsy. It wasn't due to aluminum or any adjuvant, it was the active ingredient, a viral protein, that triggered an autoimmune reaction for some unlucky people. Now that's a real concern, but that's why you need to have vaccines carefully tested in large trials before mass vaccination starts.