I got into a dead end in a Bitcoin debate

I was talking with a friend about Bitcoin being awesome and stuff. And then he said that it being manipulated and controlled by whales. And I didn’t really have any good counter argument. I know it’s being manipulated so what is stopping the whales from not letting the market dicide what Bitcoin is worth?