Based on the specs on the Amazon page, its a low-end bike with cost-conscious components.
A quick google returns reviews like https://www.bikeride.com/takara-sugiyama/ that say things like "brakes are underpowered" suggests it is an endemic problem with this bike.
Some cheap/no-cost things you can try:
- Clean the brake pad's surface - pick out any fragments of metal especially, and remove grit. There may be some valleys that help cleaning, clean them out too. Two pads in each caliper for a total of 4.
- Scuff the pads - if the braking surface is glazed and hardened then it won't grip well.
- Align the brake pads properly with the rim. They should not hang off the edge and must not contact the tyre, but higher on the rim will provide better leverage.
- Clean the rims. It is possible there are contaminants from manufacturing, or road salt/grit on the surface. Warm water with a little detergent helps, then rinse well with cold.
- Check the gaps - presuming the wheels are true, there should be minimal gap between the pads and the rim at all times, just enough to let the rim pass through without rubbing. This is adjusted by altering the barrel ad the top of each caliper, and another one on the end of each brake lever.
Things to try that cost money:
NEW BRAKE PADS is the single best thing you can to do improve brake performance. I personally prefer Kool Stop, which are excellent. Cheap brake pads are no good at all.
Replace the levers with metal ones. From the look of the photo, the levers are plastic, and will have flex.
Replace the calipers - they appear to be stamped metal. These would be fine on a child's bike, but not stopping an adult going down a hill at speed.
Replace the rims - if they're slippery then a light scuff may help tooth the brake track, but ultimately you need more friction.
Another serious point is Method - if you're not using the front brake, then you're not braking efficiently. The most braking you can get out of a bike is "as much front brake as possible until the rear wheel starts to slide"
If you're only using the rear brake, change your method.
If you are worried about going Over The Bars, learn to shift your weight backward when braking hard. Lock your elbows, lower your head, and stick your butt back like you're mooning the rider behind you. This lets you brake more and harder.
Smittay raises a good point. You could spend much more on making this bike work better than it would cost to buy a bike with better components.
This trendy fixie can be on-sold to offset the cost of a better bike that is more-capable of hills, to someone who only wants to putter 300 metres down a flat road to a coffee shop.
Next time you buy a bike, get a test ride in before committing. I suspect you bought this bike sight-unseen, which is always a gamble.
If you're truly committed to making this bike better, its going to cost money and you'll need to get your hands dirty. If you feel uncomfortable with tools and expect a bike mechanic to do the work, then the cost equation blows out very quickly.