It's honestly a lot like cornhole -- except that as the stone slides across the ice two sweeps stay abreast of it and vigorously brush just in front of it to control the amount friction and thus how far it glides. The person who slides the stone is called the thrower. The skipper, aka captain or skip, stands by the house and sets the strategy for the team, often by tapping the spot for the thrower to aim. A typical Olympic game lasts two hours and forty minutes. So, yes, it's long. Curling is called "Chess on ice" because of the insane amount of strategy involved, and each team is given 38 minutes just for strategy time per game.
How points work and other scoring rules
To score points, you must land your stone closer to the button than the opponent's stone. The different colors of the house are only to make it clearer where a stone lands; points only come relative to your opponent's stones. But only stones that settle inside the house count. Only one team can score per end, but it's possible to score two points or more if you have two stones closer to the button than your opponents stone, etc. The team that loses the round holds "hammer" (has the last shot) on the next round, which is the stronger position because you can knock their stones out of the way.