Debit card plus some travellers cheques and some cash. Also use your visa for even better rates. Debit cards are safe to use, but visa is better. Depends on what you are paying for - some things require cash only, wink, wink.
ATM machines often rip people off.
Eventually the victim can get reimbursed by his home bank, but it's a long process.
Best to use ATMs during banking hours.
That way you can at least walk into the bank and complain about the transaction gone bad.
