You are absolutely right, a load factor of greater than 1 is impossible to avoid in a proper barrel roll. The barrel part of its name comes from the spiral path the aircraft needs to perform in order to add a centrifugal acceleration which is greater than gravitational acceleration at the top of the roll. This is the condition to ensure a still positive normal load factor in the reference system of the aircraft through the whole roll. Therefore, at the bottom of the roll the normal acceleration needs to be greater than 2 g.
I took the liberty to edit the wrong answer. Given that it has received 14 upvotes at this time, it should teach everyone around here a lesson how much to rely on the number of votes to assess the correctness of an answer ;-).