Feedbacker reuse the security of the hosted SharePoint web.  
It doesn't create any new security groups, either breaks permissions on any items.  
Only the Feedback list has one specific: users with Design permission level or above (owners, site collection administrators) can see all items. 
The rest of the users will see only their own feedback.