Hmm, I can NOT reproduce that.
I tried with existing contacts with or without InfoLog entries attached, and a newly created contact.
In all case I got either no entries or just the ones linked to that contact.
How do you open the CRM view, explicitly via context menu CRM view > InfoLog contact, or view double click on the contact (which opens your preferred CRM type)?
In the later case and with InfoLog Organisation preferred (or using the context menu CRM view > InfoLog Organisation), AND a contact with an empty organization field, I get all InfoLogs. Maybe that is your problem 
Ralf