I thought that once I did an inner join that the resulting number of rows would be a limiting factor
No. Adding a left outer join to a query will not
decrease the number of rows returned. But it could
increase the number or rows returned if the outer join condition results in a one-to-many match.