I can't really diagnose what is going on with your particular view if there is a filter not working, however, like I said exposed filters probably won't work for what you are trying to do.
You have to use real arguments. Passing arguments through panels to a view is tricky but it is doable. Passing exposed filters to a panel is not at all possible, so if panels are supposed to enter into this equation at any point in the project then you need to start with arguments from the start.
