Why does my SSIS package takes so long to execute?

I am fairly new creating SSISs; I have this SQL Server 2008 table called BanqueDetailHistoryRef containing 10,922583 rows.

I want to extract the rows that were inserted on a specific date (or dates) and insert them on a table on another server. I am trying to achieve this through a SSIS which diagram looks like this:

OLEDB Source (the table with the 10Million+ records) --> Lookup --> OLEDB Destination

On the look up I have set:

Now, the query (specified on the Lookup transformation):

SELECT * FROM BanqueDetailHistoryRef WHERE ValueDate = '2014-01-06';

Takes around 1 second to run through SQL Server Management Studio, but the described SSIS package is taking really long time to run (like an hour).

Why is causing this? Is this the right way to achieve my desired results?