Hey Silja, thanks for your comment.

In this case using merge is not suitable because we it requires to have a "unique_key" to compare new rows to check if it is repeated. I spent quite some time creating a column to do so, but I abandoned that approach because of the cost implications. If you merge but still look at all the table, you will be querying the whole table every time, which is slow and expensive.