Web Interaction (Labs) Extension for Web Scraping – Capabilities and Limitations

Hello KNIME Community,

I used to perform web scraping with Selenium, thanks to a generous license provided during my studies. However, my license recently expired, and since I am currently seeking a job, I cannot afford a paid subscription.

I would like to continue using my workflows that rely on Selenium, and I recently discovered the free Web Interaction (Labs) extension. I am curious about the capabilities of this extension for web scraping tasks.

Specifically, I would like to know if the following actions are possible:

• Logging in with username and password

• Navigating through multiple pages

• Applying filters

Additionally, I have encountered websites that require more advanced handling, such as:

• Looping over the last element and repeating the process because the DOM only displays part of the data

• Handling infinite scrolling to extract all available information

Does the Web Interaction (Labs) extension support these kinds of interactions, or is it more suitable for static pages without complex dynamic elements?

I appreciate any insights or experiences you can share.

Thank you for your help!

Best regards,