Ok so I was able to get to the data without additional tools.Lucky?Maybe :) Took some sleuthing, but here's how I got to what I needed for the example above:
I guess when there's a will, there's a way!
Thanks a lot@revesz.My Python skills are...uhm..copy & paste mostly :) So I would definitely appreciate you sharing any of your content and perhaps use it to learn more.My goal for this project is to scrape the text to know when a new version of the software is available.I have done this on other sites but they either have some table exposed and I can get that directly in FME, or there is an API available which I was able to figure out from the page source itself.
Unfortunately it is a task of a web browser or at least a rendering engine.
There are Python solutions to call a browser to do the rendering stuff and get the requied information from the rendered DOM.
One of them is theSelenium package.It can even call web browsers in headless mode.A headless Chrome discussion is here as astarting point.
This solution requires toinstall the package in FME pythonandChromedriverexecutable to a folder which is visible by the Python script.
I'm working on a rendering solution but it is not a high priority so it may take a week ir so, however I'm happy to share it when it is reasonably stable.