0 votes
1 view
in RPA by (5.3k points)

I have situation where I want to scrape a profile of a company for example with 20 / 30 different attributes layout on one page, save each of those elements as a column title, and paginate through a directory and build a table with each page as a row, and the columns being the various data points (that all have different tags on the same page, but are consistent across different pages)

Right now I have been going through laborious process of copying text and using UI explorer to find an element, which is a real pain compared to the screen scraping wizard.

below is a link to a profile on test for example, the tags on the page are all different, but if I want to scrape another page, the tags will be the same, so can paginate through and create a really valuable table of all these companies.


Ref : https://forum.uipath.com/t/web-scraping-for-details-not-a-list-table/68802

but here is not solution

1 Answer

0 votes
by (9.5k points)

if you are confused about starting point, go to  https://github.com/UiPath/ReFrameWork

try this process instead: 

make a list of companies in an excel file or in an orchestrator queue. then open login and read data in excel and use looping Navigate to company page by appending baseURL
(https://www.owler.com/company) with the name of the company read from
excel row/queue transaction and use navigate to activity (https://activities.uipath.com/docs/navigate-to) to go to that page. Use anchor base activity (https://activities.uipath.com/docs/anchor-base) with a fixed element to get the value that you want. and Write the scraped data to your excel file

Related questions

0 votes
1 answer
asked Jul 25, 2019 in RPA by noah kapoor (5.3k points)
0 votes
1 answer
0 votes
1 answer
Welcome to Intellipaat Community. Get your technical queries answered by top developers !