refactored out to function to allow multipages (#4)

[markman123]

Refactored out some of hte tasks to functions to allow for multipage... i've also allowed a limit of pages and made global variables for things that are re-used often

[funbeedev]

Lots of useful changes. But the error posted below needs to be addressed.

The error occurs whenever the popup appears when transitioning to the next page. The script will run until the popup appears.
For example, it could run up to page 5, but if the pop up appears on page 6 the error will occur and the program will stop without going through the remaining pages.

Can you run it several times to see if you also get the error? Thanks.

Traceback (most recent call last):
  File "job-search-web-scraping.py", line 77, in <module>
    indeed_job_search("machine learning", PAGES, PATH_TO_DRIVER)
  File "job-search-web-scraping.py", line 61, in indeed_job_search
    search_results = get_jobs(browser)
  File "job-search-web-scraping.py", line 40, in get_jobs
    return browser.find_elements_by_xpath("//h2/a")
  File "/home/user/.local/lib/python3.8/site-packages/selenium/webdriver/remote/webdriver.py", line 410, in find_elements_by_xpath
    return self.find_elements(by=By.XPATH, value=xpath)
  File "/home/user/.local/lib/python3.8/site-packages/selenium/webdriver/remote/webdriver.py", line 1005, in find_elements
    return self.execute(Command.FIND_ELEMENTS, {
  File "/home/user/.local/lib/python3.8/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute
    self.error_handler.check_response(response)
  File "/home/user/.local/lib/python3.8/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.InvalidSessionIdException: Message: Tried to run command without establishing a connection

[markman123]

Hmm, I put a function to handle the pop-up in there, will test again

[funbeedev]

@markman123 Any updates? :)