Search Results for "regular expressions"

...It introduces request capture, browser and mobile traffic inspection, and core scraping libraries such as Requests, BeautifulSoup, Selenium, Appium, and Scrapy. Lessons also cover JSON parsing, regular expressions, concurrency, proxy usage, login handling, and CAPTCHA-related techniques. Data can be stored with CSV, MySQL, or MongoDB examples. More advanced material explores anti-scraping defenses, JavaScript analysis, WebSocket data, and distributed crawlers. The repository includes practical source-code examples for scraping several real-world websites and services.

...It accompanies a free course PDF and provides sample code for lessons organized across three weeks. Topics progress from basic syntax and command-line tools to HTTP requests, APIs, JSON, CSV, databases, scraping, regular expressions, proxies, and file handling. Later lessons cover domain research, document generation, charts, maps, web archives, dates, and simple web applications. The course is designed for investigators and researchers rather than people seeking comprehensive software-engineering training. Exercises emphasize modifying working examples and applying them to practical research tasks. ...

...Early lessons explain HTTP requests, request analysis, the Python Requests library, and common categories of extracted data. Separate chapters cover JSON processing and regular expressions for transforming responses into structured information. Practical exercises demonstrate crawlers for Douban movies, Baidu Tieba, and Baidu Translate. Broader project materials also address topics such as JavaScript reverse engineering, Selenium automation, OCR, MongoDB, and the Scrapy framework. Code demonstrations accompany the written lessons so readers can learn by modifying working examples. ...

Python scripts that eventually work. The goal is to put together helpful python libraries, at first to learn more about python. There will at least be a library to generate regular expressions and more should come later. The latest version of the code is available in code-git (code / svn is not maintained anymore)