Search Results for "regular expressions"

Scrapy is a fast, open source, high-level framework for crawling websites and extracting structured data from these websites. Portable and written in Python, it can run on Windows, Linux, macOS and BSD. Scrapy is powerful, fast and simple, and also easily extensible. Simply write the rules to extract the data, and add new functionality if you wish without having to touch the core. Scrapy does the rest, and can be used in a number of applications. It can be used for data mining, monitoring...

...It introduces request capture, browser and mobile traffic inspection, and core scraping libraries such as Requests, BeautifulSoup, Selenium, Appium, and Scrapy. Lessons also cover JSON parsing, regular expressions, concurrency, proxy usage, login handling, and CAPTCHA-related techniques. Data can be stored with CSV, MySQL, or MongoDB examples. More advanced material explores anti-scraping defenses, JavaScript analysis, WebSocket data, and distributed crawlers. The repository includes practical source-code examples for scraping several real-world websites and services.

...Early lessons explain HTTP requests, request analysis, the Python Requests library, and common categories of extracted data. Separate chapters cover JSON processing and regular expressions for transforming responses into structured information. Practical exercises demonstrate crawlers for Douban movies, Baidu Tieba, and Baidu Translate. Broader project materials also address topics such as JavaScript reverse engineering, Selenium automation, OCR, MongoDB, and the Scrapy framework. Code demonstrations accompany the written lessons so readers can learn by modifying working examples. ...

The 'filesysobjects' package provides cross-platform-utilities for path addresses of file like resources. This includes the search and navigation features on file system structures with the application of regular expressions for pathnames intermixed with globs. - filesysobjects - constants - filesysobjects.apppaths - application resource path processing - filesysobjects.paths - file systems path processing - filesysobjects.pathtools - search, enumeration, and iteration operations - filesysobjects.userdata - user directories - filesysobjects.osdata - OS directories - filesysobjects.configdata - config directories Supported platforms are: - Linux, BSD, Unix, Mac-OS/OS-X, and Windows - Python2.7, Python3.5+ Online documents: https://pyfilesysobjects.sourceforge.io/

TODOs is a small command-line utility to search TODO, FIXME and similar comments in project files. It is written in Python 3 and licensed under the terms of GNU GPL 3 license. Supported output formats are TXT, HTML and XML.

Python scripts that eventually work. The goal is to put together helpful python libraries, at first to learn more about python. There will at least be a library to generate regular expressions and more should come later. The latest version of the code is available in code-git (code / svn is not maintained anymore)

A general interface which loads programming demos from an XML file inspired by the gtk-demo program.

Regular expressions editor for Python. It is intended for Python programmers that use regular expressions. It has syntax highlighting, brace matching, results coloring, text zooming, RE insertions and more.

A regex tool -- A Python GUI for creating, testing and debugging regular expressions for the Python programming language. Kodos utilizes the pyqt library for it's interface. Screenshots available on project homepage.

Don't write that regex, grow it! Regex Garden aims to create a simple, easy-to-use graphical interface for building, testing, and debugging regular expressions. Simply stated, it's an IDE for your regular expressions.