Repository navigation

PythonTo-repeat-the-text-Bigdata

Public

About

Python脚本实现千万级文本数据快速去重

19 stars

1 watching

Report repository

Name		Name	Last commit message	Last commit date
README.md		README.md
Remove_Duplicates.py		Remove_Duplicates.py
phone_search.py		phone_search.py
see_what.py		see_what.py

Repository files navigation

PythonTo-repeat-the-text-Bigdata

Remove_Duplicates.py : Python脚本实现千万级文本数据快速去重

see_what.py :仅查看大文本内部数据样式

pthone_search.py :定向检测是否存在特定phone泄露数据

About

Python脚本实现千万级文本数据快速去重

19 stars

1 watching

Report repository

Releases

Packages

Contributors

Languages