资讯专栏INFORMATION COLUMN

Awesome Python II

lx1036 / 2564人阅读

摘要:

Caching

Libraries for caching data.

Beaker - A library for caching and sessions for use with web applications and stand-alone Python scripts and applications.

dogpile.cache - dogpile.cache is next generation replacement for Beaker made by same authors.

HermesCache - Python caching library with tag-based invalidation and dogpile effect prevention.

django-cache-machine - Automatic caching and invalidation for Django models through the ORM.

django-cacheops - A slick ORM cache with automatic granular event-driven invalidation.

johnny-cache - A caching framework for django applications.

django-viewlet - Render template parts with extended cache control.

pylibmc - A Python wrapper around the libmemcached interface.

Email

Libraries for sending and parsing email.

inbox.py - Python SMTP Server for Humans.

imbox - Python IMAP for Humans.

inbox - The open source email toolkit.

lamson - Pythonic SMTP Application Server.

flanker - A email address and Mime parsing library.

marrow.mailer - High-performance extensible mail delivery framework.

django-celery-ses - Django email backend with AWS SES and Celery.

modoboa - A mail hosting and management platform including a modern and simplified Web UI.

envelopes - Mailing for human beings.

mailjet - Mailjet API implementation for batch mailing, statistics and more.

Talon - Mailgun library to extract message quotations and signatures.

pyzmail - Compose, send and parse emails.

Internationalization

Libraries for woking with i18n.

Babel - An internationalization library for Python.

Korean - A library for Korean morphology.

URL Manipulation

Libraries for parsing URLs.

furl - A small Python library that makes manipulating URLs simple.

purl - A simple, immutable URL class with a clean API for interrogation and manipulation.

pyshorteners - A pure Python URL shortening lib.

short_url - Python implementation for generating Tiny URL and bit.ly-like URLs.

webargs - A friendly library for parsing HTTP request arguments, with built-in support for popular web frameworks, including Flask, Django, Bottle, Tornado, and Pyramid.

HTML Manipulation

Libraries for working with HTML and XML.

BeautifulSoup - Providing Pythonic idioms for iterating, searching, and modifying HTML or XML.

lxml - A very fast, easy-to-use and versatile library for handling HTML and XML.

html5lib - A standards-compliant library for parsing and serializing HTML documents and fragments.

pyquery - A jQuery-like library for parsing HTML.

cssutils - A CSS library for Python.

MarkupSafe - Implements a XML/HTML/XHTML Markup safe string for Python.

bleach - A whitelist-based HTML sanitization and text linkification library.

xmltodict - Working with XML feel like you are working with JSON.

xhtml2pdf - HTML/CSS to PDF converter.

untangle - Converts XML documents to Python objects for easy access.

Web Crawling

Libraries for scraping websites.

Scrapy - A fast high-level screen scraping and web crawling framework.

portia - Visual scraping for Scrapy.

feedparser - Universal feed parser.

RoboBrowser - A simple, Pythonic library for browsing the web without a standalone web browser.

MechanicalSoup - A Python library for automating interaction with websites.

mechanize - Stateful programmatic web browsing.

Demiurge - PyQuery-based scraping micro-framework.

cola - A distributed crawling framework.

pyspider - A powerful spider system.

Web Content Extracting

Libraries for extracting web contents.

newspaper - News extraction, article extraction and content curation in Python.

html2text - Convert HTML to Markdown-formatted text.

python-goose - HTML Content/Article Extractor.

lassie - Web Content Retrieval for Humans.

micawber - A small library for extracting rich content from URLs.

sumy - A module for automatic summarization of text documents and HTML pages.

Haul - An Extensible Image Crawler.

python-readability - Fast Python port of arc90"s readability tool.

opengraph - A Python module to parse the Open Graph Protocol

textract - Extract text from any document, Word, PowerPoint, PDFs, etc.

sanitize - Bringing sanity to world of messed-up data.

Forms

Libraries for working with forms.

WTForms - A flexible forms validation and rendering library.

WTForms-JSON - A WTForms extension for JSON data handling.

Deform - Python HTML form generation library influenced by the formish form generation library.

django-bootstrap3 - Bootstrap 3 integration with Django.

django-crispy-forms - A Django app which lets you create beautiful forms in a very elegant and DRY way.

django-remote-forms - A platform independent Django form serializer.

Data Validation

Libraries for validating data. Used for forms in many cases.

voluptuous - A Python data validation library. It is primarily intended for validating data coming into Python as JSON, YAML, etc.

colander - A system for validating and deserializing data obtained via XML, JSON, an HTML form post or any other equally simple data serialization.

schema - A library for validating Python data structures.

Schematics - Data Structure Validation.

kmatch - A language for matching/validating/filtering Python dictionaries.

valideer - Lightweight extensible data validation and adaptation library.

Anti-spam

Libraries for fighting spam.

Stopspam - Intelligent spam detection for Python.

django-simple-spam-blocker - Simple spam blocker for Django.

django-simple-captcha - A simple and highly customizable Django app to add captcha images to any Django form.

Tagging

Libraries for tagging items.

django-taggit - Simple tagging for Django.

Admin Panels

Libraries for administrative interfaces.

Ajenti - The admin panel your servers deserve.

Grappelli – A jazzy skin for the Django Admin-Interface.

django-suit - Alternative Django Admin-Interface (free only for Non-commercial use).

django-xadmin - Drop-in replacement of Django admin comes with lots of goodies.

flask-admin - Simple and extensible administrative interface framework for Flask.

flower - Real-time monitor and web admin for Celery.

Static Site Generator

Static site generator is a software that takes some text + templates as input and produces html files on the output.

Pelican - Uses Markdown or ReST for content and Jinja 2 for themes. Supports DVCS, Disqus. AGPL.

Cactus – Static site generator for designers.

Hyde - Jinja2-based static web site generator.

Nikola - A static website and blog generator.

Tags - The simplest static site generator.

Tinkerer - Tinkerer is a blogging engine/.static website generator powered by Sphinx.

Processes and Threads

Libraries for woking with processes or threads

multiprocessing - (Python standard library) Process-based "threading" interface.

threading - (Python standard library) Higher-level threading interface.

envoy - Python Subprocesses for Humans™.

sh - A full-fledged subprocess replacement for Python.

sarge - A wrapper for subprocess.

Concurrency and Networking

Libraries for concurrency and network programming.

asyncio - (Python standard library in Python 3.4+) Asynchronous I/O, event loop, coroutines and tasks.

gevent - A coroutine-based Python networking library that uses greenlet.

Twisted - An event-driven networking engine.

Tornado - A Web framework and asynchronous networking library.

pulsar - Event-driven concurrent framework for Python.

diesel - Greenlet-based event I/O Framework for Python.

eventlet - Asynchronous framework with WSGI support.

pyzmq - A Python wrapper for the 0MQ message library.

txZMQ - Twisted based wrapper for the 0MQ message library.

Crossbar - Open-source Unified Application Router (Websocket & WAMP for Python on Autobahn).

WebSocket

Libraries for woking with WebSocket.

AutobahnPython - WebSocket & WAMP for Python on Twisted and asyncio.

WebSocket-for-Python - WebSocket client and server library for Python 2 and 3 as well as PyPy.

WSGI Servers

WSGI-compatible web servers.

wsgiref - (Python standard library) WSGI reference implementation, single-threaded.

Werkzeug - A WSGI utility library for Python that powers Flask and can easily be embedded into your own projects.

paste - Multi-threaded, stable, tried and tested.

rocket - Multi-threaded.

waitress - Multi-threaded, poweres Pyramid.

netius - Asynchronous, very fast.

gunicorn - Pre-forked, partly written in C.

fapws3 - Asynchronous (network side only), written in C.

meinheld - Asynchronous, partly written in C.

bjoern - Asynchronous, very fast and written in C.

RPC Servers

RPC-compatible servers.

SimpleXMLRPCServer - (Python standard library) Simple XML-RPC server implementation, single-threaded.

SimpleJSONRPCServer - This library is an implementation of the JSON-RPC specification.

zeroRPC - zerorpc is a flexible RPC implementation based on ZeroMQ and MessagePack.

Cryptography

PyCrypto - The Python Cryptography Toolkit.

Paramiko - A Python (2.6+, 3.3+) implementation of the SSHv2 protocol, providing both client and server functionality.

cryptography - A package designed to expose cryptographic primitives and recipes to Python developers.

PyNacl - Python binding to the Networking and Cryptography (NaCl) library.

hashids - Implementation of hashids in Python.

Passlib - Secure password storage/hashing library, very high level.

GUI

Libraries for working with graphical user interface applications.

PyQt - Python bindings for the Qt cross-platform application and UI framework, with support for both Qt v4 and Qt v5 frameworks.

PySide - Python bindings for the Qt cross-platform application and UI framework, supporting the Qt v4 framework.

wxPython - A blending of the wxWidgets C++ class library with the Python.

kivy - A library for creating NUI applications, running on Windows, Linux, Mac OS X, Android and iOS.

curses - Built-in wrapper for ncurses used to create terminal GUI applications.

urwid - A library for creating terminal GUI applications with strong support for widgets, events, rich colors, etc.

pyglet - A cross-platform windowing and multimedia library for Python.

Tkinter - Tkinter is Python"s de-facto standard GUI package.

enaml - Creating beautiful user-interfaces with Declaratic Syntax like QML.

Toga - A Python native, OS native GUI toolkit.

Game Development

Awesome game development libraries.

Pygame - Pygame is a set of Python modules designed for writing games.

Cocos2d - cocos2d is a framework for building 2D games, demos, and other graphical/interactive applications. It is based on pyglet.

PySDL2 - A ctypes based wrapper for the SDL2 library.

Panda3D - 3D game engine developed by Disney and maintained by Carnegie Mellon"s Entertainment Technology Center. Written in C++, completely wrapped in Python.

PyOgre - Python bindings for the Ogre 3D render engine, can be used for games, simulations, anything 3D.

PyOpenGL - Python ctypes bindings for OpenGL and it"s related APIs.

PySFML - Python bindings for SFML

RenPy - A Visual Novel engine.

Logging

Libraries for generating and working with log files.

logging - (Python standard library) Logging facility for Python.

logbook - Logging replacement for Python.

Sentry - A realtime logging and aggregation server.

Raven - The Python client for Sentry.

Testing

Libraries for testing codebases and generating test data.

Testing Frameworks

unittest - (Python standard library) Unit testing framework.

nose - nose extends unittest.

pytest - A mature full-featured Python testing tool.

mamba - The definitive testing tool for Python. Born under the banner of BDD.

contexts - A BDD framework for Python 3.3+. Inspired by C#"s Machine.Specifications.

pyshould - Should style asserts based on PyHamcrest.

pyvows - BDD style testing for Python. Inspired by Vows.js.

Web Testing

Selenium - Python bindings for Selenium WebDriver.

splinter - Open source tool for testing web applications.

locust - Scalable user load testing tool written in Python.

sixpack - A language-agnostic A/B Testing framework.

Mock

mock - A Python Mocking and Patching Library for Testing.

responses - A utility library for mocking out the requests Python library.

doublex - Powerful test doubles framework for Python.

freezegun - Travel through time by mocking the datetime module.

httpretty - HTTP request mock tool for Python.

httmock - A mocking library for requests for Python 2.6+ and 3.2+.

Code Coverage

coverage - Code coverage measurement.

Fake Data

faker - A Python package that generates fake data.

fake2db - Fake database generator.

mixer - Generating fake data and creating random fixtures for testing in Django ORM, SQLAlchemy, Peewee, MongoEngine, Pony ORM and etc.

model_mommy - Creating random fixtures for testing in Django.

ForgeryPy - An easy to use forged data generator for Python. It"s a port of forgery.

radar - Generate random datetime / time.

Error Handler

FuckIt.py - FuckIt.py uses state-of-the-art technology to make sure your Python code runs whether it has any right to or not.

Code Analysis and Linter

Libraries and tools for analysing, parsing and manipulation codebases.

Code Analysis

pysonar2 - A type inferencer and indexer for Python.

pycallgraph - A library that visualises the flow (call graph) of your Python application.

code2flow - Turn your Python and JavaScript code into DOT flowcharts.

Linter

Flake8 - The modular source code checker: pep8, pyflakes and co.

pylama - Code audit tool for Python and JavaScript.

Pylint - A source code analyzer.

Debugging Tools

Libraries for debugging code.

pdb - (Python standard library) The Python Debugger.

ipdb - IPython-enabled pdb.

winpdb - A Platform Independent Python Debugger with GUI.

pudb – A full-screen, console-based Python debugger.

pyringe - Debugger capable of attaching to and injecting code into Python processes.

python-statsd - Python Client for the statsd server.

memory_profiler - Monitor Memory usage of Python code.

profiling - An interactive Python profiler.

django-debug-toolbar - Display various debug information about the current request/response.

django-devserver - A drop-in replacement for Django"s runserver.

flask-debugtoolbar - A port of the django-debug-toolbar to flask.

pyelftools - A pure-Python library for parsing and analyzing ELF files and DWARF debugging information.

Science and Data Analysis

Libraries for scientific computing and data analyzing.

SciPy - A Python-based ecosystem of open-source software for mathematics, science, and engineering.

NumPy - A fundamental package for scientific computing with Python.

Numba - Python JIT (just in time) complier to LLVM aimed at scientific Python by the developers of Cython and NumPy.

NetworkX - A high-productivity software for complex networks.

Pandas - A library providing high-performance, easy-to-use data structures and data analysis tools.

Open Mining - Business Intelligence (BI) in Python (Pandas web interface)

PyMC - Markov Chain Monte Carlo sampling toolkit.

zipline - A Pythonic algorithmic trading library.

PyDy - Short for Python Dynamics, used to assist with workflow in the modeling of dynamic motion based around NumPy, SciPy, IPython, and matplotlib.

SymPy - A Python library for symbolic mathematics.

statsmodels - Statistical modeling and econometrics in Python.

astropy - A community Python library for Astronomy.

orange - Data mining, data visualization, analysis and machine learning through visual programming or Python scripting.

RDKit - Cheminformatics and Machine Learning Software.

Open Babel - A chemical toolbox designed to speak the many languages of chemical data.

cclib - A library for parsing and interpreting the results of computational chemistry packages.

Biopython - Biopython is a set of freely available tools for biological computation.

bccb - Collection of useful code related to biological analysis.

bcbio-nextgen - A toolkit providing best-practice pipelines for fully automated high throughput sequencing analysis.

blaze - NumPy and Pandas interface to Big Data.

Data Visualization

Libraries for visualizing data. See: awesome-javascript.

matplotlib - A Python 2D plotting library.

bokeh - Interactive Web Plotting for Python.

plotly - Collaborative web plotting for Python and matplotlib.

vincent - A Python to Vega translator.

d3py - A plottling library for Python, based on D3.js.

ggplot - Same API as ggplot2 for R.

Kartograph.py - Rendering beautiful SVG maps in Python.

pygal - A Python SVG Charts Creator.

pygraphviz - Python interface to Graphviz.

PyQtGraph - Interactive and realtime 2D/3D/Image plotting and science/engineering widgets.

Computer Vision

Libraries for computer vision.

OpenCV - Open Source Computer Vision Library.

SimpleCV - An open source framework for building computer vision applications.

Machine Learning

Libraries for Machine Learning. See: awesome-machine-learning.

scikit-learn - A Python module for machine learning built on top of SciPy.

pattern - Web mining module for Python.

NuPIC - Numenta Platform for Intelligent Computing.

Pylearn2 - A Machine Learning library based on Theano.

hebel - GPU-Accelerated Deep Learning Library in Python.

gensim - Topic Modelling for Humans.

PyBrain - Another Python Machine Learning Library.

Crab - A flexible, fast recommender engine.

python-recsys - A Python library for implementing a Recommender System.

vowpal_porpoise - A lightweight Python wrapper for Vowpal Wabbit.

MapReduce

Framworks and libraries for MapReduce.

PySpark - The Spark Python API.

dpark - Python clone of Spark, a MapReduce alike framework in Python.

luigi - A module that helps you build complex pipelines of batch jobs.

mrjob - Run MapReduce jobs on Hadoop or Amazon Web Services.

dumbo - Python module that allows one to easily write and run Hadoop programs.

streamparse - Run Python code against real-time streams of data. Integrates with Apache Storm.

Functional Programming

Functional Programming with Python.

fn.py - Functional programming in Python: implementation of missing features to enjoy FP.

funcy - A fancy and practical functional tools.

Toolz - A collection of functional utilities for iterators, functions, and dictionaries.

CyToolz - Cython implementation of Toolz: High performance functional utilities.

Third-party APIs

Libraries for accessing third party services APIs. See: List of Python API Wrappers and Libraries.

apache-libcloud - One Python library for all clouds.

boto - Python interface to Amazon Web Services.

twython - A Python wrapper for the Twitter API.

google-api-python-client - Google APIs Client Library for Python.

gspread - Google Spreadsheets Python API.

facebook-sdk - Facebook Platform Python SDK.

facepy - Facepy makes it really easy to interact with Facebook"s Graph API

gmail - A Pythonic interface for Gmail.

django-wordpress - WordPress models and views for Django.

DevOps Tools

Software and libraries for DevOps.

OpenStack - Open source software for building private and public clouds.

Ansible - A radically simple IT automation platform.

SaltStack - Infrastructure automation and management system.

Fabric - A simple, Pythonic tool for remote execution and deployment.

Fabtools - Tools for writing awesome Fabric files.

cuisine - Chef-like functionality for Fabric.

psutil - A cross-platform process and system utilities module.

pexpect - Controlling interactive programs in a pseudo-terminal like GNU expect.

provy - An easy-to-use provisioning system in Python.

honcho - A Python port of Foreman, a tool for managing Procfile-based applications.

gunnery - Multipurpose task execution tool for distributed systems with web-based interface.

fig - Fast, isolated development environments using Docker.

hgapi - Pure-Python API for Mercurial.

gitapi - Pure-Python API for git.

Job Scheduler

Libraries for scheduling jobs.

APScheduler - A light but powerful in-process task scheduler that lets you schedule functions.

django-schedule - A calendaring app for Django.

doit - A task runner/build tool.

Joblib - A set of tools to provide lightweight pipelining in Python.

Plan - Writing crontab file in Python like a charm.

Spiff - A powerful workflow engine implemented in pure Python.

schedule - Python job scheduling for humans.

TaskFlow - A Python library that helps to make task execution easy, consistent and reliable.

Foreign Function Interface

Libraries for providing foreign function interface.

ctypes - (Python standard library) Foreign Function Interface for Python calling C code.

cffi - Foreign Function Interface for Python calling C code.

SWIG - Simplified Wrapper and Interface Generator.

PyCUDA - A Python wrapper for Nvidia"s CUDA API.

High Performance

Libraries for making Python faster.

Cython - Optimizing Static Complier for Python. Uses type mixins to compile Python into C or C++ modules resulting in large performance gains.

PyPy - An implementation of Python in Python. The interpreter uses black magic to make Python very fast without having to add in additional type information.

Stackless Python - An enhanced version of the Python.

Pyston - A Python implementation built using LLVM and modern JIT techniques with the goal of achieving good performance.

Microsoft Windows

Python programming on Microsoft Windows.

pythonlibs - Unofficial Windows(32/64-bit) binaries for Python extension packages

Python(x,y) - Scientific-applications-oriented Python Distribution based on Qt and Spyder.

spyder - IDE for the Python language with advanced editing, interactive testing, debugging and introspection features (also comes with Anaconda).

Network Virtualization and SDN

Tools and libraries for Virtual Networking and SDN (Software Defined Networking).

Mininet - A popular network emulator and API written in Python.

POX - An open source development platform for Python-based Software Defined Networking (SDN) control applications, such as OpenFlow SDN controllers.

Pyretic - A member of the Frenetic family of SDN programming languages that provides powerful abstractions over network switches or emulators.

SDX Platform - SDN based IXP implementation that leverages Mininet, POX and Pyretic.

Hardware

Libraries for programming with hardware.

PyUserInput - A module for cross-platform control of the mouse and keyboard.

wifi - A Python library and command line tool for working with WiFi on Linux.

scapy - A brilliant packet manipulation library.

ino - Command line toolkit for working with Arduino.

Pyro - Python Robotics.

Compatibility

Libraries for migrating from Python 2 to 3.

Six - Python 2 and 3 compatibility utilities.

Python-Future - The missing compatibility layer between Python 2 and Python 3.

Python-Modernize - Modernizes Python code for eventual Python 3 migration.

Miscellaneous

Useful libraries or tools that don"t fit in the categories above.

pluginbase - A simple but flexible plugin system for Python.

itsdangerous - Various helpers to pass trusted data to untrusted environments.

blinker - A fast Python in-process signal/event dispatching system.

Pychievements - A framework for creating and tracking achievements.

Algorithms and Design Patterns

Python implementation of algorithms and design patterns.

python-patterns - A collection of design patterns in Python.

algorithms - module of algorithms for Python.

Editor Plugins

Plugins for editors and IDEs.

Vim

Python-mode - An all in one plugin for turning Vim into a Python IDE.

Jedi-vim - Vim bindings for the Jedi autocompletion library for Python.

YouCompleteMe - Includes Jedi-based completion engine for Python

Emacs

Elpy - Emacs Python Development Environment.

Sublime Text

SublimeJEDI - A Sublime Text plugin to the awesome autocomplete library Jedi.

Anaconda - Anaconda turns your Sublime Text 3 in a full featured Python development IDE.

Atom

Linter - A static code analysis tool for Atom.

Linter-flake8 - An addon to linter, that acts as an interface for flake8.

virtualenv - Atom package for virtualenv management.

Resources

Where to discover new Python libraries.

Websites

r/Python - News about Python.

Python 3 Wall of Superpowers - Too many popular Python packages don"t support Python 3.

Trending Python repositories on GitHub today - Good place to find new Python libraries.

Python Hackers - List of top 400 projects in GitHub.

CoolGithubProjects - Sharing cool github projects just got easier!

Full Stack Python - Plain English explanations for every layer of the Python web application stack.

Django Packages - A directory of reusable apps, sites, tools, and more for Django projects.

Weekly

Pycoder"s Weekly

Python Weekly

Import Python Newsletter

Twitter

@pypi

@planetpython

@getpy

@pycoders

@PythonWeekly

@pythontrending

Other Awesome Lists

List of lists.

Python

pycrumbs

pythonidae

python-github-projects

python_reference

easy-python

Monty

awesome-awesomeness

lists

Contributing

文章版权归作者所有,未经允许请勿转载,若此文章存在违规行为,您可以联系管理员删除。

转载请注明本文地址:https://www.ucloud.cn/yun/45362.html

相关文章

  • Evil Python

    摘要:用将倒放这次让我们一个用做一个小工具将动态图片倒序播放发现引力波的机构使用的包美国科学家日宣布,他们去年月首次探测到引力波。宣布这一发现的,是激光干涉引力波天文台的负责人。这个机构诞生于上世纪年代,进行引力波观测已经有近年。 那些年我们写过的爬虫 从写 nodejs 的第一个爬虫开始陆陆续续写了好几个爬虫,从爬拉勾网上的职位信息到爬豆瓣上的租房帖子,再到去爬知乎上的妹子照片什么的,爬虫...

    Turbo 评论0 收藏0
  • Python实用技法第31篇:文本过滤和清理

    摘要:上一篇文章实用技法第篇从字符串中去掉不需要的字符下一篇文章实用技法第篇对齐文本字符串问题某些无聊的脚本小子在页面表单中填入了这样的文本,我们想以某种方式将其清理掉。讨论文本过滤和清理的一个主要问题就是运行时的性能。 上一篇文章:Python实用技法第30篇:从字符串中去掉不需要的字符下一篇文章:Python实用技法第32篇:对齐文本字符串  问题 某些无聊的脚本小子在Web页面表单中...

    Bryan 评论0 收藏0
  • Python爬虫之用supervisor使scrapy在服务器后台运行

    摘要:折腾原因之前都是远程连接服务器,然后在命令行运行,一旦关闭远程连接,爬虫就会停止,很不爽,毕竟能让一个爬虫在服务器一直跑才是每个小白的梦想,所以开始研究如何使程序在后台运行,刚开始看了,感觉不好用,又搜了搜,发现了这个进程管理程序。 折腾原因 之前都是远程连接服务器,然后在命令行运行scrapy crawl spider,一旦关闭远程连接,爬虫就会停止,很不爽,毕竟能让一个爬虫在服务器...

    Turbo 评论0 收藏0
  • Awesome Python

    摘要:漢字拼音 Awesome Python A curated list of awesome Python frameworks, libraries and software. Inspired by awesome-php. Awesome Python Environment Management Package Management Package Repositorie...

    fizz 评论0 收藏0

发表评论

0条评论

最新活动
阅读需要支付1元查看
<