streamparse

Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.

Github星跟蹤圖

|logo|

|Build Status|

Streamparse lets you run Python code against real-time streams of data via
Apache Storm. With streamparse you can create Storm bolts and spouts in
Python without having to write a single line of Java. It also provides handy
CLI utilities for managing Storm clusters and projects.

The Storm/streamparse combo can be viewed as a more robust alternative to Python
worker-and-queue systems, as might be built atop frameworks like Celery and RQ.
It offers a way to do "real-time map/reduce style computation" against live
streams of data. It can also be a powerful way to scale long-running, highly
parallel Python processes in production.

|Demo|

Documentation

  • HEAD <http://streamparse.readthedocs.org/en/master/>_
  • Stable <http://streamparse.readthedocs.org/en/stable/>_

User Group

Follow the project's progress, get involved, submit ideas and ask for help via
our Google Group, streamparse@googlegroups.com <https://groups.google.com/forum/#!forum/streamparse>__.

Contributors

Alphabetical, by last name:

  • Dan Blanchard (@dsblanch <https://twitter.com/dsblanch>__)
  • Keith Bourgoin (@kbourgoin <https://twitter.com/kbourgoin>__)
  • Arturo Filastò (@hellais <https://github.com/hellais>__)
  • Jeffrey Godwyll (@rey12rey <https://twitter.com/rey12rey>__)
  • Daniel Hodges (@hodgesds <https://github.com/hodgesds>__)
  • Wieland Hoffmann (@mineo <https://github.com/mineo>__)
  • Tim Hopper (@tdhopper <https://twitter.com/tdhopper>__)
  • Omer Katz (@thedrow <https://github.com/thedrow>__)
  • Aiyesha Ma (@Aiyesha <https://github.com/Aiyesha>__)
  • Andrew Montalenti (@amontalenti <https://twitter.com/amontalenti>__)
  • Rohit Sankaran (@roadhead <https://twitter.com/roadhead>__)
  • Viktor Shlapakov (@vshlapakov <https://github.com/vshlapakov>__)
  • Mike Sukmanowsky (@msukmanowsky <https://twitter.com/msukmanowsky>__)
  • Cody Wilbourn (@codywilbourn <https://github.com/codywilbourn>__)
  • Curtis Vogt (@omus <https://github.com/omus>__)

Changelog

See the releases <https://github.com/Parsely/streamparse/releases>__ page on
GitHub.

Roadmap

See the Roadmap <https://github.com/Parsely/streamparse/wiki/Roadmap>__.

.. |logo| image:: https://raw.githubusercontent.com/Parsely/streamparse/master/doc/source/images/streamparse-logo.png
.. |Build Status| image:: https://travis-ci.org/Parsely/streamparse.svg?branch=master
:target: https://travis-ci.org/Parsely/streamparse
.. |Demo| image:: https://raw.githubusercontent.com/Parsely/streamparse/master/doc/source/images/quickstart.gif

主要指標

概覽
名稱與所有者pystorm/streamparse
主編程語言Python
編程語言Shell (語言數: 3)
平台
許可證Apache License 2.0
所有者活动
創建於2014-05-02 20:33:50
推送於2024-08-09 15:10:50
最后一次提交
發布數48
最新版本名稱v5.0.1 (發布於 2024-08-09 11:10:36)
第一版名稱v0.0.6 (發布於 )
用户参与
星數1.5k
關注者數100
派生數218
提交數1.1k
已啟用問題?
問題數329
打開的問題數58
拉請求數142
打開的拉請求數0
關閉的拉請求數34
项目设置
已啟用Wiki?
已存檔?
是復刻?
已鎖定?
是鏡像?
是私有?