html5lib-python

Standards-compliant library for parsing and serializing HTML documents and fragments in Python

  • 所有者: html5lib/html5lib-python
  • 平台:
  • 許可證: MIT License
  • 分類:
  • 主題:
  • 喜歡:
    0
      比較:

Github星跟蹤圖

html5lib

.. image:: https://travis-ci.org/html5lib/html5lib-python.svg?branch=master
:target: https://travis-ci.org/html5lib/html5lib-python

html5lib is a pure-python library for parsing HTML. It is designed to
conform to the WHATWG HTML specification, as is implemented by all major
web browsers.

Usage

Simple usage follows this pattern:

.. code-block:: python

import html5lib
with open("mydocument.html", "rb") as f:
document = html5lib.parse(f)

or:

.. code-block:: python

import html5lib
document = html5lib.parse("Hello World!")

By default, the document will be an xml.etree element instance.
Whenever possible, html5lib chooses the accelerated ElementTree
implementation (i.e. xml.etree.cElementTree on Python 2.x).

Two other tree types are supported: xml.dom.minidom and
lxml.etree. To use an alternative format, specify the name of
a treebuilder:

.. code-block:: python

import html5lib
with open("mydocument.html", "rb") as f:
lxml_etree_document = html5lib.parse(f, treebuilder="lxml")

When using with urllib2 (Python 2), the charset from HTTP should be
pass into html5lib as follows:

.. code-block:: python

from contextlib import closing
from urllib2 import urlopen
import html5lib

with closing(urlopen("http://example.com/")) as f:
document = html5lib.parse(f, transport_encoding=f.info().getparam("charset"))

When using with urllib.request (Python 3), the charset from HTTP
should be pass into html5lib as follows:

.. code-block:: python

from urllib.request import urlopen
import html5lib

with urlopen("http://example.com/") as f:
document = html5lib.parse(f, transport_encoding=f.info().get_content_charset())

To have more control over the parser, create a parser object explicitly.
For instance, to make the parser raise exceptions on parse errors, use:

.. code-block:: python

import html5lib
with open("mydocument.html", "rb") as f:
parser = html5lib.HTMLParser(strict=True)
document = parser.parse(f)

When you're instantiating parser objects explicitly, pass a treebuilder
class as the tree keyword argument to use an alternative document
format:

.. code-block:: python

import html5lib
parser = html5lib.HTMLParser(tree=html5lib.getTreeBuilder("dom"))
minidom_document = parser.parse("Hello World!")

More documentation is available at https://html5lib.readthedocs.io/.

Installation

html5lib works on CPython 2.7+, CPython 3.4+ and PyPy. To install it,
use:

.. code-block:: bash

$ pip install html5lib

Optional Dependencies

The following third-party libraries may be used for additional
functionality:

  • datrie can be used under CPython to improve parsing performance
    (though in almost all cases the improvement is marginal);

  • lxml is supported as a tree format (for both building and
    walking) under CPython (but not PyPy where it is known to cause
    segfaults);

  • genshi has a treewalker (but not builder); and

  • chardet can be used as a fallback when character encoding cannot
    be determined.

Bugs

Please report any bugs on the issue tracker <https://github.com/html5lib/html5lib-python/issues>_.

Tests

Unit tests require the pytest and mock libraries and can be
run using the py.test command in the root directory.

Test data are contained in a separate html5lib-tests <https://github.com/html5lib/html5lib-tests>_ repository and included
as a submodule, thus for git checkouts they must be initialized::

$ git submodule init
$ git submodule update

If you have all compatible Python implementations available on your
system, you can run tests on all of them using the tox utility,
which can be found on PyPI.

Questions?

There's a mailing list available for support on Google Groups,
html5lib-discuss <http://groups.google.com/group/html5lib-discuss>,
though you may get a quicker response asking on IRC in #whatwg on irc.freenode.net <http://wiki.whatwg.org/wiki/IRC>
.

主要指標

概覽
名稱與所有者html5lib/html5lib-python
主編程語言Python
編程語言Python (語言數: 3)
平台
許可證MIT License
所有者活动
創建於2013-04-09 14:07:42
推送於2024-02-27 19:49:36
最后一次提交2024-02-21 16:31:38
發布數27
最新版本名稱1.1 (發布於 )
第一版名稱0.2 (發布於 )
用户参与
星數1.2k
關注者數50
派生數295
提交數1.6k
已啟用問題?
問題數258
打開的問題數81
拉請求數162
打開的拉請求數9
關閉的拉請求數151
项目设置
已啟用Wiki?
已存檔?
是復刻?
已鎖定?
是鏡像?
是私有?