ntome authored Sep 01, 2020 and hydrargyrum committed Sep 09, 2020

It's not an optional or costly dependency.

ntome authored Aug 26, 2020 and hydrargyrum committed Sep 09, 2020

Though a BOM makes no sense in UTF-8, some sites insisting on sending one
with JSON data... Drop it then, as standard "json" module fails when it
is present anyway.

ntome authored Aug 18, 2020 and hydrargyrum committed Aug 26, 2020

When enabled, the documents is pre-processed so all links of the page are
made absolute using the <base> href (if present) or the page URL.

AbsoluteLink becomes pointless when this option is enabled. It's not enabled
by default as it would break some existing XPaths like:

    starts-with(@HRef, "/foo")

Axel Pelerin authored Aug 12, 2020 and hydrargyrum committed Aug 26, 2020

If we try to create an AbstractPage of another one, the class inherited
will be AbstractPage, in consequence Page. Therefore we need to recursively handle the inheritance.

Florian Duguet authored Feb 21, 2020 and hydrargyrum committed Mar 05, 2020

this is useful when we need to override the xpath

Lucas Ficheux authored Dec 06, 2019 and hydrargyrum committed Dec 18, 2019

Previously custom headers from Form.submit()'s kwargs weren't added
to the request's headers.

That's because the Form.request property already built a
requests.Request object and Browser.build_request() down the line would
not add any headers (except the referer) to an already built
requests.Request object.

So now the headers (if any are provided to Form.submit() as keyword
arguments) are added in Form.request() to avoid modifying low
level behaviour such as Browser.build_request().

Laurent Bachelier authored Oct 01, 2019 and hydrargyrum committed Nov 30, 2019

Sometimes it is lowercase, uppercase, or even bytes instead of unicode
strings!
This removes a warning under Python 3.

Guillaume Risbourg authored Nov 12, 2019 and hydrargyrum committed Nov 20, 2019

The URL `https://people.symlink.me/~rom1` has been changed to `https://romain.bignon.me/`.

Léo Yvin authored Sep 09, 2019 and hydrargyrum committed Oct 23, 2019

Abstractxxx objects way to override __new__ is broken in python3:
any instanciations with arguments after first one trigger a TypeError
(object.__new__() takes exactly one argument).
Linked discussion: https://bugs.python.org/issue25731[p3]

Victor Kannemacher authored Sep 18, 2018 and Romain Bignon committed Oct 09, 2018

python3 requires str, but python2 requires bytes.

Sylvie Ye authored Apr 23, 2018 and Romain Bignon committed May 05, 2018

The '|' in xpath list all matched elements.
Add xpath function to get only the first non empty element like 'or' statement

hydrargyrum authored Feb 10, 2018 and Romain Bignon committed Mar 03, 2018

LoginPage is rather a mixin, since subclassing LoginPage will most
likely require to subclass a Page class anyway (like HTMLPage).

Should help fixing https://git.weboob.org/weboob/devel/issues/100 and
https://git.weboob.org/weboob/stable/issues/4.

ntome authored Nov 29, 2017 and Romain Bignon committed Dec 03, 2017

It works like re.search. The flags parameter is not supported yet.

ntome authored Jul 06, 2017 and Romain Bignon committed Jul 08, 2017

object.__new__ only takes one argument: the class to construct.
It accepts more arguments only if __init__ is not overloaded, but it
is overloaded in Abstract*'s parent classes, so don't pass more args.

In Python 2, it was just deprecated, in Python 3, it doesn't work.

ntome authored Jul 05, 2017 and Romain Bignon committed Jul 08, 2017

The use of metaclass is not required for constructing the dict of URLs.

Plus, it prevents changing the class hierarchy at runtime, which could
be an improvement for AbstractBrowser.

baptiste delpey authored Jun 21, 2017 and Romain Bignon committed Jul 08, 2017

This reverts commit d0a2a6bbe3054a4cb34cf8d5b0bac7e93ac3d509.

raise_from wraps the Python3 syntax "raise exc from cause" which is useful
when an exception is raised to wrap a lower-level exception.

Some functions changed return type from python2 to python3

TODO: not everything is tested, a full review is needed + run is needed

With: futurize -w -1 weboob

Vincent Ardisson authored Jan 25, 2017 and Romain Bignon committed Jan 28, 2017

PartialHTMLPage tries to use vanilla HTMLPage first, then resorts to
encapsulate content in a fake root.
However, with empty (or whitespace only) content, lxml raises an
AssertionError. Just skip HTMLPage in this case.

hydrargyrum authored Jan 24, 2017 and Romain Bignon committed Jan 25, 2017

Since Python 2.7 is the minimum version supported,
collections.OrderedDict is guaranteed to exist and there is no need to
reimplement it.

Vincent Ardisson authored Dec 13, 2016 and Romain Bignon committed Dec 24, 2016

Some requests return partial HTML, that should be inserted in an
existing HTML body, but it can't be parsed with HTMLPage since it may
contain multiple roots. This new Page type just encapsulates the whole
content in a <html> tag in case of parsing error.

Vincent Ardisson authored Dec 09, 2016 and Romain Bignon committed Dec 24, 2016

When instanciating an abstract page, instead of creating a dynamic type,
we tweak the class inheritance and use normal instanciation.
This fixes URL.is_here().

Baptiste Delpey authored Nov 22, 2016 and Romain Bignon committed Dec 03, 2016

this enables to modify the request object of the form

Signed-off-by: Phyks (Lucas Verney) <phyks@phyks.me>