Some bad sites have links to upper-cased domains, or with explicit port
(while it's the default port), which forces URL instances to handle
explicitly those cases. Now, the URLs passed to open() are normalized
before being used.

Since is_here is called with all kwargs, we must add the same parameters than go()
to treat this parameter correctly.

TODO this is less efficient on python2

Some functions changed return type from python2 to python3

TODO: not everything is tested, a full review is needed + run is needed

It fixes several modules crashes when there is this kind of code:

def open(self, *args, **kwargs):
    if isJSON(kwargs.get('data')):
        kwargs['data'] = json.dumps(kwargs['data'][1])
        if 'headers' not in kwargs:
            kwargs['headers'] = {}
        kwargs['headers']['Content-Type'] = 'application/json'

Adrien CLERC authored May 20, 2016 and Romain Bignon committed May 20, 2016

url.build can fail, as parameters are popped from the dict.

HEAD responses have no content, so it doesn't make sense to build
Pages out of them.

flake8 --select W391,E302,E301,E304

autopep8 can't fix W391 even though it claims it can.
Fixed using a simple custom script.

weboob.tools.browser -> weboob.deprecated.browser
weboob.tools.parsers -> weboob.deprecated.browser.parsers
weboob.tools.mech -> weboob.deprecated.mech
weboob.browser2 -> weboob.browser
weboob.core.exceptions -> weboob.exceptions

Also, the new tree for browser2 is:

weboob.browser: import weboob.browser.browsers.* and weboob.browser.url.*
weboob.browser.browsers: all browsers (including PagesBrowser and LoginBrowser)
weboob.browser.url: the URL class
weboob.browser.profiles: all Profile classes
weboob.browser.sessions: WeboobSession and FuturesSession
weboob.browser.cookies: that's a cookies thing
weboob.browser.pages: all Page and derivated classes, and Form class
weboob.browser.exceptions: specific browser exceptions
weboob.browser.elements: AbstractElement classes, and 'method' decorator
weboob.browser.filters.*: all filters