Weboob 1.3 (2017-09-20) General * Big step for python 3 full support (many patches to improve python3 support (core is compatible, a number of modules are compatible)) * New QGalleroob application for CapImage and CapGallery * New CapProfile capability (used in boobank for example) * Don't check updates of modules automatically (new --auto-update option) * Some code cleanups since python 2.6 is not supported * New bibliothequesparis module (CapBook) * New billetreduc module (CapCalendarEvent) * New blogspot module (CapMessages) * New bnppere module (CapBank) * New btpbanque module (CapBank) * New capeasi module (CapBank) * New cices module (CapBank) * New cityscoot module (CapDocument) * New cmes module (CapBank) * New cmmc module (CapBank, CapContact) * New ensap module (CapDocument) * New erehsbc module (CapBank) * New esalia module (CapBank) * New foncia module (CapHousing) * New lameteoagricole module (CapWeather) * New lampiris module (CapDocument) * New larousse module (CapTranslate) * New linebourse module (CapBank) * New myfoncia module (CapDocument) * New pixabay module (CapFile, CapImage) * New pradoepargne module (CapBank) * New ratp module (CapGauge) * New tumblr module (CapGallery) * New zerobin module (CapPaste) * Deleted champslibres module * Deleted citelis module * Deleted ovs module General: core * Use https for module updates by default * Real cleanup of modules folder in installation * Force utf-8 for backends config file encoding * API change: BrowserPasswordExpired exception now inherit from ActionNeeded (previously from BrowserIncorrectPassword ) * Print progress on stderr instead of stdout Documentation * Improved module guide Browser * Introduce weboob.browser.nss to replace OpenSSL by libnss * Add magic_highlight to open a browser showing an el * In debug, write html responses highlighting involved selectors when _highlight_el is set in backend config * Enable expiration duration on state * URL.open can take headers and methods, like URL.go * Support '*' special char in DictElement * Print session when debug is enabled * Rework of AbstractBrowser build * Support headers in stay_or_go method * Normalize URL before opening * Save content of response after headers, in case there is a crash during call of r.content Browser: Filters * Introduce filters.base, move or alias filters * Add AbsoluteLink filter * Add FormValue filter * Add HasElement filter * Add QueryValue filter * CleanText(children=False) now reads all text nodes, not just the first one * Allow for setting options on CleanHTML filter * Fix Type filter when data has already the right data type * Add debug() decorator to several filters Browser: Pages * Fix PartialHTMLPage in case of empty content * Fix off-by-one error skipping last row on XLSPage Old Browser * Remove support for older mechanize versions Tools: backend * Set fields to NotAvailable instead of NotLoaded when a module does not fill it after fill request. * New Module.get_proxy() method Tools * Remove weboob.tools.ordereddict since we now use python>=2.7 * Remove weboob.tools.compat.check_output since we now use python>=2.7 * Remove obsolete and unused weboob.tools.property * New ValueDate class * If a Value is required, it must be set to be valid (in configuration) * Value's regexp must now match until end of string Tools: pdf * get_pdf_rows now handles unsorted table lines * Support LTCurve objects and output debug images * Open method new read as bytes (windows support) Tools: media_player * Use requests instead of urllib2 Capabilities * Replace some Field objects by more specialized types (IntField, BoolField, etc) * DeltaField now accepts int and long for seconds * Copy() of BaseObject now copies fields CapBank * New steps/API to manage transfer (see do_add_recipient, new_recipient and add_recipient) * New CapBankTransferAddRecipient to filter out module without relevant methods * Use OrderedDict for currencies * Add better error codes for TransferError exception * Add Pocket class * Add Loan class to have more detailed info on loans (not printed today with boobank, only avaiable with weboob API) * New code_type field for Investment * Add basic tests for banking modules * Add sorted_transactions helper * New ISIN code checker CapHousing * New 'rooms' and 'bedrooms' and 'utilities' fields for Housing objects CapVideo * Introduce video.ytdl which uses youtube-dl Applications * Support --nss and 'use_nss' in config to replace OpenSSL by NSS * Allow user to use '~' when picking log file name * Honor quiet option for progress messages Applications: Qt * Add ResultModel for viewing objects hierarchies and FilterTypeMode * Some code cleanups/improvements * Quit faster by aborting running weboob backend calls * Limit results count in ResultsModel * Replace urllib.urlopen with requests.get * Do not keep references to main windows so that they can be garbage-collected Applications: boobank * Load config at startup * New error messages for TransferError childrens * Improve OFX formatter Applications: boobill * Reduce number of requests run by download command * Add optional PDF conversion on download Applications: boobcoming * Report CANCELLED status Applications: boobmsg * Add a few fillobj calls and export_thread support using numbers Applications: boobooks * Add a new "rented" command Applications: cookbook * Fix unicode comments display in python2 Applications: qcookboob * Fix unicode issues * Use ID as export filename default Applications: radioob * Fix playlist decoding Applications: videoob * Display xterm-256 color thumbnail * Decode utf-8 lines Formatters: csv * Use to_unicode() to be sure it does not fail * Fix unicode output in python2 Modules: 750g * fix recipe parsing because of website update Modules: adecco * fix parsing job location * fix mode site changed * Use weboob.tools.compat instead of urllib/urlparse Modules: afer * fix history parsing and transactions date * add certificate Modules: agendaculturel * Use weboob.tools.compat instead of urllib/urlparse Modules: agendadulibre * fix french region choice and use https Modules: allocine * fix get_movie_release and pep8 * bump to browser2 * Use weboob.tools.compat instead of urllib/urlparse Modules: allrecipes * Use weboob.tools.compat instead of urllib/urlparse Modules: amazon * don't crash anymore on broken links * Patch Amazon module * Bug fix in payment list (proper) * fix order not found crash * retry on TooManyRedirects error * fixed redirect loop error * use xpath "$vars" in a few modules Modules: amazonstorecard * Use weboob.tools.compat instead of urllib/urlparse Modules: ameli * detect more wrong password + improve login state management * fixing wrong regexp * Use weboob.tools.compat instead of urllib/urlparse * fix login validation URL * remove some useless ":443" in URLs since weboob normalizes them Modules: amelipro * Use weboob.tools.compat instead of urllib/urlparse * remove some useless ":443" in URLs since weboob normalizes them Modules: americanexpress * use url field instead of _link for Accounts * parse some other types of accounts * sort each transaction page to avoid sorting the whole list * set rdate to date * handle transactions as deferred * coding style * fix incorrect date (like 13th month) * fixing some accounts * fixing xpath on accounts2 * skip some canceled cards * port to python3 * fixing history and date on deferred * detect ActionNeeded * handle the new js site along with old site * add another fallback for fetching end_of_period Modules: amundi * detect NoAccountsException Modules: arte * do not crash if there is no video in creativ frame + improve test to handle this case * fix module / handle date not available in arte cinema json * do not handle arte-cinema program submenu * fix default 'quality' value * fix search and port to Python3 * base url changed * Use weboob.tools.compat instead of urllib/urlparse Modules: attilasub * Use weboob.tools.compat instead of urllib/urlparse Modules: audioaddict * fix Frescaradio + set a default test config in case no one exists * bump to browser2 / import unicode_literals * remove frescaradio / add classicalradio / There are No public stream available anymore (www.radiotunes.com/founder-letter) * fix type in tests Modules: aum * Use weboob.tools.compat instead of urllib/urlparse Modules: axabanque * avoid "is" comparison for strings * the history url is not fixed * axabanque : adding new browser to handle wealth part * fix: handle perp on wealth part * fix:: handle bank and wealth part at same time * fix: troubles on some accounts / ActionNeeded * when accounts have no detailed investments, just return empty * use io.BytesIO where deprecated StringIO module was used for bytes * investment uses dot decimals and date can be missing * do a get request to finish login * fixing account type with PEA * investments page changed * portfolio_share uses comma separator * Fix no account and get_form warning * fill the diff_percent instead of diff for life insurances * avoid relogin after visiting an erroneous wealth page * fix url for post * Fix recuperation value of invest * Fix open for personnal loan and label xpath * add isin_code to investments, add history for life insurance accounts * handle life insurance history this way only on main website * fixing navigation to get rights investments/history * deferred card transactions are now flagged as coming * improve pagination code * sometimes the pagination doesn't work at all * iter_coming is not implemented for wealth site * basic port to python3 * pagination of transaction history is broken Modules: banqueaccord * remove dummy test.py files as they are false negatives for weboob_lint * use io.BytesIO where deprecated StringIO module was used for bytes * html had 2 elements with same id * fix exception raised in case of wrong password length * fix raise BrowserIncorrectpassword * adding missing account type for several banks Modules: banquepopulaire * don't update with an empty token * handle new natixis life insurance website * fix iter_investement vdate on natixis json * set date for investment history and label * fix natixis json with missing date * some years do not exist as pdf, fallback on json * some invest history just have no label * don't raise when natixis site is broken * retry the backend method in case of unexpected logout * minor improvements on retry decorator * return investment history in reverse chronological order * add another url for natixis error pages * fetch quantity of history invest * skip transactions without date on natixis * handling empty page * adding advisor * fix 500 errors on natixis website * adding entry to match some loans * cleaner handling of website crash * detection of another pattern for error on page * fix saving accounts with investments * Raise BrowserUnvalaible when site does not work * use now linebourse module to handle more investments * remove liquidity + fetch balance with invests * [banquepop] natixis website might be broken * fix list command when investments not available * fix BrowserUnavailable. * [banquechaix/banquepopulaire] replace a website choice * modules: fix AbstractBrowser use * login changed * basic port to python3 * skip natixis accounts if website is broken * misc improvements * CardsPage changed a little * new natixis page * no coming on invest accounts * handle when card page has no cards * Add alternative to get card accounts currency * rewrite natixis pdf parsing * skip investment when account is unavailable Modules: barclays * support the revolving credit url * fix accounts balance parsing * fix rebuild data request when get iban. * Handle new website, add it to py3 compatible modules list * misc improvements * don't try to access loan accounts * fix parsing when there are 0 transactions Modules: bforbank * remove dummy test.py files as they are false negatives for weboob_lint * skip history and invest on not available market accounts * handle when spirica is broken * use io.BytesIO where deprecated StringIO module was used for bytes * handle logout when opening a spirica page * fetch deferred card transactions * fixing account type with PEA * handle transactions rdate * handle another login url * [ing/bforbank] use now ValueDate * adapt ValueDate formats * password can only contain digits * deferred debit card are now a separate account * fetch new coming page * recognize withdrawal transactions * pyflakes in bforbank * handle multiple immediates card on an account * don't generate card account if all cards are canceled * changes on deferred card summary transactions handling * skip not yet available cards * use url field instead of _link for Accounts in a few modules * [banquepopulaire][bforbank][bp] deinit sub-browsers * sometimes there are 2 "synthese-encours" * handle currency on deferred cards * change assertion to match multiple cards with 1 deferred * parse when multiple deferred cards one same checking account * modules: fix AbstractBrowser use * port to python3 * add another login url * add another life insurance url * use xpath "$vars" in a few modules * Get transactions of the day * remove some useless ":443" in URLs since weboob normalizes them * do "get today operations" only for checking accounts * add another url for errors on spirica login Modules: blablacar * fix module website changed * fix departure time parsing * Use weboob.tools.compat instead of urllib/urlparse Modules: bnporc * skip recipients without valid iban * fix bnporc bullshit * fetch waiting to be validated recipients * add_recipient * adding CapProfile to bnporc ent * fix empty recipient currency * use io.BytesIO where deprecated StringIO module was used for bytes * change exception for "1001" json code on login page * fixing wording for bnp enterprise * fix crash on not caught wrongpass * fixing account type with PEA * fix crash after password renewal * reject expired password if we won't be able to restore it * raise expired password when we can't apply temp password * use new TransferError codes in a few modules * use new TransferError subclasses in modules * adding perp type * handle pea account type * adding an account type * bnporc/entreprise: if label contains a date, use it for rdate * bnporc/entreprise: don't set coming transactions as deferred * ignore "sans suite" life insurance transactions * remove deprecated 'ppold' website * virtual keyboard has changed * fixing coming amount for enterprise accounts * update modules to use new CapBankTransferAddRecipient * don't get investments on liquidity accounts * added card account for entreprise site * raise NotImplementedError when profile is not available * fetch balance from market page and fix diff * entreprise:] fixing wrong amounts and date on cards * corrected useless pipe on password regex * remove enter/exit browser1 leftover * Add currency to card account * advisor page may be missing * Handle cards transactions as deferred * hellobank: raise ActionNeeded when bnporc pp should be used instead * bnporc entreprise: no more deferred_card transactions on checking account * entreprise: sometimes card date format has dots * add investments on PERP Modules: boursorama * skip external cards (amex cards here) * adding CapProfile to boursorama * use io.BytesIO where deprecated StringIO module was used for bytes * recognize another type of transfer * correctly type PEA account * card accounts, coming, card transactions * rdate is parsed by Raw and add new transaction pattern * fix cards number * fix date of card transactions * fix some cards where there is no info * get_history must return an iterable, not None * fix card number regexp * do not yield not activated cards * on card accounts, transactions should be TYPE_DEFERRED_CARD * retry to login when virtkeyboard process fails * stop crashing on obvious wrongpass * fix crash when job_start_date is unavailable * fetch pro accounts * handle other deferred cards * handle transfers * execute_transfer returns the passed Transfer * fixing card_summary on main account * fix coming and date of deferred_card trs * use new TransferError codes in a few modules * handle invests on PEA * use new TransferError subclasses in modules * adding advisor : hotline * implement adding recipients * remove useless config field * fix date of history of deffered_card * recognize more loan accounts + clean obj_type * fixing rdate on deferred cb * fix regexp on old versions * definitly fix rdate on deferred card * fix regexp on buggy python versions * use url field instead of _link for Accounts in a few modules * parse recipients bank_name * field webid with iban on new_recipient * fix recipient label regex pattern * update modules to use new CapBankTransferAddRecipient * fix label of external recipient (corner case) * improve condition to skip more summary in coming * create url object for PEP saving * fetch balance on pea and li from invs page * fix account type * create liquidity investment * load state only if double auth or add recipient * fix regexp to match summary * verify some kind of status page * search for danger instead of warning to raise Unavailable * fix wrongpass cornercase * the MarketPage history may have a different format * fix accounts parsing + typing * fix id transactions not being parsed * fix ord accounts typing * transaction id can be missing for coming transactions * sometimes data-deffered is just missing, drop the assert * fixed prelevement transaction amount being 0 * change typing for some accounts * port to python3 * now handle alpha password * handle alnum instead of digit + alpha * TableElement takes 2 a nodes and messes up label Modules: bouygues * remove dummy test.py files as they are false negatives for weboob_lint * Fix Bouygues module bills fetching for Internet clients * handle an insecure HTTP page to avoid BrowserHTTPSDowngrade * fix documents list * Fix ref can be not found, so add a condition before return the regex exp * fix wrongpass not detected sometime on backend or blackbox * Corrected subscription id duplication * Check if activation date is null * use xpath "$vars" in a few modules Modules: bp * sometimes, sending account id of transfer not present in recap * same id problem on recipient recap * new url for CheckPassword and use location instead of open * fix some internal recipients label * handle another change password url * use io.BytesIO instead of StringIO.StringIO * use io.BytesIO where deprecated StringIO module was used for bytes * pro, fix corrupted csv * set StatesMixin duration to 15 minutes * use new TransferError codes in a few modules * use new TransferError subclasses in modules * adding isin code on cachemire contract * handle one more deferred card url * fix handling pages with right classes * handle new par website * add cb deferred history and coming amount * get deferred card history, fix error when account has no balance * don't get shitty accounts on shitty page * account page is on error * fix empty wording on some transactions * fix coding style * fix detecting no accounts cases, and remove dead code * correctly handle multiple cards * do not consider hours in transaction labels * do not hardcode currency * ignore accounts without amount * fix cards crash when website is unavailable, and fix positive loans * fix crash on accounts without cards * really fix positive loans and remove useless code * now loan's history is not recovered * state duration of 5 minutes is enough * use exec_date field in transfer * fix no more history on pro website * avoid pro code in par browser * use linebourse browser for handling PEA accounts * fix date parsing for solesio life insurance * fix history and investment for cachemire and gmo life insurances * fixed browser unvailable error when getting deffered card account history * fix multiple recipients with same iban, and label parsing * use url field instead of _link for Accounts in a few modules * fix when transaction doesn't have investments attached * fix table with multiple invests on multiple spaces * more history for checking, savings and market accounts, fix wrong label for transactions * Bug #4020 - change url image * fix wrong iter_history method for non typed accounts * fixing login xpath and pattern * set_variables only needs a url, not a page * matching account types by label * fix crash during fetch of cards history (closes #4019) * [banquepopulaire][bforbank]deinit sub-browsers * [bp][pro] raise BrowserUnavailable on history page * corrected useless pipe on password regex * get history from html page and not from csv file. * [bp pro] enhance transaction parsing * [bp pro] fix parsing of rdate * fix bad regex URL. * detect another BrowserUnavailable at login * modules: fix AbstractBrowser use * wip add_recipient * [bp transfer] add urls * [bp pro] pagination on history * port to python3 * Use weboob.tools.compat instead of urllib/urlparse * [bp pro] handle more pro_history pagination pages * wip handle mandate space * handle mandate space * handle more informations for loans * handle one more loan detail's url * add url for loan * support more investment account types * support SEPA transfers * Convert byte buffer to unicode string (py3 compat) Modules: bred * fix json when they put "null" elements * disable pagination since the json is FUBAR * pyflakes * fix id not unique for some accounts * raise ActionNeeded when 2FA is enabled * adding loans accounts * port dispobank to browser2 the easy way * put back pagination, but limit pagination number * detect coming transactions * fix dispobank certificate + fix history * remove useless whitespaces * increase history size limit Modules: btmon * Use weboob.tools.compat instead of urllib/urlparse Modules: caels * remove dummy test.py files as they are false negatives for weboob_lint * modules: fix AbstractBrowser use Modules: caissedepargne * fix date format * fix balance for life insurance accounts * Fixing absolut amount for credit * adding CapProfile to caissedepargne * fix history for cenet pages since search is too stupid * add regex to type CB * fixing account type with PEA * cache accounts list * transfer feature * fix mistake when changing account type * handling revolving credit amout * fix iter_recipients internal accounts matching * skip itering recipients on double auth accounts * fix recipients iban regexp * fix transfer not allowed on iter_recipients * fixing palatine account type * fixing home loan * refix regexp to find iban on external recipients * use a more often present cookie to find name * fixing cb nature was not handle for palatine * fix profile and recipient * improve recipient parsing * try to come back from bourse website * fix crash on missing link * fix wrong loan amount * use new TransferError codes in a few modules * use new TransferError subclasses in modules * recognize more account types * fix navigation to transfer page * fix crash when transfer are not available * handle loans on old website * [palatine] work around broken fcking website * missing title yield None, not empty string * add recipients * ignore cards if site returns an error * fix loan account parsing. * don't list transfer recipients for loan accounts * handle corner case of recipient parsing * don't raise TransferBankError in iter_recipients * catch another transfer error * check password is not empty... * update modules to use new CapBankTransferAddRecipient * do not try to go into the loans space if we do not have one, add some account types * fix 500 error on iter_recipients try, wrong detection of transfer space link, and some coding style * fix iter_recipients when user has a dash char * add unrecovered corrency, prevent some problems * handle more credits * fix when page is None. * use vk to fix login * cnet now returns decimal values * go to home page between multiple PEA accounts * separate CENET website to a dedicated browser * straightforward port to py2/py3 * python3 fix (s/iteritems/items) * use xpath "$vars" in a few modules * use sorted_transactions * fix detection of recipient IBAN during transfer (zd:2595) * fix detection of recipient iban * Get deferred card transactions from card summary detail * Increased max history to 40 pages * increase again history limit Modules: canalplus * canalplus is now on browser2 * remove deprecated and useless stuff + fix contextmanager use * Use weboob.tools.compat instead of urllib/urlparse Modules: cappedtv * Use weboob.tools.compat instead of urllib/urlparse Modules: cci * use xpath "$vars" in a few modules Modules: chronopost * remove dummy test.py files as they are false negatives for weboob_lint Modules: cic * login url changed * update modules to use new CapBankTransferAddRecipient * modules: fix AbstractBrowser use Modules: cmb * adding advisor for cmb/cmso/cmmc * modules: fix AbstractBrowser use * clean code with AbstractModule * adding CapBak/CapContact capabilities Modules: cmso * use more accurate account id for life insurance accounts * improve clarity for some list comprehensions * Fix cmso par: wrong types for deferred cards * Fix cmso pro: wrong xpath * add rdate for deferred card * adding new accounts type * some life insurance have no invests * ignore errors when logging out * [cmb/cmso/cmmc] adding account types * [cmso par] livret vie bla bla wrongly typed life insurancehhh * recognize more life insurance accounts * don't return accounts which seem duplicate * [cmso par] skip 0 amount loan transactions * [cmso/cmb/cmmc] fix positive balances on loan accounts * adding advisor for cmb/cmso/cmmc * [cmb/cmso/cmmc] fixing coming and deferred date * fix itering on loans * [cmb] Detect BrowserUnavailable on MarketPage * change browserunvalaible to empty iter for investment * coding style * [cmso/pro] disambiguate market account ids * [cmso/cmb/cmmc] fixing id on loan accounts * fixed bad request for market account history * cleaning cmso login * incorrect password may also return 401 http code * [cmso/cmmc/cmb] fixing id on loan accounts * [cmso/cmmc/cmb] fixing deferred date * do not crash on deinit() if we haven't been logged * [cmmc] hope to fix duplicates transactions * [cmb/cmmb] clean code with AbstractModule * [cmb/cmso/cmmc] fixing random ClientError, ServerError * fix relogging when currently on another domain Modules: colissimo * fixed date parsing * New website Modules: cpasbien * Use weboob.tools.compat instead of urllib/urlparse Modules: cragr * raise ActionNeeded on trading password creation * adding advisor to cragr * port to browser2 the quick way * fix debug leftover * fix shared URL instance modification * fix browser1 leftover * fix cragr broken html * fix method name after browser2 switch * escape error message during authentication * use ActionNeeded exception when it is appropriated * implement transfers * fix TransferPage url to avoid the pattern match other pages * fix Transfer object after execute_transfer * fixing cragr : advisor on cmds * use TYPE_CARD_SUMMARY and TYPE_DEFERRED_CARD transaction types * adding CapProfile to cragr * use bytes since content is bytes * Fix BGPI go_to don't work without return, change DAV PEA type * adding xpath to get card's balance * fix mistake on card balance xpath * fixing account type with PEA * fix rdate, there are not always sorted * keep usage of LinearDateGuesser for other than cards accounts * fix cragr dateguesser for deferred cards * catch more broken html to replace * improve domain management * use new TransferError codes in a few modules * use new TransferError subclasses in modules * match another card_summary type * for card accounts, separate history from coming * fix advisor fetching navigation * handle perimeter having "&/et" sometimes * adding an account type * add autoencoding and fix market accounts * implement adding new transfer recipients * use url field instead of _link for Accounts in a few modules * update modules to use new CapBankTransferAddRecipient * more wtf on cards being debitted 37 weeks later! * Fixing using number instead of webid * some accounts need a form submit to go to history * "Remise carte" is not a TYPE_CARD_SUMMARY Transaction * Fix deferred cards * return list of deferred cards or url * fix deferred debit cards when it's a link, not a form * detect browser unavailable page when account uses a form * set card balance at 0 if there is no coming * Set balance to 0 if there is no coming transactions * get account base on acc.balance * handle some BGIPage investments * straightforward py2/py3 port * use xpath "$vars" in a few modules * use BankStandardTest * split get_cards_or_card * added BASEURL initialisation in init * sometimes site returns recipients iban not in uppercase * raise BrowserUnavailable * handle unavalaible browser a better way * handle more informations for loans. duration is now given in months * remove some useless ":443" in URLs since weboob normalizes them * handle closed loans that stay on the accounts list * add default value for Loan start/end date * sometimes there's no link for the loan Modules: creditcooperatif * port to browser2 the easy way * pro: fix for multiple cards on same account * don't modify raw label * detect PEL accounts * first implementation of transfers for perso accounts * implement transfers to external recipients * fix debug leftover * fix transfer exec_date parsing * use xpath "$vars" in a few modules * skip coming transactions without a date * use another page for coming transactions * quick port to python3 Modules: creditdunord * adding CapProfile to creditdunord * fix when no accounts + improve js search code * fixing account type with PEA * fix accounts parsing * fix investments date parsing * Add support for banque laydernier * catch no iban error, change some account id * some transactions have no dates ... * fix account not well typed * Changed json loads to literal eval to prevent useless replaces * Use weboob.tools.compat instead of urllib/urlparse * correctly type checking account * correctly sort transactions * port to python3 * fix py3 compat Modules: creditdunordpee * remove dummy test.py files as they are false negatives for weboob_lint * fix homepage regexp and virtualkeyboard * use io.BytesIO where deprecated StringIO module was used for bytes * fix "-" amount * iter_accounts now returns an iterable * fix warning Modules: creditmutuel * fixing creditmutuel/cic : remove deleted from summary manually summed * remove dirt from label * adding CapProfile to cm/cic * call super-classes on_load * fix some missing @need_login * fix advisor fetch * [cm/cic] fixing account type with PEA * remove dup URL * fix investement on PEA accounts + NotImplemented for history * catch another error message during transfer * [creditmut] add recipient feature * [cm/cic] adding account type * remove useless commented code * use new TransferError codes in a few modules * use new TransferError subclasses in modules * catch ActionNeeded on add recipient * [creditmut] change deferred card webid to be uniq * [creditmut & cic] fix bug following change of account webid * handle empty key error * [cm/cic] fix accounts type * if a transaction commission is present, exclude it from amount * [creditmut] handle new transfer bank error * P.E.A accounts has now the good type * [cic] better transfer errors handling * [cic/cm] fix problems on deferred cards and coming * update modules to use new CapBankTransferAddRecipient * [credimut] fix consecutive new recipients * [creditmut] fix check on recap transfer * [creditmut] fix fetching iban * [creditmut] preventively use has-class instead of @class= * [cm/cic] create new account to keep consistency * [cm/cic] match another loan account * remove regex on login * [cm/cic] adding word to match order * Use weboob.tools.compat instead of urllib/urlparse * use xpath "$vars" in a few modules * new URL for OperationsPage + call sorted_transactions * handle more informations for loans * stop taking closed loans into account * fix unhandled page for loans condition * [cic/creditmutuel] fixed some pages not being matched * CMCIC: fix catching URI for life insurances * CMCIC another fix for uri for life assurances * CMCIC better xpath for banqueprivee subbank for accounts items * fix validation message when the transfer is registered * CMCIC same xpath for account items for all subbanks * [credit mut] add_recipient, might have multiples hashes for same key Modules: cuisineaz * port to python3 Modules: dailymotion * set a default test config in case no-one exists * Use weboob.tools.compat instead of urllib/urlparse Modules: delubac * fix parsing when there are several accounts * detected terminated account * Corrected not accessible account and balance unavailable * fix unaccessible transactions * Improve iban recuperation * Skip unreachable accounts * some changes to be compatible with his childrens * port to python3 Modules: dlfp * quick-and-dirty port to Browser2 * fix browser1 leftovers and port to python3 Modules: ebonics * Use weboob.tools.compat instead of urllib/urlparse Modules: edf * remove dummy test.py files as they are false negatives for weboob_lint * fetch 3 years of documents instead of fixed begining date * [edf pro] catch ActionNeeded (CGU validation) * fixing parsing doc * fix edf pro: bad detection of wrongpass and dl method change * Fix edfpro: crashes when no bills found, and make subscription labels clean * fix new page for bills and new method for download * fix multiple subscriptions documents, fix download doc (same case), and fix invalid price * [edf pro] fix non-static id for subscriptions, and clean some code * fix multiple persons for multiple subs * [EDF] Factures correction * pyflakes * Fix PAR documents & PRO bills ID * [edf-par] fix disconnect on download bills * [edf - par] Corrected is_logged that was always true Modules: ehentai * Use weboob.tools.compat instead of urllib/urlparse Modules: entreparticuliers * fix land rent type * correctly handle RENT queries * Update Entreparticuliers module * Partial fix for entreparticuliers single housing fetching * Use a dedicated field for utilities status in housing capability * Fix some discrepancies between list and infos in entreparticuliers module * fix pyflakes * fix area detection when number of rooms is unknow + fix description parsing + fis nbroom parsing * Fix a bug due to invalid XML encoding in entreparticuliers module * fix parsing crappy adverts * fix module website got updated Modules: europarl * Clean up imports Modules: explorimmo * fix module: handle case price in not in search result * fix error parsing prices * handle empty search cities result * Update explorimmo module * Remove useless imports in explorimmo module * Update explorimmo single housing fetching * Use a dedicated field for utilities status in housing capability * Correctly fetch the area in Explorimmo listing when there is a comma * Fix according to comment by @Bezleputh * Fix explorimmo agency in details * Use weboob.tools.compat instead of urllib/urlparse Modules: feedly * Use weboob.tools.compat instead of urllib/urlparse Modules: fortuneo * fixing account type with PEA * fix broken html * fetch PEA balance from account page because it's more up to date * handle another actionNeeded * do not use 'with' on browser * use url field instead of _link for Accounts * changed way accounts links are retrieved * added history for PEA and life insurrances accounts * Form not found correction * ignore auto assurance account * added action needed exception for recently created profiles * [Fortuneo] Handling of liquidities because investments are very volatiles, investments are cached during list command in order to keep consistancy between list' balances and investments sums * added action needed exception when profile require it * added another case of action needed on the site * fixing account type * added BrowserUnvailable exception for unreachable accounts * fix crash on loans * port to python3 * Now full handle loans * detect BrowserUnavailable at login * another ActionNeede * Delete liquidity for stock account * now get sub transactions from main one Modules: francetelevisions * site changed * sometimes there is no date or sublabel * handle ls command + fix test Modules: freemobile * Fix for https://symlink.me/issues/3664 * Add CapMessagesPost to self using Freemobile SMS API * Should now support multilines account with CapMessage * Freemobile CapMessagePost should support multi-line accounts * Fix Freemobile HomePage not having correct logged property * use io.BytesIO where deprecated StringIO module was used for bytes * ended subs make crash when renewdate try to get recovered * use xpath "$vars" in a few modules Modules: funmooc * fix login and pages * port to python3 Modules: ganassurances * failed login can redirect to groupama * added virtual keyboard support * some life assurance accounts weren't returned * [ganssurances] diasble comings for life insurances accounts * keep get_coming as an iterator * fix history for different life insurances * Skip false account and fix columns use * using is instead of == to compare with None * add investments support * now recover currency * add arbitration and test existence of columns * parse another ISIN pattern Modules: gazelle * Use weboob.tools.compat instead of urllib/urlparse Modules: gdcvault * Use weboob.tools.compat instead of urllib/urlparse Modules: genericnewspaper * modules: fix AbstractBrowser use Modules: github * Use weboob.tools.compat instead of urllib/urlparse Modules: googletranslate * fix translation decoding Modules: groupamaes * amount column label has changed * amount may be not available * detect another negative amount transaction * fix duplicated coming operations * accept more than 8 digits in login Modules: guerrillamail * port to browser2 * remove unused import Modules: happn * add parameters 'position' and 'distance' * little improvements * fix changes in API * fix set of position Modules: hsbc * login form has changed * recognize an additional type of life insurance account * raise BrowserIncorrectPassword when password is too short * recognize an additional pattern for life insurance * fixing account type and loans * sometimes life insurance label is "elysee" instead of "elysees" * handle life insurance history and investments * fix transactions with gross amount, fix invest name (sometime there is some letters in id) * set date instead of vdate in life insurance history * life insurance website is randomly unavailable * fix mistake * fix mistake n°2 * some life insurance are not on side website * when app is gone, relogin is needed * fix crash when life insurance space is unavailable * detect another BrowserIncorrectPassword * fixed IBAN not found when on french site * fix regexp to parse first matching date instead of last * coding style: use sign CleanDecimal param * the life insurance site may not show all accounts * Fix ignored history * use url weboob field and remove some useless except * don't parse "some shop 24/24" as the transaction date * fixing history and summary on deferred cb * basic port to python3 * change site navigation to use more POSTs * some coding style improvements * detect new life insurance label + empty history * handle a variety of errors for life insurance * detect suspended account ActionNeeded Modules: imdb * Use weboob.tools.compat instead of urllib/urlparse Modules: imgur * fill more fields Modules: ina * fix ina tests Modules: indeed * set a default test config when no-one exists Modules: ing * Adding Loan type * use io.BytesIO where deprecated StringIO module was used for bytes * adding CapProfile to ING * fixing account type with PEA * fix start_with_main_site decorator * fix get_profile happening after life insurance account * fixing investment in some cases * use new TransferError codes in a few modules * use new TransferError subclasses in modules * [ing/bforbank] use now ValueDate * fix ValueDate format and no more replace * don't need anymore to hardcode server cert * handle one more format date * handle orignal_currency on TitrePage * fetch PEA and MARKET balance from details because it's more up to date * fix positive balances on loan accounts * transfers * retry if we can't get market balance * exec_date can move 4 days later * transfer better exec_date parsing * fix recipient iban parsing * Handling of liquidities as an investment. To avoid inconsistencies between balances and investment totals, investments are cached during list command * corrected useless pipe on password regex * fixing unitprice column * unitprice invest life insurance column may be missing * raise ActionNeeded if page is moveMoneyForbidden. * fix unicode exception problem * port to python3 * add error on invalid transfer amount * there is no liquidity on life insurance in creation Modules: inrocks * modules: fix AbstractBrowser use Modules: jacquieetmichel * Use weboob.tools.compat instead of urllib/urlparse Modules: jcvelaux * straightforward py3 compatibility Modules: jirafeau * port to python3 Modules: kickass * Use weboob.tools.compat instead of urllib/urlparse Modules: kiwibank * adding missing account type Modules: lcl * catch actionNeeded on trading website * fixing parsing on invest * fixing parsing on invest * do not raise ActionNeeded on BoursePage * some accounts can't do any transfer * add_recipient * fix encoding error * adding CapProfile to lcl esp/ent * use io.BytesIO where deprecated StringIO module was used for bytes * do not crash on unavailable market website * fix recipients webid * fix mistake * fix life insurance xpath * fix wrong type for cb deferred * set expire on state * use new TransferError codes in a few modules * use new TransferError subclasses in modules * entreprise: fix multiple accounts + misc * fix recipient add message * better parse accounts list if multiple companies * fixing some type accounts PEA * advisor phone can be missing * Added pro loans * Fixed AV, now taking contractID instead of labelname as ID * add e.LCL space on websites, fix crash on market disconnect page * update modules to use new CapBankTransferAddRecipient * Fix ac_details_page xpath in AvPage * fix website redirection to get lifeinsurances accounts * use on_load for life insurance routing pages * access is restricted to life insurance accounts of a third-party * parsing of life insurance investments changed * Iban duplication correction * go on accounts list before submitting life insurance page form * handle multi contracts * force logout with multi contracts and statesmixin * init some variables and avoid a name conflict * fixing pea type on bourse accounts * patch empty transaction label with nature * fix lcl transaction label at None * don't use lxml custom strs in the state but standard strings * sometimes transactions have amount of 0 * fix transferbankerror msg format * [lcl add recipient] fix detection of params xpath * port to python3 * some life insurances don't have a link and so are useless * CapDocument added, now donwloading documents * fixing wrong date on deferred_cb transactions * Missing import basestring in LCL module (Python 3 compatibility) * CapDocument is only implemented for "par" site * use xpath "$vars" in a few modules * fix iter_resources since module has CapBank/CapDocument * add currency to life insurance and market accounts * Add uppercase ASSURANCE-VIE in disc URL. * fix when form params are not in id but in href. * detect some cases of "restricted" life insurances * remove some useless ":443" in URLs since weboob normalizes them Modules: ldlc * Fix LDLC module Modules: leboncoin * set a default test config in case no-one exists * fix: module crash while searching cities whose name contains spaces * handle unknown cities search result * Update Leboncoin module * Fix single housing fetching on Leboncoin * Use a dedicated field for utilities status in housing capability * Remove region parameter in Leboncoin module * fix call to sort for py3 compat * fix warning from element.getroot() Modules: leclercmobile * use io.BytesIO where deprecated StringIO module was used for bytes * Remove support for older mechanize versions Modules: lefigaro * fix module / set a defaut test config in case no-one exists * modules: fix AbstractBrowser use Modules: liberation * modules: fix AbstractBrowser use Modules: linebourse * new bank invest module * fix non-existing page * fix portfolio_share > 1 * fix index out of range due to not urlencoded account id, change warning to assertion error * portfolio share can be NotAvailable, change static 'isin' to Investment variable * fix empty invest with 0 in quantity * sometimes investments have an empty label * change hard code type to invest variable * sometimes the diff column is just missing * reimplement MessagePage behavior of caissedepargne * create liquidity investment * fix invest history label * fix invest history label * sometimes investment list is not in a link * fix escaping '?' in URL.urls for calling go on it * the website might be dead * fix broken page on iter_history * port to python3 * use xpath "$vars" in a few modules Modules: linuxjobs * add proper favicon * Use weboob.tools.compat instead of urllib/urlparse Modules: logicimmo * Update Logicimmo module * Fix location detection in logicimmo * Update logic-immo single housing fetching * Use a dedicated field for utilities status in housing capability Modules: lolix * bump to browser2 / set a default config in case no-one exists Modules: lutim * use io.BytesIO where deprecated StringIO module was used for bytes * port to python3 * fix expiration field Modules: lyricsdotcom * fix module : website got updated * Use weboob.tools.compat instead of urllib/urlparse Modules: lyricsmode * fix artist name and song name * Use weboob.tools.compat instead of urllib/urlparse Modules: marmiton * fix parsing when cooking time is not filled * Use weboob.tools.compat instead of urllib/urlparse * fix module website got updated Modules: mediawiki * add gallery search + improve fillobj * edit token changed + fix unittest * port for python3 * fix image data fetching Modules: meteofrance * fix module website got updated (fix issue #43) * fix unorderable types error Modules: minutes20 * modules: fix AbstractBrowser use Modules: monster * fix module, website is beeing updated * fix module site changed * Use weboob.tools.compat instead of urllib/urlparse Modules: myfoncia * Billing capability for Foncia Modules: n26 * remove dummy test.py files as they are false negatives for weboob_lint * catch wrongpass * fix old-style exception * fix module creation * set account number to NotAvailable * currency is always EUR * moved login from init with wrapper * N26: Handle bank fee type; Modules: nectarine * port to browser2 * port to python3 Modules: nettokom * corrected useless pipe on password regex Modules: nolifetv * Use weboob.tools.compat instead of urllib/urlparse Modules: nova * use io.BytesIO where deprecated StringIO module was used for bytes * remove useless dict.iterkeys() calls Modules: oney * use io.BytesIO where deprecated StringIO module was used for bytes * fixed incorrect password on site choice page * catch and ignore unusable accounts * handle email on login * parse special credit page * the coming value may be missing Modules: onlinenet * setted timeout to prevent 504 errors Modules: opacwebaloes * remove dummy test.py files as they are false negatives for weboob_lint * library: rename get_booked/get_rented and remove wrong id parameter * Remove support for older mechanize versions * fix API change Modules: opensubtitles * Use weboob.tools.compat instead of urllib/urlparse Modules: orange * fix bills for pro and sosh accounts * fix bill price when there is a discount info * fix price parsing when there's vat and non-vat amounts * Corrected date xpath * Added price to ID to prevent bills doublons * [sosh - orange] Corrected url for unavailable documents * Use weboob.tools.compat instead of urllib/urlparse * Get documents and bills from new site * Some subscriptions don't have basic columns like 'Montant HT' * Pro contracts take amount without taxes Modules: ouifm * update OÜI FM stream urls * update station name * bump to browser2 * remove useless dict.iterkeys() calls * 4 brand new OUI FM streams * syntax terror * added OÜI FM Rock 2000 + OÜI FM Summertime urls Modules: ovh * remove dummy test.py files as they are false negatives for weboob_lint * [OVH] Added bills label * Two-Factor authentication now catched * Changed links to match new API & select bills 2 years ago * Added condition on login (sometimes trying to log when already logged) Modules: pap * Update Pap module * Fetch single housing fetching of Pap * Use a dedicated field for utilities status in housing capability * Use CleanText rather than CleanHTML in pap phone fetching * Better handling of housing posts with multiple phone numbers on pap * Use weboob.tools.compat instead of urllib/urlparse Modules: pariskiwi * port to python3 Modules: parolesmania * Use weboob.tools.compat instead of urllib/urlparse Modules: pastebin * base url is https Modules: paypal * fix paypal login * bypass new anti-scraping js * handle more home urls * [paypal part] create transaction with there is a funding src * fix regressions with fundingSrc * don't crash if fundingSource is missing * fix login js * fix when get account list. * Use weboob.tools.compat instead of urllib/urlparse * handle new home page Modules: phpbb * port to browser2 and add fixes * Use weboob.tools.compat instead of urllib/urlparse Modules: pixabay * add module for pixabay public domain photo search * Use weboob.tools.compat instead of urllib/urlparse Modules: pixtoilelibre * use io.BytesIO where deprecated StringIO module was used for bytes * port to browser2 and python3 Modules: podnapisi * Use weboob.tools.compat instead of urllib/urlparse Modules: popolemploi * Use weboob.tools.compat instead of urllib/urlparse * fix module site dramatically changed Modules: pornhub * Now uses https Modules: pradoepargne * adding pradoepargne module * [pradoepargne][btpbanque] Upgrade version * modules: fix AbstractBrowser use Modules: presseurop * fix module + set a default test config in case no-one exists * modules: fix AbstractBrowser use Modules: radiofrance * fix francemusique, mouv and franceculture * fix franceinter podcasts / search not only search in selections but also in podcasts * better output for current song Modules: ratp * RATP: Rename module to be lowercase * Fix a few bugs with ratp module * Make RATP module use the provided issue description * site is now https Modules: redmine * Use weboob.tools.compat instead of urllib/urlparse Modules: regionsjob * set a default test config in case no-one exists * handled websites are now using https Modules: rmll * Fix RMLL module required weboob version * Fix module : website got updated Modules: s2e * use io.BytesIO where deprecated StringIO module was used for bytes * detect an ActionNeeded page * use now AbstractBrowser and AbstractModule * adding pockets * now recover AMF code around 3 websites * fix undefined page (website without amf code) * handle another code page * fix XMLSyntaxError due to an empty page occurring sometimes * abandon AMF code fetching when the page redirects to a graphplot page * handle one more isin site (the url is enough for it) * fix cpr-am url + handle yet another isin url... except it's a pdf * add another cpr-am url pattern * add another type of ISIN page * corrected useless pipe on password regex * detect one more "no accounts" sentence * add diff to investments * diff column can be unavailable * use xpath "$vars" in a few modules * add new text to get pocket condition from dict CONDITONS Modules: seloger * Update seloger module * Filter cities results of SeLoger module * Fix seloger modifications according to @Bezleputh comments * Better title fetching from seloger module * Use a dedicated field for utilities status in housing capability * Do not return utilities.excluded when should not be the case for seloger * Add missing favicons for foncia and seloger * Use weboob.tools.compat instead of urllib/urlparse Modules: senscritique * Website now uses https Modules: sfr * Use weboob.tools.compat instead of urllib/urlparse Modules: societegenerale * new url for a ActionNeeded page * delete cb_summary transactions * new action needed page * life insurance pages are broken randomly, do retry * do not throw a TransferError if the customer can't do tranfers * fix debit date, must be descending * fix transfers * adding CapProfile to societegenerale * username is digit.. * use io.BytesIO where deprecated StringIO module was used for bytes * list loans in accounts * fix crash on history on loan accounts * raise BrowserIncorrectPassword for short logins * some loans have no balance in the loan json * fix crash on unavailable loan page * fixing account type with PEA * fix transfer * fixing isin code * add recipient * raise step on appli validation instead of waiting * use new TransferError codes in a few modules * valutations for invests are now taken from the previous page for a better value * use new TransferError subclasses in modules * fix transfer * skip life insurance transaction when date is "rejet" * [soge] fix rounded valuations bugs (KeyError), now go on all pages to get valuations, and catch the error * fix unicode literal * transfer date more flexible * [societegenerale iter_recipients] \d in field might not be an id * fix transfer data wrongly posted * sometimes an owner has no accounts * bugfix check also if _id in acc.id. * fix handling transfer page * card transactions are coming before the first card_summary * fix no accounts due to site error * fix recipients list if multiple accounts have the same name * recognize new url for ActionNeeded * skip external recipient with not valid iban * update modules to use new CapBankTransferAddRecipient * fix regex * Transfer.exec_date can vary of 2 days during weekend * fetch balance from market page * exclude a new error message for iter_transfer_recipients * [societe generale] changed IBAN to not available for Epargne accounts * skip market transaction if the amount is unavailable * fix too strict and inconsistent exec_date check * the "rejet d'intégration" state was searched on wrong doc * test another page for life insurance history * allow iter_history on PEA liquidity * Corrected validation condition to prevent recipient doublons * detect a NoAccountsException case * Use weboob.tools.compat instead of urllib/urlparse * port to Python3 * [soge] fast fix transfer * Form param value changes between 'valeur' and 'position' * detect yet another BrowserUnavailable Modules: somafm * Port somafm to browser2 Modules: spirica * 0% portfolio_share is different than NotAvailable * recognize "capitalisation" accounts * exclude 'arrêté annuel' transactions * use url field instead of _link for Accounts in a few modules Modules: sueurdemetal * port to browser2 * set timezone of events * straightforward py3 port * site completely changed Modules: supertoinette * bump to browser2 Modules: t411 * Correct download URL * new URL * Use weboob.tools.compat instead of urllib/urlparse * update to new website Modules: tapatalk * bugfix: use 'Anonymous' if post_author_name is undefined * bugfix: if a forum doesn't have new_post attribute, assume it to be true Modules: taz * modules: fix AbstractBrowser use Modules: tinder * add optional parameter 'location' to force position * sometimes 'common_likes' is not present in person dict * send a welcome message * sometimes description is missing Modules: torrentz * CSS changed * Use weboob.tools.compat instead of urllib/urlparse Modules: trainline * fix some bugs in iter_docs * fix unavalaible docs Modules: tvsubtitles * Use weboob.tools.compat instead of urllib/urlparse Modules: twitter * fix : website got updated * remove useless encoding * Use weboob.tools.compat instead of urllib/urlparse Modules: unsee * Use weboob.tools.compat instead of urllib/urlparse Modules: ups * remove dummy test.py files as they are false negatives for weboob_lint * Use weboob.tools.compat instead of urllib/urlparse Modules: vimeo * fix search / rewrite search and channels listing using phone API / set a default test config in case no-one exists * fix : keep your grubby hands to your own website ! * Use weboob.tools.compat instead of urllib/urlparse Modules: vine * Use weboob.tools.compat instead of urllib/urlparse Modules: virginradio * fix module (header wants a str not an int) * remove useless dict.iterkeys() calls Modules: weather * fix module: website got updated / bump to broser 2 Modules: wellsfargo * Use weboob.tools.compat instead of urllib/urlparse Modules: yomoni * remove dummy test.py files as they are false negatives for weboob_lint * raise ActionNeeded for certain "no accounts" * encode utf8 before base64 to avoid crash on accent * detect more ActionNeeded * User get message if subscription at step 4 * Added right tokens to all requests * don't use Account as dict key, it's not hashable * parse amount with comma and replace with dot * PEA account_type now recognized Modules: youjizz * fix parsing links without schemes * force https for thumbnails * fix parsing of urls Modules: youporn * fix compatibility with new website Modules: youtube * Use weboob.tools.compat instead of urllib/urlparse * use youtube_dl * remove pages.py since no browser is used anymore Tools * Add a script to backport modules from devel to stable * Add a script to detect new and removed modules since a release * Add check_xpath script * Add "-3" option to all relevant tools * CI update to manage both python versions Contrib * Add replace-backends-pass.py tool to use the "pass" tool * Add rboorrent-download script * Add a export_session method and a webextension Weboob 1.2 (2017-01-08) General * Add inheritance for modules, browsers and pages * Add gitlab-ci integration * Move all Qt applications to Qt5 * New application QBooblyrics * New urls for source repositories: https://git.weboob.org/ General: removed modules * Remove btdigg module, website is dead General: new modules * New module afer https://adherent.gie-afer.fr (CapBank) * New module amundi https://www.amundi-ee.com (CapBank) * New module caels https://www.ca-els.com/ (CapBank) * New module creditdunordpee https://salaries.pee.credit-du-nord.fr (CapBank) * New module number26 https://n26.com (CapBank) * New module spirica https://www.spirica.fr/ (CapBank) * New module yomoni https://www.yomoni.fr/ (CapBank) * New module centquatre https://billetterie.104.fr (CapCalendarEvent) * New module materielnet http://www.materiel.net/ (CapDocument) * New module onlinenet https://www.online.net (CapDocument) * New module trainline https://www.trainline.fr/ (CapDocument) * New module linuxjobs https://www.linuxjobs.fr/ (CapJob) * New module manpower http://www.manpower.fr/ (CapJob) * New module lyricsdotcom http://www.lyrics.com/ (CapLyrics) * New module lyricsmode http://www.lyricsmode.com/ (CapLyrics) * New module lyricsplanet http://www.lyricsplanet.com/ (CapLyrics) * New module paroles2chansons http://www.paroles2chansons.com/ (CapLyrics) * New module openedx (CapMessages) * New module tapatakl (CapMessages) * New module jirafeau https://jirafeau.net/ (CapPaste) * New module cpasbien http://www.cpasbien.cm/ (CapTorrent) * New module torrentz https://torrentz2.eu/ (CapTorrent) * New module pornhub http://www.pornhub.com (CapVideo) General: core * Add BackendsCall.stop() method to stop jobs * Add a 'requests' system to replace the primitive callbacks system * Check version before to run update request in repositories * Fix core unittests and some pyflakes warnings * Make as much modules unittests as possible run without backend * Add WebNip.load_or_install_module which does not install module (for compatibility with abstract objects) * Some fixes for windows compatibility * Force keyring generation with gpg1 Documentation * Fix some typo in browser documentation * Clarify absurl behavior * Don't add applications/index in index.rst (empty page) * Don't use :any: special keywork for old system compatibility * Update favicon path * Add contribution guide * Rewrite Weboob doc guides according to latest changes in CI and modules Browser * Detect downgrade from HTTPS to HTTP and raise exception * TableElement now handles regexp * Do not store page url if there is no current location * Use urllib3 embedded in requests first * Update firefox ESR profile to the last version * Keep order of POST data * Add XLSPage, PDFPage and GWTPage classes * Catch TooManyRedirects after reloading cookies from storage * Do not use (and remove) global logger setting 'save_responses' to know if we save responses or not * Fix some invalid encoding names (#2602, #3522) * Introde CacheMixin class to store responses * Store the request object in Form class (allow to modify it on the fly) * Add xpath funtions star-with and ends-with * Introduce PartialHTMLPage for pages wit multi-roots Browser: URL * Fix a crash when a pattern use parameters with the same name than in another pattern * Add unit test for URL with multiple patterns and same parameters subset * Add an option to send headers in go() method Filters * RawText: can now optionally retrieves text from sub-elements * Date/Datetime: add fuzzy option * Async: read result.page from loaded_page * TableCell: can now iterate on elements * Add Upper and Capitalize filters * Add Currency filter Elements * DictElement: Handle sub-dictionaries * ItemElement: Ignore items if the condition fails * ListElement: check condition before iteration Old browser * Allow monkey patch to disable SSL certificate check * Better SSL support (import more recent TLS versions if available) * Fix https downgrade detection Exceptions * Add ActionNeeded exception * Add NoAccountsException * Move ModuleInstallError to Exceptions module Tools * Introduce LimitedLRUDict to not cache too much values * Add a WeboobEncoder class * Add get_pdf_rows helper Tools: Backend * Save responses if _debug_dir backend configuration is set * Add optional 'klass' parameter for Module.create_backend Tools: bank * Add tools about IBANs and French ribs Tools: date * Add Italian translation * Fix date translation for values with \b Tools: formatters * Fix TableFormatter with lists of different lengths * Protect separator contained into values for CSV output (#2614) * Simplify CSV formatter with a call to csv python module * Fix use of -O parameter for csv formatter * Set ";" as csv default separator (#3378) Tools: tests * Add skip_without_config decorator * Add is_backend_configured method to BackendTest class Tools: ValueBackendPassword * When callback returns None, convert to empty string Tools: VirtKeyboard * Add parameterizable output code separator Capabilities * Add an url attribute to BaseObject * Add many currencies (turkish lira, romania new leu, colombian peso, etc) * Fix few __repr__/__str__ returning unicode * Add BoolField class Capabilities: Bank * Add description for 'coming' field on Account objects * Add PEE, PEA, PERP, PERCO, RSP, ARTICLE_83 and more account types * Add CARD_SUMMARY and DEFERRED_CARD transaction types * Add portfolio_share field to Investment * New fields for Investment to handle currencies * Add diff_percent field on Investment * Don't crash on empty raw values * Split transfers related methods to a new capability: CapBankTransfer * Update recipient object * Deep rework of transfer API, change modules and applications Capabilities: Contact * Add Advisor class, used in many bank modules Capabilities: Document / Bill * Major (and API breaking) change (all modules are updated) * Update all Bill modules to use url field instead of private field * Rename field "deadline" to "duedate" * Add field "income" to Bill Capabilities: File * Add license field Capabilities: Housing * Add url in HousePhoto __repr__ method * Add price_per_meter field Capabilities: Message * Create a genericnewspaper module with no capability that will be extended by other modules Capabilities: Image * Move Thunbmail class to Image capability * Fix many modules to use Thumbnail instead of BaseImage Capabilities: Lyrics * Remove useless constructor for SongLyrics objects Capabilities: PriceComparison * Add Price not found error Capabilities: Recipe * Do not crash if picture_url is an empty string * Handle decimal quantities in krecipe exports Applications: weboob script * Add "update" command Applications: console * Use self.do instead od self.weboob.do in get_object_list * Strip left and right condition (we now support rules lines like --condition 'amount > 2000') * Disable BACKEND@issues.weboob.org addresses (to much SPAM) Applications: all Qt applications * Use new-style signals and slot * Add Qt5 package in our tools * Port all applications to Qt5 * Add "wait" parameter to stop method Applications: boobank * Display sub-totals for each currency (when several currencies are detected) * Fix error display in budgea command * Increase timeout of budgea command * Do not take of loan accounts in total * Display loan accounts label in blue * Use encoding aware custom print() * New advisor command with custom formatter Applications: comparoob * Add defaultcount management * Improve products management Applications: flatboob * Improve display if Area is not found Applications: monboob * Add full thread history in headers (fix some bad detection one MUA) Applications: videoob * Correctly handle non complete url in m3u8 Applications: qcineoob * Sort torrent search result list by seeders * Display backend icon for each search results * Set tab text max size and add tooltip * Add keyboard shortcut (alt+left) to go back * Tab text is now updated on actions Applications: qcookboob * Display backend icon for search results * Add keyboard shortcut (alt+left) to go back * Better tab text/tooltip management * Fix bug when opening in a new tab, bad is was given Applications: qflatboob * Load all fields in widget list (help to rank adverts) * Display price per meter ratio Tools: boilerplate * Improve arg signature of methods generated by CapRecipe * Make u8 idempotent * Don't add failing test by default Tools * local_run: fix script when PYTHONPATH is not set * run_tests.sh: fix wrong exist status when specifying a single backend Packaging * Add a command to get the requirements with setup.py * Add cssselect to the list of requirements * Ensure that requests version is >= 2.0 Contrib * Boobot: add tasks management * Boobot: fix compatibility with iso-8859-15 messages * Boobank_indicator: do not include loan account in total * Add imm-o-matic script Modules: 750g * Update module to use new website * Do not crash when there is only one or no result Modules: adecco * Update module to use new website * Skip test if backend is not configured * Add default configuration for tests Modules: agendaculturel * Website migrated from http to https * Skip test if backend is not configured * Add default configuration for tests Modules: agendadulibre * Skip test if backend is not configured * Add default configuration for tests Modules: allocine * Update favicon Modules: allrecipes * Uses API instead to parse website Modules: amazon * Handle prices that occur twice on the page (#2057) * Fixed login after website update (#2057) * Another discount type (#2057) * Added 'Free Shipping Promo' bill detailisation keyword. (#2057) * Force label to document * Fixing amazon : sometimes tva or other amounts arent available * Use new login link id Modules: amazonstorecard * Improved stability (retry on error) (#2115) * Major website update (#2115) * Parse recent transactions (#2115) * Handle amounts more than ,000 (#2617) * Parse payment due date; allow transactions with empty id (#2617) Modules: americanexpress * Remove unused constants * Rewrite to browser2 and remove old code * Fix date parsing * Update dateguesser range to one year * Handle account suspended page * List multiple accounts * Don't report canceled accounts without history * Fix div id with single card Modules: ameli * Update module after site changes Modules: amelipro * Fix tests calls Modules: apec * Fix the way experience and contact fields are filled * JSON api format has been updated * JSON call got updated * Handle accentuated characters in search * Add default configuration for tests Modules: apivie * No more fake ids on apivie transactions Modules: arte * Do not crash while trying to handle a bad url * Handle an other type of web page in cinema.arte * Fix Debian bug #831609, correctly handle m3u8 url * Many little fixes * Handle arte creative * There are some duplicate videos in creative pages * Fix arte cinema (module was not able to find video url anymore) * Add default configuration for tests Modules: aum * Remove duplicate entry key in AUM module Modules: axabanque * Fix no history on card * Handle ACCOUNT_TYPES * Fix accounts typing * Port to browser2 and adding investments * Don't crash in case of customer error * Check when user need to change password * Fix problems when checking error * Fix asv not being fetch and portfolio * Fix bug going on agipi page * Get account IBANs and fix typing * Fix investments on market account * Fix accounts from tabs and more investments * Fix url change on invest * Fix handling pel type * Support new login and some changes * Fix: password can be only digits * Support the new website for investments * The login can now be an email * Accounts numbers may be written differently * New URL for accounts list * Some pages return overlapping accounts, skip duplicates Modules: banqueaccord * Support new login page Modules: banquepopulaire * Handling currency for cards * Adding currency for card * Handle crash on natixis website * Removing balance information in raw * Fix missing label in history * Set Account.iban to NotAvailable if user hasn't subscribed to online documents * Fixing banquepopulaire : No IBAN for checking account * Fix wrong account type * Fixing account type for "Fructi Selection Vie" * Adding more life insurance support * No IBAN on investment and life insurance * Add support for Banque de Savoie. * Check number in raw instead of label * Handle different label * Investments on savings account * Port to browser2 the easy way (without filters and so on) * Fix problem with unicode cookies * Test unavailable service on all pages * Raise NotImplementedError for new natixis pages * Use absurl for regular pages after having visited market * Update navigation token even on error pages * Fix crash on some pages without token Modules: barclays * Support investments on life insurance accounts * Updated cards handling * Fix account type detection to fix card linking * Move to browser2 and support IBAN on pdf Modules: bforbank * Adding pagination for bforbank * Don't crash on no IBAN for checking account * Fix reading when IBAN is not available * Add a favicon * Use spirica module for life insurance * Implement investments/history for MARKET accounts with lcl Modules: blablacar * Fix departure date regexp * Fix parsing date * Fix: site got updated * Add a favicon Modules: bnporc * Don't crash without simplejson (support other json modules) * Add support PEA liquidity account type * Support one more page to refresh password * Get a year of history * Correctly decode IBANs * Rebuild IBAN only if it isn't already one * Catch wrongpass * Print temporary password to allow rescue connection on website * Fix: site changed * Adapt to support CapBankTransfer * Try harder to connect on the website * Add url to renew password * Fix BNPEnterprise: add leading zero when IBAN key is < 10 * New website for BNPEnterprise, rebuild all module * Fix bnp enterprise: libelle not loaded for some reason, so take the type libelle on this case * Fix BNPEnterprise: swith date and rdate, move Account import * Fix CleanDecimal not always working * Catch change password page and raise ActionNeeded * Prevent date overlap in history search * Transfer fix on bnp * Categories on recipients * Handle transfer unavailable on fetching IBAN and recipients * Raise BrowserUnavailable on 1001 error code * Add transfer.account_balance * Add advisor support * Add a cache for account_list * Don't overwrite browser.page with something which can be a Response * Use response.json() to parse response, to prevent encoding issues Modules: boursorama * Better fall back on old website * Skip first visit page before falling back on old webiste * Better newwebsite url * Fix unitprice parsing * Support of Bourso new website and use Browser2 * Add support of loan accounts * Fixing class for transaction label changed * Handling coming card * Add a condition to prevent crashs * Fix label parsing * Update regexp for TYPE_ORDER * Fix cards transactions link * Handle wrong pin code * Fix loan, market, valuation etc .. * Two-step-auth: fix request if browser has been shutdown * Detect when PIN tries limit has been reached * Fix checking of errors * Handling when no informations is avalaible in investment * Fix in case there are divs into accounts list * Handle new bourso card ID * handle blocked page1 * Raise wrongpass on blocking secret infos update page * Handling new info profil page * Take custom-id if regular ids are not present * Fix same transactions on different accounts * Fix cards rdate parsing * Handle ord accounts * Fix pea history parsing * Fix some nav issues * More accurate url and valuation calculation * Adding incident page * Fixing wrong inheritance * Handle no link on market history * Fix history parsing * Parse transactions label back again * Try to be easier with bourso website * Do not iter coming on li and market accounts * Add a cache for accounts * Handle new history page type * Increase HTTP timeout, the website can be slow * Better typing to avoid crash * Do not crash on ClientError * Try to update balances of accounts before parsing * Try to fix XMLSyntaxError * Don't rash when no id are available (on some foreign accounts) * Catch XMLSyntaxError * Fix virtkeyboard * Don't call need_login twice * Fix page not being handled by the right class * Date might be missing * Fix unauthorized on virtkeyboard with old stored cookies * Fix cookie delation after going on login page * Fix card transactions request * Fix skiping not boursorama's accounts * Fix card accounts ids * Handle more cases where client need to log in on website * Handle more login page * relog on random disconnection * Fix coming parsing * Add IBAN page * Fix market accounts transactions date parsing * Fix useless nav and wrong webid leading to wrong IBAN * Fix transaction amount parsing * Fix crash on parsing amounts * Handle url with correct page * Type more loan accounts to prevent crash on history * Exclude deffered_card transactions of checking accounts * Add new param to login * Fix crash on expert derive account Modules: bouygues * Fixing bouygues module which works with b&you * Fix date parsing * Fixing bouygues module multiple accounts * Don't crash for accounts without document * For some reason, bills might be duplicated on website * Fix: https is now mandatory for documents URL * Fix: sometimes download document crash when reference is not specified Modules: bp * Handling wrong website selection * Add wrongpass page * Fix duplicate accounts with better id parsing * Fix regexp to get accounts ids * Support CapBankTransfer new API * Accounts are now in EUR by default * Handle deferred card * Accurate messages if users are on wrong website (between pro and perso websites) * Don't crash when no accounts are available * Port to browser2 (the easy way) * List loan accounts * More support of transfer (double auth not handled) * Fix pro browser working with StatesMixin * Reimbursed loans have an empty amount string * Parse life insurance investments and history * Fetch history for retirement contracts * Skip loan account with "unavailable data" * Fix BrowserIncorrectPassword with par/pro mix * Fix statesmixin on expired session * Handle internal recip not in accounts list * Add a cache for accounts_list * Fix a crash on unavailable pages * Skip more useless LOAN accounts * Add more regexp for transaction types * Add advisor support * Catch no accouts Modules: bred * Cut password to the first 8th char * Fetch IBAN only for checking accounts * Transactions typing * Do not yield not real market accounts * Fix duplicate id accounts Modules: caissedepargne * Fix pagination on history * Fix investments on multiple market accounts * Fix come back on synthesis * Handle loans caisse depargne * Fixing when not loan account is present * Better check if we are on wrong page * Detect and bypass useless message page * Fixing website failed redirecting * Handle delayed debit card and cleaning module * Browser handles technical error page (instead of code in iter_* functions) * Add certhash * Fix account valuation_diff parsing * Do not yield anything on market cgu * Guess IBAN only if this is a correct RIB * Fix login * Fix encoding error * Fix when there are multiple choices of spaces (between pro and personal) * Remove LoginPage and do only direct requests * Better wrong pass handling * Fixing can't leave credit page on old website * Fix navigation on history * Catch wrongpass * Life insurance might not be available for consultation * Adding lifeinsurance's history * Fix website being awful * Fix infinite loop on no accounts * Only keep relevant wrongpass (and return BrowserUnavailable for other errors) * Fallback on pro domain when loggin on personal fails if pro exists * Invest date might be unavailable * Better handle of real no accounts * Read multiple cb tabs * Bump to browser2 * Fix: sometime link is a list, so fix this * Fix: an 'href' who takes himself for an 'a' tag * Fix: on cenet website, sometime a year is not available, so try every months * Fix: on garbage page sometime link is not available, due to an ActionNeeded * Fix: if garbage go_back_link is not available, skip this step * Remove deprecated exception, use new ones * Add support of advisor Modules: carrefourbanque * Manage more accounts, investments * Fix portfolio on some modules Modules: cic * Improve account typing * Update cic sources from credit mutuel * Support CapBankTransfer new API * Cic now inherits from creditmutuel * Adding advisor for cm/cic Modules: citibank * Fixed login after website update. (#2098) * Switching to javascript library * Switching to new base url * When parsing a date in a statement, try both leap and non-leap years (#2098) * Handle negative and positive account balance (#2098) Modules: cmb * Handling agricultor website * No more crash on no account * Bump to browser2 and more (more accounts, investments, coming...) * Use AbstractBrowser instead of symlinks to cmso Modules: cmso * Fix account type * Fix wrongpass detection * Don't raise BrowserUnavailable when no savings accounts * Don't crash when no accounts are available in pro website * Manage multiple areas * Don't crash without accounts * Index were not unique * Don't crash when no IBAN for checking account * Support cmmc website * cmb/cmso/cmmc: support loans * Return on subscription before switching area to prevent 500 * Handle 500 when no history on market account * Have useful account ids * More history is now recovered * Add a forgotten return in iter_history * Getting a year of history * Use open instead of random async * Better id on market accounts * Fix crash when id is not found on market accounts * Handle multiarea on cmso pro * Handle no account in area * Fix regexp for some account ids * Start fetching investments * Fill 'areas' attribute outside of do_login (to work with blackbox) * Fix investments with non investment accounts * cmso pro: prevent infinite loop Modules: colisprive * Add a favicon Modules: colissimo * Get full history Modules: cragr * Fix broken perimeters * Get rid of not required assert * Account type on label before section title * Update label and balance on market websit * Fix bad home url and no account link for market accounts * Fix when cards and market accounts * Do not globally crash if we can't go to the market page * Fix current_perimeter and no link for market * Fix guessing of market links (use real hostname, not proxy's one) * Fix investment parsing and add vdate * Type and history of ESPE INTEG * Fix cards history navigation * Fix PEL history * Fixing cragr investment * Fix regression with cards navigation * Handle pagination on cragr CardsPage * Fix invest parsing * Do not crash on cards on some weird cases * Raise wrongpass on cgu * Fix investment parsing * Correctly handle the first connection page * Fix bad detection of current perimeter * Truncate passwords to first six chars * Remove trailling chars in isin * Fix encoding in investment code * Don't try to detect perimeter on not handled page * Handle perimeters having the same name * Handling currency on multiple card * Truncate username to the first 11 chars * Add new DAV TIGERE accounts * Fix infinite loop on wrong pass * Fix cards * Fix transactions parsing (new column) * Add account CPTEXCPRO * Fix multiple cards accounts * Update ordering date in get_history, it's useless and the link might be dead. * Fix transactions parsing on some accounts type * Fix bad isin * Handle life insurance on bgpi website * Fix some lifeinsurance * Adding pagination on accounts page * Fix parsing of unitprice on some market accounts * Fix portfolio_share on bgpi invest * Fix crash when no investments in BGPI * Fix listing card with pagination * Fix get of IBAN * Adapt to new CapBankTransfer API * Don't try to read history on market accounts * Fix detail unavailable on market accounts * Fix parsing of valuation_date of market invest * Seems like cragr normandie is not using new login method anymore * Update webid of deferred card to avoid duplicates * Fix sublabel parsing, sometimes there's no sublabel parent Modules: creditcooperatif * Add coming card page * Limit password to 12 chars * Fix xpath issue * Fix crash on technical error on website * Add IbanPage support * Fix crash on notavailable iban page Modules: creditdunord * Add bank SMC support * Add bank nuger support * Fix transactions parsing on rhonealpe * Unify regular and pro accounts cards handling * Fix deferred_card typing * Dectection of wrongpass * Fix duplicate accounts * Skip accounts without details * Fix bad isin like FR0010411884 * Handle no account * Move to browser2 * Handle loans on pro website * In iter_* methods, raise AccountNotFound if account is not found, instead of crash * Fix navigation on website to list loan accounts * Fix parsing of transactions without value date * Fix parsing of euro funds * Add loan typing * Fix navigation on website to get transactions * Fix creditdunord transaction date parsing * Some dates are not available instead of a parse error Modules: creditmutuel * Fix history and investments of life insurance accounts * Fix life insurance * Fix coming for cards * Fix when unitprice not available * Set default balance value to NotAvailable * Handle fleet cards * handle page to detect new website * Fix date parsing for cards * Raise skipitem instead of parse error * Fix amount commission of non euro fleets transactions * Handle hidden parts of labels * Fix isin parsing * Adding IBAN for new website * Parse life insurance's transactions dates as French dates; * Get IBAN based id * Handle pagination * Fix crash on more transactions * Only use last card differed for coming * Support cb diff * Adding cards to creditmutuel's new website * Fix setting deleted to transactions * Fix parsing of differred_date * Don't crash on empty city field * Use new CapBankTransfer API * Fix id and IBAN of accounts on old website but displayed on new accounts page * Fix date parsing for coming * Handle real no accounts on cic * Fix currency on lifeinsurance accounts * Fix crash when there is no bank accounts * Fix card names and set coming balances * Fix multiple month of history on cb differed * Correctly handle lifeinsurance accounts on cic * Handle newhome page to detect new website * Fix original amount of card transactions on new website * Get now about 6 months of history on new website * Handle loan history page * Handle page and fix crash on history on some accounts * Handle another user page * Fix card history link * Fix transfer on the new website * Add support of creditmut pro and add transfer category * Fix regexp for URL of subbank * Fix finding account and recipient in init_transfer * Skip wrong IBAN instead of crash * Limit transfer label to 27 char instead of raising error * Add cards on new website with tiers page * Add transfer.account_balance * Don't crash if a transfer has no label * Truncate label checking * Strip transfer.label to compare with bank return * Detect ActionNeeded after login * Prefer None accounts_list over missing attribute * Skip debit card * Add support of life insurance on new website * Add advisor * Parse balance and currency of cards in some cases * Raise wrongpass with error messages Modules: cuisineaz * Update to the new website site changed Modules: dailymotion * Fix module and bump to browser2 * Get video from page url Modules: delubac * Detect bad password * Add basic account types * Get IBAN * Fix transactions parsing Modules: dhl * Use dhl.com's JSON API * Add support for both DHL Express and Deutsche Post DHL * show URL in event description Modules: dlfp * Populate url attribute messages and thread objects * Always fill the parent attribute * Disable wiki tests when the backend is not configured Modules: dresdenwetter * Skip test if backend is not configured Modules: edf * Bump module to Browser 2 and fix parsing * Add edfpro website * Add a favicon * Always set vat attribute to to NotAvailable * Remove bad tests in edfpro folder * Ignore duplicates Modules: entreparticuliers * Fix parsing : site changed * Correctly handle source * Fix url field filling * Support new price_per_meter attribute of CapHousing * Fix bug when response is empty * Add a 100km default rayon value * Do not crash if area is unknown * Add a favicon Modules: explorimmo * Support new price_per_meter attribute of CapHousing * Fix bug in town names' encoding Modules: feedly * Update google login state * Remove need_login decorator for get_unread_feed Modules: fortuneo * Update certhash (#2550) * Detect wrong passwords * Fix duplicate of accounts * Don't try to get IBAN for checking account (token sent by SMS to customers) * Replace BrowserIncorrectPassword with ActionNeeded on renew password * Port to browser2 * Limit max time site wants us to wait in async requests * Fix separators cleaning for decimals Modules: francetelevisions * Ignore duplicate in videos search result Modules: freemobile * Fix subscription listing (site changed) * Fix sub._login parsing * Fix error when two bills happen on the same day * Id of details are not uniques anymore, so take build a new custom one Modules: funmooc * Base url of the website has changed * Fix module and add logged tests Modules: ganassurances * Add pagination to ganassurances/groupama module * Handle history and coming of another account type Modules: github * Port to browser2 * Shorten some long lines + fill url of Issue * Few fixes and tests * Use CacheMixin new class Modules: googletranslate * Bump to browser2 Modules: groupamaes * Fix bug when there is no credit anymore on PEE / fix account typing * Handle investment * Fix groupamas amount parsing * Fix crash when parsing investments * Fix portfolio_share range * Improve investment management (quantities of values of each funds are divided by availibility date) * Fix amount of withdrawal (Sadly withdrawal are not incomes) * Add a label in order to detect negative amount in transactions Modules: happn * Fix issues with new kind of ids Modules: hsbc * Fix account type * Add more history with pagination * Cache accounts and fetch IBANs * Fix accounts typing * Fix rib navigation * Fix currency of accounts * Auto delete card summary * Handle when website duplicates tr list * Raise not error implemented on life insurance for history * Add more account types to avoid crash Modules: ideel * New way of handling free shipping (#2146) Modules: ilmatieteenlaitos * Adapted to site changes Modules: imdb * Update imdb favicon to make it more different from the allocine one Modules: imgur * Implement gallery search and CapImage * Add date attribute Modules: ina * Fix duration parsing Modules: indeed * Search for words in the entire advert, not only in the title * Indeed now uses https Modules: ing * Use CleanDecimal to simplify parsing * Add history for life insurance accounts * Fix ing 500 error on bill download * Fix investment on multiple line * Handle blank transaction label * Loop on coming from market website to avoid 500 errors * Fix missing some investments * Increase requests timeout to 60 seconds * Fix id of life insurance * Fix investment on life inssurence and history on all accounts * Fix name of Account._id field * Fix navigation on the new life insurance pages * Refresh account link * Quick fix navigation * Ahistory to some asv and more * Get IBANs for accounts * Transactions detail might be unavailable * Some fixes on market accounts * Use new CapBankTransfer API * Only go on IBAN page for valid account * Fix transfer method signature * Catch action needed * Seems like response headers of download might change * Don't raise ActionNeeded for a check reception notice * Disable CapTransfer since it's broken * New login for asv page * SSL errors due to a bad certificate, so create it manually and fix a false https * Avoid re-login after lifeinsurance and market pages * Before many operations, try to go on main website first Modules: inrocks * Bump to browser2 / inherits from genericnewspaper module Modules: ipinfodb * Bump to browser2 Modules: itella * Update to use JSON API * Handle missing arrival date * Use status from JSON instead of guessing Modules: jcvelaux * Add api_key backend option * Fix str-unicode warnings and port to browser2 Modules: jvmalin * Add a favicon Modules: lacentrale * Bump to browser2 * Module connot handle products without criteria * Improve products management Modules: lcl * Remove SSL hacks (no need to RC4 anymore) * Add individual loans to lcl * Fix loans post bourse deconnection, fix loans regex * Fix unique id on loans lcl * Add certhash * Use valuation for BoursePage objects, not balance * Raise wronpass if the password is not a digit * Change label of transactions and yield card_summary * Retry read of amounts (hack to fix broken HTML) * Don't return 0 as account ID * Fix bad isin like FR0000120404 AC * BUMP LCL entreprise browser to bump2 * Fix isins like FR12345435 ABC * Code of investments might be unavailable * Rework of transactions type parsing * Don't crash when tbody is missing on market accounts table * Add a new account type * Get more history on several account types * Fix matching asv accounts * Keep check type on labels * Fix life insurance matching from site to site * Fix lifeinsurance * Check if the IBAN is for the current account * Fix crash if there is no IBAN * Catch password expired * Fix duplicate id on lcl pro * Fixing transactions are in multiple account * Fix params of history navigation when only one account * Add transfer support and use new api * Ignore HTTP error 500 on history * Have a default accounts_list to be able to bypass login * Add transfer.account_balance * Fix investment unitvalue * Fix iter recipients on loans * Handle loan not available * Fix lcl espace pro and enterprise login * Adding advisor for lcl * Add more regexp for transaction types Modules: ldlc * Better way to get subid * Add a favicon Modules: leboncoin * Adapt to new website design * Fix incomplete url in pagination * Website now uses https * Fix description field filling * Support price_per_meter new attribute * Fix typo for poitou charentes region * Add url attribute on objects built from list * Fix cost for items in rent search page Modules: lefigaro * Bump to browser2 / inherits from genercinewspaper Modules: liberation * Bump to browser2 / inherits from genericnewspaper Modules: logicimmo * Retrieve a bigger photo * Do not crash when area is unknown * Support price_per_meter new attribute * Fix town search Modules: lutim * Fix tests Modules: mailinator * Port to apibrowser Modules: mangafox * Add a favicon Modules: mangago * Add a favicon Modules: mangareader * Add a favicon Modules: marmiton * Always retrieve title Modules: mediawiki * Implement CapImage for searching images * Use https by default * Fix image search Modules: minutes20 * Bump to browser2 / inherits from genericnewspaper Modules: monster * Fix: site changed Modules: myhabit * Update after website has changed (#2615) Modules: nettokom * Add a favicon Modules: newsfeed * Populate url attribute for messages Modules: okc * Revert "do not remove old threads anymore" introduced in 1.1 Modules: oney * Fix login * Verify SSL/TLS certificate again * Raise wrongpass when password is not 10 chars Modules: opensubtitles * Fix opensubtitles small site change Modules: orange * Fix orange module which works with sosh * Add label for bills * Support multi account and more * Remove old url Modules: ovh * Fix login, remove API calls (fixed several times, OVH login page often change) * Add a favicon Modules: pap * Remove dots from cost * Support new price_per_meter attribute of CapHousing * Update to the new website Modules: pariskiwi * Fix module and prefer json mediawiki api Modules: parolesmania * Fix song search * Site changed, search artist corrected * Adapt module to not use SongLyrics construtor anymore * Bump to browser2 * Artist search: remove page calls to browser methods Modules: parolesmusique * Site changed, search song and artist corrected * Adapt module to not use SongLyrics construtor anymore * Bump to browser2 * Artist search: remove page calls to browser methods * [parolesmusique] artist search : remove page calls to browser methods, browser now does what it should : browsing Modules: parolesnet * Adapt module to not use SongLyrics construtor anymore * Bump to browser2 * Artist search: remove page calls to browser methods * Fix parolesnet, iter artist lyrics : just consider first song list to avoid ID duplication Modules: pastealacon * Fix test_spam test * Force site encoding, it is iso8859-15, not utf-8 * Fix post test when backend is not configured Modules: paypal * Update account_type at the beginning of get_accounts method * Fix crash on old website * Fix parsing of converted amount * Add english word to skipped transactions * Fix part converted amount for some transactions * Bypass new anti-parsing protection of the website * Support multiple accounts with different currencies * Get data-ads-challenge-url attribute (anti-scrapping protection again) * Catch 500 on detail and skip transaction * Fix detection of account currency in weird case * Consider that tr is valid if transactionStatus not present * Fix currency detection * Better detection of currency * No crash on securisation step * Fix domain of detail navigation * Fix transactions detail link * Fix parsing of converted amount * Fix crash on transaction conversion * Skip transactions labeled 'Bill to' * Display a warning when a currency is not found and ignore account * Fix account_type detection * Handle more home page to detect account type * Fix paypal payback * Handle more login page * Add home page paypal * Skip fake transactions * Handle another wrongpass page * Exclude draft transactions * Account detection on accountPage too * Fix value seperator detection on perso accounts * New fixes for login issues * Raise unicode message in BrowserIncorrectPassword exception * Use json data for transactions parsing * Pagination and some improvements * Problems with amount and decimals * Skip empty transactions * Set Iban as NotAvailable for all Paypal accounts * Handle english transactionStatus * Skip broken transactions * Exclude fake transactions (for english website) * Skip suspended transactions * Handle textual amount is integer * Exclude fake transactions * On old website, try to go on the new one * Skip 'Annulation des frais de PayPal' transactions * Paypal commission are now net minus gross * Detect ActionNeeded * Computation commision if it is not null * Add one more login parameter * Parse secondary transaction based on label Modules: piratebay * Ported to browser2 * Handle fuzzy dates Modules: poivy * Add a favicon Modules: popolemploi * Fix search: site changed Modules: presseurop * Bump to browser2 / inherits from genericnewspaper Modules: prixcarburants * Bump to browser2 / handle date of update * Fix parsing date (#2606) * Adapt module for new comparoob API * Website behaviour changed (#2634) * Set default configuration for tests * Update url to new website Modules: radiofrance * Fix: all websites are updated * Fix franceinter * Fix france culture podcasts * Handle selections and podcast from francetvinfo Modules: regionsjob * Handle case advert is coming from another website * Add a place filter Modules: residentadvisor * Add a favicon Modules: s2e * Fetch history on the right account * Remove id on transactions: it's not really an id * Fix capeasi login page and condition on fetching transactions * Using website with more details * Fix transactions investments valuation parsing * Fix parsing of accounts and history pages * Add currency support, add new account types * Don't crash when the customer has no account * Catch another real no accounts * Handle multientreprise * Fix transaction amount sum * Add new SWISS account type * Handle maintenance page * Add new hashes for virtual keyboard * Detect more no accounts * Handling weird wrongpass * Add a favicon * Add AMF code to investments Modules: seloger * Fix xpath for looking into cities * Retrieve all cities * Fix typo for photos * Do not crash if area is unknown * Add support of new price_per_meter field for CapHousing * Fix pagination Modules: senscritique * Fix: site got updated * Fix: json url changed * Fix parsing date Modules: societegenerale * Add cookie before login * Fix account type * Handling some wrongpass * Bump SGPE browser to browser2 * Add rdate to lifeinsurance for the sake of sorting * Do not yield canceled transactions * Raise wrongpass instead of crash for non-digit passwords * Handling multispace on sogepro * New soge entreprise browser * Add new type for transaction * Add deffered card detection * Website limit login to 8 char * History pagination * Catch login forbidden * Fix xpath on invest * Handle the two different parsing cases on invest * Catch wrongpass * Investments are now more detailed * Add advisor * Switch to browser2 * Fix pagination in life insurance history and use Form class * Add transfer support * Fix ix account id being different in sending panel and list * Handle renew password and raise ActionNeeded Modules: sueurdemetal * Fix fillobj method Modules: t411 * Site url changed * Get get_torrent_file() to work * Add tests Modules: taz * Bump to browser2 / inherits from genericnewspaper Modules: transilien * Fix: site changed Modules: twitter * Fix: site changed Modules: ups * Use https Modules: vicsec * Website got updated (#2177) * Case fix (#2134) Modules: vicseccard * Website updated (#2134) Modules: vimeo * datePublished attribute was renamed to uploadDate * Handle JSON format changes * Fix categories videos in order to use API Modules: virginradio * Correct a bug occuring when the StreamTitle is empty Modules: wellsfargo * Handle webpages with no transaction activity (#2123) * Try to get a statement multiple times (#2123) * Handle SMS security code, leap and non-leap years (#2618) Modules: wordreference * Fix module for new website * Update tests Modules: yahoo * Bump to browser2 Modules: youjizz * Fix parsing of video urls * Support mp4 videos * Use now https, but not for all videos (sometimes not available with https) Modules: youtube * Use googleapi module instead of gdata which is obsolete Weboob 1.1 (2016-02-11) General * Last release with python 2.6 support * New CapShop capability (#1662) * New shopoob application * Add new 'weboob' script to find applications * New APIBrowser class * Add a contrib script to help forking weboob * New WEBOOB_DATADIR environment variable General: removed modules * Removed grooveshark module: website is closed * remove module hellobank, use bnporc instead General: new modules * New Amazon Store Card banking module (CapBank) (#1698) * New bforbank module https://www.bforbank.com (CapBank) * New kiwibank module https://www.kiwibank.co.nz (CapBank) * New s2e (Employee Savings Plans) Support for Esalia, Capeasi, "BNP Paribas epargne & Retraite Entreprises" and "HSBC Epargne et Retraite en Entreprise" (CapBank) * New Victoria's Secret store credit card module (CapBank) (#1732) * New agendaculturel module http://www.agendaculturel.fr (CapCalendar) * New residentadvisor module https://www.residentadvisor.net (CapCalendar) * New happn module https://www.happn.com (CapDating) * New freegeoip module https://freegeoip.net (CapGeolocIp) * New ipapi module http://ip-api.com (CapGeolocIp) * New entreparticuliers module http://www.entreparticuliers.com (CapHousing) * New explorimmmo module http://www.explorimmo.com (CapHousing) * New logicimmo module http://www.logic-immo.com (CapHousing) * New virginradio module http://www.virginradio.fr (CapRadio) * New Ideel module http://www.ideel.com (CapShop) (#1733) * New MyHabit module https://www.myhabit.com (CapShop) (#1734) * New Victoria's Secret module https://www.victoriassecret.com (CapShop) (#1731) * New blablacar module https://www.blablacar.fr (CapTravel) * New dhl module http://nolp.dhl.de (CapParcel) * New dpd module https://tracking.dpd.de (CapParcel) * New gls module https://gls-group.eu (CapParcel) * New itella module http://www.itella.fi (CapParcel) * New funmooc module https://www.france-universite-numerique-mooc.fr (CapVideo) * New rmll module http://video.rmll.info (CapVideo) * New vine module https://vine.co (CapVideo) * New ilmatieteenlaitos module http://ilmatieteenlaitos.fi (CapWeather) * New ldlc module https://secure.ldlc.com and https://secure.ldlc-pro.com (CapBill) * New t411 module https://www.t411.in (CapTorrent) Core * Repositories update: display a message when all modules are up-to-date * Log full backtrace on module build error * Update windows installation (#1668) * Better detection of gpgv.exe location * Fix issues when using NamedTemporaryFile on windows * Add a datadir option, handle WEBOOB_DATADIR * Use gpg by default rather than gpgv for signature verification * Create empty temporary GPG homedir * Exclude backend using instance_name instead of module_name * Try to be consistent in variable name between backends and modules * Convert StopIteration for PEP 479 Doc * Account() constructor does not take an id * Fix symlink creation in setup.rst * Use browser2 in module documentation * Add few docstrings in core and browser Filters * Add Eval filter, for arithmetic expressions * Add Slugify filter * Add a JSValue filter to look for literals * Add Decode filter, to decore urlencoded strings * CleanText: add Unicode normalization * Regexp: nth param can now be '*' to find all * Attr: fix error message * CleanText: fix paramter name "children" * DateTime: handle TypeError exception raised by parse_date * Duration: correct '_regexp' attribut name * Dict: several improvements * Join: improve it to work like join command * Join: add ,ewMone, addBefpre, addAfter parameters * Async: if AsyncLoad parameter is None, do not try to open it * CleanDecimal: convert INT, float and long (and not only str) * Attr: fix an error message * Dict: handle TypeError in parsing * Time: Update regexp to catch more values Browser * Add comments on Form class * New unit tests * New api for content, encoding, and document building * Add ChecksumPage class * Cleaner way to get rid of BOM for CsvPage * Fix wrong encoding detection logic * Detect XML encoding * Enable passing the path to a CA file to Browser.VERIFY * Add an asset method to get absolute path of module local files * Browser.VERIFY can now be a module local file * Fix compatibility with python 2.6 in HTMLPage (#1651) * TableElement: fix count columns when there is an attribute "colspan" * Do not display urllib3 warning if there is no TLS certificate verification * Add an IPhone profile * Add a GoogleBot profile * Add method Browser.set_profile * DomainBrowser: ability to give the baseurl in constructor * Add LoginBrowser.do_logout() method * Handle "Refresh" meta tag in HTMLPage, with a REFRESH_MAX option * Add an absurl method to Page * Fix crash when using HEAD on a page-matching URL * Add BrowserQuestion exception (ask user to change config when raised) * Add 'replace' xpatch function in HTMLPage * Introduce new DictElement class * Add some JSON helpers * Strip data on CsvPage * Better control of HTTP referrer * Allow changing the Session class * Pass async/sync callbacks in the same way * Bump Firefox version to next ESR (38) * Fix documentation: use HTMLPage instead of Page * Add StatesMixin class to store state of a browser * Change worker pool size after session init * Allow to force method in URL.go (pass argument to location()) * Support using id in HTMLPage.get_form() * Rename async parameter to is_async Old Browser * Do not use PROTOCOL_SSLv3 as it is deprecated, use bad named PROTOCOL_SSLv23 instead * Add BaseBrowser.get_page method (don't change the location) * Add a StateBrowser to store cookies in storage * CSVParser: catch exceptions * Disable lowsslcheck if there is a proxy, as ssl doesn't deal with it Capabilities * Add the possibility to define Field type argument as a string * Create enum. Use it in calendar and housing (code factorization) * Add a way to instantiate an object from a dict of its fields values * Add russian ruble and XOF currencies * Add SGD, BRL, JPY and MXN in currencies Capabilities: Audio * Move specific audio filters from capabilities/audio.py to tools/capabilities/audio/audio.py * Add specific filters to create audio objects id * Do not require an id in constructors Capabilities: Bank * Fix StatusField to be a BaseObject * Change quantity type to decimal number * Better explanation for Investment class * Introduce new type Account.TYPE_LIKE_INSURANCE * Add credit limit, payment due date and amount for credit card bank accounts (#1717) * Add IBAN properties * Add card number and commission in Transaction * Add original_amount and original_currency in Transaction * Add country in Transaction * Add Transaction.investments and Investment.vdate attributes * Add Account.valuation_diff attribute * Add Account.number attribute Capabilities: Bill * Inherits Detail and Bill from Currency * Remove Bill.idparent attribute * Add Bill.vat attribute Capabilities: Calendar * Add timezone parameter to calendar event in order order do get the good date/hours in ical exports * Add a field 'summary' to Query object * Add ticket status in BaseCalendarEvent * Add a ticket field to Query * Add BaseCalendarEvent.timezone attribute * Add new categories Capabilities: Cinema * A person may have now several roles in a movie Capabilities: Collection * Do not require an params in constructor Capabilities: Contact * Set default value of Contact.profile to OrderedDict() Capabilities: Dating * Fix API to store optimization name in object ID Capabilities: Gallery * Correct method name: s/search_gallery/search_galleries/ Capabilities: GeolocIp * Add osmlink field Capabilities: Housing * Support new type SHARING Capabilities: Messages * Remove _Message and _Thread and use strings in Field instead Capabilities: Recipe * Do not force to use id in object constructor Capabilities: Torrent * Remove name mandatory parameter in constructor Capabilities: Thumbnail * Thumbnail now inherits of _BaseImage Capabilities: Weather * Do not require an id in constructor * Fix default value for date * Cosmetics in temperature formatting Applications * Backport check_output function for python 2.6 * Remove wconio dependency on win32 platform * Allow ResultsCondition to compare timedelta * Encode properly output in console.py (#1673) * Fix BrowserSSLError catch in ConsoleApplication (#1702) * Handle attribute error when stdout does not habe encoding attribute * If backend name is already taken, suggest the first available one with the same base * Formatters: use weboob.tools.misc.guess_encoding instead of utf-8 * Formatters: manage tty colummns while displaying text * Use os.devnull and binary flag for windows compatibility Applications: REPL * Fix a crash when ReplApplication.do() is called with a function * Create a message for 403 errors Applications: boobank * Format: ISIN is a 12 letter word * Format integer for quantity * Sometines the full code is not available. Display description instead * Add a command 'Budgea' to export accounts and transactions * Fix investment display when some fields are empty * Identify credit card for each transaction in OFX export Applications: boobill * Use do_ls to cache objects in REPL * Add binary mode for writing. Fix file downloading on windows Applications: boobcoming * Fix crash without end_date (#1667) * Add search by summary * Print ticket status * Add search by ticket status * Handle error correctly in do_attends * Add a load command * Improve ical export (end lines with '\r\n', as RFC says) * Add timezone in ical export * Display price as float * Improve date display * Do not crash during export of an unknown event Applications: cineoob * Give roles informations in persons_in_common and movies_in_common * Support several roles in the same movie for an actor * Movies in common are now sorted by release year * Fix problem with stream parameter in request.get in python-requests v2.5 (#1683) Applications: flatboob * Display backend in city choice Applications: geolooc * Fill OpenStreetMap link Applications: havedate * Store optimization name in object ID Applications: parceloob * Clean cached objects before getting new ones Applications: qcineoob * Add 'view' and 'view in new tab' buttons for all search results * Add 'view thumbnail' for movie and person search results * Factorisation of events in search results * Persons in common implemented in movie page * Movies in common implemented in person page * Support several roles in the same movie for an actor * Better display of search results, spaces added * Increase biography field size * Movies in common are now sorted by release year * Better user input validation for same-person movies in common Applications: qcookboob * Implement tab navigation (#1290) * Fix bug when thumbnail_url is empty Applications: radioob * Can now download full album * Add file in search subcommand Applications: videoob * Fix the problem with streamed calls on requests (#1683) * Display download subcommand in debug mode Applications: weboorrent * Fix formatter for info command Applications: weboob-config * Improve info command to allow json formatting * Put all config details in a dictionnary * Format capabilities as JSON array * Add installation status in modules subcommand * Prompt user to accept an untrusted keyring (#771) * Add module_name param in add_backend to allow command line interaction * Update help of "add" command Tools * Move guess_encoding into weboob.tools.misc * Add a Javascript class * Avoid crash on UnicodeDecodeError with retry decorator Tools: bash-completion * Hide error (#1671) Tools: date * Supporting french month abbreviation without dot * Extend date_max_bump default value to 31 days in LinearDateGuesser and ChaoticDateGuesser * Add some french translation * Parse french date with DMY order by default Tools: virtkeyboard * Fix not logical arguments order * Dump of tiles: save full image too * Allow to receive a list in get_symbol_code() method * Support pollution in coords attributes Contrib * Add a gtk appindicator for boobank * Remove bashisms in report_accounts.sh * weboob-generic: fix object listing when tomonitore is not set Contrib: downloadboob * Print link message only when needed * Fix new file detection * Support download of m3u8 files * Allow passing config and section filter on command line * Replace call to 'fill_video' by 'fillobj' Modules: 750g * 750g is now working using browser2 (#1706) * Fix: Only select the first thumbnail image * Fix: Site changed * Improve instructions parsing Modules: adecco * Bump to browser2 Modules: agendadulibre * Add missing favicons * Adapt for timezone support * Do not crash when json included in webpage is not valid * Correctly retrieve start and end date Modules: allocine * Remove excessive quote_plus call on pattern to make multi-word search work again * Adapt for more informations in persons_in_common and movies_in_common * Fix: accents were causing problems in search * Handle videos from allocine * Handles showtimelist in allocine * Fix: bug while playing videos from external url * Fix: syntax error on allocine * Adapt for timezone support * Max rallocine rate is 5 * Fix unicode warning Modules: allrecipes * Adapt to new version of website * bump to browser2 Modules: amazon * Skip "In transit" orders. (#1684) * New discount: "Lightning Deal" (#1684) * Generate payment transaction if there aren't any (#1684) * Order charges xpath fix (#1684) * Amazon module: skip 'Not yet shipped' orders (#1699) * Amazon module is updated according to the website change (#1715) * Skip "On the way" orders at Amazon (#1716) * Support new version of Amazon order details header (#1721) * Retry Amazon requests after ReadTimeout exception * handle Timeout exception as ReadTimeout has been introduced in recent versions of requests * Add French Support and Shopoob compatibilities * Add french translations * Retry ConnectionError as well (#1742) * pep8 fixes * Support for a new payment layout and priceless items (#1764) * Scrape the updated website (#1808) * Update after site changes * New status to ignore * More shippings and discounts (#1853) * Retry getting an order page (#1876) * amazon bills * Fix: work with iter_resource, and use ISO currency codes instead of symbols Modules: ameli * Update after sites changes, and upgrade to new browser * Handle authentication errors * PaymentDetailsPage: use a simpler URL * Site was updated * details isn't implemented: remove dummy code * ameli: prevents crashes when no bills are available Modules: amelipro * Update after sites changes, and upgrade to new browser * Fix decimal bug Modules: americanexpress * Handling no amount on account * Add default date to beginning_debit_date * Handle new americanexpress site but only if there is only one card * Increase timedelta to guess real date * Handle US account * Amex is dumber and dumber ( increase time delta because amex have hard time to put the date in a good interval) * Fix parsing of rdate * Fixing card type * Removing useless id Modules: apec * Use https instead of http * Adapt to the new version of the website and use browser2 Modules: arretsurimages * Fix: get videos titles in h1 (#1447) * Fix: correctly implement search and add a test (#1691) Modules: arte * Fix bug id was not well filled in info command and title was not filled * Adapt to browser2 * Fix display bug during newly install * Default value must be key, not label * Fix bug when urls are not found * Fix bug when date is not available * Handle special characters in search * Fix arte concert (a fields has been removed fron json) * Handle special cases in json parsing * Do not raise 404 error while searching a video using an other site url * Fix program menu management * Fill id using a better value for arte cinema Modules: audioaddict * Fix description data removal from audioaddict API * Rename SKY FM to Radio Tunes * Add Fresca Radio Modules: aum * Search query string: replace %(lat)s and %(lng)s with position in my profile * Fix parsing of geo position Modules: axabanque * New login pages on axabanques (#1709, #1711) * account.id is now only paramNumCompte if there is not paramNumContrat * Handle expired password * Handling banned account * Do not try to recover transaction from DAT account * axabanque fix duplicate accounts id * Handling duplicate id for account using Jsp Id * Stop parsing history of investment accounts * Fixing random number formating * Add error page Modules: banqueaccord * Fix inconsistent history on loan accounts if there is no init date * Labels of login fields changed Modules: banquepopulaire * Support new authentication on some region websites * Fix login on new website (needs upper case login) * Fix crash for new cards with no debited history * Break the new protection * Support full list of accounts (#1360) * Fix crash in a particular case of navigation * Supporting new account page * Parsing last connection date correctly * Fix navigation when passable unavailable page is displayed before login * Support case where user may accept TERMS_OF_USE * No history if account has no prev_balance * Apply alsace and lorrainechampagne fusion in bpalc in banquepopulaire module * Add Investment accounts * Correctly return an iterator even if this isn't an investment account * Fix crash on empty field banquepopulaire investment * Add life insurance investment * Skip message pages to get_investment on banquepopulaire * Fix a crash on iter_accounts after an investment on banquepopulaire * Remove stored 'token' attribute from browser and fix navigation on banquepopulaire website * Correctly get token only when available * Handle error page to avoid global crashes * Fix to get token * Adding support for IBAN * Fix getting tokens on some pages * Attempt to fix cgu validation * Adding loan * Add unavailable page * Fixing useless id * Ignore \0 bytes in documents Modules: barclays * Add AssurancePage on which we don't support get_history * Fix barclays navigation * Handle suspended accounts * Fix bug when card is first account * Support more account types * Sorting transaction before returning * Fixing page payement to foreign currency * Remove print * Remove bad transactions ids Modules: biplan * Site changed * Detect invalid events * Do not crash when no time can be found * Add timezone / fix encoding and hours detection * Fix parsing error on start date Modules: bnporc * Fix to get transactions when they are ordered by type * Get IBAN of accounts * Do not try to get IBAN for delegated accounts * Add investments to bnporc module * Handle corner case * Move old code for old site in a new folder * Add support for new bnp site * Move new browser into pp/ * Parse transaction labels, and fix account's coming * bnp history not supported on life insurance * Investment not implemented for entreprise browser * bnp investment fix * Handle error message after login * bnp type life insurance on capitalisation accounts * Do not get investments from PEA Espèces * Handling account without history * bnp history always return an iterator * New bnp entreprise certhash * Switch to new website and several fixes * Correctly set IDs * Raise BrowserIncorrectPassword when user should use hellobank instead * Raise IncorrectPassword after 100 connections * WIP on new company bnp website * Adapt module to use Browser2 * Add company browser * Fall back on old website for pro accounts * Add iban field for company accounts * New certificate * Fix compatibility with python2.6 * Fix concerning banqueprivee subdomain * Handle website unavailable for history * Better handle of expired password * rename pp folder to ppold * Fix PEP8 E713 * Support lifeinsurances on new website * Add authentification error code * Skip transaction without date * Adding support iban for some pro account * Automatically update password to the same one when the 100 connections threshold is reached * Type more accounts to get history and transactions investments on those * Revert fall back on oldwebsite for pro accounts * Add a page to renew password * Support checking type * Adding loan for crédit immobilier * Calculate IBAN key if messing * Add Hellobank support * Use shorter id * Revert "[bnporc] use shorter id" * Handle investment and history on market accounts * Fix crash if bnp throws 500 HTTP status code * New connection threshold page url for hellobank * Valution_diff on market accounts * Add number to iter_accounts * Fixing bad id for coming transaction * Prevent us from crashing when bnp crashes Modules: boursorama * Add investment * Support market investments * Fix duplicate entry on card account * Cleaner way to iterate * Better explanation for Investment class * Fix website changes (virtual keyboard, accounts list) (#1696) * Ignore moneycenter accounts * Minor fix * Introduce new type Account.TYPE_LIKE_INSURANCE * Use two_authentication with BrowserToBeContinued instead of raw_input * Use StateBrowser, s/BrowserToBeContinued/BrowserQuestion/ and coding style fixes * Remove text after card number if any * Raising incorrecte password when profil is incomplete * Fix CC history for boursorama * Update hash of boursorama's certificate * Fix duplicate accounts * bourso new investment page and fix parsing * Fix crash when there is more data in the cell * Fix PEP8 E713 * Fix parsing of unit price * Fix investment link parsing * Ignore immediate debit cards * Investments on lifeinsurance transactions * Fix pagination of lifeinsurance history * Ignore promotional fake accounts * Fix parsing some special market accounts * Valuation diff on lifeinsurance accounts * Fixing bad id transactions * Do not use useless id * Fixing false id in transactions * Fix parsing of investment label * Fall back on old website if we are on the new one Modules: bouygues * Rewrite backend using browser2 (#1970 and #1978) * Add support for bill on bouygues * Avoid useless login * Handle website modifications * Home page uses https (#2510) Modules: bp * Support professional accounts * Update upstream certificate hash (#1702) * Handling when website have an error * Fix parsing of virtual keyboard url * Add a page to pro website * Catch a no online banking service at login * Set type of accounts on professional accounts * Identify credit card for each transaction * Update to new certificate * Adding IBAN support for banque postal pro * Add a regexp on withdrawal labels * Parse IBAN for personal accounts * Do not crash if there is no IBAN for an account * Iban in unicode * Fix for newer pdfminer versions * Fixing bad account type on pro website * Sorting transactions before returning them * Fix for new API * Only call initialize if needed * Fix get_pages usage for new API * Fix newapi import * Fixing fake id for transactions * Fixing pdf parse with new api * Fixing no RIB Modules: bred * Support new website of bred * Fix compatibility with Decimal of python2.6 (#1685) * The 'categorie' key isn't always in json * Detection of disabled accounts * Correctly strip currency code * Correctly deal with cookies storage * Add type Account.TYPE_DEPOSIT * Catch technical error at login * Fix duplicates accounts * Fix PEP8 E713 * Get IBAN on accounts * Dd certash * Handle multiple universes * Oops fix mistake Modules: caissedepargne * Fix getting card accounts on old website * Set type on card transactions * Support Banque BCP which uses same website than caissedepargne * Do not force TLSv1 anymore as in some cases it doesn't work * Investment on lifeinsurance and market account * Add balance on NUANCE * Fix IndexError related to investment feature * Handling website error for market place * Fixing index error when checking if we are on error page * Fix BrowserUnavailable when browser is on market pages * Iban on cassedepargne accounts * Add new certhash * Ignoring CB transaction aggregation * Try to type more accounts * Adding support for saving type * Prevent crash on market * Get more investments * Valuation_diff on market accounts * Fix crash if there are several market accounts * Fix not authorized to read market accounts * Fix accounts parsing on banquedelareunion * Adding compte titre type * Fixing leaving investment space Modules: canalplus * Correctly fix the problem with streamed calls on requests (#1683) Modules: carrefourbanque * Fix accounts parsing * Fix 404 on history and now support "compte livret" * Fix when account balance is negative Modules: cci * Update for Join filter changes * Site changes Modules: chronopost * Status guessing Modules: cic * Handle new certificate * Supporting mouvements.html and situation_financiere.html * Fix list index out of range on iter_accounts * Rewrite module to browser2 (based on creditmutuel) * Cic can have letter in login * Add IBAN on cic * Fixing cic account with "Contre-valeur" Modules: citelis * Certificate hash change Modules: citibank * Do not wait for transactions if there's none. (#1661) * Credit limit, payment due date and amount for Citibank. (#1719) * Use V8 for login (#1743) * Relogin when the website returns garbage instead of a PDF. (#1820) * Site was updated. Closes (#1820) * Parse thousands correctly in the statements. (#1984) * Backport check_output for 2.6 Modules: cmb * Fix detection of authentication fail * Add deposit type in CMB module * Fixing when login is obsolete * Fixing cmb with some pro module * Quick fix for multiple space. Modules: cmso * Add pro browser to cmso bank module * Correctly raise instance of BrowserIncorrectPassword * Correctly handle 500 error during login * Fix parsing of market accounts and factorization of the Transaction class * Fix website changes on auth page * Go to subscription page before get accounts for some users * Use a local instance of LinearDateGuesser instead of global one * Support pagination of transactions * Fix: coma are used as decimal separators * Correctly handle expired sessions * Fixing duplicate entry * Handle double site type on the pro side * Clean + blackbox compatibility on cmso pro Modules: colisprive * Rewrite for browser2 * Fix history parsing Modules: cragr * Fix parsing of labels with new crédit agricole website * Fix parsing of raw transaction text * Handle useless pages to prevent being redirected to mobile version * Get IBAN on accounts * Detect connection errors * Add new labels to market type * Fix account list parsing, skip irrelevant account * Fix getting history for card accounts * Fix import of Account * Add tdbgestion page * The type of PEL accounts is now SAVINGS instead of MARKET. * Refactor * Support life insurance accounts * Handle sessionSAG parameter * Support market accounts * Handling bad investement parsing * Handling bad value for investement * Fix parsing on cragr investment * Fix av investment parsing * Do not return NotAvailable if value == 0.0 * Support loan accounts * Fix double clean of investment amounts * Add account types * DAV PEA is a checking account * Handle new login navigation on some sub websites * Fix incorrect password on new login * Add page to fix login access * Fixing categorization * Cragr perimeters * Adding new saving account name * Fix infinite loop when a crash occurs on perimters * Fix when some perimeters are crashing * Fix broken perimeters * Fix in case of CGU poping when changing perimeters * Fix card accounts balance parsing * Fix mistake Modules: creditcooperatif * Update regexp to support SEPA transfers * Fix exception in some cases * Fix regexp for external transfer * Handle investment * Correctly return an iterator even if this isn't an investment account * Add attribute _inv to pro accounts Modules: creditdunord * Handle the case when the creditdunord CB label is "OPERATION SUR CARTE" (#1712) * Remove spaces from IDs * Handling account with no history * Handling no details for this account * Fix crash on accounts which doesn't support history * Handle duplicate accounts * courtois: we now skip transactions without date even on pro accounts * Fixing wrong id when no details for an account * Trying to avoid duplicate accounts * Fix courtois we now always return iter for investment * Handle IBAN * Fix auth fail url * Add VirtualKeybord auth * Change lifeinsurance accounts type * Removing false id for transactions * Fix life insurance accounts and add valuation_diff * Raise BrowserIncorrectPassword is password isn't digits * Fixing history for account * Fixing pro account * Fix assert for password * Avoids infinite loop in case of fail login Modules: creditmutuel * Handle new useless pages * Updat transfer method * Save and load state of browser into storage * Handle refresh on empty page * Handling already logged * Handling html page * /cmmabn/fr/ is a valid login page * If do_login() is called, force go on the login page * Handle refresh on LoginPage too * Handle disconnection * Fix accounts parsing * Fix parsing of 'soft' parts of account names * Fix parsing of balances if accounts page has been configured by user to display balance in several currencies * Clear cookies before to login * Better form detection * Increase timeout * Clean transactions label * Parse contactless payments ("PSC") transactions * Handling orignal currency * Using TableCell to handle dynamic transaction list * Ignore ELEVE CARTE line * Add account types patterns * Add type pattern for young accounts * Investment for market accounts * Fix crash when trying to find reale amount of market accounts * Fix portefeuille account parsing * Add IBAN on creditmutuel accounts * Fix parsing market accounts * Fix parsing of unitprice * Fix skipping market summary fake account * Fix parsing valuation of a market account * get more iban * Fix parsing isin codes in special cases * Handle new website * Redirect page added * Fix label * Fix parsing label of accounts on old websites * Fix wrong valuation on market accounts if several are present * Valuation_diff on market accounts and new balance for PEA * Account typing * Fix blackbox compatibility * Fetch more transactions * Fix detection if transactions are coming or not * Fix when last_debit is None * New accounts type * Life insurance on old website * Fill the rdate field on life insurances history Modules: cuisineaz * Site changed / rewritten using browser 2 Modules: dailymotion * Fix dailymotion "search" return bug message * Fix to get video url Modules: delubac * Rewrite module with browser2 on new website * Handle accounts and transactions * Website require a digit password Modules: ovh * Adding bill for ovh Modules: edf * Correctly set amount and currency on bills Modules: ehentai * original_title does not exist anymore * There is no more description available * Update cardinality field name * Use Thumbnail object Modules: feedly * Favicon transparency and remove JPEG artifacts * Use new DictElement object * Improve tests * Iimprove login management * Fix login * Do not crash when there is no title in article Modules: fortuneo * Detection of accounts type * Support investments detail * Add page to browser: pea account type * Introduce new type Account.TYPE_LIKE_INSURANCE * Update changed certificate * Fix fortuneo module now support "compte especes" * Fix support of PEA accounts * Fixing empty performance * Fixing 2nd detail line who was considered like investment * Fixing bad int values on investment * Fetch history of life insurances * compte-espaces is a AccountHistory page * Correctly set type of market accounts * Fix savings account type * Fixing closed life insurance account on fortuneo * Raise IncorrectPassword when there is new id * Throwing error when an sms is required to access information * Switching error to browser incorrect password * Fixing listing account * Fix crash when parsing accounts without balance * Fix navigation * Support deferred debit cards * Set type of card transactions * Fix new pass required detection Modules: francetelevisions * Fix "search" always return empty list * Correctly fix the problem with streamed calls on requests (#1683) * Remove "latest" feature * Fix pluzz's search (1700) * Add option to get video from an url * Handle lastest replay videos * Fix bug search date in bad balise * Fix bug: we can only search one time * Use new DictElement object * Fix: site changed (#1855) * Fix: site changed again (#1868) * Update tests * Fix bug while getting video from some url * Fix error when video url is none * Handle url from francetvinfo website Modules: freemobile * Correctly handle wrong credentials * Fix parsing of bills urls * Force UTF-8 encoding with the standard mechanism * Enable bills filtering for multi-account * Fix subscription date parsing for multi-account * Fix forfait name parsing for multi-account Modules: ganassurances * Rewrite ganassurance with browser2 and fix auth and history * Add missing date column title for cards history * Fixing statefull website with account's link changing * Fixing coming date with an other label * Change AccountsPage xpath to only get personal finances accounts * SSL is not supported anymore * Add changing pass/id page Modules: googletranslate * Fix code used by Google Translate for Greek Modules: groupamaes * Use a local instance of LinearDateGuesser instead of global one * Should now always find accounts * Fix : site changed Modules: hellobank * Fix permissions, encoding and copyrights * Do not try to get IBAN from life insurance accounts * Do not try to get history of life insurance accounts * Allow transaction parsing across multiple pages * remove module, use bnporc instead Modules: hsbc * Handling when website is gone away * Fixing shared accounts_list * Fix new list of accounts and new URLs * No history on loan accounts * Handling duplicate account id (#2114) * Submit two useless form to mimic browser * Fix date parsing * Add coming for cards * Do not use fake id for transactions from hsbc * Allow hsbc user to have more than 8 length password * Fixing credit is positive on some account Modules: hybride * Fix: site changed * Fix: Date parsing * Fix: site changed again * Fix bug when there is no end date * Iimprove end_date management * Update to support timezone * Use Decode filter to get the good id * Simplify id Modules: imdb * Fix: python datetime is locale-dependent * Fix: 'N/A' value in movie release date Modules: imgur * Port to browser2 * Implement CapGallery Modules: ina * Bump to browser2 * Handle CapAudio * Find video from url Modules: ing * Coding style * Change selection of keyboard (more generic) * Fix navigation after a transfer * Remove hack to convert decimal to int * Fix crash if there is no ':' in IDs * Update regexp * Allow birthday to be entered with separators * Support of ASV accounts * Fix switch between market and checking websites * ASV accounts don't have history * Fix detection of errors in page * Get valuation information in several locations * NotImplemented exception for history on asv and clean code * As ING website sucks, re-login to retry getting investments list * Introduce new type Account.TYPE_LIKE_INSURANCE * Fix website change * Be sure we are logout before login * Store "where" in ing browser * Fix bad login with cookie cache * Fix parsing of euro founds * Add a kind of life insurance account name * Fix parsing of ISIN code for market accounts * Fix switches between market and bank websites * Euro funds have diff equal to 0 * Fixing not avalaible value * Handling netissima page * Fix set of Investment.unitprice for market accounts * Correctly get subscriptions even if previous page was on market * Fix finding jid on some pages * Load ISIN code from details page if not available in the list * Fixing empty page in some case in investment without pl in URL * Prevent useless request since there is no history on asv accounts * Handling +infinity (best investment ever) * Fix ISIN code on asv * Do not slugify investments without ISIN codes * Fix ing bills * Parse bills dates * Skip summary bills * Fix isin on US investment * Fix when valuation is not available Modules: inrocks * Url changed * Fix url matching * Do not try to parse premium news pages Modules: kickass * New domain name * Adaptation to new browser, iter_torrents mysteriously not working * kickass now works with new browser Modules: lcl * Website change, rewrite with browser2 * Ignore summary lines in history tables * Fix stop parsing not transactions lines * Certificate updated * Fetch detail of transactions and use it in Transaction.raw * Change timeout to 30 seconds * Call default Browser.deinit() * Do not change Transaction.raw if there is no detail * Adding pagination support for lcl * Fix async bug with cards * Fixing RC4 and cert for pp browser * New certificate for LCL Espace Pro * Browser doesn't inherit 'object', so 'super' doesn't work * Handling account can't use online service when login * Fixing bad login when session expire * New transaction detail page * New certificate for lcl entreprise * Fix date parsing bug on transaction label 0/07/2015 * Wrongpass instead of BrowserUnavailable * Fix PEP8 E713 * Fix contracts selection routing * Remove validate method * Handle one case of bad login/pass * Handle investment * Fix for clients with no market investment accounts * Fix crash on asv accounts * Fix parsing of life insurance accounts with special chars in owner name * Fixing when we have some additional information * Disconnecting from bourse portal before returning the account list * Fix bugs on av accounts, double ids and disc from detail * Fix mistake in disc page * Fix life insurance accounts ids * Fix parsing of market accounts * Fix crash on enterprise websites * Adding iban info when available * Fix pro accounts iban * No permission page to fix crash * Fix crash in case life insurances are unavailables * Support a new account type * Fix parsing of some transactions on pro accounts * Adding saving account * Handling IBAN single account * Adding checking account * Fixing payement wording * Adding SAVING type for account * Handle home page so the module is blackbox compatible * Adding account type * Change page to handle specific behavior Modules: leboncoin * Add missing favicons * Fix bug while parsing date * Fix bug when area is unknown * Add regions support * Fix error when there is no price and improve description display * Improve cities display in search * Fix search city using zipcode * Fix bug when user do not choose any city * Do not crash if a select does not exist in the form * Fix title parsing in search result * Get main photo when there is no carousel * Fix bug in costs retricton for rent type * Fix bug due to other backends cities * Fix site changed * Fix regex in id detection Modules: lutim * Upgrade to Browser2 Modules: mailinator * Fix module as the api changed Modules: mareeinfo * Add missing favicons Modules: marmiton * marmiton is now working using browser2 (#1706) * Fix bugs in marmiton * xpath change (#2117) Modules: mediawiki * Update tests to use "Project:Sandbox" page * Port to browser2 * Remove useless stuff Modules: meteofrance * Adapt to browser2 * Use new DictElement object * Allow to iter forecasts using town name in addition to city id * Site changed Modules: monster * Fix and adapt to browser2 * Improve page parsing * Adapt for new Join filter * Handle adverts coming from partner websites Modules: okc * Correctly detect when login fails * Handle logged page * Make all attributes of optim start with an underscore * Fix parsing of profiles * Way used to vote has changed * Fix encoding of urls * Fix parsing of thread title * Rewrite okc module with browser2 and less ugly code * Skip empty essay fields * Add status and orientation fields * Do not remove old threads anymore * Iter_unread_messages: do not visite read threads Modules: oney * Add new hashes for virtkeyboard * Change get_balance xpath * Adding hash for virtkeyboard * Handle multiple cards Modules: orange * Adapt to website changes (#1828) * Add https urls * Update maintainer * Supporting bill capability for orange Modules: pap * Adapt to new DictElement object * Fix bug in parsing date * Fix : site changed Modules: pastealacon * Fix: url changed * Works with other pastebin sites * Revert "pastealacon: work with other pastebin sites" Modules: paypal * Handling when user can't acces account balance on main account * Supporting new paypal website * Fixing using new account page version when we are already on old account page * Handling when currency is not in right place * Fixing primary account display twice * Fixing wrong id on account * Checking website version after login * Fix crash on new accounts list (#1654) * Fix selection of table containing last file requests to be less ambiguous * When balance is zero, paypal add a class to the div * Handling new website account for individual * Paypal fix for KeyError: 'counterparty' * We now ignore transactions with no 'displayAmount' * Fix name of paypal accounts (display currency instead of balance) * Take care of transaction's net amounts (#1694) * Fix warning with adding a new home page * Handling home page on new private website * Fix paypal new activity URL * Fix paypal * Use locale.format to format amount * Do not use locale.setlocale to parse amount * Fix history on paypal, stop parsing suspended recurring payment * Get converted amount for foreign currencies * Fix crash IndexError: list index out of range (#1747) * Remove unused code, fix timeout of history fetch * We don't try to parse transactions without currencyCode anymore * New cert + fix conversion warning * Handling useless captcha page * New paypal certificate * Execute javascript convert() function on token * Paypal handle bad login/password * Add paypal new page to fix crash on history of some accounts * Fix crash on old website and inform users * Change detection of pro or perso account_type * Increase DEFAULT_TIMEOUT for accounts with a lot of transactions with foreign currency * Fix call of ads_token convert function * Fix timeout on accounts with huge transactions number * Fixing timeout for some accounts * Handling timeout when fetching old history * Fix transactions parsing * Get real amount accounting paypal's commissions * Fixing captcha * Handling promo page for new paypal application * Rewrite paypal with browser2 and fix login * Add a way to detect login errors * Pro accounts transactions amount is now returned without commission * Ignoring refound offer for paypal * Fixing paypal auth challenge * Do not supply floats to Decimal constructor * Fix login * Detect a login error * Fix parsing accounts without available balance * All personal accounts seems to be on new api. * Parse more transactions not in account currency * Try to get the activity 3 times * Discard another transaction type * Fix regexp parsing converted amount of transactions * Fix mistake of converted amount parsing * Handling payement from another bank * Fix parse_transaction return * Using original wording for payement from another bank and setting type * Check if there is a associated transaction for "Achat de" * Fixing bad return * Include archived transactions * Fix pro accounts transactions amounts not in account currency * Fix parsing converted amount from other currency * Fixing paypal using different token for conversion * Removing commande à from transaction list * English key word to skip transactions * Fcking paypal Modules: piratebay * Use new domain names Modules: playme * Add a profile walker to automatically send won challenges * Implement get_account_status() * Fix warnings * Answer only to 5 questions * Fix challenges with users who have already challenged you * Fix crash when there is no contact * Use Module.create_browser to correctly give all standard arguments (proxy, logger, etc.) Modules: poivy * Fix low balance listing Modules: popolemploi * Fix search and upgrade to browser2 * Website uses https * Site changed Modules: presseurop * Fix body selectors Modules: radiofrance * Site changed / backend rewritten using browser2 * Manage selection podcasts / improve testing * Handle podcasts * Fix indentation typo * Minor fixes * Cleanly display live in repl * Handle new francebleu website, retrieve the good player url when default player is the video player * Fix 404 errors in selection Modules: razibus * Increase timeout * Support timezone Modules: redmine * Fix crash when parsing custom fields Modules: regionsjob * Fix: site changed * Fix parsing when advert is a picture * Update to new Join filter * Do not crash while parsing an external advert Modules: sachsen * Fix parsing of flow level * Improve test for sachsen module * Partial fix of new website * Fix history with new website Modules: seloger * Remove useless condition * Fix bug on pagination * Use new DictElement object * Handle special characters (#1883) * Fix json parsing Modules: senscritique * Skip test when StopIteration is raised * Improve module code * Fix date parsing * Add Mangas missing channel * Fix bug when end_date is asked and not found * Use set_profile(Firefox()) instead of _setup_session(Firefox()) * Remove id lists * Fix channels selection * Site changed (we cannot choose channels packages anymore) Modules: societegenerale * Correctly detect when the website is unavailable * Page parsing for saving accounts * Update upstream certificate hash * Update certificate hashes * Credit card is no longer in coming * Switch rdate/date and little fixes * Update hash of soge enterprise certificate * Fix duplicate accounts on cards accounts * Adding IBAN support for pro and entreprise accounts * Setting new certificat hash * Fix greediness of a transaction pattern to avoid crash * Update certificate * Testing account true id for card * Check ssl certificate after browser construction * Support market account * Support life insurance account (Investment) * Refactor * Support life insurance account (Transaction) * Fix type of 'PEA Espèces' account * Detect and log unknown type account * Do not iterate over all available transaction * Move set_date into LifeInsuranceHistory, and do not return to transactions list * Do not store NotAvailable amounts * Do not crash on pro account * Fix investment valuation * Fixing unsuported link account * Adding PEA Especes to unsuported link * Dd an url to the crashing ones * New ssl certificate * Add reinitpassword page to prevent crash. * Fix parsing and pagination of market investments * Try to type more accounts * Adding iban number * Try to fix weird crash * Fix navigation without id transactions * Fixing fake id for investment * Fixing account type Modules: tinder * Fix warnings * Fix crash when a contact has been removed * Use APIBrowser * Do not crash when the limitation rate is reached * fix login on tinder: need to find the cookie in js * Avoid aborting profiles walker when queue is empty * Fix PEP8 E713 * use Module.create_browser to correctly give all standard arguments (proxy, logger, etc.) Modules: transilien * Fix _regexp name in RoadMapDuration filter * Fix ambiguous departure/arrival in roadmap * Use new DictElement object * Fix incorrect roadmap duration parsing (#2089) Modules: twitter * Fix: site changed * Exclude non-tweets * Fix: trendy tweets (site changed) * Fix search pagination * Fix comments parsing * Fix condition to correctly check if user is logged Modules: vimeo * There is no latest category on vimeo (#1692) * Allow to browse categories and channels * Bump to https and handle site changes * isSafeForFamily field is not always filled + correctly handle its value Modules: vlille * Fix encoding error Modules: wellsfargo * Force TLS v1.0 for Wells Fargo module. (#1647) * Credit limit, payment due date and amount for Wells Fargo bank (#1720) * Scrape minimum credit card payment and due date (#1809) * Update to new login security checks (#1999) * backport check_output for 2.6 Modules: wordreference * [wordreference] Adapt to browser2 Modules: youjizz * Min pattern size for search is 3 characters * Use UserError instead of ValueError * Videos are now hosted on another domain Modules: youporn * 'a' and 'i' pattern are not supported (404 error) * Rewrite with Browser 2 * Use UserError instead of ValueError * get_video fill the id Modules: youtube * Fix parsing of js signature (#1695) * Backported changes from youtube-dl * Fix call to _extract_signature_function() Weboob 1.0 (2014-10-17) General * New agendadulibre module http://www.agendadulibre.org/ (CapCalendarEvent) * New Citibank module https://online.citibank.com (CapBank) (#1642) * New leboncoin module http://www.leboncoin.fr/ (CapHousing) * New mareeinfo module http://maree.info/ (CapGauge) * New playme module http://goplayme.com/ (CapMessages, CapMessagesPost, CapDating) * New razibus module http://razibus.net/ (CapCalendarEvent) API Big-Bang * Rename BaseBackend to Module * Rename BACKEND to MODULE * Rename backend.py to module.py * Rename BaseApplication to Application * Rename CapBase to Capability * Rename BasePage to Page * Rename BaseBrowser to Browser * Move CleanHTML to html filters * Remove * imports in filters * Move weboob.tools.browser2 to weboob.browser * Move weboob.tools.exceptions to weboob.exceptions * Move weboob.tools.browser to weboob.deprecated.browser * Move weboob.tools.parsers to weboob.deprecated.browser.parsers * Move weboob.tools.mech to weboob.deprecated.mech * Remove the "backend" result in do() calls Core * Catch the proper exception for missing icon * Replace usage of os.mknod() by os.open(O_CREAT) * Use the print() function everywhere * WebNip.iter_backends takes a new optional parameter 'module' * Add __getitem__ on WebNip to get a loaded backend by name * Create PrintProgress class instead of using IProgress as default one * Allow to load a module with config=None * A lot of pep8 fixes Capabilities * Let get_currency guess US$ means USD * Prevent mess when copying BaseObject instances Capabilities: bank * Add Investment.description field * Add Emirati Dirham AEB currency Capabilities: calendar * Add Conference event category Capabilities: parcel * Add parcelnotfound exception Capabilities: housing * Add and handle in flatboob house_types field * Add and handle in leboncoin a new house type: UNKNOWN * Adding a url field in housing capability and management of it in flatboob Applications * Add a new debug level (-dd option) * Add a " LIMIT " keyword in conditions * Centralize encoding guesses, default to UTF-8 (#1352) * Use class attributes as much as possible for application output * Define std* in the proper class * Handle datetime in condition argument * os.isatty is now forbidden (as stream.fileno() is not implemented by StringIO) * logging: Output to stderr, not stdout * logging: better colors Applications: repl * When getting an object, if at least one is found, display errors but correctly return the found object Applications: boobmsg * Fix "show" for threads Applications: flatboob * Ask for query.type in flatboob * Add load command * Fix bug type_of_good does not exist anymore Applications: Qflatboob * Manage count to avoid problems during pagination Applications: pastoob * Add an option to set a custom file encoding Applications: parceloob * Catch parcelnotfound by untracking Applicatitons: traveloob * Fix: crash if departure time is not available Applications: videoob * Set non verbose mode for wget when downloading m3u8 (fix #1643) Applications: weboobcfg * Return correct exit status code for enable and disable commands Applications: webcontentedit * Better checks for vim usage Browser * Add a way to asynchronously handle requests and pages * Backporting mergin_hook to support hook's requests in wheezy * HTMLPage checks the inner charset and parse again document if it is not the same than Content-Type HTTP header * Add a trivial android profile * Add has-class xpath function Browser: filters * Add debug informations * Raise ParseError only with None/NotAvailable/NotLoaded values, not with empty strings * Add a way to customize sign handling for CleanDecimal * Regexp: let template be a callable * Add some javascript dedicated filters * Add an nth parameter to Regexp filter * Add __str__ to _Filters Browser: elements * handle_loaders into AbstractElement * Ability to select an ItemElement DeprecatedBrowser * Fix: certificate check on servers which don't allow SSLv3 Documentation * Update to the new API * Show base classes in documentation Tools * American amount to decimal conversion (ref #1641) * PDF decompression function (ref #1641) * Regexp-based tokenizer (ref #1641) Tools: html2text * Use the class if possible Tools: make_man * Copyright on top of file Tools: newsfeed * No need for workaround with feedparser>=5.1 Tools: tests * Allow changing modules path and adding to PYTHONPATH Tools: pyflakes * Add test to prevent usage of prints in modules * Detect deprecated has_key function Tools: values * Ability to set value to an empty string if it is available in choices Packaging: setup * Add futures, avoid Py2-only libs under Py3 * Use Python3-compatible syntax in debpydep * Add ignore dirs for flake8 Contrib: boobot * Add a check_twitter method Contrib: videoobmc * Force relative imports Contrib: weboob-generic (munin script) * Add category option Modules: alloresto * Fix: website changes (enable https and fix the form xpath) Modules: arretsurimages * Fix: site changed Modules: aum * Remove useless features of module that don't work anymore * Enable https * Import exceptions from core Modules: banqueaccord * Support canceled transactions * Increase timeout because of slow website Modules: biplan * Use the Python SkipTest if possible Modules: boursorama * Remove prints Modules: bred * Limit length of password * Remove lot of old code and keep card transactions in separate card accounts * Translating accnum description Modules: carrefourbanque * Do not try to parse useless accounts (closes #1432) * Fix: login form is now the second form on the page Modules: cic * Fix: new certificate hash * Set an unique id Modules: cmso * Fix: parsing of transaction amounts (strip nbsp) * Fix: parsing of huge account balances Modules: colissimo * Fix: return the real error message, not "label" * Raise ParcelNotFound in colissimo * Return the fullid of not found parcel * Upgrade to browser2 Modules: cragr * Remove prints * Add a regexp for checking password Modules: creditcooperatif * Add unique id to creditcooperatif (perso) * Update regexps * Use find object * Upgrade to browser2 (perso) Modules: creditmutuel * Fix: do not lock browser2 anymore (#1635) Modules: dresdenwetter * Add the debug decorator to dresdenwetter filter Modules: europarl * Remove prints Modules: feedly * Use the Python SkipTest if possible * Fix: unicode warning Modules: fortuneo * Do exactly the same thing than js to always get accounts list Modules: gazelle * Fix: infinite loop on fail login, and fix error message lookup Modules: gdcvault * Remove prints Modules: grooveshark * Fix: bug when Year field is empty in grooveshark json * Use the Python SkipTest if possible Modules: hds * Convert to browser2 and fix it Modules: hellobank * Remove prints Modules: hybride * Use the Python SkipTest if possible Modules: imgur * Restrict URL to imgur domains Modules: ing * Fix: add an Index for some accounts... * Add a test to detect loops in the history * Fix: testing of saving accounts * Fix: crash on coming operations * Add loggedPage on bourse.ingdirect.fr * Add a @ckeck_bourse decorator for a clean redirect Modules: kickass * Fix: parsing of torrent titles Modules: lacentrale * Fix: deprecated has_key Modules: lcl * Always raise instances of NotImplementedError Modules: minutes20 * Fix: parsing insolite pages Modules: nettokom * Add tests Modules: okc * Remove prints Modules: oney * Add a favicon * Add missing symbols for the virtual keyboard * Fix: do not crash on months with no transactions Modules: ouifm * Fix: new radio names Modules: ovs * Force relative import Modules: pap * Adapt to browser2 * Exclude adverts from other websites * Fix: image retrieving Modules: pastebin * Fix: crash on spam page Modules: paypal * Use AmericanTransaction.decimal_amount in PayPal module. Part of #1641 Modules: quvi * Force relative import Modules: seloger * Adapt to browser2 * Fix: pagination * Fix: obj filling Modules: societegenerale * Remove prints * PIL is a global requirement, remove the check Modules: tinder * Fix: auth on tinder by correctly set the User-Agent header Modules: transilien * Fix: crash on late departures Modules: twitter * Fix storage system * Fix purge system * Do not import Browser1 exception Modules: unsee * Restrict URL to unsee domains Modules: vlille * Better description Modules: wellsfargo * Fix: compatibility with old versions of mechanize * Add a favicon * Rewrite Wells Fargo with browser2 (closes #1624) * Improved Wells Fargo module stability. * Use AmericanTransaction.decimal_amount, closest_date, decompress_pdf and ReTokenizer in WellsFargo module. Part of #1641 Modules: youjizz * Fix: fillobj on video thumbnail Modules: youtube * Update part of the js interpreter Weboob 0.j (2014-09-03) General: * New module: feedly (CapMessages) * New module: oney (CapBank) * New module: twitter (CapMessages) * New module: wellsfargo (CapBank) (#1430) Core * Rename CapBaseObject to BaseObject (#1424) * Rename ICap to Cap (#1424) * Ability to use weboob.function as alias to weboob.do('function') (#1425) Core: repositories * Fix HTTP error handling for browser2 * Use ConfigParser in priority with python2 (#1393) * Load browser only when needed Capabilities * Move DateField/TimeField/Delta out of BaseObject * Add LBP to currencies * Add documentation on object constants Capabilities: audio * Add Playlist and Album classes Capabilities: audiostream * Fix: get_audiostream does not have pattern name (#1626) Capabilities: dating * Add iter_new_contacts method Capabilities: files * Fix repr() and str() on File-based objects Capabilities: image * Remove data field in to_dict method to avoid json crash during conversion Capabilities: messages * Remove required items in Message constructor Capabilities: travel * Do not require in id in constructor Applications * Remove default import of browser1 * Import debug modules only when needed Applications: console * Remove the import of SSL exceptions * Add the default value displayed "upper" in aliases (#1319) * Allows shortcuts for modules (#881) * Use shortcut of id in interactive mode (#881) Applications: REPL * Allow to browse subfolders with ls * Change formatter when it cannot handle all selected fields * Introduce the DISPLAYED_FIELDS in formatter * Set fields in a consistant way with do() * Introduce parse_fields function * Use fullid parameter for CapObjects * Correct multiple language error * Move format_collection from repl to ifromatter * Remove the 'inspect' command Applications: formatters * Remove the '*' special fields in formatter * Table and Json formatters can write output to a file now (#1412) * Handle format_collection with JSON formatter Applications: boobank * Do not crash if the account type isn't in list (#1542) * Write the account currency in ofx output Applications: radioob * Manage Albums and Playlists * Fix: bug when a radio id contains a dot Applications: QHaveDate * Add tab to send queries Applications: videoob * Improve m3u8 management in download Browser1 * Introduce local exception for SSL errors * Only load FirefoxCookies as needed * Update Firefox versions to latest ESR Browser2 * Add more specialized exceptions * Allow setting query string params on build_url * Matching content with url using is_here * Ability to override the flush() method * Allow for a custom element finder * Add CSV pages * Do not crash if total_seconds() is not implemented * Fix documentation of nr parameter * Update Firefox versions to latest ESR * Add support for forms with multiple "submit" elements * Allow more flexibility for the submit button parameter Browser2: ListElement * Move ItemListTable-Element outside of page.py Browser2: filters * Overload & and | operators to chain filters (#1426) * Split filters in several files * Fix filters doctest * Force unicode * New RawText filter * New Base filter * New Type filter * Date: use default value for empty input * Date: properly handle defaults that are not datetimes * MultiFilter: allow for a default argument * Dict: manage default * Dict: ability to use Dict['a']['b']['c'] instead of Dict('a/b/c') (#1426) * CleanHTML: manage basestring * CleanDecimal: possibility to set custom separators * CleanDecimal: set replace_dots default value to False * CleanDecimal: do not crash with inputs like NotAvailable * CleanText: handle the non-breaking space thanks to the re.UNICODE flag * CleanText: add an option to keep (but normalize) newlines * CleanText: \t is always in \s so no need to add it * CleanText: add tests * CleanText: fix re flags usage for Python 2.6 (#1444) * Env: add support for a default Documentation * New Home Page * Add a "How to contribute" page * Add logo/favicon * Set more customizations * Add instruction for developers missing the first steps (#868) * Define backends/modules * Add local_run in documentation for developers * Fix many docstring issues * Change module documentation to learn browser2 (#1451) * Add __repr__ on NotAvailable, NotLoaded and _NO_DEFAULT constants to be more readable on doc * Import several pages from the wiki * Add documentation to report a bug (#873) Tools: AmericanTransaction * Add a transaction amounts cleaner helper for american banks Tools: captcha * Refactor VirtKeyboard class * Add a margin attribut * Add a grid based virtual keyboard Tools: date * Add more french dates translations * Class methods to convert date[time] objects Tools: genericArticle * Fix unicode warning Tools: make_man * Tell that it was generated automatically Tools: pyflakes * Fix: call of pyflakes on Archlinux (#1404) Tools: test * Fix: call of test.py (#1403) Tools: yaml * Represent weboob date[time] objects as timestamps Misc: local_run script * Allow customizing where the modules are Misc: setup * Support python3 (#1417 #1418 #1419) * Add prettytable in dependencies (#929) * Configure isort and flake8 Misc: Windows Installer * Remove some files * Fix bugs in windows installer scripts Contrib: munin * Rename generic-munin to weboob-munin * Move all scripts in the same folder * Encode and decode ID's in weboob-munin Contrib: boobot * Add command %delquote * Fix: %searchquote on unicode strings Contrib: XBMC/Kodi * Add a xbmc/Kodi plugin that interracts with videoob Modules: arte * Fix: Do not crash if 'VDA' fields is missing in json * Use M3U8 format instead of HBBTV * Fill video.url with NotAvailable if url is not found * Improve tests * Improve video quality choice * Handle arte podcasts * Add tests for program categories Modules: aum * Implement iter_new_contacts Modules: banquepopulaire * Strip displayed balance at end of transaction labels * Display check number in label (#1027) * Fix: remove spaces in IDs (#1368) * Support loan payment type Modules: biplan * Handle summer holiday in tests Modules: bnporc * Update order regexp * Fix: transfer regexp * Remove space in ids Modules: boursorama * Some English fixes in comments * Add new certificat hash Modules: bp * Fix: new login image for virtkeyboard Modules: bred * Handle space in account number * Switch configuration description strings to unicode Modules: caissedepargne * Force use of TLSv1 on lowsslcheck as the web server support of SSLv3 is broken Modules: colissimo * Fix: New API key for collisimo (#1617) Modules: cragr * Order transactions by date to prevent LinearDateGuesser to be duped by the f*cking website Modules: creditmutuel * Fix: set of debit date for card transactions Modules: dailymotion * Fix: dailymotion mplayer error "No stream found to handle url" * Fix: use https for test Modules: francetelevisions * Use filters as classes in chain (refs #1426) Modules: freemobile * Some English fixes in comments * Fix date of subscriptions when next month as less days than excepted (#1347) Modules: gdcvault * Remove unused import of ControlNotFoundError Modules: grooveshark * Update to match Album and Playlist management in radioob * Display users playlists only when split_path length is 0 * Fix: catch exception when id is not an integer Modules: hellobank * Get default account name if the custom name is empty Modules: hybride * Fix: handle summer holiday in tests Modules: imdb * Some English fixes in comments * Use omdbapi instead of imdbapi * Fix: site changed Modules: ina * Fix: bad characters in titles (double encoded unicode) Modules: ing * Some English fixes in comments * Remove the index on ing for pagination * Support coming operations * Fix: parsing of 'tomorrow' transaction dates Modules: izneo * Fix: bug in page list Modules: lcl * Handle lcl pro https://professionnels.secure.lcl.fr * New certificate * Add transaction patterns Modules: leclercmobile * Fix: do not crash if balance is not available Modules: lefigaro * Remove dead code Modules: meteofrance * Fix: site changed (#1390) * Fix: call the url that retrieve all the search results (#1431) * Raise an exception if forecast param is not a city id (#1433) Modules: opensubtitles * Some English fixes in comments * Fix: site changed (#1295) Modules: pastealacon * Convert to Browser2 (#674) * Use specialized Browser exception Modules: pastebin * Convert to browser2 * overload & and | operators to chain filters (refs #1426) * Handle limit exceeded warning * Fix: crash with Base() and filter chaining Modules: paypal * Get more transactions on paypal (#1405) * Retrieve all transactions from the history, merchant and regular account support (#1406) * Paypal transactions history fetching with adaptive steps (#1406) * Checking if tr contains text * Make Paypal module use AmericanTransaction helper. * Fix: empty amount. (#1415) * Support french dates for last CSV request * Ignore canceled transactions Modules: popolemploi * Fix: site is now only availbe using https Modules: presseurop * Presseurop is back! (named now voxeurop) Modules: radiofrance * Fix: FIP radio does not work (#1449) Modules: sachsen * Set the datetime to NotAvailable by default Modules: senscritique * Fix: bug in network selection * Fix: set channels and programs parameters in get_event Modules: societegenerale * Fix: certificate changed * Fix: certificate updated (#1414) Modules: sueurdemetal * Fix: broken module due to departments containing letters Modules: tinder * Update recs only when needed * Fix attribute type Modules: transilien * Adapt to browser2 * Fix: site changed (#938) Modules: vimeo * Fix: site changed * Adapt to browser2 * Enable search and tests (#1082) * Catch HttpNotFound errors Modules: youjizz * Overload & and | operators to chain filters (refs #1426) * Use filters as classes in chain (refs #1426) Modules: youtube * Fix: Youtube mplayer error "No stream found to handle url" * Fix: is_logged function does not work (#1423) * Backport some youtube-dl changes (#1422) Weboob 0.i (2014-05-19) General * New Browser: browser2 is here! See below * First steps in python3 support * New GPG key for laurentb (see https://laurent.bachelier.name/gpgtransition.txt) * New module: btdigg (CapTorrent) * New module: Mailinator (CapMessage) * New module: guerrillamail (CapMessage) * New module: SensCritique (CapCalendar) * New module: imgur (CapPaste) * New module: unsee (CapPaste) * New module: lut.im (CapPaste) * New module: pixtoilelibre (CapPaste) * New module: ColisPrive (CapParcel) * New module: AlloResto (CapBank) * New module: LaCentrale (CapPriceComparison) * New module: Groupamaes (CapBank) * New module: Tinder (CapDating) Core * Import pkg_resources only when needed, to prevent a hard useless dependency Core: browser2 * Add a new browser based on python-requests * Full support of SSL * Add the option _proxy_ssl for backends * New management of Html FORMs * New URL class * Better debugging (save HTTP requests/responses) * Simple support of pagination (@pagination decorator) * Introduce ListElement and ItemElement (parser helper) * Add a lot of Filters for ItemElement * Add TableElement, to help the parsing of a table * 24 modules are already using browser2! * And a lot more... Core: browser1 * Unify no_login and nologin * Fix call of logger (can be unset) * Move exceptions in weboob.tools.exceptions (compatibility with browser2) Core: BackendCalls * Rewrite BackendCalls with queues Core: repositories * Make GPG ignore local settings Core: configuration * Support for password retrieval from any cli tools * Prompt user during configuration of a backend Core: ManPages * Escape more '-' Core: Parsers * Add a xml parser * Remove unused/obsolete parsers Core: DateTools * Add ChaoticDateGuesser Applications: base * Add version information in Debug * catch ^C on global bcall errors handler * Allow to use condition on the fullid * Do not display warning message if -n or count is set Applications: console * Fix: masked parameter wasn't considered * Fix: password encoding issues * Display backend@issues.weboob.org and not backend.EMAIL Applications: media_player * Add a play_proxy option Applications: Qt * Add keywords in .desktop files (#1356) Applications: REPL * Exclude backends that do not implement the required method (#1325) * New obj_to_filename() method (from videoob) * Do not fetch the collections when not needed * Fix selecting a field in non-interactive mode * Use a fast path for ls if -U is set * Add documentation of the "ls -d" option * Gather collections having the same path * Override comp_obj from repl in order to sort by start_date Applications: formatters * Add a json formatter that works on a line level (json_line) Applications: yamlconfig * Allow a default equal to None Application: boobcoming * Add documentation * Add icon * Use ls/cd commands to navigate into categories * Improve collection management Application: boobsize * Add icon * Display null values * Fix hints in not found error Application: boobtracker * Support colors for issues * Create/edit tickets in a text editor * Fix email address regexp * Fix crash in interactive mode * New options --tracker, --priority, --start, --due Application: parceloob * Remove trailing \n * Ignore status of not loaded backends * Always untrack if the id is in the storage Application: pastoob * Paste binary files with "post_bin FILENAME" and "get_bin ID" * Add 'info' command Application: Qhavedate * Ignore error when notes are not implemented on contacts Application: radioob * Fix audio objects search * Pick up first available stream when radio provides a playlist (#1345) Application: translaboob * Fix a typo in the documentation Application: videoob * Braces-enclosed tags are replaced with data * Play/info: ability to give several videos * Add command 'videoob playlist download' * Add command 'videoob playlist play' * Move obj_to_filename() into ReplApplication * Use wget to download m3u8 videos Application: webcontentedit * add a -r parameter to get command to precise revision id Application: wetboobs * Remove ICapGauge Capabilities: Base * Change currencies integer constants to ISO code strings * Do not require an id, because of ItemElement which constructs objects without arguments * Introduce find_object Capabilities: CapWeather * Fix: zero temperature can not be displayed (#1333) * Accept date objects for the forecast Capabilities: CapCalendar * Raise NotImplementedError on "attends" method * Add TELE category Capabilities: CapBugTracker * Fix some conversion warnings Capabilities: CapBank * Add Account.TYPE_CARD * Add TransactionsElement and TransactionElement (helpers with browser2) Capabilities: CapContact * Factorize aum's Contact.get_text() and boobmsg formatter Capabilities: CapGeoloc * Remove unused ipaddr field Capabilities: CapMessage * Avoid warnings in GenericNewspaperBackend and GenericNewsPage Capabilities: CapPast * Show a user-friendly error message for CapNotFound Capabilities: CapTracker * Add trackers and priorities fields to Project * Add start, due, tracker and priority fields to Issue Modules: banquepopulaire, bnporc, bp, cic, cragr, creditdunord, creditmutuel, ing, lcl, societegenerale * Improvements on transaction and account types detection Module: AmericanExpress * Fix wrong date guessing * Increase timedelta to 90 * Check if a card is valid * Set card balance to Account.balance instead of Account.coming Module: Apec * Updates reflecting site changes Module: Apivie * Fix getting an account from list * Fix parsing of negative transactions Module: Arte * Encode UTF-8 strings in search * Fix naming of collections * ArteLive: new website * Improve the parsing of dates * Fix bug when VDA field not found in json file * Fix problem on extension Module: AxaBanque * Adding support for sub accounts * Fix parsing of accounts without amount Module: Banque Accord * Add icon * Fix parsing of negative amount * Fix detection of card pages * Fix virtual keyboard * Add a hash for symbol 5 on virtkeymap * Adding support for Leroy Merlin * Support LOAN accounts * Upgrade to browser2 Module: Banque Populaire * Fix: parsing of accounts (site changed) * Fix: parsing of accounts on specific regions * If an account type is not supported, raise NotImplementedError Module: Biplan * Fix bug while parsing start/end time * Updates reflecting site changes * Upgrade to browser2 Module: Bnporc * New certificate * Fix encoding issues * Disable unused parameter rotating_password * Change the domain to entreprises.bnpparibas.net for BNPEnterprise Module: Boursorama * Fix crash when there is no ID on transaction * Handle card history Module: BP * New certificate * List market account (#1298) * An account type must not be None Module: Bred * Support dispobank * New certificate Module: CanalPlus * Fix browsing categories (site changed) Module: Carrefour Banque * Upgrade to browser2 * Fix: Site changed Module: CCI * Upgrade to browser2 Module: Citelis * New icon * Fix: detection of login errors Module: cmb * Change a function call to avoid useless None * Upgrade to browser2 Module: cmso * Setting encoding to iso Module: Colissimo * Add icon * Fix license Module: Cragr * Fix parsing dates in labels (compatibility with Perigord) Module: Credit Du Nord * If type is not found, set TYPE_UNKNOWN instead of None * Add "Banque Rhône-Alpes" Module: Credit Mutuel * New icon * Upgrade to browser2 * Fix parsing of user private accounts * Fix crash on unknown accounts types Module: cuisineaz * Fix cuisineaz preparation and cooking time (site changed) Module: Dailymotion * Fix empty fields in dailymotion plugin * Change extension from flv to mp4 * New icon * Add support for videos available at kids.dailymotion.com * Fix the search (site changed) Module: Delubac * Support LCR * Fix navigation Module: DLFP * Fix logout (site changed) Module: DresdenWetter * Upgrade to browser2 Module: Fortuneo * New certificate * Do not override rdate with operation date Module: France Televisions * Upgrade to browser2 Module: Freemobile * Fix date of subscriptions when next month has less days than expected (#1347) * Upgrade to browser2 Module: googletranslate * Fix : site is now only available using https Module: grooveshark * Fix: no more field AvgRate (site changed) Module: HSBC * Fix: support of the SecureKey * Upgrade to browser2 Module: hybride * Upgrade to browser2 Module: INA * Site changed Module: indeed * Upgrade to browser2 Module: ING * Update regexps used to detect categories (site changed) * Upgrade to browser2 * Support pagination in iter_bills * Do not crash on invest objects when quantities are >999 Module: Kickass * Fix title getter (site changed) Module: LeclercMobile * Do not crash if the subscription is closed Module: LeFigaro * Fix: site changed * Fix the tests Module: LCL * New maintener * Support changes in login screens * Get more history * Remove logging checking on the contract page Module: Liberation * Add icon Module: lolix * Fix the size of the icon Module: mediawiki * Fix encoding error Module: MeteoFrance * Strip the text before to return it Module: OKC * Add the visit to a profile * Add a profile walker * First sent message is configurable * Do not crash on removed contacts * Do not crash on 'like' messages Module: pastealacon * Upgrade to browser2 Module: Paypal * Certificate changed (three times) Module: piratebay * New domain (thepiratebay.se) Module: Pole Emploi * Updates reflecting site changes * Fix parsing of dates * Fix bug in url encoding * Fix place selection Module: Poivy * Upgrade to browser2 * Support pagination for the history Module: Redmine * Add Issue.fields attribute to support custom fields * Support new versions of redmine * Use the right method to get project * If a category does not exist, try to create it * Fix compatibility with redmine 2.4 * Support start/end/tracker/priority * Fix finding the control to add a note Module: RegionsJob * Add icon * Upgrade to browser2 Module: sachsen * Upgrade to browser2 Module: Société Générale * Display card as accounts (#1362) Module: Sueurdemetal * Add date_end parameter in get_concerts_date call * Fix date and category filters Module: voyagessncf * If station ID is not found, try to look for it as a name * Forge a random IP source address to avoid redirection to other website (#1327) Module: vlille * Upgrade to browser2 Module: Weather * Fix: there are not always ten days of forecast (#1343) Module: youjizz * Handle videos longer than 59 minutes * Support pagination * Upgrade to browser2 Module: youtube * Fix: site changed * Fix: unexpected argument to BrokenPageError Tools: boilerplate * Add 'cap' recipe to prepare methods * Upgrade to browser2 Tools: local_install * Run tools/stale_pyc.py before local installation Tools: pyflakes * Ignore 'except' in a comment Misc: boobot * Add quoting commands * Fix unicode issues Misc: Windows Installer * Better script to generate the .exe * Better management for 64 bits systems Weboob 0.h (2014-01-08) General * New application: boobcoming * New application: boobsize * New capability: CapCalendarEvent * New capability: CapFile * New capability: CapAudio * New capability: CapAudioStream * New capability: CapImage * New module: Apivie (CapBank) * New module: Audioaddict (CapRadio) * New module: Banqueaccord (CapBank) * New module: Biplan (CapCalendarEvent) * New module: CCI (CapJob) * New module: Collisimo (CapParcel) * New module: EDF (CapBill) (#1296) * New module: GitHub (CapBugTracker) * New module: Indeed (CapJob) * New module: Jacquieetmichel (CapVideo) * New module: jcvelaux (CapGauge) (#376) * New module: JVMalin.fr (CapTravel) * New module: Liberation (CapMessage) * New module: lhybride.org (CapCalendarEvent) * New module: Monster (CapJob) * New module: Nectarine Demoscene Music (CapRadio) * New module: Nihon no Oto (CapRadio) * New module: OVS (CapMessage, CapContact) * New module: Pariskiwi (CapCalendarEvent) * New module: Poivy (CapBill) * New module: Quvi (CapVideo) * New module: RegionsJob (CapJob) * New module: Somafm (CapRadio) * New module: Sueurdemetal (CapCalendarEvent) * New module: VoyagesSNCF (CapTravel) * Removed module: ecrans (see new liberation module) * Removed module: Isohunt (site closed) Core * Add class WebNip (Web [in] Non Interactive Programs) * Modify/factorize/add CapVideo, CapAudio, CapImage, CapFile Core: application * The "condition" system has been rewritten (and moved from bcall to reply applications) (#1289) (#1288) * repl: add <,> and | operators in conditions * repl: support date in conditions (#1308) * repl: catch error in condition evaluation * repl: sort results of "ls" * repl: add -U option to not sort result with "ls" * repl: add documentation for conditions in manpages * repl: exclude backends which does not implement 'method' in get_object * repl: restrict to 40 results in ls by default * repl: accept 0 and negative values for count in interactive mode * Base: hide FormFieldConversionWarning * JSON: fix export format (#1294) * JSON: encode all subobjects CapBank * Add Invstment in __all__ * Use raw label to calculate unique_id CapGallery * Add iter_gallery_images method CapJob * Change API: add advanced_search_job CapTravel * Add parameter 'date' to ICapTravel.iter_station_departures * Add fields to Departure (arrival_time, price, currency) CapVideo * Inherit from CapImage CapWeather * Fix htmltable display for wetboobs forecast command (#1318) Application: boobank * Truncate label in formatter 'account_list' * Add OFX export Application: boobill * Catch some errors (#1303) * Fix: documentation erros Application: handjoob * Fix: display of results * Better ls command Application: Qhandjoob * Adapt to ICapJob update Application: parceloob * Do not show "None", but an empty string Application: pastoob * Add help for "infinite" max_age Application: radioob * Let user choose his Stream to use from Radio instance (#1291) * Use CapRadio * Add support for download and streaming of BaseAudio objects * Add support for playlist of BaseAudio objects Application: traveloob * Add (colored) formatters Application: videoob * Add playlist support * Sanitize default download filename * Fix: do not return None objects on get_object * Support curl for downloading * Allow to download in a folder with generated filename Application: wetboobs * Depreciate ICapGauge commands (#1284) Tools: Application * Add mpv to default players Tools: GenericBackend * Make a real link in signature Tools: Browser * Move the test on self.insecure to catch direct calls Tools: Value * Order Choices Module: adecco * Fix: site changed Module: allocine * Implementation of the new API mechanism Module: ameli * Fix: site changes * Better handle of login Module: amelipro * Fix listing of bills Module: apec * Fix: site changed (get job offers) * Use html2text to fill description content Module: arte * Add liveweb.arte.tv url management * Update to use arte API * Fix: fully fill Artevideo in get_video method (#1312) Module: arretsurimage * Prevent to catch all urls Module: Banquepopulaire * Get list of all accounts * Fix: do not crash if there is no operations * Fix: do not crash when there is no full list page * Support loan accounts * Support accounts with empty balance * Fix: do not crash with market accounts * Fix: new authentication * Fix: sometimes it is not possible to sort by value date in history * Fix: crash on special account histories * Support defered cards * Fix: getting history on some special workflow * Fix: crash when there is the coming column with empty value Module: Barclays * New favicon Module: Bnporc * Fix: update BNP certificate fingerprint * Add transaction patterns * Support new virtual keyboard * Fix: typo in label, s/Profesionnels/Professionnels Module: Boursorama * Fix: crash when there is no link on an opening account * Remove dead code Module: BP * New Virtualkeyboard Module: Bred * New configuration option: force the selection of account * Fix: selection of accounts when there are both personal and enterprise ones * Fix: set the right debit date on card transactions * Fix: crash on page to select account Module: Caissedepargne * New certificat Module: Carrefourbannque * Removed broken regexp for login parameter. Module: CIC and Creditmutuel * Backport fixes from creditmutuel * Correctly get the accounting amount * Support coming transactions * Do not try to find coming transactions for inappropriate account * Set the right debit date on card transactions * Fix parsing card debit date when there is a link in text * Support multi-cards pages Module: CMB * Fix: parsing accounts when there are mandated ones Module: Citelis * New certificate Module: Chronopost * Do not set location to "None" if empty Module: Cragr * Do not follow spam links * Fix: parsing of card accounts in particular cases * Fix: correctly set cards' Transaction.date to the debit date * Fix: crash when there are only three columns in card transactions listi * Fix: account IDs can contain anything else than digits Module: CreditCooperatif * New favicon Module: Creditdunord * Support enterprise accounts * Fix: parameters on request to get professionnal accounts history * Support SEPA Order parsing * Fix: pagination on professional website Module: Dailymotion * Fix: dailymotion thumbmail retrieving (#1310) * Fix: found the video URL * Fix: try to get the full JSON data * Fix: bugs in video pages (#1320) Module: Delubac * New favicon Module: Dresdenwetter * New favicon Module: francetelevisions * Fix: downloading in non-interactive mode * Fix: KeyError: 'data-date' (site changed) (#1282) Module: Grooveshark * Force mp3 extension * Many code style fixes * Manage albums search * Add user playlist management * Declare user_id as an instance variable * Fix: unitialized property user_id * Fix: NoneType return value when user is not logged * Fix: typo in test * Adapt test for logged and non logged users Module: hellobank * Fix decimal parsing of account values Module: Imdb * Fix: site changed * Add some tests Module: Leclercmobile * New favicon Module: Mangago * Fix: GenericComicReaderTest import path Module: MeteoFrance * Fix: parsing of pages, site changed Module: LCL * Fix: detection of authentication errors * Support new contracts selection page * New certificate * Fix: remove all of the agency parameter (#1313) Module: Leclercmobile * Better balance information * Remove "votre solde" in history * Strip labels Module: Lolix * Fill search job method in lolix to avoid error message Module: Nettokom * Add get_balance method * Fix: encoding warnings Module: NolifeTV * Use mobile.nolife-tv.com instead of online.nolife-tv.com * Add theme/type entries * Allow anonymous surfing Module: popolemploi * Improve deep search Module: Prixcarburant * Fix sites changes (#1031) Module: ING * Use raw parser for TitrePage * Add LDD support * Get history of titre account * Do not crash if there is no operation * Raise UseError on empty reason for transfer (#1315) Module: ipinfodb * Fix: form changed from GET to POST Module: SFR * Fix: site changed * Add some tests Module: Societegenerale * Fix: parsing of cards with undefined payment date * Add transaction patterns * Fix: conversion warnings (#1304) * Fix: support new authentication system Module: TVSubtitles * Add some tests Module: Vlille * Improve method _get_sensor_by_id * Scrap webpage instead of provided xml (get more informations) Module: Wordreference * Fix: site changed Module: Youjizz * Fix: get real thumbnail Module: Youtube * Add a new YouTube video URL * Set YOUTUBE_MAX_START_INDEX to 500 Contrib: downloadboob * Fix: call to ICapVideo.search_videos (API changed) (#1301) * Fix: print help instead of crash Contrib: generic-munin * Add get_object_list command * Fix: do not crash if one value is NotAvailable Contrib: kmymoney * Fix dead lock with krosspython > 4.8 * Add a Weboob configuration tab in account configuration window * Restrict download to N transactions by updating the history Misc: packaging * Get absolute path without readlink (compatibility with BSD systems) * Add windows installer * Use more common syntax (refs #1299) * Better detection of Pillow Misc: tools * local_run: do not erase existing PYTHONPATH Weboob 0.g (2013-08-03) General * New application: handjoob * New application: parceloob * New application: qhandjoob * New capabilitie: CapJob * New capabilitie: CapParcel * New module: Citélis (CapBank) * New module: Banque Delubac (CapBank) * New module: Hello Bank! (CapBank) (#1276) * New module: Ameli (CapBill) * New module: AmeliPro (CapBill) * New module: GDF SUEZ DolceVita (CapBill) * New module: V'Lille (CapGauge) * New module: Adecco (CapJob) * New module: Apec (CapJob) * New module: Lolix (CapJob) * New module: Pôle Emploi (CapJob) * New module: Paroles.net (CapLyrics) * New module: Chronopost (CapParcel) * New module: UPS (CapParcel) * New module: Allrecipes (CapRecipe) * New module: Supertoinette (CapRecipe) * New module: podnapisi (CapSubtitle) * New module: Arrêt sur Images (CapVideo) * New module: Grooveshark (CapVideo) * New tool: stale_pyc.py * New tool: certhash.py Core * Change '_backend' setting to '_module' (#789) * Remove all compatibily glue for python 2.5 (#806) * Remove some from __future__, forbid 2.5 in setup * Do not crash when repository is invalid (#1281) * Explicit module load errors * Fix: import Pillow in core * Fix: create containing directory of backend configuration * Fix: better English sentence when Weboob refuses to start * Fix: crash if backend name contains unicode chars Core: applications * Display a message when more results are available (#1038) * Default behavior is now to unlimit results, except for explicit commands (searches or history) (#1139) * Remove useless calls to ReplApplication.flush() (#812) * Add colors in console applications * console: display collections before objects with ls command * console: fix error if there are private attributes on backend * console: better handling of "tiny" choices, allow forcing * console: Automatically create a storage if STORAGE class attribute is not empty * repl: add a new caps parameter to get_object * repl: get_object supports backend's services returning lists * repl: Invoking 'help' command from shell display only list of commands * Fix: printing of DictObj Core: browser * Add a cache for DNS requests * Implicitly convert unicode objects to str for form values Core: capabilities * Move Currency from CapBank to CapBase * Fix: problem with strftime on date.year<1900 CapBase * add method to convert currency value to text CapBank * do not crash if date in label regexp isn't valid * add Investment object and iter_investment method * add Transaction.unique_id * more help for date fields * introduce vdate * FrenchTransaction.parse takes a new optional argument 'vdate' CapBill * add attributes to Bill (#1202) * add new attributes to Detail (#1203) CapBook * remove unused parameter 'pattern' in iter_books CapGauge * add address field to GaugeSensor CapMessage * default type of threads is IS_THREADS CapRecipe * handle interval number of persons * fix comparison to None CapSubtitle * add 'ext' attribut (extension of file) CapWeather * always call base constructor of CapBaseObject to prevent shared fields Core: documentation * Fix typo and wordwrap in INSTALL * Add manpages for new applications Core: tools * Do not try to fill None * All string values are Unicode * Allow overriding delay and tries in decorated function arguments * Add parse_french_date in weboob.tools.date Application: boobank * In interactive mode, 'transfer' commands asks confirmation (#1077) * Add parameter END_DATE to 'history' and 'coming' commands (#1150) * Add investment command * Avoid blank lines between entries in (pretty_)qif formatting * Better error messages * Prevent encoding issues in __repr__ of Transactions * Fix: do not flush twice Application: booblyrics * Fix: search command needs 2 arguments Application: boobmsg * Fix: display of messages list in non interactive mode Application: cineoob * Add caps parameter to get_object (#1280) * Filmographies and castings restricted to movie/person backend * Add language abbreviations in subtitle search help * Small bug fixes Application: comparoob * Add missing docstrings to commands Application: cookboob * Handle interval number of persons * Better nb_person interval display * Check if preparation time is available * Strip newlines from descriptions in search results Application: flatboob * Add command help * Do not use limit for cities search Application: qcineoob * Check if short description is available * Encode filename when download * Add tabs navigation * ctrl+l to get focus on search edit * Do not go on middle click opened tab * Remove useless print Application: qcookboob * Handle interval number of persons * Better nb_person interval display Application: qvideoob * Use fillobj instead of get_video to complete all fields Application: suboob * Rename command 'getfile' to 'download' * Save subtitles in a better file name (#1278) * Print filename where subtitle is saved (#1279) * Add language abbreviations in subtitle search help * Do not show URL if empty Application: webcontentedit * Use NamedTemporaryFile(delete=False) instead of mkstemp Application: weboobcfg * Remove 'backends' command from help * Fix: do not crash if a module cannot be loaded Application: weboorrents * Catch empty seeders and leechers Application: wetboobs * Fix: gauges command parsing Module: 750g * Strip accents in search URL * Fix: comments and accents striping Module: allocine * Fix: gender detection Module: americanexpress * Fix: parsing of coming value * Fix: parsing of April month Module: aum * Support new fields * Logging to see profile (because of craps) * Unescape description of profiles * Disable warning when unable to get public profile from website * Fix: encoding errors * Fix: typo on 'style' field Module: arte * Add support of ArteLive * Fix: parsing on German and English pages * Fix: id is now prefixed with "--" * Fix: prevent module from catching all URLs Module: attilasub * Add attribute 'ext' Module: axabanque * Detect when there is no operations Module: banquepopulaire * Support new authentication on some regions * Sort entries by value date * Add new URL for homepage * Store vdate * Fix: go on professional accounts list page Module: bnporc * Add support of personal accounts on professional website * Add enterprise website support * Support when sometimes 'coming' value is '-' * Prevent navigation conflicts during accounts iteration * Add regexp for payback of card transactions Module: bp * Fix: support new authentication Module: boursorama * Add two factor authentication for boursorama module * Add history for saving accounts * Add PEL support * Fix: parsing on new website * Fix: new certificat * Fix: support new website Module: bred * Supports new page which asks for a code from a card * Fix: login on accounts with several subaccounts * Fix: new certificat Module: caissedepargne * Support professional website * Add support of deferred debit cards * Be more robust on logout * Clear cookies during login * Fix: detection on login failed * Fix: navigation * Fix: avoid crashes if some useless fields are missing in global form * Fix: support new version of website * Fix: import of ControlNotFound on old versions of mechanize * Fix: navigation in card accounts history Module: cmb * Use new-style classes (coding style) Module: cic * Supports new page which asks for a code from a card Module: cragr * Add support for credit cards * Ignore accounts without balance * Add new regions * Support special login URLs on some regions * Use new-style classes (coding style) * Support account where name contains the owner * Do not raise BrowserIncorrectPassword when the website displays an useless "urgent message" on login * Better detection of useful label * Fix: use web site instead of mobile website for ca-centrest, and probably others (#1035) * Fix: an account owner name can start with Mle Module: creditcooperatif * Support coming transactions on pro accounts Module: creditdunord * Fix: navigation in history calls * Fix: attach cards to the good account * Fix: encoding error to get history for accounts with special chars in name * Fix: navigation for deferred cards * Fix: crash if the date of a transaction is empty Module: creditmutuel * Fix: listing of recipients in transfer Module: cuisineaz * Temporary fix of person number range * Fix: comments and accents striping Module: dailymotion * Fix: parsing of authors Module: dlfp * Be compliant with the dlfp 1st april joke * Fix: get new threads even if there is no comment Module: dresdenwetter * Add tests * Fix: no more snow sensor Module: freemobile * Add some tests * Fix: history when internationals calls option is not subscribed (#1078) * Fix: new certificat * Fix: conversion warnings * Fix: new bill listing * Fix: bad method name in tests Module: ganassurances * Enable support to Groupama Banque (#1112) Module: gdcvault * Only logout when actually logged in Module: hsbc * Support international accounts * Add a retry if login fail * Add missing file (login.py) * Fix: update module to support last website update * Fix: new certificate Module: imdb * Replace latin2unicode by HTMLParser Module: ing * Add support of investments * Add type of accounts * Raise NotImplementedError if account type not supported * Add some tests * Fix: conversion warnings * Fix: history of accounts * Fix: new certificat * Fix: transfer Module: kickass * Use https * Fix: new URL Module: lcl * Add enterprise site * Fix: detection of bad passwords * Fix: support new auth system * Fix: do not need to logout if the browser hasn't been used Module: leclercmobile * Add real tests * Fix: history parsing * Fix: details parsing * Fix: compatibility with calibre 0.9 Module: marmiton * Fix: comments and accents striping Module: opensubtitles * Add attribute 'ext' Module: orange * Fix SMS sending (#1206) Module: ouifm * Fix: json describing current songs and artists changed Module: paypal * Fix: ignore extra-lines in accounts list * Fix: new certificate Module: piratebay * New URL * Support proxies Module: presseurop * Get newspaper source * Fix: body parsing * Fix: better check for daily links Module: redmine * Fix: missing id class on older versions Module: sachsen * Fix: string conversion * Fix: tests do not work with new CapGauge API Module: seeklyrics * Fix: parsing in some cases Module: societegenerale * Add entreprise support * Do not consider expired cards * support 'OPPOSITION' state for cards * Fix: conflicts in detection of balance * Fix: new hashes for login * Fix: new certificat Module: tvsubtitles * Add attribute 'ext' Module: youtube * Support for a silly protection (#1277) * Detect if video is forbidden * Use https * Change maintainer * Fix: encoding of pages * Fix: stop search queries if there is no more results * Fix: parsing details * Fix: crash with weird characters * Fix: credentials encoding Module: vimeo * Get authors Module: weather * Add a favicon Tools * boilerplate.py: fix encoding issues * boilerplate.py: add default license * pyflakes.sh: more code quality checks * pyflakes.sh: use only tracked Python files * pyflakes.sh: add lines number * pyflakes.sh: ban more stuff * local_install.py: no deps by default on local install * local_run.py: do not copy the backends file * local_run.py: do not capture stderr * local_run.py and run_tests.sh: remove stale .pyc files * local_run.py: allow complete paths for script * local_run.py: allow overriding WEBOOB_BACKENDS * weboob_bash_completion: fix bash completion Contrib: boobot * Support python-irclib >= 3 * Proper freenode server name * Irc 5.0+ compatibility * Display regular URL info * Support multiple channel * Fix weird/unicode URLs * Guess page encoding * Better newline handling * Support servers without HEAD * Faster timeout * Twitter support * Configuration of boobot storage path * Better handling of zero/invalid HTML * Proper ^C closing * Support ignored users Contrib: freemobile-munin * Fix SMS regexp Contrib: generic-munin * Allow float values * Do not start every graph to 0 * Use rigid Packaging * Add --nodeps option to ignore dependencies in setup.py * Rename Makefile -> build.mk to avoid spurious build attempts * Use Pillow, unless PIL is already there * Better README/INSTALL files * Workaround Debian compatibily layer Weboob 0.f (2013-03-26) General * New application: booblyrics * New application: cineoob * New application: cookboob * New application: suboob * New application: qcineoob * New application: qcookboob * New capabilitie: CapSubtitles * New capabilitie: CapCinema * New capabilitie: CapLyrics * New capabilitie: CapRecipe * New module: American Express (CapBank) * New module: Paypal (CapBank) * New module: Crédit du Nord (CapBank) * New module: Allocine (CapCinema) * New module: IMBD (CapCinema) * New module: Parole De Musique (CapLyrics) * New module: Parolesmania (CapLyrics) * New module: Seeklyrics (CapLyrics) * New module: 750g (CapRecipe) * New module: Cuisineaz (CapRecipe) * New module: Marmiton (CapRecipe) * New module: Attilasub (CapSubtitle) * New module: OpenSubtitles (CapSubtitle) * New module: tvsubtitles (CapSubtitle) * New module: Btmon (CapTorrent) * New module: DresdenWetter (CapWeather) * New script: Generic Munin Plugin Core * Do not cry if an object is not support to be filled by a backend * Add a CSV parser * Remove two old and useless debug messages (bcall) * Force updating modules after upgrade (#1066) Core: application * Fix crash when there is no selected fields * Allow infinite search with 0 * Add a JSON encoder * move to_dict to base.py (#1060, #1061) Core: browser * Ability to set a ENCODING constant to BasePage which overrides the Browser's one * Use recent firefox user agent (Firefox ESR) * Fall back on SSLv3 if TLSv1 fails * Cache the sucessful SSL protocol Core: tools * Create DateGuesser extracted from cragr Application: boobill * Improve documentation of download command Application: havedate * Display contact IDs in 'events' command output Application: pastoob * Add command-line parameters (#920) * Support "no expiration" Application: videoob * Add resume option for video downloading * Stop the video when closing with ESC Application: webcontentedit * Add non tty stdin support to edit command * Add "get" command to webcontentedit Application: Wetboobs * Add a default error message on SensorNotFound Module: aum * Handle GONE exception * Mimic mobile application (#1041) * Fix: date used may be UTC * Fix: display of summary * Support new 'favorite_food' field * Go on website to get stats and geographical position * Read field ratio * Don't stop on threads with a contact who left the website * Fix: send email when taken in a basket Module: axabanque * Remove mkdtemp in module * Fix: crash on a new tab Module: banquepopulaire * Fix: parsing of some card transactions * Update regexps Module: barclays * Update regexps * Support market page (but do not display any history) * Support when accounts are in javascript... Module: bnporc * Remove mkdtemp in modul * Support pro accounts Module: boursoram * Take id of the website for transactions * On page to update user information, raise BrowserIncorrectPassword * Get maximum history * Do not crash for special accounts * Remove mkdtemp in module Module: bp * Fix: New SSL certificat Module: bred * Fix: deferred debit cards parsing Module: caissedepargne * Update regexps * New SSL certificat * Support more history Module: cic * support pagination * support wher forced to go on change_password page * Fix: crash on pagination Module: cmso * Update regexps Module: cragr * Use LinearDateGuesser * New maintener * Support new website Module: creditmutuel * Transfer now accepts long and short IDs * Support pagination * Support wher forced to go on change_password page * Fix: transfer problem * Fix: crash on pagination Module: dailymotion * Fix search * Avoid redirects * Fix: extraction of video url Module: dlfp * Do not crash when revision is provided(#1067) Module: fortuneo * Update regexps * Support when website asks to renew password * Fix: card transaction pattern * Fix: accounts list on new version of website * Get more history * Support PRLV pattern Module: francetelevisions * Fix: search Module: freemobile * Add an id for calls * Fix get_bill * Add multi-account support for bills command Module: gdcvault * Retrieve now video, audio, slides and Dual Screen Video * Implement searching * Implement login * Handle pages with redirects to files * Fix a lot of bugs on some pages Module: hsbc * Support deferred cards * Do not support other kind of account histories than CPT Module: ing * Detect when website is unavailable * Fix: new website * Fix: generation of IDs * Merge LoginPage and Login2Page to prevent problems when the website fails with 500 * Prevent useless debug folders Module: isohunt * Fix: bug if leech or seed is empty corrected * Fillobj integration Module: kickass * Fix: downloading gziped torrents * Fix: download URL and support magnets * Return NotAvailable if needed * Fix: url correction * Fix: download URL and magnet support in all iter_torrents Module: mediawiki * Add support for the revision argument Module: lcl * Support when there is an error * Remove mkdtemp in modules Module: leclercmobile * Add an id for balance objects Module: nettokom * Fix: crash when no data available * Display validity date of subscriptions Module: piratebay * Fix: bug on empty result page corrected * fillobj integration * get_torrent return None if 404 * Unescape title Module: presseurop * Better id management * Increase RSS size Module: redmine * Add support for the revision argument (#1067) Module: sachsen * Fix: as0.gif keyerror * Better image analyse Module: societegenerale * Fix: login * Fix: Do not crash when an account is unavailable * Fix: Transfer regexp * Recipient of a transfer can be a name Module: trictractv * Add an icon Module: vimeo * Fix for no-embed videos Module: wordreference * Fix: Take the first word * Make result cleaner * Add favicon Module: youtube * Fix: detection of media url on youtube Capabilitie: CapBank * More robust currency guessing * Fix repr() on transactions with unicode labels * support empty dates for transactions Documentation * New git URL * Add missing "whatis entry" to man pages (#618) Contrib * Add a "id_regexp" parameter to filter results on video id * Exclude on case sensitive pattern * Add utf-8 support on title_exclude Tools * Add basic boilerplate script (replace gen_comic_reader.sh) * Remove storage_convert.py * Ignore Qt generated UI files (pyflakes) Packaging * Update setup.py for latest Gentoo installs * Use a central Makefile * Fast and silent building * Ensure proper building of man pages * Tell groff manpages are utf-8 * Update INSTALL Weboob 0.e (2013-01-25) General * New module: Axa Banque (CapBank) (#807). * New module: Barclays bank (CapBank). * New module: Carrefour Banque (CapBank). * New module: Credit Cooperatif (CapBank). * New module: Credit Mutuel Sud Ouest (CapBank). * New module: Gan Assurances (CapBank). * New module: Mangago (CapGallery). * New script: anonymiser.sh. Module: Arte * Fix: parsing video title (site changed). Module: Banque Populaire * Update transaction regexps. * Correctly encode login and password. * Fix: change hostname of Aquitaine Centre atlantique bank region. * Fix: parsing accounts for some specific versions of website (reported by Alain Spaite). * Get the full label of an account. * Fix: parsing banquepopulaire accounts with no link. * Fix: crash where there is no transactions for an account. * Fix: date parsing (happy new year). * Add Credit Maritime regions compatibles with Banque Populaire. Module: bnporc * Add a second SSL cert. * Support international withdrawal. Module: Boursorama * Fix: Correctly parse label of deferred card transactions. * Support of Livret A accounts. * Support new Virtual keyboard. Module: bp * Fix: compatibility with python2.6. * Add a SSL timeout. * Support page delestage. * Support deferred debit. Module: Bred * Correctly encode login and password. * Support payment in several times. * Fix: parsing accounts when there are interlines. * ignore special accounts. * Fix: crash when there is no ID on a transaction. Module: Caisse d'épargne * Handle login errors. * Support when website is unavailable. * Parse more card transactions. * Fix: parsing funding accounts. * New favicon. Module: cic * New favicon. * Fix: parsing amounts in special cases * Fix: parsing card pages in special cases Module: cmb * do not consider special accounts * Fix: parsing balance Module: CrAgr * update transaction regexps * Fix: do not crash if there is no history link for an account * correctly use iterators Module: dlfp * Allow anonyme browsing (#923) * Fix: deconnection error * Fix: Support new html structure Module: ebonics * Add favicon Module: ehentai * Fix: Support new website Module: Fortuneo * Add new certificate Module: France Télévisions * Fix: Support new website Module: Freemobile * Fix: Support the new website * Add a real id for all details objects (#932) * Add renew date (#931) * Support of multi-accounts (#890) Module: Gazelle * Fix: parsing torrents descriptions Module: HSBC * Raise exception on login error Module: ING * Add ICapBill to download monthly reports (#897) * Add support of proxy account * Add support of Livret Epargne Orange accounts * Fix: crash when there is no operation on an account * Support question page Module: INA * Try to handle more videos Module: LCL * Fix: login regexp * Add the new SSL certificat * Add a pattern to detect cards Module: Leclercmobile * Fix: Support new versions of website Module: Le Figaro * Fix: encoding * Remove some unused files (#819) * Fix: author selection Module: Nettokom * Add validity date Module: Opacwebaloes * Fix: Accept ID with 8 chars (#921) Module: pastalacon * Remove some test warnings Module: pastebin * Fix: visibility detection * Fix: login without API * Remove some test warnings Module: Piratebay * Fix: search (site changed) Module: Presseurop * Remove tweeter sharing * Use clean_relativ_urls * Fix: Support new version of daily titles Module: Sachsen * Add a favicon * Search is no more case sentitive * Use ICapGauge instead of ICapWaterLevel * Get alarm level Module: Societegenerale * Handle error when service is unavailable * Update transaction regexps * New SSL certificat * Check date of card debit to apply it * Fix: crash on special accounts Module: Taz * Remove some adds Module: Wordreference * Fix: parsing (#840, #1036) Module: youporn * Set domain to www.youporn.com Module: youtube * Fix: login CapBank * Support currencies CapBill * Rename iter_history to iter_bills_history * Add validity and renew date fields CapCollection * Declare fields to avoid warnings CapGauge * Change API to be more flexible * Add GaugeSensor objects CapVideo * Fix: CapVideo-related ConversionWarnings (dailymotion, ehentai, francetelevisions, ina, radiofrance, youjizz, youporn, youtube) CapWaterLevel * Rename it to ICapGauge Console Applications * Properly get to the previous path, not home * Add support for ls -d option (#858) * Add global "insecure" option to skip SSL validation (#930) * Allow to exclude some backends (#617) Application: boobill * Add the keyword "all" to download command Application: boobmsg * Improve documentation of export_thread * Allow "show" command in non-interactive mode * Datetime now human readable Application: comparoob * Remove double products with multiple backends * Sort results in comparoob (#934) Application: radioob * Support of rtmp Application: videoob * Add -e to rtmpdump options * Allow to use all videos players * Allow to give arguments to players * Add mplayer2 support Application: weboob-config * fix double message "Unable to load module" Application: wetboobs * Change to use ICapGauge instead of ICapWaterLevel * Add sensors command Tools: html2text * Set INLINE_LINKS to false Tools: Newsfeed * Take the creation date if no update available Tools: Messages/GenericBackend * Get the real thread of an article * Add clean_relativ_urls function Tools: VirtKeyboard * Add an overridable method to check pixel colos * Add a parameter "convert" Tools: IParser * Add a raw parser Tools: LxmlParser * Get all strings under this element Tools: tests * Save and submit test results * Better way of handling non-module tests * Guess the right builder name * Use the guessed nosetests for the core tests too Tools: pyflakes * Use flake8 if available instead of pyflakes Core * Check value of ValueBackendPassword during load * Add new exception BrowserForbidden and add handler in applications * Fix langage when the lastet version is already installed * Allow multiple CERTHASH values in a module * Ability to specify a parser to use on a page handler Installation * setup.py: print what executable we were looking for * setup.py: be less confusing when make is missing Contrib: boobank-munin * Fix: encoding issue Contrib: downloadboob * Correctly create symlink and support when one is removed * 'exclude' parameter is case insensitive Contrib: nettokom-munin * Print all labels in config mode and stack results Weboob 0.d (2012-10-28) General * New module: BanquePopulaire (CapBank). * New module: Bred (CapBank). * New module: CaisseDEpargne (CapBank). * New module: CIC (CapBank). * New module: Ebonics (CapTranslate). * New module: EuroParl (CapVideo). * New module: GDCVault (CapVideo). * New module: LeclercMobile (CapBill). * New module: Vimeo (CapVideo). * New module: Weather (CapWeather). * New script: contrib/downloadboob to automatically download vidéos matching some criteria (#838). * Add a basic system to check SSL certificates. Console Applications * Correctly check new version of the module. * Short commands for all applications (and suggestions). Module: AuM * Add a status field to display number of new visits. * Support new API (#871,#900,#902). Module: BNPorc * Strip trailing 'CARTE XXX' from card transactions labels. * Get last 100 transactions instead of 30. * Fix: website changes. Module: Boursorama * Correctly handle case that we don't support the history page of an account. * Fix: unlimited loop in case of bad credentials. Module: BP * Parse labels and detect type of transactions. * Get maximum of transactions in history. * Workaround to libssl 1.0.1c-4 bug in Debian (#863). Module: CappedTV * Fix: proper handling of No Results Found. Module: CMB * Support proxy. * Check SSL certificate. * Fix: a bug in the accounts listing. Module: CrAgr * Reworked the whole parsing for 'list' and 'history' operations. * Parse labels and detect type of transactions. Module: CreditMutuel * Support deferred debit. * Never store 'RELEVE CARTE' transactions (redundancy with card transactions). * Fix: login (skip page which warns about phishing). Module: Dailymotion * Add support for embed URLs. * Fix: parsing authors on anyclip videos. * Fix: search-then-play combination (#860). Module: Fortuneo * Fix: website changes. * Fix: check on login failure. Module: FreeMobile * Catch unit for data. * Support multiple accounts. * Fix: login (website change). * Fix: pdf downloading. * Fix: international calls. * Fix: parsing name with a dash. Module: Gazelle * Fix: parsing title on whatcd. Module: HDS * Fix: parsing dates. Module: HSBC * Support history and coming transactions. * Fix: duplicated IDs of accounts. * Fix: parsing of accounts and history. Module: ING * Transaction IDs are generated with a hash function. * Use static IDs of accounts. * Support tranfers. Module: LCL * Parse labels and detect type of transactions. * Display password renewal warning. * Support CB operations. * Support several contracts. Module: LeFigaro * Fix: parsing of live articles. Module: Minutes20 * Fix: RSS feed url has changed. Module: Nettokom * Fix: website change about authentication. Module: Newsfeed * Add a link on top of content. Module: NolifeTV * Fix: authentication and retrieve of video url (#880). Module: Nova * Fix: retrieving of current song. Module: PAP * Fix: parsing housings (#874). Module: PressEurop * Fetch last 140 entries instead of 50. Module: PrixCarburants * Fix: regexp of product name in page. Module: RadioFrance * Support franceinfo archives. Module: SocieteGenerale * Truncate password to 6 digits. * Handle error message when unable to login. * Support deferred debit cards. * Fix: follow next pages of history. * Fix: website changes about authentication (#891). Module: Transilien * Support when a train is removed (#894). * Fix: parsing time (#866). Module: Yahoo * Fix: search of cities (website change). Module: Youjizz * Fix: parsing of duration. * Fix: parsing video url. Module: Youporn * Fix: website changed. Module: Youtube * Add support for youtube-nookie.com. * Fix: login and play of nsfw videos (#918). * Fix: finding video url (website change). Application: boobank * Fix: QIF spec requires capitalized 'type' (#898). Application: boobill * New command 'balance'. Application: comparoob * Fix: selection of product. Application: freemobile-munin * Add parameter 'phonenumber'. * Fix: data parsing. Application: havedate * Add command 'events'. Application: pastoob * Abort if paste is empty. Application: QHaveDate * Nicknames are selectable (#869). Application: QVideoob * White background is not forced anymore (#823). Application: translaboob * Add 'nigger' language. Application: weboob-debug * Support more shell libs (ipython, bpython, standard python). Appliccation: wetboobs * Ability to display temperatures either on celsius or on fahrenheit. Core * Use module 'imp' instead of '__import__'. * Fix table formatter with python-prettytable 0.6. Weboob 0.c (2012-05-04) General * New capability: CapPriceComparison. * New capability: CapTranslate. * New module: ChampsLibres (CapBook). * New module: Fortuneo (CapBank). * New module: GoogleTranslate (CapTranslate). * New module: NettoKom (CapBill). * New module: Okc (CapDating). * New module: PrixCarburants (CapPriceComparison). * New module: Taz (CapMessages). * New module: WordReference (CapTranslate). * New application: comparoob (CapPriceComparison). * New application: translaboob (CapTranslate). * New script: boobot. * New script: nettokom-munin (Nettokom). * New script: report_accounts.sh (CapBank). * Application havedate now inherits commands of boobmsg. * Fix: use the right default value for XDG_DATA_DIRS. Console Applications: * Add completion on 'ls' and 'cd' commands. * When a module requests to application a password (for example if it is not stored in the backend config), display a real question, not only 'Password:'. * Use $EDITOR env variable to edit input. * Rewrite of the formatters system. * When a bug occurs in a module, suggest user to update it. Capability: CapBank * Rename Operation object to Transaction. * Rename iter_operations() to iter_coming(). * Add a field Transaction.rdate to store date of payment. * Add field Transaction.type (enum). * Add field Account.type (enum). * Create a class FrenchTransaction in weboob.tools.capabilities.bank to help parsing transactions of french banks. * Use decimal.Decimal instead of float to store amounts of money. Module: AuM * Fix: website has changed its charset. * Fix: don't crash when a message content is empty. * Fix: save IDs as integers in storage. Module: Arte * Fix: getting latest videos. Module: BNPorc * Support private messages (CapMessages). * Fetch the last 100 transactions (instead of 30). * Support CIF accounts. Module: Boursorama * Parse categories and dates. * Ignore spurious accounts. * Fix: credit and debit where inversed. Module: BP * Don't list spurious accounts. Module: CrAgr * Fix: parsing dates. * Fix: CA Centre website has changed (#850). Module: CreditMutuel * Capitalize each words in account labels. * Fix: parsing accounts list whene there is no history associated. * Fix: parsing history when there are extra columns. * Fix: use unique IDs for accounts. Module: Dailymotion * Fix: getting latest videos. * Fix: getting thumbnails. * Fix: parsing video IDs. Module: DLFP * Do not get pages with 0 comment. * Add a cleanup function to dlfp backend. Module: FranceTelevisions * Fix: getting latest videos. Module: FreeMobile * Fix: remove timer (not more used by website). * Fix: website has changed. * Fix: multiple accounts login. Module: ING * Use FrenchTransaction for parsing transactions. * Get more historical transactions. * Catch error on password/birthday/login. * Fix: website changes on livret A history. Module: LCL * Add a regexp on password field. * Fix: getting accounts. * Fix: crash when the balance is negative. * Fix: site specific fix. * Fix: parsing account labels. * Fix: always go on the history page. * Fix: when history is empty. * Fix: prevent infinite loop when password is wrong. Module: MangaFox * Fix: domain name change. Module: PressEurop * Fix: parsing of cartoon pages. * Fix: real author catching on article pages. Module: RadioFrance * Fix: crash when there is no author. Module: Sachsen * Catch “Go Up” value. Module: SocieteGenerale * Support display of history and coming transactions. * Fix: when there is no transaction for the account. Module: Transilien * Fix: roadmap when there is no confirm page. Module: YouJizz * Fix: getting video URLs. Module: YouPorn * Fix: changes on website. Application: boobank * Add a new pretty_qif formatter (use label and rdate if exist). Application: boobathon * Fix: close command. Application: boobill * Get all available subscriptions for 'details' command (#846). Application: boobmsg * New command 'photos' to display photos of a contact with cacaview. * Add an 'atom' formatter. Application: bonboob * Add a command 'once' to process retrieving of messages once. Application: QWebContentEdit * Possibility to edit an url (#619). * Add a 'History' tab. Application: weboob-config * Remove 'install' command. Script: freemobile-munin * Fix: condition to detect empty output. Script: hds/export.py * Fix: loading HDS module. Core: * Change way to describe fields of CapBaseObjects. * Add a lot of code documentation. * Warn when implicit conversions happen on CapBaseObjects. * Create UserError exception for errors raised by modules. * Scheduler: do not stop timer because of an exception. * Repositories: support gpgv2 (#837). Weboob 0.b (2012-03-14) General * New capability: CapBill. * New capability: CapBook. * New capability: CapHousing. * New capability: CapWaterLevel. * New module: CappedTV (CapVideo). * New module: FreeMobile (CapBill). * New module: OpacWebAloes (CapBook). * New module: Pap (CapHousing). * New module: PressEurop (CapMessages). * New module: Sachsen (CapWaterLevel). * New module: SeLoger (CapHousing). * New application: boobill (CapBill). * New application: boobooks (CapBook). * New application: flatoob (CapHousing). * New application: QFlatBoob (CapHousing). * New contrib script: freemobile-munin. * Rename application: havesex -> havedate. * Rename application: QHaveSex -> QHaveDate. * Remove module: MangaToShokan (website is dead). Console applications: * Improvements of 'ls' and 'cd' commands. * Fix: crash when trying to add twice a same module. Module: Boursorama * Fix: IDs of operations. Module: BNPorc * Parse categories. * Parse account types. * Fix: getting history of secondary accounts. Module: BP * Store transactions dates as datetime.date objects. * Fix: parsing of accounts in particular cases. Module: CanalPlus * Friendlier paths in canalplus. Module: CMB * Add type and label support to CMB backend. Module: CrAgr * Now handle history-less accounts, at least for Toulouse-like layouts. * Transaction objects are now created using datetime.date (#800). * Fix: balance retrieval for history-less accounts (#788). Module: CreditMutuel * Store Transaction.date as a datetime.date object. * Support loan history. * Parse type of transactions. * Fix: lot of bugs. Module: DLFP * Parse a comment only if needed (performances enhancement). * Get comments only in case of rss-comments changes. Module: Ecrans * Store only last 20 articles. Module: HSBC * Display only real accounts. Module: ING * The account listing is now more robust. * Parse types of transactions. Module: Kickass * Fix: search was broken. Module: Mangafox * Fix: crash on Comments page. Module: NolifeTV * Support authentication. * Fix: parsing of videos with missing description. Module: OuiFM * Fix: error when no artist/title. Module: Pastebin * Fix: getting pastebin paste visiblity. Module: Piratebay * Support magnets properly. Module: RadioFrance * Support replay. * Use a better source for FIP. * Fix: fetching FIP current. Module: SocieteGenerale * Check if login is failed. Module: Youtube * Fix: crash when there is no author. Application: boobank * Display types of transactions. * Add formatter 'transactions'. Application: chatoob * Removed because unused. Application: videoob-webserver * Moved to contrib/. Application: weboob-config * Fix: command 'list' can filter by capability (#786). Application: weboorrents * Support magnet URLs. Application: wetboobs * Now supports CapWaterLevel in addition to CapWeather. Core: * Big refactoring of CapCollection. * Use libyaml for faster loading and saving. * Sign modules.list. * Support gzipped responses in Browser. * Fix: retrieving third icons if module is local. Weboob 0.a (2012-02-05) General * New backend: Boursorama (CapBank). * New backend: CMB (CapBank). * New backend: HSBC (CapBank). * New backend: ING (CapBank). * New backend: Nolifetv (CapVideo). * New backend: RadioFrance (CapVideo, CapRadio) which merges FranceInter and LeMouv backends. * Support repositories to manage backends (#747). * Support XDG Base Directory Specification (#765). * Make CapCollection understandable and usable by humans. Console applications * Ability to add all supported modules at once. * With -a, try to separate saved responses by backend (#661). Qt applications * Verbose error messages (#775). Backend: AuM * Display the 'title' field on contact profiles. * Get events (baskets, charms and visits). * Add city in status message. * Add 'Sent with my iPhone' in mail signatures when needed. * Display at least one photo url in profile even if there isn't any visible. * Add a 'ratio' field. * Fix: getting contacts list. * Fix: support new API. * Fix: ipaddr is not available anymore. * Fix: do not crash if there are php errors before json. Backend: Batoto * Change .com to .net. Backend: BNP * Fix: website changed (#769). Backend: BP * Fix: website changed. * Fix: open images in memory instead of saving them in temp files. Backend: CanalPlus * Support https?://www\.canal-?plus\.fr/.*\?vid=(\d+) urls. Backend: CreditMutuel * Internal transfer implemented. * Fix: website changed. Backend: Dailymotion * Fix: support missing descriptions. Backend: DLFP * Limit feed entries by date instead of number of results. Backend: FranceTelevisions * Fix: website changed. Backend: Gazelle * Handle general errors when website is unavailable. Backend: INA * Fix: parsing of URLs. Backend: Kickass * Fix: website changed. Backend: LCL * Add support for various types of accounts. * List 45 days history by default. * Fix: website changed. Backend: LeFigaro * Better cleanup of generic articles (#725). * Fix: website changed. Backend: Orange * Fix: unicode errors. Backend: Pastebin * Handle user pages. Backend: Piratebay * Fix: website changed. Backend: SocieteGenerale * Fix: website changed. Backend: Youjizz * Fix: video URLs have changed. Backend: Youporn * Fix: website changed. Backend: Youtube * Fix: website changed. Application: QBoobMsg * When a thread is a discussion, display messages linearly. * Add a button 'Profile'. Application: QHaveSex * Add a 'Events' tab. * Add a 'Notes' tab for taking notes about a contact. Application: QVideoob * Fix: crash when there is no thumbnail on a video (#708). Application: weboob-config-qt * Ability to edit sources.list, update repositories and install modules. Weboob 0.9 (2011-10-10) General * New backend: Batoto (CapGallery). * New backend: Eatmanga (CapGallery). * New backend: FranceTelevisions (CapVideo). * New backend: HDS (CapMessages). * New backend: Izneo (CapGallery). * New backend: Mangafox (CapGallery). * New backend: Mangahere (CapGallery). * New backend: Mangareader (CapGallery). * New backend: Mangatoshokan (CapGallery). * New backend: Nova (CapRadio). * New backend: PhpBB (CapMessages, CapMessagesReply). * New backend: Simplyread.it (CapGallery). * New application: boobtracker (CapBugTracker). * New script: hds/export.py to export stories from histoires-de-sexe.net into a sqlite database. * License change to AGPLv3+. * Ability to not save backend passwords. Applications will prompt them when needed. Backend: Arte * Set duration on video results. Backend: AuM * Rewrite to use the mobile API. Backend: BNPorc * Get operation categories. Backend: CrAgr * Get full history. * Optimized operations retrieval for CA Centre. * Fix: parsing accounts list. Backend: CreditMutuel * Maine-Anjou, Basse-Normandie bank added. Backend: Dailymotion * Fix: parsing duration. * Fix: parsing of lives in search results. Backend: DLFP * Fix: disconnection URL needs to be called with POST instead of GET. * Fix: do tests on alpha.linuxfr.org. * Fix: relevance on news/diaries. Backend: Gazelle * Handle login errors. * Fix: parsing on several gazelle websites. Backend: INA * Support videos on www.ina.fr (in addition to boutique.ina.fr). Backend: IPInfoDB * Fix: no crash when there are no coordinates from server. Backend: Kickass * Fix: parsing of search results (#663). Backend: MediaWiki * Handle errors from API. Backend: MeteoFrance * Fix: website changes. Backend: Orange * Fix: handling of pages. Backend: PirateBay * Fix: parsing of search results. Backend: Redmine * Now implements CapBugTracker (#684). Backend: Transilien * Supports the roadmap feature (#681). Backend: Youtube * Support more URLs. * Support authentication. * Fix: website changes. Application: boobank * Add the 'qif' formatter. Application: boobank-munin * When handling an incorrect password error, disable backend to prevent your bank to disable your account (for example with BNP). Application: pastoob * Ability to pipe output. Application: traveloob * New command 'roadmap' to get the roadmap between to stations. It's also possible to give a departure or an arrival time (#681). Application: videoob * Do not run player in background (#664). * Command 'download' supports mms streams. Application: weboorrents * The given filename to command 'getfile' is optional (#683). Weboob 0.8 (2011-05-08) General * New backend: E-Hentai (CapGallery). * New backend: FranceInter (CapRadio). * New backend: LeMouv (CapRadio). * New backend: PasteALaCon (CapPaste). * New backend: PasteBin (CapPaste). * New application: Boobathon (CapContent). * New application: Galleroob (CapGallery). * New application: Pastoob (CapPaste). * Fix lot of unicode problems. * License changed to AGPLv3+. * FreeBSD support. Repl applications * The new CapCollection capability is supported by every REPL Application. At the moment, only few backends implement it. * Better messages and return codes in applications. Backend: AdopteUnMec * Fix: website changes (#508,#637,#638,#639). Backend: BNPorc * The 'rotating_password' parameter is now an hidden one (#627). * Ability to do transfers to external recipients. Backend: BP * Add 'comptes titres', 'comptes vies' and 'comptes retraites' to the list of accounts (#567). * Fix: website changes (#621). Backend: CanalPlus * Implement the new CapCollection capability. Backend: CrAgr * Support of a new history layout. * Fix: login issues with the Toulouse website (#629). Backend: Dailymotion * Fix: URL was not found in special cases. Backend: FourChan * Fix: support message "AMERICA FUCK YEAH" outside of a thread. Backend: Gazelle * Fix: work with broken gazelle websites. Backend: Inrocks * Fix: matching URLs. Backend: KickAss * Several fixes and enhancements (#651). Backend: LCL * Fix: websites changes. Backend: OuiFM * Implements the new CapCollection capability. Backend: Transilien * Add the PAA code for Gare de Lyon. Backend: Youtube * Support more URLs. Backend: Youporn * Correctly set the 'ext' attribute on videos. Application: monboob * Check configuration (#484). Application: weboob-config * New commands 'enable' and 'disable'. Core * Use lowercase http_proxy environment variable. * select() function has been moved into parser. * Support for xpath in LxmlHtmlParser.select. * Fragments are removed from URLs (#636). * Remove a hack from feedparser which fixes parsing of webpages with recent versions of this library. * Also log redirects when saving responses and debugging (#398). Weboob 0.7 (2011-04-01) General * New backend: Dailymotion (CapVideo). * New backend: Ecrans (CapMessages). * Now compatible with Windows (is it really a good news? :)). Console applications * Do not print escape characters (like bold) when using -O. Backend: AuM * Fix: parsing of smileys (#532). * Fix: new page (#535). Backend: BP * Fix: parsing of accounts is case there are missing sections. Backend: CreditMutuel * Compatibility with other agencies (#550). Backend: DLFP * Ability to plusse/moinse contents. * Ability to tag a content. * Support the board. * Support comments signatures. * Support wiki, forums, polls, tracker. * Now implements CapContent to edit wiki. Backend: FourChan * All messages are children of thread. Backend: Inrocks * Add support of 'InrocksTV' pages. Backend: IpInfoDB * Fix: crash when lat/long are empty (#585). Backend: LCL * Fix login, and implement CapBank methods. Backend: Newsfeed * Fix: correctly set the UNREAD flag. Backend: Orange * Fix: posting messages (#614). Backend: Redmine * Fix: support project names with '-' in. Backend: Transilien * Fix: don't keep previous results. * Change user-agent of browser and use HTTPS (#580,#583). Backend: Youjizz * Fix: crash when duration is not available. Backend: Youtube * Now correctly handle gdata errors. * Fix: get video from page URL. * Fix: get file URL of video. Application: boobmsg * New command 'export_all'. * New xhtml formatter. Application: masstransit * Works without conic or hildon (#562). * Add banner on load. Application: QWebContentEdit * Better errors management. Application: videoob * New command 'download'. Application: webcontentedit * Set a default editor (#557). Core * Split of ReplApplication to create ConsoleApplication. * Remove the 'refresh' feature from Browser (to prevent unwanted behaviors like freezes). * Browser has upgraded Firefox from 3.0.3 to 3.6.13. * Browser doesn't retry on 404 errors. * Script to generate Sphinx API documentation. Weboob 0.6 (2011-03-01) General * New backend: Inrocks (CapMessages). * New backend: LeFigaro (CapMessages). * New backend: MediaWiki (CapContent). * New backend: Minutes20 (CapMessages). * New application: QWebContentEdit (CapContent). Backend: AuM * Fix: website changed, mails.php renamed to mail.php. Backend: BNP * Fix: the captcha has been changed on their website (#461). Backend: CrAgr * Fix: the history operation works when every non-ASCII character on the bank website is replaced with two interrogation marks. * Fix: calculation of cents. Backend: CreditMutuel * Fix: negative value correctly considered by 'list' Backend: DLFP * Fix: website changed to a new version (#503). Backend: IsoHunt * Fix: website doesn't provide seed information on info page anymore (#529). Backend: KickAss * Fix: size span detection improved (fixes #497). Backend: OuiFM * Fix: website changed to get current song. Backend: PirateBay * Fix: parsing to find leecher and seeders (#458). Backend: Redmine * Adds support for previewing modifications on redmine's wiki pages. * Fix: when login/password is invalid. Backend: Yahoo * Fix: didn't load with python < 2.6 Application: boobmsg * New command 'export_thread'. * New parameter '-t' on the 'post' command to set a title. Application: monboob * Fix: catch errors when trying to bind the SMTP server (#485). Application: QBoobMsg * Fix: reload of backends list. Application: webcontentedit * New command 'log' to display all revisions of a page. Application: weboob-config * The 'edit' command can be used to interactively edit one backend, instead of opening the './weboob/backends' file with a text editor. * Checks on given backends for 'backends ' subcommands. Application: weboob-config-qt * Fix: crash when trying to add an already existing backend. Repl Applications * New parameter '-O' to set an output file. Core: * Fix: Browser.location() crashes when uri is empty (#488). * Fix: catch every exceptions when loading a backend (not only ImportError). Weboob 0.5 (2011-01-08) General * New backend: MeteoFrance (CapWeather). * New backend: Orange (CapMessages, CapMessagesPost). * A new tool, make_man.py, is used to generate manpages. Backend: Bouygues * Fix: logging issues (#444). Backend: CrAgr * Fix: do not keep accounts list in cache. * Fix: extraction of amounts >999€ and negative amounts. Backend: KickAss * Fix: website changes (#457). * Fix: size parsing. Backend: PirateBay * Fix: size parsing. Backend: Yahoo * The 'search' command is implemented. Backend: Youtube * Fix: website changes (#450). Application: boobmsg * The 'post' command can take message from command-line instead of stdin. * Fix: encoding problems. Application: videoob * Fix: playing videos in some cases (#446). Application: wetboobs * Rewrite of application to use formatters. Weboob 0.4 (2010-12-01) General * New backend: Bouygues (CapMessagesPost). * New backend: CanalPlus (CapVideo). * New backend: CreditMutuel (CapBank). * New backend: IPInfoDB (CapGeolocIp). * New backend: IsoHunt (CapTorrent). * New backend: KickAss (CapTorrent). * New backend: PirateBay (CapTorrent). * New backend: SFR (CapMessagesPost). * New backend: SocieteGenerale (CapBank). * New application: boobmsg (CapMessages, CapMessagesPost). Console applications * New command 'inspect' to open a graphical webkit browser with the current page (to help debugging). If it is not available, the page source is displayed on stdout. * In question prompts, display a bullet list when there are too many choices. * The --save-responses (-a) parameter stores now pages in a directory and save here a debug log and a list of visited URLs associated to the files. * Fix unicode issues (#436). Backend: AuM * Do not send baskets messages from left sluts. * Anti-spam is updated. * Raise an error when user is banned. * New optimization PRIORITY_CONNECTION to create fake godchilds to allow user access to website between 18h and 1h. (#319) * New optimization QUERIES_QUEUE to enqueue queries in case no charms are available. * New backend parameter 'baskets' to enable getting baskets messages. * In profiles, look for hidden photos. Backend: BNPorc * Fix: display of coming operations. * Fix: check if the password rotation has been succeed. Backend: BP * Backend has been rewritten to use BaseBrowser (#422). * Fix: backend initialization. * Fix: parsing of accounts. * Fix: handle of transfers errors. Backend: CrAgr * Support of history operations. * Support monay transfers. * Choose the agency website in a list instead of giving URL. Backend: DLFP * Store datetime from newsfeed in the Thread object (#419). * Now the session is closed at deinit. * Fix: when posting a comment, send right parameters to immediately display it. Backend: GeolocIP * Use the website www.geolocip.com instead of www.geolocalise-ip.com. It prevents authentication and limits. Backend: INA * Fix: parsing date, duration and title. Application: boobank-munin * Save cache in .weboob/munin/ and handle errors. * New option 'boobank_cumulate' to display graph as areas instead of plots. Application: havesex * The optimizations management has been rewritten. * New command 'query' to send a query to a contact (like a charm or a poke). * Fix: do not exist after displaying a profile in interactive mode. Application: monboob * New option to pipe mails to an external process instead of sending it to a SMTP server. * Fix: when domain in In-Reply-To contains a '@'. * Fix: parsing incoming mails when no charset is supplied. * Fix: unicode issues. Application: QHaveSex * Display URL of contacts. * Contacts list is now sorted. * Have a photos caroussel on profile page. Application: weboob-config * New command 'confirm'. It takes an email in stdin and call corresponding backend to go on the confirm address. It is useful to automatically confirm account register. Application: weboorrents * Ability to complete paths. Core * The 'repeat' scheduler has been rewritten. * Ability to cancel a scheduled task. * Fix parsing of path-like in INI config. * Conditions are now treated by BackendsCall instead by formatters (#372). * Backends name can now contain only letters and digits. * Add a tool to generate manpages. Weboob 0.3 (2010-11-01) General * New backend: LCL (CapBank) -- unfinished. * New backend: OuiFM (CapRadio). * New backend: Newsfeed (CapMessages). * New backend: Redmine (CapContent). * New application: radioob (CapRadio). * New application: webcontentedit (CapContent). * New application: boobank-munin is a plugin for munin (CapBank). * New tests. * New global parameter --logging-file to log into a file instead of stdout. * Logging is now colorized when printed on stdout (depending on level). Console Applications * Formatters management have been rewritten. Now each command can set its own default formatter, and user can redefine them. * If output exceed the height of term, ask user to press a key for each page. * Do not display columns when all of these values are NotLoaded or NotAvailable. * Add a CSV formatter (#350). * Command 'backends register' to register a new account (#294). * Can use '$full' and '$direct' selectors. Backend: Arte * Fix: fall-back when the wanted quality is not available. Backend: AuM * New anti-spam feature to detect, block and report spambots (#313). * Implements the capability CapAccount to register new accounts (#389). * In profile walker, when reloading sluts list from search page, do not keep the previous queue to prevent visiting sluts who have been added a long time before and who are now disconnected. * Contact status is now 'connected'/'not connected since ... hours'. * Fix: do not crash if contact list is empty. Backend: BNPorc * If password is expired, switch with the value of the new 'rotating_password' backend setting. * Support transfers (#416). * Fix: don't crash when accounts don't support 'coming' (#401). * Fix: when website is not available, raise BrowserUnavailable instead of BrowserIncorrectPassword. Backend: DLFP * Replace 'cite>' and 'tt>' to 'i>' in read messages. Application: boobank * Use 'table' as default formatter. * Output for the 'list' command is more readable (#410). * When a transfer is made, display all information instead of ID. * Fix: do not load backends twice (#405). Application: QBoobMsg * Support threads display and answers. * Support sending answers (plaintext or HTML). * Unread messages are in yellow in list, and set message as read when one is selected. * Fix: correctly reload when backends have been changed. Application: QHaveSex * Ability to display a profile from URL. Application: QVideoob * Fix: search on youtube was unlimited, so QVideoob freezed. Application: traveloob * Use 'table' as default formatter. Application: videoob * Output for the 'search' command is more readable. Application: weboob-config * Add a 'register' command (#294). Application: weboob-config-qt * Add a 'Register' button to register a new account on a backend (#390). Application: weboorrents * Output for the 'search' and 'info' commands is more readable. Core * Weboob.load_backends() takes a new 'errors' argument. * CapBaseObject has a new method 'add_field' to add a field property which forces a specific type and is set to NotLoaded by default. * Browser.readurl() can take same arguments than Browser.openurl(). * If a page is not recognized by the Browser instance, save response even if -a is not supplied. * Introduce 'Value' classes to replace BaseBackend.ConfigField and is used by ReplApplication.ask(). * Use several loggers for parts of weboob. * Fix: crash when HTTP server returns shit (#406). Weboob 0.2 (2010-10-01) * Backend 'yweather' renamed to 'yahoo'. * New capability: ICapGeolocIp to geolocalise IP addresses. * New backend Arte: for the arte.tv french TV website. * New backend GeolocIp: for the geolocalise-ip.com website. * New backend BP: for the “Banque Postale” french bank. * AuM backend: check when the account is blocked. * AuM backend: ability to register new account. * BNPorc backend: support history. * CrAgr backend fix: support of another version of Credit Agricole. * CrAgr backend fix: check if website is down. * DLFP backend: display comments link in signature. * DLFP backend fix: parsing of comments when templeet sucks. * Youtube backend: support infinite searches. * Youtube backend fix: parsing of URLs (#388). * New application geolooc: a console application to interact with ICapGeolocIp backends. * New application weboob-cli: a console application to interact with every backends. * boobank application: new command 'history'. * boobank application: new command 'transfer'. * QHaveSex application: know if a message has been read or not. * videoob application: new command 'play'. * Console applications: can be interactive (repl) when run without any command (#353). * Console applications: if no backends are loaded at startup, ask user to add them. * Console applications: -s '*' fills objects. * Qt applications: display configuration window if no backends are loaded at startup. * Core: ability to fill objects already fetched to complete them. * Core: ICapMessages has been rewritten to be more efficient. * Core: can enable or disable backends. * Core: a test architecture has been written. * Core: all loaded backends now need to be configured (#368). * Core: new pargument --save-responses to debug HTML pages (#274). * Core fix: handle read URL data failure. * Core fix: Client is merged into mechanize >= 0.2 (#362). Weboob 0.1 (2010-08-03) * First public release. * The core system can load/unload backends, supports configured backends, can do asynchronous calls to specific backends. * Capabilities are abstractions to be overloaded by backends: - ICapBank - ICapChat - ICapContact - ICapDating - ICapMessages - ICapMessagesReply - ICapTorrent - ICapTravel - ICapVideo - ICapWeather * Backends interact with websites: - AuM - BNPorc - CanalTP - CrAgr - DLFP - FourChan - Gazelle - INA - Transilien - YouJizz - YouPorn - YouTube - YWeather * Applications interact with backends: Console - boobank - chatoob - havesex - traveloob - videoob - weboob-config - weboorrents - wetboobs Nokia N900 Phones - masstransit Daemon - monboob Qt - QBoobMsg - QHaveSex - QVideoob - weboob-config-qt Web - videoob-web-server