woob:3760cfdc40dfcc6656707b9a37802340e5e649d3 commitshttps://gitlab.com/woob/woob/-/commits/3760cfdc40dfcc6656707b9a37802340e5e649d32020-01-08T12:48:50+01:00https://gitlab.com/woob/woob/-/commit/3760cfdc40dfcc6656707b9a37802340e5e649d3[hsbc] adding diff ratio when available for hsbc/life_insurance module2020-01-08T12:48:50+01:00François Schmidtsfrancois.schmidts@gmail.comhttps://gitlab.com/woob/woob/-/commit/54d19c5866eb625fce5e62102416c8a786465533[hsbc] fix history issue when multiple credit cards2020-01-08T12:48:50+01:00sinopsysHKsinofwd@gmail.com
when two (or more) credit cards are linked to a same parent account, as card numbers are close to each others it can mess'up the fetch of history providing the transactions from the other card.
fixing in a row a side effect of the same issue preventing to revert CB payment record from parent account to card account to perform monthly reset.
fixing also an issue in the history which was missing some transactions:
if history is being called when no new transaction has been recorded
since last credit card payement then history tab will have only last
period and before last period shown. But currently hsbc module assume
that first tab always contains "coming" entries (which are due in the
future) so it is always skipped for fetching history. So past entries of
the last period are not fetched from history and neither form coming as
they are filtered out due to past date.
Add new mapping for transaction types related to Global Transferts (with own foreign accounts).https://gitlab.com/woob/woob/-/commit/9cdbb55a7503e8f38c68936e3bd9d9ec19bb5388[hsbc] fixing PERP AccountType2020-01-08T12:48:50+01:00François Schmidtsfrancois.schmidts@gmail.comhttps://gitlab.com/woob/woob/-/commit/c136b1b4c8685d3651c4b01eba0210d055cdefdd[creditmutuel] Handle transactions with no label2020-01-08T12:48:50+01:00Guillaume Risbourgguillaume.risbourg@budget-insight.comhttps://gitlab.com/woob/woob/-/commit/5543cfe679e4b031c1ee277b2fa675203e3b10b6[weboob/exceptions] Replace BrowserQuestion __str__ with __unicode__2020-01-08T12:48:50+01:00Guillaume Risbourgguillaume.risbourg@budget-insight.com
Currently in python 2 if we try to print a BrowserQuestion that has a
unicode message, it crash with the error UnicodeEncodeError or
UnicodeDecodeError. This can be fixed by using the __unicode__ from
StrConv.https://gitlab.com/woob/woob/-/commit/36b7cfefb4c131961435ea4862f7da0b92dbf579[boursorama] Change loan parsing to handle CLIC2020-01-08T12:48:50+01:00Axel Pelerinaxel.pelerin@budget-insight.com
Boursorama implemented a payment in 3 months called CLIC, the url was not handled, most of the page is
similar to other loans but most of the Xpaths are not persistent.
For example some Xpaths are there but empty while other lack of accents.
So I added the URL, changed most of the Xpaths to handle all loans, and
since it does not have a rate, I put a default value for this attribute.https://gitlab.com/woob/woob/-/commit/6dc8e9967bc2bdf014b01a15ff4cadaaef808de0[cragr] Remove useless fill_env in ListElement2020-01-08T12:48:50+01:00Lucas Ficheuxlucas.ficheux@budget-insight.com
The ListElement's fill_env added in 077105e8e2f89049d301cde804062360af3c3ceb
was not implemented properly and crashes the module.
Moreover, it is useless because it is only important that the DateGuesser
object be the same between the Transactions.https://gitlab.com/woob/woob/-/commit/be663cbb527117e06914fc1395c0cbb32ce44805[caissedepargne] Fixed get_measure_accounts_list + add ownership for old website2020-01-08T12:48:50+01:00Guillaume Risbourgguillaume.risbourg@budget-insight.comhttps://gitlab.com/woob/woob/-/commit/6a80691bacc79f4fa31d0ecedff59da6bac1ff4f[caissedepargne] Add missing account types2020-01-08T12:48:50+01:00Guillaume Risbourgguillaume.risbourg@budget-insight.comhttps://gitlab.com/woob/woob/-/commit/39d1f0947540e0c7a1dd17c0fef4a4ff1b4e360c[sogecartenet] Rewrote module to handle new website2020-01-08T12:48:50+01:00Guillaume Risbourgguillaume.risbourg@budget-insight.comhttps://gitlab.com/woob/woob/-/commit/f778cd5f4bac688077252be7cde6c6d9ffe23c40[browser/selenium] Set default logging level to ERROR for selenium2020-01-08T12:48:50+01:00Guillaume Risbourgguillaume.risbourg@budget-insight.com
We set the default value of selenium logger to ERROR to avoid
spamming logs with useless information.
Also, the data we send to the browser using selenium (with send_keys)
can be displayed clearly in the log, if the log level is
set to DEBUG.https://gitlab.com/woob/woob/-/commit/990bb177a0ff468d4558f0197cdb2f1750a5d0b2[cragr] Use fill_env instead of overriding LinearDateGuesser2020-01-08T12:48:50+01:00Lucas Ficheuxlucas.ficheux@budget-insight.com
Get rid of NoCopyLinearDateGuesser because it was only created to change
the behaviour of LinearDateGuesser's __deepcopy__ to avoid the copy of
the object when copying *Elements' env.
Now that you can override this behaviour with fill_env this modification
is no longer needed.
See : e1027be50a506baa6fe525a61896e3cfb9c25e6chttps://gitlab.com/woob/woob/-/commit/245abd40236d6722ce96c35e8ec57c8d321f9e9e[browser/elements] Added the ability to overrride *Elements' env copy2020-01-08T12:48:50+01:00Lucas Ficheuxlucas.ficheux@budget-insight.com
Added fill_env method to AbstractElement so that it can be
overriden in pages methods.
It is useful to chose how Env behaveshttps://gitlab.com/woob/woob/-/commit/262e0f637340ddce4ad264aeff9fc394850d8fb0[creditmutuel] Add deferred date xpath2020-01-08T12:48:50+01:00Guillaume Risbourgguillaume.risbourg@budget-insight.com
Some children of creditmutuel do not use the same xpath where we search
for the deferred date.https://gitlab.com/woob/woob/-/commit/1252fba61529163902ae961d1d46eeda6f2c2c29[boursorama] Fixed loans label xpath2020-01-08T12:48:50+01:00Guillaume Risbourgguillaume.risbourg@budget-insight.com
The xpath to get the loan's name changed on the website.https://gitlab.com/woob/woob/-/commit/f36d745184d29635aab990f13a65c6cef62b4632[cragr/api] raise ActionNeeded when SCA is required2020-01-08T12:48:50+01:00Jerome Berthierjerome.berthier@budget-insight.com
Waiting for an account to develop it, and because a consent is cross browser,
we raise an ActionNeeded to make the user performing the SCA in its side.https://gitlab.com/woob/woob/-/commit/ea8f26fa6a86c74538337339fa0a067be4d279ef[banquepopulaire] Typed several Life Insurances & repaired their investments2020-01-08T12:48:50+01:00Quentin Defenouillerequentin.defenouillere@budget-insight.com
Irriga, Generali & Delfea were not typed correctly. After typing, the
iter_investments did not work because Euro funds have no ISIN code and
the codeIsin key is absent from the JSON.https://gitlab.com/woob/woob/-/commit/092d558d5f008b1e6a2d8a77436fa7c8218b7597[caissedepargne] CloudCard not supported for transfer2020-01-08T12:48:50+01:00Célande Adriencelande.adrien@budget-insight.com
The CloudCard uses biometric recognition to authenticate the user.
So it is not Supported.
Otherwise, if an exception is not raised,
it generates a 400 error with the code 102 and the message
'Unauthorized to execute fallback'https://gitlab.com/woob/woob/-/commit/e5d1c90a24628e59360c9e484dd2da9780e3c76a[bp] Changed ProAccountsList page is_here and handle new errors2020-01-08T12:48:50+01:00Guillaume Risbourgguillaume.risbourg@budget-insight.com
The is_here on ProAccountsList caused the errors to not be catched.
New ActionNeeded error catched in ProAccountsList.
New BrowserUnavailable error catched in the RedirectPage.https://gitlab.com/woob/woob/-/commit/71c8205aa705db65fc74474fc335d71f93fcf0b7[cragr] Stricter matching patterns for rdates2020-01-08T12:48:50+01:00Lucas Ficheuxlucas.ficheux@budget-insight.com
Somme patterns for matching rdates from transactions labels
weren't strict enough, for exemple :
^(?P<category>PRELEVEMENT) (?P<text>.*) (?P<dd>\d{2})\s(?P<mm>\d{2})\s(?P<yy>\d{4}) .*
matched PRELEVEMENT TEXT TEXT (YYYY MM DD YYYY MM DD)
^(?P<category>PRELEVEMENT) (?P<text>.*) (?P<dd>\d{2})-(?P<mm>\d{2})$
matched PRELEVEMENT TEXT TEXT MM-YY
Both were made stricter as to avoid these unwanted matches that would
crash the date parser.https://gitlab.com/woob/woob/-/commit/a00217163cc3138535b6db9be124beb551d60f94[axabanque] Add default value to get_pid Attr()2020-01-08T12:48:50+01:00Quentin Defenouillerequentin.defenouillere@budget-insight.com
Otherwise iter_history crashes for accounts that have no pid.https://gitlab.com/woob/woob/-/commit/6c3ba9591e8c3b4ebd98a0b772aa234258303bff[societegenerale] factorize code to prepare coming 2FA2020-01-08T12:48:50+01:00Edouard Lambertelambert@budget-insight.comhttps://gitlab.com/woob/woob/-/commit/8e09ef98bed4b21f45e130a7b3e13c315cb807b4[s2e] Implemented additional attributes for Etoile Gestion2020-01-08T12:48:50+01:00Quentin Defenouillerequentin.defenouillere@budget-insight.com
The investment details page contains the performance history of the
investment. Handling these pages correctly also avoids logouts and
BrowserHTTPSDowngrade errors.https://gitlab.com/woob/woob/-/commit/dbe10b8ae0cf9852d07b1b765d534388420643faweboob.exceptions: add str method to BrowserQuestion exception2020-01-08T12:48:50+01:00Leo Yvinleo.yvin@budget-insight.comhttps://gitlab.com/woob/woob/-/commit/d7322e854f1e77f708823cfb0aa0c2765d2774fa[trainline] a bill can have a duplicate id when it has several refunds2020-01-08T12:48:50+01:00Florian Duguetflorian.duguet@budget-insight.comhttps://gitlab.com/woob/woob/-/commit/9492bd93bcc51e8bce4646d34648c671020f2d3c[degiro] Fix for empty history (missing json keys)2020-01-08T12:48:50+01:00Guillaume Risbourgguillaume.risbourg@budget-insight.comhttps://gitlab.com/woob/woob/-/commit/372721a3595d5dfc0122ca63235593167350dfc7[degiro] Repaired iter_history and used float_to_decimal()2020-01-08T12:48:50+01:00Quentin Defenouillerequentin.defenouillere@budget-insight.com
The history_history parsing was completely broken. Now, all transaction
have an 'id' key = 0 so we cannot retrieve proper transaction IDs
anymore. The code to get the amount was wrong since there was a (self)
missing for Field('raw'), we were evulating a Regexp() on the Field
class itself.
We do not scrape transaction.amount if it is in a different currency
than the account; in these cases we only scrape the original_amoutn and
the original_currency.https://gitlab.com/woob/woob/-/commit/f8e8f9cc81c65331f52213fee28105e4adf7cd5e[degiro] Fixed obj_code_type for investments2020-01-08T12:48:50+01:00Damien Matdamien.mat@budget-insight.com
Field('code') was never evaluated, my bad!https://gitlab.com/woob/woob/-/commit/6584691ac97b8ba208715d7b8c5df1a9ad583a42[degiro] Fixed amount and currency handling for transactions2020-01-08T12:48:50+01:00Damien Matdamien.mat@budget-insight.com
The module didn't respect the data model for transations concerning
orgininal_currency and original_amount.
The acounts are in Euros but the website doesn't provide conversion so
foreign amount and currencies had to be handled.https://gitlab.com/woob/woob/-/commit/74d601988dbde63623782bf1966409d35c53938e[degiro] added vdate for investments2020-01-08T12:48:50+01:00Damien Matdamien.mat@budget-insight.com
A few code tweaks toohttps://gitlab.com/woob/woob/-/commit/da35919c7ed4d5ce63860ce8a016e0096ef2f18f[degiro] added unitprice for invests2020-01-08T12:48:50+01:00Damien Matdamien.mat@budget-insight.comhttps://gitlab.com/woob/woob/-/commit/79f900ffc245c0dcbcb4ad99e5a5d9146f662139[degiro] Fix duplicated transaction id2020-01-08T12:48:50+01:00Jerome Berthierjerome.berthier@budget-insight.comhttps://gitlab.com/woob/woob/-/commit/649f20efceda9a708a084fffcfb0971c36aa397e[degiro] Corrected investment valuations and account balance2020-01-08T12:48:50+01:00Quentin Defenouillerequentin.defenouillere@budget-insight.com
The account balance is not available in the JSON, so we need to sum the
investment valuations to get the correct value.
However, it seems that investments in JPY are multiplied by 100, so we
must divide this value accordingly otherwise the invest AND the account
abalnce will be wrong.https://gitlab.com/woob/woob/-/commit/72419746c71c7330ee644f281138001347b82f20[degiro] Fix Wrong transactions dates (part2)2020-01-08T12:48:50+01:00Martin Sicotmartin.sicot@budget-insight.com
Transactions date are displayed in the JSON in yyyy-mm-dd format but
where retrieved using day_first=True. Transactions are currently lacking
an id. When they get one, we can merge this MR and the transactions in
the backend will be corrected.https://gitlab.com/woob/woob/-/commit/e4938af9b62d93a499782b6d911d69203753cd9e[degiro] Inserted new key 'data' when getting information2020-01-08T12:48:50+01:00Quentin Defenouillerequentin.defenouillere@budget-insight.com
The JSON after login slightly changed, now we need to use the path
'data/intAccount' instead of 'intAccount'.https://gitlab.com/woob/woob/-/commit/932c2216abc025cf2628b52759eb7da39a7edc29[degiro] Add id for transactions part 12020-01-08T12:48:50+01:00Martin Sicotmartin.sicot@budget-insight.com
Transactions were lacking an id.
Patch related to !2547 in order to correct wrong dates in ther backend.
We first add an id to map the backend, and then when this patch is live
we patch with the !2547.
Needs backend!1286 first.https://gitlab.com/woob/woob/-/commit/19400826e9fdbd34c68ff1e72ac335cff033bbb4[degiro] add new foreign languages2020-01-08T12:48:50+01:00Maxime Gasselinmaxime.gasselin@budget-insight.comhttps://gitlab.com/woob/woob/-/commit/cfd32a7b12adb0e3b29583500630fb332b8d4aa1[degiro] Fix: balance, original_val, liquidity2020-01-08T12:48:50+01:00Martin Sicotmartin.sicot@budget-insight.com
Balance : The account balance and the total amount of the investments in
that same account was not the same because of the wrong dictionnary key.
original_valuation : added parse function to handle correclty
investments in foreign currency
liquidity : replaced the investments that are cash in the iter_investments list by
liquidities.https://gitlab.com/woob/woob/-/commit/133fc067191e9ee2652eadcf6b34bc972529c3f8[degiro] revert regression introduced for liquidities2020-01-08T12:48:50+01:00Martin Sicotmartin.sicot@budget-insight.com
Liquidites are actually inside the investment list. We were duplicating
the liquiditites.https://gitlab.com/woob/woob/-/commit/607d98c38ddd040cd7db24a0da4b2e453ae9eb57[degiro] Liquidities added2020-01-08T12:48:50+01:00Martin Sicotmartin.sicot@budget-insight.com
Liquidities were not brought up by the module because there is not a
place where it is recorded. We had to deduce it from the most recent
balance of the account, found in the transaction history page.