PERF: Some faster date/time string formatting by smarie · Pull Request #46759 · pandas-dev/pandas (original) (raw)

SQL mini-bench:

import sqlite3 con = sqlite3.connect(':memory:') dt = pd.date_range('2014-01-01', periods=1000, freq='10h') df = pd.DataFrame({'time': dt.time})

from timeit import Timer to_assess = lambda: df.to_sql('test_datetime', con, index=False, if_exists='replace') glob = globals() glob.update(locals()) res = Timer("to_assess()", globals=glob).repeat(5, 300) print(res)

before: [2.667514099999991, 2.711463600000002, 2.7073388000000023, 2.6616616999999962, 2.7392122000000114]
after: [0.9359815999999981, 0.9132108000000017, 0.9482149999999976, 0.9659205999999969, 0.9622573000000045]
65% improvement