Workload settings-add-embeddings-hf

Comparing 95fcd1737... on main to 59ecf1cea...

Diff

Total time

Commit Total time Difference Proportion Time outside spans
This commit 2min (±971μs) 1324ms 0.8956671312125356% 952ms (±971μs)
Baseline 2min (±584μs) 0 ±0% 5161μs (±584μs)

Improvements

indexing::scheduler::apply_index_operation

Commit Self time Difference Proportion Total time Calls
This commit 574ms (±22ms) -9121μs 1.565433438670989% 2min (±22ms) 3 (±0)
Baseline 583ms (±12ms) 0 ±0% 2min (±12ms) 1 (±0)

indexing::extract::extract_vector_points

Commit Self time Difference Proportion Total time Calls
This commit 2240μs (±158μs) -568μs 20.23925508615759% 2240μs (±158μs) 1 (±0)
Baseline 2808μs (±816μs) 0 ±0% 2808μs (±816μs) 1 (±0)

indexing::write_db::write_typed_chunk_into_index

Commit Self time Difference Proportion Total time Calls
This commit 171μs (±48μs) -34μs 16.76960921481242% 21ms (±48μs) 27 (±0)
Baseline 205μs (±26μs) 0 ±0% 5486μs (±26μs) 14 (±0)

indexing::write_db::field_id_facet_exists_docids

Commit Self time Difference Proportion Total time Calls
This commit 5110ns (±349ns) -1020ns 16.636758132402367% 145μs (±349ns) 2 (±0)
Baseline 6130ns (±5412ns) 0 ±0% 119μs (±5412ns) 1 (±0)

Regressions

indexing::details::index_documents_raw

Commit Self time Difference Proportion Total time Calls
This commit 2min (±229ms) 343ms 0.233363386412156% 2min (±229ms) 2 (±0)
Baseline 2min (±321ms) 0 ±0% 2min (±321ms) 1 (±0)

indexing::extract::extract_embeddings

Commit Self time Difference Proportion Total time Calls
This commit 2min (±230ms) 319ms 0.21654646563706534% 2min (±230ms) 1 (±0)
Baseline 2min (±322ms) 0 ±0% 2min (±322ms) 1 (±0)

indexing::extract::data_from_obkv_documents

Commit Self time Difference Proportion Total time Calls
This commit 18ms (±3934μs) 11ms 157.10908918162343% 23ms (±3934μs) 2 (±0)
Baseline 7107μs (±928μs) 0 ±0% 7107μs (±928μs) 1 (±0)

indexing::scheduler::process_batch

Commit Self time Difference Proportion Total time Calls
This commit 9770μs (±695μs) 9743μs 35915.79187955734% 2min (±695μs) 3 (±0)
Baseline 27μs (±7776ns) 0 ±0% 2min (±7776ns) 1 (±0)

indexing::extract::extract_docid_word_positions

Commit Self time Difference Proportion Total time Calls
This commit 8787μs (±726μs) 7754μs 750.4782585214994% 9766μs (±726μs) 2 (±0)
Baseline 1033μs (±569μs) 0 ±0% 1324μs (±569μs) 1 (±0)

indexing::details::sorter_into_reader

Commit Self time Difference Proportion Total time Calls
This commit 6770μs (±776μs) 6523μs 2636.2781764965966% 6770μs (±776μs) 2 (±0)
Baseline 247μs (±19μs) 0 ±0% 247μs (±19μs) 1 (±0)

indexing::grenad::sorter_into_reader

Commit Self time Difference Proportion Total time Calls
This commit 8507μs (±694μs) 6019μs 241.94837235699939% 8507μs (±694μs) 22 (±0)
Baseline 2488μs (±118μs) 0 ±0% 2488μs (±118μs) 12 (±0)

indexing::extract::extract_word_pair_proximity_docids

Commit Self time Difference Proportion Total time Calls
This commit 5703μs (±706μs) 4782μs 519.4148569889367% 15ms (±706μs) 2 (±0)
Baseline 921μs (±430μs) 0 ±0% 1283μs (±430μs) 1 (±0)

indexing::extract::extract_word_docids

Commit Self time Difference Proportion Total time Calls
This commit 5534μs (±473μs) 4629μs 511.37320919548665% 8092μs (±473μs) 2 (±0)
Baseline 905μs (±373μs) 0 ±0% 1142μs (±373μs) 1 (±0)

indexing::extract::extract_facet_string_docids

Commit Self time Difference Proportion Total time Calls
This commit 4080μs (±409μs) 3916μs 2388.7781683567578% 4638μs (±409μs) 2 (±0)
Baseline 164μs (±229μs) 0 ±0% 350μs (±229μs) 1 (±0)

indexing::extract::extract_word_position_docids

Commit Self time Difference Proportion Total time Calls
This commit 2683μs (±257μs) 2516μs 1500.2797034308696% 6203μs (±257μs) 2 (±0)
Baseline 168μs (±168μs) 0 ±0% 398μs (±168μs) 1 (±0)

indexing::extract::extract_fid_docid_facet_values

Commit Self time Difference Proportion Total time Calls
This commit 3667μs (±913μs) 1974μs 116.56211223186494% 4557μs (±913μs) 2 (±0)
Baseline 1693μs (±709μs) 0 ±0% 1879μs (±709μs) 1 (±0)

indexing::grenad::write_sorter_into_database

Commit Self time Difference Proportion Total time Calls
This commit 1402μs (±92μs) 1019μs 266.34518018594946% 1402μs (±92μs) 8 (±0)
Baseline 383μs (±43μs) 0 ±0% 383μs (±43μs) 4 (±0)

indexing::extract::extract_fid_word_count_docids

Commit Self time Difference Proportion Total time Calls
This commit 1080μs (±317μs) 997μs 1207.2597263285847% 1495μs (±317μs) 2 (±0)
Baseline 83μs (±16μs) 0 ±0% 220μs (±16μs) 1 (±0)

indexing::prefix::words_prefix_fst

Commit Self time Difference Proportion Total time Calls
This commit 6583μs (±1116μs) 459μs 7.495160706856681% 6583μs (±1116μs) 2 (±0)
Baseline 6124μs (±462μs) 0 ±0% 6124μs (±462μs) 1 (±0)

indexing::prefix::words_prefix_integer_docids

Commit Self time Difference Proportion Total time Calls
This commit 562μs (±60μs) 394μs 234.46138130315256% 1466μs (±60μs) 4 (±0)
Baseline 168μs (±9571ns) 0 ±0% 328μs (±9571ns) 2 (±0)

indexing::extract::extract_facet_number_docids

Commit Self time Difference Proportion Total time Calls
This commit 524μs (±264μs) 385μs 277.50006839935423% 776μs (±264μs) 2 (±0)
Baseline 139μs (±177μs) 0 ±0% 254μs (±177μs) 1 (±0)

indexing::scheduler::create_next_batch

Commit Self time Difference Proportion Total time Calls
This commit 318μs (±110μs) 214μs 205.48898642810823% 318μs (±110μs) 6 (±0)
Baseline 104μs (±23μs) 0 ±0% 104μs (±23μs) 2 (±0)

indexing::documents::reindex

Commit Self time Difference Proportion Total time Calls
This commit 3238μs (±202μs) 194μs 6.358517553506868% 2min (±202μs) 2 (±0)
Baseline 3045μs (±496μs) 0 ±0% 2min (±496μs) 1 (±0)

indexing::write_db::documents

Commit Self time Difference Proportion Total time Calls
This commit 433μs (±24μs) 188μs 76.99609563048988% 433μs (±24μs) 2 (±0)
Baseline 245μs (±52μs) 0 ±0% 245μs (±52μs) 1 (±0)

indexing::prefix::word_prefix_docids

Commit Self time Difference Proportion Total time Calls
This commit 739μs (±145μs) 186μs 33.533713462681455% 1270μs (±145μs) 4 (±0)
Baseline 553μs (±101μs) 0 ±0% 792μs (±101μs) 2 (±0)

indexing::prefix::index_documents_prefix_databases

Commit Self time Difference Proportion Total time Calls
This commit 231μs (±9755ns) 178μs 340.98773740378624% 9688μs (±9755ns) 2 (±0)
Baseline 52μs (±8060ns) 0 ±0% 7323μs (±8060ns) 1 (±0)

indexing::write_db::field_id_docid_facet_strings

Commit Self time Difference Proportion Total time Calls
This commit 240μs (±4921ns) 158μs 190.43714195203702% 240μs (±4921ns) 2 (±0)
Baseline 83μs (±1328ns) 0 ±0% 83μs (±1328ns) 1 (±0)

indexing::write_db::vector_points

Commit Self time Difference Proportion Total time Calls
This commit 1156μs (±201μs) 150μs 14.866343682449381% 1156μs (±201μs) 1 (±0)
Baseline 1006μs (±90μs) 0 ±0% 1006μs (±90μs) 1 (±0)

indexing::write_db::field_id_docid_facet_numbers

Commit Self time Difference Proportion Total time Calls
This commit 166μs (±3371ns) 86μs 108.08677267211289% 166μs (±3371ns) 2 (±0)
Baseline 80μs (±2673ns) 0 ±0% 80μs (±2673ns) 1 (±0)

indexing::transform::flatten_from_fields_ids_map

Commit Self time Difference Proportion Total time Calls
This commit 158μs (±8276ns) 58μs 58.59663462893542% 158μs (±8276ns) 297 (±0)
Baseline 99μs (±24μs) 0 ±0% 99μs (±24μs) 198 (±0)

indexing::write_db::word_docids

Commit Self time Difference Proportion Total time Calls
This commit 111μs (±7911ns) 38μs 52.402102648687496% 6940μs (±7911ns) 2 (±0)
Baseline 73μs (±12μs) 0 ±0% 3176μs (±12μs) 1 (±0)

indexing::write_db::field_id_facet_number_docids

Commit Self time Difference Proportion Total time Calls
This commit 81μs (±8730ns) 26μs 47.70131249636227% 1092μs (±8730ns) 2 (±0)
Baseline 55μs (±5865ns) 0 ±0% 55μs (±5865ns) 1 (±0)

indexing::extract::details::extract_multiple_chunks

Commit Self time Difference Proportion Total time Calls
This commit 41μs (±7527ns) 22μs 118.50257260705021% 36ms (±7527ns) 12 (±0)
Baseline 19μs (±1692ns) 0 ±0% 3692μs (±1692ns) 6 (±0)

indexing::details::compute_prefix_diffs

Commit Self time Difference Proportion Total time Calls
This commit 31μs (±9498ns) 12μs 64.68034644135273% 31μs (±9498ns) 2 (±0)
Baseline 19μs (±3940ns) 0 ±0% 19μs (±3940ns) 1 (±0)

indexing::write_db::field_id_facet_is_null_docids

Commit Self time Difference Proportion Total time Calls
This commit 13μs (±7685ns) 8899ns 225.76487898929423% 144μs (±7685ns) 2 (±0)
Baseline 3942ns (±360ns) 0 ±0% 107μs (±360ns) 1 (±0)

indexing::write_db::field_id_facet_string_docids

Commit Self time Difference Proportion Total time Calls
This commit 81μs (±5896ns) 7449ns 10.16781647478929% 1133μs (±5896ns) 2 (±0)
Baseline 73μs (±8622ns) 0 ±0% 73μs (±8622ns) 1 (±0)

indexing::details::extract_and_send_grenad_chunks

Commit Self time Difference Proportion Total time Calls
This commit 15μs (±11μs) 7327ns 101.07601048420472% 23ms (±11μs) 2 (±0)
Baseline 7249ns (±4424ns) 0 ±0% 7125μs (±4424ns) 1 (±0)

indexing::write_db::word_pair_proximity_docids

Commit Self time Difference Proportion Total time Calls
This commit 9530ns (±10μs) 5958ns 166.8066521081807% 7243μs (±10μs) 2 (±0)
Baseline 3572ns (±377ns) 0 ±0% 73μs (±377ns) 1 (±0)

indexing::write_db::field_id_word_count_docids

Commit Self time Difference Proportion Total time Calls
This commit 8007ns (±5157ns) 4698ns 141.9532241493926% 121μs (±5157ns) 2 (±0)
Baseline 3309ns (±266ns) 0 ±0% 75μs (±266ns) 1 (±0)

indexing::write_db::word_position_docids

Commit Self time Difference Proportion Total time Calls
This commit 7820ns (±5386ns) 4077ns 108.95729784618675% 2178μs (±5386ns) 2 (±0)
Baseline 3742ns (±237ns) 0 ±0% 36μs (±237ns) 1 (±0)

indexing::write_db::field_id_facet_is_empty_docids

Commit Self time Difference Proportion Total time Calls
This commit 7590ns (±5159ns) 3958ns 108.95826450831404% 129μs (±5159ns) 2 (±0)
Baseline 3632ns (±287ns) 0 ±0% 103μs (±287ns) 1 (±0)

indexing::prefix::index_documents_word_prefix_docids

Commit Self time Difference Proportion Total time Calls
This commit 5999ns (±844ns) 2254ns 60.17836163622772% 1337μs (±844ns) 4 (±0)
Baseline 3745ns (±813ns) 0 ±0% 797μs (±813ns) 2 (±0)

indexing::write_db::script_language_docids

Commit Self time Difference Proportion Total time Calls
This commit 2936ns (±366ns) 1172ns 66.47012132894885% 2936ns (±366ns) 2 (±0)
Baseline 1764ns (±137ns) 0 ±0% 1764ns (±137ns) 1 (±0)

Stable

Unstable

indexing::write_db::write_entries_into_database

Commit Self time Difference Proportion Total time Calls
This commit 13ms (±209μs) 11ms 537.08573320159% 13ms (±209μs) 18 (±0)
Baseline 1997μs (±3384μs) 0 ±0% 1997μs (±3384μs) 9 (±0)

New

indexing::details::document_into_sorter

Commit Self time Total time Calls
This commit 2231μs (±213μs) 2231μs (±213μs) 98 (±0)

indexing::details::final_document_into_sorter

Commit Self time Total time Calls
This commit 7097ns (±1290ns) 7097ns (±1290ns) 1 (±0)

indexing::documents::add_documents

Commit Self time Total time Calls
This commit 9107ns (±2243ns) 1656μs (±2243ns) 1 (±0)

indexing::documents::enrich_documents_batch

Commit Self time Total time Calls
This commit 361μs (±65μs) 470μs (±65μs) 1 (±0)

indexing::documents::fetch_or_generate_document_id

Commit Self time Total time Calls
This commit 71μs (±18μs) 71μs (±18μs) 99 (±0)

indexing::documents::from_reader

Commit Self time Total time Calls
This commit 44μs (±988ns) 44μs (±988ns) 1 (±0)

indexing::documents::index_documents

Commit Self time Total time Calls
This commit 14μs (±465ns) 45ms (±465ns) 1 (±0)

indexing::documents::read_documents

Commit Self time Total time Calls
This commit 1069μs (±9241ns) 1173μs (±9241ns) 1 (±0)

indexing::extract::words_into_sorter

Commit Self time Total time Calls
This commit 926μs (±320μs) 926μs (±320μs) 198 (±0)

indexing::extract::words_position_into_sorter

Commit Self time Total time Calls
This commit 911μs (±116μs) 911μs (±116μs) 99 (±0)

indexing::facets::bulk::execute

Commit Self time Total time Calls
This commit 1901μs (±42μs) 1901μs (±42μs) 2 (±0)

indexing::transform::output_from_sorter

Commit Self time Total time Calls
This commit 1188μs (±15μs) 1188μs (±15μs) 1 (±0)

Lost