Kouskousi/gte-large-en-v1.5_SEC_docs_ft_with_5_epochs

SentenceTransformer based on Alibaba-NLP/gte-large-en-v1.5

This is a sentence-transformers model finetuned from Alibaba-NLP/gte-large-en-v1.5. It maps sentences & paragraphs to a 1024-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: Alibaba-NLP/gte-large-en-v1.5
• Maximum Sequence Length: 8192 tokens
• Output Dimensionality: 1024 tokens
• Similarity Function: Cosine Similarity

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 8192, 'do_lower_case': False}) with Transformer model: NewModel 
  (1): Pooling({'word_embedding_dimension': 1024, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    "What critical accounting estimate is highlighted regarding the valuation of investments in Ameriprise Financial, Inc.'s financial statements?",
    'Index\nAmeriprise Financial, Inc.\nThe following table reconciles net income to adjusted operating earnings and the five-point average of quarter-end equity to adjusted operating equity:\n \nYears Ended December 31,\n2023\n2022\n(in millions)\nNet income\n$\n2,556 \n$\n3,149 \nLess: Adjustments \n(555)\n264 \nAdjusted operating earnings\n$\n3,111 \n$\n2,885 \nTotal Ameriprise Financial, Inc. shareholders’ equity\n$\n4,116 \n$\n4,170 \nLess: AOCI, net of tax\n(2,297)\n(1,769)\nTotal Ameriprise Financial, Inc. shareholders’ equity, excluding AOCI\n6,413 \n5,939 \nLess: Equity impacts attributable to CIEs\n(4)\n— \nAdjusted operating equity\n$\n6,417 \n$\n5,939 \nReturn on equity, excluding AOCI\n39.9 \n%\n53.0 \n%\nAdjusted operating return on equity, excluding AOCI\n48.5 \n%\n48.6 \n%\nAdjustments reflect the sum of after-tax net realized investment gains/losses, net of the reinsurance accrual; the market impact on non-traditional long-duration products (including\nvariable and fixed deferred annuity contracts and UL insurance contracts), net of hedges and the reinsurance accrual; mean reversion related impacts; block transfer reinsurance\ntransaction impacts; the market impact of hedges to offset interest rate and currency changes on unrealized gains or losses for certain investments; gain or loss on disposal of a\nbusiness that is not considered discontinued operations; integration and restructuring charges; income (loss) from discontinued operations; and net income (loss) from consolidated\ninvestment entities. After-tax is calculated using the statutory tax rate of 21%.\nAdjusted operating return on equity, excluding AOCI is calculated using adjusted operating earnings in the numerator and Ameriprise Financial shareholders’ equity, excluding AOCI\nand the impact of consolidating investment entities using a five-point average of quarter-end equity in the denominator. After-tax is calculated using the statutory rate of 21%.\nThe following table reconciles GAAP total equity to Available Capital for Capital Adequacy:\nDecember 31, 2023\nDecember 31, 2022\n(in millions)\nAmeriprise Financial, Inc. GAAP total equity\n$\n4,729 \n$\n3,803 \nLess: AOCI\n(1,766)\n(2,546)\nAmeriprise Financial, Inc. GAAP total equity, excluding AOCI\n6,495 \n6,349 \nLess: RiverSource Life Insurance Company GAAP equity, excluding AOCI\n1,851 \n2,057 \nAdd: RiverSource Life Insurance Company statutory total adjusted capital\n3,093 \n3,103 \nLess: Goodwill and intangibles\n2,622 \n2,485 \nAdd: Other adjustments\n303 \n299 \n   Available Capital for Capital Adequacy\n$\n5,418 \n$\n5,209 \nCritical Accounting Estimates\nThe accounting and reporting policies that we use affect our Consolidated Financial Statements. Certain of our accounting and reporting policies are critical to an\nunderstanding of our consolidated results of operations and financial condition and, in some cases, the application of these policies can be significantly affected by\nthe estimates, judgments and assumptions made by management during the preparation of our Consolidated Financial Statements. The accounting and reporting\npolicies and estimates we have identified as fundamental to a full understanding of our consolidated results of operations and financial condition are described\nbelow. See Note 2 to our Consolidated Financial Statements for further information about our accounting policies.\nValuation of Investments\nThe most significant component of our investments is our Available-for-Sale securities, which we carry at fair value within our Consolidated Balance Sheets. See\nNote 16 to our Consolidated Financial Statements for discussion of the fair value of our Available-for-Sale securities. Financial markets are subject to significant\nmovements in valuation and liquidity, which can impact our ability to liquidate and the selling price that can be realized for our securities and increases the use of\njudgment in determining the estimated fair value of certain investments. We are unable to predict impacts and determine sensitivities in reported amounts reflecting\nsuch market movements on our aggregate Available-for-Sale portfolio. Changes to these assumptions do not occur in isolation and it is impracticable to predict such\nimpacts at the individual security unit of measure which are predominately Level 2 fair value and based on observable inputs.\n(1)\n (2)\n(1) \n(2) \n34',
    'Additionally, users can sign up to receive automatic\nnotifications when new materials are posted. The information found on the website is not incorporated by reference into this report or in any other report or\ndocument we furnish or file with the SEC.\nItem 1A. \nRisk Factors\nOur operations and financial results are subject to various risks and uncertainties, including those described below, that could have a material adverse effect on our\nbusiness, financial condition or results of operations and could cause the trading price of our common stock to decline. We believe that the following information\nidentifies the material factors affecting our company based on the information we currently know. However, the risks and uncertainties our company faces are not\nlimited to those described below. Additional risks and uncertainties not presently known to us or that we currently believe to be immaterial may also adversely affect\nour business.\nMarket Risks\nOur results of operations and financial condition may be adversely affected by market fluctuations and by economic, political and other factors.\nOur results of operations and financial condition may be materially affected by market fluctuations and by economic and other factors. Such factors, which can be\nglobal, regional, national or local in nature, include: (i) the level and volatility of the markets, including equity prices, interest rates, commodity prices, currency values\nand other market indices and drivers; \n(ii) geopolitical strain, terrorism and armed conflicts, (iii) political dynamics or elections and social, economic and market\nconditions; (iv) the availability and cost of capital; (v) global health emergencies (such as the coronavirus disease 2019 (“COVID-19”) pandemic); (vi) technological\nchanges and\n16',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 1024]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Evaluation

Metrics

Information Retrieval

• Evaluated with InformationRetrievalEvaluator

Metric	Value
cosine_accuracy@1	0.6062
cosine_accuracy@3	0.8508
cosine_accuracy@5	0.9226
cosine_accuracy@10	0.9712
cosine_precision@1	0.6062
cosine_precision@3	0.2836
cosine_precision@5	0.1845
cosine_precision@10	0.0971
cosine_recall@1	0.6062
cosine_recall@3	0.8508
cosine_recall@5	0.9226
cosine_recall@10	0.9712
cosine_ndcg@10	0.7958
cosine_mrr@10	0.7386
cosine_map@100	0.7403
dot_accuracy@1	0.6062
dot_accuracy@3	0.8503
dot_accuracy@5	0.9226
dot_accuracy@10	0.9712
dot_precision@1	0.6062
dot_precision@3	0.2834
dot_precision@5	0.1845
dot_precision@10	0.0971
dot_recall@1	0.6062
dot_recall@3	0.8503
dot_recall@5	0.9226
dot_recall@10	0.9712
dot_ndcg@10	0.7953
dot_mrr@10	0.7379
dot_map@100	0.7396

Training Details

Training Dataset

Unnamed Dataset

• Size: 9,400 training samples
• Columns: sentence_0 and sentence_1
• Approximate statistics based on the first 1000 samples:

  	sentence_0	sentence_1
  type	string	string
  details	min: 12 tokens mean: 22.99 tokens max: 44 tokens	min: 107 tokens mean: 671.18 tokens max: 977 tokens

• Samples:

  sentence_0	sentence_1
  What is the fiscal year end date for Ameriprise Financial, Inc. as stated in the document?	UNITED STATES SECURITIES AND EXCHANGE COMMISSION WASHINGTON, D.C. 20549 FORM 10-K ANNUAL REPORT PURSUANT TO SECTION 13 OR 15(d) OF THE SECURITIES EXCHANGE ACT OF 1934 For the Fiscal Year Ended December 31 , 2023 OR TRANSITION REPORT PURSUANT TO SECTION 13 OR 15(d) OF THE SECURITIES EXCHANGE ACT OF 1934 For the Transition Period from_______________________to_______________________ Commission File No. 1-32525 AMERIPRISE FINANCIAL, INC. (Exact name of registrant as specified in its charter) Delaware 13-3180631 (State or other jurisdiction of incorporation or organization) (I.R.S. Employer Identification No.) 1099 Ameriprise Financial Center Minneapolis Minnesota 55474 (Address of principal executive offices) (Zip Code) Registrant’s telephone number, including area code: (612) 671-3131 Securities registered pursuant to Section 12(b) of the Act: Title of each class Trading Symbol Name of each exchange on which registered Common Stock (par value $.01 per share) AMP New York Stock Exchange Securities registered pursuant to Section 12(g) of the Act: None Indicate by check mark if the registrant is a well-known seasoned issuer, as defined in Rule 405 of the Securities Act. Yes No Indicate by check mark if the registrant is not required to file reports pursuant to Section 13 or Section 15(d) of the Exchange Act. Yes No Indicate by check mark whether the registrant (1) has filed all reports required to be filed by Section 13 or 15(d) of the Securities Exchange Act of 1934 during the preceding 12 months (or for such shorter period that the registrant was required to file such reports), and (2) has been subject to such filing requirements for the past 90 days. Yes No Indicate by check mark whether the registrant has submitted electronically every Interactive Data File required to be submitted pursuant to Rule 405 of Regulation S-T (§232.405 of this chapter) during the preceding 12 months (or for such shorter period that the registrant was required to submit such files). Yes No Indicate by check mark whether the registrant is a large accelerated filer, an accelerated filer, a non-accelerated filer, smaller reporting company, or an emerging growth company. See the definitions of “large accelerated filer,” “accelerated filer,” “smaller reporting company,” and “emerging growth company” in Rule 12b-2 of the Exchange Act. Large Accelerated Filer Accelerated Filer Non-accelerated Filer Smaller reporting company Emerging growth company If an emerging growth company, indicate by check mark if the registrant has elected not to use the extended transition period for complying with any new or revised financial accounting standards provided pursuant to Section 13(a) of the Exchange Act. Indicate by check mark whether the registrant has filed a report on and attestation to its management’s assessment of the effectiveness of its internal control over financial reporting under Section 404(b) of the Sarbanes-Oxley Act by the registered public accounting firm that prepared or issued its audit report. If securities are registered pursuant to Section 12(b) of the Act, indicate by check mark whether the financial statements of the registrant included in the filing reflect the correction of an error to previously issued financial statements. Indicate by check mark whether any of those error corrections are restatements that required a recovery analysis of incentive-based compensation received by any of the registrant’s executive officers during the relevant recovery period pursuant to §240.10D-1(b). Indicate by check mark whether the registrant is a shell company (as defined in Rule 12b-2 of the Exchange Act). Yes No The aggregate market value, as of June 30, 2023, of voting shares held by non-affiliates of the registrant was approximately $ 34.1 billion.
  What is the Commission File Number for Ameriprise Financial, Inc.?	UNITED STATES SECURITIES AND EXCHANGE COMMISSION WASHINGTON, D.C. 20549 FORM 10-K ANNUAL REPORT PURSUANT TO SECTION 13 OR 15(d) OF THE SECURITIES EXCHANGE ACT OF 1934 For the Fiscal Year Ended December 31 , 2023 OR TRANSITION REPORT PURSUANT TO SECTION 13 OR 15(d) OF THE SECURITIES EXCHANGE ACT OF 1934 For the Transition Period from_______________________to_______________________ Commission File No. 1-32525 AMERIPRISE FINANCIAL, INC. (Exact name of registrant as specified in its charter) Delaware 13-3180631 (State or other jurisdiction of incorporation or organization) (I.R.S. Employer Identification No.) 1099 Ameriprise Financial Center Minneapolis Minnesota 55474 (Address of principal executive offices) (Zip Code) Registrant’s telephone number, including area code: (612) 671-3131 Securities registered pursuant to Section 12(b) of the Act: Title of each class Trading Symbol Name of each exchange on which registered Common Stock (par value $.01 per share) AMP New York Stock Exchange Securities registered pursuant to Section 12(g) of the Act: None Indicate by check mark if the registrant is a well-known seasoned issuer, as defined in Rule 405 of the Securities Act. Yes No Indicate by check mark if the registrant is not required to file reports pursuant to Section 13 or Section 15(d) of the Exchange Act. Yes No Indicate by check mark whether the registrant (1) has filed all reports required to be filed by Section 13 or 15(d) of the Securities Exchange Act of 1934 during the preceding 12 months (or for such shorter period that the registrant was required to file such reports), and (2) has been subject to such filing requirements for the past 90 days. Yes No Indicate by check mark whether the registrant has submitted electronically every Interactive Data File required to be submitted pursuant to Rule 405 of Regulation S-T (§232.405 of this chapter) during the preceding 12 months (or for such shorter period that the registrant was required to submit such files). Yes No Indicate by check mark whether the registrant is a large accelerated filer, an accelerated filer, a non-accelerated filer, smaller reporting company, or an emerging growth company. See the definitions of “large accelerated filer,” “accelerated filer,” “smaller reporting company,” and “emerging growth company” in Rule 12b-2 of the Exchange Act. Large Accelerated Filer Accelerated Filer Non-accelerated Filer Smaller reporting company Emerging growth company If an emerging growth company, indicate by check mark if the registrant has elected not to use the extended transition period for complying with any new or revised financial accounting standards provided pursuant to Section 13(a) of the Exchange Act. Indicate by check mark whether the registrant has filed a report on and attestation to its management’s assessment of the effectiveness of its internal control over financial reporting under Section 404(b) of the Sarbanes-Oxley Act by the registered public accounting firm that prepared or issued its audit report. If securities are registered pursuant to Section 12(b) of the Act, indicate by check mark whether the financial statements of the registrant included in the filing reflect the correction of an error to previously issued financial statements. Indicate by check mark whether any of those error corrections are restatements that required a recovery analysis of incentive-based compensation received by any of the registrant’s executive officers during the relevant recovery period pursuant to §240.10D-1(b). Indicate by check mark whether the registrant is a shell company (as defined in Rule 12b-2 of the Exchange Act). Yes No The aggregate market value, as of June 30, 2023, of voting shares held by non-affiliates of the registrant was approximately $ 34.1 billion.
  What is the trading symbol for Ameriprise Financial, Inc. on the New York Stock Exchange?	UNITED STATES SECURITIES AND EXCHANGE COMMISSION WASHINGTON, D.C. 20549 FORM 10-K ANNUAL REPORT PURSUANT TO SECTION 13 OR 15(d) OF THE SECURITIES EXCHANGE ACT OF 1934 For the Fiscal Year Ended December 31 , 2023 OR TRANSITION REPORT PURSUANT TO SECTION 13 OR 15(d) OF THE SECURITIES EXCHANGE ACT OF 1934 For the Transition Period from_______________________to_______________________ Commission File No. 1-32525 AMERIPRISE FINANCIAL, INC. (Exact name of registrant as specified in its charter) Delaware 13-3180631 (State or other jurisdiction of incorporation or organization) (I.R.S. Employer Identification No.) 1099 Ameriprise Financial Center Minneapolis Minnesota 55474 (Address of principal executive offices) (Zip Code) Registrant’s telephone number, including area code: (612) 671-3131 Securities registered pursuant to Section 12(b) of the Act: Title of each class Trading Symbol Name of each exchange on which registered Common Stock (par value $.01 per share) AMP New York Stock Exchange Securities registered pursuant to Section 12(g) of the Act: None Indicate by check mark if the registrant is a well-known seasoned issuer, as defined in Rule 405 of the Securities Act. Yes No Indicate by check mark if the registrant is not required to file reports pursuant to Section 13 or Section 15(d) of the Exchange Act. Yes No Indicate by check mark whether the registrant (1) has filed all reports required to be filed by Section 13 or 15(d) of the Securities Exchange Act of 1934 during the preceding 12 months (or for such shorter period that the registrant was required to file such reports), and (2) has been subject to such filing requirements for the past 90 days. Yes No Indicate by check mark whether the registrant has submitted electronically every Interactive Data File required to be submitted pursuant to Rule 405 of Regulation S-T (§232.405 of this chapter) during the preceding 12 months (or for such shorter period that the registrant was required to submit such files). Yes No Indicate by check mark whether the registrant is a large accelerated filer, an accelerated filer, a non-accelerated filer, smaller reporting company, or an emerging growth company. See the definitions of “large accelerated filer,” “accelerated filer,” “smaller reporting company,” and “emerging growth company” in Rule 12b-2 of the Exchange Act. Large Accelerated Filer Accelerated Filer Non-accelerated Filer Smaller reporting company Emerging growth company If an emerging growth company, indicate by check mark if the registrant has elected not to use the extended transition period for complying with any new or revised financial accounting standards provided pursuant to Section 13(a) of the Exchange Act. Indicate by check mark whether the registrant has filed a report on and attestation to its management’s assessment of the effectiveness of its internal control over financial reporting under Section 404(b) of the Sarbanes-Oxley Act by the registered public accounting firm that prepared or issued its audit report. If securities are registered pursuant to Section 12(b) of the Act, indicate by check mark whether the financial statements of the registrant included in the filing reflect the correction of an error to previously issued financial statements. Indicate by check mark whether any of those error corrections are restatements that required a recovery analysis of incentive-based compensation received by any of the registrant’s executive officers during the relevant recovery period pursuant to §240.10D-1(b). Indicate by check mark whether the registrant is a shell company (as defined in Rule 12b-2 of the Exchange Act). Yes No The aggregate market value, as of June 30, 2023, of voting shares held by non-affiliates of the registrant was approximately $ 34.1 billion.

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 10
• per_device_eval_batch_size: 10
• num_train_epochs: 5
• multi_dataset_batch_sampler: round_robin

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: steps
• prediction_loss_only: True
• per_device_train_batch_size: 10
• per_device_eval_batch_size: 10
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 5e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1
• num_train_epochs: 5
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.0
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• use_ipex: False
• bf16: False
• fp16: False
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: False
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: False
• hub_always_push: False
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• dispatch_batches: None
• split_batches: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: False
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• use_liger_kernel: False
• eval_use_gather_object: False
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: round_robin

Training Logs

Epoch	Step	cosine_map@100
0.0532	50	0.7017
0.1064	100	0.7136
0.1596	150	0.7155
0.2128	200	0.7228
0.2660	250	0.7403

Framework Versions

• Python: 3.10.12
• Sentence Transformers: 3.2.1
• Transformers: 4.45.1
• PyTorch: 2.1.0+cu118
• Accelerate: 1.0.1
• Datasets: 3.1.0
• Tokenizers: 0.20.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

MultipleNegativesRankingLoss

@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply},
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}