metadata
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- dense
- generated_from_trainer
- dataset_size:2369
- loss:MultipleNegativesRankingLoss
- dataset_size:6288
base_model: AI-Growth-Lab/PatentSBERTa
widget:
- source_sentence: "COMPOSITIONS COMPRISING OR CONSISTING OF POLYDATIN FOR USE IN TREATMENT OF BONE DISEAS. Title: COMPOSITIONS COMPRISING OR CONSISTING OF POLYDATIN FOR USE IN TREATMENT OF BONE DISEAS\n\nAbstract: \n\nBusiness Description: The patent concerns the possible use of polydatin for the treatment of pathologies characterized by reduced bone mass. Polydatin is an oligostilbene that can be extracted in abundant quantities from the roots of the Polygonum Cuspidatum plant and, according to our studies about osteoblastic proliferation and differentiation, is able to increase osteogenic activity.\n\nTech Features: Skeletal pathologies are widespread in the world population, more than 200 million people are osteoporosis patients and have a high probability of fracture. Polydatin is a substance of natural origin, free of the side effects related to the use of synthetic drugs,\_currently administered for the treatment of bone loss diseases . Our experiments carried out in two-dimensional cultures (2D) and in cells grown on Scaffold (3D), have shown that polydatin is able to increase the activity of osteoblasts (ALP) and the deposition of Bone Matrix. The compositions comprising or consisting of polydatin may be administered orally (for example capsules or tablets, solutions, emulsions) or topically (oils, creams, ointments), or even through an appropriate enrichment of the active ingredient in functional foods\n\nApplications: Patients with traumatic-degenerative pathologies of the skeleton and oral cavity; Osteoporosis patients;\n\nAdvantages: Molecule of natural origin; Antioxidant activity on the whole organism; Possibility of topical use;"
sentences:
- >-
Inhibitory compounds neurodegeneration and tumors. Title: Inhibitory
compounds neurodegeneration and tumors
Abstract:
Business Description: The inhibition of the monoacylglycerol lipase
enzyme (MAGL), naturally present in many brain cells and involved in
physio-pathological processes, has a high therapeutic potential:
neurodegenerative inflammation pathologies and tumors could be treated
with new reversible inhibitory compounds, which would reduce the side
effects of the irreversible inhibitors tested so far.
Tech Features: Monoacylglycerol lipase (MAGL) is a human enzyme of the
endocannabinoid system involved in numerous physio-pathological
processes (regulation of inflammation, anxiety, immune modulation, motor
coordination ...), yet its overexpression/upregulation can cause
neuroinflammatory diseases and tumors. The inhibition of MAGL for
therapeutic purposes has been studied so far with irreversible
inhibitors, which however nullify the enzyme activity, leading to a
progressive loss of the therapeutic effect and to addiction phenomena.
On the contrary, the new-patented compounds based on a strong
non-covalent reversible mechanism of action avoid the side effects
mentioned. Effective in laboratory on various tumor cell lines (e.g.
colorectal, breast and ovarian cancer), they could also treat other
MAGL-mediated pathologies (neuroinflammation/degeneration, pain,
amyotrophic multiple/lateral sclerosis, Alzheimer's disease, Parkinson's
disease). Link to scientific publication and information on Ca' Foscari
website
Applications: Innovative and less harmful pharmaceutical compositions
for the treatment of serious neurodegenerative pathological conditions;
Innovative and less harmful pharmaceutical compositions for cancer
treatment.
Advantages: Temporary nature and reversibility; Drastic reduction of
side effects; High efficacy tested on tumor cell lines; Exploitable to
treat numerous neurodegenerative diseases; One of the few non-covalent
reversible MAGL inhibitors with high efficacy.
- >-
New computational method for the prognosis of amyotrophic lateral
sclerosis. Title: New computational method for the prognosis of
amyotrophic lateral sclerosis
Abstract: A method is described for determining a disease progression
and survival prognosis, at a succession of prediction times, for
patients suffering from amyotrophic lateral sclerosis (ALS). The method
comprises a step of defining a set of variables associated with the
onset and progression of amyotrophic lateral sclerosis, comprising a
first group of variables associated with the onset of amyotrophic
lateral sclerosis (comprising at least the variables “patient sex”,
“disease onset age”, “disease onset site”), a second group of dynamic
time variables (comprising at least the variable “time elapsed since
disease onset”), a third group of dynamic functional variables
(comprising at least one of the variables breathing, swallowing,
communicating, walking/self-care or at least one variable of a
functional progression and/or severity scale of amyotrophic lateral
sclerosis), and further at least one variable associated with survival.
The method further provides for encoding by means of a Dynamic Bayesian
Network, using at least one trained algorithm, a plurality of
probabilistic conditional dependence relationships, in which each
relationship is a probabilistic conditional dependence relationship
between two of the aforesaid variables. The aforesaid prediction times
are defined so that each prediction time belongs to a respective time
interval in which the conditional dependence relationships between the
variables are stationary. The method further involves describing the
Dynamic Bayesian Network, using at least one trained algorithm, by means
of a corresponding graph, comprising said variables as nodes and
comprising topological connections oriented between nodes corresponding
to variables among which a probabilistic conditional dependence is
identified. In the graph, given a node, the connections entering it show
a conditional probability of the value assumed by the variable
associated with such node, in a given prediction time, depending on the
values assumed, in a prior prediction time, from the variables
associated with the nodes from which such connections originate. The
method further comprises the steps of entering, for each of the defined
variables, data acquired at a given acquisition time relating to the
situation of a specific patient; and calculating, by electronic
processing and/or calculating means, on the basis of the Dynamic
Bayesian Network and the graph, and starting from the aforesaid acquired
data, the values of each of the defined variables, at one or more
prediction times following the acquisition time. Finally, the method
involves obtaining, in a given prediction time, disease progression
prognosis results on the basis of the values of one or more of the
variables of the third group calculated in such prediction time; and the
survival prognosis results on the basis of the value of at least one
variable associated with survival, calculated at such prediction time.
Business Description: The invention relates to a new probabilistic model
based on dynamic Bayesian networks: by introducing specific clinical
data of patients suffering from amyotrophic lateral sclerosis (ALS), the
model object of the invention allows to predict the course of the
disease, the loss of autonomy in specific functional domains and the
survival, and to identify risk factors of the disease.
Tech Features: Amyotrophic lateral sclerosis (ALS) is a
neurodegenerative disease, characterized by progressive muscle paralysis
caused by motor neuron degeneration. The onset and progression of ALS
are very heterogeneous, making the development of personalised
approaches extremely difficult. The invention consists of a
probabilistic predictor of ALS progression, based on a dynamic Bayesian
network built using a database of over 4000 patients treated at
specialised centres in Italy and Israel. By intoducing the clinical
information of a new ALS subject, the invention allows to simulate the
clinical course and to probabilistically predict the risk of impairment
of the functional domains typical of ALS and the survival, representing
an important tool to support clinical decision-making and the drafting
of the treatment plan.
Applications: Online platform (SaaS)/software for predicting ALS
progression; Support to clinical decision and drafting of the treatment
plan; Institutional stakeholder decision support; In silico generation
of patient populations with specific characteristics.
Advantages: Prediction of ALS progression; Personalized medicine
approach; Clinical decision support; Identification of new prognostic
markers; Possible alternative to placebo cohorts in clinical trials.
- "COMPOSITIONS COMPRISING OR CONSISTING OF POLYDATIN FOR USE IN TREATMENT OF BONE DISEAS. Title: COMPOSITIONS COMPRISING OR CONSISTING OF POLYDATIN FOR USE IN TREATMENT OF BONE DISEAS\n\nAbstract: \n\nBusiness Description: The patent concerns the possible use of polydatin for the treatment of pathologies characterized by reduced bone mass. Polydatin is an oligostilbene that can be extracted in abundant quantities from the roots of the Polygonum Cuspidatum plant and, according to our studies about osteoblastic proliferation and differentiation, is able to increase osteogenic activity.\n\nTech Features: Skeletal pathologies are widespread in the world population, more than 200 million people are osteoporosis patients and have a high probability of fracture. Polydatin is a substance of natural origin, free of the side effects related to the use of synthetic drugs,\_currently administered for the treatment of bone loss diseases . Our experiments carried out in two-dimensional cultures (2D) and in cells grown on Scaffold (3D), have shown that polydatin is able to increase the activity of osteoblasts (ALP) and the deposition of Bone Matrix. The compositions comprising or consisting of polydatin may be administered orally (for example capsules or tablets, solutions, emulsions) or topically (oils, creams, ointments), or even through an appropriate enrichment of the active ingredient in functional foods\n\nApplications: Patients with traumatic-degenerative pathologies of the skeleton and oral cavity; Osteoporosis patients;\n\nAdvantages: Molecule of natural origin; Antioxidant activity on the whole organism; Possibility of topical use;"
- source_sentence: >-
OFFLOADNN. Title: OFFLOADNN
Abstract:
Business Description: Resource availability at the edge is generally
limited, with particular regard to memory consumption of DNNs, rarely
considered as a limiting factor to the execution of tasks at the edge.
Furthermore, the structure of the DNNs required for different CV inference
tasks and the correlation among them have often been overlooked.
Accounting for all this, the invention decreases the resource consumption
of DNNs dedicated to run CV tasks, which in turn allow to run more tasks
or to decrease the energy consumption with the same number of running
tasks.
Tech Features: The invention is OffloaDNN, a framework to support the
scalable offloading of computer vision (CV) tasks to the edge. We
formulated the problem of DNN for scalable Offloading of Tasks (DOT) to
find the optimal configuration of the DNN, the tasks that can be admitted
and the allocation of compute and network resources to assign to the
tasks. DOT minimizes the task rejection rate and resource consumption,
while meeting the accuracy and latency requirements of admitted tasks. As
the DOT is NP-hard, and therefore complex to solve to optimality,
OffloaDNN solves the DOT efficiently using a weighted tree-based graph
modeling of the feasible solutions. The invention allows to decrease the
resources needed at the edge, also allowing for multiple task execution
when these require the same DNN components. The lowering of resources
needed implies also a lower energy consumption with operational savings.
Applications: Computer vision tasks using edge computing.
Advantages: Lower resources needed at the edge; Lower energy consumption;
Lower operative costs.
sentences:
- >-
OFFLOADNN. Title: OFFLOADNN
Abstract:
Business Description: Resource availability at the edge is generally
limited, with particular regard to memory consumption of DNNs, rarely
considered as a limiting factor to the execution of tasks at the edge.
Furthermore, the structure of the DNNs required for different CV
inference tasks and the correlation among them have often been
overlooked. Accounting for all this, the invention decreases the
resource consumption of DNNs dedicated to run CV tasks, which in turn
allow to run more tasks or to decrease the energy consumption with the
same number of running tasks.
Tech Features: The invention is OffloaDNN, a framework to support the
scalable offloading of computer vision (CV) tasks to the edge. We
formulated the problem of DNN for scalable Offloading of Tasks (DOT) to
find the optimal configuration of the DNN, the tasks that can be
admitted and the allocation of compute and network resources to assign
to the tasks. DOT minimizes the task rejection rate and resource
consumption, while meeting the accuracy and latency requirements of
admitted tasks. As the DOT is NP-hard, and therefore complex to solve to
optimality, OffloaDNN solves the DOT efficiently using a weighted
tree-based graph modeling of the feasible solutions. The invention
allows to decrease the resources needed at the edge, also allowing for
multiple task execution when these require the same DNN components. The
lowering of resources needed implies also a lower energy consumption
with operational savings.
Applications: Computer vision tasks using edge computing.
Advantages: Lower resources needed at the edge; Lower energy
consumption; Lower operative costs.
- >-
Polymeric endodontic instruments. Title: Polymeric endodontic
instruments
Abstract: The present invention relates to an endodontic tool for
shaping a dental root canal, wherein said tool comprises a handle (13),
a tang (11), and a stem (10) made of polymeric material and comprising a
tip (12) and at least one helically developing cutting edge (100), and
wherein said stem (10) develops along a longitudinal axis (A-A). The
stem (10) has a substantially conical or tapering twisted shape, in
particular said stem (10) having a solid cross-section with a diameter
increasing from the tip (12) to the tang (11).
Business Description: Endodontic files for shaping canal roots are made
of Ni-Ti alloy or stainless steel. Production, based on precision
micromechanics processes, involves high costs and time. Production
limitations affect the geometries, especially near the tip, reducing
cutting efficiency. Another critical issue is the potential failure of
the instrument during treatment, which can trap it in the canal and
require invasive procedures for the patient.
Tech Features: The analysis of materials databases has identified
families of biocompatible polymers, potentially reinforced, capable of
sustaining the applied loads even better than the traditional metallic
materials used for endodontic files. The selected polymers offer
advantages in terms of fatigue resistance and reduced costs. However,
they present critical issues related to hardness and torsion resistance,
which are fundamental characteristics for the shaping of the canal root.
To address these issues, the use of biocompatible surface coatings with
high hardness and low friction coefficient is proposed, applicable
through technologies such as chemical vapor deposition. These coatings
can significantly improve the surface resistance of polymers, making
them suitable for use in endodontic files.
Applications: Biocompatible polymers have been identified that withstand
critical stresses leading to the failure of metallic tools during canal
shaping; The identified polymers, with lower density and cost compared
to metals, allow the use of inexpensive mass production technologies.
Advantages: Drastic reduction in production costs; Reduction or
elimination of the risk of instrument failure in the canal; Creation of
innovative geometries through 3D printing or injection molding for
large-scale production.
- >-
Unidirectional mechanical device. Title: Unidirectional mechanical
device
Abstract: Unidirectional mechanical device comprising at least one array
(10; 20) of three or more cells (100; 200). Each cell (100; 200) of the
array comprises: a floating mass (101; 201); at least one first elastic
element (102; 202) connecting the floating mass (101; 201) to a
reference external structure for the unidirectional mechanical device,
wherein the at least one first elastic element (102; 202) comprises at
least one first folded beam; at least one second elastic element (103)
connecting the floating mass (101) to a second floating mass of a
preceding cell of the at least one array (10), wherein the at least one
second elastic element (103) comprises at least one second folded beam;
at least one third elastic element (104) connecting the floating mass
(101) to a third floating mass of a succeeding cell of the at least one
array (10), wherein the at least one third elastic element (104)
comprises at least one third folded beam; an electric system configured
to control a potential difference acting on the floating mass (101;
201), determining an overall electrostatic stiffness of the at least one
array (10; 20).
Business Description: The invention consists of a mono-directional
mechanical filter at a micrometric scale, which can be integrated into
MEMS systems. In certain frequency bands, the device allows the
propagation of mechanical waves in only one direction, blocking those
travelling in the opposite direction. We obtain this filter by means of
a periodic structure with time-modulated stiffness, here achieved by
regulating suitable voltages.
Tech Features: In mechanics, the principle of reciprocity dictates that
a system excited at point A and observed at point B behaves in the same
way if excited at B and observed at A. One of the ways to create a
non-reciprocal system is to break temporal invariance. A substantial
number of scientific works in recent years have dealt with the
theoretical and experimental description of these systems, created
through periodic structures of time-varying stiffness. However, these
works remain confined to the level of speculation and demonstrative
prototypes to the macro-scale, with complicated and difficult to
implement solutions. The present invention realizes the above principles
in an easy-to-produce MEMS device by using an electrostatic principle
for the modulation of the stiffness which, since it is not present at
the macro-scale but only at the micro-scale, had not been considered
with this aim up to now. Essentially, the system is made up of the
repetition of some elementary cells, made up of springs and masses that
house an electrode with parallel faces for modulation. We speculate that
this new type of system can be used both as a new sensor and/or as a
component (e.g. filter) in more complex systems.
Applications: MEMS directional sensor; Directional filter for devices
that use elastic waves as the main means of transduction.
Advantages: Uses mechanical waves; Mechanical device with
non-symmetrical response (equivalent of an electric diode); Lower
frequencies as compared to electromagnetic waves; Can be manufactured
using traditional MEMS technologies.
- source_sentence: >-
GEL FORMULATION FOR THE ORAL ADMINISTRATION OF DRUGS IN PARTICULAR TO
DYSPHAGIC PATIENTS. Title: GEL FORMULATION FOR THE ORAL ADMINISTRATION OF
DRUGS IN PARTICULAR TO DYSPHAGIC PATIENTS
Abstract:
Business Description: The present invention relates to a gel formulation
containing water-soluble active ingredients mainly available on the
pharmaceutical market as oral solid dosage forms such as immediate-release
tablets or capsules or powders or granules for oral use. The formulation
object of the present invention satisfies the particular needs of patients
who show anomalies in the swallowing process. The pathological condition
related to swallowing problems is called dysphagia.
Tech Features: The present invention provides a method for reformulating
water-soluble drugs, when commercially available for oral administration
only in solid form with immediate release, mostly tablets and / or
capsules without neglecting the existence of granules and powders for oral
use. Drugs are reformulated as semi-solid preparations suitable for oral
administration in patients with swallowing. This method allows to obtain
an unchanged release of the active ingredient, compared to that of the
drug formulated in the original dosage form. The present patent therefore
describes a semi-solid formulation with rheological characteristics
comparable to commercially gelled drinks, used for hydration and the
administration of therapy to patients with swallowing disorders.
Applications: Avoid any handling operations by eliminating the dangers
associated with loss of active substance; Avoid contamination and dosage
errors with greater safety in the administration of drugs; The active
substance is formulated in a dosage form with a consistency suitable for
swallowing in the dysphagic patients without its release kinetics being
altered.
Advantages: Potential applicability in hospital pharmacies to standardize,
optimize and automate the galenic preparations of drugs available only as
tablets; Large-scale marketing can improve the therapeutic possibilities
for dysphagia patients; Industrial production may cover a market share,
which is currently entrusted to galenic production in a pharmacy.
sentences:
- >-
Supplement for psychiatric disorders. Title: Supplement for psychiatric
disorders
Abstract:
Business Description: The present invention relates to an ester of a
phospholipid with conjugated linoleic acid (CLA) as a nutritional
supplement in treatment of psychiatric disorders with neuroinflammatory
and neurodegenerative basis, such as depression, bipolar disorder and
schizophrenia.
Tech Features: The search for alternative therapies in place of
non-steroidal anti-inflammatory drugs for neuroinflammation is crucial
since the risk of side effects derived from their use has been
demonstrated especially during pregnancy with serious outcomes such as
the development of sexual organs in the fetus as well as subsequent
psychiatric trajectory in the offspring life in both sexes. Therefore,
an alternative therapeutic approach would be resolutive to
pharmacological treatment. We have shown in in-vivo models that the
dietary intake of 0.5% CLA (i) increases omega-3 DHA fatty acid levels
by approx. 10 times in both the maternal and fetal liver, and approx. 5
times in the fetal brain; (ii) increases gene expression of PPAR alpha
and its PEA and OEA ligands. These molecules are known to exert a potent
anti-neuroinflammatory activity and thereby a protective effect against
those psychiatric disorders with neuroinflammatory basis. Furthermore,
as ester of a phospholipid the bioavailability of CLA is increased.
TRL= 3 - 4 ( in-vivo )
Applications: Psychiatric disorders with neuroinflammatory basis such as
depression, bipolar disorder and schizophrenia.
Advantages: Absence of side effects; Suitable also during critical
windows of vulnerability such as pregnancy and infancy; CLA can be
formulated as a functional food, facilitating its compliance.
- >-
Safepack: Safety Backpack for riders. Title: Safepack: Safety Backpack
for riders
Abstract:
Business Description: Safepack is the first smart backpack designed for
Gig Economy delivery service riders. It is fully integrated into the
work dynamics and improves user safety by reducing the possibility of
distraction and enhancing communication with other road users.
Tech Features: Safepack consists of: 1) Tactile navigation system,
inserted in the belt, consisting of piezoelectric actuators that vibrate
in the direction of the path to follow and an inflation system that
ensures the fitting and correct perception of the vibration. 2)
Communication system based on voice interface (Speaker and microphone):
the rider can receive information from the platform, such as the
delivery of a new order (collection / delivery point, distance,
compensation), can accept or reject it and communicate delays or
emergencies. 3) Automatic lighting system, aimed at improving
communication with other road users. The light is generated by
side-emitting optical fibers connected to a yellow LED for the
visibility lights, and red LEDs for the directional and brake lights.
Finally, Safepack communicates via bluetooth with the platform app and
with the navigation app. The volume of the voice interface and the
intensity of the vibration can be adjusted thanks to a pressure sensor
placed in the right shoulder strap.
Applications: Riders working in Gig economy delivery services.
Advantages: A smart product perfectly integrated into the working
dynamics of the delivery platforms; Offers a support tool that allows a
rider not to have to constantly look at a smartphone to receive
navigation instructions and information from the platform app; Improves
rider safety by reducing distracting factors, making him visible and
communicating his movements to other road users.
- >-
GEL FORMULATION FOR THE ORAL ADMINISTRATION OF DRUGS IN PARTICULAR TO
DYSPHAGIC PATIENTS. Title: GEL FORMULATION FOR THE ORAL ADMINISTRATION
OF DRUGS IN PARTICULAR TO DYSPHAGIC PATIENTS
Abstract:
Business Description: The present invention relates to a gel formulation
containing water-soluble active ingredients mainly available on the
pharmaceutical market as oral solid dosage forms such as
immediate-release tablets or capsules or powders or granules for oral
use. The formulation object of the present invention satisfies the
particular needs of patients who show anomalies in the swallowing
process. The pathological condition related to swallowing problems is
called dysphagia.
Tech Features: The present invention provides a method for reformulating
water-soluble drugs, when commercially available for oral administration
only in solid form with immediate release, mostly tablets and / or
capsules without neglecting the existence of granules and powders for
oral use. Drugs are reformulated as semi-solid preparations suitable for
oral administration in patients with swallowing. This method allows to
obtain an unchanged release of the active ingredient, compared to that
of the drug formulated in the original dosage form. The present patent
therefore describes a semi-solid formulation with rheological
characteristics comparable to commercially gelled drinks, used for
hydration and the administration of therapy to patients with swallowing
disorders.
Applications: Avoid any handling operations by eliminating the dangers
associated with loss of active substance; Avoid contamination and dosage
errors with greater safety in the administration of drugs; The active
substance is formulated in a dosage form with a consistency suitable for
swallowing in the dysphagic patients without its release kinetics being
altered.
Advantages: Potential applicability in hospital pharmacies to
standardize, optimize and automate the galenic preparations of drugs
available only as tablets; Large-scale marketing can improve the
therapeutic possibilities for dysphagia patients; Industrial production
may cover a market share, which is currently entrusted to galenic
production in a pharmacy.
- source_sentence: "TARGETING SMALL RNAS AS A THERAPY FOR ALS. Title: TARGETING SMALL RNAS AS A THERAPY FOR ALS\n\nAbstract: The present invention relates to an inhibitor of miR-129, relative compounds and pharmaceutical compositions for use in the treatment and/or prevention of amyotrophic lateral sclerosis and Alzheimer's disease. The invention also relates to a method for the diagnosis and/or prognosis of Alzheimer's disease in a subject or to identify a subject at risk to develop amyotrophic lateral sclerosis or Alzheimer's disease and to a method for the measuring the efficacy of a therapy for amyotrophic lateral sclerosis or for Alzheimer's disease and relative kits.\n\nBusiness Description: We propose to develop a drug product to treat all forms of ALS by targeting an important pathogenic pathway, miR-129-1 that is up-regulated in both familial and sporadic ALS patients, in human and SOD1 G93A mice (A-B). Antisense technology is entering a phase of clinical successes and we believe that our strategy can provide clinically meaningful benefit to patients that have no therapeutic hope. To date, current approved treatments for ALS, which at best guarantee a span life extension of 3 months, are riluzole (Li et al., Plos One 2013) and edaravone (Ito et al, Exp Neurol, 2008) .\n\nTech Features: Our proposed miR-129-1 PMO therapeutic strategy outperformed when compared with these ALS approved molecules. Our patented a miR-129-1 modulation strategy with a Morpholino Antisense Oligonucleotide (ASO-PMO) and demonstrated in vivo that it recovers the expression of its target protein HuD, allowing for a 12.5% increase in survival and an improvement neuromuscular performance of SOD1 G93A mice, a genetic model of ALS, treated in the pre-symptomatic phase.\_To improve miR-129-1 PMO therapeutic efficacy, better delivery to target tissue is needed: based on our experimental data from another study on motor neuron disease, an arginine-rich peptide conjugated with PMO (CPP-PMO) shows an increased efficacy in vivo . In addition, the mouse model TDP43 can be used to demonstrate a more general efficacy of the product, before proceeding with toxicological and pharmacokinetic evaluation in the preclinical setting. In addition, the mouse model TDP43 can be used to demonstrate a more general efficacy of the product, before proceeding with toxicological and pharmacokinetic evaluation in the preclinical setting.\n\nApplications: Familial amyotrophic lateral sclerosis, Sporadic amyotrophic lateral sclerosis, Alzheimer Disease, Epilepsy, Fragile X syndrome, Tubero sclerosis complex and Cornea pathologies.\n\nAdvantages: Targeting miRNA allows modulation of a large number of target genes; PMO works as a steric-blocker, a more effective strategy when the target is a miRNA; PMO is superior to small molecules for improved target affinity; PMO fulfills important criteria of solubility, stability, binding affinity, in vitro and in vivo efficacy and in vivo toxicity if compared to other chemistries; PMO has low risk in terms of toxicity, off target effects and immune response stimulation."
sentences:
- >-
Antimicrobial dental adhesive graphene-based. Title: Antimicrobial
dental adhesive graphene-based
Abstract: Disclosed is a dental adhesive including a polymeric adhesive
and a nanofiller dispersed in the polymeric adhesive, the nanofiller
being constituted by graphene nanostructures which are properly
dispersed inside the polymer adhesive and over the surface of the
adhesive layer without formation of agglomerates, so that the dental
adhesive exhibits significant antimicrobial and antibiofilm properties
against pathogens of the oral cavity.
Business Description: The patent is based on a dental adhesive with
antimicrobial and anti-biofilm properties taking advantage of the use of
graphene-based micro and nanometer fillers. The nanomaterials introduced
into an adhesive are uniformly dispersed, without agglomerations inside
the polymer and partially exposed over the adhesive surface. These
significantly inhibit, by mechanical action, adhesion and bacterial
growth.
Tech Features: The adhesive object of the patent consists of a dental
adhesive composed of BisGMA, filled with graphene-based nanoplachets
(GNP), produced at low cost by thermal expansion, or its derivatives
incorporated in the polymer matrix. Adhesives have strong antimicrobial
properties against the bacteria that typically populate the oral cavity,
such as Streptococcus mutants. Current commercial adhesives use
nanometric fillers, in particular barium glass, zirconium oxide,
aluminum oxide, or silicon dioxide, for the sole purpose of increasing
the micromechanical adhesion between the adhesive and dentin or enamel,
and therefore typically do not have specific properties. antimicrobials.
The antimicrobial dental adhesives used have limitations, as organic
fillers tend to worsen the mechanical characteristics of dental
materials. In fact, these fillers are subject to shrinkage after the
cure and polymerization phase, just like the matrix and therefore limit
the mechanical strength of the composite.
Applications: Dental adhesive with antimicrobial properties.
Advantages: The particular production process of the new adhesive
possess antimicrobial properties; The production of this adhesive does
not require structural changes to companies producing dental adhesives;
GNP possess the properties of the basal plane typical of 2D graphene, at
a lower cost and without its technological problems. Moreover they can
be used on a large scale.
- "OXYSTEROL FOR THE TREATMENT AND PREVENTION OF CORONAVIRUS DISEASES. Title: OXYSTEROL FOR THE TREATMENT AND PREVENTION OF CORONAVIRUS DISEASES\n\nAbstract: \n\nBusiness Description: The invention aims to provide antiviral compounds for the prevention and treatment of infections caused by a coronavirus, particularly by SARS-CoV-2. The invention shows that 27-hydroxycholesterol can activate the innate immune response and induce the response of cells and tissues. Formulated in a pharmaceutical composition, it significantly inhibits the infectivity of SARS-CoV-2 (100% at the highest doses).\n\nTech Features: An oxysterol called 27-hydroxycholesterol (27OHC), a derivative of cholesterol obtained by oxidation, endogenous, that is, produced naturally by the human body, has been identified as an antiviral compound. In fact,\_ in vitro tests, 27OHC was administered after inoculating susceptible cells with SARS-CoV-2, simulating a viral infection treatment protocol. 27OHC was able to inhibit the replication of SARS-CoV-2 and other human coronavirus that causes the common cold (HCoV-OC43), without cytotoxicity, at concentrations in the micromolar range.\n\nThis study has been published on the journal Redox Biology and is available ( https://doi.org/10.1016/j.redox.2020.101682 ).\n\nApplications: Pharmaceutical sector; Respiratory diseases; Chronic inflammatory gastrointestinal diseases.\n\nAdvantages: New treatment for SARS-CoV-2; Treatment active against other Coronaviruses; Physiological drug naturally present in the human organism."
- "TARGETING SMALL RNAS AS A THERAPY FOR ALS. Title: TARGETING SMALL RNAS AS A THERAPY FOR ALS\n\nAbstract: The present invention relates to an inhibitor of miR-129, relative compounds and pharmaceutical compositions for use in the treatment and/or prevention of amyotrophic lateral sclerosis and Alzheimer's disease. The invention also relates to a method for the diagnosis and/or prognosis of Alzheimer's disease in a subject or to identify a subject at risk to develop amyotrophic lateral sclerosis or Alzheimer's disease and to a method for the measuring the efficacy of a therapy for amyotrophic lateral sclerosis or for Alzheimer's disease and relative kits.\n\nBusiness Description: We propose to develop a drug product to treat all forms of ALS by targeting an important pathogenic pathway, miR-129-1 that is up-regulated in both familial and sporadic ALS patients, in human and SOD1 G93A mice (A-B). Antisense technology is entering a phase of clinical successes and we believe that our strategy can provide clinically meaningful benefit to patients that have no therapeutic hope. To date, current approved treatments for ALS, which at best guarantee a span life extension of 3 months, are riluzole (Li et al., Plos One 2013) and edaravone (Ito et al, Exp Neurol, 2008) .\n\nTech Features: Our proposed miR-129-1 PMO therapeutic strategy outperformed when compared with these ALS approved molecules. Our patented a miR-129-1 modulation strategy with a Morpholino Antisense Oligonucleotide (ASO-PMO) and demonstrated in vivo that it recovers the expression of its target protein HuD, allowing for a 12.5% increase in survival and an improvement neuromuscular performance of SOD1 G93A mice, a genetic model of ALS, treated in the pre-symptomatic phase.\_To improve miR-129-1 PMO therapeutic efficacy, better delivery to target tissue is needed: based on our experimental data from another study on motor neuron disease, an arginine-rich peptide conjugated with PMO (CPP-PMO) shows an increased efficacy in vivo . In addition, the mouse model TDP43 can be used to demonstrate a more general efficacy of the product, before proceeding with toxicological and pharmacokinetic evaluation in the preclinical setting. In addition, the mouse model TDP43 can be used to demonstrate a more general efficacy of the product, before proceeding with toxicological and pharmacokinetic evaluation in the preclinical setting.\n\nApplications: Familial amyotrophic lateral sclerosis, Sporadic amyotrophic lateral sclerosis, Alzheimer Disease, Epilepsy, Fragile X syndrome, Tubero sclerosis complex and Cornea pathologies.\n\nAdvantages: Targeting miRNA allows modulation of a large number of target genes; PMO works as a steric-blocker, a more effective strategy when the target is a miRNA; PMO is superior to small molecules for improved target affinity; PMO fulfills important criteria of solubility, stability, binding affinity, in vitro and in vivo efficacy and in vivo toxicity if compared to other chemistries; PMO has low risk in terms of toxicity, off target effects and immune response stimulation."
- source_sentence: >-
High reduction and backdrivability ACTUATion SYSTEM with minimal lateral
encumbrance. Title: High reduction and backdrivability ACTUATion SYSTEM
with minimal lateral encumbrance
Abstract:
Business Description: Typical robotic actuation units have a motor and its
transmission system aligned with the axis of the joint they actuate,
resulting in large lateral encumbrance of the whole system.
This solution aims at solving this problem and allows to locate the last
transmission stage at an arbitrary distance from the axis of the screw.
Tech Features: This invention consists in a class of actuation systems
which is specifically designed to minimize the lateral encumbrance of the
exoskeletal system to maximize its practical usability. Its core
components are a motor coupled to a leadscrew or ballscrew system and a
further (arbitrary) transmission system to connect the nut of the screw
based transmission to the output wheel.
Furthermore, this solution allows to displace the location of the screw
with respect to the final transmission stage, allowing the adaptation of
the location of the different stages of the system without influencing the
overall behavior.The designed anti-blockage system guarantees proper
functioning of each mechanical component and high back-drivability of the
overall system even for high overall gearing.
Applications: Robotics.
Advantages: Minimal lateral encumbrance; High gearing; Highly
Back-drivable; Torque estimation through current measurement; Capability
of dislocating the screw from the point of application of force.
sentences:
- >-
High reduction and backdrivability ACTUATion SYSTEM with minimal lateral
encumbrance. Title: High reduction and backdrivability ACTUATion SYSTEM
with minimal lateral encumbrance
Abstract:
Business Description: Typical robotic actuation units have a motor and
its transmission system aligned with the axis of the joint they actuate,
resulting in large lateral encumbrance of the whole system.
This solution aims at solving this problem and allows to locate the last
transmission stage at an arbitrary distance from the axis of the screw.
Tech Features: This invention consists in a class of actuation systems
which is specifically designed to minimize the lateral encumbrance of
the exoskeletal system to maximize its practical usability. Its core
components are a motor coupled to a leadscrew or ballscrew system and a
further (arbitrary) transmission system to connect the nut of the screw
based transmission to the output wheel.
Furthermore, this solution allows to displace the location of the screw
with respect to the final transmission stage, allowing the adaptation of
the location of the different stages of the system without influencing
the overall behavior.The designed anti-blockage system guarantees proper
functioning of each mechanical component and high back-drivability of
the overall system even for high overall gearing.
Applications: Robotics.
Advantages: Minimal lateral encumbrance; High gearing; Highly
Back-drivable; Torque estimation through current measurement; Capability
of dislocating the screw from the point of application of force.
- >-
Fluid filtering device based on a rotating valve pressure exchanger.
Title: Fluid filtering device based on a rotating valve pressure
exchanger
Abstract:
Business Description: The invention consists of an high pressure
reciprocating pumping system equipped with an energy recovery device,
intended for reverse osmosis plants. The patented device, descending by
previous ENEA's patents, permits to realize water treatment plants with
low energy consumption.
Tech Features: During ENEA's research in absorption refrigeration
machines, have been patented several reciprocating pumping systems based
on oil gear pumps coupled with an original self-adjusting rotating
valve. Such a coupling, instead of the usual piston-rod-crank kinematic,
has permitted to realize low cost and high reliability high pressure
reciprocating pumps, called "VR pumps". Basing on the original know-how
developed for the technology, a new invention has been patented, which
consists to link a high pressure primary pump, VR type or not, to a
second VR pump acted by the pressure of the waste water coming from the
desalination plant, instead by pressurized oil as usual. Such second VR
pump acts on the desalination circuit like an innovative pressure
exchanger.
Applications: Reverse osmosis desalination plants; Microfiltration
desalination plants.
Advantages: Low cost; Easy scale up; Suitable for small plants; Low
specific energy consumption.
- >-
Mechanical towing for automatic vehicle convoys. Title: Mechanical
towing for automatic vehicle convoys
Abstract:
Business Description: The patent allows a mechanical coupling between
vehicles in order to guarantee the safety and operation of a convoy of
even 10 vehicles capable of circulating as if it were a single vehicle.
This technology therefore allows a single driver in the head vehicle to
automatically control the convoy of vehicles connected, revolutionizing
the local transport systems with transport services that would otherwise
not be feasible.
Tech Features: The patented mobile mechanical connection couples two
vehicles and transforms them into a convoy that moves like a single
unit. By means of an automatic guidance system, the coupled vehicles are
able to synchronize automatically with the movements of the head
vehicle, ensuring compliance with the trajectory of the head vehicle.
The mechanical connection also acts as a safeguard in case of
malfunctions and motion "harmonizer". This system allows single vehicles
to form convoys driven by the driver only on the leading vehicle:
free-flow car-sharing vehicles can be relocated from areas where they
would be stationed for a long time to areas where there is demand,
forming a convoy also of 10 vehicles and moving them with one driver;
buses can be extended for the central sections of the transport lines
with the highest demand without increasing the drivers; transport
systems can be created in which small buses gather people on call in the
suburbs and form a single convoy that crosses the center with a single
driver. The patented coupling mechanism allows passenger transport
companies to re-organize their services by means of convoys of vehicles
which combine the maintenance of the optimum passenger capacity and the
social requirements imposed by pandemic of COVID-19 and the containment
measures taken.
Applications: Car-sharing services; Logistics and goods distribution
companies; Public and private transport with variable capacity.
Advantages: Certified transport system; Responsible automation; Flexible
and client-oriented transport system; Efficiency of transport and
sharing systems; Management cost reduction, creating capillary and high
capacity services.
pipeline_tag: sentence-similarity
library_name: sentence-transformers
metrics:
- cosine_accuracy@1
- cosine_accuracy@3
- cosine_accuracy@5
- cosine_accuracy@10
- cosine_precision@1
- cosine_precision@3
- cosine_precision@5
- cosine_precision@10
- cosine_recall@1
- cosine_recall@3
- cosine_recall@5
- cosine_recall@10
- cosine_ndcg@10
- cosine_mrr@10
- cosine_map@100
model-index:
- name: SentenceTransformer based on AI-Growth-Lab/PatentSBERTa
results:
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: mnrl val
type: mnrl-val
metrics:
- type: cosine_accuracy@1
value: 0.039440203562340966
name: Cosine Accuracy@1
- type: cosine_accuracy@3
value: 0.08778625954198473
name: Cosine Accuracy@3
- type: cosine_accuracy@5
value: 0.14122137404580154
name: Cosine Accuracy@5
- type: cosine_accuracy@10
value: 0.2035623409669211
name: Cosine Accuracy@10
- type: cosine_precision@1
value: 0.039440203562340966
name: Cosine Precision@1
- type: cosine_precision@3
value: 0.029262086513994912
name: Cosine Precision@3
- type: cosine_precision@5
value: 0.028244274809160308
name: Cosine Precision@5
- type: cosine_precision@10
value: 0.020356234096692113
name: Cosine Precision@10
- type: cosine_recall@1
value: 0.039440203562340966
name: Cosine Recall@1
- type: cosine_recall@3
value: 0.08778625954198473
name: Cosine Recall@3
- type: cosine_recall@5
value: 0.14122137404580154
name: Cosine Recall@5
- type: cosine_recall@10
value: 0.2035623409669211
name: Cosine Recall@10
- type: cosine_ndcg@10
value: 0.10853541428278174
name: Cosine Ndcg@10
- type: cosine_mrr@10
value: 0.07969071852659648
name: Cosine Mrr@10
- type: cosine_map@100
value: 0.08979593108601017
name: Cosine Map@100
SentenceTransformer based on AI-Growth-Lab/PatentSBERTa
This is a sentence-transformers model finetuned from AI-Growth-Lab/PatentSBERTa. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
Model Details
Model Description
- Model Type: Sentence Transformer
- Base model: AI-Growth-Lab/PatentSBERTa
- Maximum Sequence Length: 384 tokens
- Output Dimensionality: 768 dimensions
- Similarity Function: Cosine Similarity
Model Sources
- Documentation: Sentence Transformers Documentation
- Repository: Sentence Transformers on GitHub
- Hugging Face: Sentence Transformers on Hugging Face
Full Model Architecture
SentenceTransformer(
(0): Transformer({'max_seq_length': 384, 'do_lower_case': False, 'architecture': 'MPNetModel'})
(1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)
Usage
Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
pip install -U sentence-transformers
Then you can load this model and run inference.
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
'High reduction and backdrivability ACTUATion SYSTEM with minimal lateral encumbrance. Title: High reduction and backdrivability ACTUATion SYSTEM with minimal lateral encumbrance\n\nAbstract: \n\nBusiness Description: Typical robotic actuation units have a motor and its transmission system aligned with the axis of the joint they actuate, resulting in large lateral encumbrance of the whole system.\n\nThis solution aims at solving this problem and allows to locate the last transmission stage at an arbitrary distance from the axis of the screw.\n\nTech Features: This invention consists in a class of actuation systems which is specifically designed to minimize the lateral encumbrance of the exoskeletal system to maximize its practical usability. Its core components are a motor coupled to a leadscrew or ballscrew system and a further (arbitrary) transmission system to connect the nut of the screw based transmission to the output wheel.\n\nFurthermore, this solution allows to displace the location of the screw with respect to the final transmission stage, allowing the adaptation of the location of the different stages of the system without influencing the overall behavior.The designed anti-blockage system guarantees proper functioning of each mechanical component and high back-drivability of the overall system even for high overall gearing.\n\nApplications: Robotics.\n\nAdvantages: Minimal lateral encumbrance; High gearing; Highly Back-drivable; Torque estimation through current measurement; Capability of dislocating the screw from the point of application of force.',
'High reduction and backdrivability ACTUATion SYSTEM with minimal lateral encumbrance. Title: High reduction and backdrivability ACTUATion SYSTEM with minimal lateral encumbrance\n\nAbstract: \n\nBusiness Description: Typical robotic actuation units have a motor and its transmission system aligned with the axis of the joint they actuate, resulting in large lateral encumbrance of the whole system.\n\nThis solution aims at solving this problem and allows to locate the last transmission stage at an arbitrary distance from the axis of the screw.\n\nTech Features: This invention consists in a class of actuation systems which is specifically designed to minimize the lateral encumbrance of the exoskeletal system to maximize its practical usability. Its core components are a motor coupled to a leadscrew or ballscrew system and a further (arbitrary) transmission system to connect the nut of the screw based transmission to the output wheel.\n\nFurthermore, this solution allows to displace the location of the screw with respect to the final transmission stage, allowing the adaptation of the location of the different stages of the system without influencing the overall behavior.The designed anti-blockage system guarantees proper functioning of each mechanical component and high back-drivability of the overall system even for high overall gearing.\n\nApplications: Robotics.\n\nAdvantages: Minimal lateral encumbrance; High gearing; Highly Back-drivable; Torque estimation through current measurement; Capability of dislocating the screw from the point of application of force.',
'Mechanical towing for automatic vehicle convoys. Title: Mechanical towing for automatic vehicle convoys\n\nAbstract: \n\nBusiness Description: The patent allows a mechanical coupling between vehicles in order to guarantee the safety and operation of a convoy of even 10 vehicles capable of circulating as if it were a single vehicle. This technology therefore allows a single driver in the head vehicle to automatically control the convoy of vehicles connected, revolutionizing the local transport systems with transport services that would otherwise not be feasible.\n\nTech Features: The patented mobile mechanical connection couples two vehicles and transforms them into a convoy that moves like a single unit. By means of an automatic guidance system, the coupled vehicles are able to synchronize automatically with the movements of the head vehicle, ensuring compliance with the trajectory of the head vehicle. The mechanical connection also acts as a safeguard in case of malfunctions and motion "harmonizer". This system allows single vehicles to form convoys driven by the driver only on the leading vehicle: free-flow car-sharing vehicles can be relocated from areas where they would be stationed for a long time to areas where there is demand, forming a convoy also of 10 vehicles and moving them with one driver; buses can be extended for the central sections of the transport lines with the highest demand without increasing the drivers; transport systems can be created in which small buses gather people on call in the suburbs and form a single convoy that crosses the center with a single driver. The patented coupling mechanism allows passenger transport companies to re-organize their services by means of convoys of vehicles which combine the maintenance of the optimum passenger capacity and the social requirements imposed by pandemic of COVID-19 and the containment measures taken.\n\nApplications: Car-sharing services; Logistics and goods distribution companies; Public and private transport with variable capacity.\n\nAdvantages: Certified transport system; Responsible automation; Flexible and client-oriented transport system; Efficiency of transport and sharing systems; Management cost reduction, creating capillary and high capacity services.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[1.0000, 1.0000, 0.5066],
# [1.0000, 1.0000, 0.5066],
# [0.5066, 0.5066, 1.0000]])
Evaluation
Metrics
Information Retrieval
- Dataset:
mnrl-val - Evaluated with
InformationRetrievalEvaluator
| Metric | Value |
|---|---|
| cosine_accuracy@1 | 0.0394 |
| cosine_accuracy@3 | 0.0878 |
| cosine_accuracy@5 | 0.1412 |
| cosine_accuracy@10 | 0.2036 |
| cosine_precision@1 | 0.0394 |
| cosine_precision@3 | 0.0293 |
| cosine_precision@5 | 0.0282 |
| cosine_precision@10 | 0.0204 |
| cosine_recall@1 | 0.0394 |
| cosine_recall@3 | 0.0878 |
| cosine_recall@5 | 0.1412 |
| cosine_recall@10 | 0.2036 |
| cosine_ndcg@10 | 0.1085 |
| cosine_mrr@10 | 0.0797 |
| cosine_map@100 | 0.0898 |
Training Details
Training Dataset
Unnamed Dataset
- Size: 6,288 training samples
- Columns:
sentence_0andsentence_1 - Approximate statistics based on the first 1000 samples:
sentence_0 sentence_1 type string string details - min: 4 tokens
- mean: 12.3 tokens
- max: 35 tokens
- min: 8 tokens
- mean: 12.08 tokens
- max: 36 tokens
- Samples:
sentence_0 sentence_1 Epigenetic regulation system for the control of target gene expressionApplicant/Organization: FONDAZIONE ISTITUTO ITALIANO DI TECNOLOGIASystem integrating a membrane humidifier and an adsorption-based storage for polymer membrane hydrogen fuel cell applications.Technical Classification: H01MSuperconducting bipolar thermoelectric memoryTechnical Classification: G11C_11 - Loss:
MultipleNegativesRankingLosswith these parameters:{ "scale": 20.0, "similarity_fct": "cos_sim", "gather_across_devices": false }
Training Hyperparameters
Non-Default Hyperparameters
eval_strategy: stepsper_device_train_batch_size: 12per_device_eval_batch_size: 12num_train_epochs: 10multi_dataset_batch_sampler: round_robin
All Hyperparameters
Click to expand
do_predict: Falseeval_strategy: stepsprediction_loss_only: Trueper_device_train_batch_size: 12per_device_eval_batch_size: 12gradient_accumulation_steps: 1eval_accumulation_steps: Nonetorch_empty_cache_steps: Nonelearning_rate: 5e-05weight_decay: 0.0adam_beta1: 0.9adam_beta2: 0.999adam_epsilon: 1e-08max_grad_norm: 1num_train_epochs: 10max_steps: -1lr_scheduler_type: linearlr_scheduler_kwargs: Nonewarmup_ratio: Nonewarmup_steps: 0log_level: passivelog_level_replica: warninglog_on_each_node: Truelogging_nan_inf_filter: Trueenable_jit_checkpoint: Falsesave_on_each_node: Falsesave_only_model: Falserestore_callback_states_from_checkpoint: Falseuse_cpu: Falseseed: 42data_seed: Nonebf16: Falsefp16: Falsebf16_full_eval: Falsefp16_full_eval: Falsetf32: Nonelocal_rank: -1ddp_backend: Nonedebug: []dataloader_drop_last: Falsedataloader_num_workers: 0dataloader_prefetch_factor: Nonedisable_tqdm: Falseremove_unused_columns: Truelabel_names: Noneload_best_model_at_end: Falseignore_data_skip: Falsefsdp: []fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}parallelism_config: Nonedeepspeed: Nonelabel_smoothing_factor: 0.0optim: adamw_torch_fusedoptim_args: Nonegroup_by_length: Falselength_column_name: lengthproject: huggingfacetrackio_space_id: trackioddp_find_unused_parameters: Noneddp_bucket_cap_mb: Noneddp_broadcast_buffers: Falsedataloader_pin_memory: Truedataloader_persistent_workers: Falseskip_memory_metrics: Truepush_to_hub: Falseresume_from_checkpoint: Nonehub_model_id: Nonehub_strategy: every_savehub_private_repo: Nonehub_always_push: Falsehub_revision: Nonegradient_checkpointing: Falsegradient_checkpointing_kwargs: Noneinclude_for_metrics: []eval_do_concat_batches: Trueauto_find_batch_size: Falsefull_determinism: Falseddp_timeout: 1800torch_compile: Falsetorch_compile_backend: Nonetorch_compile_mode: Noneinclude_num_input_tokens_seen: noneftune_noise_alpha: Noneoptim_target_modules: Nonebatch_eval_metrics: Falseeval_on_start: Falseuse_liger_kernel: Falseliger_kernel_config: Noneeval_use_gather_object: Falseaverage_tokens_across_devices: Trueuse_cache: Falseprompts: Nonebatch_sampler: batch_samplermulti_dataset_batch_sampler: round_robinrouter_mapping: {}learning_rate_mapping: {}
Training Logs
| Epoch | Step | Training Loss | mnrl-val_cosine_ndcg@10 |
|---|---|---|---|
| 1.6835 | 500 | 0.0001 | - |
| 0.0954 | 50 | - | 0.0077 |
| 0.1908 | 100 | - | 0.0105 |
| 0.2863 | 150 | - | 0.0147 |
| 0.3817 | 200 | - | 0.0205 |
| 0.4771 | 250 | - | 0.0240 |
| 0.5725 | 300 | - | 0.0324 |
| 0.6679 | 350 | - | 0.0348 |
| 0.7634 | 400 | - | 0.0332 |
| 0.8588 | 450 | - | 0.0445 |
| 0.9542 | 500 | 2.3022 | 0.0491 |
| 1.0 | 524 | - | 0.0473 |
| 1.0496 | 550 | - | 0.0479 |
| 1.1450 | 600 | - | 0.0491 |
| 1.2405 | 650 | - | 0.0466 |
| 1.3359 | 700 | - | 0.0593 |
| 1.4313 | 750 | - | 0.0547 |
| 1.5267 | 800 | - | 0.0516 |
| 1.6221 | 850 | - | 0.0596 |
| 1.7176 | 900 | - | 0.0596 |
| 1.8130 | 950 | - | 0.0681 |
| 1.9084 | 1000 | 1.9086 | 0.0667 |
| 2.0 | 1048 | - | 0.0666 |
| 2.0038 | 1050 | - | 0.0686 |
| 2.0992 | 1100 | - | 0.0732 |
| 2.1947 | 1150 | - | 0.0686 |
| 2.2901 | 1200 | - | 0.0772 |
| 2.3855 | 1250 | - | 0.0752 |
| 2.4809 | 1300 | - | 0.0803 |
| 2.5763 | 1350 | - | 0.0721 |
| 2.6718 | 1400 | - | 0.0779 |
| 2.7672 | 1450 | - | 0.0745 |
| 2.8626 | 1500 | 1.6854 | 0.0866 |
| 2.9580 | 1550 | - | 0.0837 |
| 3.0 | 1572 | - | 0.0788 |
| 3.0534 | 1600 | - | 0.0752 |
| 3.1489 | 1650 | - | 0.0788 |
| 3.2443 | 1700 | - | 0.0845 |
| 3.3397 | 1750 | - | 0.0898 |
| 3.4351 | 1800 | - | 0.0920 |
| 3.5305 | 1850 | - | 0.0877 |
| 3.6260 | 1900 | - | 0.0926 |
| 3.7214 | 1950 | - | 0.0858 |
| 3.8168 | 2000 | 1.5140 | 0.0889 |
| 3.9122 | 2050 | - | 0.0882 |
| 4.0 | 2096 | - | 0.0848 |
| 4.0076 | 2100 | - | 0.0828 |
| 4.1031 | 2150 | - | 0.0910 |
| 4.1985 | 2200 | - | 0.0928 |
| 4.2939 | 2250 | - | 0.0913 |
| 4.3893 | 2300 | - | 0.0923 |
| 4.4847 | 2350 | - | 0.0888 |
| 4.5802 | 2400 | - | 0.0882 |
| 4.6756 | 2450 | - | 0.0987 |
| 4.7710 | 2500 | 1.3415 | 0.0954 |
| 4.8664 | 2550 | - | 0.0911 |
| 4.9618 | 2600 | - | 0.0932 |
| 5.0 | 2620 | - | 0.0887 |
| 5.0573 | 2650 | - | 0.0952 |
| 5.1527 | 2700 | - | 0.0954 |
| 5.2481 | 2750 | - | 0.0972 |
| 5.3435 | 2800 | - | 0.0957 |
| 5.4389 | 2850 | - | 0.0999 |
| 5.5344 | 2900 | - | 0.0964 |
| 5.6298 | 2950 | - | 0.0980 |
| 5.7252 | 3000 | 1.2411 | 0.0959 |
| 5.8206 | 3050 | - | 0.0943 |
| 5.9160 | 3100 | - | 0.0963 |
| 6.0 | 3144 | - | 0.0914 |
| 6.0115 | 3150 | - | 0.0915 |
| 6.1069 | 3200 | - | 0.0974 |
| 6.2023 | 3250 | - | 0.1019 |
| 6.2977 | 3300 | - | 0.1014 |
| 6.3931 | 3350 | - | 0.1037 |
| 6.4885 | 3400 | - | 0.0987 |
| 6.5840 | 3450 | - | 0.1010 |
| 6.6794 | 3500 | 1.1304 | 0.1064 |
| 6.7748 | 3550 | - | 0.1085 |
Framework Versions
- Python: 3.12.12
- Sentence Transformers: 5.2.3
- Transformers: 5.0.0
- PyTorch: 2.10.0+cu128
- Accelerate: 1.13.0
- Datasets: 4.0.0
- Tokenizers: 0.22.2
Citation
BibTeX
Sentence Transformers
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
MultipleNegativesRankingLoss
@misc{henderson2017efficient,
title={Efficient Natural Language Response Suggestion for Smart Reply},
author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
year={2017},
eprint={1705.00652},
archivePrefix={arXiv},
primaryClass={cs.CL}
}