{ "dataset": "LibriSpeech dev-clean, 8 held-out speakers", "streams": 12, "minutes": 9.669754166666667, "two_speaker_streams": 4, "reference_words": 1579, "normalization": "Uppercase ASCII words, 'Speaker N:' labels and punctuation removed", "word_errors": { "baseline": 43, "awq_pytorch": 39, "c_bf16": 44, "c_awq": 40 }, "wer": { "baseline": 0.027232425585813805, "awq_pytorch": 0.024699176694110196, "c_bf16": 0.02786573780873971, "c_awq": 0.0253324889170361 }, "held_out_speakers": [ "174", "2086", "2277", "2412", "5338", "5536", "6313", "7976" ], "samples_detail": [ { "wav": "/mnt/ssd0/vv3/awq-stream/data/eval/eval-000.wav", "reference": "I EXPRESSED BY SIGNS MY ADMIRATION AND PLEASURE TO MY GUIDES AND THEY WERE GREATLY PLEASED THE COUNTRY WAS HIGHLY CULTIVATED EVERY LEDGE BEING PLANTED WITH CHESTNUTS WALNUTS AND APPLE TREES FROM WHICH THE APPLES WERE NOW GATHERING I SAW A FEW SHEEP WITH ROUNDED NOSES AND ENORMOUS TAILS IN ABOUT FOUR HOURS OF WALKING FROM THE TIME WE STARTED AND AFTER PASSING TWO OR THREE MORE VILLAGES WE CAME UPON A CONSIDERABLE TOWN AND MY GUIDES MADE MANY ATTEMPTS TO MAKE ME UNDERSTAND SOMETHING BUT I GATHERED NO INKLING OF THEIR MEANING EXCEPT THAT I NEED BE UNDER NO APPREHENSION OF DANGER SUFFICE IT THAT I FOUND MYSELF TAKEN BEFORE THE CHIEF MAGISTRATE AND BY HIS ORDERS WAS PLACED IN AN APARTMENT WITH TWO OTHER PEOPLE WHO WERE THE FIRST I HAD SEEN LOOKING ANYTHING BUT WELL AND HANDSOME IN FACT ONE OF THEM WAS PLAINLY VERY MUCH OUT OF HEALTH AND COUGHED VIOLENTLY FROM TIME TO TIME IN SPITE OF MANIFEST EFFORTS TO SUPPRESS IT", "baseline": " \n Speaker 0:I expressed by signs my admiration and pleasure to my guides, and they were greatly pleased. The country was highly cultivated, every ledge being planted with chestnuts, walnuts and apple trees, from which the apples were now gathering. I saw a few sheep with rounded noses and enormous tails. In about four hours of walking from the time we started and after passing two or three more villages, we came upon a considerable town and my guides made many attempts to make me understand something. \n Speaker 0:But I gathered no inkling of their meaning, except that I need be under no apprehension of danger. Suffice it that I found myself taken before the chief magistrate and by his orders was placed in an apartment with two other people. Who were the first I had seen looking anything but well handsome. In fact, one of them was plainly very much out of health and coughed violently from time to time in spite of manifest efforts to suppress it.", "awq": " \n Speaker 0:I expressed by signs my admiration and pleasure to my guides, and they were greatly pleased. The country was highly cultivated, every ledge being planted with chestnuts, walnuts and apple trees, from which the apples were now gathering. I saw a few sheep with rounded noses and enormous tails. In about four hours of walking from the time we started and after passing two or three more villages, we came upon a considerable town and my guides made many attempts to make me understand something. \n Speaker 0:But I gathered no inkling of their meaning, except that I need be under no apprehension of danger. Suffice it that I found myself taken before the chief magistrate and by his orders was placed in an apartment with two other people.Who were the first I had seen looking anything but well handsome. In fact, one of them was plainly very much out of health and coughed violently from time to time in spite of manifest efforts to suppress it.", "awq_chunks": [ " \n Speaker 0:I expressed by signs my admiration and pleasure to ", "my guides, and they were greatly pleased. ", "The country was highly cultivated, every ledge ", "being planted with chestnuts, walnuts and apple trees, ", "from which the apples were now gathering. ", "I saw a few sheep with rounded noses and enormous ", "tails. In about four hours of ", "walking from the time we started and after passing two or three ", "more villages, we came upon a considerable town and ", "my guides made many attempts to make me understand something.", " \n Speaker 0:But I gathered no inkling of their ", "meaning, except that I need be under no apprehension ", "of danger. Suffice it that I found ", "myself taken before the chief magistrate and by ", "his orders was placed in an apartment with two other people.", "Who were the first I had seen looking anything but well ", "handsome. In fact, one of them ", "was plainly very much out of health and coughed ", "violently from time to time in spite of manifest efforts to ", "suppress it." ], "generation_seconds": 6.309504985809326, "c_awq": "I expressed by signs my admiration and pleasure to my guides, and they were greatly pleased. The country was highly cultivated, every ledge being planted with chestnuts, walnuts and apple trees, from which the apples were now gathering. I saw a few sheep with rounded noses and enormous tails. In about four hours of walking from the time we started and after passing two or three more villages, we came upon a considerable town and my guides made many attempts to make me understand something. But I gathered no inkling of their meaning, except that I need be under no apprehension of danger. Sufficed it that I found myself taken before the chief magistrate and by his orders was placed in an apartment with two other people.Who were the first I had seen looking anything but well handsome. In fact, one of them was plainly very much out of health and coughed violently from time to time in spite of manifest efforts to suppress it.", "c_bf16": "I expressed by signs my admiration and pleasure to my guides, and they were greatly pleased. The country was highly cultivated, every ledge being planted with chestnuts, walnuts and apple trees, from which the apples were now gathering. I saw a few sheep with rounded noses and enormous tails. In about four hours of walking from the time we started and after passing two or three more villages, we came upon a considerable town and my guides made many attempts to make me understand something. But I gathered no inkling of their meaning, except that I need be under no apprehension of danger. Suffice it that I found myself taken before the chief magistrate and by his orders was placed in an apartment with two other people.Who were the first I had seen looking anything but well handsome. In fact, one of them was plainly very much out of health and coughed violently from time to time in spite of manifest efforts to suppress it." }, { "wav": "/mnt/ssd0/vv3/awq-stream/data/eval/eval-001.wav", "reference": "THEIR EXPRESSION WAS DIVINE AND AS THEY GLANCED AT ME TIMIDLY BUT WITH PARTED LIPS IN GREAT BEWILDERMENT I FORGOT ALL THOUGHTS OF THEIR CONVERSION IN FEELINGS THAT WERE FAR MORE EARTHLY EVEN IN MIDDLE AGE THEY WERE STILL COMELY AND THE OLD GREY HAIRED WOMEN AT THEIR COTTAGE DOORS HAD A DIGNITY NOT TO SAY MAJESTY OF THEIR OWN THE MEN WERE AS HANDSOME AS THE WOMEN BEAUTIFUL I HAVE ALWAYS DELIGHTED IN AND REVERENCED BEAUTY BUT I FELT SIMPLY ABASHED IN THE PRESENCE OF SUCH A SPLENDID TYPE A COMPOUND OF ALL THAT IS BEST IN EGYPTIAN GREEK AND ITALIAN THE CHILDREN WERE INFINITE IN NUMBER AND EXCEEDINGLY MERRY I NEED HARDLY SAY THAT THEY CAME IN FOR THEIR FULL SHARE OF THE PREVAILING BEAUTY I EXPRESSED BY SIGNS MY ADMIRATION AND PLEASURE TO MY GUIDES AND THEY WERE GREATLY PLEASED THE COUNTRY WAS HIGHLY CULTIVATED EVERY LEDGE BEING PLANTED WITH CHESTNUTS WALNUTS AND APPLE TREES FROM WHICH THE APPLES WERE NOW GATHERING", "baseline": " \n Speaker 0:Their expression was divine, and as they glanced at me timidly, but with parted lips and great bewilderment, I forgot all thoughts of their conversion and feelings that were far more earthly. Even in middle age, they were still comely, and the old gray-haired women at their cottage doors had a dignity, not to say majesty, of their own. The men were as handsome as the women beautiful. I have always delighted in and reverenced beauty, but I felt simply abashed in the presence of such a splendid type. \n Speaker 0:A compound of all that is best in Egyptian, Greek, and Italian. The children were infinite in number, and exceedingly merry. I need hardly say that they came in for their full share of the prevailing beauty. I expressed by signs my admiration and pleasure to my guides, and they were greatly pleased. The country was highly cultivated, every ledge being planted with chestnuts, walnuts, and apple trees from which the apples were now gathering.", "awq": " \n Speaker 0:Their expression was divine, and as they glanced at me timidly, but with parted lips and great bewilderment, I forgot all thoughts of their conversion and feelings that were far more earthly. Even in middle age, they were still comely, and the old gray-haired women at their cottage doors had a dignity, not to say majesty, of their own. The men were as handsome as the women beautiful. I have always delighted in and reverenced beauty, but I felt simply abashed in the presence of such a splendid type. \n Speaker 0:A compound of all that is best in Egyptian, Greek, and Italian. The children were infinite in number, and exceedingly merry. I need hardly say that they came in for their full share of the prevailing beauty. I expressed by signs my admiration and pleasure to my guides, and they were greatly pleased. The country was highly cultivated, every ledge being planted with chestnuts, walnuts, and apple trees from which the apples were now gathering.", "awq_chunks": [ " \n Speaker 0:Their expression was divine, and as they glanced at ", "me timidly, but with parted lips and great bewilderment, ", "I forgot all thoughts of their conversion and feelings that were ", "far more earthly. Even in middle age, they ", "were still comely, and the old gray-haired women at their ", "cottage doors had a dignity, not to say ", "majesty, of their own. The men were as handsome ", "as the women beautiful. I have always delighted ", "in and reverenced beauty, but I felt simply ", "abashed in the presence of such a splendid type. \n Speaker 0:A ", "compound of all that is best in Egyptian, Greek, and Italian. ", "The children were infinite in number, and ", "exceedingly merry. I need hardly say that they came ", "in for their full share of the prevailing beauty. ", "I expressed by signs my admiration and pleasure to ", "my guides, and they were greatly pleased. ", "The country was highly cultivated, every ledge ", "being planted with chestnuts, walnuts, and apple trees ", "from which the apples were now gathering." ], "generation_seconds": 6.368318796157837, "c_awq": "Their expression was divine, and as they glanced at me timidly, but with parted lips and great bewilderment, I forgot all thoughts of their conversion and feelings that were far more earthly. Even in middle age, they were still comely, and the old gray-haired women at their cottage doors had a dignity, not to say majesty, of their own. The men were as handsome as the women beautiful. I have always delighted in and reverenced beauty, but I felt simply abashed in the presence of such a splendid type. A compound of all that is best in Egyptian, Greek, and Italian. The children were infinite in number, and exceedingly merry. I need hardly say that they came in for their full share of the prevailing beauty. I expressed by signs my admiration and pleasure to my guides, and they were greatly pleased. The country was highly cultivated, every ledge being planted with chestnuts, walnuts, and apple trees from which the apples were now gathering.", "c_bf16": "Their expression was divine, and as they glanced at me timidly but with parted lips and great bewilderment, I forgot all thoughts of their conversion and feelings that were far more earthly. Even in middle age, they were still comely, and the old gray-haired women at their cottage doors had a dignity, not to say majesty, of their own. The men were as handsome as the women beautiful. I have always delighted in and reverenced beauty, but I felt simply abashed in the presence of such a splendid type. A compound of all that is best in Egyptian, Greek, and Italian. The children were infinite in number, and exceedingly merry. I need hardly say that they came in for their full share of the prevailing beauty. I expressed by signs my admiration and pleasure to my guides, and they were greatly pleased. The country was highly cultivated, every ledge being planted with chestnuts, walnuts, and apple trees from which the apples were now gathering." }, { "wav": "/mnt/ssd0/vv3/awq-stream/data/eval/eval-002.wav", "reference": "SO THEY FOLLOWED HER THROUGH THE LOW ARCHWAY AND IN A ROOM BEYOND VERY SIMPLY FURNISHED SAT A YOUNG GIRL ENGAGED IN DARNING A PAIR OF PINK STOCKINGS SHE WAS A BEAUTIFUL GIRL OF ABOUT SEVENTEEN YEARS OF AGE NOT FAT LIKE ALL THE REST OF THE PINKIES BUT SLENDER AND WELL FORMED ACCORDING TO OUR OWN IDEAS OF BEAUTY HER COMPLEXION WAS NOT A DECIDED PINK BUT A SOFT ROSY TINT NOT MUCH DEEPER THAN THAT OF TROT'S SKIN GIVING THEMSELVES UP WHOLLY TO THEIR GRIEF THEY ARE NO LONGER CONCERNED ABOUT ANY EARTHLY POSSESSION AND OFTEN GIVE AWAY ALL THAT THEY HAVE TO THE FIRST COMERS EVEN TO THEIR BEDS AND THEIR HOME IT WAS PREPARED BY DRESSING IN THE FINEST CLOTHES TOGETHER WITH SOME PERSONAL POSSESSIONS AND ORNAMENTS WRAPPED IN SEVERAL ROBES AND FINALLY IN A SECURE COVERING OF RAW HIDE AS A SPECIAL MARK OF RESPECT THE BODY OF A YOUNG WOMAN OR A WARRIOR WAS SOMETIMES LAID OUT IN STATE IN A NEW TEEPEE WITH THE USUAL HOUSEHOLD ARTICLES AND EVEN WITH A DISH OF FOOD LEFT BESIDE IT NOT THAT THEY SUPPOSED THE SPIRIT COULD USE THE IMPLEMENTS OR EAT THE FOOD BUT MERELY AS A LAST TRIBUTE", "baseline": " \n Speaker 0:So they followed her through the low archway and in a room beyond, very simply furnished, sat a young girl engaged in darning a pair of pink stockings. She was a beautiful girl of about seventeen years of age, not fat like all the rest of the Pinkies, but slender and well formed, according to our own ideas of beauty. Her complexion was not a decided pink, but a soft rosy tint, not much deeper than that of trot's skin. \n Speaker 1:Giving themselves up wholly to their grief, they are no longer concerned about any earthly possession, and often give away all that they have to the first comers, even to their beds and their home. It was prepared by dressing in the finest clothes, together with some personal possessions and ornaments, wrapped in several robes and finally in a secure covering of rawhide.As a special mark of respect, the body of a young woman or a warrior was sometimes laid out in state in a new tepee, with the usual household articles and even with a dish of food left beside it. \n Speaker 1:Not that they supposed the spirit could use the implements or eat the food, but merely as a last tribute.", "awq": " \n Speaker 0:So they followed her through the low archway and in a room beyond, very simply furnished, sat a young girl engaged in darning a pair of pink stockings. She was a beautiful girl of about seventeen years of age, not fat like all the rest of the Pinkies, but slender and well formed, according to our own ideas of beauty. Her complexion was not a decided pink, but a soft rosy tint, not much deeper than that of trot's skin. \n Speaker 1:Giving themselves up wholly to their grief, they are no longer concerned about any earthly possession, and often give away all that they have to the first comers, even to their beds and their home. It was prepared by dressing in the finest clothes, together with some personal possessions and ornaments, wrapped in several robes and finally in a secure covering of rawhide.As a special mark of respect, the body of a young woman or a warrior was sometimes laid out in state in a new tepee, with the usual household articles and even with a dish of food left beside it. \n Speaker 1:Not that they supposed the spirit could use the implements or eat the food, but merely as a last tribute.", "awq_chunks": [ " \n Speaker 0:So they followed her through the low archway and in a ", "room beyond, very simply furnished, sat a ", "young girl engaged in darning a pair of pink stockings. ", "She was a beautiful girl of about ", "seventeen years of age, not fat like all the ", "rest of the Pinkies, but slender and well formed, ", "according to our own ideas of beauty. Her ", "complexion was not a decided pink, but a ", "soft rosy tint, not much deeper than that of trot's skin.", " \n Speaker 1:Giving themselves up wholly to their ", "grief, they are no longer concerned about any earthly possession, ", "and often give away all that they have to the first comers, ", "even to their beds and their home. It was ", "prepared by dressing in the finest clothes, together with some ", "personal possessions and ornaments, wrapped in several robes ", "and finally in a secure covering of rawhide.", "As a special mark of respect, the body of a young ", "woman or a warrior was sometimes laid out in state in a ", "new tepee, with the usual household articles and ", "even with a dish of food left beside it. \n Speaker 1:Not that they ", "supposed the spirit could use the implements or eat the food, ", "but merely as a last tribute." ], "generation_seconds": 7.597476482391357, "c_awq": "So they followed her through the low archway and in a room beyond, very simply furnished, sat a young girl engaged in darning a pair of pink stockings. She was a beautiful girl of about seventeen years of age, not fat like all the rest of the Pinkies, but slender and well formed, according to our own ideas of beauty. Her complexion was not a decided pink, but a soft rosy tint, not much deeper than that of trot's skin. Giving themselves up wholly to their grief, they are no longer concerned about any earthly possession, and often give away all that they have to the first comers, even to their beds and their home. It was prepared by dressing in the finest clothes, together with some personal possessions and ornaments, wrapped in several robes and finally in a secure covering of rawhide.As a special mark of respect, the body of a young woman or a warrior was sometimes laid out in state in a new tepee, with the usual household articles and even with a dish of food left beside it. Not that they supposed the spirit could use the implements or eat the food, but merely as a last tribute.", "c_bf16": "So they followed her through the low archway and in a room beyond, very simply furnished, sat a young girl engaged in darning a pair of pink stockings. She was a beautiful girl of about seventeen years of age, not fat like all the rest of the Pinkies, but slender and well formed, according to our own ideas of beauty. Her complexion was not a decided pink, but a soft rosy tint, not much deeper than that of trot's skin. Giving themselves up wholly to their grief, they are no longer concerned about any earthly possession, and often give away all that they have to the first comers, even to their beds and their home. It was prepared by dressing in the finest clothes, together with some personal possessions and ornaments, wrapped in several robes and finally in a secure covering of rawhide.As a special mark of respect, the body of a young woman or a warrior was sometimes laid out in state in a new tepee, with the usual household articles and even with a dish of food left beside it. Not that they supposed the spirit could use the implements or eat the food, but merely as a last tribute." }, { "wav": "/mnt/ssd0/vv3/awq-stream/data/eval/eval-003.wav", "reference": "WHAT ALTERNATIVE WAS THERE FOR HER SHE WAS DESTROYED NOT MERELY BY THE UNCONSIDERED UNDISCIPLINED PASSIONS OF HER HUSBAND AND HER LOVER BUT BY THE VAST TRADITION THAT SUSTAINS AND ENFORCES THE SUBJUGATION OF HER SEX", "baseline": " \n Speaker 0:What alternative was there for her? She was destroyed, not merely by the unconsidered, undisciplined passions of her husband and her lover, but by the vast tradition that sustains and enforces the subjugation of her sex.", "awq": " \n Speaker 0:What alternative was there for her? She was destroyed, not merely by the unconsidered, undisciplined passions of her husband and her lover, but by the vast tradition that sustains and enforces the subjugation of her sex.", "awq_chunks": [ " \n Speaker 0:What alternative was there for her? ", "She was destroyed, not ", "merely by the unconsidered, undisciplined passions ", "of her husband and her lover, but by the ", "vast tradition that sustains and enforces the ", "subjugation of her sex." ], "generation_seconds": 1.7527744770050049, "c_awq": "What alternative was there for her? She was destroyed, not merely by the unconsidered, undisciplined passions of her husband and her lover, but by the vast tradition that sustains and enforces the subjugation of her sex.", "c_bf16": "What alternative was there for her? She was destroyed, not merely by the unconsidered, undisciplined passions of her husband and her lover, but by the vast tradition that sustains and enforces the subjugation of her sex." }, { "wav": "/mnt/ssd0/vv3/awq-stream/data/eval/eval-004.wav", "reference": "MOREOVER JEAN VALJEAN HAD CHOSEN HIS REFUGE WELL HE HAD PAID HER SIX MONTHS IN ADVANCE AND HAD COMMISSIONED THE OLD WOMAN TO FURNISH THE CHAMBER AND DRESSING ROOM AS WE HAVE SEEN WEEK FOLLOWED WEEK THESE TWO BEINGS LED A HAPPY LIFE IN THAT HOVEL COSETTE WAS NO LONGER IN RAGS SHE WAS IN MOURNING AND THEN HE TALKED OF HER MOTHER AND HE MADE HER PRAY HE PASSED HOURS IN WATCHING HER DRESSING AND UNDRESSING HER DOLL AND IN LISTENING TO HER PRATTLE THE BEST OF US ARE NOT EXEMPT FROM EGOTISTICAL THOUGHTS HE HAD RETURNED TO PRISON THIS TIME FOR HAVING DONE RIGHT HE HAD QUAFFED FRESH BITTERNESS DISGUST AND LASSITUDE WERE OVERPOWERING HIM EVEN THE MEMORY OF THE BISHOP PROBABLY SUFFERED A TEMPORARY ECLIPSE THOUGH SURE TO REAPPEAR LATER ON LUMINOUS AND TRIUMPHANT BUT AFTER ALL THAT SACRED MEMORY WAS GROWING DIM", "baseline": " \n Speaker 0:Moreover, Jean Valjean had chosen his refuge well. He had paid her six months in advance and had commissioned the old woman to furnish the chamber and dressing room as we have seen. Week followed week, these two beings led a happy life in that hovel. Cosette was no longer in rags. She was in mourning. \n Speaker 0:And then he talked to her mother and he made her pray. He passed hours in watching her dressing and undressing her doll and in listening to her prattle. The best of us are not exempt from egotistical thoughts.He had returned to prison, this time for having done right. He had quaffed fresh bitterness, distrust and lassitude were overpowering him. \n Speaker 0:Even the memory of the bishop, probably suffered a temporary eclipse, though sure to reappear later on, luminous and triumphant. But after all, that sacred memory was growing dim.", "awq": " \n Speaker 0:Moreover, Jean Valjean had chosen his refuge well. He had paid her six months in advance and had commissioned the old woman to furnish the chamber and dressing room as we have seen. Week followed week, these two beings led a happy life in that hovel. Cosette was no longer in rags. She was in mourning. And then he talked to her mother and he made her pray. \n Speaker 0:He passed hours in watching her dressing and undressing her doll and in listening to her prattle. The best of us are not exempt from egotistical thoughts.He had returned to prison, this time for having done right. He had quaffed fresh bitterness, distrust and lassitude were overpowering him. \n Speaker 0:Even the memory of the bishop, probably suffered a temporary eclipse, though sure to reappear later on, luminous and triumphant. But, after all, that sacred memory was growing dim.", "awq_chunks": [ " \n Speaker 0:Moreover, Jean Valjean had ", "chosen his refuge well. He had ", "paid her six months in advance and had commissioned ", "the old woman to furnish the chamber and dressing room ", "as we have seen. Week ", "followed week, these two beings led a happy ", "life in that hovel. Cosette ", "was no longer in rags. She was in ", "mourning. And then he talked to ", "her mother and he made her pray.", " \n Speaker 0:He passed hours in watching her dressing ", "and undressing her doll and in listening to her ", "prattle. The best of us are ", "not exempt from egotistical thoughts.", "He had returned to prison, this ", "time for having done right. ", "He had quaffed fresh bitterness, ", "distrust and lassitude were overpowering him.", " \n Speaker 0:Even the memory of the bishop, ", "probably suffered a temporary eclipse, ", "though sure to reappear later on, luminous and ", "triumphant. But, after ", "all, that sacred memory was growing ", "dim." ], "generation_seconds": 6.573299169540405, "c_awq": "Moreover, Jean Valjean had chosen his refuge well. He had paid her six months in advance and had commissioned the old woman to furnish the chamber and dressing room as we have seen. Week followed week, these two beings led a happy life in that hovel. Cosette was no longer in rags. She was in mourning. And then he talked to her mother and he made her pray. He passed hours in watching her dressing and undressing her doll and in listening to her prattle. The best of us are not exempt from egotistical thoughts.He had returned to prison, this time for having done right. He had quaffed fresh bitterness, distrust and lassitude were overpowering him. Even the memory of the bishop, probably suffered a temporary eclipse, though sure to reappear later on, luminous and triumphant. But, after all, that sacred memory was growing dim.", "c_bf16": "Moreover, Jean Valjean had chosen his refuge well. He had paid her six months in advance and had commissioned the old woman to furnish the chamber and dressing room as we have seen. Week followed week, these two beings led a happy life in that hovel. Cosette was no longer in rags. She was in mourning. And then he talked to her mother and he made her pray. He passed hours in watching her dressing and undressing her doll and in listening to her prattle. The best of us are not exempt from egotistical thoughts.He had returned to prison, this time for having done right. He had quaffed fresh bitterness, distrust and lassitude were overpowering him. Even the memory of the bishop, probably suffered a temporary eclipse, though sure to reappear later on, luminous and triumphant. But after all, that sacred memory was growing dim." }, { "wav": "/mnt/ssd0/vv3/awq-stream/data/eval/eval-005.wav", "reference": "THEN HE SAT DOWN IN HIS CHAIR AND GAZED WITHOUT SEEING CONTEMPLATING THE RESULT OF HIS WORK WEEK FOLLOWED WEEK THESE TWO BEINGS LED A HAPPY LIFE IN THAT HOVEL WHAT WOULD SHE DO ABOUT THAT THE CONFOUNDED WRETCH COSETTE WAS NO LONGER IN RAGS SHE WAS IN MOURNING AND THEN HE TALKED OF HER MOTHER AND HE MADE HER PRAY HE PASSED HOURS IN WATCHING HER DRESSING AND UNDRESSING HER DOLL AND IN LISTENING TO HER PRATTLE LATER HOWEVER HIS OLD DISCRETION ASSERTED ITSELF SOMETHING HAD TO BE DONE A CLIMAX WAS NEAR AND SHE WOULD NOT SIT IDLE THE BEST OF US ARE NOT EXEMPT FROM EGOTISTICAL THOUGHTS HE KNEW HER WELL ENOUGH TO KNOW THAT WHEN SHE HAD DECIDED UPON A PLAN SHE WOULD FOLLOW IT UP HE AROSE FROM HIS CHAIR AND WENT AND LOOKED OUT INTO THE STREET", "baseline": " \n Speaker 0:Then he sat down in his chair and gazed without saying, contemplating the result of his work. \n Speaker 0:Week followed week. These two beings led a happy life in that hovel. \n Speaker 0:What would she do about that, the confounded wretch? \n Speaker 0:Cusack was no longer in Rags. She was in mourning.And then he talked of her mother, and he made her pray. He passed hours in watching her dressing and undressing her doll, and in listening to her prattle. \n Speaker 0:Later, however, his old discretion asserted itself.Something had to be done. A climax was near, and she would not sit idle. The best of us are not exempt from egotistical thoughts. \n Speaker 0:He knew her well enough to know that when she had decided upon a plan, she would follow it up.He arose from his chair and went and looked out into the street.", "awq": " \n Speaker 0:Then he sat down in his chair and gazed without scene, contemplating the result of his work. \n Speaker 0:Week followed week. These two beings led a happy life in that hovel. \n Speaker 0:What would she do about that, the confounded wretch? \n Speaker 0:Cusack was no longer in Rags. She was in mourning.And then he talked of her mother, and he made her pray. He passed hours in watching her dressing and undressing her doll, and in listening to her prattle. \n Speaker 0:Later, however, his old discretion asserted itself.Something had to be done. A climax was near, and she would not sit idle. The best of us are not exempt from egotistical thoughts. \n Speaker 0:He knew her well enough to know that when she had decided upon a plan, she would follow it up.He arose from his chair and went and looked out into the street.", "awq_chunks": [ " \n Speaker 0:Then he sat down in his chair and gazed without ", "scene, contemplating the result of his work.", " \n Speaker 0:Week followed week. These two beings ", "led a happy life in that hovel.", " \n Speaker 0:What would she do about that, the confounded wretch?", " \n Speaker 0:Cusack was no longer in ", "Rags. She was in mourning.", "And then he talked of her mother, and he made her ", "pray. He passed ", "hours in watching her dressing and undressing her doll, ", "and in listening to her prattle.", " \n Speaker 0:Later, however, his old discretion asserted itself.", "Something had to be done. A climax was near, and ", "she would not sit idle. The best of ", "us are not exempt from egotistical thoughts.", " \n Speaker 0:He knew her well enough to know that when she had ", "decided upon a plan, she would follow it up.", "He arose from his chair and went and looked out into the street.", "" ], "generation_seconds": 6.074247121810913, "c_awq": "Then he sat down in his chair and gazed without scene, contemplating the result of his work. Week followed week. These two beings led a happy life in that hovel. What would she do about that, the confounded wretch? Cusack was no longer in Rags. She was in mourning.And then he talked of her mother, and he made her pray. He passed hours in watching her dressing and undressing her doll, and in listening to her prattle. Later, however, his old discretion asserted itself.Something had to be done. A climax was near, and she would not sit idle. The best of us are not exempt from egotistical thoughts. He knew her well enough to know that when she had decided upon a plan, she would follow it up.He arose from his chair and went and looked out into the street.", "c_bf16": "Then he sat down in his chair and gazed without saying, contemplating the result of his work. Week followed week. These two beings led a happy life in that hovel. What would she do about that, the confounded wretch? Cousec was no longer in Rags. She was in mourning.And then he talked of her mother, and he made her pray. He passed hours in watching her dressing and undressing her doll, and in listening to her prattle. Later, however, his old discretion asserted itself.Something had to be done. A climax was near, and she would not sit idle. The best of us are not exempt from egotistical thoughts. He knew her well enough to know that when she had decided upon a plan, she would follow it up.He arose from his chair and went and looked out into the street." }, { "wav": "/mnt/ssd0/vv3/awq-stream/data/eval/eval-006.wav", "reference": "YET THE PHYSIOGNOMY OF THE PEOPLE WHEN MORE CLOSELY EXAMINED WAS FAR FROM EXHIBITING THE INDIFFERENCE OF STUPIDITY THEIR FEATURES WERE ROUGH BUT REMARKABLY INTELLIGENT GRAVE BUT THE VERY REVERSE OF STUPID AND FROM AMONG THE YOUNG WOMEN AN ARTIST MIGHT HAVE CHOSEN MORE THAN ONE MODEL WHOSE FEATURES AND FORM RESEMBLED THOSE OF MINERVA THIS AVENUE WAS STRAIGHT AND OF MODERATE LENGTH RUNNING BETWEEN A DOUBLE ROW OF VERY ANCIENT HORSE CHESTNUTS PLANTED ALTERNATELY WITH SYCAMORES WHICH ROSE TO SUCH HUGE HEIGHT AND NOURISHED SO LUXURIANTLY THAT THEIR BOUGHS COMPLETELY OVER ARCHED THE BROAD ROAD BENEATH IT WAS ONE OF THOSE EFFECTS WHICH A PAINTER LOVES TO REPRESENT AND MINGLED WELL WITH THE STRUGGLING LIGHT WHICH FOUND ITS WAY BETWEEN THE BOUGHS OF THE SHADY ARCH THAT VAULTED THE BROAD GREEN ALLEY", "baseline": " \n Speaker 0:Yet the physiognomy of the people, when more closely examined, was far from exhibiting the indifference of stupidity. Their features were rough, but remarkably intelligent, grave. But the very reverse of stupid. And from among the young women, an artist might have chosen more than one model whose features and form resembled those of Minerva.This avenue was straight and of moderate length, running between a double row of very ancient horse chestnuts. \n Speaker 0:Planted alternately with sycamores, which rose to such huge heights and nourished so luxuriantly that their boughs completely overarched the broad road beneath.It was one of those effects which a painter loves to represent and mingled well with the struggling light, which found its way between the boughs of the shady arc that vaulted the broad green alley.", "awq": " \n Speaker 0:Yet the physiognomy of the people, when more closely examined, was far from exhibiting the indifference of stupidity. Their features were rough, but remarkably intelligent, grave. But the very reverse of stupid, and from among the young women, an artist might have chosen more than one model whose features and form resembled those of Minerva.This avenue was straight and of moderate length, running between a double row of very ancient horse-chestnuts. \n Speaker 0:Planted alternately with sycamores, which rose to such huge heights, and nourished so luxuriantly that their boughs completely overarched the broad road beneath.It was one of those effects which a painter loves to represent, and mingled well with the struggling light which found its way between the boughs of the shady arch that vaulted the broad green alley.", "awq_chunks": [ " \n Speaker 0:Yet the physiognomy of the people, ", "when more closely examined, was far from ", "exhibiting the indifference of stupidity. Their ", "features were rough, but remarkably ", "intelligent, grave. But the ", "very reverse of stupid, and from among the young ", "women, an artist might have chosen more than one model ", "whose features and form resembled those of Minerva.", "This avenue was straight and of moderate ", "length, running between a double row of very ", "ancient horse-chestnuts. \n Speaker 0:Planted ", "alternately with sycamores, which rose to such huge ", "heights, and nourished so luxuriantly that their ", "boughs completely overarched the broad road beneath.", "It was one of those effects which a ", "painter loves to represent, and mingled well with the ", "struggling light which found its way between the boughs ", "of the shady arch that vaulted the broad green ", "alley." ], "generation_seconds": 5.82283616065979, "c_awq": "Yet the physiognomy of the people, when more closely examined, was far from exhibiting the indifference of stupidity. Their features were rough, but remarkably intelligent, grave. But the very reverse of stupid, and from among the young women, an artist might have chosen more than one model whose features and form resembled those of Minerva.This avenue was straight and of moderate length, running between a double row of very ancient horse-chestnuts. Planted alternately with sycamores, which rose to such huge heights, and nourished so luxuriantly that their boughs completely overarched the broad road beneath.It was one of those effects which a painter loves to represent, and mingled well with the struggling light which found its way between the boughs of the shady arch that vaulted the broad green alley.", "c_bf16": "Yet the physiognomy of the people, when more closely examined, was far from exhibiting the indifference of stupidity. Their features were rough, but remarkably intelligent, grave. But the very reverse of stupid. And from among the young women, an artist might have chosen more than one model whose features and form resembled those of Minerva.This avenue was straight and of moderate length, running between a double row of very ancient horse chestnuts. Planted alternately with sycamores, which rose to such huge heights and nourished so luxuriantly that their boughs completely overarched the broad road beneath.It was one of those effects which a painter loves to represent and mingled well with the struggling light, which found its way between the boughs of the shady arc that vaulted the broad green alley." }, { "wav": "/mnt/ssd0/vv3/awq-stream/data/eval/eval-007.wav", "reference": "THE CRIES AND CURSES OF THE ROBBERS FILLED THE AIR THEY TRIED IN VAIN TO BREAK DOWN THE GREAT DOORS ALL MY WORRIES ABOUT YOU WERE FOOLISH", "baseline": " \n Speaker 0:The cries and curses of the robbers filled the air. They tried in vain to break down the great doors. All my worries about you were foolish.", "awq": " \n Speaker 0:The cries and curses of the robbers filled the air. They tried in vain to break down the great doors. All my worries about you were foolish.", "awq_chunks": [ " \n Speaker 0:The cries and curses of the robbers filled the ", "air. They tried in vain to break down the ", "great doors. All my worries about you were ", "foolish." ], "generation_seconds": 1.1491668224334717, "c_awq": "The cries and curses of the robbers filled the air. They tried in vain to break down the great doors. All my worries about you were foolish.", "c_bf16": "The cries and curses of the robbers filled the air. They tried in vain to break down the great doors. All my worries about you were foolish." }, { "wav": "/mnt/ssd0/vv3/awq-stream/data/eval/eval-008.wav", "reference": "THIS IS THE MATERIAL OR PHYSICAL PRAYER AND THAT TUMBLE'S ENOUGH TO KNOCK THE SENSE OUT OF A FULL GROWN MAN I COULD NOT THINK OF ALLOWING ANY OF MY CHARGES TO TAKE SO TERRIBLE A RISK AND NO I AM THE LIGHTER OF THE TWO URGED TAD NOTHING OF THE MARVELOUS COULD ASTONISH HIM AS THAT A BEAST SHOULD SPEAK OR THE SUN STAND STILL WHO MAY CONDEMN HIS SUPERSTITION HERE IS THE SUPREME MYSTERY THAT IS THE ESSENCE OF WORSHIP WITHOUT WHICH THERE CAN BE NO RELIGION AND IN THE PRESENCE OF THIS MYSTERY OUR ATTITUDE CANNOT BE VERY UNLIKE THAT OF THE NATURAL PHILOSOPHER WHO BEHOLDS WITH AWE THE DIVINE IN ALL CREATION I AM THE ONE TO GO AFTER WALT IF ANYONE HAS TO I'LL GO DOWN MISTER THOMAS MASTER TAD IS RIGHT DECIDED THE GUIDE GAZING AT THE TWO BOYS APPROVINGLY I PROTEST SHOUTED THE PROFESSOR", "baseline": " \n Speaker 0:This is the material or physical prayer. \n Speaker 0:And that tumbles enough to knock the sense out of a full grown man. \n Speaker 0:I could not think of allowing any of my chargers to take so terrible a risk at no. I am the lighter of the two urged had. \n Speaker 0:Nothing of the marvellous could astonish him, as that a beast should speak or the sun stand still. \n Speaker 0:Who may condemn his superstition? Here is the supreme mystery. That is the essence of worship, without which there can be no religion. And in the presence of this mystery, our attitude cannot be very unlike that of the natural philosopher who beholds with awe the divine in all creation. \n Speaker 0:I am the one to go after Walt, if anyone has to. I'll go down, Mister Thomas. Master Ted is right, decided the guide, gazing at the two boys approvingly. I protest, shouted the professor.", "awq": " \n Speaker 0:This is the material or physical prayer. \n Speaker 1:And that tumble's enough to knock the sense out of a full grown man. I could not think of allowing any of my chargers to take so terrible a risk at.No, I am the lighter of the two, urged Tad. \n Speaker 0:Nothing of the marvellous could astonish him, as that a beast should speak or the sun stand still.Who may condemn his superstition?Here is the supreme mystery that is the essence of worship, without which there can be no religion, and in the presence of this mystery our attitude cannot be very unlike that of the natural philosopher, who beholds with awe the divine in all creation. \n Speaker 1:I am the one to go after Walt, if anyone has to. I'll go down, Mister Thomas. Master Ted is right, decided the guide, gazing at the two boys approvingly. I protest, shouted the professor.", "awq_chunks": [ " \n Speaker 0:This is the material or physical prayer.", " \n Speaker 1:And that tumble's enough to knock the sense out of a full grown ", "man. I could not think of allowing any of my ", "chargers to take so terrible a risk at.", "No, I am the lighter of the two, urged Tad.", " \n Speaker 0:Nothing of the marvellous could astonish him, as ", "that a beast should speak or the sun stand still.", "Who may condemn his superstition?", "Here is the supreme mystery that is the essence of ", "worship, without which there can be no religion, and in the ", "presence of this mystery our attitude cannot be very unlike that ", "of the natural philosopher, who beholds with awe ", "the divine in all creation. \n Speaker 1:I am ", "the one to go after Walt, if anyone has to. I'll ", "go down, Mister Thomas. Master Ted is ", "right, decided the guide, gazing at the two boys ", "approvingly. I protest, shouted the ", "professor." ], "generation_seconds": 6.092253684997559, "c_awq": "This is the material or physical prayer. And that tumble's enough to knock the sense out of a full grown man. I could not think of allowing any of my chargers to take so terrible a risk at.No, I am the lighter of the two, urged Tad. Nothing of the marvellous could astonish him, as that a beast should speak or the sun stand still.Who may condemn his superstition?Here is the supreme mystery that is the essence of worship, without which there can be no religion, and in the presence of this mystery our attitude cannot be very unlike that of the natural philosopher, who beholds with awe the divine in all creation. I am the one to go after Walt, if anyone has to. I'll go down, Mister Thomas. Master Ted is right, decided the guide, gazing at the two boys approvingly. I protest, shouted the professor.", "c_bf16": "This is the material or physical prayer. And that tumbles enough to knock the sense out of a full grown man. I could not think of allowing any of my chargers to take so terrible a risk at no. I am the lighter of the two urged had. Nothing of the marvellous could astonish him, as that a beast should speak or the sun stand still. Who may condemn his superstition? Here is the supreme mystery. That is the essence of worship, without which there can be no religion. And in the presence of this mystery, our attitude cannot be very unlike that of the natural philosopher who beholds with awe the divine in all creation. I am the one to go after Walt, if anyone has to. I'll go down, Mister Thomas. Master Ted is right, decided the guide, gazing at the two boys approvingly. I protest, shouted the professor." }, { "wav": "/mnt/ssd0/vv3/awq-stream/data/eval/eval-009.wav", "reference": "GRUB PI LE GRUB PI LE WHO IS THE WRANGLER THIS MORNING ASKED THE FOREMAN GLANCING ABOUT AT HIS MEN A WRANGLER'S A WRANGLER ANSWERED BIG FOOT STOLIDLY HE'S A FELLOW WHO'S ALL THE TIME MAKING TROUBLE ISN'T HE ASKED STACY INNOCENTLY OH NO THIS KIND OF A WRANGLER ISN'T LAUGHED THE FOREMAN HE'S A TROUBLE CURER NOT A TROUBLEMAKER EXCEPT FOR HIMSELF PONG TELL THE YOUNG GENTLEMEN WHAT WOULD BECOME OF YOU IF YOU WERE TO SERVE BAD MEALS TO THIS OUTFIT OF COWPUNCHERS HOW ASKED TAD WE HAD BETTER START THE DRIVE THIS MORNING", "baseline": " \n Speaker 0:Grip pile, grip pile. \n Speaker 0:Who is the wrangler of this morning? asked the foreman, glancing about at his men. A wrangler is a wrangler, answered Bigfoot stottily.He's a fellow who's all the time making trouble, isn't he? asked Stacy innocently. Oh, no, this kind of a wrangler isn't, laughed the foreman. He's a trouble cure, not a trouble maker, except for himself. Pong, tell the young gentlemen what would become of you if you were to serve bad meals to this outfit of cowpunchers. \n Speaker 0:How? asked Ted. We had better start the drive this morning.", "awq": " \n Speaker 0:Grip pile, grip pile. \n Speaker 0:Who is the wrangler of this morning? asked the foreman, glancing about at his men. A wrangler is a wrangler, answered Bigfoot stottily.He's a fellow who's all the time making trouble, isn't he? asked Stacy innocently. Oh, no, this kind of a wrangler isn't, laughed the foreman. He's a troubled cure, not a troublemaker, except for himself. Pong, tell the young gentlemen what would become of you if you were to serve bad meals to this outfit of cowpunchers. \n Speaker 0:How? asked Ted. We had better start the drive this morning.", "awq_chunks": [ " \n Speaker 0:Grip pile, grip pile.", " \n Speaker 0:Who is the wrangler of this morning? asked the ", "foreman, glancing about at his men. A ", "wrangler is a wrangler, answered Bigfoot stottily.", "He's a fellow who's all the time making trouble, isn't ", "he? asked Stacy innocently. Oh, ", "no, this kind of a wrangler isn't, laughed the foreman. ", "He's a troubled cure, not a troublemaker, ", "except for himself. Pong, tell the young ", "gentlemen what would become of you if you were to serve bad meals ", "to this outfit of cowpunchers.", " \n Speaker 0:How? asked Ted. We had better start the ", "drive this morning." ], "generation_seconds": 4.5349719524383545, "c_awq": "Grip pile, grip pile. Who is the wrangler of this morning? asked the foreman, glancing about at his men. A wrangler is a wrangler, answered Bigfoot stottily.He's a fellow who's all the time making trouble, isn't he? asked Stacy innocently. Oh, no, this kind of a wrangler isn't, laughed the foreman. He's a troubled cure, not a troublemaker, except for himself. Pong, tell the young gentlemen what would become of you if you were to serve bad meals to this outfit of cowpunchers. How? asked Ted. We had better start the drive this morning.", "c_bf16": "Grip pile, grip pile. Who is the wrangler of this morning? asked the foreman, glancing about at his men. A wrangler is a wrangler, answered Bigfoot stottily. He's a fellow who's all the time making trouble, isn't he? asked Stacy innocently. Oh, no, this kind of a wrangler isn't, laughed the foreman. He's a trouble cure, not a trouble maker, except for himself. Pong, tell the young gentleman what would become of you if you were to serve bad meals to this outfit of cowpunchers. How? asked Ted. We had better start the drive this morning." }, { "wav": "/mnt/ssd0/vv3/awq-stream/data/eval/eval-010.wav", "reference": "THE ENCLOSURE HAD FORMERLY BEEN VERY EXTENSIVE BUT WAS NOW CONTRACTED WITHIN SMALL COMPASS AND HEMMED ABOUT PARTLY BY HIGH WOODEN FENCES AND PARTLY BY THE OUTBUILDINGS OF HOUSES THAT STOOD ON ANOTHER STREET THE WHITE DOUBLE ROSEBUSH HAD EVIDENTLY BEEN PROPPED UP ANEW AGAINST THE HOUSE SINCE THE COMMENCEMENT OF THE SEASON AND A PEAR TREE AND THREE DAMSON TREES WHICH EXCEPT A ROW OF CURRANT BUSHES CONSTITUTED THE ONLY VARIETIES OF FRUIT BORE MARKS OF THE RECENT AMPUTATION OF SEVERAL SUPERFLUOUS OR DEFECTIVE LIMBS THERE WERE ALSO A FEW SPECIES OF ANTIQUE AND HEREDITARY FLOWERS IN NO VERY FLOURISHING CONDITION BUT SCRUPULOUSLY WEEDED AS IF SOME PERSON EITHER OUT OF LOVE OR CURIOSITY HAD BEEN ANXIOUS TO BRING THEM TO SUCH PERFECTION AS THEY WERE CAPABLE OF ATTAINING SUMMER SQUASHES ALMOST IN THEIR GOLDEN BLOSSOM CUCUMBERS NOW EVINCING A TENDENCY TO SPREAD AWAY FROM THE MAIN STOCK AND RAMBLE FAR AND WIDE TWO OR THREE ROWS OF STRING BEANS AND AS MANY MORE THAT WERE ABOUT TO FESTOON THEMSELVES ON POLES TOMATOES OCCUPYING A SITE SO SHELTERED AND SUNNY THAT THE PLANTS WERE ALREADY GIGANTIC AND PROMISED AN EARLY AND ABUNDANT HARVEST", "baseline": " \n Speaker 0:The enclosure had formerly been very extensive, but was now contracted within small compass and hemmed about partly by high wooden fences and partly by the outbuildings of houses that stood on another street.The white double rose bush had evidently been propped up anew against the house since the commencement of the season, and the pear tree and three damson trees, which except a row of currant bushes, constituted the only varieties of fruit for marks of the recent amputation of several superfluous or defective limbs. \n Speaker 0:There were also a few species of antique and hereditary flowers, and no very flourishing condition.But scrupulously weeded, as if some person, either out of love or curiosity, had been anxious to bring them to such perfection as they were capable of attaining. Summer squashes, almost in their golden blossom, cucumbers, now evincing a tendency to spread away from the main stock and ramble far and wide. \n Speaker 0:Two or three rows of string beans, and as many more that were about to festoon themselves on poles. Tomatoes occupying a site so sheltered and sunny that the plants were already gigantic and promised an early and abundant harvest.", "awq": " \n Speaker 0:The enclosure had formerly been very extensive, but was now contracted within small compass and hemmed about partly by high wooden fences and partly by the outbuildings of houses that stood on another street. The white double rose bush had evidently been propped up anew against the house since the commencement of the season, and the pear tree and three damson trees, which except a row of currant bushes, constituted the only varieties of fruit for marks of the recent amputation of several superfluous or defective limbs. \n Speaker 0:There were also a few species of antique and hereditary flowers, and no very flourishing condition. But scrupulously weeded, as if some person, either out of love or curiosity, had been anxious to bring them to such perfection as they were capable of attaining. Summer squashes, almost in their golden blossom, cucumbers, now evincing a tendency to spread away from the main stock and ramble far and wide. Two or three rows of string beans, and as many more that were about to festoon themselves on poles. \n Speaker 0:Tomatoes occupying a site so sheltered and sunny that the plants were already gigantic and promised an early and abundant harvest.", "awq_chunks": [ " \n Speaker 0:The enclosure had formerly been very extensive, but ", "was now contracted within small compass and hemmed ", "about partly by high wooden fences and partly ", "by the outbuildings of houses that stood on another street. ", "The white double rose bush had ", "evidently been propped up anew against the house since the ", "commencement of the season, and the pear tree and ", "three damson trees, which except a row of currant ", "bushes, constituted the only varieties of ", "fruit for marks of the recent amputation ", "of several superfluous or defective limbs.", " \n Speaker 0:There were also a few species of antique and ", "hereditary flowers, and no very flourishing condition. ", "But scrupulously weeded, as if some ", "person, either out of love or curiosity, ", "had been anxious to bring them to such perfection as they were ", "capable of attaining. Summer ", "squashes, almost in their golden blossom, cucumbers, ", "now evincing a tendency to spread away from the main ", "stock and ramble far and wide. Two or three ", "rows of string beans, and as many more that were about to ", "festoon themselves on poles. \n Speaker 0:Tomatoes ", "occupying a site so sheltered and sunny that the plants were ", "already gigantic and promised an early and abundant ", "harvest." ], "generation_seconds": 8.07678771018982, "c_awq": "The enclosure had formerly been very extensive, but was now contracted within small compass and hemmed about partly by high wooden fences and partly by the outbuildings of houses that stood on another street.The white double rose bush had evidently been propped up anew against the house since the commencement of the season, and the pear tree and three damson trees, which except a row of currant bushes, constituted the only varieties of fruit for marks of the recent amputation of several superfluous or defective limbs. There were also a few species of antique and hereditary flowers, and no very flourishing condition.But scrupulously weeded, as if some person, either out of love or curiosity, had been anxious to bring them to such perfection as they were capable of attaining. Summer squashes, almost in their golden blossom, cucumbers, now evincing a tendency to spread away from the main stock and ramble far and wide. Two or three rows of string beans, and as many more that were about to festoon themselves on poles. Tomatoes occupying a site so sheltered and sunny that the plants were already gigantic and promised an early and abundant harvest.", "c_bf16": "The enclosure had formerly been very extensive, but was now contracted within small compass and hemmed about partly by high wooden fences and partly by the outbuildings of houses that stood on another street.The white double rose bush had evidently been propped up anew against the house since the commencement of the season. And the pear tree and three damson trees, which except a row of currant bushes, constituted the only varieties of fruit for marks of the recent amputation of several superfluous or defective limbs. There were also a few species of antique and hereditary flowers, and no very flourishing condition.But scrupulously weeded, as if some person, either out of love or curiosity, had been anxious to bring them to such perfection as they were capable of attaining. Summer squashes, almost in their golden blossom, cucumbers, now evincing a tendency to spread away from the main stock and ramble far and wide. Two or three rows of string beans, and as many more that were about to festoon themselves on poles. Tomatoes occupying a site so sheltered and sunny that the plants were already gigantic and promised an early and abundant harvest." }, { "wav": "/mnt/ssd0/vv3/awq-stream/data/eval/eval-011.wav", "reference": "THE HOUSE WHICH SEEMED TO CONSIST OF TWO OR THREE HIGH NARROW AND STEEP ROOFED BUILDINGS PROJECTING FROM EACH OTHER AT RIGHT ANGLES FORMED ONE SIDE OF THE INCLOSURE IT HAD BEEN BUILT AT A PERIOD WHEN CASTLES WERE NO LONGER NECESSARY AND WHEN THE SCOTTISH ARCHITECTS HAD NOT YET ACQUIRED THE ART OF DESIGNING A DOMESTIC RESIDENCE NEITHER DID THE FRONT INDICATE ABSOLUTE SECURITY FROM DANGER PASS THE CHARM OUT TO ME THEN SAID THE ROBBER WHEN SHE RETURNED HIS HAND WAS STICKING THROUGH THE HOLE IN THE DOOR THE CRIES AND CURSES OF THE ROBBERS FILLED THE AIR THEY TRIED IN VAIN TO BREAK DOWN THE GREAT DOORS ALL MY WORRIES ABOUT YOU WERE FOOLISH", "baseline": " \n Speaker 0:The house, which seemed to consist of two or three high, narrow, and steep-roofed buildings, projecting from each other at right angles, formed one side of the enclosure. It had been built at a period when castles were no longer necessary, and when the Scottish architects had not yet acquired the art of designing a domestic residence.Neither did the front indicate absolute security from danger. \n Speaker 1:Pass the charm out to me then, said the robber. When she returned, his hand was sticking through the hole in the door.The cries and curses of the robbers filled the air. They tried in vain to break down the great doors. All my worries about you were foolish.", "awq": " \n Speaker 0:The house, which seemed to consist of two or three high, narrow, and steep roofed buildings, projecting from each other at right angles, formed one side of the enclosure. It had been built at a period when castles were no longer necessary, and when the Scottish architects had not yet acquired the art of designing a domestic residence.Neither did the front indicate absolute security from danger. \n Speaker 1:Pass the charm out to me then, said the robber, when she returned his hand was sticking through the hole in the door.The cries and curses of the robbers filled the air. They tried in vain to break down the great doors. All my worries about you were foolish.", "awq_chunks": [ " \n Speaker 0:The house, which seemed to consist of two or three ", "high, narrow, and steep roofed buildings, ", "projecting from each other at right angles, formed one side of ", "the enclosure. It had been built at a ", "period when castles were no longer necessary, and when the ", "Scottish architects had not yet acquired the art ", "of designing a domestic residence.", "Neither did the front indicate absolute security ", "from danger. \n Speaker 1:Pass the charm out to me ", "then, said the robber, when she ", "returned his hand was sticking through the hole in the door.", "The cries and curses of the robbers ", "filled the air. They tried in vain to break ", "down the great doors. All my worries about ", "you were foolish." ], "generation_seconds": 4.500569105148315, "c_awq": "The house, which seemed to consist of two or three high, narrow, and steep roofed buildings, projecting from each other at right angles, formed one side of the enclosure. It had been built at a period when castles were no longer necessary, and when the Scottish architects had not yet acquired the art of designing a domestic residence.Neither did the front indicate absolute security from danger. Pass the charm out to me then, said the robber, when she returned his hand was sticking through the hole in the door.The cries and curses of the robbers filled the air. They tried in vain to break down the great doors. All my worries about you were foolish.", "c_bf16": "The house, which seemed to consist of two or three high, narrow, and steep-roofed buildings, projecting from each other at right angles, formed one side of the enclosure. It had been built at a period when castles were no longer necessary, and when the Scottish architects had not yet acquired the art of designing a domestic residence.Neither did the front indicate absolute security from danger. Pass the charm out to me then, said the robber. When she returned, his hand was sticking through the hole in the door.The cries and curses of the robbers filled the air. They tried in vain to break down the great doors. All my worries about you were foolish." } ], "vibevoice_c_bench_rtx3090": [ { "audio": "jfk.wav", "weights": "awq", "attn": "flashinfer", "text": "And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country.", "rtf": 0.035, "decode_tok_s": 152.1, "prefill_tok_s": 927.0, "lm_layers_mb": 3306.0, "load_ms": 4222.0 }, { "audio": "jfk.wav", "weights": "awq", "attn": "fa2", "text": "And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country.", "rtf": 0.035, "decode_tok_s": 152.2, "prefill_tok_s": 922.0, "lm_layers_mb": 3306.0, "load_ms": 4315.0 }, { "audio": "jfk.wav", "weights": "bf16", "attn": "auto", "text": "And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country.", "rtf": 0.071, "decode_tok_s": 56.4, "prefill_tok_s": 844.0, "lm_layers_mb": 12446.0, "load_ms": 1950.0 }, { "audio": "test30.wav", "weights": "awq", "attn": "flashinfer", "text": "And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. He hoped there would be stew for dinner, turnips and carrots and bruised potatoes and fat mutton pieces to be ladled out in thick peppered flour fattened sauce. And so, my fellow Americans, ask not what your country can do for you.", "rtf": 0.036, "decode_tok_s": 151.3, "prefill_tok_s": 934.0, "lm_layers_mb": 3306.0, "load_ms": 4349.0 }, { "audio": "test30.wav", "weights": "awq", "attn": "fa2", "text": "And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. He hoped there would be stew for dinner, turnips and carrots and bruised potatoes and fat mutton pieces to be ladled out in thick peppered flour fattened sauce. And so, my fellow Americans, ask not what your country can do for you.", "rtf": 0.036, "decode_tok_s": 149.5, "prefill_tok_s": 936.0, "lm_layers_mb": 3306.0, "load_ms": 4371.0 }, { "audio": "test30.wav", "weights": "bf16", "attn": "auto", "text": "And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. He hoped there would be stew for dinner, turnips and carrots and bruised potatoes and fat mutton pieces to be ladled out in thick peppered flour fattened sauce. And so, my fellow Americans, ask not what your country can do for you.", "rtf": 0.076, "decode_tok_s": 56.1, "prefill_tok_s": 856.0, "lm_layers_mb": 12446.0, "load_ms": 1918.0 }, { "audio": "test120.wav", "weights": "awq", "attn": "flashinfer", "text": "And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. He hoped there would be stew for dinner, turnips and carrots and bruised potatoes and fat mutton pieces to be ladled out in thick peppered flour fattened sauce. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. He hoped there would be stew for dinner, turnips and carrots and bruised potatoes and fat mutton pieces to be ladled out in thick peppered flour fattened sauce. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. He hoped there would be stew for dinner, turnips and carrots and bruised potatoes and fat mutton pieces to be ladled out in thick peppered flour fattened sauce. And so, my fellow Americans, ask not what your country can do for you,ask what you can do for your country. He hoped there would be stew for dinner, turnips and carrots and bruised potatoes and fat mutton pieces to be ladled out in thick peppered flour fattened sauce. And so, my fellow Americans, ask not what your country can do for you,ask what you can do for your country. He hoped there would be stew for dinner, turnips and carrots and bruised potatoes and fat mutton pieces to be ladled out in thick peppered flour fattened sauce. And so, my fellow Americans, ask not what your.", "rtf": 0.034, "decode_tok_s": 149.2, "prefill_tok_s": 959.0, "lm_layers_mb": 3306.0, "load_ms": 4305.0 }, { "audio": "test120.wav", "weights": "awq", "attn": "fa2", "text": "And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. He hoped there would be stew for dinner, turnips and carrots and bruised potatoes and fat mutton pieces to be ladled out in thick peppered flour fattened sauce. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. He hoped there would be stew for dinner, turnips and carrots and bruised potatoes and fat mutton pieces to be ladled out in thick peppered flour fattened sauce. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. He hoped there would be stew for dinner, turnips and carrots and bruised potatoes and fat mutton pieces to be ladled out in thick peppered flour fattened sauce. And so, my fellow Americans, ask not what your country can do for you,ask what you can do for your country. He hoped there would be stew for dinner, turnips and carrots and bruised potatoes and fat mutton pieces to be ladled out in thick peppered flour fattened sauce. And so, my fellow Americans, ask not what your country can do for you,ask what you can do for your country. He hoped there would be stew for dinner, turnips and carrots and bruised potatoes and fat mutton pieces to be ladled out in thick peppered flour fattened sauce. And so, my fellow Americans, ask not what your.", "rtf": 0.035, "decode_tok_s": 142.8, "prefill_tok_s": 951.0, "lm_layers_mb": 3306.0, "load_ms": 4313.0 }, { "audio": "test120.wav", "weights": "bf16", "attn": "auto", "text": "And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. He hoped there would be stew for dinner, turnips and carrots and bruised potatoes and fat mutton pieces to be ladled out in thick peppered flour fattened sauce. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. He hoped there would be stew for dinner, turnips and carrots and bruised potatoes and fat mutton pieces to be ladled out in thick peppered flour fattened sauce. And so, my fellow Americans, ask not what your country can do for you, ask what you can do for your country. He hoped there would be stew for dinner, turnips and carrots and bruised potatoes and fat mutton pieces to be ladled out in thick peppered flour fattened sauce. And so, my fellow Americans, ask not what your country can do for you,ask what you can do for your country. He hoped there would be stew for dinner, turnips and carrots and bruised potatoes and fat mutton pieces to be ladled out in thick peppered flour fattened sauce. And so, my fellow Americans, ask not what your country can do for you,ask what you can do for your country. He hoped there would be stew for dinner, turnips and carrots and bruised potatoes and fat mutton pieces to be ladled out in thick peppered flour fattened sauce. And so, my fellow Americans, ask not what your.", "rtf": 0.074, "decode_tok_s": 55.9, "prefill_tok_s": 871.0, "lm_layers_mb": 12446.0, "load_ms": 1826.0 } ], "evaluation_scope": "English read speech (LibriSpeech), one- and two-speaker streams. Not a multilingual, noisy-audio or diarization benchmark." }