Prompt:
Please determine the type of the question below. Here are some examples of questions.

Question: What was the first video ever made ?
Type: Invention, book and other creative piece
Question: What people make up half the Soviet Union 's population ?
Type: Group or organization of person
Question: How can you become an FBI agent ?
Type: Manner of an action
Question: Who was the mother of the man who would not be king , the duke of Windsor ?
Type: Individual
Question: What two countries in South America are landlocked ?
Type: Country
Question: Where is your corpus callosum ?
Type: Other location
Question: Who died with more than 1 , 000 U.S. patents to his credit ?
Type: Individual
Question: What age is Benny Carter ?
Type: Lasting time of somethin
Question: What is `` flintknapping '' ?
Type: Definition of something
Question: What city 's theatrical district has been dubbed The Roaring Forties ?
Type: City
Question: What does the `` blue ribbon '' stand for ?
Type: Expression abbreviated
Question: How much of the silver production is manufactured by independent silversmiths ?
Type: Number of something
Question: What is a specimen of basidiomycetes ?
Type: Definition of something
Question: What are the dimensions of an ice hockey goal ?
Type: Distance, linear measure
Question: Where is South Bend ?
Type: Other location
Question: What are the chances of pregnacy if the penis does not penetrate the vagina ?
Type: Percent, fraction
Question: Who provides telephone service in Orange County , California ?
Type: Group or organization of person
Question: Define Spumante .
Type: Definition of something
Question: When was the women 's suffrage amendment ratified ?
Type: Date
Question: What did the forward-thinking Simon Brothers Bakery of Chicago insert into bagels to boost business ?
Type: Other entity
Question: Why are there olives in martinis ?
Type: Reason
Question: Which soft drink does Madonna advertise for ?
Type: Food
Question: What is the most commonly used 1 letter word in the English language ?
Type: Word with a special property
Question: What ocean was Amelia Earhart flying over when she disappeared ?
Type: Other location
Question: In which sport is there a `` scrum '' ?
Type: Sport
Question: How many innings are there in a regulation softball game ?
Type: Number of something
Question: What does the word LASER mean ?
Type: Expression abbreviated
Question: What are some mythology websites ?
Type: Other location
Question: What is the frequency of VHF ?
Type: Other number
Question: What is the difference between molecules and compounds ?
Type: Description of something
Question: What is e-commerce ?
Type: Definition of something
Question: What 1942 espionage movie reunited director John Huston with Maltese Falconers Humphrey Bogart , Mary Astor , and Sidney Greenstreet ?
Type: Invention, book and other creative piece
Question: How many warmup pitches does a reliever get coming into a baseball game ?
Type: Number of something
Question: How far can a human eye see ?
Type: Distance, linear measure
Question: Whose autobiography is titled Yes I Can ?
Type: Individual
Question: Name of heroine in `` Scruples '' ?
Type: Individual
Question: Why does it snow ?
Type: Reason
Question: What Japanese electronics company was named for a coastal city northeast of Tokyo ?
Type: Group or organization of person
Question: What year were the Olympic Games played in where Nadia Comaneci became popular ?
Type: Date
Question: Where is Amsterdam ?
Type: Other location
Question: What two US biochemists won the Nobel Prize in medicine in 1992 ?
Type: Individual
Question: What do Englishmen weigh themselves in ?
Type: Weight
Question: What impenetrable system of French fortifications was built along the German frontier before World War II ?
Type: Other entity
Question: What 's the maximum length , in inches , of a first baseman 's glove ?
Type: Number of something
Question: What state produces the best lobster to eat ?
Type: State
Question: Stuart Hamblen is considered to be the first singing cowboy of what ?
Type: Invention, book and other creative piece
Question: What does a pedometer measure ?
Type: Other entity
Question: What was the name of the director of the movie `` Jaws '' ?
Type: Individual
Question: Name the first Russian astronaut to do a spacewalk .
Type: Individual
Question: Which Bloom County resident wreaks havoc with a computer ?
Type: Individual
Question: How long did Shea and Gould practice law in Los Angeles ?
Type: Lasting time of somethin
Question: How tall is Prince Charles ?
Type: Distance, linear measure
Question: What country has the highest per capita consumption of cheese ?
Type: Country
Question: What are the highest-paying odds on a roulette table ?
Type: Percent, fraction
Question: What lake is Sheboygan on ?
Type: Other location
Question: Where is the Danube ?
Type: Other location
Question: What fast-food magnate 's initials graced the left sleeve of the San Diego Padres ' baseball uniforms in 1984 ?
Type: Group or organization of person
Question: Hazmat stands for what ?
Type: Definition of something
Question: What plant is rum made from ?
Type: Plant
Question: Where did Bill Gates go to college ?
Type: Other location
Question: What city is sometimes called Gotham ?
Type: City
Question: On average , how many miles are there to the moon ?
Type: Number of something
Question: What are the odds of giving birth to twins ?
Type: Percent, fraction
Question: How do you tell somebody you like them ?
Type: Manner of an action
Question: What countries have the most auto thefts ?
Type: Country
Question: How much did Manchester United spend on players in 1993 ?
Type: Price
Question: What TV station did Mary Richards work for ?
Type: Invention, book and other creative piece
Question: What Morris West novel deals with Russian bishop who becomes Pope ?
Type: Invention, book and other creative piece
Question: What is a reliable site that I can download Heretic 2 ?
Type: Other location
Question: What film or films has Jude Law appeared in ?
Type: Invention, book and other creative piece
Question: What day was Pearl Harbor attacked in 1942 ?
Type: Date
Question: Where is Natchitoches , Louisiana ?
Type: Other location
Question: What task does the Bouvier breed of dog perform ?
Type: Title of a person
Question: What revelation did Alexander Butterfield make to the Senate Watergate committee ?
Type: Description of something
Question: How many pairs of legs does a lobster have ?
Type: Number of something
Question: What color , s , appear on boxes of Kodak film ?
Type: Color
Question: How many people died on D-Day ?
Type: Number of something
Question: What is an annotated bibliography ?
Type: Definition of something
Question: What is a caldera ?
Type: Definition of something
Question: Where is the largest dam in the world ?
Type: Other location
Question: What was Mae West 's last film ?
Type: Invention, book and other creative piece
Question: Who is the sexiest women in the world ?
Type: Individual
Question: What kind of rocket launched the Surveyor spacecraft ?
Type: Vehicle
Question: What causes an earthquake ?
Type: Reason
Question: How many feet long is a baseball pitcher 's rubber ?
Type: Number of something
Question: What dummy received an honorary degree from Northwestern University ?
Type: Individual
Question: Who is section manager for guidance and control systems at JPL ?
Type: Individual
Question: What creative genius said : `` Everything comes to him who hustles while he waits '' ?
Type: Individual
Question: Who is the owner of CNN ?
Type: Individual
Question: What suburban housewife and mother of three wrote The Feminine Mystique ?
Type: Individual
Question: What city is . KDGE Radio located in ?
Type: City
Question: What is Nebraska 's most valuable resource ?
Type: Other entity
Question: Where is the human skin least sensitive ?
Type: Organ of body
Question: What is the abbreviated form of the National Bureau of Investigation ?
Type: Abbreviation
Question: What was the highest mountain on earth before Mount Everest was discovered ?
Type: Mountain
Question: What month were you born in if your birthstone is sardonyx ?
Type: Date
Question: What blew up at Lakehurst , New Jersey , on May 6 , 1977 ?
Type: Other entity
Question: How many miles is it from London , England to Plymouth , England ?
Type: Number of something
Question: What is Larry King 's occupation ?
Type: Title of a person
Question: How can I find out my biorhythm ?
Type: Manner of an action
Question: What developed a crack in 1835 while tolling the death of U.S. Chief Justice John Marshall ?
Type: Other entity
Question: How is plastic made ?
Type: Manner of an action
Question: What Pope inaugurated Vatican International Radio ?
Type: Individual
Question: What feud ended with a marriage in Kentucky on March 21 , 1891 ?
Type: Event
Question: What does Ouija mean ?
Type: Definition of something
Question: What was the name of Randy Craft 's lawyer ?
Type: Individual
Question: Who is Samuel F. Pickering ?
Type: Description of a person
Question: What 's the middle name of movie producer Joseph E. Levine ?
Type: Individual
Question: Who was nicknamed The Little Corporal ?
Type: Individual
Question: Who was Thucydides ?
Type: Description of a person
Question: What is the name of the police officer who tried to keep order in Top Cat 's neighborhood ?
Type: Individual
Question: What chocolate bar created by Frank Mars and his wife is often called a Milky Way with peanuts ?
Type: Food
Question: What is the alphabet for Latin ?
Type: Letter like a-z
Question: How do I impress a guy ?
Type: Manner of an action
Question: Where is the Orange Bowl ?
Type: Other location
Question: What did John F. Kennedy consider his greatest blunder in office ?
Type: Description of something
Question: What is LMDS ?
Type: Expression abbreviated
Question: What are amaretto biscuits ?
Type: Definition of something
Question: What are Bellworts ?
Type: Definition of something
Question: What European country 's monarchy was restored in 1975 ?
Type: Country
Question: What causes the redness in your cheeks when you blush ?
Type: Reason
Question: Where did surfing originate ?
Type: Other location
Question: Which team won the Super Bowl in 1968 ?
Type: Group or organization of person
Question: What Batman character tools around on a Batcycle ?
Type: Individual
Question: What camera company said , `` If you haven 't got the time , we 've got the camera ? ''
Type: Group or organization of person
Question: What are the requirements for becoming a citizen of Australia ?
Type: Description of something
Question: Name a novel written by John Steinbeck .
Type: Invention, book and other creative piece
Question: Who was the first jockey to ride two Triple Crown winners ?
Type: Individual
Question: Who played the title role in The Romantic Englishwoman ?
Type: Individual
Question: What London museum features a Chamber of Horrors ?
Type: Other location
Question: Which presidents of the USA were Masons ?
Type: Individual
Question: Who 's the lead singer of the Led Zeppelin band ?
Type: Individual
Question: Who owns the St. Louis Rams ?
Type: Individual
Question: What organization was founded by the Rev. Jerry Falwell ?
Type: Group or organization of person
Question: What color is the stripe along each side of a Coho salmon ?
Type: Color
Question: What singer became despondent over the death of Freddie Prinze , quit show business , and then quit the business ?
Type: Individual
Question: Who was the first American poet to win the Nobel Prize for literature , in 1948 ?
Type: Individual
Question: What does SIDS stand for ?
Type: Expression abbreviated
Question: What 's the most abundant element in the sun ?
Type: Element and substance
Question: What state was named the Green Mountain state ?
Type: State
Question: Who started the Dominos Pizza chain ?
Type: Individual
Question: What is the name of the city that Maurizio Pellegrin lives in ?
Type: City
Question: Whose biography by Maurice Zolotow is titled Shooting Star ?
Type: Individual
Question: What was the favorite sport of Tom Wolfe 's The Pump House Gang ?
Type: Sport
Question: Where did Wile E. Coyote always get his devices ?
Type: Other location
Question: What brand of white rum is still made in Cuba ?
Type: Product
Question: For what reason did some San Diego schools stop serving apples ?
Type: Reason
Question: How many Stradivarius violins were ever made ?
Type: Number of something
Question: How do they get Teflon to stick to the pan ?
Type: Manner of an action
Question: How long do flies live ?
Type: Lasting time of somethin
Question: How many people died when the Estonia sank in 1994 ?
Type: Number of something
Question: What year did Apartheid start ?
Type: Date
Question: What is the regular price ?
Type: Price
Question: How many months does a normal human pregnancy last ?
Type: Number of something
Question: What kind of organization is ` Last Chance for Animals ' ?
Type: Group or organization of person
Question: What country boasts the southernmost point in continental Europe ?
Type: Country
Question: Name a golf course in Myrtle Beach .
Type: Other entity
Question: Where did the myth of Santa Claus originate ?
Type: Other location
Question: What is a fear of weakness ?
Type: Disease and medicine
Question: Name a canine cartoon character other than Huckleberry Hound to have a voice by Daws Butler .
Type: Individual
Question: What country has the most time zones , with 11 ?
Type: Country
Question: What did Mr. Magoo flog on TV for General Electric ?
Type: Other entity
Question: What species was Winnie the Pooh ?
Type: Animal
Question: Why are electric cars less efficient in the northeast than in California ?
Type: Reason
Question: What is the belt of low pressure around the equator called ?
Type: Equivalent term
Question: What does CNN stand for ?
Type: Expression abbreviated
Question: Where can I read about Chiang Kai-shek ?
Type: Other location
Question: What is Bombay duck ?
Type: Definition of something
Question: Whose video is titled Shape Up with Arnold ?
Type: Individual
Question: What are my legal rights in an automobile repossession in California ?
Type: Description of something
Question: How long does James Bond like his eggs boiled ?
Type: Lasting time of somethin
Question: What was John F. Kennedy 's 1960 campaign song ?
Type: Invention, book and other creative piece
Question: What country covers 8 , 600 , 387 square miles ?
Type: Country
Question: Where was the first zoo in the U.S. ?
Type: Other location
Question: The operating system that runs on IBM-compatible machines is called what ?
Type: Equivalent term
Question: What do Hasidic Jews refrain from while dating ?
Type: Other entity
Question: In 139 the papal court was forced to move from Rome to where ?
Type: Other location
Question: Who said `` What contemptible scoundrel stole the cork from my lunch ? ''
Type: Individual
Question: What country is the worlds leading supplier of cannabis ?
Type: Country
Question: What did Cool Hand Luke go to jail for ?
Type: Reason
Question: Who were the Yankee 's frequent enemies ?
Type: Group or organization of person
Question: Who tramped through Florida looking for the Fountain of Youth ?
Type: Individual
Question: What woman has carried the most multiple births , twins , triplets , etc. , ?
Type: Individual
Question: How many miles of corridors are in The Pentagon ?
Type: Number of something
Question: What is Candlemas Day ?
Type: Definition of something
Question: What was the Ventura County police department that seized the county 's largest amount of cocaine ever ?
Type: Group or organization of person
Question: Who portrayed Maggio in the film From Here to Eternity ?
Type: Individual
Question: When are sheep shorn ?
Type: Date
Question: Whose acceptance speech of more than 3 minutes prompted a time limit on Academy Award thank-yous ?
Type: Individual
Question: What is Mississippi 's state animal ?
Type: Animal
Question: How can SQL queries be improved ?
Type: Manner of an action
Question: What actor 's autobiography is titled All My Yesterdays ?
Type: Individual
Question: What is the most widely cultivated plant ?
Type: Plant
Question: What actor has a tattoo on his right wrist reading Scotland Forever ?
Type: Individual
Question: Where does Ray Bradbury 's Chronicles take place ?
Type: Other location
Question: What is false consciousness ?
Type: Definition of something
Question: What is the length of border between the Ukraine and Russia ?
Type: Distance, linear measure
Question: What does Melissa mean ?
Type: Definition of something
Question: What animal 's tail is called a brush ?
Type: Animal
Question: In what year did the US Marine Corps adopt the motto `` Semper Fidelis '' ?
Type: Date
Question: How many species of the Great White shark are there ?
Type: Number of something
Question: What are snowballs to a hot-rodder ?
Type: Definition of something
Question: What does Salk vaccine prevent ?
Type: Disease and medicine
Question: Who used AuH2O as an election slogan ?
Type: Individual
Question: Where is Romania located ?
Type: Other location
Question: What was the education system in the 1960 's ?
Type: Other entity
Question: Who was the first actress to appear on a postage stamp ?
Type: Individual
Question: Who turned all he touched to gold ?
Type: Individual
Question: What is the largest city in Connecticut ?
Type: City
Question: What state is the Filenes store located in ?
Type: State
Question: Where are the apartments in Saint John , New Brunswick ?
Type: Other location
Question: What 's the last line of Dickens 's A Christmas Carol ?
Type: Description of something
Question: What is a mathematical factor ?
Type: Definition of something
Question: Where can I find correct tabs for Third Eye Blind songs ?
Type: Other location
Question: How do I find if my relatives were on the Trail of Tears ?
Type: Manner of an action
Question: When was Christ born ?
Type: Date
Question: What 's the name of the temple that is located near the capital city of Laos ?
Type: Other location
Question: What was the name of the orca that died of a fungal infection ?
Type: Animal
Question: What 's another name for aspartame ?
Type: Equivalent term
Question: About how many soldiers died in World War II ?
Type: Number of something
Question: How is silk screening done ?
Type: Manner of an action
Question: Who was the tallest U.S. president ?
Type: Individual
Question: What first name was Nipsy Russell given at birth ?
Type: Individual
Question: What comedian created a punch-drunk pugilist named Cauliflower McPugg ?
Type: Individual
Question: What do the 12 days of Christmas mean ?
Type: Definition of something
Question: What does NAFTA stand for ?
Type: Expression abbreviated
Question: What are the short- and long-term effects of underage drinking ?
Type: Description of something
Question: How come a doughnut has a hole in it ?
Type: Reason
Question: What is the capital of Mongolia ?
Type:


Jim tracks Finn's package number 45678 which will be delivered to him tomorrow.

Prompt:
Summarize the dialogue into a few short sentences. The following are some examples.

Dialogue: Madeline: How are you doing guys? any news?
Harrison: I'm fine, but super busy at work these days
Robert: I'm ok! you?
Madeline: Not bad, when are we going to see each other again? I miss you guys!
Robert: and where?
Harrison: I live in Berlin now, Robert in Sevilla, are you at least still in Edinburgh?
Madeline: Yes, I think I'll never move from here, too settled
Harrison: Maybe we could meet in some warm place, like Malta?
Robert: or at my place in Spain?
Madeline: It can be a bit difficult for me with the kids. Do you hate Edinburgh so much?
Harrison: It's not about Edinburgh. I hate winter and rain. I want some SUN finally
Harrison: Can't you take Tom and kids to sevilla?
Madeline: Actually I could probably, the problem is that it's always difficult for Tom to give on holiday
Madeline: and I don't work right now, taking care of the kids
Harrison: I can't believe it. Such a feminist once, such a housewife now!
Madeline: I know 😅 but it's rather a coincidence
Robert: What do you mean?
Madeline: Tom was on paternity leave but then I lost the job, so it just happened
Madeline: and as a programmer he earns much better than I ever could
Robert: sure
Madeline: a separate question is how much there is structural inequality in all of this
Madeline: you see! We have to meet and talk, spend some time together. Free me from this housewife's prison
Robert: Talk to Tom first, then we will know what the situation is
Madeline: ok!
Summary: Harrison lives in Berlin now and he's been busy at work lately. Robert setlled in Sevilla and Madeline in Edinburgh. Madeline lost her job and she is a housewife now. She will talk to her husband, Tom, about going to Sevilla with kids to meet Robert and Harrison.
Dialogue: Hetty: do you know how I can get an app on the ipad from internet
Alfred: through the app store
Hetty: no I mean if you are already on a site
Alfred: what site?
Hetty: if you are on a website and you want to make it an app
Alfred: oh like a shortcut to a link
Hetty: yeah that
Alfred: when you are on the website there is a square with an arrow at the top
Hetty: hold on, just opening the website
Hetty: where is the square?
Alfred: In the top right somewhere
Hetty: where? I can't see it
Alfred: <file_photo>
Hetty: oh yeah, got it
Alfred: if you look in there there should be a button called add to home screen or link to homescreen or something
Hetty: hold on
Hetty: is it in more?
Alfred: No I don't think so, bottom row I think
Hetty: oh yeah I found it
Alfred: then give it a name and off you go!
Hetty: oh wow, thanks lovely xx
Alfred: no worries mum
Alfred: what site are you on anyway
Hetty: in my Hotmail
Alfred: but that has  a link already!
Hetty: where?
Alfred: the envelope in the bottom row of your ipad!!!!
Hetty: oh is that my Hotmail? I didn't know!
Alfred: there you go, learned two things!
Hetty: thanks lovely xx
Summary: Alfred tells his mum, Hetty, how to create a shortcut on an iPad and where to find her e-mail app.
Dialogue: Mary: Where are you?
Tom: in Grenada :P
Poppy: lucky bastard
Tom: I am!
Poppy: I'm at the office Mary
Mary: me too :(
Summary: Tom is in Grenada while Mary and Poppy are at the office.
Dialogue: Darrell: Hey, are you back yet?
Heidi: Hi, yes, I actually came back!!!
Darrell: Cool. How was it?
Heidi: It felt like I woke up from a coma.
Darrell: hehe
Heidi: Yeah, really weird. Have you moved to lublanska yet?
Darrell: Yeah, we moved. It sucks now, it's so far.
Heidi: Yeah, but now we work so close to each other.
Darrell: That's about the only positive. You know it takes me an 1h 20m to get here. That's over 2.5 h for commuting.
Heidi: Maybe you should consider taking your car.
Darrell: Maybe, but it burns so much.
Heidi: Get a new car! The newer cars burn like 5 nowadays.
Darrell: Yeah, I'd love to, but no moollah!
Heidi: I know what you mean. Everything keeps going up except our salaries.
Darrell: Tell me about it. All my fav. restaurants jacked up their prices.
Heidi: Speaking of which, let's have lunch? :)
Darrell: Ok. See you at 12:30
Summary: Darrell has moved to Lublanska. He spends over 2.5 h commuting, so he should get a new car. Now he and Heidi work close to each other. They'll have a lunch together at 12:30.
Dialogue: Norma: Should we meet tonight for a pint?
Lenny: yes yes yes!
Jackie: sure, would be nice to catch up
Norma: about 8?
Lenny: I'd prefer 6-6.30 even
Lenny: Marie wants to go out later as well and we can't leave Nicky alone
Norma: sure, 6.30 is fine for me
Jackie: for me as well
Summary: Norma, Lenny and Jackie are meeting tonight for a pint around 6.30.
Dialogue: Libbie: mom when you will be at home?
Mom: in 20 minutes
Libbie: can you buy bread on your way?
Mom: ok
Summary: Mom will be home soon and she will buy bread on her way.
Dialogue: Amit: How many foamed cabinets are left in the first bay?
Choula: Dunno. Will have to count.
Amit: K. Quickly please.
Choula: Right away.
Amit: The meeting is waiting for the info.
Choula: I'm doing it!
Amit: KK
Choula: 3,432
Amit: That sound wrong.
Choula: You can count them yourself.
Amit: I believe you.
Choula: I can count again to verify. One sec.
Amit: I'll go with 3432.
Choula: Yes. 3,432.
Amit: That won't go over well!
Choula: Oh well!
Summary: There are 3,432 foamed cabinets left in the first bay according to Choula. Amit is afraid that won't go over well.
Dialogue: Monica: Have you seen that hottie on your left?
Monica: He's been checking you out since we walked into the bus
Sarah: Yeah
Sarah: I felt his eyes on me
Sarah: I got used to such situations
Sarah: It's normal cuz I'm hot
Sarah: I'm a realist and I'm self-conscious
Sarah: I don't even bother paying attention to those horny losers
Monica: Wow, Sarah, I didn't expect you're so prideful!
Sarah: I told you, I'm a realist
Sarah: Look, I don't care if a boy is handsome, it's actually a common quality
Sarah: Of course, it could be a nice bonus but what I value the most is inteligence
Monica: That's very profound. I've never seen this side of you before
Monica: I feel surprised. In a positive way ofc
Monica: Hope you'll find someone with all the qualities you like someday :)
Sarah: Thanks Monica, you're a good friend :)
Summary: Sarah doesn't care about a handsome guy who was looking at her in the bus. She's self-aware and values inteligence more than the looks. Monica is positively surprised and impressed.
Dialogue: Leah: got 1 free ticket for split tonight at 7:45pm, who's in?
Zara: me! me!
Rose: meeee
Rose: noooo
Leah: Zara was first, sorry Rose :<
Rose :(
Summary: Leah will give Zara 1 free ticket for tonight at 7:45 pm. Rose responded too late, so she won't get any.
Dialogue: Chloe: what do you want for dinner?
Bella: idk veggie burgers?
Bella: btw i'll be late, i need to pick up my order from h&m
Chloe: ok
Chloe: can you buy two tins of beans on your way home?
Bella:  black, white or kidney beans?
Chloe: i usually use white beans, but it doesn't really matter
Bella: ok, i'll buy them. do you need anything else?
Chloe: no, thanks! :)
Summary: Bella and Chloe will have vegetarian burgers for dinner. Bella will pick up her order from H&M and buy the ingredients for the burgers.
Dialogue: Monica: Jessica has a boyfriend?!?! WHAT?
Jasmine: yes, she does, finally - I talked to her about it last week
Monica: no way... who is he?!
Jasmine: yeah, she is sooo in love , well I don't know much really, he is a fireman and that's it
Monica: can't believe it
Jasmine: hahaha yeah, me neither, i don't really talk to her that much anymore to be honest
Summary: Jessica has a boyfriend finally. He is a fireman. Monica can't believe it, neither Jasmine.
Dialogue: Tyler: wanna go to the basketball game tm?
James: who's playing?
Tyler: UofL and UK
James: wait really??
Tyler: yes haha
James: thats a super big game how u get tickets??
Tyler: I have a friend thats working it and got me tickets
James: yes yes I wanna go its Saturday right??
Tyler: you all ready know hahaha
James: because I wanted to go and couldn't get tickets
Tyler: well now we can go, maybe drive together? parking will be crazy
James: yeah!  we can take my car
Tyler: awesome I will sen you a copy of the tickets
James: ok great!
Summary: Tyler has tickets for Saturday's UofL and UK basketball game. He got them from a friend who works it. James will go with Tyler by car. Tyler will send him a copy of the tickets.
Dialogue: Robert: Hey, what are you up to tonight?
Sandy: I was supposed to meet up with Janet, but she cancelled on me. U?
Robert: I was thinking about going out myself. Wanna do something fun?
Sandy: Sure. Anything particular in mind?
Robert: Not really. You know of anything going on tonight?
Sandy: Well, there's this exhibition of modern art...
Robert: Sorry, not a fan. Don't really get modern art. Don't know why.
Sandy: Really? I love modern art.
Robert: How come? You don't seem the type...
Sandy: And what "type" likes modern art?
Robert: You know, the geeky type...
Sandy: So, I'm a geek?
Robert: Still, better than a nerd ;)
Sandy: LOL. Probably.
Robert: Anything else? Maybe the movies?
Sandy: Haven't been to the cinema in a while. Anything good on at the moment?
Robert: I'll check. Brb.
Sandy: Ok.
Robert: Sorry to keep you waiting. There are three to choose from: horror, romantic comedy, documentary.
Sandy: Well, I'm not a fan of horrors... They scare me to death...
Robert: That's the point, isn't it? ;)
Sandy: Maybe. Still...
Robert: Okay then. Not the horror. The documentary? Building dams in Afghanistan. Sounds fun?
Sandy: More fun than the vampires, blood, scary creatures...
Robert: What time do you want to go? 6:30? 7:30? 8:30?
Sandy: 7:30 is fine.
Robert: So 7:00 at the cinema?
Sandy: Let's make it 7:15.
Robert: Sure. See you there.
Sandy: Bye.
Summary: Robert and Sandy are planning to go out together, but Robert doesn't like modern art, although Sandy loves it. They are considering to go to the movies. Sandy doesn't like horrors. They decide to go to see a documentary about Afghanistan at 7.30. They will meet at 7.15 at the cinema.
t
Dialogue: Anne: Mum's seeing someone :/
Yvonne: I had my suspicions
Anne: And you didn't tell me?!
Yvonne: Why wouldn't I? it's her life, if she didn't tell you, maybe she wasn't ready, it's her choice
Anne: Ok, but she's still my mother. I think she should have told us
Yvonne: Have you told her about your every single boyfriend?
Anne: Come on! It's not the same, she's our mother for fuck's sake!
Yvonne: And still a person. I don't get why you're so upset about this
Anne: It's been only four months since dad left her, isn't it a bit early for going out with other people?
Yvonne: you really think that? Dad left her for another woman
Anne: So?
Yvonne: So his own marriage didn’t stop him from meeting other women, I’m proud of her, she deserves to be happy
Anne: Of course she does, I just think it’s too early
Yvonne: You’re just upset she didn’t tell you and that she has her secrets
Anne: Don’t be ridiculous, I worry about her
Anne: At this stage she’s too vulnerable
Yvonne: She’s an adult, I think she can handle her love life perfectly fine ;)
Summary: Mum's seeing someone and she didn't tell Yvonne or Anne.
Dialogue: Tony: Do you have any recommendation for us? What we should see in NYC?
Sally: the regular stuff: MOMA, Guggenheim, empire State Buiding etc.
Tony: but maybe anything not so well known?
Sally: go to Ellis Island
Sally: they have an amazing museum about immigration
Tony: that sounds good!
Sally: you'll like it
Tony: thanks!
Sally: you're welcome
Summary: Tony gives recommendations on what Sally should see in NYC.
Dialogue: Tina: <file_photo>
Tina: Dear Ella and Jamie, we wish you a wonderful Christmas - wherever you are going to celebrate it!
Ella: <file_photo>
Ella: Thank you my dear! From our Havana abode we are wishing you a lovely time with your family at Christmas!
Ella: Have you got some Xmas tree? Here in Cuba nobody celebrates Christmas, it seems. But a holiday flat opposite ours has some sort of Xmas decoration.
Ella: <file_photo>
Tina: <file_photo>
Tina: My little Christmas tree, bought on the side of the road, made by Africans.
Ella: I think I like this tree very much!
Tina: :)) Bill is rather skeptical and says that its only good feature is that it will shed no needles. Will you be celebrating?
Ella: Not really. In fact we never do, apart from a few jokes about a Xmas dinner. In a country like this it is easy to forget it is Christmastide. We really don't care. I would still do something at home but don't bother while travelling. And you?
Tina: My daughter Laura and her hubby are coming down from Jo'burg, so I guess we'll have a grand Christmas meal. Bill loves preparing all these English things and Laura is quite mad about them too. I'll bake a proper south African sugarcane cake.
Ella: Never tried this one!
Tina: It's really a joke, more of a traditional name than anything. And too sweet to be enjoyed. Just a Xmas treat. Did you have traditional dishes in Poland, the ones your mother used to prepare for Christmas?
Ella: Oh yes, plenty! But I liked only few of them. I wish I could taste them again though. :( weep,weep..
Tina: Good old days of childhood... When I think about Howick in the days of my childhood and how it has changed for worse, it makes me cringe. Good that my mother didn't live long enough to experience all this deterioration. No good thoughts for Xmas.
Ella: But good to remember our loved ones!
Tina: Right you are. Then once more: Happy Christmas to you both!
Ella: And a happy Christmas to you, dear Tina and Bill! With kind regards to your family!
Tina: Thank you dear.
Summary: Tina and Ella wish each other a happy Christmas. Ella and Jamie are spending Christmas in their Havana abode and they do not plan to celebrate. Tina bought a Christmas tree. Tina's daughter Laura and her husband are coming from Johannesburg. Tina and Bill will prepare a grand Christmas meal.
Dialogue: Ronnie: hey, I'm in Tesco and look
Ronnie: they've got discount on your dad's favourite coffee
Ronnie: <file_photo>
Georgia: wow, that is a really good price!
Georgia: pls buy 5 packs
Georgia: I remember that granny likes this coffee too
Ronnie: okie dokie
Ronnie: do you want anything else?
Georgia: buy some chocolate cookies :D
Ronnie: <file_gif>
Summary: Ronnie is in Tesco and there's a discount for Georgia's dad's favourite coffee. He will get 5 packs for her, and some chocolate cookies.
Dialogue: Pete: hey
Laura: hello
Pete: how are you?
Laura: fine thanks
Pete: will we meet today?
Laura: sure
Laura: :)
Summary: Laura and Pete are going to meet today.
Dialogue: Felicity: <file_photo> combines impact and effort
Joe: I know it... unfort it doesnt cover my problem completely
Felicity: what do you mena?
Joe: I used this chart, but it doesn't include shortage of time unfort, and this is the main thing
Felicity: uuu I get it :P
Summary: Felicity sent a photo to Joe. He is not satisfied with it.
Dialogue: Martha: I just got accepted!!!
Jay: Whaaaat!!! Congratulations! This is amazing!
Martha: <file_photo>
Martha: Here's my unconditional offer :)
Jay: So proud of you <3 Are then ready to go?
Martha: I just booked my tickets, I'm flying on 12 September
Jay: That's in less than a month!
Martha: hahaha I know, time flies
Martha: I'm worried though because I still have no place to stay
Jay: Hm, are you looking for a flat, a room or student halls?
Martha: Honestly? I'd take anything at this stage
Jay: Have you checked if the university has a student accommodation programme?
Martha: Yes, they do, but it's only for full time students ;/ it's ridiculous, because I applied for the part time as I can't afford to just study, therefore I need to pay more for my accommodation. Fuck logic
Jay: Hah, seems like that, doesn't make any sense to me either
Martha: So I'm not entitled to any accommodation programme and I'm probably at the end of the list to get a room at student halls
Jay: Maybe a private one? How expensive are the flats?
Martha: Crazy expensive... I most probably can't afford it, but maybe it'll be possible to share with someone
Jay: I may ask around, I think I have some friends there, I can ask around, maybe they'll have a spare room
Martha: Could you that? I'd need to stay somewhere until I can get my head around the city, uni, people...
Martha: Oh my, I am excited, but also scared as hell...
Jay: It'll be fun, you'll see!
Martha: It definitely would be fun if I have a place to stay
Jay: Don't be so overdramatic, it'll work out :D
Summary: Martha got accepted at university as part time student. She's just booked a ticket for 12th September. She doesn't have a place to stay. Flats are expensive and she doesn't have right to any accommodation program. Jay will ask around if his friends have a spare room.
Dialogue: Des: I'm hungry
Wanda: already?
Des: <file_gif>
Wanda: ok, ok
Wanda: in a half?
Des: yes!
Wanda: see u :)
Summary: Des is hungry. He and Wanda are going to meet in half an hour.
Dialogue: Lucas: Howard and Nancy are coming to visit me on Saturday
Lucas: how about you John? Wanna join us?
John: this Saturday?
Lucas: that's right, in the afternoon.
John: damnit. I want but I can't...
Lucas: Come on, why?
John: this Saturday I'm working until 5 p.m. and then I have an appointment at the dentist's
Lucas: oh my... looks like a busy and unpleasant time...
Lucas: I'm sorry for you, John
John: there certainly are things in life you cannot skip
John: but thanks a lot Luc, I appreciate that you invited me anyway :)
Lucas: no problem, you're my friend, bro :)
Lucas: hope you won't suffer too much at the dentist's
John: thanks!
John: don't worry, he's a real professional, I trust him
Lucas: good for you
John: yeah. Have fun on Saturday and say hello for me, please. Bye
Lucas: Thanks, I will! Bye
Summary: Howard and Nancy are visiting Lucas on Saturday, but John can't join because of work.
Dialogue: Glenda: Have you seen weather forecast ?
Martin: Yes, it is going to be warm and sunny
Glenda: Damn, why did I already pack all my summer stuff ??
Summary: According to the forecast, the weather is going to be warm and sunny.
Dialogue: Peg: i got a cold :(
Tyson: typical this time of year
Peg: here's the voice of a sympathetic man, thx Ty!
Ridge: u take anything?
Peg: some pills. aspirin and stuff
Landry: i feel shit too. any good ideas?
Landry: i mean home recipes
Nettie: i know. hot water, cinamon, lemon, honey
Nettie: plenty of all, drink hot
Nettie: go to bed straight after. sweats a lot
Landry: sounds better than garlic my mum tortuted me with all life
Peg: ill try this one out too
Tyson: i know 1 too, but pretty hardcore
Peg: ok
Tyson: lemon and honey are the same. only 190 proof alc
Landry: that is srsly cool
Summary: Peg and Landry are sick. They receive pieces of advice how to get better.
Dialogue: Mark: We'll be late 1 hour, sorry guys, you can start without us
Paul: No, we will wait with the dinner
Steven: Take your time, we're enjoying a nice chat
Mark: ok, thanks a lot
Summary: Mark will be an hour late for the dinner.

Dialogue: Jim: Hello, welcome to the store, how can I help you
Finn: Hello could you help me track my shippment?
Jim: yes, can you please tell me your order number
Finn: It's 45678
Jim: Thank you, from what I can see your package has left the warehouse and will be delivered to you tommorrow
Summary:


Prompt:
Please determine the type of the question below. Here are some examples of questions.

Question: Why are sometimes your hands cold , but the rest of you isn 't ?
Type: Reason
Question: What snack food has ridges ?
Type: Food
Question: Who was the first coach of the Cleveland Browns ?
Type: Individual
Question: What arch can you see from the Place de la Concorde ?
Type: Other location
Question: Who created Harry Lime ?
Type: Individual
Question: What Caribbean cult did Marcus Garvey originate ?
Type: Religion
Question: When did Iraqi troops invade Kuwait ?
Type: Date
Question: Whose cover is that of an employee of Universal Import and Export ?
Type: Individual
Question: What was the name of Betty Boop 's dog ?
Type: Animal
Question: What is the deepest area of the Arctic Ocean ?
Type: Other location
Question: Who 's the founder and editor of The National Review ?
Type: Individual
Question: Who was Tiny Tim 's father ?
Type: Individual
Question: What are the historical trials following World War II called ?
Type: Event
Question: What is the claim to fame of Agra , India ?
Type: Reason
Question: What is white chocolate ?
Type: Definition of something
Question: What 's the farthest planet from the sun ?
Type: Other location
Question: What is a fear of everything ?
Type: Disease and medicine
Question: Whose old London come-on was : `` Buy my sweet lavender '' ?
Type: Individual
Question: The major league baseball team in Pittsburgh is called what ?
Type: Group or organization of person
Question: How do microwaves work ?
Type: Manner of an action
Question: What is the name given to a group of geese ?
Type: Animal
Question: What is gymnophobia ?
Type: Definition of something
Question: What is the difference between khaki and chino ?
Type: Description of something
Question: Who was the lawyer for Randy Craft ?
Type: Individual
Question: When was the San Francisco fire ?
Type: Date
Question: What year were the Olympic Games played in where Nadia Comaneci became popular ?
Type: Date
Question: What country has the most coastline ?
Type: Country
Question: What is goulash ?
Type: Definition of something
Question: What was the Vietnam War ?
Type: Definition of something
Question: Who wrote the lyrics to Porgy and Bess ?
Type: Individual
Question: What are all the southern states of the U.S. ?
Type: State
Question: Who came up with the name , El Nino ?
Type: Individual
Question: What man-made waterways is 1.76 miles long ?
Type: Other location
Question: What is the former name of Zimbabwe ?
Type: Equivalent term
Question: What is the history of yo-yos ?
Type: Description of something
Question: What state was named the Green Mountain state ?
Type: State
Question: How do ants have sex ?
Type: Manner of an action
Question: When did the Dow first reach ?
Type: Date
Question: What is the high pitched sound that you hear in your ear every now and then , but then it goes away , after a while ?
Type: Other entity
Question: When did communist control end in Hungary ?
Type: Date
Question: How can I find a list of celebrities ' real names ?
Type: Manner of an action
Question: What did the pyramid-builders of Egypt mainly eat ?
Type: Food
Question: How does Belle describe her life in Beauty and the Beast ?
Type: Manner of an action
Question: When reading classified ads , what does EENTY : other stand for ?
Type: Expression abbreviated
Question: When was Florida admitted into the Union ?
Type: Date
Question: How many Israeli athletes were killed at the Munich Olympics ?
Type: Number of something
Question: What detective lives on Punchbowl Hill and has 11 children ?
Type: Individual
Question: What state is the Filenes store located in ?
Type: State
Question: What are the cookies in Internet ?
Type: Definition of something
Question: What English word contains the most letters ?
Type: Word with a special property
Question: What is Larry King 's occupation ?
Type: Title of a person
Question: Name a French fascist party .
Type: Group or organization of person
Question: What American poet wrote : `` Good fences make good neighbors '' ?
Type: Individual
Question: Where are the busiest Amtrak rail stations in the U.S. ?
Type: Other location
Question: How many people die of tuberculosis yearly ?
Type: Number of something
Question: What was the worst hurricane ?
Type: Event
Question: What Caribbean island is northeast of Trinidad ?
Type: Other location
Question: Who was Jean Nicolet ?
Type: Description of a person
Question: What do the 12 days of Christmas mean ?
Type: Definition of something
Question: What caused Harry Houdini 's death ?
Type: Reason
Question: What building appropriately enough is depicted on the back of the 1-dollar bill ?
Type: Other location
Question: How many logarithmic scales are there on a slide rule ?
Type: Number of something
Question: What is the origin of the word , JJ .
Type: Description of something
Question: What is the average hours per months spent online by AOL users ?
Type: Number of something
Question: How does a copier work ?
Type: Manner of an action
Question: How many calories are there in a glass of water ?
Type: Number of something
Question: What color is Chablis ?
Type: Color
Question: Where is Ayer 's rock ?
Type: Other location
Question: What corporation does Madonna advertise for ?
Type: Group or organization of person
Question: Where is the bridge over the river Kwai ?
Type: Other location
Question: What cigarette is `` a whole new world '' ?
Type: Other entity
Question: When did the Chernobyl nuclear accident occur ?
Type: Date
Question: What is the first book of the Old Testament ?
Type: Invention, book and other creative piece
Question: What does `` Philebus-like '' mean ?
Type: Definition of something
Question: When did Rococo painting and architecture flourish ?
Type: Date
Question: What is the difference between fatalism and determinism ?
Type: Description of something
Question: Where is Poe 's birthplace ?
Type: Other location
Question: What U.S. state has the lowest highest elevation at 6 feet ?
Type: State
Question: How do you calculate the change in enthalpy of a chemical reaction ?
Type: Manner of an action
Question: What are the `` Star Wars '' satellites ?
Type: Definition of something
Question: What country was General Douglas McArthur in when he was recalled by President Truman ?
Type: Country
Question: How is Easter Sunday 's date determined ?
Type: Manner of an action
Question: What city is the setting for Puccini 's opera La Boheme ?
Type: City
Question: When was Dick Clark born ?
Type: Date
Question: Where can one find information on religion and health , the brain and nutrition ?
Type: Other location
Question: What comedian hit the TV screen in 1951 with the NBC afternoon show Time for Ernie ?
Type: Individual
Question: How much of the earth 's surface is permanently frozen ?
Type: Number of something
Question: What English playwright penned : `` Where the bee sucks , so shall I '' ?
Type: Individual
Question: What song put James Taylor in the limelight ?
Type: Invention, book and other creative piece
Question: What new middle school was built in Philadelphia , Pennsylvania last year ?
Type: Group or organization of person
Question: What southwestern state is dubbed The Silver State ?
Type: State
Question: What is Betsy Ross famous for ?
Type: Reason
Question: What is California 's capital ?
Type: City
Question: What Asian leader was known as The Little Brown Saint ?
Type: Individual
Question: Who led the Normans to victory in the Battle of Hastings ?
Type: Individual
Question: What type of exercise burns the most calories ?
Type: Sport
Question: What was the name of the Crimean meeting of Roosevelt , Churchill , and Stalin ?
Type: Event
Question: What is dry ice ?
Type: Definition of something
Question: How much money was the minimum wage in 1991 ?
Type: Price
Question: On which Hawaiian island is Pearl Harbor ?
Type: Other location
Question: Who made the first surfboard ?
Type: Individual
Question: Where did the Maya people live ?
Type: Other location
Question: How do you make a paintball ?
Type: Manner of an action
Question: What then-derogatory term was applied to the painters Monet , Sisley , Pissarro , Renoir and Degas ?
Type: Equivalent term
Question: What lake in Scotland is said to hold one or more monsters ?
Type: Other location
Question: What is the lens behind the iris in the eye called ?
Type: Equivalent term
Question: Who leads the star ship Enterprise in Star Trek ?
Type: Individual
Question: Why do we have to go to school ?
Type: Reason
Question: What is a term for behavior , appearance , or expression that violates the accepted standards of sexual morality ?
Type: Equivalent term
Question: Who is the President of Pergament ?
Type: Individual
Question: What religion has the most members ?
Type: Religion
Question: What country would you visit to ski in the Dolomites ?
Type: Country
Question: What does VCR stand for ?
Type: Expression abbreviated
Question: Where can I buy a good snowboard for less than $200 ?
Type: Other location
Question: Where can I buy movies on videotape online ?
Type: Other location
Question: Who was the 16th President of the United States ?
Type: Individual
Question: What was the education system in the 1960 's ?
Type: Other entity
Question: Why are peanut butter cookies topped with crisscrosses ?
Type: Reason
Question: Name the designer of the shoe that spawned millions of plastic imitations , known as ` jellies ' .
Type: Individual
Question: What are the rules to `` snow golf '' ?
Type: Description of something
Question: What were the names of the three ships used by Columbus ?
Type: Vehicle
Question: What should you do for an ankle sprain ?
Type: Description of something
Question: CNN began broadcasting in what year ?
Type: Date
Question: When is a woman most fertile ?
Type: Date
Question: Whose special bear 's creator was born on January 18 , 1779 ?
Type: Individual
Question: What is a neurosurgeon ?
Type: Definition of something
Question: What are the Baltic States ?
Type: Definition of something
Question: Who used AuH2O as an election slogan ?
Type: Individual
Question: In what book can I find the story of Aladdin ?
Type: Invention, book and other creative piece
Question: What country is home to Heineken beer ?
Type: Country
Question: What are the various ways in which one can measure IT User Satisfaction Level ?
Type: Techniques and method
Question: What is software piracy ?
Type: Definition of something
Question: What British prime minister and U.S. president were seventh cousins once-removed ?
Type: Individual
Question: Name a Gaelic language .
Type: Language
Question: What is the best way to overcome a fear ?
Type: Techniques and method
Question: What soft drink would provide me with the biggest intake of caffeine ?
Type: Food
Question: Where in the United States do people live the longest ?
Type: Other location
Question: On which dates does the running of the bulls occur in Pamplona , Spain ?
Type: Date
Question: What is the name of the rare neurological disease with symptoms such as : involuntary movements , tics , swearing , and incoherent vocalizations , grunts , shouts , etc. ?
Type: Disease and medicine
Question: What is an urban legend ?
Type: Definition of something
Question: What is a multiplexer ?
Type: Definition of something
Question: What is Boston Kreme ?
Type: Definition of something
Question: What Russian master spy lived in the U.S. under the name Emil Goldfus ?
Type: Individual
Question: What 's a perfect score in a gymnastics exercise ?
Type: Other number
Question: What cathedral was Thomas Becket murdered in ?
Type: Other location
Question: Why did Egyptians shave their eyebrows ?
Type: Reason
Question: What does the name Melissa mean ?
Type: Definition of something
Question: What year did Montana become a state ?
Type: Date
Question: What card game can feature dealer 's choice ?
Type: Sport
Question: What are the different approaches of systems analysis ?
Type: Techniques and method
Question: What does the double-O indicate in 007 ?
Type: Definition of something
Question: What color is the lipstick on Boy George 's wax lips at London 's Madame Tussaud 's ?
Type: Color
Question: What anesthetic did Queen Victoria allow to be used for the birth of her seventh child , in 1853 ?
Type: Disease and medicine
Question: What do river otters eat ?
Type: Food
Question: How many miles is it from NY to Austria ?
Type: Number of something
Question: What is a fear of odors , body , ?
Type: Disease and medicine
Question: How is energy created ?
Type: Manner of an action
Question: What causes panic attacks ?
Type: Reason
Question: How can I get started in writing for television ?
Type: Manner of an action
Question: Where 's the GUM department store ?
Type: Other location
Question: Who is the voice of Miss Piggy ?
Type: Individual
Question: What kind of science is cosmology ?
Type: Other entity
Question: Who patented the first phonograph ?
Type: Individual
Question: Who was the 15th century fire-and-brimstone monk who gained control of Florence but ended burnt at the stake ?
Type: Individual
Question: What is the definition of cecum ?
Type: Definition of something
Question: Which city has the oldest relationship as a sisterðcity with Los Angeles ?
Type: City
Question: Who wrote `` The Pit and the Pendulum '' ?
Type: Individual
Question: What country is the world 's largest importer of cognac ?
Type: Country
Question: What is a technique popularly used to detect birth defects ?
Type: Techniques and method
Question: What toy can you make sleep ?
Type: Product
Question: Stuart Hamblen is considered to be the first singing cowboy of what ?
Type: Invention, book and other creative piece
Question: What city is wiener schnitzel named for ?
Type: City
Question: What Southern California town is named after a character made famous by Edgar Rice Burroughs ?
Type: City
Question: How much stronger is the new vitreous carbon material invented by the Tokyo Institute of Technology compared with the material made from cellulose ?
Type: Number of something
Question: What former African leader held his country 's boxing title for nine years ?
Type: Individual
Question: What is a bone marrow transplant ?
Type: Definition of something
Question: What are the world 's three largest oceans , in order of size ?
Type: Other location
Question: What is a virtual IP address ?
Type: Definition of something
Question: What New Hampshire hamlet rises early to vote first in U.S. presidential elections ?
Type: City
Question: What were the first words spoken on a film sound track ?
Type: Description of something
Question: Who is Stein Eriksen ?
Type: Description of a person
Question: Why is the universe flat , if it started by an explosion , shouldn 't it be a sphere ?
Type: Reason
Question: Where can I buy a pony on the Big Island for my daughter ?
Type: Other location
Question: How do you match a name to a social security number ?
Type: Manner of an action
Question: What is the only modern language that capitalizes its singular first-person pronoun ?
Type: Language
Question: Who accompanied Space Ghost on his missions ?
Type: Individual
Question: What is the celtic symbol for `` life '' ?
Type: Symbols and sign
Question: What is the name of the American who was captured when his plane went down over Syrian-held Lebanon ?
Type: Individual
Question: What is Judy Garland 's date of birth ?
Type: Date
Question: What do you call the feeling of having experienced something before ?
Type: Equivalent term
Question: How do I know if I 'm jealous of someone ?
Type: Manner of an action
Question: Which police department made the all-time biggest cocaine bust in Ventura County ?
Type: Group or organization of person
Question: What was the name of the lawyer who represented Randy Steven Craft ?
Type: Individual
Question: What state on the Gulf of Mexico has its lowest point five feet below sea level ?
Type: State
Question: What is troilism ?
Type: Definition of something
Question: What is the population of Kansas ?
Type: Other number
Question: What was lost and regained by poet John Milton ?
Type: Other entity
Question: How often are quadruplets born ?
Type: Other number
Question: Who was the Charlie perfume woman ?
Type: Individual
Question: What woman has carried the most multiple births , twins , triplets , etc. , ?
Type: Individual
Question: What is a nematode ?
Type: Definition of something
Question: When was Franklin D. Roosevelt stricken with polio ?
Type: Date
Question: What are the names of Richard Nixon 's two daughters ?
Type: Individual
Question: What country in 1998 had the most suicides regardless of population size ?
Type: Country
Question: Who was the king who was forced to agree to the Magna Carta ?
Type: Individual
Question: Who invented Make-up ?
Type: Individual
Question: What are the major differences in the Catholic and Methodist religions ?
Type: Description of something
Question: What U.S. city is known as The Rubber Capital of the World ?
Type: City
Question: What two Japanese cities are spelled with the letters K , O , O , T and Y ?
Type: City
Question: What chemicals are used in lethal injection ?
Type: Disease and medicine
Question: What does a philatelist collect ?
Type: Other entity
Question: How do plants make food ?
Type: Manner of an action
Question: What is the acronym for the rating system for air conditioner efficiency ?
Type: Abbreviation
Question: What do I need to do to take my dog with me to live in Dominica , West Indies for a year ?
Type: Description of something
Question: What is a fuel cell ?
Type:


super( source, new Predicate<PatternMatch>()

Prompt:
Please complete the code given below.
/**
 * Copyright (c) 2002-2012 "Neo Technology,"
 * Network Engine for Objects in Lund AB [http://neotechnology.com]
 *
 * This file is part of Neo4j.
 *
 * Neo4j is free software: you can redistribute it and/or modify
 * it under the terms of the GNU General Public License as published by
 * the Free Software Foundation, either version 3 of the License, or
 * (at your option) any later version.
 *
 * This program is distributed in the hope that it will be useful,
 * but WITHOUT ANY WARRANTY; without even the implied warranty of
 * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
 * GNU General Public License for more details.
 *
 * You should have received a copy of the GNU General Public License
 * along with this program.  If not, see <http://www.gnu.org/licenses/>.
 */
package org.neo4j.graphmatching;
import java.util.Arrays;
import java.util.Collection;
import java.util.HashMap;
import java.util.HashSet;
import java.util.Map;
import java.util.Set;
import org.neo4j.graphdb.Node;
import org.neo4j.graphmatching.filter.AbstractFilterExpression;
import org.neo4j.graphmatching.filter.FilterBinaryNode;
import org.neo4j.graphmatching.filter.FilterExpression;
import org.neo4j.graphmatching.filter.FilterValueGetter;
import org.neo4j.helpers.Predicate;
import org.neo4j.helpers.collection.FilteringIterable;
/**
 * The PatternMatcher is the engine that performs the matching of a graph
 * pattern with the actual graph.
 */
@Deprecated
public class PatternMatcher
{
	private static PatternMatcher matcher = new PatternMatcher();
	private PatternMatcher()
	{
	}
    /**
     * Get the sole instance of the {@link PatternMatcher}.
     *
     * @return the instance of {@link PatternMatcher}.
     */
	public static PatternMatcher getMatcher()
	{
		return matcher;
	}
    /**
     * Find occurrences of the pattern defined by the given {@link PatternNode}
     * where the given {@link PatternNode} starts matching at the given
     * {@link Node}.
     *
     * @param start the {@link PatternNode} to start matching at.
     * @param startNode the {@link Node} to start matching at.
     * @return all matching instances of the pattern.
     */
    public Iterable<PatternMatch> match( PatternNode start,
        Node startNode )
    {
        return match( start, startNode, null );
    }
    /**
     * Find occurrences of the pattern defined by the given {@link PatternNode}
     * where the given {@link PatternNode} starts matching at the given
     * {@link Node}.
     *
     * @param start the {@link PatternNode} to start matching at.
     * @param startNode the {@link Node} to start matching at.
     * @param objectVariables mapping from names to {@link PatternNode}s.
     * @return all matching instances of the pattern.
     */
	public Iterable<PatternMatch> match( PatternNode start,
		Node startNode, Map<String, PatternNode> objectVariables )
	{
		return match( start, startNode, objectVariables,
		    ( Collection<PatternNode> ) null );
	}
    /**
     * Find occurrences of the pattern defined by the given {@link PatternNode}
     * where the given {@link PatternNode} starts matching at the given
     * {@link Node}.
     *
     * @param start the {@link PatternNode} to start matching at.
     * @param objectVariables mapping from names to {@link PatternNode}s.
     * @param optional nodes that form sub-patterns connected to this pattern.
     * @return all matching instances of the pattern.
     */
    public Iterable<PatternMatch> match( PatternNode start,
            Map<String, PatternNode> objectVariables,
            PatternNode... optional )
    {
        return match( start, objectVariables,
            Arrays.asList( optional ) );
    }
    /**
     * Find occurrences of the pattern defined by the given {@link PatternNode}
     * where the given {@link PatternNode} starts matching at the given
     * {@link Node}.
     *
     * @param start the {@link PatternNode} to start matching at.
     * @param objectVariables mapping from names to {@link PatternNode}s.
     * @param optional nodes that form sub-patterns connected to this pattern.
     * @return all matching instances of the pattern.
     */
	public Iterable<PatternMatch> match( PatternNode start,
	        Map<String, PatternNode> objectVariables,
	        Collection<PatternNode> optional )
    {
	    Node startNode = start.getAssociation();
        if ( startNode == null )
        {
            throw new IllegalStateException(
                    "Associating node for start pattern node is null" );
        }
	    return match( start, startNode, objectVariables, optional );
    }
    /**
     * Find occurrences of the pattern defined by the given {@link PatternNode}
     * where the given {@link PatternNode} starts matching at the given
     * {@link Node}.
     *
     * @param start the {@link PatternNode} to start matching at.
     * @param startNode the {@link Node} to start matching at.
     * @param objectVariables mapping from names to {@link PatternNode}s.
     * @param optional nodes that form sub-patterns connected to this pattern.
     * @return all matching instances of the pattern.
     */
	public Iterable<PatternMatch> match( PatternNode start,
		Node startNode, Map<String, PatternNode> objectVariables,
		Collection<PatternNode> optional )
	{
        Node currentStartNode = start.getAssociation();
        if ( currentStartNode != null && !currentStartNode.equals( startNode ) )
        {
            throw new IllegalStateException(
                    "Start patter node already has associated " +
                    currentStartNode + ", can not start with " + startNode );
        }
	    Iterable<PatternMatch> result = null;
		if ( optional == null || optional.size() < 1 )
		{
			result = new PatternFinder( this, start, startNode );
		}
		else
		{
			result = new PatternFinder( this, start, startNode, false,
			    optional );
		}
		if ( objectVariables != null )
		{
    		// Uses the FILTER expressions
    		result = new FilteredPatternFinder( result, objectVariables );
		}
		return result;
	}
    /**
     * Find occurrences of the pattern defined by the given {@link PatternNode}
     * where the given {@link PatternNode} starts matching at the given
     * {@link Node}.
     *
     * @param start the {@link PatternNode} to start matching at.
     * @param startNode the {@link Node} to start matching at.
     * @param objectVariables mapping from names to {@link PatternNode}s.
     * @param optional nodes that form sub-patterns connected to this pattern.
     * @return all matching instances of the pattern.
     */
	public Iterable<PatternMatch> match( PatternNode start,
		Node startNode, Map<String, PatternNode> objectVariables,
		PatternNode... optional )
	{
		return match( start, startNode, objectVariables,
		    Arrays.asList( optional ) );
	}
	private static class SimpleRegexValueGetter implements FilterValueGetter
	{
	    private PatternMatch match;
	    private Map<String, PatternNode> labelToNode =
	        new HashMap<String, PatternNode>();
	    private Map<String, String> labelToProperty =
	        new HashMap<String, String>();
	    SimpleRegexValueGetter( Map<String, PatternNode> objectVariables,
	        PatternMatch match, FilterExpression[] expressions )
	    {
            this.match = match;
            for ( FilterExpression expression : expressions )
            {
                mapFromExpression( expression );
            }
            this.labelToNode = objectVariables;
	    }
	    private void mapFromExpression( FilterExpression expression )
	    {
	        if ( expression instanceof FilterBinaryNode )
	        {
	            FilterBinaryNode node = ( FilterBinaryNode ) expression;
	            mapFromExpression( node.getLeftExpression() );
	            mapFromExpression( node.getRightExpression() );
	        }
	        else
	        {
	            AbstractFilterExpression pattern =
	                ( AbstractFilterExpression ) expression;
	            labelToProperty.put( pattern.getLabel(),
	                pattern.getProperty() );
	        }
	    }
        public String[] getValues( String label )
        {
            PatternNode pNode = labelToNode.get( label );
            if ( pNode == null )
            {
                throw new RuntimeException( "No node for label '" + label +
                    "'" );
            }
            Node node = this.match.getNodeFor( pNode );
            String propertyKey = labelToProperty.get( label );
            if ( propertyKey == null )
            {
                throw new RuntimeException( "No property key for label '" +
                    label + "'" );
            }
            Object rawValue = node.getProperty( propertyKey, null );
            if ( rawValue == null )
            {
                return new String[ 0 ];
            }
            Collection<Object> values =
                ArrayPropertyUtil.propertyValueToCollection( rawValue );
            String[] result = new String[ values.size() ];
            int counter = 0;
            for ( Object value : values )
            {
                result[ counter++ ] = ( String ) value;
            }
            return result;
        }
	}
	private static class FilteredPatternFinder
	    extends FilteringIterable<PatternMatch>
	{
        public FilteredPatternFinder( Iterable<PatternMatch> source,
            final Map<String, PatternNode> objectVariables )
        {
Next line of code:


Prompt:
Please complete the code given below.
/* NFC Reader is free software; you can redistribute it and/or modify
it under the terms of the GNU General Public License as published by
the Free Software Foundation; either version 3 of the License, or
(at your option) any later version.
NFC Reader is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.
You should have received a copy of the GNU General Public License
along with Wget.  If not, see <http://www.gnu.org/licenses/>.
Additional permission under GNU GPL version 3 section 7 */
package cache.wind.nfc.nfc.reader.pboc;
import android.nfc.tech.IsoDep;
import java.io.IOException;
import java.util.ArrayList;
import java.util.Arrays;
import cache.wind.nfc.SPEC;
import cache.wind.nfc.nfc.Util;
import cache.wind.nfc.nfc.bean.Application;
import cache.wind.nfc.nfc.bean.Card;
import cache.wind.nfc.nfc.tech.Iso7816;
@SuppressWarnings("unchecked")
public abstract class StandardPboc {
	private static Class<?>[][] readers = {
			{ BeijingMunicipal.class, WuhanTong.class, CityUnion.class, TUnion.class,
					ShenzhenTong.class, }, { StandardECash.class, } };
	public static void readCard(IsoDep tech, Card card) throws InstantiationException,
			IllegalAccessException, IOException {
		final Iso7816.StdTag tag = new Iso7816.StdTag(tech);
		tag.connect();
		for (final Class<?> g[] : readers) {
			HINT hint = HINT.RESETANDGONEXT;
			for (final Class<?> r : g) {
				final StandardPboc reader = (StandardPboc) r.newInstance();
				switch (hint) {
				case RESETANDGONEXT:
					if (!reader.resetTag(tag))
						continue;
				case GONEXT:
					hint = reader.readCard(tag, card);
					break;
				default:
					break;
				}
				if (hint == HINT.STOP)
					break;
			}
		}
		tag.close();
	}
	protected boolean resetTag(Iso7816.StdTag tag) throws IOException {
		return tag.selectByID(DFI_MF).isOkey() || tag.selectByName(DFN_PSE).isOkey();
	}
	protected enum HINT {
		STOP, GONEXT, RESETANDGONEXT,
	}
	protected final static byte[] DFI_MF = { (byte) 0x3F, (byte) 0x00 };
	protected final static byte[] DFI_EP = { (byte) 0x10, (byte) 0x01 };
	protected final static byte[] DFN_PSE = { (byte) '1', (byte) 'P', (byte) 'A', (byte) 'Y',
			(byte) '.', (byte) 'S', (byte) 'Y', (byte) 'S', (byte) '.', (byte) 'D', (byte) 'D',
			(byte) 'F', (byte) '0', (byte) '1', };
	protected final static byte[] DFN_PXX = { (byte) 'P' };
	protected final static int SFI_EXTRA = 21;
	protected static int MAX_LOG = 10;
	protected static int SFI_LOG = 24;
	protected final static byte TRANS_CSU = 6;
	protected final static byte TRANS_CSU_CPX = 9;
	protected abstract Object getApplicationId();
	protected byte[] getMainApplicationId() {
		return DFI_EP;
	}
	protected SPEC.CUR getCurrency() {
		return SPEC.CUR.CNY;
	}
	protected boolean selectMainApplication(Iso7816.StdTag tag) throws IOException {
		final byte[] aid = getMainApplicationId();
		return ((aid.length == 2) ? tag.selectByID(aid) : tag.selectByName(aid)).isOkey();
	}
	protected HINT readCard(Iso7816.StdTag tag, Card card) throws IOException {
		/*--------------------------------------------------------------*/
		// select Main Application
		/*--------------------------------------------------------------*/
		if (!selectMainApplication(tag))
			return HINT.GONEXT;
		Iso7816.Response INFO, BALANCE;
		/*--------------------------------------------------------------*/
		// read card info file, binary (21)
		/*--------------------------------------------------------------*/
		INFO = tag.readBinary(SFI_EXTRA);
		/*--------------------------------------------------------------*/
		// read balance
		/*--------------------------------------------------------------*/
		BALANCE = tag.getBalance(0, true);
		/*--------------------------------------------------------------*/
		// read log file, record (24)
		/*--------------------------------------------------------------*/
		ArrayList<byte[]> LOG = readLog24(tag, SFI_LOG);
		/*--------------------------------------------------------------*/
		// build result
		/*--------------------------------------------------------------*/
		final Application app = createApplication();
		parseBalance(app, BALANCE);
		parseInfo21(app, INFO, 4, true);
		parseLog24(app, LOG);
		configApplication(app);
		card.addApplication(app);
		return HINT.STOP;
	}
	protected float parseBalance(Iso7816.Response data) {
		float ret = 0f;
		if (data.isOkey() && data.size() >= 4) {
			int n = Util.toInt(data.getBytes(), 0, 4);
			if (n > 1000000 || n < -1000000)
				n -= 0x80000000;
			ret = n / 100.0f;
		}
		return ret;
	}
	protected void parseBalance(Application app, Iso7816.Response... data) {
		float amount = 0f;
		for (Iso7816.Response rsp : data)
			amount += parseBalance(rsp);
		app.setProperty(SPEC.PROP.BALANCE, amount);
	}
	protected void parseInfo21(Application app, Iso7816.Response data, int dec, boolean bigEndian) {
		if (!data.isOkey() || data.size() < 30) {
			return;
		}
		final byte[] d = data.getBytes();
		if (dec < 1 || dec > 10) {
			app.setProperty(SPEC.PROP.SERIAL, Util.toHexString(d, 10, 10));
		} else {
			final int sn = bigEndian ? Util.toIntR(d, 19, dec) : Util.toInt(d, 20 - dec, dec);
			app.setProperty(SPEC.PROP.SERIAL, String.format("%d", 0xFFFFFFFFL & sn));
		}
		if (d[9] != 0)
			app.setProperty(SPEC.PROP.VERSION, String.valueOf(d[9]));
		app.setProperty(SPEC.PROP.DATE, String.format("%02X%02X.%02X.%02X - %02X%02X.%02X.%02X",
				d[20], d[21], d[22], d[23], d[24], d[25], d[26], d[27]));
	}
	protected boolean addLog24(final Iso7816.Response r, ArrayList<byte[]> l) {
		if (!r.isOkey())
			return false;
		final byte[] raw = r.getBytes();
		final int N = raw.length - 23;
		if (N < 0)
			return false;
		for (int s = 0, e = 0; s <= N; s = e) {
			l.add(Arrays.copyOfRange(raw, s, (e = s + 23)));
		}
		return true;
	}
	protected ArrayList<byte[]> readLog24(Iso7816.StdTag tag, int sfi) throws IOException {
		final ArrayList<byte[]> ret = new ArrayList<byte[]>(MAX_LOG);
		final Iso7816.Response rsp = tag.readRecord(sfi);
		if (rsp.isOkey()) {
			addLog24(rsp, ret);
		} else {
Next line of code:


Prompt:
You are given a scientific article and a question. Answer the question as concisely as you can, using a single phrase or sentence if possible. If the question cannot be answered based on the information in the article, write "unanswerable". If the question is a yes/no question, answer "yes", "no", or "unanswerable". Do not provide any explanation.

Article: Introduction
Privacy policies are the documents which disclose the ways in which a company gathers, uses, shares and manages a user's data. As legal documents, they function using the principle of notice and choice BIBREF0, where companies post their policies, and theoretically, users read the policies and decide to use a company's products or services only if they find the conditions outlined in its privacy policy acceptable. Many legal jurisdictions around the world accept this framework, including the United States and the European Union BIBREF1, BIBREF2. However, the legitimacy of this framework depends upon users actually reading and understanding privacy policies to determine whether company practices are acceptable to them BIBREF3. In practice this is seldom the case BIBREF4, BIBREF5, BIBREF6, BIBREF7, BIBREF8, BIBREF9, BIBREF10. This is further complicated by the highly individual and nuanced compromises that users are willing to make with their data BIBREF11, discouraging a `one-size-fits-all' approach to notice of data practices in privacy documents.
With devices constantly monitoring our environment, including our personal space and our bodies, lack of awareness of how our data is being used easily leads to problematic situations where users are outraged by information misuse, but companies insist that users have consented. The discovery of increasingly egregious uses of data by companies, such as the scandals involving Facebook and Cambridge Analytica BIBREF12, have further brought public attention to the privacy concerns of the internet and ubiquitous computing. This makes privacy a well-motivated application domain for NLP researchers, where advances in enabling users to quickly identify the privacy issues most salient to them can potentially have large real-world impact.
[1]https://play.google.com/store/apps/details?id=com.gotokeep.keep.intl [2]https://play.google.com/store/apps/details?id=com.viber.voip [3]A question might not have any supporting evidence for an answer within the privacy policy.
Motivated by this need, we contribute PrivacyQA, a corpus consisting of 1750 questions about the contents of privacy policies, paired with over 3500 expert annotations. The goal of this effort is to kickstart the development of question-answering methods for this domain, to address the (unrealistic) expectation that a large population should be reading many policies per day. In doing so, we identify several understudied challenges to our ability to answer these questions, with broad implications for systems seeking to serve users' information-seeking intent. By releasing this resource, we hope to provide an impetus to develop systems capable of language understanding in this increasingly important domain.
Related Work
Prior work has aimed to make privacy policies easier to understand. Prescriptive approaches towards communicating privacy information BIBREF21, BIBREF22, BIBREF23 have not been widely adopted by industry. Recently, there have been significant research effort devoted to understanding privacy policies by leveraging NLP techniques BIBREF24, BIBREF25, BIBREF26, BIBREF27, BIBREF28, especially by identifying specific data practices within a privacy policy. We adopt a personalized approach to understanding privacy policies, that allows users to query a document and selectively explore content salient to them. Most similar is the PolisisQA corpus BIBREF29, which examines questions users ask corporations on Twitter. Our approach differs in several ways: 1) The PrivacyQA dataset is larger, containing 10x as many questions and answers. 2) Answers are formulated by domain experts with legal training. 3) PrivacyQA includes diverse question types, including unanswerable and subjective questions.
Our work is also related to reading comprehension in the open domain, which is frequently based upon Wikipedia passages BIBREF16, BIBREF17, BIBREF15, BIBREF30 and news articles BIBREF20, BIBREF31, BIBREF32. Table.TABREF4 presents the desirable attributes our dataset shares with past approaches. This work is also tied into research in applying NLP approaches to legal documents BIBREF33, BIBREF34, BIBREF35, BIBREF36, BIBREF37, BIBREF38, BIBREF39. While privacy policies have legal implications, their intended audience consists of the general public rather than individuals with legal expertise. This arrangement is problematic because the entities that write privacy policies often have different goals than the audience. feng2015applying, tan-EtAl:2016:P16-1 examine question answering in the insurance domain, another specialized domain similar to privacy, where the intended audience is the general public.
Data Collection
We describe the data collection methodology used to construct PrivacyQA. With the goal of achieving broad coverage across application types, we collect privacy policies from 35 mobile applications representing a number of different categories in the Google Play Store. One of our goals is to include both policies from well-known applications, which are likely to have carefully-constructed privacy policies, and lesser-known applications with smaller install bases, whose policies might be considerably less sophisticated. Thus, setting 5 million installs as a threshold, we ensure each category includes applications with installs on both sides of this threshold. All policies included in the corpus are in English, and were collected before April 1, 2018, predating many companies' GDPR-focused BIBREF41 updates. We leave it to future studies BIBREF42 to look at the impact of the GDPR (e.g., to what extent GDPR requirements contribute to making it possible to provide users with more informative answers, and to what extent their disclosures continue to omit issues that matter to users).
Data Collection ::: Crowdsourced Question Elicitation
The intended audience for privacy policies consists of the general public. This informs the decision to elicit questions from crowdworkers on the contents of privacy policies. We choose not to show the contents of privacy policies to crowdworkers, a procedure motivated by a desire to avoid inadvertent biases BIBREF43, BIBREF44, BIBREF45, BIBREF46, BIBREF47, and encourage crowdworkers to ask a variety of questions beyond only asking questions based on practices described in the document.
Instead, crowdworkers are presented with public information about a mobile application available on the Google Play Store including its name, description and navigable screenshots. Figure FIGREF9 shows an example of our user interface. Crowdworkers are asked to imagine they have access to a trusted third-party privacy assistant, to whom they can ask any privacy question about a given mobile application. We use the Amazon Mechanical Turk platform and recruit crowdworkers who have been conferred “master” status and are located within the United States of America. Turkers are asked to provide five questions per mobile application, and are paid $2 per assignment, taking ~eight minutes to complete the task.
Data Collection ::: Answer Selection
To identify legally sound answers, we recruit seven experts with legal training to construct answers to Turker questions. Experts identify relevant evidence within the privacy policy, as well as provide meta-annotation on the question's relevance, subjectivity, OPP-115 category BIBREF49, and how likely any privacy policy is to contain the answer to the question asked.
Data Collection ::: Analysis
Table.TABREF17 presents aggregate statistics of the PrivacyQA dataset. 1750 questions are posed to our imaginary privacy assistant over 35 mobile applications and their associated privacy documents. As an initial step, we formulate the problem of answering user questions as an extractive sentence selection task, ignoring for now background knowledge, statistical data and legal expertise that could otherwise be brought to bear. The dataset is partitioned into a training set featuring 27 mobile applications and 1350 questions, and a test set consisting of 400 questions over 8 policy documents. This ensures that documents in training and test splits are mutually exclusive. Every question is answered by at least one expert. In addition, in order to estimate annotation reliability and provide for better evaluation, every question in the test set is answered by at least two additional experts.
Table TABREF14 describes the distribution over first words of questions posed by crowdworkers. We also observe low redundancy in the questions posed by crowdworkers over each policy, with each policy receiving ~49.94 unique questions despite crowdworkers independently posing questions. Questions are on average 8.4 words long. As declining to answer a question can be a legally sound response but is seldom practically useful, answers to questions where a minority of experts abstain to answer are filtered from the dataset. Privacy policies are ~3000 words long on average. The answers to the question asked by the users typically have ~100 words of evidence in the privacy policy document.
Data Collection ::: Analysis ::: Categories of Questions
Questions are organized under nine categories from the OPP-115 Corpus annotation scheme BIBREF49:
First Party Collection/Use: What, why and how information is collected by the service provider
Third Party Sharing/Collection: What, why and how information shared with or collected by third parties
Data Security: Protection measures for user information
Data Retention: How long user information will be stored
User Choice/Control: Control options available to users
User Access, Edit and Deletion: If/how users can access, edit or delete information
Policy Change: Informing users if policy information has been changed
International and Specific Audiences: Practices pertaining to a specific group of users
Other: General text, contact information or practices not covered by other categories.
For each question, domain experts indicate one or more relevant OPP-115 categories. We mark a category as relevant to a question if it is identified as such by at least two annotators. If no such category exists, the category is marked as `Other' if atleast one annotator has identified the `Other' category to be relevant. If neither of these conditions is satisfied, we label the question as having no agreement. The distribution of questions in the corpus across OPP-115 categories is as shown in Table.TABREF16. First party and third party related questions are the largest categories, forming nearly 66.4% of all questions asked to the privacy assistant.
Data Collection ::: Analysis ::: Answer Validation
When do experts disagree? We would like to analyze the reasons for potential disagreement on the annotation task, to ensure disagreements arise due to valid differences in opinion rather than lack of adequate specification in annotation guidelines. It is important to note that the annotators are experts rather than crowdworkers. Accordingly, their judgements can be considered valid, legally-informed opinions even when their perspectives differ. For the sake of this question we randomly sample 100 instances in the test data and analyze them for likely reasons for disagreements. We consider a disagreement to have occurred when more than one expert does not agree with the majority consensus. By disagreement we mean there is no overlap between the text identified as relevant by one expert and another.
We find that the annotators agree on the answer for 74% of the questions, even if the supporting evidence they identify is not identical i.e full overlap. They disagree on the remaining 26%. Sources of apparent disagreement correspond to situations when different experts: have differing interpretations of question intent (11%) (for example, when a user asks 'who can contact me through the app', the questions admits multiple interpretations, including seeking information about the features of the app, asking about first party collection/use of data or asking about third party collection/use of data), identify different sources of evidence for questions that ask if a practice is performed or not (4%), have differing interpretations of policy content (3%), identify a partial answer to a question in the privacy policy (2%) (for example, when the user asks `who is allowed to use the app' a majority of our annotators decline to answer, but the remaining annotators highlight partial evidence in the privacy policy which states that children under the age of 13 are not allowed to use the app), and other legitimate sources of disagreement (6%) which include personal subjective views of the annotators (for example, when the user asks `is my DNA information used in any way other than what is specified', some experts consider the boilerplate text of the privacy policy which states that it abides to practices described in the policy document as sufficient evidence to answer this question, whereas others do not).
Experimental Setup
We evaluate the ability of machine learning methods to identify relevant evidence for questions in the privacy domain. We establish baselines for the subtask of deciding on the answerability (§SECREF33) of a question, as well as the overall task of identifying evidence for questions from policies (§SECREF37). We describe aspects of the question that can render it unanswerable within the privacy domain (§SECREF41).
Experimental Setup ::: Answerability Identification Baselines
We define answerability identification as a binary classification task, evaluating model ability to predict if a question can be answered, given a question in isolation. This can serve as a prior for downstream question-answering. We describe three baselines on the answerability task, and find they considerably improve performance over a majority-class baseline.
SVM: We define 3 sets of features to characterize each question. The first is a simple bag-of-words set of features over the question (SVM-BOW), the second is bag-of-words features of the question as well as length of the question in words (SVM-BOW + LEN), and lastly we extract bag-of-words features, length of the question in words as well as part-of-speech tags for the question (SVM-BOW + LEN + POS). This results in vectors of 200, 201 and 228 dimensions respectively, which are provided to an SVM with a linear kernel.
CNN: We utilize a CNN neural encoder for answerability prediction. We use GloVe word embeddings BIBREF50, and a filter size of 5 with 64 filters to encode questions.
BERT: BERT BIBREF51 is a bidirectional transformer-based language-model BIBREF52. We fine-tune BERT-base on our binary answerability identification task with a learning rate of 2e-5 for 3 epochs, with a maximum sequence length of 128.
Experimental Setup ::: Privacy Question Answering
Our goal is to identify evidence within a privacy policy for questions asked by a user. This is framed as an answer sentence selection task, where models identify a set of evidence sentences from all candidate sentences in each policy.
Experimental Setup ::: Privacy Question Answering ::: Evaluation Metric
Our evaluation metric for answer-sentence selection is sentence-level F1, implemented similar to BIBREF30, BIBREF16. Precision and recall are implemented by measuring the overlap between predicted sentences and sets of gold-reference sentences. We report the average of the maximum F1 from each n$-$1 subset, in relation to the heldout reference.
Experimental Setup ::: Privacy Question Answering ::: Baselines
We describe baselines on this task, including a human performance baseline.
No-Answer Baseline (NA) : Most of the questions we receive are difficult to answer in a legally-sound way on the basis of information present in the privacy policy. We establish a simple baseline to quantify the effect of identifying every question as unanswerable.
Word Count Baseline : To quantify the effect of using simple lexical matching to answer the questions, we retrieve the top candidate policy sentences for each question using a word count baseline BIBREF53, which counts the number of question words that also appear in a sentence. We include the top 2, 3 and 5 candidates as baselines.
BERT: We implement two BERT-based baselines BIBREF51 for evidence identification. First, we train BERT on each query-policy sentence pair as a binary classification task to identify if the sentence is evidence for the question or not (Bert). We also experiment with a two-stage classifier, where we separately train the model on questions only to predict answerability. At inference time, if the answerable classifier predicts the question is answerable, the evidence identification classifier produces a set of candidate sentences (Bert + Unanswerable).
Human Performance: We pick each reference answer provided by an annotator, and compute the F1 with respect to the remaining references, as described in section 4.2.1. Each reference answer is treated as the prediction, and the remaining n-1 answers are treated as the gold reference. The average of the maximum F1 across all reference answers is computed as the human baseline.
Results and Discussion
The results of the answerability baselines are presented in Table TABREF31, and on answer sentence selection in Table TABREF32. We observe that bert exhibits the best performance on a binary answerability identification task. However, most baselines considerably exceed the performance of a majority-class baseline. This suggests considerable information in the question, indicating it's possible answerability within this domain.
Table.TABREF32 describes the performance of our baselines on the answer sentence selection task. The No-answer (NA) baseline performs at 28 F1, providing a lower bound on performance at this task. We observe that our best-performing baseline, Bert + Unanswerable achieves an F1 of 39.8. This suggest that bert is capable of making some progress towards answering questions in this difficult domain, while still leaving considerable headroom for improvement to reach human performance. Bert + Unanswerable performance suggests that incorporating information about answerability can help in this difficult domain. We examine this challenging phenomena of unanswerability further in Section .
Results and Discussion ::: Error Analysis
Disagreements are analyzed based on the OPP-115 categories of each question (Table.TABREF34). We compare our best performing BERT variant against the NA model and human performance. We observe significant room for improvement across all categories of questions but especially for first party, third party and data retention categories.
We analyze the performance of our strongest BERT variant, to identify classes of errors and directions for future improvement (Table.8). We observe that a majority of answerability mistakes made by the BERT model are questions which are in fact answerable, but are identified as unanswerable by BERT. We observe that BERT makes 124 such mistakes on the test set. We collect expert judgments on relevance, subjectivity , silence and information about how likely the question is to be answered from the privacy policy from our experts. We find that most of these mistakes are relevant questions. However many of them were identified as subjective by the annotators, and at least one annotator marked 19 of these questions as having no answer within the privacy policy. However, only 6 of these questions were unexpected or do not usually have an answer in privacy policies. These findings suggest that a more nuanced understanding of answerability might help improve model performance in his challenging domain.
Results and Discussion ::: What makes Questions Unanswerable?
We further ask legal experts to identify potential causes of unanswerability of questions. This analysis has considerable implications. While past work BIBREF17 has treated unanswerable questions as homogeneous, a question answering system might wish to have different treatments for different categories of `unanswerable' questions. The following factors were identified to play a role in unanswerability:
Incomprehensibility: If a question is incomprehensible to the extent that its meaning is not intelligible.
Relevance: Is this question in the scope of what could be answered by reading the privacy policy.
Ill-formedness: Is this question ambiguous or vague. An ambiguous statement will typically contain expressions that can refer to multiple potential explanations, whereas a vague statement carries a concept with an unclear or soft definition.
Silence: Other policies answer this type of question but this one does not.
Atypicality: The question is of a nature such that it is unlikely for any policy policy to have an answer to the question.
Our experts attempt to identify the different `unanswerable' factors for all 573 such questions in the corpus. 4.18% of the questions were identified as being incomprehensible (for example, `any difficulties to occupy the privacy assistant'). Amongst the comprehendable questions, 50% were identified as likely to have an answer within the privacy policy, 33.1% were identified as being privacy-related questions but not within the scope of a privacy policy (e.g., 'has Viber had any privacy breaches in the past?') and 16.9% of questions were identified as completely out-of-scope (e.g., `'will the app consume much space?'). In the questions identified as relevant, 32% were ill-formed questions that were phrased by the user in a manner considered vague or ambiguous. Of the questions that were both relevant as well as `well-formed', 95.7% of the questions were not answered by the policy in question but it was reasonable to expect that a privacy policy would contain an answer. The remaining 4.3% were described as reasonable questions, but of a nature generally not discussed in privacy policies. This suggests that the answerability of questions over privacy policies is a complex issue, and future systems should consider each of these factors when serving user's information seeking intent.
We examine a large-scale dataset of “natural” unanswerable questions BIBREF54 based on real user search engine queries to identify if similar unanswerability factors exist. It is important to note that these questions have previously been filtered, according to a criteria for bad questions defined as “(questions that are) ambiguous, incomprehensible, dependent on clear false presuppositions, opinion-seeking, or not clearly a request for factual information.” Annotators made the decision based on the content of the question without viewing the equivalent Wikipedia page. We randomly sample 100 questions from the development set which were identified as unanswerable, and find that 20% of the questions are not questions (e.g., “all I want for christmas is you mariah carey tour”). 12% of questions are unlikely to ever contain an answer on Wikipedia, corresponding closely to our atypicality category. 3% of questions are unlikely to have an answer anywhere (e.g., `what guides Santa home after he has delivered presents?'). 7% of questions are incomplete or open-ended (e.g., `the south west wind blows across nigeria between'). 3% of questions have an unresolvable coreference (e.g., `how do i get to Warsaw Missouri from here'). 4% of questions are vague, and a further 7% have unknown sources of error. 2% still contain false presuppositions (e.g., `what is the only fruit that does not have seeds?') and the remaining 42% do not have an answer within the document. This reinforces our belief that though they have been understudied in past work, any question answering system interacting with real users should expect to receive such unanticipated and unanswerable questions.
Conclusion
We present PrivacyQA, the first significant corpus of privacy policy questions and more than 3500 expert annotations of relevant answers. The goal of this work is to promote question-answering research in the specialized privacy domain, where it can have large real-world impact. Strong neural baselines on PrivacyQA achieve a performance of only 39.8 F1 on this corpus, indicating considerable room for future research. Further, we shed light on several important considerations that affect the answerability of questions. We hope this contribution leads to multidisciplinary efforts to precisely understand user intent and reconcile it with information in policy documents, from both the privacy and NLP communities.
Acknowledgements
This research was supported in part by grants from the National Science Foundation Secure and Trustworthy Computing program (CNS-1330596, CNS-1330214, CNS-15-13957, CNS-1801316, CNS-1914486, CNS-1914444) and a DARPA Brandeis grant on Personalized Privacy Assistants (FA8750-15-2-0277). The US Government is authorized to reproduce and distribute reprints for Governmental purposes not withstanding any copyright notation. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of the NSF, DARPA, or the US Government. The authors would like to extend their gratitude to Elias Wright, Gian Mascioli, Kiara Pillay, Harrison Kay, Eliel Talo, Alexander Fagella and N. Cameron Russell for providing their valuable expertise and insight to this effort. The authors are also grateful to Eduard Hovy, Lorrie Cranor, Florian Schaub, Joel Reidenberg, Aditya Potukuchi and Igor Shalyminov for helpful discussions related to this work, and to the three anonymous reviewers of this draft for their constructive feedback. Finally, the authors would like to thank all crowdworkers who consented to participate in this study.

 Answer the question based on the above article as concisely as you can, using a single phrase or sentence if possible. If the question cannot be answered based on the information in the article, write "unanswerable". If the question is a yes/no question, answer "yes", "no", or "unanswerable". Do not provide any explanation.

Question: Who were the experts used for annotation?

Answer: