Download Information Retrieval Performance, Lecture Slides - Computer Science and more Slides Artificial Intelligence in PDF only on Docsity!
Week 4
Evaluation of IR Performance
- (IIR Chapter 8)
- Evaluation Metrics
- Test Collections
Query Refinement
- (IIR Chapter 9)
- Query Expansion
- Relevance Feedback
Relevance
In what ways can a document be relevant
to a query?
- Answer question precisely (or partially)
- Suggest a source for more information
- Give background information
- Remind the user of other knowledge
Degree of Relevance
- Binary: relevant or not?
- On a scale: 0-
Intrinsic or Subjective
What to Evaluate?
What can be measured that reflects
users’ ability to use system? (Cleverdon 66)
- Coverage of Information
- Form of Presentation
- Effort required/Ease of Use
- Time and Space Efficiency
- Recall
- proportion of relevant material actually retrieved
- Precision
- proportion of retrieved material actually relevant
Problems with Precision/Recall
Can’t know true recall value
- except in small collections
Precision/Recall measure different
aspects of search quality
- A combined measure sometimes is more
appropriate
Focused somewhat on set evaluation vs.
ranked lists
Precision/Recall Curves There is a tradeoff between precision and recall So measure precision at different levels of recall
- Interpolate
- Average over multiple queries precision recall x x x x x x x x x x x Which of these three curves is better?
Existing Test Collections
Historical, Small
– CACM (3204), CISI (1460), CRAN (1397)
– INSPEC (12684), MED (1033), REUTERS (21578)
More recent
- TREC: 1.5M newsprint; 10/18/100GB Web; 1 TB
- CLEF: 1M+ newspaper articles from 1994 – 1995, 13 langs
- NTCIR: Asian languages (JP, KR, ZH)
- FIRE: Hindi, Marathi, Bengali (about 100k docs each)
- Reuters RV1 (880,000)
Text REtrieval Conference (TREC)
Annual bake-off for text retrieval systems
Sponsored by
Roughly 2.5 gigabytes of text, newswire
- 50 “topics” (queries)
- Return top 1000 documents per topic (~80 groups)
- Results judged by retired intelligence analysts
- Documents are relevant or not
Numerous tracks
- Cross-Language
- Spoken Documents
- Question Answering
http://trec.nist.gov/
Sample TREC Topic
Number: 285 Topic: World submarine forces <desc> Description: Determine the number of submarines, both nuclear-powered and conventional, presently in the inventories of all the countries in the world. <narr> Narrative: We are looking for a count of operable submarines in any country that currently has a navy with submarines. To be relevant a document should give a specific number of submarines, but not necessarily its entire fleet of submarines (although, that is our ultimate goal). A report of a French submarine suffering a mishap in the North sea would not be relevant. However, a report of a new submarine being built in Shanghai that contains other valuable information, such as “this is the third reported unit constructed at this base” would be relevant. Any information that would be considered useful as an intelligence tool in determining a country’s submarine order of battle would be relevant. </top> SGML Markup Short Phrase Sentence Paragraph</p> <h2>How Test Runs are Evaluated</h2> <p> <strong>First ranked doc is relevant, which is 10% of the total relevant. Therefore Precision at the 10% Recall level is 100%</strong> <strong>Next Relevant gives us 66% Precision at 20% recall level</strong> <strong>Etc….</strong></p> <h3>1. d 123 *</h3> <h3>2. d 84</h3> <h3>3. d 56 *</h3> <h3>4. d 6</h3> <h3>5. d 8</h3> <h3>6. d 9 *</h3> <h3>7. d 511</h3> <h3>8. d 129</h3> <h3>9. d 187</h3> <h3>10. d 25 *</h3> <h3>11. d 38</h3> <h3>12. d 48</h3> <h3>13. d 250</h3> <h3>14. d 113</h3> <h3>15. d 3 *</h3> <p>Rq={d 3 ,d 5 ,d 9 ,d 25 ,d 39 ,d 44 ,d 56 ,d 71 ,d 89 ,d 123 } : 10 Relevant Example from Chapter 3 in MIR</p> <h2>Interpolation</h2> <h3> So, at recall levels 0%, 10%, 20%, and</h3> <h3>30% the interpolated precision is 33.3%</h3> <h3> At recall levels 40%, 50%, and 60%</h3> <h3>interpolated precision is 25%</h3> <h3> And at recall levels 70%, 80%, 90% and</h3> <h3>100%, interpolated precision is 20%</h3> <h3> Giving graph…</h3> <p><strong>X</strong></p> <h2>Interpolation</h2> <h5>P R E C I S I O N</h5> <h5>RECALL</h5> <p><strong>X X</strong></p> <h2>Computing Average Precision</h2> <p> <strong>We sum over the 5 seen relevant documents</strong> <strong>(1 + 0.66 + 0.5 + 0.4 + 0.3)</strong> <strong>We must divide by the number of relevant (10 docs)</strong></p> <ul> <li><strong>5 relevant document’s weren’t</strong> <strong>observed</strong> <strong>Average Precision is 0.</strong> <strong><em>Mean</em></strong> <strong>average precision is an average over multiple queries</strong></li> </ul> <h2>1. d 123 *</h2> <h2>2. d 84</h2> <h2>3. d 56 *</h2> <h2>4. d 6</h2> <h2>5. d 8</h2> <h2>6. d 9 *</h2> <h2>7. d 511</h2> <h2>8. d 129</h2> <h2>9. d 187</h2> <h2>10. d 25 *</h2> <h2>11. d 38</h2> <h2>12. d 48</h2> <h2>13. d 250</h2> <h2>14. d 113</h2> <h2>15. d 3 *</h2> <p>Rq={d 3 ,d 5 ,d 9 ,d 25 ,d 39 ,d 44 ,d 56 ,d 71 ,d 89 ,d 123 } : 10 Relevant</p> <h2>Using TREC_EVAL</h2> <h4> Developed from SMART evaluation programs</h4> <h4>for use in TREC</h4> <ul> <li><strong>trec_eval [-q] [-a] [-d] trec_qrel_file top_ranked_file</strong></li> </ul> <h4> Uses:</h4> <ul> <li><strong>List of top-ranked documents</strong> <ul> <li><strong>QID iter docno rank sim runid</strong></li> <li><strong>030 Q0 ZF08-175-870 0 4238 prise</strong></li> </ul></li> <li><strong>QRELS file for collection</strong> <ul> <li><strong>QID docno rel</strong></li> <li><strong>251 0 FT911-1003 1</strong></li> <li><strong>251 0 FT911-101 1</strong></li> <li><strong>251 0 FT911-1300 0</strong></li> </ul></li> </ul> <h2>Query Refinement</h2> <h3> Global Methods</h3> <ul> <li><strong>Context independent thesaurus expansion</strong></li> </ul> <h3> Local Methods</h3> <ul> <li><strong>Manual Feedback</strong></li> <li><strong>Automated Relevance Feedback</strong></li> </ul> <h2>Query Modification</h2> <h3> Problem: how to reformulate the query?</h3> <ul> <li><strong>Thesaurus expansion:</strong> <ul> <li><strong>Suggest terms similar to query terms</strong></li> <li><strong>Global method: see car, add ‘automobile’</strong></li> </ul></li> <li><strong>Relevance feedback:</strong> <ul> <li><strong>Suggest terms (and documents) similar to</strong> <strong>retrieved documents that have been judged (by a</strong> <strong>user) to be relevant (or use top k documents)</strong></li> <li><strong>Local method: based on retrieved document set</strong></li> </ul></li> <li><strong>Term re-weighting</strong></li> </ul> <h2>Thesauri</h2> <h3> Some electronic thesauri exist</h3> <ul> <li><strong>E.g., Roget’s</strong></li> <li><strong>Domain specific thesauri (e.g., chemistry)</strong> <ul> <li><strong>might map NaCl, salt, sodium chloride</strong></li> </ul></li> </ul> <h3> Other approach is to induce one from a</h3> <h3>collection of text, statistically</h3> <ul> <li><strong>Can capture synonymy</strong></li> <li><strong>But, might also get other word relations</strong></li> </ul> <h3> My opinion</h3> <ul> <li><strong>Thesaurus-based query expansion is best</strong></li> </ul> <h4>with controlled vocabulary search</h4> <h2>Automagically building thesauri</h2> <h3> Church (“One Term or Two”, SIGIR 1995)</h3> <h3>looked at correlations between forms of</h3> <h3>words in texts</h3> <h3> If hostage and hostages both occur in a</h3> <h3>document</h3> <ul> <li><strong>Worth more than single occurrence, but less</strong></li> </ul> <h4>than two. Possibly 1.</h4> <h3> Church proposes novel term weighting</h3> <h3>scheme</h3> <p><strong>hostages! hostages hostage 619 479 ! hostage 648 78,</strong></p> <h2>Lexical Associations</h2> <p> <strong>Subjects write first word that comes to mind</strong></p> <ul> <li><strong>doctor/nurse; black/white (Palermo & Jenkins 64)</strong></li> <li><strong>Text corpora yield similar associations</strong> <strong>One measure: Mutual Information</strong></li> <li><strong>See Church and Hanks (Comp. Ling. ’90)</strong> <strong>If word occurrences are independent, the numerator and denominator become equal</strong></li> <li><strong>when measured across a large collection</strong></li> </ul> <h2>Associations with “Doctor”</h2> <h4>(AP Corpus, N=15 million, Church & Hanks)</h4> <p><strong>MI(x,y) f(x,y) f(x) x f(y) y</strong> 11.3 12 111 honorary 621 doctor 11.3 8 1105 doctors 44 dentists 10.7 30 1105 doctors 241 nurses 9.4 8 1105 doctors 154 treating 9.0 6 275 examined 621 doctor 8.9 11 11.05 doctors 317 treat 8.7 25 621 doctor 1407 bills 0.96 6 621 doctor 73785 with 0.95 41 284690 a 1105 doctors 0.93 12 84716 is 1105 doctors</p> <h2>Term Similarity Calculations</h2> <p> <strong>Multiple metrics possible</strong></p> <ul> <li><strong>See Chung & Lee, JASIST</strong> <strong>52(4), 2001 for comparison</strong> <strong>Contingency table Present Absent Present a b a+b Absent c d c+d a+c b+d N snow plow</strong></li> </ul> <h2>Relevance Feedback</h2> <h3> Main Idea:</h3> <ul> <li><strong>Modify existing query based on relevance</strong></li> </ul> <h4>judgments</h4> <ul> <li><strong>Extract terms from relevant documents and add</strong> <strong>them to the query</strong></li> <li><strong>and/or re-weight the terms already in the query</strong></li> <li><strong>Manually</strong></li> <li><strong>Users select relevant documents</strong></li> <li><strong>Users/system select terms from an automatically- generated list</strong></li> <li><strong>Automated (blind/pseudo) rel. feedback</strong></li> <li><strong>Assume top</strong> <strong><em>k</em></strong> <strong>docs are relevant (e.g., 5 to 20)</strong></li> </ul> </div></div></div></div><footer id="footer" class="sc-gsnTZi hxUvtc"><div width="100%" display="grid" class="sc-gsnTZi sc-breuTD hQDdiS hAbyOH"><div class="sc-gsnTZi sc-ksZaOG hINUYJ ijDdyb"><p color="muted" class="sc-dkzDqf jtFJUi">University</p><div width="100%" display="grid" class="sc-gsnTZi sc-breuTD jxbiSy ddZtgY"><div class="sc-gsnTZi sc-ksZaOG hINUYJ dPsdkt"><a href="/en/university/us/" color="negative" class="sc-dkzDqf liUIpz">United States of America (USA)</a></div><div class="sc-gsnTZi sc-ksZaOG hINUYJ dPsdkt"><a href="/en/university/ph/" color="negative" class="sc-dkzDqf liUIpz">Philippines</a></div><div class="sc-gsnTZi sc-ksZaOG hINUYJ dPsdkt"><a href="/en/university/in/" color="negative" class="sc-dkzDqf liUIpz">India</a></div><div class="sc-gsnTZi sc-ksZaOG hINUYJ dPsdkt"><a href="/en/university/vn/" color="negative" class="sc-dkzDqf liUIpz">Vietnam</a></div><div class="sc-gsnTZi sc-ksZaOG hINUYJ dPsdkt"><a href="/en/university/gb/" color="negative" class="sc-dkzDqf liUIpz">United Kingdom</a></div><div class="sc-gsnTZi sc-ksZaOG hINUYJ dPsdkt"><a href="/en/university/ca/" color="negative" class="sc-dkzDqf liUIpz">Canada</a></div><div class="sc-gsnTZi sc-ksZaOG hINUYJ dPsdkt"><a href="/en/university/tr/" color="negative" class="sc-dkzDqf liUIpz">Turkey</a></div><div class="sc-gsnTZi sc-ksZaOG hINUYJ dPsdkt"><a href="/en/university/id/" color="negative" class="sc-dkzDqf liUIpz">Indonesia</a></div></div></div><div class="sc-gsnTZi sc-ksZaOG hINUYJ ijDdyb"><p color="muted" class="sc-dkzDqf jtFJUi">questions</p><div width="100%" display="grid" class="sc-gsnTZi sc-breuTD jxbiSy ddZtgY"><div class="sc-gsnTZi sc-ksZaOG hINUYJ dPsdkt"><a href="/en/answers/" color="negative" class="sc-dkzDqf liUIpz">Latest questions</a></div><div class="sc-gsnTZi sc-ksZaOG hINUYJ dPsdkt"><a href="/en/answers/biology-and-chemistry/" color="negative" class="sc-dkzDqf liUIpz">Biology and Chemistry</a></div><div class="sc-gsnTZi sc-ksZaOG hINUYJ dPsdkt"><a href="/en/answers/psicology-and-sociology/" color="negative" class="sc-dkzDqf liUIpz">Psychology and Sociology</a></div><div class="sc-gsnTZi sc-ksZaOG hINUYJ dPsdkt"><a href="/en/answers/management/" color="negative" class="sc-dkzDqf liUIpz">Management</a></div><div class="sc-gsnTZi sc-ksZaOG hINUYJ dPsdkt"><a href="/en/answers/physics/" color="negative" class="sc-dkzDqf liUIpz">Physics</a></div></div></div></div><div class="sc-gsnTZi dfEwCf"><img src="https://assets.docsity.com/ds/logo/docsity-logo-rebrand-negativo.svg" alt="Docsity logo" width="269px" height="120px" class="sc-crXcEl kmMsfS"/></div><div direction="row" class="sc-bczRLJ iznJYF"><a color="negative" target="_self" href="/en/ai/explore-ai/" class="sc-dkzDqf liUIpz">Docsity AI</a><a color="negative" target="_self" href="/en/store/sell/" class="sc-dkzDqf liUIpz">Sell documents</a><a color="negative" target="_blank" href="https://corporate.docsity.com/about-us/" class="sc-dkzDqf liUIpz">About us</a><a color="negative" target="_blank" href="https://support.docsity.com/hc/en-us" class="sc-dkzDqf liUIpz">Contact us</a><a color="negative" target="_blank" href="https://corporate.docsity.com/docsity-partners/" class="sc-dkzDqf liUIpz">Partners</a><a color="negative" target="_self" href="/en/pag/how-does-docsity-works/" class="sc-dkzDqf liUIpz">How does Docsity work</a><a color="negative" target="_blank" href="https://www.weuni.com/en/" class="sc-dkzDqf liUIpz">WeUni</a></div><div class="sc-gsnTZi ktkVSn"><div direction="row" class="sc-bczRLJ iznJYF"><a color="negative" target="_self" href="/es/universidad/es/" class="sc-dkzDqf liUIpz">Español</a><a color="negative" target="_self" href="/it/universita/it/" class="sc-dkzDqf liUIpz">Italiano</a><a color="negative" target="_self" href="/en/university/us/" class="sc-dkzDqf liUIpz">English</a><a color="negative" target="_self" href="/sr/univerzitet/sr/" class="sc-dkzDqf liUIpz">Srpski</a><a color="negative" target="_self" href="/pl/uniwersytet/pl/" class="sc-dkzDqf liUIpz">Polski</a><a color="negative" target="_self" href="/ru/universitet/ru/" class="sc-dkzDqf liUIpz">Русский</a><a color="negative" target="_self" href="/pt/universidade/br/" class="sc-dkzDqf liUIpz">Português</a><a color="negative" target="_self" href="/fr/universite/fr/" class="sc-dkzDqf liUIpz">Français</a><a color="negative" target="_self" href="/de/universitat/de/" class="sc-dkzDqf liUIpz">Deutsch</a></div></div><div class="sc-gsnTZi fHZVwh"><div direction="row" class="sc-bczRLJ iznJYF"><a color="negative" target="_self" href="/en/usa/" class="sc-dkzDqf liUIpz">United States of America (USA)</a><a color="negative" target="_self" href="/en/phl/" class="sc-dkzDqf liUIpz">Philippines</a><a color="negative" target="_self" href="/en/ind/" class="sc-dkzDqf liUIpz">India</a><a color="negative" target="_self" href="/en/vnm/" class="sc-dkzDqf liUIpz">Vietnam</a><a color="negative" target="_self" href="/en/gbr/" class="sc-dkzDqf liUIpz">United Kingdom</a><a color="negative" target="_self" href="/en/can/" class="sc-dkzDqf liUIpz">Canada</a><a color="negative" target="_self" href="/en/tur/" class="sc-dkzDqf liUIpz">Turkey</a><a color="negative" target="_self" href="/en/idn/" class="sc-dkzDqf liUIpz">Indonesia</a></div></div><div class="sc-gsnTZi dNwUEv"><div direction="row" class="sc-bczRLJ gIiniM"><button display="flex" aria-label="Google play store" class="sc-gsnTZi gTkYJ"><img src="https://assets.docsity.com/sdk/common/app/google/GooglePlayBadge_EN.svg" alt="Google play badge" width="135px" height="40px"/></button><button display="flex" aria-label="App store" class="sc-gsnTZi gTkYJ"><img src="https://assets.docsity.com/sdk/common/app/apple/AppStoreBadge_EN.svg" alt="App store badge" width="120px" height="40px"/></button></div></div><div display="flex" class="sc-gsnTZi gCHycu"><div direction="row" class="sc-bczRLJ iznJYF"><a color="negative" target="_self" href="/en/pag/terms-and-conditions/" class="sc-dkzDqf liUIpz">Terms of Use</a><a color="negative" target="_self" href="/en/pag/cookie-policy/" class="sc-dkzDqf liUIpz">Cookie Policy</a><button color="negative" target="_self" class="sc-dkzDqf liUIpz">Cookie setup</button><a color="negative" target="_self" href="/en/pag/privacy/" class="sc-dkzDqf liUIpz">Privacy Policy</a></div><div direction="row" class="sc-bczRLJ iznJYF"><a href="https://www.facebook.com/DocsityGlobal" target="_blank" aria-label="facebook" color="inherit" class="sc-dkzDqf kUmfEV"><span class="sc-iIPllB jjxFtg"><svg xmlns="http://www.w3.org/2000/svg" width="1em" height="1em" fill="currentColor" viewBox="0 0 256 256"><path d="M128,20A108,108,0,1,0,236,128,108.12,108.12,0,0,0,128,20Zm12,191.13V156h20a12,12,0,0,0,0-24H140V112a12,12,0,0,1,12-12h16a12,12,0,0,0,0-24H152a36,36,0,0,0-36,36v20H96a12,12,0,0,0,0,24h20v55.13a84,84,0,1,1,24,0Z"></path></svg></span></a><a href="https://www.instagram.com/docsity_en/" target="_blank" aria-label="instagram" color="inherit" class="sc-dkzDqf kUmfEV"><span class="sc-iIPllB jjxFtg"><svg xmlns="http://www.w3.org/2000/svg" width="1em" height="1em" fill="currentColor" viewBox="0 0 256 256"><path d="M128,80a48,48,0,1,0,48,48A48.05,48.05,0,0,0,128,80Zm0,72a24,24,0,1,1,24-24A24,24,0,0,1,128,152ZM176,20H80A60.07,60.07,0,0,0,20,80v96a60.07,60.07,0,0,0,60,60h96a60.07,60.07,0,0,0,60-60V80A60.07,60.07,0,0,0,176,20Zm36,156a36,36,0,0,1-36,36H80a36,36,0,0,1-36-36V80A36,36,0,0,1,80,44h96a36,36,0,0,1,36,36ZM196,76a16,16,0,1,1-16-16A16,16,0,0,1,196,76Z"></path></svg></span></a><a href="https://www.linkedin.com/company/docsity-com/" target="_blank" aria-label="linkedin" color="inherit" class="sc-dkzDqf kUmfEV"><span class="sc-iIPllB jjxFtg"><svg xmlns="http://www.w3.org/2000/svg" width="1em" height="1em" fill="currentColor" viewBox="0 0 256 256"><path d="M216,20H40A20,20,0,0,0,20,40V216a20,20,0,0,0,20,20H216a20,20,0,0,0,20-20V40A20,20,0,0,0,216,20Zm-4,192H44V44H212ZM112,176V120a12,12,0,0,1,21.43-7.41A40,40,0,0,1,192,148v28a12,12,0,0,1-24,0V148a16,16,0,0,0-32,0v28a12,12,0,0,1-24,0ZM96,120v56a12,12,0,0,1-24,0V120a12,12,0,0,1,24,0ZM68,80A16,16,0,1,1,84,96,16,16,0,0,1,68,80Z"></path></svg></span></a></div><div direction="row" class="sc-bczRLJ iznJYF"><a color="negative" target="_self" href="/en/sitemap/better/" class="sc-dkzDqf liUIpz">Sitemap Resources</a><a color="negative" target="_self" href="/en/sitemap/latest/" class="sc-dkzDqf liUIpz">Sitemap Latest Documents</a><a color="negative" target="_self" href="/en/sitemap/country/" class="sc-dkzDqf liUIpz">Sitemap Languages and Countries</a></div><p color="muted" class="sc-dkzDqf exhynh">Copyright © 2026 Ladybird Srl - Via Leonardo da Vinci 16, 10126, Torino, Italy - VAT 10816460017 - All rights reserved</p></div></footer><div id="modal-area"></div><div width="unset,360px" overflow="hidden" class="sc-gsnTZi GrWcS"></div></div><script id="__NEXT_DATA__" type="application/json">{"props":{"pageProps":{"currentUrl":"/en/docs/information-retrieval-performance-lecture-slides-computer-science/38683/","currentRoute":"document.view","currentUser":null,"translations":{"alerts.action_spacer":"or","alerts.back_lang.action":"Back to %s language","alerts.complete_profile.link":"Complete profile","alerts.complete_profile.text":"Help us recommend the best content for you and receive instantly **%s download points**","alerts.confirm_email.action_modifica":"Change email address","alerts.confirm_email.action_reinvia":"Resend email.","alerts.confirm_email.text":"Confirm your email address by clicking on the link we sent you at %s.","alerts.diff_lang.action":"Click here","alerts.diff_lang.text":"You are browsing in a language other than your own","alerts.invalid_email.action_modifica":"Change email","alerts.invalid_email.action_resend":"Resend email","alerts.invalid_email.text":"We are unable to send the confirmation email to your address: **%s**","alerts.low_points.action":"Get points immediately","alerts.low_points.main":"You are running out of Download Points.","common.date.formatAcademicYear":"Pre %s","completeProfile.form_label":"Birth year","completeProfile.form_label_cta":"Confirm data","completeProfile.label_cta":"Start now","completeProfile.text_default_1":"You'll earn % points","completeProfile.text_default_2":"to download documents and gain access to free Video Courses and Quizzes","completeProfile.text_default_3":"to download documents","completeProfile.text_guest":"To proceed, enter the missing data","completeProfile.title_default":"Update your profile to continue","completeProfile.title_guest":"Oops, looks like you missed something!","docProfessorModal.disclaimer":"The page is generated automatically and is not managed by a person (the Professor or anyone else). The documents listed are not official or representative of the teaching methods and contents of the Professor in question. They are automatically aggregated according to criteria entered by users. The personal data relating to the Professor contained in this page have been collected by the Data Controller (Ladybird s.r.l.) from open sources accessible to the public and / or have been generated directly by the users. The goal is to enrich the contents of the platform for the legitimate interest of Ladybird s.r.l. to improve its usability for the benefit of its users. They will be stored until any opposition to the processing by the interested party, who is entitled to oppose the processing for reasons related to their particular situation, except for the provisions of art. 21 § 1, Paragraph 2, GDPR. For more information on the categories of recipients of the personal data and the additional rights of the data subject, please refer to sections B and H respectively of the Docsity privacy policy available at this [link](%s)","docs.abstractArea.documents":"Documents","docs.abstractArea.seoString":"Download %1$s and more %2$s %3$s in PDF only on Docsity!","docs.abstractArea.thisSubject":"This subject","docs.abstractArea.title":"Partial preview of the text","docs.actionSection.disabledByLanguageUser":"Only %s Docsity users can download this document","docs.actionSection.disabledByUserNotSeller":"We have received reports about this document. The download is temporarily disabled.","docs.actions.addFavourite":"Add to favourites","docs.actions.approveDocument":"Approve Document","docs.actions.approveDocument.force":"Force document approval","docs.actions.cannotEditPrime":"This document can no longer be modified because it has been promoted as a Top Document","docs.actions.deleteDocument":"Delete","docs.actions.download":"Download","docs.actions.downloadDocuemnt":"Download the document","docs.actions.edit":"Edit","docs.actions.follow":"Follow","docs.actions.reconvertDocument.errorMessage":"Error during the request","docs.actions.reconvertDocument.label":"Convert the document","docs.actions.reconvertDocument.successMessage":"Conversion successfully completed","docs.actions.remove":"Remove","docs.actions.removeFavourite":"Remove from favourites","docs.actions.reportDocument":"Report document","docs.actions.requestError":"An error has occurred","docs.actions.requestSuccess":"Request submitted, wait a few seconds and reload the page","docs.actions.review":"Leave a review","docs.actions.save":"Save","docs.actions.shareDocTooltip":"Share document","docs.actions.shareLabel":"Share","docs.actions.unfollow":"Unfollow","docs.actions.useAI":"Try Docsity AI","docs.actions.watchReview":"Your review","docs.aiOffCanvas.aiAlertFreemium":"**Free trial on %s documents or use without limits with Premium**","docs.aiOffCanvas.aiCtaDownload":"Download document","docs.aiOffCanvas.aiDownload":"You can use AI after downloading the document","docs.aiOffCanvas.aiDownloadDocument":"**AI is available with a Premium plan.** You can use AI after downloading the document, no additional cost.","docs.aiOffCanvas.aiFeaturePoints":"%s points","docs.aiOffCanvas.chat.infoPoint1":"Explore the content of a document with chat responses","docs.aiOffCanvas.chat.infoPoint2":"Clear any doubts to study in less time","docs.aiOffCanvas.chat.title":"Ask the document","docs.aiOffCanvas.map.infoPoint1":"Get the conceptual map of a document, generated by the AI","docs.aiOffCanvas.map.infoPoint2":"Edit the map","docs.aiOffCanvas.map.infoPoint3":"Download a PNG","docs.aiOffCanvas.map.title":"Concept map","docs.aiOffCanvas.points":"points","docs.aiOffCanvas.quiz.infoPoint1":"Generate a number of questions on the topics covered by the document","docs.aiOffCanvas.quiz.infoPoint2":"Download the PDF quiz so you can study whenever you want","docs.aiOffCanvas.quiz.infoPoint3":"Get the correct answer for each question","docs.aiOffCanvas.quiz.title":"Quiz","docs.aiOffCanvas.subtitle":"What you can get","docs.aiOffCanvas.summary.infoPoint1":"Summary of approximately 70%, in just a few minutes and in PDF format","docs.aiOffCanvas.summary.infoPoint1updated":"Summarise the document in a few minutes","docs.aiOffCanvas.summary.infoPoint2":"Download the summary document in PDF format","docs.aiOffCanvas.summary.infoPoint2updated":"Download the summary in PDF format","docs.aiOffCanvas.summary.title":"Summary","docs.aiOffCanvas.title":"Use Docsity AI on the document","docs.aiOffCanvas.titleUpdated":"Download the document to use AI","docs.breadcrumb.free":"Documents","docs.breadcrumb.store":"Store","docs.ctaArea.toggleSidebarTooltip":"Find here **related documents** and other useful resources","docs.ctaMessages.AI":"AI","docs.ctaMessages.alreadyDownloadedTitle":"You already downloaded this document","docs.ctaMessages.alreadyReviewedTitle":"You've already downloaded and reviewed this document","docs.ctaMessages.descriptionAI":"Make a summary, create a concept map or a quiz from this document","docs.ctaMessages.disabledByLanguageUser":"Only %s Docsity users can download this document","docs.ctaMessages.disabledByUserNotSeller":"This document is temporarily unavailable for download","docs.ctaMessages.discountBadge":"On special offer","docs.ctaMessages.myDocumentOffer":"Your document is discounted temporarily","docs.ctaMessages.uploadedTtile":"You uploaded this document on %s","docs.docDeletionModal.empty":"The field is mandatory","docs.docDeletionModal.notice":"Document_notice","docs.docDeletionModal.report":"Reports","docs.docDeletionModal.submit":"Delete Document","docs.docDeletionModal.textArea.label":"Notes","docs.docDeletionModal.textArea.optional":"(optional)","docs.docDeletionModal.textArea.placeholder":"Write here...","docs.docDeletionModal.title":"Select the reason for deletion","docs.docMyDiscountModal.close":"OK, close","docs.docMyDiscountModal.content":"Since this document was not receiving downloads, we decided to discount it to. When the number of downloads goes back up, we will increase the price again.","docs.docMyDiscountModal.title":"This document has been discounted","docs.docProfessorModal.disclaimer":"The page is generated automatically and is not managed by a person (the Professor or anyone else). The documents listed are not official or representative of the teaching methods and contents of the Professor in question. They are automatically aggregated according to criteria entered by users. The personal data relating to the Professor contained in this page have been collected by the Data Controller (Ladybird s.r.l.) from open sources accessible to the public and / or have been generated directly by the users. The goal is to enrich the contents of the platform for the legitimate interest of Ladybird s.r.l. to improve its usability for the benefit of its users. They will be stored until any opposition to the processing by the interested party, who is entitled to oppose the processing for reasons related to their particular situation, except for the provisions of art. 21 § 1, Paragraph 2, GDPR. For more information on the categories of recipients of the personal data and the additional rights of the data subject, please refer to sections B and H respectively of the Docsity privacy policy available at this [link](%s)","docs.docReportingModal.email":"Email","docs.docReportingModal.errorMessage":"We received a report from you regarding this document on %1$s with reason *“%2$s“*","docs.docReportingModal.errorTitle":"You have reported this document before","docs.docReportingModal.genericMessage":"We will try to solve this as quickly as possible.","docs.docReportingModal.guestName":"Name and surname","docs.docReportingModal.leaveAmessage":"Leave a message","docs.docReportingModal.optional":"Optional","docs.docReportingModal.reasons.copyrightViolation":"This document contains copyright infringement","docs.docReportingModal.reasons.duplicatedDocument":"This document has been duplicated","docs.docReportingModal.reasons.inconsitentContent":"The content is not consistent with the description","docs.docReportingModal.reasons.uploadedMyDocument":"User has uploaded a document that belongs to me","docs.docReportingModal.required":"Field required","docs.docReportingModal.sendReport":"Send report","docs.docReportingModal.successMessage":"Error processing your request","docs.docReportingModal.successTitle":"Thanks for reporting","docs.docReportingModal.title":"Why do you want to report this document?","docs.docReportingModal.validationError.fieldTooLong":"The max. number of characters is %d","docs.download.idle.buttonLabel":"Download now","docs.download.idle.label":"Download using","docs.download.idle.label2":"It will be available on all devices","docs.download.idle.selectDownload":"%s download Points","docs.download.idle.selectPremium":"%s premium Points","docs.download.idle.title":"You're downloading...","docs.download.noPoints.ctaTitle":"Download now","docs.download.noPoints.powerCtaSubtitle":"by purchasing a Power Recharge","docs.download.noPoints.premiumCtaSubtitle":"by purchasing a Premium plan","docs.download.noPoints.premiumUploadAction":"[Upload documents](%s) and get download points within a **few minutes**","docs.download.noPoints.rewardLabel":"and get the points you are missing","docs.download.noPoints.rewardTimeLabel":"*%s* Points are awarded within a **few minutes**","docs.download.noPoints.title":"Your points:","docs.download.noPoints.uploadAction":"Share documents","docs.download.redirecting.close":"Close","docs.download.redirecting.title":"There was a problem, [try again](%s)","docs.download.resend_email_action":"Resend email","docs.download.resend_email_body":"Before proceeding confirm your email. Click the link that we just sent you at **%s**.","docs.download.resend_email_heading":"Oops! Something is missing to download the document","docs.download.resend_email_invalid_description":"We can't deliver messages to **%s**. Before proceeding, double check whether your email address is valid or you need to change it.","docs.download.resend_email_invalid_title":"Oops! Something is missing to download the document","docs.flatSection.academicYear":"Academic Year","docs.flatSection.description":"Description","docs.flatSection.download":"Download","docs.flatSection.favourites":"Favourites","docs.flatSection.follow":"Follow","docs.flatSection.hide":"Hide","docs.flatSection.multipleDocLabel":"Documents","docs.flatSection.multipleReviewsLabel":"Reviews","docs.flatSection.page":"Page","docs.flatSection.pageNumber":"Number of pages","docs.flatSection.pages":"Pages","docs.flatSection.professorPrefix":"Prof. %s","docs.flatSection.sellDateLabel":"Available from","docs.flatSection.showMore":"Show more","docs.flatSection.singleDocLabel":"Document","docs.flatSection.singleReviewsLabel":"Review","docs.flatSection.unfollow":"Unfollow","docs.flatSection.uploadDateLabel":"Uploaded on","docs.header.alreadyDownloadedTitle":"You already downloaded this document","docs.header.alreadyReviewedTitle":"You've already downloaded and reviewed this document","docs.header.review":"%d Review","docs.header.reviews":"%d Reviews","docs.header.uploadedTtile":"You uploaded this document on %s","docs.headingArea.notPublished":"Document not published","docs.headingArea.topTooltip":"One of the most popular and successful documents in our community","docs.hero.multipleDocLabel":"Documents","docs.hero.notPublished":"Document not published","docs.hero.professorPrefix":"Prof. %s","docs.hero.questionsLabel":"What you will learn","docs.hero.review":"%d Review","docs.hero.reviews":"%d Reviews","docs.hero.sellDateLabel":"Available from","docs.hero.singleDocLabel":"Document","docs.hero.typology":"Typology: %s","docs.hero.unknownUser":"unknown user","docs.hero.uploadDateLabel":"Uploaded on","docs.infoArea.alreadyReviewedTitle":"You already downloaded this document","docs.infoArea.uploadedTtile":"You uploaded this document on %s","docs.intentClose.action":"Show others","docs.intentClose.heading":"Abracadabra 🔮 More documents for you! There’s really no magic, only our massive library!","docs.player.controllerLabel":"Page %1$d / %2$d","docs.player.crossPaywall.buttonPremiumLabel":"Download now","docs.player.crossPaywall.buttonShareLabel":"Share documents","docs.player.crossPaywall.textButtonPremium":"by purchasing a Premium plan","docs.player.crossPaywall.textButtonShare":"and get the points you are missing in **%s hours**","docs.player.downloadBlock.always.buttonLabel":"Download for free","docs.player.downloadBlock.always.copy":"This page cannot be seen from the preview","docs.player.downloadBlock.always.copyLastPage":"You can download it any time from any device","docs.player.downloadBlock.always.title":"You already downloaded this document","docs.player.downloadBlock.always.titleLastPage":"You already downloaded this document","docs.player.downloadBlock.default.buttonLabel":"Download","docs.player.downloadBlock.default.copy":"This page cannot be seen from the preview","docs.player.downloadBlock.default.copyLastPage":"You can download it any time from any device","docs.player.downloadBlock.default.title":"Don't miss anything!","docs.player.downloadBlock.default.titleLastPage":"Download the full document","docs.player.paywallBlock.unlock.buttonLabel":"Read the document","docs.player.paywallBlock.unlock.title":"Register for free to read the full document","docs.player.previewLabel":"Document preview","docs.playerToolbar.pageNumber":"Number of pages","docs.playerToolbar.scrollTop":"Go back to top","docs.priceModal.pointsImgAlt":"Get points","docs.priceModal.pointsLinkLabel":"Other ways to get download points for free","docs.priceModal.pointsSubtitle":"[Upload](%1$s) your documents or [answer](%2$s) questions and get download points","docs.priceModal.pointsTitle":"Get points to download the document","docs.priceModal.premiumImgAlt":"Go Premium","docs.priceModal.premiumLinkLabel":"See our Premium plans","docs.priceModal.premiumSubtitle":"Choose one of our Premium plans and use the points to download your documents right away","docs.priceModal.premiumTitle":"Don't want to wait?","docs.priceSection.discountBadge":"On special offer","docs.priceSection.discountLimitedLabel":"Limited-time offer","docs.priceSection.points":"Points","docs.recentArea.emptyPlaceholder":"Here you'll find the latest visited documents","docs.recentArea.title":"Recently viewed documents","docs.relatedArea.emptyPlaceholder":"There are no similar documents","docs.relatedArea.title":"Related documents","docs.relatedArea.viewOthers":"Show others","docs.reviewsArea.noReviewTitle":"No reviews yet","docs.reviewsArea.title":"Reviews","docs.reviewsArea.viewAll":"View all","docs.reviewsModal.awaitingModeration":"Under moderation","docs.reviewsModal.errorCase":"Something went wrong","docs.reviewsModal.getPoints":"Get %d download points","docs.reviewsModal.leaveReview":"Leave a review","docs.reviewsModal.orderHighest":"Highest rate","docs.reviewsModal.orderLowest":"Lowest rate","docs.reviewsModal.orderRecent":"Most recent","docs.reviewsModal.rating1":"Poor","docs.reviewsModal.rating2":"Insufficient","docs.reviewsModal.rating3":"Sufficient","docs.reviewsModal.rating4":"Good","docs.reviewsModal.rating5":"Excellent","docs.reviewsModal.reload":"Top-up","docs.reviewsModal.showMore":"Show others","docs.reviewsModal.showRatingDetails":"Show more","docs.reviewsModal.sortBy":"Sort by","docs.reviewsModal.title":"Reviews","docs.reviewsModal.whoCanReview":"Only users who downloaded the document can leave a review","docs.reviewsModal.yourReview":"Your review","docs.searchBar.counter":"%(index)s of %(total)s **(%(matches)s visible)**","docs.searchBar.error.button":"Reload","docs.searchBar.error.content":"Try searching again","docs.searchBar.error.title":"Loading error","docs.searchBar.placeholder":"Search in the preview","docs.searchBar.popover.close":"Close","docs.searchBar.popover.download":"Download","docs.searchBar.popover.hasDownload":"Displaying only results that are visible in the preview","docs.searchBar.popover.hasNotDownload":"Displaying results exclusively from pages shown in the preview.**Download the document to see all.**","docs.sidebar.areaLink":"Discover %1$s of %2$s %3$s","docs.suggestedArea.title":"Often downloaded together","docs.zoomLabels.zoomExpand":"Enlarge","docs.zoomLabels.zoomMaxWidth":"Maximum Width","docs.zoomLabels.zoomNormal":"Default View","docs.zoomLabels.zoomReduce":"Minimise","docs.zoomLabels.zoomThumbs":"Thumbnails","footer.country.de":"German","footer.country.en":"English","footer.country.es":"Spanish","footer.country.fr":"French","footer.country.pt":"Portuguese","footer.options.howdocsitywork":"How does Docsity work","footer.options.partners":"Partners","footer.options.sell":"Sell documents","footer.options.sellerguide":"Seller's Handbook","footer.options.support":"Contact us","footer.options.whoweare":"About us","footer.options.workwithus":"Career","footer.privacy.cookie":"Cookie Policy","footer.privacy.cookiesetup":"Cookie setup","footer.privacy.privacy":"Privacy Policy","footer.privacy.terms":"Terms of Use","footer.sitemap.biologiaechimica":"Biology and Chemistry","footer.sitemap.country":"Sitemap Languages and Countries","footer.sitemap.economia":"Economics","footer.sitemap.fisica":"Physics","footer.sitemap.giurisprudenza":"Law","footer.sitemap.ingegneria":"Engineering","footer.sitemap.lastquestions":"Latest questions","footer.sitemap.latestdoc":"Sitemap Latest Documents","footer.sitemap.lettereecomunicazione":"Literature and Communication","footer.sitemap.management":"Management","footer.sitemap.medicinaefarmacia":"Medicine and Pharmacy","footer.sitemap.psicologiaesociologia":"Psychology and Sociology","footer.sitemap.resource":"Sitemap Resources","footer.sitemap.scienzepolitiche":"Search Videos Courses and exercises carried out","footer.sitemap.storiaefilosofia":"History and Philosophy","footer.sitemap.supportopersonalizzato":"Customized support","footer.sitemap.tesinedimaturita":"High school diploma papers","footer.sitemap.topics":"Study Topics Sitemap","footer.sitemap.traccesvolteannipassati":"Proofs of previous years","footer.staticroutes.degreethesisLabel":"Thesis","footer.staticroutes.degreethesisUrl":"degree-thesis","footer.staticroutes.examquestionsLabel":"Exam","footer.staticroutes.examquestionsUrl":"exam-questions","footer.staticroutes.exceriseUrl":"exercises","footer.staticroutes.exerciseLabel":"Exercises","footer.staticroutes.notesLabel":"Lecture notes","footer.staticroutes.notesUrl":"lecture-notes","footer.staticroutes.schemesLabel":"Schemes","footer.staticroutes.schemesUrl":"schemes","footer.staticroutes.storeLabel":"Document Store","footer.staticroutes.studynotesLabel":"Study notes","footer.staticroutes.studynotesUrl":"study-notes","footer.staticroutes.summariesLabel":"Summaries","footer.staticroutes.summariesUrl":"summaries","general.docTitle":"%1$s of %2$s","generalDoc.beforeYear":"Pre %s","generalDoc.documentLabel":"Document","generalDoc.documentsLabel":"Documents","generalDoc.lessInfo":"Less info","generalDoc.moreInfo":"More info","generalDoc.orLabel":"Or","generalDoc.pointsLabel":"Points","generalDoc.shareLabel":"Share","generalDoc.titleSuffix":"%1$s of %2$s","header.common.points":"Points","header.contentArea.blogLink":"Go to the blog","header.contentArea.blogTitle":"From our blog","header.ctaUpload.sellerTooltip":"Share or sell documents","header.ctaUpload.tooltip":"Share documents","header.firstBlock.contentArea.0.heading":"Video Courses","header.firstBlock.contentArea.0.heading_pt":"Videolessons","header.firstBlock.contentArea.0.text":"Prepare yourself with lectures and tests carried out based on university programs!","header.firstBlock.contentArea.1.heading":"Find documents","header.firstBlock.contentArea.1.text":"Prepare for your exams with the study notes shared by other students like you on Docsity","header.firstBlock.contentArea.2.heading":"Search for your university","header.firstBlock.contentArea.2.text":"Find the specific documents for your university's exams","header.firstBlock.contentArea.3.heading":"Quiz","header.firstBlock.contentArea.3.text":"Respond to real exam questions and put yourself to the test","header.firstBlock.contentArea.4.link":"Search through all study resources","header.firstBlock.contentArea.6.heading":"Papers %s","header.firstBlock.contentArea.6.text":"Study with past exams, summaries and useful tips","header.firstBlock.contentArea.7.heading":"Explore questions","header.firstBlock.contentArea.7.text":"Clear up your doubts by reading the answers to questions asked by your fellow students","header.firstBlock.contentArea.8.heading":"Study topics","header.firstBlock.contentArea.8.text":"Explore the most downloaded documents for the most popular study topics","header.firstBlock.contentArea.ai":"Summarize your documents, ask them questions, convert them into quizzes and concept maps","header.firstBlock.infoArea.heading":"Prepare for your exams","header.firstBlock.infoArea.text":"Study with the several resources on Docsity","header.login":"Log in","header.menu_voices.advice":"Guidelines and tips","header.menu_voices.ai.text":"Docsity AI","header.menu_voices.ctaEvent":"Go live","header.menu_voices.earn.text":"Sell on Docsity","header.menu_voices.exam":"Prepare for your exams","header.menu_voices.points":"Get points","header.menu_voices.premium":"Premium plans","header.menu_voices.subscrive":"Subscribe","header.notifications.all_notifications":"All notifications","header.notifications.label":"Notifications","header.premium.reload":"Power top-up","header.premium.signup":"Get Premium","header.record":"Record a lesson","header.register":"Sign up","header.search.empty":"No documents found for this query","header.search.label":"Search in","header.search.placeholder":"What are you studying today?","header.search.scope.document":"Documents","header.search.scope.professor":"Professors","header.search.scope.question":"Questions","header.search.scope.quiz":"Quiz","header.search.scope.video":"Video Courses","header.secondBlock.contentArea.0.heading":"Share documents","header.secondBlock.contentArea.0.text":"For each uploaded document","header.secondBlock.contentArea.1.heading":"Answer questions","header.secondBlock.contentArea.1.text":"For each given answer (max 1 per day)","header.secondBlock.contentArea.2.link":"All the ways to get free points","header.secondBlock.contentArea.3.heading":"Get points immediately","header.secondBlock.contentArea.3.heading_premium":"Buy a Power Top-up","header.secondBlock.contentArea.3.text":"Choose a premium plan with all the points you need","header.secondBlock.contentArea.3.text_it_es":"Access all the Video Courses, get Premium Points to download the documents immediately and practice with all the Quizzes","header.secondBlock.contentArea.3.text_premium":"Get additional Premium Points that you can use until your Premium plan is active","header.secondBlock.infoArea.heading":"Earn points to download ","header.secondBlock.infoArea.text":"Earn points by helping other students or get them with a premium plan","header.thirdBlock.contentArea.0.heading":"Choose your next study program","header.thirdBlock.contentArea.0.text":"Get in touch with the best universities in the world. Search through thousands of universities and official partners","header.thirdBlock.contentArea.0.title":"Study Opportunities","header.thirdBlock.contentArea.1.title":"Community","header.thirdBlock.contentArea.2.heading":"Ask the community","header.thirdBlock.contentArea.2.text":"Ask the community for help and clear up your study doubts ","header.thirdBlock.contentArea.3.heading":"University Rankings","header.thirdBlock.contentArea.3.text":"Discover the best universities in your country according to Docsity users","header.thirdBlock.contentArea.4.heading":"Our save-the-student-ebooks!","header.thirdBlock.contentArea.4.text":"Download our free guides on studying techniques, anxiety management strategies, and thesis advice from Docsity tutors","header.thirdBlock.contentArea.4.title":"Free resources","header.usermenu.ai":"Docsity AI","header.usermenu.b2b":"Study Plans","header.usermenu.chiedi_supporto":"Get support","header.usermenu.documenti":"My documents","header.usermenu.documenti_fav":"Favourites","header.usermenu.domande":"My questions","header.usermenu.downloaded":"Downloaded","header.usermenu.gestione_abbonamento":"Manage your subscription","header.usermenu.gestione_account":"Manage account","header.usermenu.homepage":"Home","header.usermenu.lezioni":"My lessons","header.usermenu.recensioni":"My reviews","header.usermenu.uploaded":"Uploaded","header.usermenu.vendite":"Sales area","header.usermenu.vendite.chip":"Balance","header.usermenu.videocorsi":"My video courses","headerLogged.searchPlaceholder":"Search for documents, lecture-notes, exam banks...","headerLogged.subscribe":"Subscribe","headerSidebar.aiStudio":"AI Studio","headerSidebar.archive":"Archive","headerSidebar.banner.description":"From audio notes, videos, links and photos to **summaries**, **maps** and **flashcards**: Docsity AI generates content that's easy for you to study.","headerSidebar.banner.title":"Try the Docsity AI app","headerSidebar.close":"Close","headerSidebar.demoTitle":"Test note","headerSidebar.downloadApp":"Download the app","headerSidebar.filters.downloaded":"Downloaded","headerSidebar.filters.emptyDownloaded":"Here, you will find all your downloaded documents","headerSidebar.filters.emptyUploaded":"Here you will find your documents uploaded from the web or the app","headerSidebar.filters.uploaded":"Uploaded","headerSidebar.itTakesNote":"AI takes notes for you","headerSidebar.landingSeller":"Sell on Docsity","headerSidebar.library":"Your library","headerSidebar.linkFavorites":"Favourites","headerSidebar.linkFavoritesEmpty":"Like a document? Click on this symbol to add it to your favourites","headerSidebar.linkHome":"Home","headerSidebar.linkLogin":"Sign up","headerSidebar.linkRecents":"Recently seen by you","headerSidebar.linkRecentsEmpty":"Here you will find your most recently viewed documents, start your search now!","headerSidebar.linkSeller":"Sales area","headerSidebar.loading":"Creation in progress...","headerSidebar.open":"Open","headerSidebar.popoverViewAll":"View all","headerSidebar.uploadCTA":"Upload","modals.modify_email_action_label":"Change email","modals.modify_email_heading":"Change you email address","modals.modify_email_placeholder":"Insert email address","modals.resend_email_action":"Request email","modals.resend_email_body":"**Before requesting the email, log in to your mailbox** to make sure it's still active","modals.resend_email_body_guest":"Before proceeding, confirm your email address. We sent you a link to confirm your email address.","modals.resend_email_heading":"Request confirmation email","modals.resend_email_invalid_confirm":"Resend confirmation email","modals.resend_email_invalid_description":"Please enter a valid email address","modals.resend_email_invalid_divider":"Or","modals.resend_email_invalid_edit":"Change email","modals.resend_email_invalid_modifica":"to keep the current one","modals.resend_email_invalid_title":"Your email address does not appear to be valid.","modals.resend_email_success_action":"Resend email","modals.resend_email_success_body":"Check if you received it at following email address: **%s**. If you don't find it in your inbox, check your spam folder.","modals.resend_email_success_title":"We sent you another email","notifications.actionButton.document.ko.review":"Read our guidelines","notifications.actionButton.points":"Find documents","notifications.actionButton.profile":"See suggestions","notifications.actionButton.review":"Leave a review","notifications.actionButton.seller":"Read the Strategies","notifications.actionButton.share":"Share","notifications.actionButtonGroup.point_blue":"Find documents","notifications.actionButtonGroup.review":"Leave a review","notifications.actionTextGroup.document_store":"Spread the word to other students like you","notifications.actionTextGroup.point_blue":"Download your favourite documents right away!","notifications.actionTextGroup.points":"Download your favourite documents right away!","notifications.content.document.change_approved":"The changes to document **%s** were approved","notifications.content.document.change_rejected":"The changes to document **%s** were not approved","notifications.content.document.ko.afterReview":"Te review of your document “%s” has not been accepted, as the document does not meet our guidelines","notifications.content.document.ko.noReview":"Your document ”%s\" wasn't published. \u003cbr/\u003e\u003cu\u003e**Read our guidelines**\u003c/u\u003e","notifications.content.document.ko.review":"Your document ”%s\" wasn't published. \u003cbr/\u003e\u003cu\u003e**Request a review**\u003c/u\u003e","notifications.content.document.store_approved":"The %s document is officially on sale at the Store","notifications.content.invoice.ready":"A new invoice is available in your personal area","notifications.content.oboarding_b2b":"We help you find **work and study opportunities that suit you:** answer a few questions and get %s Download Points","notifications.content.point_blue_answer":"You received %s Download pts for answering the question %s","notifications.content.point_blue_answer_best":"You received %s Download pts because your answer was rated as the best answer.","notifications.content.point_blue_document_download":"You received %s Download pts because %s users downloaded your document %s","notifications.content.point_blue_document_download_1":"You received %s Download pts because a user downloaded your document %s","notifications.content.point_blue_document_promoted":"You have received **%d Download points** for promoting your documents to **Top**","notifications.content.point_blue_document_request":"Some of your documents have been selected to become **Top**. Promote them and earn **%d Download points for each**","notifications.content.point_blue_premium_ai":"You have received **%d Download Points** for activating a Premium plan","notifications.content.point_blue_profile":"You received %s Download pts for completing your profile.","notifications.content.point_blue_review_document":"You received %s Download pts for leaving a review to %s","notifications.content.point_blue_review_professor":"You received %s Download points for reviewing professor %s","notifications.content.point_blue_review_university":"You received %s Download pts for leaving a review to %s","notifications.content.point_blue_upload":"You received %s Download pts for uploading the document %s","notifications.content.point_yellow.renewal":"You received %s Premium pts upon the renewal of your %s subscription.","notifications.content.profile":"Did you know that we suggest **content based on the subjects listed in your profile**? These are associated with the documents you have downloaded to date, but **you can update them whenever you want**!","notifications.content.question.answer":"%s replied to your question: %s.","notifications.content.question.answer_comment":"%s commented your answer to the question: %s.","notifications.content.question.answer_follow":"%s replied to the question you follow: %s.","notifications.content.question.comment":"%s added a comment to your question: %s.","notifications.content.review.notify_received":"You received new reviews last week!","notifications.content.review.receive_document":"%s rated your document: %s.","notifications.content.review.release_course":"What do you think of the **%s** course?","notifications.content.review.release_document":"Leave a review to %s and get %d Download points.","notifications.content.review.release_document_free":"Review the document you downloaded: %s\",2020-12-17 17:41:08","notifications.content.review.release_professor":"Do you know prof. %s? Write a review and get %d download points","notifications.content.review.release_professors":"Review your University professors and earn Download points","notifications.content.seller":"Learn now about some **Selling strategies**","notifications.content.seller.discovery":"Learn now about some **Selling strategies**","notifications.content.withdrawal.pending_fraud":"Your **withdrawals are suspended** because our payment gateway **has abnormal requests**. We are verifying that everything is ok.","notifications.contentGroup.comments":"%s and other %s users added a comment to your question: %s.","notifications.contentGroup.comments_2":"%s and another user added a comment to your question: %s.","notifications.contentGroup.docreviews_2":"You have %s pending reviews. Get %d Download points for each reviewed document","notifications.contentGroup.docreviews_free":"**%s** and other %s users replied to your question: %s.","notifications.contentGroup.documents":"%s and other %s users reviewed your document: %s.","notifications.contentGroup.documents_2":"%s and another user reviewed your document: %s.","notifications.contentGroup.follows":"%s and other %s users replied to a question you follow: %s.","notifications.contentGroup.follows_2":"%s and another user replied a question you follow: %s.","notifications.contentGroup.point_blue":"You received %s Download points since the last time.","notifications.contentGroup.point_blue_review_professor":"You received %s Download points since the last time","notifications.contentGroup.question_answers":"**%s** and other %s users replied to your question: \"%s\".","notifications.contentGroup.question_answers_2":"%s and another user replied to your question: %s.","notifications.contentGroup.questions":"%s and other %s commented your answer to the question: %s.","notifications.contentGroup.questions_2comments":"%s and another user commented your answer to the question: %s.","phoneCondition.conditionOne":"Do not use a VOIP number or a temporary number, they are not accepted","phoneCondition.conditionThree":"We will not be able to retrieve your number, so don't lose it","phoneCondition.conditionTwo":"You will need your number every time you want to withdraw","premiumAIModal.box.bottom":"Cancel anytime","premiumAIModal.box.claim":"%1$s%2$s per month","premiumAIModal.box.head.premium":"AI is already included in your subscription","premiumAIModal.close":"Close","premiumAIModal.close.download":"Continue without Premium","premiumAIModal.cta":"Subscribe now","premiumAIModal.cta.download":"Activate Premium AI","premiumAIModal.feature1":"Use AI on **private files**","premiumAIModal.feature2":"Turn **your files into summaries**","premiumAIModal.feature3":"Generate concept maps and **edit them however you like**","premiumAIModal.feature3updated":"Generate and export **concept maps**","premiumAIModal.feature4":"Generate quizzes, with **solutions included**","premiumAIModal.feature5":"Make **insights in chat**","premiumAIModal.firstPurchase":"With your first purchase, you'll receive **%s blue points** to download documents","premiumAIModal.subheading.blockCopy":"Get full access to copy, save, and use content as many times as you want.","premiumAIModal.subheading.download":"To download summaries, maps, and quizzes generated by AI, you need Premium AI.","premiumAIModal.title":"Study with AI **without limits**","premiumAIModal.title.blockCopy":"Upgrade to Premium **to copy** text","premiumAIModal.title.download":"Unlock downloads with Premium AI","promoAppModal.downloadApp":"Download the app","promoAppModal.features1":"You listen, AI writes every word for you","promoAppModal.features2":"Scan your notes and books","promoAppModal.features3":"Create summaries, maps and quizzes with AI","promoAppModal.title":"Download the app and transcribe lessons with AI","shareModal.copyAction":"Copy","shareModal.linkCopied":"Link copied!","shareModal.title":"Share \"%s\"","uploadModal.alertCapReached":"You've reached the daily limit of %1$d document uploads for using the AI. Come back tomorrow to upload more documents.","uploadModal.alertDocumentSize":"The file is too large: how about compressing and re-uploading it? ( %d MB is the maximum size)","uploadModal.alertLoadFailed":"Oops! Something went wrong","uploadModal.alertPageCount":"Currently we cannot handle files that have less than %1$s pages or more than %2$s pages.","uploadModal.community.buttonTitle":"Upload file","uploadModal.community.capReached.features1":"AI Studio not available","uploadModal.community.capReached.features2":"Earn points by helping others","uploadModal.community.features1":"Earn points by helping others","uploadModal.community.features2":"Use AI Studio Basic for free","uploadModal.community.features3":"Earn points by helping others","uploadModal.community.featuresRemaining":"Use AI Studio for free (%1$s %2$s)","uploadModal.community.points":"points","uploadModal.community.premium.features1":"Process your content with AI","uploadModal.community.title":"Upload to the community","uploadModal.community.usePlural":"remaining uses","uploadModal.community.useSingular":"remaining use","uploadModal.dropArea":"Drag and drop files","uploadModal.maxSizeTip":"PDFs of max %1$s MB that have between %2$s and %3$s pages","uploadModal.private.features1":"Upload documents that are only visible to you","uploadModal.private.features2":"Use AI Studio without limits","uploadModal.private.features3":"Included in your subscription","uploadModal.private.title":"Upload privately","uploadModal.selectButton":"Choose file","uploadModal.sellerBox.becomeSeller":"\u003cu\u003e**Become a seller!**\u003c/u\u003e","uploadModal.sellerBox.description":"Do you want to make money with your notes?","uploadModal.sellerBox.isSeller":"\u003cu\u003e**Sell Documents**\u003c/u\u003e","uploadModal.title":"We're uploading the document","uploadModal.uploadArea":"Upload your file","uploadModal.uploadTypeLimitations":"Photos and scans are not compatible","uploadModal.wrongFile":"Wrong type of file","word.common.documenti":"Documents","word.common.domande":"questions","word.common.maturita":"maturity","word.common.quiz":"Quiz","word.common.test":"test","word.common.universita":"University","word.common.veditutte":"View all","word.common.veditutti":"View all","word.common.video":"Video Courses","default":{"alerts.action_spacer":"or","alerts.back_lang.action":"Back to %s language","alerts.complete_profile.link":"Complete profile","alerts.complete_profile.text":"Help us recommend the best content for you and receive instantly **%s download points**","alerts.confirm_email.action_modifica":"Change email address","alerts.confirm_email.action_reinvia":"Resend email.","alerts.confirm_email.text":"Confirm your email address by clicking on the link we sent you at %s.","alerts.diff_lang.action":"Click here","alerts.diff_lang.text":"You are browsing in a language other than your own","alerts.invalid_email.action_modifica":"Change email","alerts.invalid_email.action_resend":"Resend email","alerts.invalid_email.text":"We are unable to send the confirmation email to your address: **%s**","alerts.low_points.action":"Get points immediately","alerts.low_points.main":"You are running out of Download Points.","common.date.formatAcademicYear":"Pre %s","completeProfile.form_label":"Birth year","completeProfile.form_label_cta":"Confirm data","completeProfile.label_cta":"Start now","completeProfile.text_default_1":"You'll earn % points","completeProfile.text_default_2":"to download documents and gain access to free Video Courses and Quizzes","completeProfile.text_default_3":"to download documents","completeProfile.text_guest":"To proceed, enter the missing data","completeProfile.title_default":"Update your profile to continue","completeProfile.title_guest":"Oops, looks like you missed something!","docProfessorModal.disclaimer":"The page is generated automatically and is not managed by a person (the Professor or anyone else). The documents listed are not official or representative of the teaching methods and contents of the Professor in question. They are automatically aggregated according to criteria entered by users. The personal data relating to the Professor contained in this page have been collected by the Data Controller (Ladybird s.r.l.) from open sources accessible to the public and / or have been generated directly by the users. The goal is to enrich the contents of the platform for the legitimate interest of Ladybird s.r.l. to improve its usability for the benefit of its users. They will be stored until any opposition to the processing by the interested party, who is entitled to oppose the processing for reasons related to their particular situation, except for the provisions of art. 21 § 1, Paragraph 2, GDPR. For more information on the categories of recipients of the personal data and the additional rights of the data subject, please refer to sections B and H respectively of the Docsity privacy policy available at this [link](%s)","docs.abstractArea.documents":"Documents","docs.abstractArea.seoString":"Download %1$s and more %2$s %3$s in PDF only on Docsity!","docs.abstractArea.thisSubject":"This subject","docs.abstractArea.title":"Partial preview of the text","docs.actionSection.disabledByLanguageUser":"Only %s Docsity users can download this document","docs.actionSection.disabledByUserNotSeller":"We have received reports about this document. The download is temporarily disabled.","docs.actions.addFavourite":"Add to favourites","docs.actions.approveDocument":"Approve Document","docs.actions.approveDocument.force":"Force document approval","docs.actions.cannotEditPrime":"This document can no longer be modified because it has been promoted as a Top Document","docs.actions.deleteDocument":"Delete","docs.actions.download":"Download","docs.actions.downloadDocuemnt":"Download the document","docs.actions.edit":"Edit","docs.actions.follow":"Follow","docs.actions.reconvertDocument.errorMessage":"Error during the request","docs.actions.reconvertDocument.label":"Convert the document","docs.actions.reconvertDocument.successMessage":"Conversion successfully completed","docs.actions.remove":"Remove","docs.actions.removeFavourite":"Remove from favourites","docs.actions.reportDocument":"Report document","docs.actions.requestError":"An error has occurred","docs.actions.requestSuccess":"Request submitted, wait a few seconds and reload the page","docs.actions.review":"Leave a review","docs.actions.save":"Save","docs.actions.shareDocTooltip":"Share document","docs.actions.shareLabel":"Share","docs.actions.unfollow":"Unfollow","docs.actions.useAI":"Try Docsity AI","docs.actions.watchReview":"Your review","docs.aiOffCanvas.aiAlertFreemium":"**Free trial on %s documents or use without limits with Premium**","docs.aiOffCanvas.aiCtaDownload":"Download document","docs.aiOffCanvas.aiDownload":"You can use AI after downloading the document","docs.aiOffCanvas.aiDownloadDocument":"**AI is available with a Premium plan.** You can use AI after downloading the document, no additional cost.","docs.aiOffCanvas.aiFeaturePoints":"%s points","docs.aiOffCanvas.chat.infoPoint1":"Explore the content of a document with chat responses","docs.aiOffCanvas.chat.infoPoint2":"Clear any doubts to study in less time","docs.aiOffCanvas.chat.title":"Ask the document","docs.aiOffCanvas.map.infoPoint1":"Get the conceptual map of a document, generated by the AI","docs.aiOffCanvas.map.infoPoint2":"Edit the map","docs.aiOffCanvas.map.infoPoint3":"Download a PNG","docs.aiOffCanvas.map.title":"Concept map","docs.aiOffCanvas.points":"points","docs.aiOffCanvas.quiz.infoPoint1":"Generate a number of questions on the topics covered by the document","docs.aiOffCanvas.quiz.infoPoint2":"Download the PDF quiz so you can study whenever you want","docs.aiOffCanvas.quiz.infoPoint3":"Get the correct answer for each question","docs.aiOffCanvas.quiz.title":"Quiz","docs.aiOffCanvas.subtitle":"What you can get","docs.aiOffCanvas.summary.infoPoint1":"Summary of approximately 70%, in just a few minutes and in PDF format","docs.aiOffCanvas.summary.infoPoint1updated":"Summarise the document in a few minutes","docs.aiOffCanvas.summary.infoPoint2":"Download the summary document in PDF format","docs.aiOffCanvas.summary.infoPoint2updated":"Download the summary in PDF format","docs.aiOffCanvas.summary.title":"Summary","docs.aiOffCanvas.title":"Use Docsity AI on the document","docs.aiOffCanvas.titleUpdated":"Download the document to use AI","docs.breadcrumb.free":"Documents","docs.breadcrumb.store":"Store","docs.ctaArea.toggleSidebarTooltip":"Find here **related documents** and other useful resources","docs.ctaMessages.AI":"AI","docs.ctaMessages.alreadyDownloadedTitle":"You already downloaded this document","docs.ctaMessages.alreadyReviewedTitle":"You've already downloaded and reviewed this document","docs.ctaMessages.descriptionAI":"Make a summary, create a concept map or a quiz from this document","docs.ctaMessages.disabledByLanguageUser":"Only %s Docsity users can download this document","docs.ctaMessages.disabledByUserNotSeller":"This document is temporarily unavailable for download","docs.ctaMessages.discountBadge":"On special offer","docs.ctaMessages.myDocumentOffer":"Your document is discounted temporarily","docs.ctaMessages.uploadedTtile":"You uploaded this document on %s","docs.docDeletionModal.empty":"The field is mandatory","docs.docDeletionModal.notice":"Document_notice","docs.docDeletionModal.report":"Reports","docs.docDeletionModal.submit":"Delete Document","docs.docDeletionModal.textArea.label":"Notes","docs.docDeletionModal.textArea.optional":"(optional)","docs.docDeletionModal.textArea.placeholder":"Write here...","docs.docDeletionModal.title":"Select the reason for deletion","docs.docMyDiscountModal.close":"OK, close","docs.docMyDiscountModal.content":"Since this document was not receiving downloads, we decided to discount it to. When the number of downloads goes back up, we will increase the price again.","docs.docMyDiscountModal.title":"This document has been discounted","docs.docProfessorModal.disclaimer":"The page is generated automatically and is not managed by a person (the Professor or anyone else). The documents listed are not official or representative of the teaching methods and contents of the Professor in question. They are automatically aggregated according to criteria entered by users. The personal data relating to the Professor contained in this page have been collected by the Data Controller (Ladybird s.r.l.) from open sources accessible to the public and / or have been generated directly by the users. The goal is to enrich the contents of the platform for the legitimate interest of Ladybird s.r.l. to improve its usability for the benefit of its users. They will be stored until any opposition to the processing by the interested party, who is entitled to oppose the processing for reasons related to their particular situation, except for the provisions of art. 21 § 1, Paragraph 2, GDPR. For more information on the categories of recipients of the personal data and the additional rights of the data subject, please refer to sections B and H respectively of the Docsity privacy policy available at this [link](%s)","docs.docReportingModal.email":"Email","docs.docReportingModal.errorMessage":"We received a report from you regarding this document on %1$s with reason *“%2$s“*","docs.docReportingModal.errorTitle":"You have reported this document before","docs.docReportingModal.genericMessage":"We will try to solve this as quickly as possible.","docs.docReportingModal.guestName":"Name and surname","docs.docReportingModal.leaveAmessage":"Leave a message","docs.docReportingModal.optional":"Optional","docs.docReportingModal.reasons.copyrightViolation":"This document contains copyright infringement","docs.docReportingModal.reasons.duplicatedDocument":"This document has been duplicated","docs.docReportingModal.reasons.inconsitentContent":"The content is not consistent with the description","docs.docReportingModal.reasons.uploadedMyDocument":"User has uploaded a document that belongs to me","docs.docReportingModal.required":"Field required","docs.docReportingModal.sendReport":"Send report","docs.docReportingModal.successMessage":"Error processing your request","docs.docReportingModal.successTitle":"Thanks for reporting","docs.docReportingModal.title":"Why do you want to report this document?","docs.docReportingModal.validationError.fieldTooLong":"The max. number of characters is %d","docs.download.idle.buttonLabel":"Download now","docs.download.idle.label":"Download using","docs.download.idle.label2":"It will be available on all devices","docs.download.idle.selectDownload":"%s download Points","docs.download.idle.selectPremium":"%s premium Points","docs.download.idle.title":"You're downloading...","docs.download.noPoints.ctaTitle":"Download now","docs.download.noPoints.powerCtaSubtitle":"by purchasing a Power Recharge","docs.download.noPoints.premiumCtaSubtitle":"by purchasing a Premium plan","docs.download.noPoints.premiumUploadAction":"[Upload documents](%s) and get download points within a **few minutes**","docs.download.noPoints.rewardLabel":"and get the points you are missing","docs.download.noPoints.rewardTimeLabel":"*%s* Points are awarded within a **few minutes**","docs.download.noPoints.title":"Your points:","docs.download.noPoints.uploadAction":"Share documents","docs.download.redirecting.close":"Close","docs.download.redirecting.title":"There was a problem, [try again](%s)","docs.download.resend_email_action":"Resend email","docs.download.resend_email_body":"Before proceeding confirm your email. Click the link that we just sent you at **%s**.","docs.download.resend_email_heading":"Oops! Something is missing to download the document","docs.download.resend_email_invalid_description":"We can't deliver messages to **%s**. Before proceeding, double check whether your email address is valid or you need to change it.","docs.download.resend_email_invalid_title":"Oops! Something is missing to download the document","docs.flatSection.academicYear":"Academic Year","docs.flatSection.description":"Description","docs.flatSection.download":"Download","docs.flatSection.favourites":"Favourites","docs.flatSection.follow":"Follow","docs.flatSection.hide":"Hide","docs.flatSection.multipleDocLabel":"Documents","docs.flatSection.multipleReviewsLabel":"Reviews","docs.flatSection.page":"Page","docs.flatSection.pageNumber":"Number of pages","docs.flatSection.pages":"Pages","docs.flatSection.professorPrefix":"Prof. %s","docs.flatSection.sellDateLabel":"Available from","docs.flatSection.showMore":"Show more","docs.flatSection.singleDocLabel":"Document","docs.flatSection.singleReviewsLabel":"Review","docs.flatSection.unfollow":"Unfollow","docs.flatSection.uploadDateLabel":"Uploaded on","docs.header.alreadyDownloadedTitle":"You already downloaded this document","docs.header.alreadyReviewedTitle":"You've already downloaded and reviewed this document","docs.header.review":"%d Review","docs.header.reviews":"%d Reviews","docs.header.uploadedTtile":"You uploaded this document on %s","docs.headingArea.notPublished":"Document not published","docs.headingArea.topTooltip":"One of the most popular and successful documents in our community","docs.hero.multipleDocLabel":"Documents","docs.hero.notPublished":"Document not published","docs.hero.professorPrefix":"Prof. %s","docs.hero.questionsLabel":"What you will learn","docs.hero.review":"%d Review","docs.hero.reviews":"%d Reviews","docs.hero.sellDateLabel":"Available from","docs.hero.singleDocLabel":"Document","docs.hero.typology":"Typology: %s","docs.hero.unknownUser":"unknown user","docs.hero.uploadDateLabel":"Uploaded on","docs.infoArea.alreadyReviewedTitle":"You already downloaded this document","docs.infoArea.uploadedTtile":"You uploaded this document on %s","docs.intentClose.action":"Show others","docs.intentClose.heading":"Abracadabra 🔮 More documents for you! There’s really no magic, only our massive library!","docs.player.controllerLabel":"Page %1$d / %2$d","docs.player.crossPaywall.buttonPremiumLabel":"Download now","docs.player.crossPaywall.buttonShareLabel":"Share documents","docs.player.crossPaywall.textButtonPremium":"by purchasing a Premium plan","docs.player.crossPaywall.textButtonShare":"and get the points you are missing in **%s hours**","docs.player.downloadBlock.always.buttonLabel":"Download for free","docs.player.downloadBlock.always.copy":"This page cannot be seen from the preview","docs.player.downloadBlock.always.copyLastPage":"You can download it any time from any device","docs.player.downloadBlock.always.title":"You already downloaded this document","docs.player.downloadBlock.always.titleLastPage":"You already downloaded this document","docs.player.downloadBlock.default.buttonLabel":"Download","docs.player.downloadBlock.default.copy":"This page cannot be seen from the preview","docs.player.downloadBlock.default.copyLastPage":"You can download it any time from any device","docs.player.downloadBlock.default.title":"Don't miss anything!","docs.player.downloadBlock.default.titleLastPage":"Download the full document","docs.player.paywallBlock.unlock.buttonLabel":"Read the document","docs.player.paywallBlock.unlock.title":"Register for free to read the full document","docs.player.previewLabel":"Document preview","docs.playerToolbar.pageNumber":"Number of pages","docs.playerToolbar.scrollTop":"Go back to top","docs.priceModal.pointsImgAlt":"Get points","docs.priceModal.pointsLinkLabel":"Other ways to get download points for free","docs.priceModal.pointsSubtitle":"[Upload](%1$s) your documents or [answer](%2$s) questions and get download points","docs.priceModal.pointsTitle":"Get points to download the document","docs.priceModal.premiumImgAlt":"Go Premium","docs.priceModal.premiumLinkLabel":"See our Premium plans","docs.priceModal.premiumSubtitle":"Choose one of our Premium plans and use the points to download your documents right away","docs.priceModal.premiumTitle":"Don't want to wait?","docs.priceSection.discountBadge":"On special offer","docs.priceSection.discountLimitedLabel":"Limited-time offer","docs.priceSection.points":"Points","docs.recentArea.emptyPlaceholder":"Here you'll find the latest visited documents","docs.recentArea.title":"Recently viewed documents","docs.relatedArea.emptyPlaceholder":"There are no similar documents","docs.relatedArea.title":"Related documents","docs.relatedArea.viewOthers":"Show others","docs.reviewsArea.noReviewTitle":"No reviews yet","docs.reviewsArea.title":"Reviews","docs.reviewsArea.viewAll":"View all","docs.reviewsModal.awaitingModeration":"Under moderation","docs.reviewsModal.errorCase":"Something went wrong","docs.reviewsModal.getPoints":"Get %d download points","docs.reviewsModal.leaveReview":"Leave a review","docs.reviewsModal.orderHighest":"Highest rate","docs.reviewsModal.orderLowest":"Lowest rate","docs.reviewsModal.orderRecent":"Most recent","docs.reviewsModal.rating1":"Poor","docs.reviewsModal.rating2":"Insufficient","docs.reviewsModal.rating3":"Sufficient","docs.reviewsModal.rating4":"Good","docs.reviewsModal.rating5":"Excellent","docs.reviewsModal.reload":"Top-up","docs.reviewsModal.showMore":"Show others","docs.reviewsModal.showRatingDetails":"Show more","docs.reviewsModal.sortBy":"Sort by","docs.reviewsModal.title":"Reviews","docs.reviewsModal.whoCanReview":"Only users who downloaded the document can leave a review","docs.reviewsModal.yourReview":"Your review","docs.searchBar.counter":"%(index)s of %(total)s **(%(matches)s visible)**","docs.searchBar.error.button":"Reload","docs.searchBar.error.content":"Try searching again","docs.searchBar.error.title":"Loading error","docs.searchBar.placeholder":"Search in the preview","docs.searchBar.popover.close":"Close","docs.searchBar.popover.download":"Download","docs.searchBar.popover.hasDownload":"Displaying only results that are visible in the preview","docs.searchBar.popover.hasNotDownload":"Displaying results exclusively from pages shown in the preview.**Download the document to see all.**","docs.sidebar.areaLink":"Discover %1$s of %2$s %3$s","docs.suggestedArea.title":"Often downloaded together","docs.zoomLabels.zoomExpand":"Enlarge","docs.zoomLabels.zoomMaxWidth":"Maximum Width","docs.zoomLabels.zoomNormal":"Default View","docs.zoomLabels.zoomReduce":"Minimise","docs.zoomLabels.zoomThumbs":"Thumbnails","footer.country.de":"German","footer.country.en":"English","footer.country.es":"Spanish","footer.country.fr":"French","footer.country.pt":"Portuguese","footer.options.howdocsitywork":"How does Docsity work","footer.options.partners":"Partners","footer.options.sell":"Sell documents","footer.options.sellerguide":"Seller's Handbook","footer.options.support":"Contact us","footer.options.whoweare":"About us","footer.options.workwithus":"Career","footer.privacy.cookie":"Cookie Policy","footer.privacy.cookiesetup":"Cookie setup","footer.privacy.privacy":"Privacy Policy","footer.privacy.terms":"Terms of Use","footer.sitemap.biologiaechimica":"Biology and Chemistry","footer.sitemap.country":"Sitemap Languages and Countries","footer.sitemap.economia":"Economics","footer.sitemap.fisica":"Physics","footer.sitemap.giurisprudenza":"Law","footer.sitemap.ingegneria":"Engineering","footer.sitemap.lastquestions":"Latest questions","footer.sitemap.latestdoc":"Sitemap Latest Documents","footer.sitemap.lettereecomunicazione":"Literature and Communication","footer.sitemap.management":"Management","footer.sitemap.medicinaefarmacia":"Medicine and Pharmacy","footer.sitemap.psicologiaesociologia":"Psychology and Sociology","footer.sitemap.resource":"Sitemap Resources","footer.sitemap.scienzepolitiche":"Search Videos Courses and exercises carried out","footer.sitemap.storiaefilosofia":"History and Philosophy","footer.sitemap.supportopersonalizzato":"Customized support","footer.sitemap.tesinedimaturita":"High school diploma papers","footer.sitemap.topics":"Study Topics Sitemap","footer.sitemap.traccesvolteannipassati":"Proofs of previous years","footer.staticroutes.degreethesisLabel":"Thesis","footer.staticroutes.degreethesisUrl":"degree-thesis","footer.staticroutes.examquestionsLabel":"Exam","footer.staticroutes.examquestionsUrl":"exam-questions","footer.staticroutes.exceriseUrl":"exercises","footer.staticroutes.exerciseLabel":"Exercises","footer.staticroutes.notesLabel":"Lecture notes","footer.staticroutes.notesUrl":"lecture-notes","footer.staticroutes.schemesLabel":"Schemes","footer.staticroutes.schemesUrl":"schemes","footer.staticroutes.storeLabel":"Document Store","footer.staticroutes.studynotesLabel":"Study notes","footer.staticroutes.studynotesUrl":"study-notes","footer.staticroutes.summariesLabel":"Summaries","footer.staticroutes.summariesUrl":"summaries","general.docTitle":"%1$s of %2$s","generalDoc.beforeYear":"Pre %s","generalDoc.documentLabel":"Document","generalDoc.documentsLabel":"Documents","generalDoc.lessInfo":"Less info","generalDoc.moreInfo":"More info","generalDoc.orLabel":"Or","generalDoc.pointsLabel":"Points","generalDoc.shareLabel":"Share","generalDoc.titleSuffix":"%1$s of %2$s","header.common.points":"Points","header.contentArea.blogLink":"Go to the blog","header.contentArea.blogTitle":"From our blog","header.ctaUpload.sellerTooltip":"Share or sell documents","header.ctaUpload.tooltip":"Share documents","header.firstBlock.contentArea.0.heading":"Video Courses","header.firstBlock.contentArea.0.heading_pt":"Videolessons","header.firstBlock.contentArea.0.text":"Prepare yourself with lectures and tests carried out based on university programs!","header.firstBlock.contentArea.1.heading":"Find documents","header.firstBlock.contentArea.1.text":"Prepare for your exams with the study notes shared by other students like you on Docsity","header.firstBlock.contentArea.2.heading":"Search for your university","header.firstBlock.contentArea.2.text":"Find the specific documents for your university's exams","header.firstBlock.contentArea.3.heading":"Quiz","header.firstBlock.contentArea.3.text":"Respond to real exam questions and put yourself to the test","header.firstBlock.contentArea.4.link":"Search through all study resources","header.firstBlock.contentArea.6.heading":"Papers %s","header.firstBlock.contentArea.6.text":"Study with past exams, summaries and useful tips","header.firstBlock.contentArea.7.heading":"Explore questions","header.firstBlock.contentArea.7.text":"Clear up your doubts by reading the answers to questions asked by your fellow students","header.firstBlock.contentArea.8.heading":"Study topics","header.firstBlock.contentArea.8.text":"Explore the most downloaded documents for the most popular study topics","header.firstBlock.contentArea.ai":"Summarize your documents, ask them questions, convert them into quizzes and concept maps","header.firstBlock.infoArea.heading":"Prepare for your exams","header.firstBlock.infoArea.text":"Study with the several resources on Docsity","header.login":"Log in","header.menu_voices.advice":"Guidelines and tips","header.menu_voices.ai.text":"Docsity AI","header.menu_voices.ctaEvent":"Go live","header.menu_voices.earn.text":"Sell on Docsity","header.menu_voices.exam":"Prepare for your exams","header.menu_voices.points":"Get points","header.menu_voices.premium":"Premium plans","header.menu_voices.subscrive":"Subscribe","header.notifications.all_notifications":"All notifications","header.notifications.label":"Notifications","header.premium.reload":"Power top-up","header.premium.signup":"Get Premium","header.record":"Record a lesson","header.register":"Sign up","header.search.empty":"No documents found for this query","header.search.label":"Search in","header.search.placeholder":"What are you studying today?","header.search.scope.document":"Documents","header.search.scope.professor":"Professors","header.search.scope.question":"Questions","header.search.scope.quiz":"Quiz","header.search.scope.video":"Video Courses","header.secondBlock.contentArea.0.heading":"Share documents","header.secondBlock.contentArea.0.text":"For each uploaded document","header.secondBlock.contentArea.1.heading":"Answer questions","header.secondBlock.contentArea.1.text":"For each given answer (max 1 per day)","header.secondBlock.contentArea.2.link":"All the ways to get free points","header.secondBlock.contentArea.3.heading":"Get points immediately","header.secondBlock.contentArea.3.heading_premium":"Buy a Power Top-up","header.secondBlock.contentArea.3.text":"Choose a premium plan with all the points you need","header.secondBlock.contentArea.3.text_it_es":"Access all the Video Courses, get Premium Points to download the documents immediately and practice with all the Quizzes","header.secondBlock.contentArea.3.text_premium":"Get additional Premium Points that you can use until your Premium plan is active","header.secondBlock.infoArea.heading":"Earn points to download ","header.secondBlock.infoArea.text":"Earn points by helping other students or get them with a premium plan","header.thirdBlock.contentArea.0.heading":"Choose your next study program","header.thirdBlock.contentArea.0.text":"Get in touch with the best universities in the world. Search through thousands of universities and official partners","header.thirdBlock.contentArea.0.title":"Study Opportunities","header.thirdBlock.contentArea.1.title":"Community","header.thirdBlock.contentArea.2.heading":"Ask the community","header.thirdBlock.contentArea.2.text":"Ask the community for help and clear up your study doubts ","header.thirdBlock.contentArea.3.heading":"University Rankings","header.thirdBlock.contentArea.3.text":"Discover the best universities in your country according to Docsity users","header.thirdBlock.contentArea.4.heading":"Our save-the-student-ebooks!","header.thirdBlock.contentArea.4.text":"Download our free guides on studying techniques, anxiety management strategies, and thesis advice from Docsity tutors","header.thirdBlock.contentArea.4.title":"Free resources","header.usermenu.ai":"Docsity AI","header.usermenu.b2b":"Study Plans","header.usermenu.chiedi_supporto":"Get support","header.usermenu.documenti":"My documents","header.usermenu.documenti_fav":"Favourites","header.usermenu.domande":"My questions","header.usermenu.downloaded":"Downloaded","header.usermenu.gestione_abbonamento":"Manage your subscription","header.usermenu.gestione_account":"Manage account","header.usermenu.homepage":"Home","header.usermenu.lezioni":"My lessons","header.usermenu.recensioni":"My reviews","header.usermenu.uploaded":"Uploaded","header.usermenu.vendite":"Sales area","header.usermenu.vendite.chip":"Balance","header.usermenu.videocorsi":"My video courses","headerLogged.searchPlaceholder":"Search for documents, lecture-notes, exam banks...","headerLogged.subscribe":"Subscribe","headerSidebar.aiStudio":"AI Studio","headerSidebar.archive":"Archive","headerSidebar.banner.description":"From audio notes, videos, links and photos to **summaries**, **maps** and **flashcards**: Docsity AI generates content that's easy for you to study.","headerSidebar.banner.title":"Try the Docsity AI app","headerSidebar.close":"Close","headerSidebar.demoTitle":"Test note","headerSidebar.downloadApp":"Download the app","headerSidebar.filters.downloaded":"Downloaded","headerSidebar.filters.emptyDownloaded":"Here, you will find all your downloaded documents","headerSidebar.filters.emptyUploaded":"Here you will find your documents uploaded from the web or the app","headerSidebar.filters.uploaded":"Uploaded","headerSidebar.itTakesNote":"AI takes notes for you","headerSidebar.landingSeller":"Sell on Docsity","headerSidebar.library":"Your library","headerSidebar.linkFavorites":"Favourites","headerSidebar.linkFavoritesEmpty":"Like a document? Click on this symbol to add it to your favourites","headerSidebar.linkHome":"Home","headerSidebar.linkLogin":"Sign up","headerSidebar.linkRecents":"Recently seen by you","headerSidebar.linkRecentsEmpty":"Here you will find your most recently viewed documents, start your search now!","headerSidebar.linkSeller":"Sales area","headerSidebar.loading":"Creation in progress...","headerSidebar.open":"Open","headerSidebar.popoverViewAll":"View all","headerSidebar.uploadCTA":"Upload","modals.modify_email_action_label":"Change email","modals.modify_email_heading":"Change you email address","modals.modify_email_placeholder":"Insert email address","modals.resend_email_action":"Request email","modals.resend_email_body":"**Before requesting the email, log in to your mailbox** to make sure it's still active","modals.resend_email_body_guest":"Before proceeding, confirm your email address. We sent you a link to confirm your email address.","modals.resend_email_heading":"Request confirmation email","modals.resend_email_invalid_confirm":"Resend confirmation email","modals.resend_email_invalid_description":"Please enter a valid email address","modals.resend_email_invalid_divider":"Or","modals.resend_email_invalid_edit":"Change email","modals.resend_email_invalid_modifica":"to keep the current one","modals.resend_email_invalid_title":"Your email address does not appear to be valid.","modals.resend_email_success_action":"Resend email","modals.resend_email_success_body":"Check if you received it at following email address: **%s**. If you don't find it in your inbox, check your spam folder.","modals.resend_email_success_title":"We sent you another email","notifications.actionButton.document.ko.review":"Read our guidelines","notifications.actionButton.points":"Find documents","notifications.actionButton.profile":"See suggestions","notifications.actionButton.review":"Leave a review","notifications.actionButton.seller":"Read the Strategies","notifications.actionButton.share":"Share","notifications.actionButtonGroup.point_blue":"Find documents","notifications.actionButtonGroup.review":"Leave a review","notifications.actionTextGroup.document_store":"Spread the word to other students like you","notifications.actionTextGroup.point_blue":"Download your favourite documents right away!","notifications.actionTextGroup.points":"Download your favourite documents right away!","notifications.content.document.change_approved":"The changes to document **%s** were approved","notifications.content.document.change_rejected":"The changes to document **%s** were not approved","notifications.content.document.ko.afterReview":"Te review of your document “%s” has not been accepted, as the document does not meet our guidelines","notifications.content.document.ko.noReview":"Your document ”%s\" wasn't published. \u003cbr/\u003e\u003cu\u003e**Read our guidelines**\u003c/u\u003e","notifications.content.document.ko.review":"Your document ”%s\" wasn't published. \u003cbr/\u003e\u003cu\u003e**Request a review**\u003c/u\u003e","notifications.content.document.store_approved":"The %s document is officially on sale at the Store","notifications.content.invoice.ready":"A new invoice is available in your personal area","notifications.content.oboarding_b2b":"We help you find **work and study opportunities that suit you:** answer a few questions and get %s Download Points","notifications.content.point_blue_answer":"You received %s Download pts for answering the question %s","notifications.content.point_blue_answer_best":"You received %s Download pts because your answer was rated as the best answer.","notifications.content.point_blue_document_download":"You received %s Download pts because %s users downloaded your document %s","notifications.content.point_blue_document_download_1":"You received %s Download pts because a user downloaded your document %s","notifications.content.point_blue_document_promoted":"You have received **%d Download points** for promoting your documents to **Top**","notifications.content.point_blue_document_request":"Some of your documents have been selected to become **Top**. Promote them and earn **%d Download points for each**","notifications.content.point_blue_premium_ai":"You have received **%d Download Points** for activating a Premium plan","notifications.content.point_blue_profile":"You received %s Download pts for completing your profile.","notifications.content.point_blue_review_document":"You received %s Download pts for leaving a review to %s","notifications.content.point_blue_review_professor":"You received %s Download points for reviewing professor %s","notifications.content.point_blue_review_university":"You received %s Download pts for leaving a review to %s","notifications.content.point_blue_upload":"You received %s Download pts for uploading the document %s","notifications.content.point_yellow.renewal":"You received %s Premium pts upon the renewal of your %s subscription.","notifications.content.profile":"Did you know that we suggest **content based on the subjects listed in your profile**? These are associated with the documents you have downloaded to date, but **you can update them whenever you want**!","notifications.content.question.answer":"%s replied to your question: %s.","notifications.content.question.answer_comment":"%s commented your answer to the question: %s.","notifications.content.question.answer_follow":"%s replied to the question you follow: %s.","notifications.content.question.comment":"%s added a comment to your question: %s.","notifications.content.review.notify_received":"You received new reviews last week!","notifications.content.review.receive_document":"%s rated your document: %s.","notifications.content.review.release_course":"What do you think of the **%s** course?","notifications.content.review.release_document":"Leave a review to %s and get %d Download points.","notifications.content.review.release_document_free":"Review the document you downloaded: %s\",2020-12-17 17:41:08","notifications.content.review.release_professor":"Do you know prof. %s? Write a review and get %d download points","notifications.content.review.release_professors":"Review your University professors and earn Download points","notifications.content.seller":"Learn now about some **Selling strategies**","notifications.content.seller.discovery":"Learn now about some **Selling strategies**","notifications.content.withdrawal.pending_fraud":"Your **withdrawals are suspended** because our payment gateway **has abnormal requests**. We are verifying that everything is ok.","notifications.contentGroup.comments":"%s and other %s users added a comment to your question: %s.","notifications.contentGroup.comments_2":"%s and another user added a comment to your question: %s.","notifications.contentGroup.docreviews_2":"You have %s pending reviews. Get %d Download points for each reviewed document","notifications.contentGroup.docreviews_free":"**%s** and other %s users replied to your question: %s.","notifications.contentGroup.documents":"%s and other %s users reviewed your document: %s.","notifications.contentGroup.documents_2":"%s and another user reviewed your document: %s.","notifications.contentGroup.follows":"%s and other %s users replied to a question you follow: %s.","notifications.contentGroup.follows_2":"%s and another user replied a question you follow: %s.","notifications.contentGroup.point_blue":"You received %s Download points since the last time.","notifications.contentGroup.point_blue_review_professor":"You received %s Download points since the last time","notifications.contentGroup.question_answers":"**%s** and other %s users replied to your question: \"%s\".","notifications.contentGroup.question_answers_2":"%s and another user replied to your question: %s.","notifications.contentGroup.questions":"%s and other %s commented your answer to the question: %s.","notifications.contentGroup.questions_2comments":"%s and another user commented your answer to the question: %s.","phoneCondition.conditionOne":"Do not use a VOIP number or a temporary number, they are not accepted","phoneCondition.conditionThree":"We will not be able to retrieve your number, so don't lose it","phoneCondition.conditionTwo":"You will need your number every time you want to withdraw","premiumAIModal.box.bottom":"Cancel anytime","premiumAIModal.box.claim":"%1$s%2$s per month","premiumAIModal.box.head.premium":"AI is already included in your subscription","premiumAIModal.close":"Close","premiumAIModal.close.download":"Continue without Premium","premiumAIModal.cta":"Subscribe now","premiumAIModal.cta.download":"Activate Premium AI","premiumAIModal.feature1":"Use AI on **private files**","premiumAIModal.feature2":"Turn **your files into summaries**","premiumAIModal.feature3":"Generate concept maps and **edit them however you like**","premiumAIModal.feature3updated":"Generate and export **concept maps**","premiumAIModal.feature4":"Generate quizzes, with **solutions included**","premiumAIModal.feature5":"Make **insights in chat**","premiumAIModal.firstPurchase":"With your first purchase, you'll receive **%s blue points** to download documents","premiumAIModal.subheading.blockCopy":"Get full access to copy, save, and use content as many times as you want.","premiumAIModal.subheading.download":"To download summaries, maps, and quizzes generated by AI, you need Premium AI.","premiumAIModal.title":"Study with AI **without limits**","premiumAIModal.title.blockCopy":"Upgrade to Premium **to copy** text","premiumAIModal.title.download":"Unlock downloads with Premium AI","promoAppModal.downloadApp":"Download the app","promoAppModal.features1":"You listen, AI writes every word for you","promoAppModal.features2":"Scan your notes and books","promoAppModal.features3":"Create summaries, maps and quizzes with AI","promoAppModal.title":"Download the app and transcribe lessons with AI","shareModal.copyAction":"Copy","shareModal.linkCopied":"Link copied!","shareModal.title":"Share \"%s\"","uploadModal.alertCapReached":"You've reached the daily limit of %1$d document uploads for using the AI. Come back tomorrow to upload more documents.","uploadModal.alertDocumentSize":"The file is too large: how about compressing and re-uploading it? ( %d MB is the maximum size)","uploadModal.alertLoadFailed":"Oops! Something went wrong","uploadModal.alertPageCount":"Currently we cannot handle files that have less than %1$s pages or more than %2$s pages.","uploadModal.community.buttonTitle":"Upload file","uploadModal.community.capReached.features1":"AI Studio not available","uploadModal.community.capReached.features2":"Earn points by helping others","uploadModal.community.features1":"Earn points by helping others","uploadModal.community.features2":"Use AI Studio Basic for free","uploadModal.community.features3":"Earn points by helping others","uploadModal.community.featuresRemaining":"Use AI Studio for free (%1$s %2$s)","uploadModal.community.points":"points","uploadModal.community.premium.features1":"Process your content with AI","uploadModal.community.title":"Upload to the community","uploadModal.community.usePlural":"remaining uses","uploadModal.community.useSingular":"remaining use","uploadModal.dropArea":"Drag and drop files","uploadModal.maxSizeTip":"PDFs of max %1$s MB that have between %2$s and %3$s pages","uploadModal.private.features1":"Upload documents that are only visible to you","uploadModal.private.features2":"Use AI Studio without limits","uploadModal.private.features3":"Included in your subscription","uploadModal.private.title":"Upload privately","uploadModal.selectButton":"Choose file","uploadModal.sellerBox.becomeSeller":"\u003cu\u003e**Become a seller!**\u003c/u\u003e","uploadModal.sellerBox.description":"Do you want to make money with your notes?","uploadModal.sellerBox.isSeller":"\u003cu\u003e**Sell Documents**\u003c/u\u003e","uploadModal.title":"We're uploading the document","uploadModal.uploadArea":"Upload your file","uploadModal.uploadTypeLimitations":"Photos and scans are not compatible","uploadModal.wrongFile":"Wrong type of file","word.common.documenti":"Documents","word.common.domande":"questions","word.common.maturita":"maturity","word.common.quiz":"Quiz","word.common.test":"test","word.common.universita":"University","word.common.veditutte":"View all","word.common.veditutti":"View all","word.common.video":"Video Courses"}},"trace":{"page_type":"document.view","navigation_language":"en"},"locale":"en","pointsRules":{"document_upload":20,"document_review":5,"university_review":5,"professor_review":5,"user_signup":10,"user_profile_b2b":10,"answer":5,"answer_best":10,"document_prime_promoted":100,"document_upload_ai_slave":5},"enabledModules":{"isPremiumEnabled":true,"isStoreEnabled":true,"isQuizEnabled":false,"isVideoEnabled":false,"isQuestionsEnabled":true,"isOnboardingB2bEnabled":true,"isProfessorsEnabled":true,"isProfessorReviewsEnabled":false,"isFastCheckoutEnabled":true,"isBlogEnabled":true,"isAiEnabled":true,"isLeanFreeToStoreEnabled":true},"options":{"headerStrategy":"NOT_ANIMATION_NOT_ALERTS","showFooter":true,"showHeader":true},"translationsUserLang":null,"trackParams":true,"_sentryTraceData":"b7f47bf4e15e40b38277d505d1c51f4e-ac847afaa11bb45a-0","_sentryBaggage":"sentry-environment=production,sentry-release=4.10.13,sentry-public_key=e22fc7b9af4a4f95b7a7c142e6fe1e5f,sentry-trace_id=b7f47bf4e15e40b38277d505d1c51f4e,sentry-sample_rate=0.01,sentry-transaction=%2Fdocs,sentry-sampled=false","doc":{"id":38683,"lang":"en","slug":"information-retrieval-performance-lecture-slides-computer-science","userId":150111,"title":"Information Retrieval Performance, Lecture Slides - Computer Science","description":"Prof.Paul McNamee, Information Retrieval,Computer Science, Artificial Intelligence, Johns Hopkins University, Computer Science, Prof.Paul McNamee, Information Retrieval Permormance, Query Refinement","downloads":0,"reviewsCount":0,"averageVotes":"0.0","isStore":false,"isPrime":false,"isPrimeEnabled":false,"isTop":false,"isActive":true,"isReviewed":true,"isHighschool":false,"isUniversity":true,"isSitePatatabrava":false,"isSiteEbah":false,"createdAt":{"timestamp":1320870191,"date":"2011-11-09","time":"21:23:11"},"year":2011,"favouritesCount":0,"points":20,"pointsIncrease":true,"lastPriceDown":null,"thumbnail":"https://static.docsity.com/media/avatar/documents/2011/11/09/ce59ae595b0603be063a5169c69d2243.jpeg","isUnlocked":false,"file":{"pages":24,"fileExt":"pdf","source":"file","isUnconverted":false,"id":1550887,"firstPageUrl":"https://static.docsity.com/documents_first_pages/2011/11/09/2ed34e3ae03f19d68d00e8e8bbad8f9d.png","policyDate":{"timestamp":1783102315,"date":"2026-07-03","time":"20:11:55"},"htmlCssKey":"documents_html/css/2011/11/09/ce59ae595b0603be063a5169c69d2243/ce59ae595b0603be063a5169c69d2243.css","htmlStructureKey":"documents_html/pages/2011/11/09/ce59ae595b0603be063a5169c69d2243/ce59ae595b0603be063a5169c69d2243.json","textContentKey":"documents_text_html/2011/11/09/ce59ae595b0603be063a5169c69d2243.html"},"country":{"lang":"en"},"typology":{"id":8,"name":"Slides","slug":"slides"},"subject":{"id":441,"name":"Artificial Intelligence","slug":"artificial-intelligence"},"exam":{"id":7933,"name":"Artificial Intelligence","slug":"artificial-intelligence-jhu"},"university":{"id":1646,"lang":"en","slug":"johns-hopkins-university-md","name":"Johns Hopkins University (JHU)","country":{"code":"us"}},"professor":null,"optimization":null,"user":{"id":150111,"username":"stagist","avatar":"https://static.docsity.com/media/avatar/users/2011/09/20/150111_p.jpg","url":"https://www.docsity.com/en/users/profile/stagist/home/","isActive":true,"country":{"code":"us"},"stat":{"receivedReviewsCount":27,"uploadedDocumentsCount":265,"receivedReviewsAverageVotes":4.1},"seller":null}},"documentCssUrl":"https://static.docsity.com/documents_html/css/2011/11/09/ce59ae595b0603be063a5169c69d2243/ce59ae595b0603be063a5169c69d2243.css","documentBgPolicy":"?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9zdGF0aWMuZG9jc2l0eS5jb20vZG9jdW1lbnRzX2h0bWwvaW1hZ2VzLzIwMTEvMTEvMDkvY2U1OWFlNTk1YjA2MDNiZTA2M2E1MTY5YzY5ZDIyNDMvKi5wbmciLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE3ODMxMDIzMTV9fX1dfQ__\u0026Key-Pair-Id=K2FDQI4R6KV6U\u0026Signature=XsZJiJDiWWTli8p90SY4SfJDQx-UkgB-DXMUzClWe-TV3osmnoyX1X32lYxhA9lr0JsJHMWshfsameG-ACYwuGW8TJ74w9RglQWazuhrH4RmAFwsyyv1DbQ8CG3n5F0E~WeKV1F5l15TmqYRtYtJqAn308Fteb0U01d3W5zoVoqFrpdNoVOTGpyghMqNED~88kuNsD5hfqQux9jorRWk84~rGGWyP3g7QtZDW81OTMgVz3j8tJBrldcc9KuqWXCT3pW1CAW1rM1p7dr2c3xhodSorw2xOghafFjujXNEvj6pBKvwFptJUOyUHCSwDf2KzrOGnluH-QohM3erhe5kkQ__","documentContent":[{"html":"\u003cdiv class=\"pc pc1 w0 h0\"\u003e\u003cimg class=\"bi x0 y0 w1 h1\" alt=\"bg1\" src=\"https://static.docsity.com/documents_html/images/2011/11/09/ce59ae595b0603be063a5169c69d2243/bg1.png?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9zdGF0aWMuZG9jc2l0eS5jb20vZG9jdW1lbnRzX2h0bWwvaW1hZ2VzLzIwMTEvMTEvMDkvY2U1OWFlNTk1YjA2MDNiZTA2M2E1MTY5YzY5ZDIyNDMvKi5wbmciLCJDb25kaXRpb24iOnsiRGF0ZUxlc3NUaGFuIjp7IkFXUzpFcG9jaFRpbWUiOjE3ODMxMDIzMTV9fX1dfQ__\u0026Key-Pair-Id=K2FDQI4R6KV6U\u0026Signature=XsZJiJDiWWTli8p90SY4SfJDQx-UkgB-DXMUzClWe-TV3osmnoyX1X32lYxhA9lr0JsJHMWshfsameG-ACYwuGW8TJ74w9RglQWazuhrH4RmAFwsyyv1DbQ8CG3n5F0E~WeKV1F5l15TmqYRtYtJqAn308Fteb0U01d3W5zoVoqFrpdNoVOTGpyghMqNED~88kuNsD5hfqQux9jorRWk84~rGGWyP3g7QtZDW81OTMgVz3j8tJBrldcc9KuqWXCT3pW1CAW1rM1p7dr2c3xhodSorw2xOghafFjujXNEvj6pBKvwFptJUOyUHCSwDf2KzrOGnluH-QohM3erhe5kkQ__\" fetchpriority=\"high\" decoding=\"auto\"\u003e\u003cdiv class=\"c x1 y1 w2 h2\"\u003e\u003cdiv class=\"t m0 x2 h3 y2 ff1 fs0 fc0 sc0 ls6 ws1\"\u003e1 \u003c/div\u003e\u003c/div\u003e\u003cdiv class=\"c x3 y3 w3 h4\"\u003e\u003cdiv class=\"t m0 x4 h5 y4 ff2 fs1 fc0 sc0 ls7 ws1\"\u003eWeek 4 \u003c/div\u003e\u003cdiv class=\"t m0 x4 h6 y5 ff3 fs2 fc0 sc0 ls8 ws0\"\u003e\u003cspan class=\"ff4 ls0\"\u003e \u003c/span\u003e\u003cspan class=\"ff2 fs3 ws1\"\u003eEvaluation of IR Performance \u003c/span\u003e\u003c/div\u003e\u003cdiv class=\"t m0 x5 h7 y6 ff5 fs0 fc0 sc0 ls1\"\u003e•\u003cspan class=\"ff4 ls2\"\u003e \u003cspan class=\"ff2 ls8 ws1\"\u003e(IIR Chapter 8) \u003c/span\u003e\u003c/span\u003e\u003c/div\u003e\u003cdiv class=\"t m0 x6 h8 y7 ff5 fs4 fc0 sc0 ls3\"\u003e–\u003cspan class=\"ff4 ls4\"\u003e \u003cspan class=\"ff2 ls8 ws1\"\u003eEvaluation Metrics \u003c/span\u003e\u003c/span\u003e\u003c/div\u003e\u003cdiv class=\"t m0 x6 h8 y8 ff5 fs4 fc0 sc0 ls3\"\u003e–\u003cspan class=\"ff4 ls4\"\u003e \u003cspan class=\"ff2 ls8 ws1\"\u003eTest Collections \u003c/span\u003e\u003c/span\u003e\u003c/div\u003e\u003cdiv class=\"t m0 x4 h6 y9 ff3 fs2 fc0 sc0 ls8 ws0\"\u003e\u003cspan class=\"ff4 ls0\"\u003e \u003c/span\u003e\u003cspan class=\"ff2 fs3 ws1\"\u003eQuery Refinement \u003c/span\u003e\u003c/div\u003e\u003cdiv class=\"t m0 x5 h7 ya ff5 fs0 fc0 sc0 ls1\"\u003e•\u003cspan class=\"ff4 ls2\"\u003e \u003cspan class=\"ff2 ls8 ws1\"\u003e(IIR Chapter 9) \u003c/span\u003e\u003c/span\u003e\u003c/div\u003e\u003cdiv class=\"t m0 x6 h8 yb ff5 fs4 fc0 sc0 ls3\"\u003e–\u003cspan class=\"ff4 ls4\"\u003e \u003cspan class=\"ff2 ls8 ws1\"\u003eQuery Expansion \u003c/span\u003e\u003c/span\u003e\u003c/div\u003e\u003cdiv class=\"t m0 x6 h8 yc ff5 fs4 fc0 sc0 ls3\"\u003e–\u003cspan class=\"ff4 ls4\"\u003e \u003cspan class=\"ff2 ls9 ws1\"\u003eRelevance Feedback \u003c/span\u003e\u003c/span\u003e\u003c/div\u003e\u003c/div\u003e\u003cdiv class=\"c x3 yd w3 h4\"\u003e\u003cdiv class=\"t m0 x4 h5 y4 ff2 fs1 fc0 sc0 lsa ws1\"\u003eRelevance \u003c/div\u003e\u003cdiv class=\"t m0 x4 h6 y5 ff3 fs2 fc0 sc0 ls8 ws0\"\u003e\u003cspan class=\"ff4 ls0\"\u003e \u003c/span\u003e\u003cspan class=\"ff2 fs3 ws1\"\u003eIn what ways can a document be relevant \u003c/span\u003e\u003c/div\u003e\u003cdiv class=\"t m0 x7 h6 ye ff2 fs3 fc0 sc0 ls8 ws1\"\u003eto a query? \u003c/div\u003e\u003cdiv class=\"t m0 x6 h8 yf ff5 fs4 fc0 sc0 ls3\"\u003e–\u003cspan class=\"ff4 ls4\"\u003e \u003cspan class=\"ff2 ls8 ws1\"\u003eAnswer question precisely (or partially) \u003c/span\u003e\u003c/span\u003e\u003c/div\u003e\u003cdiv class=\"t m0 x6 h8 y10 ff5 fs4 fc0 sc0 ls3\"\u003e–\u003cspan class=\"ff4 ls4\"\u003e \u003cspan class=\"ff2 ls8 ws1\"\u003eSuggest a source for more information \u003c/span\u003e\u003c/span\u003e\u003c/div\u003e\u003cdiv class=\"t m0 x6 h8 y11 ff5 fs4 fc0 sc0 ls3\"\u003e–\u003cspan class=\"ff4 ls4\"\u003e \u003cspan class=\"ff2 ls8 ws1\"\u003eGive background information \u003c/span\u003e\u003c/span\u003e\u003c/div\u003e\u003cdiv class=\"t m0 x6 h8 y12 ff5 fs4 fc0 sc0 ls3\"\u003e–\u003cspan class=\"ff4 ls4\"\u003e \u003cspan class=\"ff2 ls8 ws1\"\u003eRemind the user of other knowledge \u003c/span\u003e\u003c/span\u003e\u003c/div\u003e\u003cdiv class=\"t m0 x4 h6 y13 ff3 fs2 fc0 sc0 ls8 ws0\"\u003e\u003cspan class=\"ff4 ls0\"\u003e \u003cspan class=\"ff2 fs3 ls5 ws1\"\u003eDegree of Relevance \u003c/span\u003e\u003c/span\u003e\u003c/div\u003e\u003cdiv class=\"t m0 x6 h8 y14 ff5 fs4 fc0 sc0 ls3\"\u003e–\u003cspan class=\"ff4 ls4\"\u003e \u003cspan class=\"ff2 ls8 ws1\"\u003eBinary: relevant or not? \u003c/span\u003e\u003c/span\u003e\u003c/div\u003e\u003cdiv class=\"t m0 x6 h8 y15 ff5 fs4 fc0 sc0 ls3\"\u003e–\u003cspan class=\"ff4 ls4\"\u003e \u003cspan class=\"ff2 ls8 ws1\"\u003eOn a scale: 0-100 \u003c/span\u003e\u003c/span\u003e\u003c/div\u003e\u003cdiv class=\"t m0 x4 h6 y16 ff3 fs2 fc0 sc0 ls8 ws0\"\u003e\u003cspan class=\"ff4 ls0\"\u003e \u003c/span\u003e\u003cspan class=\"ff2 fs3 ws1\"\u003eIntrinsic or Subjective \u003c/span\u003e\u003c/div\u003e\u003c/div\u003e\u003c/div\u003e","isFetched":true,"page":"documents_html/pages/2011/11/09/ce59ae595b0603be063a5169c69d2243/491f408af234597823e3f2f99028138e.html","pageNumber":1,"type":"HTML"},{"html":"","isFetched":false,"page":"https://static.docsity.com/documents_html/pages/2011/11/09/ce59ae595b0603be063a5169c69d2243/4393bb38d16725e2811d876a7bc8c1bb.html?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9zdGF0aWMuZG9jc2l0eS5jb20vZG9jdW1lbnRzX2h0bWwvcGFnZXMvMjAxMS8xMS8wOS9jZTU5YWU1OTViMDYwM2JlMDYzYTUxNjljNjlkMjI0My80MzkzYmIzOGQxNjcyNWUyODExZDg3NmE3YmM4YzFiYi5odG1sIiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNzgzMTAyMzE1fX19XX0_\u0026Key-Pair-Id=K2FDQI4R6KV6U\u0026Signature=mhKh46b5wEBDIMhgqRUuirrNwqGMiQrQAV~yr0vLgJQAGHNVNJdsWSRqFeTABDeMph2G2siqFQiY-A-ifpIuH73wGSacJOYoN5MM7NciwZJpVXlsTYG4OU2KfKpu6ngrQ-EkXWYRX3YCQ~EPOhQQxRibs5~53a3DpzRWt7CdipqTK3eGbFOtp6Y6ilksykqwNnv-PZiLyUOJtlIThIaIy7WqgnqmITF~gBmkv--gfhWAiAERjdcRq-HBodhvQEJcdTvdmHXwGsiaZt8cUnRmhaS3YUPZhFQInPrL4znZ3hBhQYUP8~lHhC7JhXOvzCyhABcpnn4SWaqOYZAZlUgg4A__","pageNumber":2,"type":"HTML"},{"html":"","isFetched":true,"page":"https://static.docsity.com/documents_html/blur/2011/11/09/ce59ae595b0603be063a5169c69d2243/a54a53cbfb1d1dd3d5bb74141b01b2a3.webp","pageNumber":3,"type":"IMAGE"},{"html":"","isFetched":true,"page":"https://static.docsity.com/documents_html/blur/2011/11/09/ce59ae595b0603be063a5169c69d2243/5745399bb01b1737be7b806fc09520b4.webp","pageNumber":4,"type":"IMAGE"},{"html":"","isFetched":true,"page":"https://static.docsity.com/documents_html/blur/2011/11/09/ce59ae595b0603be063a5169c69d2243/20ff3207fb324329e884b19cbbb03565.webp","pageNumber":5,"type":"IMAGE"},{"html":"","isFetched":false,"page":"https://static.docsity.com/documents_html/pages/2011/11/09/ce59ae595b0603be063a5169c69d2243/2d093724cca3d5aaba47e55d493c79a4.html?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9zdGF0aWMuZG9jc2l0eS5jb20vZG9jdW1lbnRzX2h0bWwvcGFnZXMvMjAxMS8xMS8wOS9jZTU5YWU1OTViMDYwM2JlMDYzYTUxNjljNjlkMjI0My8yZDA5MzcyNGNjYTNkNWFhYmE0N2U1NWQ0OTNjNzlhNC5odG1sIiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNzgzMTAyMzE1fX19XX0_\u0026Key-Pair-Id=K2FDQI4R6KV6U\u0026Signature=pEK8Lndwz3UnHWqA3b8fuftcs4Cz4tbqHULl3QbcrZKcLeV6Hycm7hlOmS-x-OtefsQ--IabicMSi65xoWIu8IAzS9iKXoaVZih3~TjN2dvm0ZWmDNG8eAaVoBGA92H-G2yYGEKpBhyNAq~IHP6wM6xJtN7y7wrfAq3i09wPvmczcNgP8AZ0a5Eve04nc1hyqKQtIHjEf2caup0k7r6U0wQecLxY4J5KCDo8CIEwdNGMDJpMY0Mbr4dHWuatK5DNgJr3B6TvavLHRAQRbSm8~8jxfuho5iniNNSqw91JYH9FGdFdjjtV5a6Hwel-34rPEuQMAJ-EeKfheNQtdr4Ofw__","pageNumber":6,"type":"HTML"},{"html":"","isFetched":false,"page":"https://static.docsity.com/documents_html/pages/2011/11/09/ce59ae595b0603be063a5169c69d2243/b400e355b5b8a42255bc6b0a54c1ac93.html?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9zdGF0aWMuZG9jc2l0eS5jb20vZG9jdW1lbnRzX2h0bWwvcGFnZXMvMjAxMS8xMS8wOS9jZTU5YWU1OTViMDYwM2JlMDYzYTUxNjljNjlkMjI0My9iNDAwZTM1NWI1YjhhNDIyNTViYzZiMGE1NGMxYWM5My5odG1sIiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNzgzMTAyMzE1fX19XX0_\u0026Key-Pair-Id=K2FDQI4R6KV6U\u0026Signature=nWQNV5FSC2KXDXKwj0F5iWUlodgbAPrbKoiziJZKsKgOqGZEBD9PyHrIZH3JLqYlWzHmEnOJCQ0BrRH6tmE1evAoK9LoyLxQ~u69KyEXgcqh6UGlifUzpONCwpoP2T3rIj3AxC3TIOoN7qmJFRPdq07kiPXWREeECZhqoFaET8qyeiFHhHn-64gNJ-l6wnDrj8zd8hwFlpgSw8SZDBONbYOB3FwaV5rs31atPD4n6mEsFTjxEYYxH3bTrJ1HTplz07nh1mPoxFGkKvG0-CJgO9tRKrvrYR-lrPsW-LhOiZD~hG90vgVrB1xbUEQ08fai0in8LbqlE2qS16jtYHjoHA__","pageNumber":7,"type":"HTML"},{"html":"","isFetched":true,"page":"https://static.docsity.com/documents_html/blur/2011/11/09/ce59ae595b0603be063a5169c69d2243/1d45d0dd759274a516057d8597ce4c25.webp","pageNumber":8,"type":"IMAGE"},{"html":"","isFetched":true,"page":"https://static.docsity.com/documents_html/blur/2011/11/09/ce59ae595b0603be063a5169c69d2243/a779aef733a9b68d8d7332f17005f170.webp","pageNumber":9,"type":"IMAGE"},{"html":"","isFetched":true,"page":"https://static.docsity.com/documents_html/blur/2011/11/09/ce59ae595b0603be063a5169c69d2243/6f122e1ae6322c065146fab7f35da0af.webp","pageNumber":10,"type":"IMAGE"},{"html":"","isFetched":false,"page":"https://static.docsity.com/documents_html/pages/2011/11/09/ce59ae595b0603be063a5169c69d2243/42b5ddcba835f98ed104917068f84a68.html?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9zdGF0aWMuZG9jc2l0eS5jb20vZG9jdW1lbnRzX2h0bWwvcGFnZXMvMjAxMS8xMS8wOS9jZTU5YWU1OTViMDYwM2JlMDYzYTUxNjljNjlkMjI0My80MmI1ZGRjYmE4MzVmOThlZDEwNDkxNzA2OGY4NGE2OC5odG1sIiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNzgzMTAyMzE1fX19XX0_\u0026Key-Pair-Id=K2FDQI4R6KV6U\u0026Signature=kI384XS3E-oBN8iZ3x7M3rchMaAPWVdvR9xPMzoPNp41NkNCjQD9itQtsppsGwbyDPaMAbvmgfqgpwz5tLCuwlI1tRMja0B6vk0NV0zB9ombODjffVVAwWu~ZT2b2zsNH6jqsj8a78M4ABx36j8iNhBY3hN9rksSv-YXCntz9rXpoqpJotFOjuptB3LE2JzYkl6mgHdOP19PNdftsw90dArQHB6QSGN4KlzS4jKnOvAkLEhY8jlpLytguvqqKuw2URdsgbe0yAFaa8pc9cGEV0Lm-RRF3-z4wfdwXEsnYc1GqW7xzFNE8xkd~-0DgaglYKKjmJJo~zWz~TsH7tjFXg__","pageNumber":11,"type":"HTML"},{"html":"","isFetched":false,"page":"https://static.docsity.com/documents_html/pages/2011/11/09/ce59ae595b0603be063a5169c69d2243/d751c96265e4f578e52eeb1f7977c78b.html?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9zdGF0aWMuZG9jc2l0eS5jb20vZG9jdW1lbnRzX2h0bWwvcGFnZXMvMjAxMS8xMS8wOS9jZTU5YWU1OTViMDYwM2JlMDYzYTUxNjljNjlkMjI0My9kNzUxYzk2MjY1ZTRmNTc4ZTUyZWViMWY3OTc3Yzc4Yi5odG1sIiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNzgzMTAyMzE1fX19XX0_\u0026Key-Pair-Id=K2FDQI4R6KV6U\u0026Signature=hDIk853oM1fl3C4xM8~TyHjBR9fK4Gx481wXxNQe-AkfLOszOPMfyYE1g6zK-zzK7fMWC9T-qRdhhUPMHngQjG-NucF5zDdUDFgbLoZqGTAV1XGxY~1csLpJegE0ArZdnvc4N-7VrNMOwfjpCLGvwvcogeVV3tOoNmt2IoRB0L3waTUut4IJ-8peLMotZRPcwQ79DSfq5yOMRZjqSiWwhIvBnVb5P4OEBYQHX8~e7Kxx3fm4BKHW-GHUdyVt5zmuiNF6cZRF5n0lSepX0dfR5dFPNWeoL~c66BWR~XTN0n6U0pvQN~E~EA3Q3qXQs-ke9bqZs1HEBoF6jLHnzdC~nA__","pageNumber":12,"type":"HTML"},{"html":"","isFetched":true,"page":"https://static.docsity.com/documents_html/blur/2011/11/09/ce59ae595b0603be063a5169c69d2243/54c898e1fe585347627656a5e00eb110.webp","pageNumber":13,"type":"IMAGE"},{"html":"","isFetched":true,"page":"https://static.docsity.com/documents_html/blur/2011/11/09/ce59ae595b0603be063a5169c69d2243/d81ba6d652802e7c9ebd2528bfa24f0d.webp","pageNumber":14,"type":"IMAGE"},{"html":"","isFetched":true,"page":"https://static.docsity.com/documents_html/blur/2011/11/09/ce59ae595b0603be063a5169c69d2243/0b591addf9fdf3b4a47a85aa0a4a7695.webp","pageNumber":15,"type":"IMAGE"},{"html":"","isFetched":false,"page":"https://static.docsity.com/documents_html/pages/2011/11/09/ce59ae595b0603be063a5169c69d2243/379d9abdac42462ff3abd8c8a79aed47.html?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9zdGF0aWMuZG9jc2l0eS5jb20vZG9jdW1lbnRzX2h0bWwvcGFnZXMvMjAxMS8xMS8wOS9jZTU5YWU1OTViMDYwM2JlMDYzYTUxNjljNjlkMjI0My8zNzlkOWFiZGFjNDI0NjJmZjNhYmQ4YzhhNzlhZWQ0Ny5odG1sIiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNzgzMTAyMzE1fX19XX0_\u0026Key-Pair-Id=K2FDQI4R6KV6U\u0026Signature=u~IkYt0COnJBN8HGn3RcBzBg9euI8k5BS2kFqZ8l3YyJJzXcrn8ogHY3gsdu8db1kifTZ7PfkeYWYP1GTXA-s4WTSpYp9U7a384TbsHF2XAithMwmbIj7sMDoCN3sAs8wfgdDH~CyH5-xxIeiG3GXMJoNAmToUFiH1xOevtA-EFHg50hjc~1qsor5mxQmEADAgfND7~1kDChCQx75DvX31X1uXMO-uKQQNrXtmfIJs3smAcjzEFneqLGX3Xea8kzaS~t5swOE2YJeA3q9NNCU1NrRKnRbGViCRJUB21dt67zCWHrzPKgHkRhXuQECiFHJljXamfCZh~6R~UBXx67xA__","pageNumber":16,"type":"HTML"},{"html":"","isFetched":false,"page":"https://static.docsity.com/documents_html/pages/2011/11/09/ce59ae595b0603be063a5169c69d2243/ac29b3ccebb56db6824f7734feb4e410.html?Policy=eyJTdGF0ZW1lbnQiOlt7IlJlc291cmNlIjoiaHR0cHM6Ly9zdGF0aWMuZG9jc2l0eS5jb20vZG9jdW1lbnRzX2h0bWwvcGFnZXMvMjAxMS8xMS8wOS9jZTU5YWU1OTViMDYwM2JlMDYzYTUxNjljNjlkMjI0My9hYzI5YjNjY2ViYjU2ZGI2ODI0Zjc3MzRmZWI0ZTQxMC5odG1sIiwiQ29uZGl0aW9uIjp7IkRhdGVMZXNzVGhhbiI6eyJBV1M6RXBvY2hUaW1lIjoxNzgzMTAyMzE1fX19XX0_\u0026Key-Pair-Id=K2FDQI4R6KV6U\u0026Signature=FSgxa2cIEnDmdqbmkLam4HaO6WbrnwTAO1CRzf~4uTHDx2vujlp557l0eVgU02TzzaaFa42YsDg2KsT9rOFuGWRu4m-vOnQj~tkuveEAbxwg06UTeINUyYuraWHLL~aM9z3pPX1ltcWrkyKXbyel~y8WhNQdp5QRcwL~lguQG4UhCrjsum2-wsQmWGaMQ3zLwijlICwhPGlFKd0fVOIezw9sO4fXObk3A4v~RKGUkhlN-0b-TrerWb5MurjcK7jhgFndw8L0get6xOJkmSa4RGLaaDCo7TejbzVOSLwPIGDtZ-aBYleL3XBWduGxrK9zIgK0rTGo50~AT9OehTKp~g__","pageNumber":17,"type":"HTML"},{"html":"","isFetched":true,"page":"https://static.docsity.com/documents_html/blur/2011/11/09/ce59ae595b0603be063a5169c69d2243/b93b2989dd9acb76066f97e5dde42ffe.webp","pageNumber":18,"type":"IMAGE"},{"html":"","isFetched":true,"page":"https://static.docsity.com/documents_html/blur/2011/11/09/ce59ae595b0603be063a5169c69d2243/f1022424edc530ea2200c7948d192beb.webp","pageNumber":19,"type":"IMAGE"},{"html":"","isFetched":true,"page":"https://static.docsity.com/documents_html/blur/2011/11/09/ce59ae595b0603be063a5169c69d2243/e05a5042b9d838f3efee09a7bb8752d2.webp","pageNumber":20,"type":"IMAGE"},{"html":"","isFetched":true,"page":"https://static.docsity.com/documents_html/blur/2011/11/09/ce59ae595b0603be063a5169c69d2243/f41ccd1bf7f372684e45eb57eab9d1d5.webp","pageNumber":21,"type":"IMAGE"},{"html":"","isFetched":true,"page":"https://static.docsity.com/documents_html/blur/2011/11/09/ce59ae595b0603be063a5169c69d2243/e05c346151d6641aeb3191e9aac09883.webp","pageNumber":22,"type":"IMAGE"},{"html":"","isFetched":true,"page":"https://static.docsity.com/documents_html/blur/2011/11/09/ce59ae595b0603be063a5169c69d2243/d72532b14a394a1d16e673fa1c8bcde7.webp","pageNumber":23,"type":"IMAGE"},{"html":"","isFetched":true,"page":"https://static.docsity.com/documents_html/blur/2011/11/09/ce59ae595b0603be063a5169c69d2243/76f0b61eaac4eaac7aca0889fca96d06.webp","pageNumber":24,"type":"IMAGE"}],"documentStructure":{"maxWidth":1240,"maxHeight":1602,"pages":[{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"},{"className":"pf w0 h0","width":"1240","height":"1602.679739"}],"sizes":[{"width":"1240","height":"1602.679739","numberOfPages":24}]},"documentText":"\u003ch2\u003eWeek 4\u003c/h2\u003e \u003ch3\u003e Evaluation of IR Performance\u003c/h3\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003e(IIR Chapter 8)\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eEvaluation Metrics\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eTest Collections\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch3\u003e Query Refinement\u003c/h3\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003e(IIR Chapter 9)\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eQuery Expansion\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eRelevance Feedback\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch2\u003eRelevance\u003c/h2\u003e \u003ch3\u003e In what ways can a document be relevant\u003c/h3\u003e \u003ch3\u003eto a query?\u003c/h3\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eAnswer question precisely (or partially)\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eSuggest a source for more information\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eGive background information\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eRemind the user of other knowledge\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch3\u003e Degree of Relevance\u003c/h3\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eBinary: relevant or not?\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eOn a scale: 0-\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch3\u003e Intrinsic or Subjective\u003c/h3\u003e \u003ch2\u003eWhat to Evaluate?\u003c/h2\u003e \u003ch3\u003e What can be measured that reflects\u003c/h3\u003e \u003ch3\u003eusers’ ability to use system? (Cleverdon 66)\u003c/h3\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eCoverage of Information\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eForm of Presentation\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eEffort required/Ease of Use\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eTime and Space Efficiency\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eRecall\u003c/strong\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eproportion of relevant material actually retrieved\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003ePrecision\u003c/strong\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eproportion of retrieved material actually relevant\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch2\u003eProblems with Precision/Recall\u003c/h2\u003e \u003ch3\u003e Can’t know true recall value\u003c/h3\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eexcept in small collections\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch3\u003e Precision/Recall measure different\u003c/h3\u003e \u003ch3\u003easpects of search quality\u003c/h3\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eA combined measure sometimes is more\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch4\u003eappropriate\u003c/h4\u003e \u003ch3\u003e Focused somewhat on set evaluation vs.\u003c/h3\u003e \u003ch3\u003eranked lists\u003c/h3\u003e \u003cp\u003e\u003cstrong\u003ePrecision/Recall Curves\u003c/strong\u003e \u003cstrong\u003eThere is a tradeoff between precision and recall\u003c/strong\u003e \u003cstrong\u003eSo measure precision at different levels of recall\u003c/strong\u003e\u003c/p\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eInterpolate\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eAverage over multiple queries\u003c/strong\u003e precision recall x x x x x x x x x x x Which of these three curves is better?\u003c/li\u003e \u003c/ul\u003e \u003ch2\u003eExisting Test Collections\u003c/h2\u003e \u003ch4\u003e Historical, Small\u003c/h4\u003e \u003ch5\u003e– CACM (3204), CISI (1460), CRAN (1397)\u003c/h5\u003e \u003ch5\u003e– INSPEC (12684), MED (1033), REUTERS (21578)\u003c/h5\u003e \u003ch4\u003e More recent\u003c/h4\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eTREC: 1.5M newsprint; 10/18/100GB Web; 1 TB\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eCLEF: 1M+ newspaper articles from 1994 – 1995, 13 langs\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eNTCIR: Asian languages (JP, KR, ZH)\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eFIRE: Hindi, Marathi, Bengali (about 100k docs each)\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eReuters RV1 (880,000)\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch2\u003eText REtrieval Conference (TREC)\u003c/h2\u003e \u003ch4\u003e Annual bake-off for text retrieval systems\u003c/h4\u003e \u003ch4\u003e Sponsored by\u003c/h4\u003e \u003ch4\u003e Roughly 2.5 gigabytes of text, newswire\u003c/h4\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003e50 “topics” (queries)\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eReturn top 1000 documents per topic (~80 groups)\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eResults judged by retired intelligence analysts\u003c/strong\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eDocuments are relevant or not\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch4\u003e Numerous tracks\u003c/h4\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eCross-Language\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eSpoken Documents\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eQuestion Answering\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch4\u003e http://trec.nist.gov/\u003c/h4\u003e \u003ch2\u003eSample TREC Topic\u003c/h2\u003e \u003cp\u003e\u003ctop\u003e \u003cnum\u003e Number: 285 \u003ctitle\u003e Topic: World submarine forces \u003cdesc\u003e Description: Determine the number of submarines, both nuclear-powered and conventional, presently in the inventories of all the countries in the world. \u003cnarr\u003e Narrative: We are looking for a count of operable submarines in any country that currently has a navy with submarines. To be relevant a document should give a specific number of submarines, but not necessarily its entire fleet of submarines (although, that is our ultimate goal). A report of a French submarine suffering a mishap in the North sea would not be relevant. However, a report of a new submarine being built in Shanghai that contains other valuable information, such as “this is the third reported unit constructed at this base” would be relevant. Any information that would be considered useful as an intelligence tool in determining a country’s submarine order of battle would be relevant. \u003c/top\u003e SGML Markup Short Phrase Sentence Paragraph\u003c/p\u003e \u003ch2\u003eHow Test Runs are Evaluated\u003c/h2\u003e \u003cp\u003e \u003cstrong\u003eFirst ranked doc is relevant, which is 10% of the total relevant. Therefore Precision at the 10% Recall level is 100%\u003c/strong\u003e \u003cstrong\u003eNext Relevant gives us 66% Precision at 20% recall level\u003c/strong\u003e \u003cstrong\u003eEtc….\u003c/strong\u003e\u003c/p\u003e \u003ch3\u003e1. d 123 *\u003c/h3\u003e \u003ch3\u003e2. d 84\u003c/h3\u003e \u003ch3\u003e3. d 56 *\u003c/h3\u003e \u003ch3\u003e4. d 6\u003c/h3\u003e \u003ch3\u003e5. d 8\u003c/h3\u003e \u003ch3\u003e6. d 9 *\u003c/h3\u003e \u003ch3\u003e7. d 511\u003c/h3\u003e \u003ch3\u003e8. d 129\u003c/h3\u003e \u003ch3\u003e9. d 187\u003c/h3\u003e \u003ch3\u003e10. d 25 *\u003c/h3\u003e \u003ch3\u003e11. d 38\u003c/h3\u003e \u003ch3\u003e12. d 48\u003c/h3\u003e \u003ch3\u003e13. d 250\u003c/h3\u003e \u003ch3\u003e14. d 113\u003c/h3\u003e \u003ch3\u003e15. d 3 *\u003c/h3\u003e \u003cp\u003eRq={d 3 ,d 5 ,d 9 ,d 25 ,d 39 ,d 44 ,d 56 ,d 71 ,d 89 ,d 123 } : 10 Relevant Example from Chapter 3 in MIR\u003c/p\u003e \u003ch2\u003eInterpolation\u003c/h2\u003e \u003ch3\u003e So, at recall levels 0%, 10%, 20%, and\u003c/h3\u003e \u003ch3\u003e30% the interpolated precision is 33.3%\u003c/h3\u003e \u003ch3\u003e At recall levels 40%, 50%, and 60%\u003c/h3\u003e \u003ch3\u003einterpolated precision is 25%\u003c/h3\u003e \u003ch3\u003e And at recall levels 70%, 80%, 90% and\u003c/h3\u003e \u003ch3\u003e100%, interpolated precision is 20%\u003c/h3\u003e \u003ch3\u003e Giving graph…\u003c/h3\u003e \u003cp\u003e\u003cstrong\u003eX\u003c/strong\u003e\u003c/p\u003e \u003ch2\u003eInterpolation\u003c/h2\u003e \u003ch5\u003eP R E C I S I O N\u003c/h5\u003e \u003ch5\u003eRECALL\u003c/h5\u003e \u003cp\u003e\u003cstrong\u003eX X\u003c/strong\u003e\u003c/p\u003e \u003ch2\u003eComputing Average Precision\u003c/h2\u003e \u003cp\u003e \u003cstrong\u003eWe sum over the 5 seen relevant documents\u003c/strong\u003e \u003cstrong\u003e(1 + 0.66 + 0.5 + 0.4 + 0.3)\u003c/strong\u003e \u003cstrong\u003eWe must divide by the number of relevant (10 docs)\u003c/strong\u003e\u003c/p\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003e5 relevant document’s weren’t\u003c/strong\u003e \u003cstrong\u003eobserved\u003c/strong\u003e \u003cstrong\u003eAverage Precision is 0.\u003c/strong\u003e \u003cstrong\u003e\u003cem\u003eMean\u003c/em\u003e\u003c/strong\u003e \u003cstrong\u003eaverage precision is an average over multiple queries\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch2\u003e1. d 123 *\u003c/h2\u003e \u003ch2\u003e2. d 84\u003c/h2\u003e \u003ch2\u003e3. d 56 *\u003c/h2\u003e \u003ch2\u003e4. d 6\u003c/h2\u003e \u003ch2\u003e5. d 8\u003c/h2\u003e \u003ch2\u003e6. d 9 *\u003c/h2\u003e \u003ch2\u003e7. d 511\u003c/h2\u003e \u003ch2\u003e8. d 129\u003c/h2\u003e \u003ch2\u003e9. d 187\u003c/h2\u003e \u003ch2\u003e10. d 25 *\u003c/h2\u003e \u003ch2\u003e11. d 38\u003c/h2\u003e \u003ch2\u003e12. d 48\u003c/h2\u003e \u003ch2\u003e13. d 250\u003c/h2\u003e \u003ch2\u003e14. d 113\u003c/h2\u003e \u003ch2\u003e15. d 3 *\u003c/h2\u003e \u003cp\u003eRq={d 3 ,d 5 ,d 9 ,d 25 ,d 39 ,d 44 ,d 56 ,d 71 ,d 89 ,d 123 } : 10 Relevant\u003c/p\u003e \u003ch2\u003eUsing TREC_EVAL\u003c/h2\u003e \u003ch4\u003e Developed from SMART evaluation programs\u003c/h4\u003e \u003ch4\u003efor use in TREC\u003c/h4\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003etrec_eval [-q] [-a] [-d] trec_qrel_file top_ranked_file\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch4\u003e Uses:\u003c/h4\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eList of top-ranked documents\u003c/strong\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eQID iter docno rank sim runid\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003e030 Q0 ZF08-175-870 0 4238 prise\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eQRELS file for collection\u003c/strong\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eQID docno rel\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003e251 0 FT911-1003 1\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003e251 0 FT911-101 1\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003e251 0 FT911-1300 0\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch2\u003eQuery Refinement\u003c/h2\u003e \u003ch3\u003e Global Methods\u003c/h3\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eContext independent thesaurus expansion\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch3\u003e Local Methods\u003c/h3\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eManual Feedback\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eAutomated Relevance Feedback\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch2\u003eQuery Modification\u003c/h2\u003e \u003ch3\u003e Problem: how to reformulate the query?\u003c/h3\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eThesaurus expansion:\u003c/strong\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eSuggest terms similar to query terms\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eGlobal method: see car, add ‘automobile’\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eRelevance feedback:\u003c/strong\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eSuggest terms (and documents) similar to\u003c/strong\u003e \u003cstrong\u003eretrieved documents that have been judged (by a\u003c/strong\u003e \u003cstrong\u003euser) to be relevant (or use top k documents)\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eLocal method: based on retrieved document set\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eTerm re-weighting\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch2\u003eThesauri\u003c/h2\u003e \u003ch3\u003e Some electronic thesauri exist\u003c/h3\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eE.g., Roget’s\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eDomain specific thesauri (e.g., chemistry)\u003c/strong\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003emight map NaCl, salt, sodium chloride\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch3\u003e Other approach is to induce one from a\u003c/h3\u003e \u003ch3\u003ecollection of text, statistically\u003c/h3\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eCan capture synonymy\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eBut, might also get other word relations\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch3\u003e My opinion\u003c/h3\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eThesaurus-based query expansion is best\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch4\u003ewith controlled vocabulary search\u003c/h4\u003e \u003ch2\u003eAutomagically building thesauri\u003c/h2\u003e \u003ch3\u003e Church (“One Term or Two”, SIGIR 1995)\u003c/h3\u003e \u003ch3\u003elooked at correlations between forms of\u003c/h3\u003e \u003ch3\u003ewords in texts\u003c/h3\u003e \u003ch3\u003e If hostage and hostages both occur in a\u003c/h3\u003e \u003ch3\u003edocument\u003c/h3\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eWorth more than single occurrence, but less\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch4\u003ethan two. Possibly 1.\u003c/h4\u003e \u003ch3\u003e Church proposes novel term weighting\u003c/h3\u003e \u003ch3\u003escheme\u003c/h3\u003e \u003cp\u003e\u003cstrong\u003ehostages! hostages hostage 619 479 ! hostage 648 78,\u003c/strong\u003e\u003c/p\u003e \u003ch2\u003eLexical Associations\u003c/h2\u003e \u003cp\u003e \u003cstrong\u003eSubjects write first word that comes to mind\u003c/strong\u003e\u003c/p\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003edoctor/nurse; black/white (Palermo \u0026amp; Jenkins 64)\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eText corpora yield similar associations\u003c/strong\u003e \u003cstrong\u003eOne measure: Mutual Information\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eSee Church and Hanks (Comp. Ling. ’90)\u003c/strong\u003e \u003cstrong\u003eIf word occurrences are independent, the numerator and denominator become equal\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003ewhen measured across a large collection\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch2\u003eAssociations with “Doctor”\u003c/h2\u003e \u003ch4\u003e(AP Corpus, N=15 million, Church \u0026amp; Hanks)\u003c/h4\u003e \u003cp\u003e\u003cstrong\u003eMI(x,y) f(x,y) f(x) x f(y) y\u003c/strong\u003e 11.3 12 111 honorary 621 doctor 11.3 8 1105 doctors 44 dentists 10.7 30 1105 doctors 241 nurses 9.4 8 1105 doctors 154 treating 9.0 6 275 examined 621 doctor 8.9 11 11.05 doctors 317 treat 8.7 25 621 doctor 1407 bills 0.96 6 621 doctor 73785 with 0.95 41 284690 a 1105 doctors 0.93 12 84716 is 1105 doctors\u003c/p\u003e \u003ch2\u003eTerm Similarity Calculations\u003c/h2\u003e \u003cp\u003e \u003cstrong\u003eMultiple metrics possible\u003c/strong\u003e\u003c/p\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eSee Chung \u0026amp; Lee, JASIST\u003c/strong\u003e \u003cstrong\u003e52(4), 2001 for comparison\u003c/strong\u003e \u003cstrong\u003eContingency table Present Absent Present a b a+b Absent c d c+d a+c b+d N snow plow\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch2\u003eRelevance Feedback\u003c/h2\u003e \u003ch3\u003e Main Idea:\u003c/h3\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eModify existing query based on relevance\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e \u003ch4\u003ejudgments\u003c/h4\u003e \u003cul\u003e \u003cli\u003e\u003cstrong\u003eExtract terms from relevant documents and add\u003c/strong\u003e \u003cstrong\u003ethem to the query\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eand/or re-weight the terms already in the query\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eManually\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eUsers select relevant documents\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eUsers/system select terms from an automatically- generated list\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eAutomated (blind/pseudo) rel. feedback\u003c/strong\u003e\u003c/li\u003e \u003cli\u003e\u003cstrong\u003eAssume top\u003c/strong\u003e \u003cstrong\u003e\u003cem\u003ek\u003c/em\u003e\u003c/strong\u003e \u003cstrong\u003edocs are relevant (e.g., 5 to 20)\u003c/strong\u003e\u003c/li\u003e \u003c/ul\u003e ","relatedDocs":[{"id":38661,"lang":"en","slug":"information-retrieval-5-exercises-computer-science","title":"Information Retrieval 5, Exercises - Computer Science","isStore":false,"isPrime":false,"isTop":false,"averageVotes":"4.5","reviewsCount":2},{"id":38687,"lang":"en","slug":"information-retrieval-tolerant-retrieval-lecture-slides-computer-science","title":"Information Retrieval Tolerant Retrieval, Lecture Slides - Computer Science","isStore":false,"isPrime":false,"isTop":false,"averageVotes":"0.0","reviewsCount":0},{"id":38658,"lang":"en","slug":"information-retrieval-3-exercises-computer-science","title":"Information Retrieval 3, Exercises - Computer Science","isStore":false,"isPrime":false,"isTop":false,"averageVotes":"0.0","reviewsCount":0},{"id":38655,"lang":"en","slug":"information-retrieval-2-exercises-computer-science","title":"Information Retrieval 2, Exercises - Computer Science","isStore":false,"isPrime":false,"isTop":false,"averageVotes":"0.0","reviewsCount":0},{"id":38676,"lang":"en","slug":"information-retrieval-overview-lecture-slides-computer-science","title":"Information Retrieval Overview, Lecture Slides - Computer Science","isStore":false,"isPrime":false,"isTop":false,"averageVotes":"0.0","reviewsCount":0},{"id":38660,"lang":"en","slug":"information-retrieval-4-exercises-computer-science","title":"Information Retrieval 4, Exercises - Computer Science","isStore":false,"isPrime":false,"isTop":false,"averageVotes":"0.0","reviewsCount":0},{"id":38663,"lang":"en","slug":"information-retrieval-6-exercises-computer-science","title":"Information Retrieval 6, Exercises - Computer Science","isStore":false,"isPrime":false,"isTop":false,"averageVotes":"0.0","reviewsCount":0},{"id":38667,"lang":"en","slug":"information-retrieval-and-nlp-lecture-slides-computer-science","title":"Information Retrieval and NLP, Lecture Slides - Computer Science","isStore":false,"isPrime":false,"isTop":false,"averageVotes":"0.0","reviewsCount":0},{"id":38681,"lang":"en","slug":"information-retrieval-7-exercises-computer-science","title":"Information Retrieval 7, Exercises - Computer Science","isStore":false,"isPrime":false,"isTop":false,"averageVotes":"0.0","reviewsCount":0},{"id":38653,"lang":"en","slug":"information-retrieval-and-question-answering-lecture-slides-computer-science","title":"Information Retrieval and Question Answering, Lecture Slides - Computer Science","isStore":false,"isPrime":false,"isTop":false,"averageVotes":"0.0","reviewsCount":0},{"id":38670,"lang":"en","slug":"information-retrieval-distributed-retrieval-lecture-slides-computer-science","title":"Distributed Info Retrieval: Algorithms for Partitioning, Files, and Queries","isStore":false,"isPrime":false,"isTop":false,"averageVotes":"0.0","reviewsCount":0},{"id":38678,"lang":"en","slug":"information-retrieval-search-and-multilinguality-lecture-slides-computer-science","title":"Cross-Language Information Retrieval: N-grams and Query Expansion","isStore":false,"isPrime":false,"isTop":false,"averageVotes":"0.0","reviewsCount":0}],"suggestedDocs":[]},"__N_SSP":true},"page":"/docs","query":{"slug":"information-retrieval-performance-lecture-slides-computer-science","id":"38683"},"buildId":"88ab84EjVlt2ImlLvPoah","assetPrefix":"https://assets.docsity.com/mf/docs/4.10.13","isFallback":false,"isExperimentalCompile":false,"gssp":true,"appGip":true,"locale":"en","locales":["default","it","en","es","pt","fr","pl","ru","sr","de"],"defaultLocale":"default","scriptLoader":[]}</script></body></html>
