Evalvator

-
Evaluator is for Client Query evaluation and Rate mapping . The Aim to increase the map technology to user tomakesure they receive the relevant and accurate details for evaluate as per topic relevant to the guide lines and rate the results .

Part 1 - Relevance is Navigational Excellent , Good , Acceptable Bad

Querry are address querry , POI, Business , Category , My Location , and the result can be Business /POI type with classification , Address type with no classification , result a POI and not a address with feature like bus stop, park

Part 2 - Name Accuracy High-level question - language script , business not exits

Business queries - Restuarant , hotles, Store , Chain Business ,

Name not Applicable is N/A Names can't be verified also ifdatais not obtained fromstoremenu.logo,Articles ,

cooperate naems

result & the web siite

McDonald’s McDonald’s CorrectCorrect

Peet’s Coffee & Tea is Peet’s - Polk Stree tCorrect

best Buy is Best Buy San Jose Correct

Microsoft - Microsoft Store Correct

Location Modifier

Apple-----Apple Valley Fair

Peet’s Coffee------Peet’s – Ferry Bldg S

Old Navy – Belle Isle Station-----Old Navy

Delgado Community College – Charity School of Nursing----Charity School of Nursing is due tolocation modifier

stylized logos and letters

Toys ‘R’ Us-----Toys Я Us

missing

Home Depot- The Home Depot is correct

Partially correct



Macys-Macy’s

HM-H&M

uhaul uhaul-U-Haul Seven Eleven--7-Eleven GAMESTOP--GameStop Mosjaw---Moosejaw Eco future Buildng Co---Ecofutures Building Inc

Napoli Coffeehouse & Pastries--- Napoli Coffee

GAP Superstore----GAP

BerkeleyLaw Univerzitní of California====Berkeley law University of California

Aqua Spa 䄬ଝ࿜ ᮷ Aqua Spa - Ocean City

att---AT&T

University of California-----University of California Irvine

Nike-----NIKELAB 21M NYC

The Sears-------Sears



Patagonia Outlet----Patagonia

Delhaize----Delhaize Supermarkt

Best Buy----Best Buy Express

Best Buy Express----Best Buy

IT’SUGAR LLC-----IT’SUGAR

Nordstrom, Inc.------Nordstrom

and incorrect names

misspelling changes the meaning
factory and chain business is different

british slang classification accracy

POI - Interesting location The same rating rules will apply to both Business and POI results.

When you can’t make a decision about business closure due to lack of resources, assume the business could exist and rate the name, address, and pin accuracy as Can’t Verify (unless there is an obvious data issue like a missing mandatory address component or a pin in the ocean. .

category queery - Bus stopm fast foods, coffee shops

location querry - Lomgitude and latitude , Explicit location intent & Implicit location Intend where location and area is clear and not clear where by using viewport and user location for expected result

Localized are country state city and Non-Localized Components Emoji Queries

Bad querry fails in No Location, No location Intent , ,

Nmeaccuracy part 2
Correct Incorrect Part 3 - Address Accuracy Address results can be one of the multiple address types, residential address or locality.

163 Main St.”, but only “163A Main St.” and “163B Main St.” Adress extnesion is wrong

1) complete address, including street number, street name, locality, state, country, and postal code. which is a Point of Interest

Address Accuracy Incorrect – Language/Script Issue checkbox if you find issues of this nature in any of the address components in the address details (not the address title) of any result.

Closed/Does Not Exist vs. Inaccurate Name and Address

Rating Relevance of Closed/Non-existing Business/POI Never automatically demote to Bad. Use your best judgement to determine how well the result satisfies user intent within the area of expected results.

street no , unit / apt, street name , mispelled street names , street direction and types,

locality and administrative boundaries

region & state

postalcode Any combination of unexpected language or script is considered Incorrect.

163 Main St.”, but only “163A Main St.” and “163B Main St.” Adress extnesion is wrong

Country Specific Issue when there is an address problem that is not covered by the available checkboxes. This includes things like instances when an address also requires a sub-locality or municipality in addition to locality and state, but those components are either missing or incorrect.

uplicate address components The name of POI reappears in the address details Natural features that contain street address elements (see Natural Features) P.O. box addresses

Formatting issues include the order of addressing components and other minor issues that are not necessarily considered wrong.

omponents are in an unexpected order Non-required but correct address components Extra spacing Double comma [,,] Rate Incorrect if a required component is missing

can't veify Lack of resources: No official webpage found No official address listed General lack of official resources Lack of street imagery Unexpected address formats used by official resources can include: Intersection address (Main St and 2nd St) Exit address (Exit 5, Hwy 101) Descriptive address (Main St between 6th and 7th Streets)

Business, Residenital area, Naturalfeatures,landmark, transit station ,nationalparks

Can’t Verify for Street Number

Part 4 -Pin Accuracy

Languages and script

test locale’s language depend on Localized are country state city and Non-Localized Components are square, bridge, roundabout, or intersection)) Street names and street addresses including building names)

Expected language/script:

Test locale: en_US

Result in California, USA

Query: [mystery]

Result Name: Mystery Spot

The result name is in English and satisfies the query.

Expected language/script:

Test locale: es_ES

Result in California, USA

Query: [college]

Result name: Colegio Skyline

The result name is in Spanish, which matches the language of the test locale, so this result title is expected and acceptable..

Expected language/script:

Test locale: en_US

Result in Rio de Janeiro, BR

Query: [beach]

Result name: Praia de Copacabana Result satisfies the category “beach” and the result’s name is in Latin script and the Portuguese language, which is the language of Brazil.

Expected language/script:

Test locale: en_US

Result in Rio de Janeiro, BR

Query: [beach]

Result name: Praia de Copacabana Result satisfies the category “beach” and the result’s name is in Latin script and the Portuguese language, which is the language of Brazil.

Unexpected language/script:

Test locale: ar_SA

Suggestion in Riyadh, SA

]ماكدونالدز[ Query:

Result name: [ϫμϖϗϸϖ]

The name of this restaurant is in Japanese, which is not the language of the query, the locale, the result region, or the official brand name.

Unexpected language/script:

Test locale: en_US Result in Rio, BR Query: [beach] Result name: Playa de Copacabana Though the result name is in the same script as the test locale and query language, returning the name in Spanish is unexpected language because the language of Brazil is Portuguese. Unexpected language/script:

Test locale: en_US

Result in California, USA

Query: [college]

Result name: Colegio Skyline

“Colegio” is in Spanish, but the test locale is in English, so the result title is in an unexpected language.

Unexpected language/script:

Test locale: en_US

Result in California, USA

Query: [market]

Result Name: ေစျးကွက်

The result name is “Market” in Burmese script.
Extreme prominence (e.g. Eiffel Tower) Uniqueness (e.g. complete address) Proximity (e.g. incomplete address that points to an unambiguous option that is is extremely close)
User Intent Issue Distance/Prominence Issue

relevance is Satisfying user intent, Prominence, Distance

satisfies intent and is the closest to the user is good rating
Br> locations that are a bit farther away from the user/viewport is good

esult implied by the user’s query, location, and/or viewport that completely satisfies the user’s distinct intent is navigational

igh-quality result that clearly satisfies the user’s intent is excellent

atisfy the user’s intent due to lack of relevance or great distance should have a relevance rating ispoor

partially satisfies the user’s intent due to relevance, prominence, or distance should have a relevance rating o is good

satisfies the user’s intent but does so poorly due to relevance is Acceptable

Query-Result Connection

General Connection. most specific part of the query’s intent. like Mariot hotel and the result is San Francisco Marriott Union Square ---- Houston airport] George Bush Intercontinental ----- london, brighton in London

2) abbreviation or alternate name like [ewr] Newark Liberty International Airport and [sears tower] Willis Tower is a alternate name

3) category food La Ciccia restaurant

4) transit intent of the query [bart] Richmond BART Station Transit Intent close station that runs the requested transit service for a user/viewport located in the Richmond area.

5) specific language conventions --- möllersdorf Moellersdorf "oe" is a valid variation for the special character "ö" in the country/language of the result (Germany/German).


Addess result connection 1_ query[357 westernave suite 1]

result 357 Western Ave St. Johnsbury, VT -----Query street number is missing ,the Address is good

2) Query 357 westernave suite 1]

Result 357 Western Ave Suite 2 Query and result street number changes from 1 to 2 so it is good

3) Query : 357 westernave suite 1]



Result : Western Ave St. Johnsbury, V

Not a full address only street name is in result soit is acceptable

4) query [357 western ave st. johnsbury]

result St. Johnsbury, VT

Only locality in result so it bad

Lack of connection is bad rating .if the query and result not matches .

Lack of connection is the Result does not include the business named in the query, so users will have no way of knowing if this is truly connected to the business or not. Rate Bad.

Lack of connecion is the Result is for a store, not a mall. This store is inside the requested mall, but does not satisfy the intent of the query, which is the whole mall.

Lack of connection is the Result is for a mall, not a store. This mall contains the requested store, but this result is the whole mall, not the single store the user asked for.. Rate Bad.

Lack of connection is the Result is for a Costco gas station, not a Costco store. The store and the station are at the same address and share a brand name, but the result is not what the user asked for and does not satisfy the query intent. Rate Bad.

Lack of connection is the Result is for a Costco store, not a Costco gas station. The store and the station are at the same address and share a brand name, but the result is not what the user asked for and does not satisfy the query intent. Rate Bad.

User Intent issue Select when the demotion is due to a result only partially fulfilling the query intent. If both issues were reasons for your relevance rating, select both checkboxes. .

Distance/ Prominence issue :Select when the demotion is due to a distance issue based on the user or viewport location or when you demoted for a result that is less prominent based on the initial query intent. You can also select this option when the query asks for something at a specific location and the result is not at or near the requested location..

Comments on user intenet or distance prominance

prominancemeanspopularity

distance demote and do notdemote

distance v/s prominance

A query is having multiple intent based to satisfy the user based on distance ,prominance

country ,city , statein navigation good,bad

The Query is for a street and resultinclude the street number will notsatisfy the user rated bad

The Query is for intersection , query for neighbourhood,not resturant , The query is for a street and the result is a specific business on that street is bad , Result is for the address and not the business stated in the query,, The query is for an entire mall and the result is for a cinema inside the mall. Even though the cinema shares the mall’s name and address, it does not match the query intent. is navigation algoodand bad

Unique
demoting on uniquue names,

demoting on tramp stops

Comments

Post a Comment

Popular posts from this blog

cemenary

-
2) Culver's 7208 Mineral Point Rd, Madison, WI 53717 Not Naviagational Relevance Good Name Accuracy : Correct Street Number Address : Incorrect Pine Correct 3) Miami Name,Address Pin perfect not naviagational 4) One Stop Drive Thru Liquor One Stop Drive Thru Liquor 6702 W Indian School Rd, Phoenix, AZ 85033 Star Plaza Shopping Center, 6702 W Indian School Rd, Phoenix, AZ 85033, United States Name Address pincode is correct not navigation; 5) 5 Guys incorrect address street name missing Name Partially correct rating acceptable 2260 Callagan Hwy Bldg 3187-A, San Diego, CA 92136 2260 Callaghan Cir Bldg 3187-A, San Diego, CA 92136, 6) American Eagle Outfitters American Eagle Store 3200 W South Airport Rd, Traverse City, MI 49684, United States 3200 W South Airport Rd, Traverse City, MI 49684 rating bad user intend pincode appropriate 7) XCaret Club And Lounge XCaret Club And Lounge 2700 University Ave, West Des Moines, IA 50266, United States 2701 University...
Read more

instruction

-
Page 1 MilkyWay - Phone/Browser Search Rating' Project Work is to satisfaction ratings for the results of the searches from smartphone users. client and project details are confidential and must not be breached! Introduction page 2 Search Engine result satisfy our searches that help people compare the result of two searches and rate those results and rating chenges on web app and mobile app . There are three types of tasks 1) Resut from one search query and rate how satisfying each result 2) Result from two search query and rate how satisfying each result 3) Result from two search query and rate how satisfying each result and choose which version of result selected Four Result are infocards vedieos Image in group web result eg weather weather of melborune weather of melborune card on topic sunrise card on topic sunrise Appon sunserland sunrise wwww.sunrise.com Here wwww.sunrise.com is inappropriate Since the site is not safe and insecure and rat...
Read more