Skip to main content
 
 
 
IN THIS SECTION
4 posts
crew102
Last seen: 09/13/2021 - 21:26
Joined: 11/25/2019 - 12:02
Evaluation metrics are missing for inventor disambiguation

Greetings -

Does PatentsView have evaluation metrics on the various inventor evaluation sets that they're willing to make public? I noticed in the docs (https://s3.amazonaws.com/data.patentsview.org/documents/PatentsView_Disambiguation_Methods_Documentation.pdf) that only assignee and location-based disambiguation tasks had evaluation metrics reported.

Thanks,

Chris

emelluso
Role: administrator
Last seen: 01/20/2023 - 13:57
Joined: 10/21/2020 - 10:51
Hello Chris, Here is the…

Hello Chris, 

Here is the information you requested. It will likely be included in future documentation but is not currently part of anything publicly available. 

Table with metrics and classifications for evaluation

Best,

Emily, on behalf of  the PVTeam

crew102
Last seen: 09/13/2021 - 21:26
Joined: 11/25/2019 - 12:02
Hi Emily - Thanks for the…

Hi Emily -

Thanks for the prompt response. I don't think any of those evaluation sets are for inventors, though. In other words, I'm looking for metrics that describe the ability of the disambiguation algorithm to disambiguate inventors on patents, not assignees or locations.

Chris

PVTeam
Role: moderator
Last seen: 01/23/2023 - 12:16
Joined: 10/17/2017 - 10:47
Hello Chris! So sorry about…

Hello Chris! So sorry about that table not being the correct one. 

Here is the inventor metrics table: 

 

# Mentions

# Entities

Prec

Rec

F1

Academic Life Sciences

41347

4743

0.999

0.975

0.987

Academic Life Sciences Common Characteristics

9396

1150

0.997

0.960

0.978

Engineers and Scientists

10595

1821

1.0

0.968

0.984

Israeli Inventors

2060

742

0.999

0.959

0.979

Hand-Labeled

93

67

0.842

0.810

0.826