Skip to content

Commit 7a7d194

Browse files
author
Joe Wass
committed
Change to Twitter URLs
1 parent 8e70f98 commit 7a7d194

File tree

4 files changed

+59
-4
lines changed

4 files changed

+59
-4
lines changed

docs/history.md

Lines changed: 14 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,11 +4,24 @@ This document describes substantial or breaking changes to the Event Data system
44

55
## Changes
66

7-
### [2019-01-10] Update Release History page
7+
### [2019-01-10] Change to Twitter URLs
8+
- [event-data-user-guide 1.2.2](https://github.com/CrossRef/event-data-user-guide/releases/tag/1.2.2)
9+
- [event-data-agents 0.1.17](https://github.com/CrossRef/event-data-agents/releases/tag/0.1.17)
10+
- [event-investigator 0.1.5](https://github.com/CrossRef/event-data-investigator/releases/tag/0.1.5)
11+
12+
New Twitter guidance means that for future Events we are unable to share Tweet URLs. Instead we use custom URIs to express Tweet IDs and author usernames. They still contain all the necessary information to identify the Twitter Content and retrieve the data from the Twitter APIs. Full documentation on the [Twitter Agent](/sources/twitter/) page.
13+
14+
### [2019-01-10] Update Release History page and copy editing
815
- [event-data-user-guide 1.2.1](https://github.com/crossref/event-data-user-guide/tree/1.2.1)
916

1017
The Release History page now tracks substantial changes to the Event Data Service, not just changes to the documentation. From this point onward it also includes versions of software releases that correspond to changes.
1118

19+
The guide was also reviewed for wording.
20+
21+
## Older changes
22+
23+
Before this point changes only pertain to the documentation.
24+
1225
### [2018-09-21] Documentation review
1326
- [event-data-user-guide](https://github.com/crossref/event-data-user-guide) 1.2.0
1427

docs/index.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# Crossref Event Data
22

3-
[Version 2.2.0 - Release](/history)
3+
Version 1.2.2 [Release history](/history)
44

55
## This guide is for everyone
66

docs/sources/twitter.md

Lines changed: 43 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,7 @@
2121

2222
## What it is
2323

24-
Twitter users discuss registered content items in tweets. They also retweet others who have discussed registered content items. The Twitter agent monitors a stream of tweets and tries to match DOI links, landing page links, and unlinked DOIs back to registered content items.
24+
Twitter users discuss registered content items in tweets. They also retweet others who have discussed registered content items. The Twitter agent monitors a stream of tweets and tries to match DOI links, landing page links, and unlinked DOIs back to registered content items. Note that we use a unique URI format when we refer to Tweets.
2525

2626
## What it does
2727

@@ -46,6 +46,46 @@ We then attempt to match all links to registered content items.
4646

4747
## Example Event
4848

49+
Note that the format of Tweet and author IDs changed in January 2019. They are now non-resolvable URIs. To read a Tweet in your browser, you can visit the URL:
50+
51+
http://twitter.com/statuses/«ID»
52+
53+
New format:
54+
55+
{
56+
"license":"https://creativecommons.org/publicdomain/zero/1.0/",
57+
"obj_id":"https://doi.org/10.1039/c8ee03134g",
58+
"source_token":"45a1ef76-4f43-4cdc-9ba8-5a6ad01cc231",
59+
"occurred_at":"2019-01-10T17:12:26Z",
60+
"subj_id":"twitter://status?id=1083411254788739073",
61+
"id":"29ffcda3-c9bc-47ca-a916-dcde1e2023fa",
62+
"evidence_record":"https://evidence.eventdata.crossref.org/evidence/20190110-twitter-28393e6c-03e9-47f8-89ae-584f0d9687f9",
63+
"terms":"https://doi.org/10.13003/CED-terms-of-use",
64+
"action":"add",
65+
"subj":{
66+
"pid":"twitter://status?id=1083411254788739073",
67+
"url":"twitter://status?id=1083411254788739073",
68+
"title":"Tweet 1083411254788739073",
69+
"issued":"2019-01-10T17:12:26.000Z",
70+
"author":{
71+
"url":"twitter://user?screen_name=pmherder"},
72+
"original-tweet-url":"twitter://status?id=1083379011089133568",
73+
"original-tweet-author":"twitter://user?screen_name=TomBurdyny",
74+
"alternative-id":"1083411254788739073"
75+
},
76+
"source_id":"twitter",
77+
"obj":{
78+
"pid":"https://doi.org/10.1039/c8ee03134g",
79+
"url":"https://pubs.rsc.org/en/Content/ArticleLanding/2019/EE/C8EE03134G",
80+
"method":"landing-page-meta-tag",
81+
"verification":"checked-url-exact"
82+
},
83+
"timestamp":"2019-01-10T17:21:51Z",
84+
"relation_type_id":"discusses"
85+
}
86+
87+
Old style, pre 2019:
88+
4989
{
5090
"license": "https://creativecommons.org/publicdomain/zero/1.0/",
5191
"obj_id": "https://doi.org/10.1107/s2052252514014845",
@@ -99,6 +139,8 @@ Events that have been subject to compliance actions will not be included in new
99139

100140
## Quirks
101141

142+
In January we updated the Agent to use the new URL format. We did not update old Events. You should expect URIs in either format when you use data from this Source.
143+
102144
The rules sent to Gnip PowerTack are manually updated. We aim to keep them in sync with the `domain-list` Artifact, but they may lag slightly.
103145

104146
According to the agreement we have with Twitter, we are allowed to process the text of tweets to extract events but we are not allowed to store or redistribute it. The text of the tweet is therefore passed to the Percolator and marked as 'sensitive'. This means that the SHA1 hash of the text appears in the Evidence Record as an `input-content-hash`, but not the text itself.

mkdocs.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,6 +9,7 @@ repo_url: https://github.com/CrossRef/event-data-user-guide
99
site_url: https://www.eventdata.crossref.org/guide/
1010
nav:
1111
- "Welcome": index.md
12+
- "Release history": history.md
1213
- "Introduction": introduction.md
1314
- "What's in Event Data?":
1415
- "About the Data": data/about-the-data.md
@@ -63,4 +64,3 @@ nav:
6364
- "Appendix: Scholix": app-scholix.md
6465
- "Appendix: FAQ": app-faq.md
6566
- "Appendix: Glossary": app-gloss.md
66-
- "Document history": history.md

0 commit comments

Comments
 (0)