AWAC2
Une collaboration internationale autour d’un corpus massif d’archives du web

Frédéric Clavert
(C2DH, Université du Luxembourg)

Comprendre les archives du web. Séminaire respadon. 26 novembre 2021.

AWAC2
Entre Europe, Canada et États-Unis

WARCnet

Web ARChive studies network
researching web domains and events

The aim of the WARCnet network is to promote high-quality national and transnational research that will help us to understand the history of (trans)national web domains and of transnational events on the web, drawing on the increasingly important digital cultural heritage held in national web archives.

The Archives Unleashed Project

The Archives Unleashed project aims to make petabytes of historical internet content accessible to scholars and others interested in researching the recent past.

WARCnet Working group 2:
Analysing transnational events


To create synergy, Working Group 2 will also investigate the relationship between the events and the different national web domains […]

COVID-19 comme événement transnational


  • travail antérieur du WG2, notamment autour des seedlists des archives nationales
    • datathons internes
  • travail d’enquête / d’entretien / d’histoire orale auprès de plusieurs bibliothèques nationales, de l’INA et de l’International Internet Preservation Consortium


→ Pas d’accès aux données elles-mêmes

Analysing Web Archives of the COVID Crisis (AWAC2)
through the IIPC Novel Coronavirus dataset (Juillet 2021)

L’équipe

  • Valérie Schafer, University of Luxembourg (LU)
  • Karin De Wild, Leiden University (NL)
  • Frédéric Clavert, University of Luxembourg (LU)
  • Niels Brügger, Aarhus University (DK)
  • Susan Aasman, University of Groningen (NL)
  • Sophie Gebeil, University of Aix-Marseille (FR)

Investigating transnational events through web archive collections, the AWAC2 team will focus on a distant reading of the IIPC COVID-19 web archival collection to understand actors, content types and interconnectivity throughout it.

Le corpus


  • Coopération des membres de l’IIPC
    • Corpus hétérogène
  • 4,9Tb de données ‘brutes’ (= fichiers WARC)
  • 6,699,438 pages web
    • ‘lignes’ → certaines pages sont indexées plusieurs fois à plusieurs dates

Domaines


##                            domain  count
## 1                     twitter.com 212409
## 2                    facebook.com 146781
## 3                     youtube.com  75608
## 4         coronavirus.rutgers.edu  70082
## 5             accounts.google.com  68489
## 6                     co.vid19.sg  61887
## 7           ourwayforward.wfu.edu  59851
## 8              inumeraveis.com.br  57732
## 9                  ecdc.europa.eu  53759
## 10         covidresponse.wisc.edu  53566
## 11                     moh.gov.bh  46678
## 12     medicalcountermeasures.gov  43427
## 13        dashboard.kerala.gov.in  43044
## 14           platform.twitter.com  37785
## 15             covid19data.com.au  25423
## 16      tpc.googlesyndication.com  25016
## 17          pandemicoversight.gov  24566
## 18               lockdown-stop.ch  23587
## 19           bredamaaktmijblij.nl  22904
## 20                     google.com  22801
## 21                    covid-19.tn  22699
## 22                   linkedin.com  22412
## 23              sites.rutgers.edu  22019
## 24             bag-coronavirus.ch  21593
## 25                     tumblr.com  21193
## 26                play.google.com  21074
## 27                  corona.gov.bd  21067
## 28                  health.gov.au  21057
## 29               appel-a-prier.ch  21013
## 30            mourningamerica.org  20061
## 31               es.wikipedia.org  20043
## 32                     github.com  19979
## 33                   lexcorona.de  19305
## 34       extrahandenvoordezorg.nl  19209
## 35 securepubads.g.doubleclick.net  19079
## 36            invito-a-pregare.ch  18697
## 37                        cdc.gov  18695
## 38                       nihb.org  18651
## 39               coronagedicht.nl  18362
## 40            korona-slovensko.sk  18210
## 41         pandemic.oversight.gov  18061
## 42                    moph.gov.af  17844
## 43                    moph.gov.lb  17559
## 44                      cdc.go.kr  17134
## 45                     reddit.com  17096
## 46       backtowork.easygov.swiss  17069
## 47        koronavirususrpskoj.com  17036
## 48           accounts.mainichi.jp  17014
## 49                     kariyon.ch  16980
## 50                  coronatest.de  16889

Accès au corpus