“Flickr.com is a Gathering of Memory” Insights from the Flickr Foundation’s First Conversation

Susan Mernit & George Oates

On September 26, 2024, we hosted our first-ever public conversation featuring director George Oates and advisors Anasuya Sengupta and Eliza Gregory. The event explored critical questions about preserving digital visual history in our rapidly evolving technological landscape.

The discussion centered on our purpose: to keep Flickr pictures visible for 100 years. We discussed the long list of technological uncertainties, with George quoting another Flickr Foundation advisor, Temi Odumosu, who said, “We don’t even know what a JPEG will be in ten years.”

Anasuya described social justice issues, emphasizing that digital preservation must address questions of power and representation. She stressed how important it is for marginalized communities to control  their narratives , and how we must keep this in the front of our minds as we make tools..

The conversation touched on several key points:

  • We must balance vast scale with meaningful personal engagement
  • Using Flickr Commons to empowering communities to define their histories 
  • How we can support smaller cultural institutions in digital preservation efforts
  • What community engagement brings to enriching digital archives
  • Myriad curatorial challenges as we consider deciding what to preserve

→ Read the full transcript of the event

 

Preserving Our Visual Heritage: The Flickr Foundation was established in 2022 with the purpose to keep Flickr pictures visible for 100 years. As part of our work, we look after the Flickr Commons, a unique collection of historical photographs from cultural institutions all around the world.

To stay in touch, follow us on LinkedIn or sign up for our occasional newsletter (at the bottom of our home page).

Welcome, Joshua!

Joining us from Los Angeles, Californ-I-A

Hello Flickr Foundation family!

My name is Joshua Christman and I am a designer thrilled to be working with the Flickr Foundation.

I first stumbled across Flickr in the early 00s, being part of the generation who began exploring their identities through online photo sharing. Growing up in rural USA, Flickr offered a window into a larger world full of diversity and culture – and with that, a larger sense of belonging and understanding the bigger picture of humanity.

I am bringing a wide range of experiences and skills to the Foundation team. My undergraduate studies at Parsons School for Design kicked off a career where I have explored multiple avenues of creativity collaborating with brands, non-profits, artists and everyday people on everything from interior design to music videos to logos and packaging. All these experiences have one thing in common: to visually communicate a message and foster connection.

So, who am I on the Flickr Foundation family tree?

Working with George, I am helping to launch the “Best Little Museum Shop” – the Flickr Foundation’s unique take on small batches of limited edition merch. The merch will make use of photos from Flickr Commons as well as graphic data sets from projects such as Data Lifeboat – using creative interpretation and art to raise awareness of all the wonderful things the folks at Flickr.org are working so hard for, and to offer our donors something to thank them for their support.

Welcome, Fattori!

Hello, world! I’m Fattori, Lead Researcher on the Data Lifeboat Project at the Flickr Foundation.

I first used Flickr in 2005; at that time, I was an angsty teen who needed a place to store grainy photos of Macclesfield, my post-industrial hometown, that I shot on an old Minolta camera. Since then, both my career and my academic research have focused on themes that are central to the aims of Flickr.org: images, databases, community, and the recording of human experiences.

In 2017 I began working as a researcher for strategic design studios based in New York, Helsinki, London and Mumbai. My research tried to address complex questions about humans’ experience of modern visual cultures by blending semiotics, ethnography and participatory methods. My commercial projects allowed me to explore women’s domestic needs in rural Vietnam, the future of work in America’s Rust Belt, and much in between.

As a postgraduate researcher at the University of Oxford’s Internet Institute, my work explores how blockchain experiments have shaped art and heritage sectors in the U.K. and Italy. At an Oxford Generative AI Summit I met the Flickr Foundation’s Co-Founder, George, and we hosted a workshop on Flickr’s 100-Year Plan with University and Bodleian academics, archivists, and students. I subsequently became more involved with Flickr.org when I contributed research to their generative AI time-capsule, A Generated Family of Man.

Now, as a Lead Researcher at Flickr.org, I’m developing a plan to help better understand future users of Data Lifeboat and the proposed Safe Harbour Network. We want to know how these tools might be implemented in real-world contexts, what problems they might solve, and how we can maintain the soft, collective infrastructure that keeps the Data Lifeboat afloat. 

Beyond my professional life, I always have a jumper on my knitting needles (I can get quite nerdy about wool), I rush to a potter’s wheel whenever I can, and I’m writing a work of historical fiction about a mystic in the Balearic Islands. Like my 2005 self, I still snap the odd photo, these days on a Nikon L35AF.

New Grant from the Mellon Foundation!

by George Oates

It’s my great pleasure to let you know about another step forward for the Flickr Foundation today. We’ve been awarded a grant in the Public Knowledge program of the Mellon Foundation to continue our development of the Data Lifeboat. Yay!

What’s the grant for?

It’s a 12-month grant, and mostly involves using the prototype work we’ve been doing to demonstrate and discuss the concept with our community. We can’t wait to hold the two events we have planned in the (Northern hemisphere) autumn, and we’ll likely be having them on the East Coast of the USA, and in our homebase, London. If you’d like to learn more about attending one of these small meetings, please let us know via hello [at] flickr.org.

We expect to also iterate on the software itself, but we’re not quite sure where we’ll end up just yet, especially if all our conversations result in us needing to pursue different directions.

Growing the team

As part of this grant, we’ll be advertising for two new roles, likely on contract: Researcher and Software Developer. Stay tuned for those!

What’s a Data Lifeboat again?

A Data Lifeboat is an archival piece of Flickr, not all of the 50 billion images and their metadata. For example, a Lifeboat might contain all the photos tagged with “sunflower” or all the Recipes to Share group submissions. Whatever facet of the data you can think of, you could generate a Data Lifeboat for it. We envision an archival sliver richer than a mere folder of JPGs: one where you can navigate the content to explore and understand its networked context. Even better, an archival sliver that is updated if things change at flickr.com.

Today, Flickr members can make an archive of their own photostream, and that works really well. You can “get your data” and that download includes most, if not all, of the kinds of information we expect a Data Lifeboat to contain. And, we want to take it two steps further, from an archival point of view:

  1. Allow creators to make Data Lifeboats that can contain other people’s images (with permission, and that’s very, very gnarly), and
  2. We plan to develop ‘known places’ for Data Lifeboats to land, so they can be registered or even accessioned as bonafide objects of meaningful cultural value. We’re calling those landing places Docks. That work is probably going to start in earnest in 2025.

In our ideal world, these docks will live inside our great and good cultural organizations, spreading the load, responsibility, and acknowledgement that our digital, user-generated cultural heritage is valuable and worthy of the attention and care our archives, museums, and libraries can provide. Jenn’s recent deeper dive into this is worth your time.

Building steadily

Our prototyping stage is nearly done now, within which we expect to come out with some Data Lifeboats to look at and critique, some “prototype policies” for Flickr members, Data Lifeboat creators, and possible “dock” operators. We are also doing some foundational work on models for sustainability, because, as you will know, to date, we’ve been largely quite bad at planning for long term life for our digital projects.

Thank you

A huge thank you to Jenn and Ewa for your fantastic support getting the grant application done, and to the team at Mellon for such constructive feedback.

On the way to 100 years of Flickr

A report on archival strategies

By Ashley Kelleher Skjøtt

Flickr is an important piece of social history that pioneered user-driven curation, through folksonomic tags and through a publicly-accessible platform at scale, crystallising the web 2.0 internet. Applying tags to one’s own images and those of others, Flickr’s users significantly contributed to the emergence of commons culture. These collective practices became a core tenet of Flickr’s design ethos as a platform, decentralising and democratising the role of curation.

Of course, Flickr was not alone in pioneering this—hashtags and social sharing on other platforms added momentum to the general shift which was overall democratising by giving users agency over what they shared, experienced, and categorised. This shift in curatorial agency is just one aspect of Flickr’s significance as a living piece of social history.

Flickr continues to be one of the largest public collections of photographs on the planet, comprising tens of billions of images. Flickr celebrated its 20th birthday in February 2024. The challenge of archiving Flickr at scale, then, perhaps becomes about designing processes for preservation which can also be decentralised.

In August 2023, I learnt from a dear friend and colleague, Dan Pett, that the Flickr Foundation, newly based in London, was beginning to build an innovative archival practice for the platform. With my interest in digital cultural memory systems, an interest for which I have moved continents, I was determined to contribute in some way to the Foundation’s new goal. After exploring and discussing the space with George Oates, Director of the Flickr Foundation, we agreed that a practice-based information-gathering exercise could be useful in building up an understanding of such a practice.

So, what would an archive for Flickr look like?

Flickr is a living social media environment, with up to 25 million images uploaded each day. The reality of the company’s being acquired by a number of different parent companies over the course of its 20-year lifetime—already a remarkable timespan by social media standards—additionally brings to the forefront a stark case for working to ensure the availability of its contents into the long future. This is a priority shared today between Flickr itself and the new Flickr Foundation.

I have prepared a report of findings, written over a deliberately slow period and which aims to present a colloquial yet current answer to the question of archival practice for Flickr as a unique case, both when it comes to scale and defining what should be prioritised for preservation. Presuming that the platform is not invulnerable to media obsolescence, what on earth (or space) should an archive preserving the best of Flickr look like today? The work of asking this question again and again through the days, months, years, and decades to come leads us to the Foundation’s own question: what does it look like to ensure Flickr lasts for one hundred years?

REPORT: 20 Years of Flickr: Archiving the Living Environment

This information-gathering exercise consisted of seven interviews with sector peers across a wide range of practice, from academia to a small company, to a global design practice and within the museum world. My sincere thanks to:

  • Alex Seville (Head of Flickr),
  • Cass Fino-Radin (Small Data Industries),
  • Richard Palmer (V&A Museum),
  • Annet Dekker (University of Amsterdam),
  • Jenny Basford (British Library),
  • Matthew Hoerl (Arch Mission Foundation), and
  • Julie May (Bjarke Ingels Group)

Many thanks for taking the time to generously share their thoughts on the prospect, reflections on their own work, and expertise in the area.

The report sets out to define the value of what should be preserved for Flickr, as (1) a social platform, (2) a network-driven community, (3) a collection of uniquely user-generated metadata, and (4) as an invaluable image collection, specifically of photography. It then proceeds through a discussion of risks identified through the course of interviews. Finally, it proceeds through ten identified areas of practice which can be addressed in the Foundation’s archival plan, divided into long- and short-term initiatives. The report closes with six recommendations for the present.

An archive for Flickr which honours its considerable legacy should be created in the same vein. One interviewee reflected that the work of the archivist is to select what to preserve. This is, effectively, curation – the curation of archival material. It follows then, that if a central innovation of Flickr as a platform was to democratise the application of curatorial tools – enabling tags as metadata based in natural language, at scale – then the approach to archiving such a platform should follow this model in allowing its selection to be driven by users. What about a “preserve” tag?

Thanks to Flickr and other internet pioneers, this is far from any kind of revolutionary idea – and is one worth creating an archival practice around, so that coming generations can access the stories we want to tell about Flickr: the story of the internet, of the commons, of building open structures to find new images and of what it means to be a community, online.

Introducing Prakash Krishnan, 2024 Research Fellow

Prakash Krishnan (he/him) is an artist-researcher and cultural worker based in Tiohtià:ke (Montréal, Canada) on the stolen lands of the Kanien’kehá:ka (Mohawk) Nation. His recent projects explore various issues relating to accessibility and disability justice, community archival practices, and environmental humanities. He is joining the Flickr Foundation as a research fellow from May to July 2024. 

What’s drawn you to family archives?

For a class on research-creation methods (also referred to as arts-based research) I took in 2019, I had big ambitions of creating an experimental, non-narrative documentary using cellphone footage during a planned trip to my parents’ home country of Malaysia. Upon returning home and examining the footage, I unfortunately came to the realization that a combination of obsolete technology (an iPhone 4S in the year of the iPhone 11 – imagine!!!), corrupted sound, and sabotage by my own, unsteady hands rendered my footage unusable. Scrambling to find some way to complete my term project in the final weeks of the semester, I decided to undergo what I saw as an intrapersonal reflection via an investigation of my own family archives. 

These “archives” are fairly small. Limited to the albums of photos my parents once carefully categorized and now just haphazardly store in a pile on a basement shelf. I confess that when living with my parents as a child, I was too self-centred to pay attention to any of the albums that didn’t include me. As the firstborn and only a year after my parents’ marriage, effectively I was prominently featured in all the albums except one. Paging through the album documenting my parents’ courtship, wedding, and first year of marriage, I was embarrassed by my shock of confronting these two people, whom I’ve evidently known my whole life, living this whole other life without me. As I passed on to the albums of my infancy, I became overcome with emotion seeing them making their life together, still virtually strangers having had an arranged marriage and finding themselves shortly thereafter in a new country, facing what I know now as the pressures that come with being not only new parents, but new immigrants, newly coupled, and struggling with finding lasting employment. 

Inspired by my reaction to these albums, I planned on conducting an oral history interview with my parents. I wanted to know the people in these photos, what they were thinking, feeling, doing. Yet there was something holding me back. The photos were so intimate, often only one of them in the shot, as the other was behind the camera. These felt like private moments between the two of them that was solely theirs to wholly know and experience. Instead, I took a selection of these photos and wrote my own reflections. Searching back through my own memories of the rare times my parents spoke about their youth and the early years of their marriage, I pieced together a history of their early settlement and parenthood in Canada (circa 1991-1995) through written reflections and image descriptions I then inscribed on the digitized copies of the photos. I’m usually not a very emotionally expressive person, but I cried when I presented this to my class. 

This experience fundamentally changed my relationship to photo archives and sowed the seeds for what would become my master’s thesis South Asian Instagram Community Archives: A Platform for Performance, Curation, and Identity as well as my approach to creative and poetic visual description for blind and low-vision communities as workshopped in the online exhibitions Audio Description in the Making and Air, River, Sea, Soil: A History of an Exploited Land

Continuing this line of engagement along with my community archival engagement approaches prototyped in the community digital archive/exhibition project Things+Time,

What would you like to work on during your fellowship?

I will, over the course of my fellowship at the Flickr Foundation, work with two community organizations, one based in London, UK and one in Montreal, Canada to undergo a digital archival excavation workshop. Through a series of guided prompts and reflections, these community groups will decide specific search criteria in order to activate the Flickr archive, creating informal collections that respond to and inform the earlier reflections. Together, community members will create descriptions for the images that can dually serve as archival and visual descriptions for potential use in a future exhibition.

Using a “photovoice” methodology, participants will also be tasked with adding their own, related and annotated material to the Flickr archive in response to the collective and reflections feedback from the workshop.

The goals of this project are to engage community organizations with the creative possibilities afforded through archival and photo research as well as to unearth and activate some of the rich histories embedded in the Flickr archive.

Introducing Eliza Gregory, research partner

Eliza Gregory is a social practice artist, a photographer, an educator and a writer.

Research is a key facet of the Flickr Foundation’s work. We are gathering a group of intersectional researcher partners to question the idea of a 21st century image archive together, and Eliza is one of them.

Who ARE you, Eliza?

My name is Eliza Gregory. I’m a mom of two daughters, a wife/partner, a photographer, a social practice artist, a curator, and an educator. I like cake and noodles and I keep chickens. I have issues with chronic clutter. I am getting more and more interested in plants. This might be the result of middle age, or it might be related to feeling like connecting with plants is the roadmap back from total social and environmental collapse. Or both.

For about ten years I made work about cultural identity and cultural adaptation through a mixture of large format portraiture, interviews, events and relationships. Those projects focused on resettled refugee households in Phoenix, Arizona; mapping the wide array of Australian cultural identities (indigenous, recent-immigrant, and long-time-ago-immigrant; cultural identity tied to gender and sexuality, etc.) in the neighborhood where I lived in Melbourne; and immigration to the Bay Area in California over the last 40+ years.

More recently, I curated a show called Photography & Tenderness that investigates how we can hold photography accountable for the ways in which it has been used to build a racist society and somehow still use it to make something tender. That took place at Wave Pool Art Fulfillment Center in Cincinnati, OH as part of the Cincinnati FotoFocus 2022 Biennial.

And I’ve been working on a project I call [Placeholder], about holding and being held by place. It investigates relationships between people and land and asks what might happen if we acknowledged the fundamental rupture that has occurred between land and people, and began working to repair it. So far I’m mainly in the research phase of that work, but my research has taken place with my students at Sacramento State University, and with other artists, and I’ve pulled together two different exhibitions to invite audiences into that research at Axis Gallery, Sacramento, CA: [Placeholder] a studio visit with Eliza Gregory and [Placeholder]: florilegia.

 

I started out my career trained as a fine art photographer and a creative writer. I have always been interested in telling stories with pictures, but as soon as I tried my hand at it I got caught up in questions about the ethical implications of making an object about (i.e. objectifying) another person. I started to solve those problems by building out relationships and project structures that relied on exchange and accountability, and then went to grad school in Art & Social Practice at Portland State University. That program was a revelation for me and really provided the tools and the language I needed to keep building out my work in a way that felt good. In my experience, the dialogue around social practice is much more radical and useful and socially critical than the dialogue around photography, so I’ve really leaned into that space. But I still enjoy pictures and appreciate how powerful they can be.

Flickr is an interesting organization because it hosts a lot of pictures, but it also catalyzes a lot of relationships and interactions around those pictures. So Flickr represents an institution based around social practice and photography, in a certain way.

Why did you join as a research partner at flickr.org?

What is the relationship between justice and photographic representation? That is a question I think about a lot.

The human brain likes to simplify things. It’s how we are able to perceive so much and yet still focus on a single task or idea. And it’s why we take something like a human being, with a whole life full of perceptions and feelings and paradoxes, and reduce them to a single descriptor–child. American. Woman. White. Cis-gendered. Hetero. Middle aged. Tall. Pink. (I had someone I was photographing once tell me I was “big and pink.” And…I couldn’t argue.) Or we take an individual from another species, who has a whole life full of specific experiences, and reduce it to just the species name: rat. Grey squirrel. Monarch. Or even more reductively: Tree. Butterfly.

Photographs basically do the same thing. You take a whole moment filled with a million different feelings, thoughts, respirations, scents, sensations, views and reduce it to one small, flat, rectangle. And we call that a picture. And we equate it with “truth.”

That’s a problematic process, based on a problematic (though necessary and useful) human tendency. It’s inherently reductive. And yet we see it as a mechanism for communication, inquiry and learning. Photography can be a mechanism for those things, certainly. I used it for that purpose in a project called Massive Urban Change, where I photographed a dynamic urban environment that you can never fully take in SO that it would hold still; so that you could look at it more closely. But that reductive quality of photography can be used for radically different ends. It has also been a tool for building racist societies; for creating and cementing stereotypes; for mapping natural resources for extraction and destruction. Sometimes photography obfuscates truly important complexities by reducing things too much.

A lot of my work has been about interrogating the process of making photographs, especially of people (and now of places) to try to understand when photography is doing what we like to tell ourselves it’s doing, and when it’s doing something else.

I want to know, how do photographs shape the stories we tell ourselves, and how do those stories, in turn, shape society?

Thinking about Flickr is a way of approaching some of these questions. And thinking about how to conserve Flickr adds a whole new dimension to them.  I wanted to work with the Flickr Foundation mostly because I like the people it is bringing together–there is so much work going on around archiving images and cataloging images and reading images and finding certain images that goes beyond what I know as a maker of images. I love getting to be at the table with people who work on photography from such different angles. It helps blast me out of my normal frame of reference.

I also want to be bringing my students into photographic dialogues that are larger than our classroom. The Flickr Foundation is actively thinking about how to intersect with students and curriculum design. I want to create opportunities for my students to do meaningful work, and I see the Flickr Foundation as a partner in that.

Finally, I really love exhibitions. In some ways, exhibitions seem to be heading toward obsolescence, much like museums themselves. Both those structures are built on gatekeeping, colonial hierarchies, and a top-down, hierarchical flow of knowledge. So in the social practice dialogues I am a part of, sometimes the exhibition as a form feels sort of passé. But I love it as a way of creating experiences for people, of shaping or catalyzing dialogues, of giving people a gift. And the Flickr Foundation feels like a partner that I could potentially build visual experiences (exhibitions!) with.

What do you think will be the hardest parts of achieving its 100-year plan?

The questions around how to conserve digital material for a hundred years are HARD. That’s what I learned from bringing some of those questions to a group of senior photography students at Sacramento State University this fall. George has been delivering a 100 year plan workshop to various groups, and we conducted a version of that experience with my students. It’s basically asking people to think about what digital images will look like, consist of, and be viewed through in 100 years. As well as, What will it take to preserve a digital image we have now for that long? And how do you build an organization that can do that?

George had us start with finding an image of a place that’s meaningful to us, and then going out and trying to find the oldest photograph we can of that same place. Right away, that activity makes you think about how we view places, and what photographs we have access to, and what places we have access to visually. I once asked a group of photo history students, What is a photograph you wish you could see that’s impossible to make? A really surprising number of them said, “I wish I could see a picture of the pyramids being constructed!” That feels like a complementary mind-exercise to me, because we are so used to being able to see anything and everything we want in pictures. It’s important to remember that they haven’t always existed. And to contemplate what is un-photographable.

Then my students and I struggled to project our imaginations even into the near future to anticipate how technology will change, how behaviors will change around technology (both as it currently exists, and in terms of platforms and processes that haven’t been invented yet), and what it will mean to actually translate a jpg into multiple new file formats without losing whatever data make it a recognizable image in the first place.

Everything about this seems hard to me. The only things I’ve been able to hang on to so far, and visualize, are some of the foundation’s ideas around ritual—perhaps there will be a ritualized translation from one format to another every five or ten years. The idea that conserving something by allowing it to change feels very resonant—perhaps that is a shift in perspective that we are approaching on many fronts at once, from interpersonal relations (growth mindset!) to global ecology (I’m thinking of Anna Tsing’s book The Mushroom at the End of the World).

The scale is also difficult to fathom. 50 billion images is…so many images. And the collection is likely to grow. So the usual questions around archives are present too—what do we keep? What do we throw away? How does someone access the resource? How does someone FIND what they are looking for? (And along the way can we help them maybe find a few things they aren’t looking for but need or want to see?)

At the end we made zines to try to pull our thoughts together.

How do you hope to use the partnership to further your own research?

In my current artistic work, I research intergenerational narratives—both because inserting ourselves into them in families leads to improved mental health and in terms of how thinking about intergenerational narratives shifts our understanding of stewardship of the land that cares for us—and I’m a photographer. So the question, How do we approach the conservation of digital images for future generations? relates to HOW we are going to tell those intergenerational stories. I think that some of the long-term storytelling strategies we’ve lost track of or never understood within British-influenced contemporary American colonist culture—such as oral history and land-based, place-based knowledge—are tools we might turn to. But right now we are so image-obsessed that pictures will be in the mix too, and they might be the bridge that gets us to new (or old!) styles of connection, communication and storytelling.

Eliza Gregory is an artist and educator. She makes complex projects that unfold over time to reveal compassion, insight and new social forms.
www.elizagregory.org

With apologies to Eliza for leaving it so long to post this! ❤️
– George

Data Lifeboat Update 2: More questions than answers

By Ewa Spohn

Thanks to the Digital Humanities Advancement Grant we were awarded by the National Endowment for the Humanities, our Data Lifeboat project (which is part of the Content Mobility Program) is now well and truly underway. The Data Lifeboat is our response to the challenge of archiving the 50 billion or so images currently on Flickr, should the service go down. It’s simply too big to archive as a whole, and we think that these shared histories should be available for the long term, so we’re exploring a decentralized approach. Find out more about the context for this work in our first blog post.

So, after our kick-off last month, we were left with a long list of open questions. That list became longer thanks to our first all-hands meeting that took place shortly afterwards! It grew again once we had met with the project user group – staff from the British Library, San Diego Air & Space Museum, and Congregation of Sisters of St Joseph – a small group representing the diversity of Flickr Commons members. Rather than being overwhelmed, we were buoyed by the obvious enthusiasm and encouragement across the group, all of whom agreed that this is very much an idea worth pursuing. 

As Mia Ridge from the British Library put it; “we need ephemeral collections to tell the story of now and give people who don’t currently think they have a role in preservation a different way of thinking about it”. And from Mary Grace of the Congregation of Sisters of St. Joseph in Canada, “we [the smaller institutions] don’t want to be the 3rd class passengers who drown first”. 

Software sketching

We’ve begun working on the software approach to create a Data Lifeboat, focussing on the data model and assessing existing protocols we may use to help package it. Alex and George started creating some small prototypes to test how we should include metadata, and have begun exploring what “social metadata” could be like – that’s the kind of metadata that can only be created on Flickr, and is therefore a required element in any Data Lifeboat (as you’ll see from the diagram below, it’s complex). 


Feb 2024: An early sketch of a Data Lifeboat’s metadata graph structure.

Thanks to our first set of tools, Flinumeratr and Flickypedia, we have robust, reusable code for getting photos and metadata from Flickr. We’ve done some experiments with JSON, XML, and METS as possible ways to store the metadata, and started to imagine what a small viewer that would be included in each Data Lifeboat might be like. 

Complexity of long-term licensing

Alongside the technical development we have started developing our understanding of the legal issues that a Data Lifeboat is going to have to navigate to avoid unintended consequences of long-term preservation colliding with licenses set in the present. We discussed how we could build care and informed participation into the infrastructure, and what the pitfalls might be. There are fiddly questions around creating a Data Lifeboat containing photos from other Flickr members. 

  • As the image creator, would you need to be notified if one of your images has been added to a Data Lifeboat? 
  • Conversely, how would you go about removing an image from a Data Lifeboat? 
  • What happens if there’s a copyright dispute regarding images in a Data Lifeboat that is docked somewhere else? 

We discussed which aspects of other legal and licensing models might apply to Data Lifeboats, given the need to maintain stewardship and access over the long term (100 years at least!), as well as the need for the software to remain usable over this kind of time horizon. This isn’t something that the world of software has ready answers for. 

  • Could Flickr.org offer this kind of service? 
  • How would we notify future users of the conditions of the license, let alone monitor the decay of licenses in existing Data Lifeboats over this kind of timescale? 

So many standards to choose from

We had planned to do a deep dive into the various digital asset management systems used by cultural institutions, but this turned out to be a trickier subject than we thought as there are simply too many approaches, tools, and cobbled-together hacks being used in cultural institutions. Everyone seems to be struggling with this, so it’s not clear (yet) how best to approach this. If you have any ideas, let us know!

This work is supported by the National Endowment for the Humanities.

NEH logo

Data Lifeboat Update 2: More questions than answers

By Ewa Spohn

Thanks to the Digital Humanities Advancement Grant we were awarded by the National Endowment for the Humanities, our Data Lifeboat project (which is part of the Content Mobility Program) is now well and truly underway. The Data Lifeboat is our response to the challenge of archiving the 50 billion or so images currently on Flickr, should the service go down. It’s simply too big to archive as a whole, and we think that these shared histories should be available for the long term, so we’re exploring a decentralized approach. Find out more about the context for this work in our first blog post.

So, after our kick-off last month, we were left with a long list of open questions. That list became longer thanks to our first all-hands meeting that took place shortly afterwards! It grew again once we had met with the project user group – staff from the British Library, San Diego Air & Space Museum, and Congregation of Sisters of St Joseph – a small group representing the diversity of Flickr Commons members. Rather than being overwhelmed, we were buoyed by the obvious enthusiasm and encouragement across the group, all of whom agreed that this is very much an idea worth pursuing. 

As Mia Ridge from the British Library put it; “we need ephemeral collections to tell the story of now and give people who don’t currently think they have a role in preservation a different way of thinking about it”. And from Mary Grace of the Congregation of Sisters of St. Joseph in Canada, “we [the smaller institutions] don’t want to be the 3rd class passengers who drown first”. 

Software sketching

We’ve begun working on the software approach to create a Data Lifeboat, focussing on the data model and assessing existing protocols we may use to help package it. Alex and George started creating some small prototypes to test how we should include metadata, and have begun exploring what “social metadata” could be like – that’s the kind of metadata that can only be created on Flickr, and is therefore a required element in any Data Lifeboat (as you’ll see from the diagram below, it’s complex). 


Feb 2024: An early sketch of a Data Lifeboat’s metadata graph structure.

Thanks to our first set of tools, Flinumeratr and Flickypedia, we have robust, reusable code for getting photos and metadata from Flickr. We’ve done some experiments with JSON, XML, and METS as possible ways to store the metadata, and started to imagine what a small viewer that would be included in each Data Lifeboat might be like. 

Complexity of long-term licensing

Alongside the technical development we have started developing our understanding of the legal issues that a Data Lifeboat is going to have to navigate to avoid unintended consequences of long-term preservation colliding with licenses set in the present. We discussed how we could build care and informed participation into the infrastructure, and what the pitfalls might be. There are fiddly questions around creating a Data Lifeboat containing photos from other Flickr members. 

  • As the image creator, would you need to be notified if one of your images has been added to a Data Lifeboat? 
  • Conversely, how would you go about removing an image from a Data Lifeboat? 
  • What happens if there’s a copyright dispute regarding images in a Data Lifeboat that is docked somewhere else? 

We discussed which aspects of other legal and licensing models might apply to Data Lifeboats, given the need to maintain stewardship and access over the long term (100 years at least!), as well as the need for the software to remain usable over this kind of time horizon. This isn’t something that the world of software has ready answers for. 

  • Could Flickr.org offer this kind of service? 
  • How would we notify future users of the conditions of the license, let alone monitor the decay of licenses in existing Data Lifeboats over this kind of timescale? 

So many standards to choose from

We had planned to do a deep dive into the various digital asset management systems used by cultural institutions, but this turned out to be a trickier subject than we thought as there are simply too many approaches, tools, and cobbled-together hacks being used in cultural institutions. Everyone seems to be struggling with this, so it’s not clear (yet) how best to approach this. If you have any ideas, let us know!

This work is supported by the National Endowment for the Humanities.

NEH logo