This important on-line dialogue featured Documenting Violations: Choosing the Right Approach from January 27 to February 2, 2010. This dialogue featured practitioners that have developed database systems to document human rights violations, organizations on the ground documenting violations, and those that are training practitioners on how to choose the right approach and system for their documentation. We looked at options for ways to collect, store and share your human rights data safely and effectively. If you are trying to figure out the best documenting system for your work - or if you have found something that works well, please add your comments to this dialogue to share your questions, ideas, resources and stories!
Featured resource practitioners for this dialogue include (click here for more biographical info):
- Vijaya Tripathi and Megan Price work with the Martus database developed by Benetech
- Bert Verstappen and Daniel D'Esposito work on the OpenEvSys database developed by HURIDOCS
- Nathan Freitas of the Guardian Project
- Jorge Villagran and Sofia Espinosa of the Guatemalan National Police Archive Team
- Patrick J. Pierce, head of the International Center for Transitional Justice - Burma Program
- Oleg Burlaca, utilizes HURIDOCS methodology and working on websites for World Organisation Against Torture and SOVA Center for Information and Analysis
- Patrick Stawski, Human Rights Archivist at Duke University and Seth Shaw, Duke's Libraries' Electronic Records Archivist
- Jana Asher, M.S., is the Executive Director of StatAid
- Agnieszka Raczynska of Red Nacional de Organismos Civiles de Derechos Humanos, Mexico
- Daniel Rothenberg is the Managing Director of International Projects at the International Human Rights Law Institute (IHRLI) at DePaul University College of Law
Main Themes
Please add your comments beneath these main themes by replying to their corresponding comments in the dialogue:
- What is documentation?
- How to determine what kinds of information to collect?
- What are the ways to acquire, store & organize information?
- What are the purposes of documentation?
- What are the risks, challenges & opportunities of documentation work?
Summary of the Documenting Violations Dialogue
In the dialogue titled Documenting Violations: Choosing the Right Approach, participants discussed the range of methods that can be used to thoroughly document human rights violations, and utilize them to motivate a response. Participants shared a myriad of powerful examples from their own work, proving the importance and vast range of impact that documentation has.
What is documentation?
Documentation is a process of strategic and systematic gathering of quantitative or qualitative data. This process consists of several activities, namely:
- determining what information is needed and establishing means for acquiring it;
- recording the discovered information and storing such in appropriate containers (called documents) or collecting already-existing documents containing the needed information;
- organising the documents to make them more accessible; and
- actually providing the documents to users who need the information.
Before starting data collection, it is important to have a concrete end goal for the data, as that will largely influence the type and scope of data collected, and determine the parameters of the collection process. Furthermore, it is essential to establish baseline data to which new data can be compared and contrasted with.
Documentation builds a strong platform for advocacy for it provides evidence that can oppose what governments or newspapers are reporting. Here is a 10-step plan on how to use documentation for human rights advocacy.
An important lesson learned is to review the impact of the documents on particular human rights efforts and store data safely.
Data Collection Software:
Two main kinds of software were mentioned throughout the dialogue – Martus and OpenEvsys. What tool for what purpose? The differences of the two documentation systems are discussed here.
Martus secures your data by encrypting it on your computer and (if you choose to) automatically backing it up to remote, dedicated secure servers around the world. If your computer is lost, destroyed or stolen, you can retrieve your information from the remote servers. Martus is a very good tool for use in countries with very repressive regimes, where you and your sources can get into serious trouble if your data is found.
OpenEvsys can be used both to collect and organize stories, but also to provide "who did what to whom" quantitative analysis of the violations in these stories: how many acts of torture by military in X province, what is the gender breakdown of the victims, etc.OpenEvsys is different, in that you can also record in as much detail as needed what happens inside these stories. You can record violations, link them to the victims, and the perpetrators, and the sources. It is a fully relational system, so you only enter perpetrator X once, and then you link perpetrator to all the acts that he or she has committed, in all your stories, and then you can get a "bio" of all the acts that perpetrator has committed.
Compiling Different Documents
Although different organizations will use different software, the contents of their documentation are likely related. Advocacy efforts benefit by compiling data and creating a bigger picture of human rights violations.
Metadata , or simply “data about data,” is a set of structured data or content types that characterize an information object. Metadata can be used to compile data from multiple databases, thus creating a larger document. Developing a useful metadata system for the human rights community could have tremendous impact for the human rights community for it would allow drawing connections between different data sets and discover greater patterns of abuse.
What data can be collected?
- violations
- testimonies – For example, the Iraq History Project collected thousands of testimonies documenting the destructive impact of political violence under the Saddam Hussein regime.
- monitoring indicators – particularly helpful for discrimination, ongoing oppression
- legal investigations & researching government data - archives of repressive regimes may contain important information. For example, the Guatemala Archive Project revealed that many government-supported atrocities were well documented in their own archives.
- scanning media
- documenting HR interventions
- anthropological research
- ecological studies
- realtime data - for example, a dynamic realtime geo-map of the post-election situation in Kenya and a range of projects on the use of mobile technology can be found here.
Qualitative or quantitative research?
A big challenge in the field of documentation is whether to rely on quantitative or qualitative data. Both are important, quantitative data draw the big picture for us and qualitative data supply the emotive, social, and political aspects of a person's experience. A related question – How structured should documentation be? - poses a challenge to field research. Narrowly defined questionnaires will likely omit a large portion of the person's experience, whereas powerful individual testimonies are difficult to summarize into big reports that ought to quantify impact. The advantages and disadvantages of each approach are discussed here.
Documenting civil and political & economic, social, and cultural rights
Some of the traditional approaches (such as documenting violations) have been used primarily in the case of civil and political rights. However, the human rights community is strengthening its focus on the documentation of economic, social and cultural rights. Three broad categories of approaches to ESC were mentioned in the dialogue:
- state violations resulting from government actions, policies, and legislation.
- violations related to patterns of discrimination.
- violations related to the state’s failure to fulfill minimum core obligations of enumerated rights.
Challenges
- when released, some data can be harmful to the very individuals it aims to protect
- accuracy – it is important to be aware of our biases as those who collect documents, “record the story not your interpretation of the story.”
- activist vs. scientists – NGO documentation is sometimes not trusted by scientists. Cooperation between experts and activists is key to solid documentation
- security - Recognizing the need of organizations to combine their data to create greater impact, it is all the more important to ensure a secure transfer and storage of data that does not put people (both those documented and documenting) at risk
Resources
- Protection manual for HR defenders - tactics to reduce the risks that those who document HR violations face
- Information cycles in HR organizations - graphic representation
- Presentation on "Digital Democracy" - engaging technology at the local level to produce an international response
- Planning a large scale documentation project - "Who did What to Whom?" is a detailed resource describing the different aspects of a human rights campaign achieved through documentation.
- Core Concepts in Data Analysis
- Statistics Manual for Human Rights Research
- Methods, tools and framework in HR documentation - a set of tools developed by Metagora



--- What is documentation?
Under this main theme, please address these kinds of questions:
qu'est ce que la documentation ?
Dans le domaine des droits humains, je pense que la documentation fait référence à la collecte des inforamtions relatives aux violations en vue d'aider les victimes dans les procédures de demande de réparation.
De mon point de vue, la documentation sert à argumenter le plaidoyer de même qu'elle nourrit la recherche.
La doumentation des violations de droits humains peut surtout être utile dans le contexte de l'Afrique subsaharienne où les populations les plus démunies, plus exposées à ces violations, sont en majeur partie des personnes anaphabètes, n'ayant pas la culture de l'écriture. D'où la complexité aussi de la documentation pour les organisations de défense des droits humains
for those who do not read
for those who do not read the language of Molière, nthuman wrote:
"In the field of human rights, I believe that documentation refers to the collection of information related to violations, with the purpose to assist victims in the procedures for requesting reparations.
From my point of view, documentation helps to argue for advocacy and also nourishes research.
The documentation of human rights violations is especially useful in the context of sub-Saharan Africa, where the most poor populations, which are most exposed to violations, are mostly analphabetic. This makes documentation complicated for human rights organisations."
Bert Verstappen, Programme Coordinator at the Human Rights Information and Documentation Systems, International (HURIDOCS)
Moving beyond text for analphabetic populations
The point about the correlation between exposure to human rights violations and literacy is an important one to be made, especially in a digital age. It pushes me to think that new media offers a chance to re-emphasize oral and visual documentation, and move away from text or data oriented collection. In addition, the development of devices, applications and user interfaces that employ metaphors more closely aligned with the specific populations, could be useful in enabling a group to more directly document violations against them, without requiring literacy in a specific written language.
In a related note, my students from last semester at NYU helped design an application for UNICEF to assist in reconnecting children in IDP camps with their parents. One of the interesting challenges was that a child may not know the exact location of the place they are from or be able to point it out on a map. However, our approach was to use a combination of maps, satellite photos, street views, etc to narrow down to a specific region or town. Again, instead of just a single field on a form "Location", a richer tapestry of media data can be weaved together to more accurately represent the complexity of a situation.
Nathan Freitas, the Guardian Project
What is documentation?
Documentation can take on a number of forms. I think it human rights documentation should be creative and innovative. Documentation approaches should be dictated by the end purpose, which is to improve respect for human rights. Whatever information is needed to further that goal, should be collected and used, and it can indeed be a variety of things.
Yes, documentation can fuel research (to understand root causes or consequences), or to inform advocacy... but in practice it can take a number of forms.
The classic approach, as pointed out below by Jana, is the violations approach, meaning to investigate cases of violations, and collect the facts about victims and perpetrators, the circumstances of the act, and so on. This approach, often used for civil and political rights, is still valid today. A violation is a violation, and always one too many.
There are other approaches however. Monitoring indicators can be really valuable, in order to document issues such as discrimination in access to housing, access to justice, access to schooling, and so on. This does not involve documenting cases at all.
Documentation can also mean deep legal investigations for the purpose of strategic or public interest litigation.
Sometimes, documentation can mean researching the archives of a repressive regime to establish post mortem patterns of abuse, such as for Stalinist Russia, Baathist Iraq, and the Ethiopian Red Terror.
Human rights organisations also need to track their interventions, both with an eye towards efficiency and effectiveness (such as NHRIs or special rapporteurs that handle individual complaints, or NGOs that provide medical legal or financial support to victims), but sometimes simply to collect success stories for their donors (who always like success stories!). This is also part of documentation.
Documentation can also mean scanning and searching the media, and transcripts of parliamentary discussions, for examples of discriminatory or xenophobic speeches, or anti-Islamic or anti-Semitic statements.
Documentation can also involve socio-economic research, such as the research conducted by several NGOs on the economic consequences of the West Bank Barrier on the populations of the occupied territories in Palestine.
Documentation can even involve anthropological research, to try to understand the consequences of violations for its victims. When I was at ICRC, we tried to better understand the plight of families of missing persons in Kosovo, in particular women. We found that in addition to the problem of unresolved grief, they faced all kinds of social and economical consequences due to the dominance of traditional law and customs in rural areas.
Documentation can even involve ecological studies. For example, to protect the rights of indigenous peoples in Siberia or the Amazon and ensure their livelihood, it may be useful to examine the effects of oil forage on the water systems and fish stocks, orthe possible negative effects that pipelines can have on migratory patterns of animals that are essential to these peoples survival.
Have I missed anything?
Documentation is also dictated by practical considerations: what an NGO knows how to do, has the means to do, or wants to do. What information is available, where? What information has already been collected? What information is missing? What is important to document on the short term, medium term, and long term? Where can resources be deployed with the most added value? What information is needed to convince a particular target audience? These are also factors to be integrated in a documentation strategy.
Daniel D'Esposito, HURIDOCS
Using videos to document
Using videos to document stories can useful in areas where literacy rates are low, and are easy to broadcast nowadays on sites like Vimeo or the HUB. I liked this Tactical Tech video on how this can be done.
http://www.informationactivism.org/viewtactic4
Daniel D'Esposito, HURIDOCS
What is human rights documentation?
What do we mean when we talk about human rights documentation?
An excellent question. Many of the featured practitioners here are documenting violations against political and civil rights. We create a record--hopefully a permanent record--of experiences of individuals who have survived violations of their right to life, to peaceful assembly, to security of person. In other words, we document violations of the following types: extrajudicial killings, torture, physical assault, sexual assault, property damage, destruction or theft, forced displacement, and forced consumption (typically of items that are nonedible or taboo, or forced overconsumption). In some cases that record is qualitative in nature; for example, the record might be a story, recorded verbatim, told by a survivor of the abuse. Or it might have come to us in the form of a newspaper report or official document. In some cases that record is quantitative in nature; it has come from a random sample survey or from the coding of qualitative information.
Both quantitative and qualitative documentation are useful; I like to think of them as "the forest" and "the trees." The quantitative information is akin to the forest, or an aerial snapshot of the big picture. The qualitative information is akin to the trees, or a picture of an individual tree. From the picture of the individual tree, you can see all of the details of the tree -- the pattern of the bark, the knotholes -- just like from qualitative information, you can learn the details of an individual's human rights violations experience. From the picture of the forest, you can't see details, but you get a different, equally important overview of the whole group of trees -- just like from quantitative information, you get a "snapshot" of what happened and the prevalence/intensity of the violations. I believe that the best overall picture of mass human rights violations is given by combining the forest and the trees--in other words, documenting what happened via both quantitative and qualitative information.
Going back to the types of human rights violations, there are violations against rights other than civil and political that we must turn our attention to in the future--I am thinking of violations of economic, social, and cultural rights, such as the right to food, water, shelter, a means of employment, medical care, and education. Yes, these types of violations are often harder to document, but then again, there are some clear-cut cases. Sometimes E/S/C rights violations are interwoven with P/C right violations. For example, if forced displacement results in a lack of access to food and water, then both a P/C violation and an E/S/C violation have occurred. As an example of a purely E/S/C violation, consider the case of a government which restricts the movement of humanitarian workers attempting to bring food aid to a population suffering a famine.
How do we, as practioners, best document such violations? I believe this is an open question that deserves some debate and a great deal of research. First, we must agree that it is possible to document violations of this type. Much work has been done by the human rights community on defining E/S/C rights and the violation of those rights -- it is time to translate those definitions into documentation practices.
Jana Asher Executive Director StatAid www.stataid.org
Hello Jana, Thanks for
Hello Jana,
Thanks for this good input.
Quite some research has already been done on methods for measuring E/S/C/ rights.
Among various other resources, I would like to mention the large number of papers produced for the 2000 Montreux Conference Statistics, Development and Human Rights, available at http://www.portal-stat.admin.ch/iaos2000/index2.htm and Measuring Human Rights and Democratic Governance, published as OECD Journal on Development and available at http://browse.oecdbookshop.org/oecd/pdfs/browseit/4308021E.PDF
Essential is the distinction, and complimentarity, of the "indicators" method, to measure long-term impact, and the violations approach which starts from the point that each violation is one too many. The latter approach can also be used for monitoring E/S/C rights, see among others Audrey Chapman at http://www.cceia.org/resources/publications/dialogue/1_10/articles/580.html
But maybe I am moving too quickly to the "how" - all of you, feel free to exchange views on the "why"!
Best wishes,
Bert Verstappen, Programme Coordinator at the Human Rights Information and Documentation Systems, International (HURIDOCS)
Montreaux led to Metagora....
Thank you for mentioning Montreaux! For those that don't know, that first meeting in Montreaux led to the creation of a project called Metagora; it was housed at the OECD and the web site for the project is still up: www.metagora.org. Audrey Chapman also had a role in Metagora, as well as spending many, many years helping to clarify definitions of economic, social and cultural rights.
However, I would still argue the documentation of E/S/C rights is in its infancy, and not as far along as P/C right documentation!
Jana Asher Executive Director StatAid www.stataid.org
Innivation, training in monitoring ESC rights
But what has been happening since Metagora, in the area of measuring these rights? Where is the innovation coming from?
I see interesting work from the UNDP human development reports, the work on MDGs, and specialist NGOs like Cohre, Fian, Social Watch and CESR.
http://hdr.undp.org/en/
http://www.cohre.org/
http://www.cesr.org/
http://www.fian.org/
http://www.socialwatch.org/
But for generalist NGOs, its a challenge to get started with monitoring ESC rights. How to pick a high-leverage project, a feasible niche? What strategies: awareness raising, litigation, advisory services to policy makers?
ADH in Geneva is running a course about monitoring ESC rights, its in May 10-14 at the same time as the ESC Committee, and there will be high-level interaction with key Committee members. So its a good place to start. Highly recommended.
http://www.adh-geneve.ch/formation_continue/formation.php?id_formation=1/
http://www2.ohchr.org/english/bodies/cescr/
Daniel D'Esposito, HURIDOCS
New in ESC rights
I think the most exciting innovation in ESC rights, in terms of data, is the push for better monitoring and evaluation of development programs. There has been some advocacy for that cause in the statistics community here in the U.S., and a NGO-led advocacy effort that has resulted in proposed revitalizations of the Foreign Assistance Act in both the House and Senate. Both plans call for stronger evidence-based monitoring and evaluation.
In terms of potential topics to begin to explore, here's a bit of brainstorming:
1. You can look at transnational corporations and some of the rights issues surrounding their actions. When transnational corporations start violating rights, there is almost always an E/S/C rights aspect... either they are displacing individuals and/or depriving them of cultural rights, or maybe taking away a livelihood (taking land for strip mining) or access to water (I believe there was a case of this in India, related to Coca Cola).
2. There is the issue of incorporating the E/S/C rights violations into the P/C framework already used for many projects. For example, forced displacement can be accompanied by starvation -- are we recording those cases as violations resulting in death? Similar issues can occur with property violations, or even with physical assaults/killings, if they take away a family's livelihood.
3. There have been some data collection efforts related to indigenous people's rights to land -- two in Metagora -- that have met with quite a bit of success in terms of policy. The Metagora projects were in the Phillipines and South Africa. I wonder if there are other countries that could benefit from similar data collection projects.
4. One issue across many countries is the lack of good baseline data for measuring improvements in terms of poverty levels, access to food, water, shelter, education, etc. So there is quite a bit of room for gathering those type of data, in order to do a preliminary assessment of the distribution of resources within a country (which is related to E/S/C rights, especially if governmental policy is causing uneven distribution through direct persecution and/or prejudice).
Well, that's about all my brain can come up with early in the morning!
Jana Asher Executive Director StatAid www.stataid.org
Examples of ESC rights advocacy
Thanks for sharing your thoughts on innovations related to economic, social and cultural (ESC) rights.
Jana, your comment regarding "the lack of good baseline data for measuring improvements in terms of poverty levels, access to food, water, shelter, education, etc" really struck me.
New Tactics has a couple of excellent tactical notebooks that highlight NGO advocacy efforts working in this area.
Such baseline information would be incredibly important for tracking improvement data, as well as reversals, that are emerging. Improvement data would be very motivating for communities themselves - it is difficult to recognize incremental gains given the on-going state of their condition. What a great tool such data would be for NGOs to show governments and corporations that what NGOs are advocating for is having impact.
One such example from IDASA in South Africa has been their Using Government Budgets as a Monitoring Tool as one form of data collection that has been used for tracking incremental gains in poverty reduction. IDASA has used this budget information to hold government accountable to its commitmenst, advance their advocacy for system changes, level of investments, and other on-going improvements.
Another example comes from FIAN's efforts to connect transnational corporations supported by German bank investments to hold corporations accountable for their abuses - see "Leveraging the Money: Enforcing human rights by influencing financial institutions".
Nancy Pearson, New Tactics in Human Rights Training Manager
Information activism
Jana, your post about ESC transnational corporation made me think of this case study by Tactical Tech, on how farm subsidies are spent.
http://www.informationactivism.org/viewtactic7
It shows how to present complex data in ways that really talk to people.
Have a look at the video, should inpsire some really nice ideas. Its part of a series of videos on information activism, really inspirational.
Daniel D'Esposito, HURIDOCS
More on monitoring E/S/C rights violations
Thanks for posting these resources. The 1997 article in Human Rights Dialogue by Audrey Chapman outlines a 3-part framework for monitoring E/S/C rights violations, arguing most vigorously for monitoring violations, meaning acts of commission, rather than assessing progress on attempts toward realizing greater fulfillment of the rights outlined in the International Covenent of Economic, Social, and Cultural Rights (ICESC).
To quote, she proposes a tripartite categorization of violations. (See Box, page 19.) The first category includes state violations resulting from government actions, policies, and legislation. The second contains violations related to patterns of discrimination. The third includes violations related to the state’s failure to fulfill minimum core obligations of enumerated rights. This article was written in 1997. I see the tools developed by HURIDOCS address this, but I'm wondering if there are additional resources that people could point to. In particular, I am looking for resources about arbitrary taxation as a human rights violation - both tools for monitoring and for data analysis.
Patrick J. Pierce
Head, Burma Program
International Center for Transitional Justice
Received today via e-mail!
Dear Friends,
The Project on Economic, Social and Cultural Rights at the Geneva Academy of International Humanitarian Law and Human Rights is pleased to announce that it is now accepting applications for its third annual training course on Monitoring Economic, Social and Cultural Rights. The course will be held in Geneva, Switzerland from May 10 – 14, 2010.
The course will provide participants with the know-how to get started in monitoring economic, social and cultural rights (ESC rights), as well as the in-depth knowledge to enhance the ESC rights monitoring work they may already be doing. The course will take place in parallel with the May session of the Committee on Economic, Social, and Cultural Rights in order to allow course participants to observe the Committee in session, to the extent time permits.
The course is designed for human rights professionals from small and medium-sized organisations (particularly NGOs) who monitor ESC rights or who wish to begin doing so.
For more information on the course, please see the attached flyer and application form or visit http://www.adh-geneva.ch/teaching_for_professionals/teaching.php?id_formation=1
Kind regards,
Project on Economic, Social and Cultural Rights
Geneva Academy of International Humanitarian Law and Human Rights
Jana Asher Executive Director StatAid www.stataid.org
great comment...
Jana's comment is very important. I think that we in the human rights community very much need to open ourselves up to a serious discussion of what it means to document violations.
Jana's point about the tension between "qualitative" and "quantitative" is essential. Communication human rights documentation often involves a tendency towards the quantitative as a stand-in for "serious" with qualitative as a stand in for "emotion".
Actually, a great deal of quantitative human rights data is not gathered in a rigorous manner such that it is either accurate (for example, total numbers of victims) or representative of a population (if 50% of those interviewed were tortured, it obviously doesn't mean that 50% of the population was tortured is those interveiwed were not identified in a rigorous and statistically relevant manner, etc.).
And, so much of qualitative data as presented is oriented towards the emotive aspects of human rights advocacy rather than as a means of better understanding what is actually going on. This is interesting because human rights violations are only really sensible through an engagement with social and political context. People are not "tortured" they are tortured by certain actors in certain social environments. While it is true that teh act of torture as a crime may not require a great deal of sensitivity towards context it is equally true than any serious engagement with the meaning of the crime or the means of responding to that crime very much requires an understanding of context. In this way, the qualitative nature of data collecion is essential for making sense of what is actually going on.
Daniel Rothenberg
Managing Director of International Projects
International Human Rights Law Institute
DePaul University College of Law
Chicago, IL USA
Managing popular demand for quantification
To build on this topic further – as all of us participating in this dialogue know well, the discourse on human rights violations is peppered with demands for quantification. In the Benetech Human Rights Data Analysis Group (HRDAG) we engage in statistical analysis of human rights data when we assess that the data are of a high enough quality and quantity that we can conduct the analysis in a scientifically defensible and rigorous way. However, the conditions required to conduct that kind of analysis are hard to meet. We discuss some of the challenges we've identified over the years on our HRDAG 'Core Concepts' page in case it's of interest - I'm sure you'll recognize the challenges we've listed.
Because of this, while it’s generally possible to create ‘descriptive statistics’ that describe the contents of a documentation project database (for example) it’s much more difficult and sometimes impossible to infer from the observed violations captured in that dataset to the greater reality of the human rights context in that city, or district, or country. (as with the example Daniel gave in his earlier post)
Often, when people ask us to produce statistics on a conflict, our response is to ask them to instead focus on the qualitative data, because that’s where the strength of the documentation is. In our view, it is worse to have a bad quantification of a human rights situation than to have no statistics at all. If flawed statistics are put forth and then undermined by a critic, that kind of methodological attack can damage the credibility of the entire advocacy effort on that given issue.
Qualitative information is an incredibly rich source of detailed information about what’s happening to whom, by who, when, where and how, and a report that draws informed conclusions and recommendations about a human rights crisis based on observed phenomena is much stronger than a number which cannot be defended.
Vijaya (Jaya) Tripathi, Benetech
To count or not to count...
I agree with Dan and Vijaya that quantitative analysis is often a problem for human rights NGOs.
To complement Dan's example, we can take the case of an NGO that collected 20 torture cases in January, 40 in February, and 100 in March. It may be tempted to conclude that torture is increasing. This may be correct, but the increase may also be due to a variety of other reasons:
But I don't think, as Vijaya, that that NGOs shoulf be discouraged from using numbers:
... our response is to ask them to instead focus on the qualitative data,
because that’s where the strength of the documentation is. In our view,
it is worse to have a bad quantification of a human rights situation
than to have no statistics at all. If flawed statistics are put forth
and then undermined by a critic, that kind of methodological attack can
damage the credibility of the entire advocacy effort on that given
issue.
Rather, they should be encourage to engage, make mistakes, learn from them, and move forwards and upwards. If their credibility is attacked because their numbers and interpretations are wonky, fair enough, this should stimulate them to review their copy and improve their methodology, and come back to the table with something better. Its a learning process, nobody get it right the first go.
Otherwise we risk creating a situation where quantitative analysis is the the preserve of a few scientists, guardians of the Temple of Truth in Numbers, because only their numbers are scientifically valid, and only scientifically valid is good enough... and the rest of us are to be content with collecting stories, however useful these may be. :-)))
NGOs want to count, and they always will. Its natural. And I would argue, they will always be able to say something meaningful with their data, provided they have a little basic expertise to identify sources of bias and place the necessary caveats where they belong. A violation is a violation, 200 violations are 200 violations, and 20 thousand violations are 20 thousand violations.
An organisation in Africa has collected 20 thousand cases of torture, often with detailed medical affidavits. Now thats something. Maybe they cannot give a precisely count of the whole phenomenon, or say the percentage of persons arrested who were tortured (as those who weren't go unreported), but they can certainly use their data to say that torture is a problem in this country, and that its systematic and widespread, and lasts over time. Now thats already a strong and important type of statement you cannot say with stories alone. It shows a policy of repression. And you need numbers for that, numbers connected to places and perpetrators and context. They also collect details on which methods are used, so they can certainly say something about the prevalence of certain methods in certain areas, or by certain perpetrators. They also collect biographical information about victims, so we can assume they can say something reasonably accurate, about the profiles of the victims.
But even if the NGO has only 200 cases, and the government has only 11 because it is in denial of the problem, then these may be used quantitively. I am referring to CATW in the Philippines, who was able to successfully get an anti-trafficking law passed, on the basis of the advocacy mileage they got from these 200 cases. So maybe the sample was on the smallish side, but at the end of the day they got their law, they won their battle, so they were right to use these numbers. Its maybe not scientific, but it worked.
At HURIDOCS, our approach is to provide both quantitative and qualitative possibilities with the tools be build, so people have options. For example, OpenEvsys can be used both to collect and organize stories, but also to provide "who did what to whom" quantitative analysis of the violations in these stories: how many acts of torture by military in X province, what is the gender breakdown of the victims, etc.
We are currently working on the analytics of this tool, so if you want to take a look at the advanced search area:
Online demo: http://resperesaas.com/openevsys/
The user name is "admin" and the password is "password".
We also are working with Oleg Burlaca, on a prototype for a similar "who did what to whom system", have a look here: http://openevsys.burlaca.com/
And this is the first step, we'd like to go as far as we can: custom reports, built-in production of graphs and charts, GIS and maps. NGOs want this, so we need to give it to them. And if they accept, we'll also provide them with advice on how to make meaningful statements from their data, how to avoid the bias traps.
These scientists themselves they often work with the same imperfect data, often collected by these NGOs at the risk of their lives in difficult circumstances. There is no such thing as a pure, absolute, scientific truth, there is no black or white, somehow its always shades of gray. The key difference is that the scientists know what can be said in the basis of this data, and what cannot be said.
I would say that no dataset is perfect, there will always be some trace of bias especially in repressive regimes where the strategy of perpetrators is often to conceal violations, which only come out once its too late. So scientific rigor is elusive. And NGOs don't have the luxury to wait, they have to make their case now, with the data they have, whether good or bad or somewhere in between. Its an information war, so lets help them win as many rounds as they can. Good enough is good enough, as long as you get from A to B, it doesn't have to be perfect.
On the contrary, we need to bridge the gaps between scientists and advocates, this is the real challenge. Organisations like Stataid and HRDAG have an important role to play in building the capacity of NGOs, because of their acute understanding of social research methods as they can be applied to the human rights context.
Its not easy to bridge the gaps. Activists are often distrustful of science and scientists, or they simply are not willing to acknowledge possible sources of bias, and react defensively to any suggestions. So what can we do? Any ideas would be appreciated.
Its important to bridge this gap, because as our world is becoming more sophisticated, and human rights actors need to be able to deploy ever more complex argumentations to make their case. Not only to provide evidence of violations, but to understand causes and consequences, and to offer well informed and well articulated policy solutions. We need a pluridisciplinary approach to documenting human rights, and many areas of expertise have a role to play: lawyers, communicators, statisticians, information scientists, IT systems developers, social researchers, economists, archivists, historians, public policy specialists...
Its a pity, because help is often just around the corner, at the local university. Online, HRDAG's core concepts offer a concise list of very valuable pointers. The Spirer manual on human rights statistics is also an excellent reference, but nobody knows about it. Herbert Spirer is a statistician who worked in economics, before devoting his life to explaining how statistical methods can be applied to human rights.
There are As Bert mentions, HURIDOCS is currently putting together a digital library with the best resources, in the coming two months. The idea is to work collectively on finding the best items to include in each section, because each of us has a few pieces of the puzzle.
Quantitative analysis extends beyond counting violations, too, as it also involves using indicators approaches. Have a look at this Rosling video and imagine how these types of tools like Gapminder World can be used for human rights, if we can link the right datasets to the human rights indicators.
Again, I'm not saying that numbers are better than stories, only that some carefully chosen and interpreted numbers will usually have their place. And that NGOs should not necessarily be discouraged from using them on the basis of their presumed lack of expertise, rather that they should be helped to use them cleverly, avoiding statements that are not backed up by their data.
Sorry for the long spiel, but its a topic I feel strongly about!!!
Daniel D'Esposito, HURIDOCS
re. to count or not to count...
Hello,
I am glad that Daniel D'Esposito refered to the Spirers manual, it remains an essential resource for NGOs to apply simple statistical methods and techniques in the various stages of information processing: collection, documentation, analysis, reporting...
One important lesson from that book is that your data may be good or bad, but will never be perfect. Therefore, it is essential to explain your working methods and qualify your findings. When it comes to figures, it is also better to give qualified estimates rather than round or hard figures.
This is one important way in which the gap between NGO reports and "real science" can be bridged.
Bert Verstappen, Programme Coordinator at the Human Rights Information and Documentation Systems, International (HURIDOCS)
stick to the data
I completely agree with Daniel that one of the most important roles experts can play is to help NGOs (and other non-technical-experts) "...use [numbers] cleverly, avoiding statements that are not backed up by their data." There is certainly nothing wrong with reporting the numbers of acts, victims, etc. that have been collected. When we get into trouble is when we attempt to infer from what has been observed to a larger, unobserved, population. If the data has not been collected in a rigorous, representative way, then we cannot possibly draw these types of conclusions. As Jaya points out above, in these cases summary statistics about the data observed are the only responsible numbers to report.
Inferences about a larger population may not be necessary to win a battle. As Daniel points out, certain acts may be considered so egregious that any documented evidence of their occurance is sufficient to enact policy change or affect public opinion. We do not always need to reach beyond what has been observed and attempt to make statements about broader patterns.
Certainly science only advances through trial and error, and of course researchers should constantly work to improve their methodology. However, at every phase of this process we must be modest and transparent in our conclusions - this is what I mean by sticking to the data. We can only report what the data tells us, and if the data was collected in an unrepresentative way, we only know about the data we have collected and observed. It does not tell us anything about larger patterns beyond what we observed.
Unfortunately, I have to disagree that the organization doing the reporting is the only one to suffer when these kinds of mistakes are made. As the recent controversy over mortality rates in the Congo shows us, when researchers publicly reach beyond what can be reasonably concluded from their data, everyone's credibility is undermined.
Megan Price, Benetech
Hi Megan, could you tell us
Hi Megan, could you tell us more about the Congo controversy? Its very interesting. Why was the issue controversial? What were the stakes?
I think its important to link the credibility of NGO data, and the statements they derive from it, to the attitude of the authorities in charge of ensuring respect for human rights, usually the government. Are they acting in good or bad faith? Sometimes, they may attack a report, in good faith, because they have legitimate questions. More frequently, they attack the report in bad faith, and it doesn't matter if its solid or not, they'll find some reason to undermine or bury it. Or other mitigating tactics, such as setting up an "Investigation Commission" that goes nowhere. But its better than ignoring the debate and attacking the NGOs in other ways, such as trumped up legal charges, raids, or physical attacks.
Thanks
Daniel D'Esposito, HURIDOCS
Congo mortality rates
Sure. Researchers at Simon-Fraser University recently published a Human Security Report titled "The Shrinking Costs of War." In Chapter 3 they criticize some of the methodology employed by the International Rescue Committee in some of their surveys in the Democratic Republic of Congo. This story was picked up by numerous news outlets.
Now, it's important to note here that as a statistician I can point to strengths and weaknesses in both sides of this argument. Also to reiterate that scientific debate is absolutely necessary for scientific progress. Much of the negative fall-out of this public debate is due to our inability as scientists to conduct this debate publicly in a way that is clear to a general audience.
However, those issues aside, my point here is that as a result of the IRC reaching beyond what could be reasonably concluded by their data collection methods, they left themselves open to scientific criticism. Now, I fear, in the Congo as in Darfur, all numbers are considered suspect. Whenever any group produces statistics to bolster their claims of the need for policy change or humanitarian efforts in these areas those numbers are viewed with much more skepticism than statistics from other geographic areas that have not experienced this sort of public debate over methodology. I believe this level of skepticism of numbers harms all groups, not just those actively involved in this current debate.
Megan Price, Benetech
A very interesting example,
A very interesting example, thanks for sharing this. Read a bit more about it on the HRDAG website. If you have similar experiences, please share before the dialogue closes, its very interesting!
Daniel D'Esposito, HURIDOCS
the scientist-activist gap
Just a quick response to Daniel's question:
Its not easy to bridge the gaps. Activists are often distrustful of science and scientists, or they simply are not willing to acknowledge possible sources of bias, and react defensively to any suggestions. So what can we do? Any ideas would be appreciated.
Two issues come to mind, both of which are rather sensitive: financial resources and how experts engage as experts. The local Burmese groups have appreciated Benetech's engagement with their project because it has been sustained and there was an institutional commitment to see the project through. Scientists, especially if they are living in the global north where cost of living is high, are expensive. One of the most effective ways for scientists to engage is to not only cover their own costs but to use their access to donors to acquire funds for their local partner(s).
The other issue is the arrogance or perceived arrogance with which scientists engage local groups. (I've actually never witnessed such a thing; lawyers on the other hand ...) It's a matter of trust building and respect and that comes most easily through long-term engagement as well.
Patrick J. Pierce
Head, Burma Program
International Center for Transitional Justice
To quantify or not to quantify?
Vijayat raises an important point regarding summary statistics of data collected via non-random means; inference is extremely limited. I believe, however, that this is an issue of capacity building -- NGOs need to understand the limitations of quantitative analyses in that context. Similarly, newspaper reporters need to understand the limitations of quantitative analyses in that context! I am guessing that NGOs (and newspapers) will continue to attempt to quantify data whether we intervene or not -- better that they understand the risks and the issues.
There is also the issue of the purpose of the information. If the information is to come under intense scrutiny -- for example, in the case of legal proceedings and/or in the case of the results of a TRC (truth and reconciliation commission) -- then the analysis of the available information -- whether qualitative or quantitative -- needs to be as airtight as possible. In that situation, a quantitative analysis of data that are not derived from a random sample is very risky.
If the data are to be used in a context where there is less scrutiny -- perhaps in the case of humanitarian assistance or reparations -- there is less risk to the human rights cause in quantifying the data. However, if the data are not truly representative of the population, there is a risk of not providing assistance and/or support to members of that population that truly need and deserve it.
Jana Asher Executive Director StatAid www.stataid.org
To quantify or not to quantify?
Thanks Jana, Vijaya, and Megan,
"I like to think of them as "the forest" and "the trees." The quantitative information is akin to the forest, or an aerial snapshot of the big picture. The qualitative information is akin to the trees, or a picture of an individual tree. From the picture of the individual tree, you can see all of the details of the tree -- the pattern of the bark, the knotholes -- just like from qualitative information, you can learn the details of an individual's human rights violations experience. From the picture of the forest, you can't see details, but you get a different, equally important overview of the whole group of trees -- just like from quantitative information, you get a "snapshot" of what happened and the prevalence/intensity of the violations. I believe that the best overall picture of mass human rights violations is given by combining the forest and the trees--in other words, documenting what happened via both quantitative and qualitative information. "
Wow, excellent metaphor, Jana.
If I understand your points correctly, by inference you mean that you cannot make a presumption about the whole, on the basis of the part that you can observe, unless the part is representative of the whole.
And that the part can only be representative of the whole, if it is chosen with completely random methods, to protect against any selection bias. For example, every fifth household in every fifth street.
Well, that may be possible in polling situations, where you have a stable environment, a nice detailed map of the city, and the financial means and human resources to do the work thoroughly, according to the book.
But what to do in the kind of human rights situations NGOs face in Zimbabwe, or Russia for example, or Burma where cross-border researchers don't even have good real-time access to the population at risk. In these situations, people work with what they can get.
I guess your answer would be to focus on collecting detailed testimonies, and forget the numbers.
But can there be no way to make use of the numbers at all? I mean, if you've collected 10 thousand torture testimonies, you don't have to infer on the probable total number, which would only stir up polemics. The number or 20 thousand stands by itself. Its 20 thousand too many. Its enough to show that you're not talking about a few rogue policemen, thats there is a policy behind it. Or is this mistaken?
What if you have many more testimonies than that, but your monitors were not so well trained or are not very articulate writers, so even if they risked their lives to collect these stories, most don't have many circumstantial details beyond the basic facts and characteristics of victim. So what to do with this information? Throw it out?
Is inference possible by using some random sample surveys to get an idea of the whole? For example, to ask a refugee population, during household food security surveys for example, if they have any persons in their family who were killed or tortured in relation with the conflict.
A personal situation I was faced with, was receiving a regular trickle of families coming in to the office report enforced disappearances. We were not doing any outreach to influence the number of incoming visitors. The government may have been declaring the war was over, the trickle was still taking place. We didn't try to figure out the total number of missing, it was enough for us to conclude, for our advocacy interventions, that the pattern of disappearances was still ongoing. Was this wrong?
I also think that numbers and stories work together. They protect each other. For example, if you come forward with stories, its easy for the perpetrators to dismiss the violations as the actions of a few rogue soldiers, or as deliberate exagerations of politically motivated pseudo-victims told to gullible human rights workers. But you can use numbers to show that the violations are widespread enough to exclude the rogue soldier theory, or the exageration theory. So the numbers protect the story, by giving an idea of the scale, if not a precise count of the total phenomenon (which is not needed anyway).
Have a look at section 3 of this ICRC report, which describes torture by Coalition forces of Iraqis in 2003. It makes a very careful use of stats, not to give their interlocutors any rope to hang them with. But it does use some numbers, but very subtly. It speaks of a memorandum containing 200 allegations of ill-treatment. It speaks of another letter of 50 allegations. It speaks of a wide array of places. This cuts off any "rogue soldier" argumentation and shows that it is indeed a systemic problem and its a rock-solid report, even though the "rogue soldier" tactic was the finally public defense used by the Bush administration. So the numbers protected the stories!
http://cryptome.org/icrc-report.htm
Overall, what level of proof is to be expected from human rights NGOs for their day to day advocacy?
Daniel D'Esposito, HURIDOCS
more thoughts on data
Thanks Daniel for continuing to work to clarify this important idea.
If I understand your points correctly, by inference you mean that you cannot make a presumption about the whole, on the basis of the part that you can observe, unless the part is representative of the whole.
And that the part can only be representative of the whole, if it is chosen with completely random methods, to protect against any selection bias. For example, every fifth household in every fifth street.
Yes, this is a correct interpretation of inference. However I want to add that random selection methods are but one piece of collecting representative data. In addition to being randomly selected, a large enough sample must also be selected to claim representativeness. “Large enough” is highly dependent on individual context.
I guess your answer would be to focus on collecting detailed testimonies, and forget the numbers.
I would never suggest forgetting the numbers. I completely agree that collecting a random sample is frequently impossible in situations where we need to gather data about human rights violations. As I hoped to make clear above, what I emphasize to our partners is to use those numbers modestly, to make sure to avoid claims that cannot be backed up by those numbers. That certainly is not the same as not using numbers at all.
But can there be no way to make use of the numbers at all? I mean, if you've collected 10 thousand torture testimonies, you don't have to infer on the probable total number, which would only stir up polemics. The number or 20 thousand stands by itself. Its 20 thousand too many. Its enough to show that you're not talking about a few rogue policemen, thats there is a policy behind it. Or is this mistaken?
No, you’re right, some violations are so egregious any documented evidence of their occurrence is enough – there is no need to generalize beyond what has been collected and observed. In fact, all the more reason to avoid generalizing, when that may open you up to criticism and undermine your cause.
A personal situation I was faced with, was receiving a regular trickle of families coming in to the office report enforced disappearances. We were not doing any outreach to influence the number of incoming visitors. The government may have been declaring the war was over, the trickle was still taking place. We didn't try to figure out the total number of missing, it was enough for us to conclude, for our advocacy interventions, that the pattern of disappearances was still ongoing. Was this wrong?
No, this was right precisely because you “didn't try to figure out the total number of missing.” Data that is collected in this way, called convenience data, can be extremely useful. And in the case described above it can certainly serve your advocacy intentions. The appearance of any families in your office was enough to contradict the government’s claims. You did not need to generalize to the total number of missing to make your case. This is sticking close to the data – describing exactly what the numbers say, and nothing more.
Agreed. As Jana so eloquently says above, quantitative and qualitative information need to complement each other to tell complete stories of human rights violations.
Megan Price, Benetech
Thanks for this, everything
Thanks for this, everything is much clearer now! I think I learned a lot these last days! Daniel D'Esposito, HURIDOCS
Daniel D'Esposito, HURIDOCS
Qualitative vs Quantitative
Frankly I do not see the tension nowadays.
One can record open ended interviews (qualitative) but then use natural language recognition and machine learning to extract quantifiable data from these interviews / pictures / etc.
The quantitaive data may not be accurate at the individual level, but over large numbers of individuals one gets a decent picture for various research purposes.
I think a more important distinction is between machine readable and non machine readable data.
relevant tension
The decsions that have to be made about the collection of data are based not only on how the information will be extracted than about the realities in the field, where the interviewer meets the person who has witnessed or suffered violence. The examples I give above about the Burma database shows this - the information that was collected using the "ask about everything" provided a broad picture. But for people who are looking at specific issues, the depth of the information is lacking. So the question is not about extracting the data but about collecting it. How much time does the interviewer have? How long can she stay and talk with the person? How many people need to provide information for some meaningful analysis to take place?
In addition, sometimes the person's individual truth is exactly what's needed. I think dismissing these tensions as irrrelevant is only reasonable if one has a very narrow purpose in mind. But as the rest of this dialogue is demonstrating, there are a variety of purposes and thinking through these questions is essential given the reality on the ground for fieldworkers.
That said, Fernando - I would be interested to read more about the distinction between machine readable and non-readable data.
Patrick J. Pierce
Head, Burma Program
International Center for Transitional Justice
Distinction between machine readable and non-readable data
I agree with all you have to say. Indeed I see no tension between what I suggested and the more nuanced data collection you have in mind.
My point is that you can collect any data you want - open ended interviews, pictures, Geo locations, video, voice, etc.... - so long as it is in some electronic format.
From there you can feed that data to the computer to sort, interpret, find patterns, etc.. It is amazing what computers can do nowadays.
I am not saying this is all one should do, or that computers can solve everything, but rather that useful data, nowadays, goes well beyond a relational table or a structure inteerview, and that human coding of open ended interviews into "data" is almost unecessary.
So I think the key is to have the data - however qualitative it may appear - in electronic format.
Machine Readable Video Transcripts
Nandi,
I think this is an excellent idea regarding using speech recognition to create machine readable text from audio and video recordings. This is particularly useful in light of recent technology improvements in this area, such as the audio transcription that YouTube and Google Voice now provide for free (http://googlesystem.blogspot.com/2009/11/youtube-audio-transcription.html), not to mention the number of higher end commercial engines offered by Dragon, IBM and others.
In general, I think this just points to a trend towards the ability to link and analyze deeply within multimedia content which up to this point has been treated more as a block with tags.
Nathan Freitas, the Guardian Project
Visual documentation - how hr community reacts to + quantity?
One question that WITNESS (www.witness.org) is wrestling with in terms of documentation is how to understand burgeoning amounts of citizen documentation that are not gathered through formal human rights documentation processes. Does text/images/testimony need to have been conceptualized as 'human rights documentation' in order for it to be useful to human rights work? This relates very closely to the real-time dilemmas that I also see emerging in other threads.
This question arises particularly in the light of the increasing amount of visual documentation (primarily of civil and political rights violations, e.g Iran, Honduras etc, but also including testimony-based documentation around ESC rights) that is being circulated online and because of more and more ubiquitous cameras on cell-phones and the like.This kind of visual documentation was already fairly poorly assimilated into human rights documentation strategies (if better incorporated into mobilization and advocacy strateiges), because of the slippery nature of its documentation value (how do we understand pov, whats in and out of frame etc) and the speed, pace and volume of creation of a/v material is outpacing much of the human rights community's capacity to relate to it.
If we assume that in five, ten years time, perhaps 90% of visual documentation of human rights violations will have been gathered outside of the formal human rights infrastructure, how do we make sure that this citizen documentation is of value to more formal documentation/advocacy processes (which will continue to be important for securing protection and redress) both in real-time and after the fact?
Sam Gregory, Program Director, WITNESS (www.witness.org/hub.witness.org)
"formal" human rights documentation
I wonder what the boundary is between formal and informal human rights documentation, an issue that Sam raises here. It seems to me to be a matter of being systematic or not, and it applies to to not only video material but other ways of hearing people's stories as well.
For example, if I sit down and listen to the life story of someone who has suffered a series of human rights violations, and then I write that story up and post it on my blog, I am applying some of what might be called "formal" human rights documentation techniques, but not submitting it to any systematic or larger effort. I am also not making an effort to use that person's story to advocate for anything in particular, but just to raise awareness among people who might read my blog.
On the other hand, contributing that story to an effort to collect lots of those stories, analyze them, and use that analysis to bring about some kind of positive change is a systematic way of handling it. Can video documentation be treated the same way? How to make it of value to human rights advocacy?
I think one possibility is to develop systematic ways of storing, coding, and analyzing the information contained in the videos. (Sam, has Witness developed some methodologies for something like this? I see that there is a sophisticated search tool on the media search portion of the website. Can you talk about the process of applying keywords, etc.?)
The second possibility is to take it for what it is, value it for its immediacy. The videos of monks marching in Burma in 2007 and the subsequent crackdown brought unprecedented attention to the human rights situation in Burma. It also created a political environment internationally where promoting a human rights agenda (e.g. pushing for an arms embargo, calling for a commission of inquiry), got a wider hearing, though it was still difficult (and ultimately was not successful).
Perhaps the real-time evidence does not need to be incorporated into a formal effort, but can be seen as an essential tool that can be used alongside human rights documentation.
Patrick J. Pierce
Head, Burma Program
International Center for Transitional Justice
Formal, informal,
Formal, informal, interesting and useful distinction! Maybe formality can be applied not only to how the data is processed, but also to how it is disseminated: a blog would be informal, a communication to a special rapporteur would be more formal.
About videos, the key concept is metadata. As you can't "see into" the video without watching it, you need to apply metadata to retrieve it reliably. This includes an abstract, author, date, location, corporate author, format, length, etc.... and index terms.
Witness has developed a really useful thesaurus of index terms, Sam would it be possible to share it? HURIDOCS has a general list of index terms, also a useful starting point, but it needs a bit of refreshing.
Daniel D'Esposito, HURIDOCS
Audiovisual documentation
Dan - this is Grace Lile, from the WITNESS archive. I am happy to send our subject index to anyone who contacts me at grace [at] witness [dot] org; at some point we will make it available online but it is likewise in need of some updating.
There are myriad challenges in managing video as documentation, and yes, metadata is key. It is a simple fact that images, moving or still, never stand on their own as documentation - they must be accompanied by words - description, metadata - to describe, authenticate, evaluate, contextualize, reveal meaning. Perhaps this seems obvious, but the ease with which images are disseminated, duplicated, edited, recombined and recontextualized, especially in the digital world, and the current lack of technical tools for ensuring persistence of metadata across these processes, creates endless opportunities for misuse, misappropriation, error. The ability to identify, authenticate, retain and track content is imperative, not only in an evidentiary context, but to tell any story truthfully.
At WITNESS we have developed our own database to manage our video collection, which has been generated by a large number of remotely-based HRNGOs. A record for any given video document will ideally contain the following:
I would also note that in some spheres, including within the archival community, there has historically been a bias against visual information, regarding it as being of primarily illustrative (which it certainly can be as well) rather than documentary or evidentiary value. So standards for documenting with moving images have sometimes been poor, and there is a dearth of tools and best practices pertaining to audiovisual documentation. I'd love to hear from others who are grappling with this.
http//:archive.witness.org
www.witnessmediaarchive.org
Re: Audiovisual documentation
I admit that there is a historical bias against visual information within the archival community (Joan Schwartz referred to this as "archival othering": it isn't what we are used to so we treat it differently) as documentary record; however I must stress the historical part. I would be surprised to still discover this bias in any of my colleagues.
Like all records good context is essential but archivists have little-to-no capacity for adding item-level metadata but resort to description on aggregate bodies of records. Good documentation and metadata provided by the creators is like gold to us and future researchers. Grace gave a great list of metadata fields and the need for better standards and tools is certainly there. I must echo her statement: "The ability to identify, authenticate, retain and track content is imperative, not only in an evidentiary context, but to tell any story truthfully." Trustworthiness of the record is even more difficult to retain in a digital information wold. We must keep that in mind and act accordingly.
Seth Shaw, Duke's Libraries' Electronic Records Archivist
Human Rights & Metadata
I agree that metadata is key, not just for video, but for all born-digital and as well as digitized records. HURIDOCS provides a set of terms or a lexicon which can be used to populate metadata fields, but as far as I know there are no standardized metadata schemas for human rights records. Such a metadata schema must meet the requirements of persistent, authentic records, as well as the requirements of the human right practitioners who make and deploy these records. Such a descriptive standard is essential if the records we generate are to remian viable and useful, whether they be documents containing first-hand testimony, text messages from the field, complex data sets, or video or audio recordings.
Patrick Stawski - Human Rights Archivist, Duke University Libraries
Help defining terms and metadata
Patrick and others,
I have found myself getting lost in the terms. There is a great deal of wonderful technical information being shared – perhaps in the New Tactics summary of this dialogue we could include a summary of terms to help people better grasp the powerful and insightful comments.
I found the information on Wikipedia on “metadata” helpful. Although even Wikipedia said that the article was in need of attention from an expert on the subject. Perhaps someone in this dialogue would have an interest in helping to provide a better understanding. Here is the link: http://en.wikipedia.org/wiki/Metadata
The definition provided on “metadata” is this:
Metadata (meta data, meta-data, or sometimes metainformation) is “data about data.” Metadata is an emerging practice with close ties to librarianship, information science, information technology and GIS. It can be applied to a vast array of objects including both physical and electronic items such as raw data, books, CDs, DVDs, images, maps, database tables, and web pages. Since the emergence of the Dublin Core metadata set and the internet, use of metadata has experienced a considerable growth in popularity as businesses and other organisations seek to organise rapidly growing volumes of data and information.
Nancy Pearson, New Tactics in Human Rights Training Manager
Yes Nancy, metadata is data
Yes Nancy, metadata is data about data. It helps you find things. For example, if you're looking for a book, you'll use keywords to narrow down your search, or if you click on a term in a tag cloud, you'll get the blog posts that have been given this term.
Your wikipedia article quotes Dublin Core, which is the standard set of metadata, and its good to work with existing standards.
http://dublincore.org/ http://en.wikipedia.org/wiki/Dublin_Core
Here is a very good example of metadata for a book: Who did what to whom, no less! http://shr.aaas.org/Ball/copyrite.html
Daniel D'Esposito, HURIDOCS
Great resource for NGOs
Daniel,
Thank you so much for sharing this great resource by Patrick Ball. The table of contents provides an easy way to see the overview of the "Who did what to whom" documentation planning and documentation process. But it also provides some great insights into what challenges organizations might face from WITHIN their own organization for setting up the kinds of documentation systems that you all have been talking about in this wonderful exchange of experiences.
I appreciate that you shared more information about the Dublin Core and connecting people to that resource as well.
Nancy Pearson, New Tactics in Human Rights Training Manager
Metadata Schemas for Human Rights
Nancy and All - Although it is true that metadata is "data about data", perhaps a more useful definition would be:
-metadata is a set of structured data or content types (referred to as a metadata schema) that characterize an information object (data) -
There can be different metadata schemas for different uses. For example, there are schemas related to descriptive data, preservation data, rights data, etc.
The best example of a metadata schema is the MARC record that we encounter in all library catalogs across the USA. It is a set of standard fields (author, title, pub. date,etc.) that all libraries adhere to. coupled with controlled vocabularies MARC allows all libraries to describe similar objects (books) in similar ways, and just as importantly, users do not need to re-learn again and again how to discover material. We can pretty much log into any on-line catalog across the country and easily find our way around because of the standardized mnetadata schema.
Imagine how useful a metadata schema approach could be for the human rights community:
1) We develop and promote standard (but dynamic) metadata schemas for describing different types of human rights information (audio-video, data bases, publications, etc.);
2) We couple these with the controlled vocabularies managed by WITNESS, HURIDOCS, and other organizations;
3) We build these concepts, both schemas and lexicons, into data management tools such as MARTUS and the system developed by RED in Mexico;
4) Once data is standardized we could then work towards developing a federated, secure, access-controlled union catalog or index that will allow human rights practitioners to share information in an efficient and user-friendly fashion.
Patrick Stawski - Human Rights Archivist, Duke University Libraries
Great outline for HR metadata schema and future vision
Patrick,
Thank you for sharing this very helpful explanation on metadata schema. You also offer an excellent outline for the steps needed for vision of the future of human rights data collection and usage to where we want to go!
Nancy Pearson, New Tactics in Human Rights Training Manager
Thesauri browser
Thanks for the comment, Patrick!
Yes, HURIDOCS has published a series of human rights standards for bibliographic information available below, but this was in 1985 and the world has moved on since then. The internet didn't even exist at the time! So, if you have some serious energy to devote to this, and think we should get a task force going on this, lets talk! http://books.google.com/books?id=37h_3KBm9uoC
HURIDOCS also put together 48 controlled vocabularies, the most important of which is the first one, a set of general index terms. But these are currently static, locked into PDF which hasn't changed since 2001. And again, the world changes and new terms need to be added. For example, the Witness vocabulary includes the term "rendition", which is of fairly recent use. This vocabulary needs to be alive. http://books.google.com/books?id=eUxo7yIUHRAC
So we're working on an online thesauri builder. People will be able to download the latest vocabularies in whatever format they need: PDF, SKOS, spreadsheet, etc. But more importantly, they will be able to sign up and add terms, or even whole vocabularies, so we can keep this up to date collaboratively. We could add the UNHCR refugee thesaurus, and others. If you are working on a thesaurus, you can add it and use the system to get comments.
Personally, I think that these general index terms will have enormous value in today's internet age, to automatically feed together information from various websites into a portal. But the problem is that many don't want to use certain standard terms, but their own preferred terms. For example, some don't like latin terms like "infanticide" or "ne bis in idem", preferring English equivalents. And thats fine. But it makes systematic information exchange difficult.
So I see the potential for online systems to connect these different equivalent terms and translations for the same thing, and map them to an international standard term, so all these documents can be accessible through search engines and portals. So if you search for "ninos", you also get "children", and vice versa. So we can find each others documents, even if we use different terms and speak different languages.
Daniel D'Esposito, HURIDOCS
Atom
Patrick, as an archivist, did you ever use Atom?
http://ica-atom.org/
Daniel D'Esposito, HURIDOCS
When systematizing happens w/ documentation? + video as data
Thanks Patrick.
I'd tend to agree that the boundary between formal and informal documentation is the systematic nature. The question for me is how much we ground this 'systematic' nature at the point of direct gathering/documentation vs at the organizing moment, especially with increasing quantities of non-NGO documentation/quasi-documentation of human rights violations or testimonies.There are already a number of examples of documentation that rely more on organizing data in the moment rather than gathering it: e.g media monitoring as an approach to documentation (as Daniel D'Esposito cites); or is also the case in the real-time documentation apps that Nathan is referencing such as Ushahidi/Swiftriver. I think we are potentially about to be confronted by new organizing challenges of data that we don't yet deal with. AT WITNESS the skillset we think about for human rights advocates now stretches from how to aggregate/foster/curate others' human rights video, through how to use it in evidence, to creating NGO driven targeted advocacy videos, as well as increasingly how to use it in real-time mobilizing contexts.
In terms of how we think about how video contributes to larger, more systematic efforts of analysis and advocacy....
On the one hand, there is certainly already an established usage of videos as emblematic stories that represent complex patterns of abuse that the quantitative data has identified - an example from WITNESS' work would be something like the video Dual Injustice, that uses an emblematic story of one woman's disappearance in Ciudad Juarez and the arrest and torture of her cousin to confess to her murder to present a narrative that reflects multiple other cases of feminicide/police torture and misconduct. Another example might be a judicial case submission that uses some sample stories to reflect a broader pattern - which we've done in cases with the Inter-American Commission and African Commission.
The aspect that you are getting at, and that I think is more germane to our discussion is whether quantity of video data can contribute to large-scale systematic efforts. My sense is that the raw data value of video is not fully realized: most storing, coding and analyzing of video relies on tagging it with a thesaurus (WITNESS uses a modified version of the HURIDOCS thesaurus). The challenge for video is how to represent the quantitative/data aspects of video without reducing it back down simply to numbers/relationships that might have as well originated in another format (e.g an interview documentation), and losing the qualitative values of video as a witnessing medium.
In this light, the most (moderately) successful experiments in this regard have been mapping exercises such as the Google Earth layers experimentation in Darfur where video/photos are left as video/photos, and via a visual interface the scale/scope of a problem is shown and reflects the widespread nature of a human rights crisis.
It seems a pity if we cannot find a way to incorporate this real-time data and citizen documentation (I'd distinguish them, though they often overlap) effectively into our work as baseline documentation as well as advocacy and mobilizing materials. I think we're making progress with new platforms like Ushahidi, though there is a lot further to go on the visual documentation/advocacy side.
Sam Gregory, Program Director, WITNESS (www.witness.org/hub.witness.org)
Resources to help us answer 'what is documentation'
In preparation for this dialogue, I have come across many great resources to help us identify what documentation is, and how it relates to human rights.
In chapter 1.1 Purpose and definition of an information management system, Patrick explains, "As you can see from the preceding examples, the term 'information management system' implies more than a computer database. Rather, it suggests an integrated system through which an organization collects data, organizes it, puts it somewhere, and then analyzes it. A good paper filing system is always an important component of the system, whether or not an organization uses computers. Good information management can be done without computers. We talk of an information management system in order to highlight the whole process by which an organization obtains and analyzes information." Four steps of an information management system:
In chapter 1.2 Why use a formal system for information management?, Patrick explains,
"The information management system gives the organization a way to accumulate many individuals' systematic efforts. Thus the organization's memory can slowly grow to be greater than any of its member's memories." An information management system, if done correctly, is also important for human rights work in that it helps us to see relationships between events - and trends.
This document points out right away that 'documentation' means different things to different people. Some see 'documentation' as the collection of documents (like a documentation centre). Others think of 'documentation' as the "act of recording the results of an investigation, inquiry, research or similar activity." These two types of 'documentation' can be considered: library-type of documentation (collection of docs) and the documentation of events (recording info on ongoing or recent events).
Documentation is a process consisting of several activities, namely:
Documentation could also mean a specific part of this process. Thus, documentation could refer to the act of recording information, or the act of collecting and organising documents. [taken from 'What is Documentation']
Judith Dueck, the Vice-President of HURIDOCS, gave a presentation on human rights documentation in 2009 at the Soul of the New Machine conference in Berkeley, California. This is a link to a 5 minute introduction to the growth of the human rights documentation field with a few great personal stories.
Kristin Antin, New Tactics Online Community Builder
Thanks for Patrick Ball's book
Kristin, thank you for the 'Who Did What to Whom?' book!
In October 2009 I've read the HURIDOCS books before developing a prototype of a new version of the OpenEvSys system. The prototype is online (screencasts, working demo) and described in this paper. At that time I was feeling that I don't have enough "expertise glue" to nicely stick toghether two pieces: "Documenting Violations" & "Informations Systems". I think that Patrick Ball's book can help me find this magick glue and is a must read for an IT developer. Once again thanks for the link!
Oleg Burlaca
--- How to determine what kinds of information to collect?
Under this main theme, please discuss these kinds of questions:
Where does one start?
With so much information, and so little resources, where does a human rights organization start when trying to determine what kinds of information they should collect?
I did a little homework and found some good information in the 'What is Documentation' guide. The guide lists four aspects of determing what kind of info to collect:
Can you share any examples of what this process looks like? This seems pretty straight-forward, but I am sure it is not as easy as it seems...
Kristin Antin, New Tactics Online Community Builder
Where does one start?
Good question.
In my view, a useful tool is the chicken analogy: input, processing, output and dissemination. And the place to start is at the end of the cycle, with your organisational goals and stategies, your organisation strenths and weaknesses, the contextual constraints and opportunities. This gives you the overall picture of what information you need for your stratagies, why you need this information, and what you can realistically expect to collect. And you work your way back from there.
Documentation is resource-intensive, and monitoring is usually a long term activity. So its important to pack your bag as if you're on a marathon, and not a short term sprint. Any excess activity will weigh you down over the long term, and you'll inevitably start to shed information collection that is not truly essential to your strategies, or work in partnership with others who are already collecting this information, or resorting to more efficient tools such as online storage and collaboration. You can talk of information economy, or cost benefit analysis, to make sure you are investing your resources wisely.
So the starting questions could be:
A couple of other useful diagrams for planning documentation, kindly reproduced by Tom Longley from Tactical Tech:
ICRC's double cycle and Manuel Guzman's documentation cycle.
Daniel D'Esposito, HURIDOCS
Where does one start?
Thanks for such nice intro, Kristin.
Users' needs analysis:
Sure, it's a definitely a place to start with. Properly designed IS have to start with users needs, but every time I ask: "OK, tell me what you need?" I get 2 kinds of answers.
As we all know, the solution for this problem is quite simple - ask user to put it on the paper. However, even then the result is far from perfect. In most cases, we need to "predict" future needs and as you may guess, it's a kind of "black magic", and it's definitely a problem. IMHO, it's good to have at least one person with minimum 10 years of practice in the area of analysis and design of Information systems.
Back in 1992, when the War in Bosnia just started, we build our first version of database application in order to keep track of war crimes committed. After one year we realized serious problem with our database: we didn't predict the occurrence of concentration camps and mass graves!!
Today, using data from RDC (and thanks to "Google Earth" and cheap GPS device), I made this.
Only few years ago, was there anyone who could predict this? Definitely no, but as Daniel pointed with 2 diagrams representing development cycles, we are doomed to constantly re-define our goals.
Determination of the possible sources of information:
The sources stated in the "What is Documentation" guide are good examples of possible sources. However, it's interesting that some sources which we consider standard and well-known in some countries are treated differently in other countries. In June 2008 we conducted "Training on the Information System for Human Rights Organisations" so I had a chance to share ideas and experiences with people from 7-8 countries. Here are the examples:
-Obituaries.
In the Balkans region it's a practice to publish obituaries in local papers. I believe that people publish obituaries all over the world, but in the Balkans (Bosnia & Herzegovina, Serbia, Croatia, Kosovo...) families of the deceased are particularly concerned about this issue. So, if we believe that one person was killed on specific date, the chances are good that we can find obituary in local papers. Kind of press clipping focused on last pages in the papers. It was important source for "Human Loses" project in Bosnia & Herzegovina. More info about this project is here (it's Bosnian language, but google translate will do the job)
- religious institutions
If one can get books from church or mosque, consider this as a quite reliable source. After all, if there is a dead person, there must be some kind of priest, right?
- monuments and memorial sites, cemeteries
If the name has been carved into a stone, it has to be reliable.
- collecting living memories of the war through oral history-based research
- war crimes trial monitoring
There is even more, but I can't recall ...
The rule is: there is no rule, search for your data everywhere!
Well, enough for my first post here ;-)
Kenan Zahirovic, MCITP
Many many possible sources of information...
Thank you, Kenan, for contributing to this dialogue! What a great list of addition sources of information...it would be great to hear from even more practitioners out there on more types of sources for information on human rights violations.
From my brief experience attempting to create an information management system in Uganda, I can completely relate to the challenges around having the user write down on paper their needs for information/data. The more people involved in the data collection, the more complex it can become! Each person brings their own list of data points to be collected.
Another important source of information is the treatment/rehabilitation center working with survivors of human rights violations (such as torture treatment centers). These organizations are often vital to documenting violations, but the documentation is not the primary reason for these types of organizations. Their primary focus is on the treatment of their clients, as it should be. How can data collection focused organizations like HURIDOCS and Benetech partner with these types of organizations to assist them in their data collection needs?
If you work at a treatment/rehabilitation center - it would be great to hear about your organization's data collection priorities and also how you use the data that has been collected.
Kristin Antin, New Tactics Online Community Builder
start in the middle
I think one of the factors that upsets this framework is that people involved in documentation projects usually start thinking through how to do it systematically after a significant amount of ad-hoc work has already been carried out. So the framework provided by Kristin and others is helpful, but people involved are stuck with the dilemma of what to do with existing processes and existing data. So I would add two steps - first to conduct an assessment of what has already been collected and how it is being stored, and then somewhere in the middle or end - make recommendations for incorporating the existing data into the new system.
Patrick J. Pierce
Head, Burma Program
International Center for Transitional Justice
10 point plan...
Below is a 10-point plan that we use to structure our training of human rights NGOs in Iraq... We will have the whole manual reday in English and Arabic for public use soon. Where can we post it?
Perhaps this brief outline will be of use for some...
Overview of ten-step plan for human rights research and advocacy
There is no single way to do professional human rights research. However, certain steps are necessary. The following is an outline of ten key steps that take you from the identification of a problem through research, analysis, report writing advocacy and subsequent planning.
Daniel Rothenberg
Managing Director of International Projects
International Human Rights Law Institute
DePaul University College of Law
Chicago, IL USA
Sharing documentation resources on the New Tactics website
Thanks for sharing this great training resource, Daniel! Looks like a good plan of action for practitioners.
You and all of our online community members are welcome to share any documents, videos, images, links, and conversations in our 'Documenting Violations' group space! Please join the group and add your resources. You can also use this space to keep in touch with documentation practitioners. I hope you'll find it useful!
Kristin Antin, New Tactics Online Community Builder
--- What are the ways to acquire, store & organize information?
Under this main theme, please discuss these kinds of questions:
documentation goals? How is technology helping to solve real world
problems?
Moving to a realtime operation model
With the increased implementations of crisis mapping tools, we are seeing the emergency of a "Realtime" acquisition and analysis of data about human rights violations. Rather than focus on detective research after the fact, those interested in protecting populations at risk must now move into more of a operational center model of tracking, vetting, organizing and disseminating data as it is happening, with the dual goal of getting to the truth of what is happening at that moment, while also doing what you can to stop a tragedy before it can escalate.
Obviously, realtime tools will not always be applicable for every case, especially with long term violations related to the environment, sexual crimes or corruption.
I don't want to get into a discussion of the quality of this new type of data collection model here, more I just want to represent that this new model exists, whether we like it or not, and all of the questions asked in this thread, must also take into account the fact that people who are suffering violations may be reporting about them directly, in 140 character chunks, with questionable authenticity and quality. What we are still figuring out is, how and when to respond to this, and where does it fit within all of the other tools which exist.
Nathan Freitas, the Guardian Project
re, Moving to a realtime operation model
Good point, Nathan! I trust many of us are familiar with Ushahidi.
Could you give some more examples of recent-ongoing "realtime" projects for communicating violations?
Bert Verstappen, Programme Coordinator at the Human Rights Information and Documentation Systems, International (HURIDOCS)
Examples of realtime data collection / using new technologies
Hi Nathan and Bert,
I wanted to share a few good examples of realtime data collection tactics that have been mentioned in a few of our previous dialogues.
From our dialogue on Geo-mapping for human rights, the Ushahidi example that was mentioned was that of their work in post-election Kenya. Ushahidi called on Kenyans to text in the locations of current acts of violence. This data allowed Ushahidi to create and disseminate a dynamic real-time geo-map of the violence taking place throughout Kenya. The data also served as a 'place-holder' for journalists and human rights workers to follow-up with the reports to further investigate and document the situation. (Also included in the Ushahidi example in the Geo-mapping dialogue is a mention to the use of satellite imagery to document evidence human rights violations -- visually.)
Ushahidi is currently working on a realtime map for Haiti to visualize incidents of emergencies, threats, vital lines, and response locations.
Another interesting example that I think we are all familiar with at this point is that of using mobile phones to collect data on election monitoring. This example has been shared in our dialogue on Election Monitoring. This example comes from Kenya, again regarding the 2007 elections. A collaboration of NGOs encouraged citizens to become their own journalists and activists by sending, via mobile phone, information on violations at polling stations. What they received were images of police brutality and instances of violence targeting opposition supporters.
I think that the ues of mobiles phone to collect information on violations is a promising tool for all the reasons that Nathan points out. Will it always, in your opinion, require the follow-up investigation work of documentation workers on the ground? Are there successful models of this practice being used today?
Kristin Antin, New Tactics Online Community Builder
Moving from 2D to 3D
My two cents: I think that GoogleMaps or OpenLayers (the technology behind ushahidi.com) would be enough for HR geo-mapping needs, but you already can go 3D using GoogleEarth. You may find interesting the following links:
Stunning Examples of Data Visualization in Google Earth
KML Screenshots from Google Earth
Notice that the visualization may be dynamic, i.e. animated.
Oleg Burlaca
A few more thoughts on mobile technology
The use of mobile phones to capture real-time information on the ground is indeed exciting – the ability to immediately record in words, photo or video information about a human rights violation and communicate that instantaneously is powerful, especially when we consider that that person may be otherwise limited in their ability to gather and share that knowledge.
However, I think that the use of mobile technology will never remove the need for more traditional human rights documentation gathered ‘on the ground’. Although they can complement one another, mobile technology meets a different need than qualitative human rights documentation. A 140 character SMS from someone experiencing or witnessing a human rights violation is likely to have very different information density and quality than an interview with that individual, even if that interview is conducted some time after the incident occurs. SMS provides thin,immediate knowledge/alert of an incident, while the interview may provide more information answering our questions of Who Did What to Whom, When, Where and How.
As a technology tool, it is also affected by certain key limitations – for example, it is not a practical tool in areas where there is limited to no cell phone reception. If we rely solely on mobile tech data, we might interpret that the situation is very bad in urban Area A which has multiple reports via mobile phones, and stable in rural Area B which has no reports. Is the situation really better in Area B? Or is there simply no cell phone reception in Area B? Or is it both? From the information, we can't be sure.
Another application of mobile tech that needs to be done carefully is the mapping of mobile tech data. In a map where it appears that there are several incidents in a given area, depending on the quality of the data itself, it may be impossible to say whether each report was about a different incident or whether several people saw and reported the same high profile incident. Because a map is a statistical product, this becomes a problem in the same way it would for statistics – how can we remove multiple reports of the same incident? The SMS data may be too thin for us to address this issue at all.
I think that as the human rights community explores what is possible with mobile technology, we must balance its immense advantages with these limitations.
Vijaya (Jaya) Tripathi, Benetech
Mobiles as documentation recorders as well as transmitters
I think Vijaya's right about the potential limitations of mobiles as real-time reporting tools (both for thin-ness of data in SMS, as well as bandwidth/reception limitations that prevent transmission and skew information received ). But if we think of mobiles as recording devices in and of themselves, not just sharing/communication devices - e.g. audio/video, then they radically expand the number of potential documentors, particularly in contexts of limited literacy; as well as in situations where the real-time documentation may be less important. And there's no reason an interview recorded on a mobile can't be as detailed as a 10 minute interview (or whatever memory is on mobile) conducted via another means.
Nathan - can you talk to safety/security of documentation and the possibilities of mobiles to facilitate this?
Sam Gregory, Program Director, WITNESS (www.witness.org/hub.witness.org)
How mobiles can facilitate the safety/security of documentation
This is in response to Sam's question about how mobile technology might improve the security of data and the safety of those documenting or being documented.
I'm going to brainstorm a bit here, to try to expand some of my ideas on this topic beyond the specific work I am already engaged in. So, here goes...
Those are just a few possibilities off the top of my head of ways in which mobile phones might provide for more security of data, and increase the safety of those doing the good work of documenting. I would love to see others contribute more ideas, challenge my assumptions or find flaws in their approach to security, or provide additional case studies that might benefit from a bit of crypto creativity applied to them.
Nathan Freitas, the Guardian Project
Keyparis, OTPs, keyfiles
Hi Nathan, nice to meet you!
"A mobile phone can be used as a "something you have" in a two-factor security system, more specifically an application on the phone can generate one time passwords for use in a system like Martus or another tool that requires more than a simple password."
This is something really useful for us: an system that sends an OTP to a user as a second line of security. I like it because its simple, and people usually have mobile phones, it doesn't involve hardware like tokens. Is this hard to implement? Can such messages be intercepted? I can imagine that if you start receiving OTPs you didn't ask for, you'll know your system is compromised and the sysadmin can quickly lock it down. What about if the system prints out a PDF with a table containing 100 OTPs, that the user can store in his or her wallet? What is safer?
What about a system using a ditigal object, like Martus keypair? Truecrypt offers a simpler alternative, in the form of keyfiles, which can be anything.... an MP3, a picture of your cat, that you carry on a USB. That seems really inconscicous to me. Is that hard to implement? What do you think of keyfiles in comparison with other "what you have" security systems.
Could you also tell us more about your work on these projects with students at NYU, like the elections monitoring? Are you looking for projects to dig in to?
Many thanks,
Daniel D'Esposito, HURIDOCS
Mobiles as Authentication Tools
>Hi Nathan, nice to meet you!
Great to meet and read become acquainted with your work through this dialogue, Daniel.
>it doesn't involve hardware like tokens. Is this hard to >implement? Can such messages be intercepted? I can >imagine that if you start receiving OTPs you didn't ask for,
OTP over SMS is pretty common actually, along with simple mobile phone apps that can replace hardware tokens. It has its issues, but it can work if implemented properly.
http://en.wikipedia.org/wiki/One-time_password#OTP_over_SMS
http://www.verisign.com/authentication/consumer-authentication/two-factor-authentication/index.html
>PDF with a table containing 100 OTPs, that the user can >store in his or her wallet? What is safer?
Wow, "One Time Pads" - that is very retro of you (http://en.wikipedia.org/wiki/One-time_pad), but it is also very, very secure. As long as you have a way of secure physically transmitting the new set of passwords on a regular basis this can be the ultimate in authorization and encryption.
>keyfiles in comparison with other "what you have" security >systems.
I am not a fan of keyfiles, because they tend to get misplaced. However, they are better than weak passwords, as long as you have a way centrally for them to be expired.
>Could you also tell us more about your work on these >projects with students at NYU, like the elections >monitoring? Are you looking for projects to dig in to?
I taught last semester at NYU's Interactive Telecommunications Program (ITP), where Clay Shirky is a full-time instructor. ITP had been around for thirty years, with more of an art bent, but slowly they've been awaking to the design, technology and social challenges of activism and humanitarian efforts, mostly due to Clay's guidance and presence. He taught another class this last Fall in partnership with UNICEF, focused on technology design challenges for IDP camps.
I was invited by the department chair to create a new course (which we ended up calling "Social Activism using Mobile Technology"), with the goal of bringing my hands-on, real life experiences into a program that has been pretty theoretical in the past. The course featured case studies of recent use of mobile technology (from Iran to Obama), guest speakers (in person and via Skype) and required team projects focused on using mobile technology to improve a social condition, whether it was in the local neighborhood or at a global level. You can see some of what was presented through my site at: http://openideals.com/itp2800
There were twenty students, and the final projects were all very successful. They ranged from iPhone apps to assist in suicide prevention training, to Google Voice for Homeless populations (free lifetime phone numbers!), and Project NOAH - a geo-bio tracking system for smartphones that plugs into the Encyclopedia of Life project. I will hopefully be teaching it again next Fall, and would love to connect with anyone on this list who'd like to propose projects, or collaborate in some other way.
Nathan Freitas, the Guardian Project
Thanks, thats very very very
Thanks, thats very very very useful!
I'm sure we'll be in touch. We have a lot of ideas and projects, and we need your experience on all the areas you've mentioned. I got your email from your blog.
Daniel D'Esposito, HURIDOCS
Response to Thoughts on Mobile Technology
Just a few thoughts in response to your excellent introduction on this topic.
>However, I think that the use of mobile technology will >never remove the need for more traditional human rights >documentation gathered ‘on the ground’. Although they can >complement one another, mobile technology meets a >different need than qualitative human rights documentation.
I think the role of mobile technology today within HR documentation work is in more of an either or. The mobile is seen as a low-end, limited text-oriented device that members of a population may own, and can use to self-document violations against themselves. In addition, a mobile is seen as something that requires an always available GSM connection to function.
>A 140 character SMS from someone experiencing or >witnessing a human rights violation is likely to have very >different information density and quality than an interview >with that individual, even if that interview is conducted some
I agree with this point, within the definition of mobile device that I laid out in my previous paragraph. The issue I have is that the more in depth interview with an individual could also occur on a mobile device, albeit a more sophisticated one, or perhaps, through a mobile phone call that was tied into a more sophisticated back end system.
I was one of the developers involved in TwitterVoteReport (http://twittervotereport.com), an Ushahidi-like system that was developed in Nov 2008 to provide realtime election monitoring by US citizens of their own election. It was a "People's Monitoring System" by, for, and of, all powered by mobile devices of many different varieties. We, of course, provided a baseline SMS number and Twitter interface that anyone could text a report into from a polling place, ideally using a basic set of tags to help indicate what they were reporting about (wait time, ID card issues, broken machines, etc).
We also provided interactive voice systems in English and Spanish that allowed the user to select menu items to provide more automatically structured information, as well as leave a voice audio message.
Finally, we released iPhone and Android applications which provided the most high fidelity and media rich tool for reporting on the election. The apps would automatically find the user's GPS, linking their report to the nearest polling place. The apps also provided a rich form with a variety of slider widgets and checkbox options to visual present a way to quickly enter data with one finger. Most importantly, the apps provided a way to record audio, video and take photos. All of this data was wrapped into a bundle and uploaded to the VoteReport server databases (Ruby on Rails, MySQL based).
As the election reports began rolling from east to west throughout the day, it was fascinating to see how different geographic and demographic areas corresponded with means of report. It was more evenly distributed than we expected, but there was also a definite increases of smartphone app usage on the west and east costs. I expect that if we deployed this same tool today, we'd see a much wider use of iPhone and Android across the country, due to the $99 price point of these devices and easy availability through Walmart and Best Buy.
My point with all this is to lay out how we are beginning to see the evolution of reporting beyond 140 character SMS, and I think people int he HRV documentation arena should be prepared for this, and in fact encouraging it by utilizing pilot/seed hardware whenever possible.
>limitations – for example, it is not a practical tool in areas >where there is limited to no cell phone reception. If we rely
The need for active, available cell phone reception is one that Java phones, both Nokia/J2ME and more sophisticated smartphones, particularly Android-based devices are beginning to be able to address. The key is to support "offline mode", in other words local databases on the device. My brother is currently working in Haiti using his Droid device without an active network (no Verizon in PaP). However the device is still immensely useful to its GPS, offline OpenStreetMap support, high resolution camera, multitude of applications, long battery life, strong construction, and so on. It is much more suited than a laptop, video camera or just about any other larger bulkier device in that situation. In addition, because it is an open platform, it can be completely customized to provide all the functions he needs to complete the work while he is there in the field. Once the data is captured, he can then upload to a database/server when he can find wifi or a 3G network... with my brother, as soon as he gets back to the Dominican Republic, he will have Verizon service again, and can transmit the data he has captured.
>I think that as the human rights community explores what is >possible with mobile technology, we must balance its >immense advantages with these limitations.
In closing, I do commend and agree with a sober attitude towards the adoption of new technology, as long as it is paired with a fairly dynamic, informed awareness of all the possibilities that rapidly evolving mobile technology provides.
Nathan Freitas, the Guardian Project
Android and iPhone apps
Wow, am really amazed by this!
"Finally, we released iPhone and Android applications which provided the
most high fidelity and media rich tool for reporting on the election.
The apps would automatically find the user's GPS, linking their report
to the nearest polling place. The apps also provided a rich form with a
variety of slider widgets and checkbox options to visual present a way
to quickly enter data with one finger. Most importantly, the apps
provided a way to record audio, video and take photos."
Could you tell us more about this project? Do you have a case study or somthing similar? What was involved in developing the android and iphone apps? Do you have screenshots of these? I tried to download the iphone app, but its not available in the Swiss app store.
I was chatting about this with a friend from ANFREL, an NGO that monitors elections across Asia. He was pretty excited, its exactly the kind of thing they need. So don't be surprised if you get an email from them.
I am also thinking that we may need an iPhone app to interact with a database we're planning for litigators, called Casebox, which would be a bit like Basecamp (we'd use Open Atrium as a code base). This would allow a litigation NGO to store and collaborate on case documents, manage court deadlines, access caselaw databases, and so on.
The iPad (or Android tablet) would be a great way of accessing this database on the move, because its more secure than a PC (no keyloggers in the app store) and very affordable too.The manager of a litigation NGO could work via wifi in the court room, review cases and deadlines, pull out a copy of a key affidavit and forward it by email, make comments by email, and even look up the lawyer in charge and call him or her directly from the iPad via skypeout or a similar Voip app. What do you think?
Daniel D'Esposito, HURIDOCS
VoteReport Case Study
Case studies of VoteReport, and its more light-hearted sequel "Inauguration Report", are available at: http://www.centerforsocialmedia.org/resources/publications/public_media_20_field_report_building_social_media_infrastructure_to_engage/
Source code the Android application is available through my site here: http://openideals.com/guardian/greporter/
While I am a huge fan of Ushahidi, in many ways I feel the richness of the VoteReport engine, both for input methods and output rendering (widgets, maps, charts, multimedia support), was far superior. However, Ushahidi proved that dedication, persistence and organization trump short-term feature richness when it comes to open-source project development.
Regarding Casebox, you should check out the open-source issue/project management system called RedMine - http://redmine.org. It is a fine open-source replacement for Basecamp, and supports wikis, forums, and more. In addition, there are a number of iPhone apps and mobile web interfaces under development. You can secure Redmine hosting through SSL certificates (client and server) as well as IP filtering, or even using a VPN.
Nathan Freitas, the Guardian Project
Limitations on reception
Hi Nathan,
With regards to limitations with reception another aspect that is useful about samrt phones is their possibility to trasnmit info via wireless network.
One could record events like a protest and then do a data dump near a building with an open wireless network.
Moreover one could set up a wireless hub/server in the back of a car even if unconenected to internet. It would allow local phones to talk to each other, store data in server to be latter uploaded to internet in data dump site.
I think this is all feasible.
Fernando
Acquiring, Storing and Making use of information
Since I'm very new to human rights domain (since August 2009), I've decided to lurk around before making a post.
As pointed out, there are 3 steps:
If we summarize what have been said today, almost all messages are about the Acquiring stage. I completely agree that it's the most important step and it's very hard to create a successfull software product without having a background in human rights violations. HRV is not accounting and even if you (as an IT developer) have this background, it's hard build a flexible product because the requirements may be fuzzy.
What I'd like to see is an online aggregation facility of HRV projects. A project is composed of: problem statement, a list of tools that were used, the challenges, the tradeoffs and some use cases. A use case shows a specific solution to a specific problem, for example: how the 'who did what to whom' methodology was used to document a specific event. The idea behind such a resource is to have a complete list of available software for the HRV domain and what kind of problems these software is solving and how.
When Jana Asher said about "quantitative and qualitative documentation", I recall the idea to use OpenCalais to automatically extract “who, what, where and when.” information out of articles published on OMCT. Almost all articles on the OMCT website is about HRV. The fact that the results of applying the 'who did what to whom' methodology is similar to what OpenCalais can do, what if we automatically process a big dataset (a collection of articles) and build a database of entities and relationships ?! For example, we can extract the names of the persons (and eventually their age) that were mentioned in an article, how these persons connect (Person1 killed Person2), what actions have been commited against a person etc, the location of the event etc etc. Here is the result of processing this page using Calais Viewer. You may read how Calais works and an article about OpenCalais. I fully understand that such approach may not yield very accurate data, but it can help a lot if you quickly want to see the "forest, or an aerial snapshot of the big picture" as Jana said. This might be a complementary tool along with OpenEvSys from HURIDOCS for example.
Oleg Burlaca
+1 for OpenCalais
I agree... automated semantic analysis of data using tools such as OpenCalais both during and after a crisis, can be very helpful in seeing the situation from new angles. In addition, HRV data should be infused with as much semantic data as it is captured, via microformats and via platforms such as Semantic MediaWiki.
Excellent point and post, Oleg!
Nathan Freitas, the Guardian Project
Semantic data improves interoperability&exchangeability
Using widely accepted(and well maintained) thesauri for recording HRV into a computer system, infusing with as much semantic data as Nathan mentioned, will help us in the future when organizations that deal with HRV will need to exchange information, or maybe when the need for an aggregation service will appear (automatically collecting information from many repositories). By the way, how many organizations in the world are using software to record HRV? How big are their databases in terms of the total number of acts of violence for ex? Can we cluster these repositories by domain? Probably ESCR (Economic, Social and Cultural Rights) and PC (Political & Civil) are two clusters.
I'm talking here about the need to use the same "language" accross HRV organizations.
This infusion mentioned by Nathan can be inline or as a complementary afterthought. By 'inline' I mean the use of microformats to modify the content of a testimonial or an urgent appeal for ex. The 'complementary afterthought' is a well structured&interconnected 'translation' of a free text (the automated approach to use OpenCalais is such an afterthought).
I've tried to make a mash-up of terms: microformats + HRV + geo mapping. The result was the discovery of http://chicago.everyblock.com/crime/ website. This website was mentioned in the book Microformats -empowering your markup for Web 2.0. You can download the the chapter on the GEO and ADR microformats to get an idea.
Imagine we have X organizations in Kenya and Y in Brazil that record HRV. How can we automatically extract violations from X+Y databases according to some criterias (acts of torture for ex.) if every organizations speaks it's own language (custom made thesauri) ?
Oleg Burlaca
Martus - free, open source, secure information management tool
One of the tools available for those documenting human rights is Martus (Greek for ‘witness’), a free and open source secure information management tool developed by the Benetech Human Rights Program .
We developed Martus because after years of working on human rights data analysis projects, we felt there was a need for an easy-to-use encryption tool as well as an information management solution for the human rights community. We designed Martus based on feedback from our project partners, and since 2003 have provided Martus outreach and support to users around the world, and continued releasing new versions of Martus.
Here’s how it works:
Martus is used by organizations around the world to document human rights abuses, protect sensitive information and shield the identity of victims or witnesses who provide testimony on human rights abuses.
You can read more about Martus and download the software here
Martus is just one of the resources available, however, and it’s not necessarily right for every individual or every organization. We always encourage people to try out the demo and think through their project needs and resources when they are considering whether to use Martus for their information management project. A given organization’s information management and security needs may well change over its lifetime as well, so that Martus may be right for it when it starts out but not a few years down the road – or vice versa. We’re always available to advise during the process of deciding what the correct tool is.
Vijaya (Jaya) Tripathi, Benetech
Analyzer
Hi Vijaya, what about Analyzer?
Can you let us know a little more about this Benetech tool? How is it to be used, what can you do with it exactly? And how can you import data from Martus? I guess you still have to go through each bulletin manually to extract the information on acts, victims, perps, and so on. Is this how it works?
Patrick Ball says you're updating it as a web app, any progress in this or screenshots to share? Would love to know!
Daniel D'Esposito, HURIDOCS
What is the relationship between Benetech and HURIDOCS?
Hi Jaya, Daniel and others,
I would be curious to know more about the relationship between HURIDOCS and Benetech since there seems to be overlap of your work - specifically regarding the OpenEvSys database and the Martus database. Do you envision the two database systems becoming one system in order to pool resources for maintenance, support, training, etc? Or, on the other hand, has it been a strategic decision to keep the two systems seperate because it is important for practitioners to have a number of options for their documentation work? Thanks for this interesting discussion, everyone!
Kristin Antin, New Tactics Online Community Builder
What tool for what purpose?
Thanks for the question, Kristin.
Simply put, Benetech's Martus and our OpenEvsys are two tools dealing with the same challenge of documenting violations, but in different ways.
http://martus.org/
http://openevsys.org/
Martus is above all about security, about locking your data in an encrypted safe on your computer, and exporting it easily to an out-of-country internet server. Once you're inside the safe, Martus allows you to set up record these violations using free-text fields and attachments, and also to categorize your stories about violations, and you can then retrieve them by searching these fields. So its very much for qualitative work: you enter your stories, and then you can search and retrieve them efficiently, like a library system.
I thiink Martus is a very good tool for use in countries with very repressive regimes, where you and your sources can get into serious trouble if your data is found.
OpenEvsys is different, in that you can also record in as much detail as needed what happens inside these stories. You can record violations, link them to the victims, and the perpetrators, and the sources. Its a fully relational system, so you only enter perpetrator X once, and then you link perpetrator to all the acts that he or she has committed, in all your stories, and then you can get a "bio" of all the acts that perpetrator has committed.
You can even set specific fields for certain violations: for example for torture, in addition to generic fields like place and date, it has fields about whether a confession was forced. Or for house destructions, the value of the property.
Like Martus, with OpenEvsys you can then retrieve the stories according to the fields you chose to use. But you can also get a much more fine-grained analysis of your data, such as how many acts of torture committed by the police in 2008, then do a breakdown by province, or a time series analysis, and then get an analysis of the victims by gender, ethnicity, religion, political affiliation, and so on.
If you want to check it out, you'll find an online demo here. We're still finetuning the advanced search, should be ready in a couple of weeks.
http://openevsys.org/
You can also record interventions, their status and impact and so on, which is useful for NGOs that provide legal or medical aid.
So it depends on what you want to do. I think Martus is a great, rock-solid tool, I've tried it out and noted its progression in terms of how you can add your own fields. Both Martus and OpenEvsys are flexible and can be adapted by the end-user. Its a question of the right tool for the right purpose, to seek advice, to read the manuals, and take the time to really understand your needs before choosing.
Documentation is a like a trekking: its going to be a long enough slog anyway, so at least make sure you have the right shoes!
Some organisations have developed their own systems, like Karapatan in the Philippines.
http://code.google.com/p/karapatan-monitor/
One problem NGOs face is the "black box" syndrome. They spend a lot of time entering data, and its stays in the black box, and its never really put to use. Or a lot of time is spent extracting data, making graphs and tables, and pasting it into reports. This should be more efficient.
To solve this problem, I see a lot of potential in web systems, that connect the organisation's website to its internal database. This will shorten the processing loop to quicker advocacy and allow more time to be spent on analysis, and less on repetitive copy-paste jobs. For example, as you enter the facts about a case, it would appear automatically on the website: the case abstract would appear in the right thematic or regional sections, and the statistical tables would be updated automatically. We are building such a system, it will come online in a few days. And we hope to build more.
But there are other generic needs as well, meaning needs that are shared by a large number of NGOs, to justify a system for all to use.
Litigators will not be fully happy with either Martus or OpenEvsys. Yes, they can create a section for a case, and store case docs and so on. But they also need to be able to assign lawyers and staff to a case (not all lawyers should see all cases), work collaboratively on the brief, discuss on forums, retrieve jurisprudence from caselaw databases, manage court deadlines, and track lawyer time spent on each case. LCM is an example, which offers some of these functions:
http://www.lcm.ngo-bg.org/en
Another area for tool development is search and intelligence, also known media monitoring although its wider than that. This involves tracking and searching a number of online sources. A subject matter specialist then reviews the results, and selects the items that are worth sharing within the organisation. These items are then disseminated via RSS feeds or email newsletters. Some very nice and free media monitoring tools already exist, such as Phase2's Tattler and Development Seed's Managing News, but there is room for a lot of development until we have something that is really powerful and easy to use.
http://managingnews.com/
http://tattlerapp.com/
In short, I don't think its a question of integrating Martus and OpenEvsys into one super-tool that will make everybody happy. That would be like having a Swiss knife with 250 blades! Complete but cumbersome and hard to maintain.
There are so many different needs, which require different tools, and thinking carefully about needs should be the starting point. In some cases, as those mentioned above, there is scope to develop a tool that will serve many. Others will need develop their own tools for very specific purposes, such as the tools that Nathan was mentioning for elections monitoring, or simply because want to experiment, which is great too. In some cases, a spreadsheet will be perfectly OK, or Google Alerts for media monitoring, or project management software like Basecamp.
Thats all fine. The important thing is to share, as much as we can, so as not to reinvent the wheel each time. We try to track all existing initiatives, so we can match a need to a solution and save people time and energy. Thats why this dialogue is so valuable for us.
Software is a very competitive area, even for free tools for nonprofits. An NGO will not use a tool unless it really matches their needs. It should provide the key functionalities, integrate well into existing work processes. It should not become an extra burden, but should make life easier. It should be the right size.
Again, the Swiss knife metaphor is useful: you have knives for campers, knives for techies, knives for sailors... each type of user must find their tool useful enough to be worth carrying in the pocket. Or it gets left in the drawer.
There is a debate between standard tools for use by all, and customized, bespoke, tailor made tools that fit a particular organisation like a glove. Of course the latter is better - this very website is a example of why custom tools are so good. But few can afford them, especially in the South. So what to do? Our previous approach was to make OpenEvsys into a 250-blade Swiss knife, but we've learned that one tool cannot make everybody happy. So our new approach is to develop custom systems for specific NGOs, and if we note that there is a generic need by many potential users, to develop them into a standard open source system for use by all.
Daniel D'Esposito, HURIDOCS
CiviCRM - a tool for case and contact management
Thanks, Daniel, for replying to my question about the difference between Martus and OpenEvSys. This is VERY helpful! And yes, I like your advice: one gigantic super-tool would be too cumbersome and hard to maintain. Having a super-tool makes it even more difficult to use these tools the ground without experts.
You mention LCM - Legal Case Management - as a good tool for litigators and I looked into it because I hadn't heard of this before. The website mentions that LCM is no longer being maintained, but that they recommend using another great option - CiviCRM.
CiviCRM is a free, libre and open source software constituent relationship management solution. CiviCRM is web-based, internationalized, and designed specifically to meet the needs of advocacy, non-profit and non-governmental groups. Integration with both Drupal and Joomla! content management systems gives you the tools to connect, communicate and activate your supporters and constituents.
Now this is a great tool for many purposes, and is FREE and open-source. Many developers maintain it, including people passionate about human rights issues. This is a tool I have been wanted to play around with for a while, so when I finally get the chance to I will be sure to check back in here and let you know how it goes!
Kristin Antin, New Tactics Online Community Builder
Yes Kristin, let me know how
Yes Kristin, let me know how it goes!
Frontline used CiviCRM as a backend database to handle their activities in defense of human rights defenders, so a lot can be done with it.
http://forum.civicrm.org/index.php?topic=2479.0
Daniel D'Esposito, HURIDOCS
Martus and OpenEvsys
Thanks very much Daniel for that thorough and helpful explanation of OpenEvsys!
As you note, Martus’ design has been built around encryption, secure sharing and automated backup features. As far as I know, OpenEvsys does not have an encryption component.
As I mentioned above in the post about the Martus software - Martus is a tool for capturing information. You can structure the information you capture in Martus by customizing the tool. Some projects do develop quite sophisticated customizations, structuring the information to facilitate advanced searching and reporting and later analytic work. And, although you can create reports and run complex searches on your data, you can only count the number of bulletins you have that meet a certain criteria (as opposed to counting how many peoplewere actually killed).
For example, you can ask Martus ‘how many bulletins do I have which have “Location = Capital City” and contain “Human rights violation = Disappearance”?’ You cannot from the number of bulletins then say ‘There were X cases of Disappearance in Capital City’. The reason for our caution in developing the reporting (andcounting) feature of Martus is that de-duplication and other important data processing steps haven’t yet been done.
At Benetech we view Martus and OpenEvsys as human rights information management tools meeting some of the same needs and some different needs, and certainly not competitors! Because of this, we don’t feel that it makes sense for the two tools to merge.
When thinking about which of these (or other) tools to use, we strongly encourage groups or individuals documenting human rights abuses to inform themselves well about each tool, and ask the following questions:
It’s always a fascinating conversation – and it’s one that we regularly have with current and potential project partners. We are always happy to talk through project goals and discuss whether Martus is the right tool with a new potential user. If you do have questions about Martus, definitely check out the links I provided in my earlier post, and feel free to email us at info [at] martus [dot] org.
Vijaya (Jaya) Tripathi, Benetech
also -
Nice Swiss Army knife analogy! That's spot on to how it feels, sometimes :)
Vijaya (Jaya) Tripathi, Benetech
We also feel that OpenEvsys
We also feel that OpenEvsys and Martus are not competitors. We often present Martus in our trainings or introductory talks, because its best to let people see all the options and make their choice.
Daniel D'Esposito, HURIDOCS
Analyzer
Hi Daniel (and everyone!)
Analyzer is a free and open source statistical database tool developed by Benetech that provides the structure required to quantify patterns of large-scale human rights abuse.
To answer your qs, Daniel - We are not ourselves developing a web app version of Analyzer, although a partner is developing a web app based on Analyzer. (We think it’s a good direction for the tool.)
It is certainly possible to import information initially captured in Martus into Analyzer, but this would require either careful coding of the information or development of an import script.
Below, I talk more about the software itself as well as the data processing core concepts that we strongly encourage all projects seeking to quantify information to consider as they develop their project. All of our Analyzer projects take these concepts/challenges into account.
From our experience, statistical projects that would benefit from using a tool like Analyzer require a considerable investment in technical development, data processing methods, and thinking about exactly what they intend to analyze. Analyzer does require asignificant commitment of training, resources, and typically, a close collaboration with us. Projects that use Analyzer tend have (or intend to have) thousands of raw documents that they need to process and analyze. Using Analyzer usually requires significant resources over multiple years, including technical database administration skills and in-depth staff training. One of our most recent Analyzer projects was with the Liberian Truth and Reconciliation Commission (see more about the project here: http://www.hrdag.org/about/liberia.shtml),and earlier projects include working with the Truth and Reconciliation Commission and the Campaign for Good Governance in Sierra Leone, member non-governmental organizations of the Human Rights Accountability Coalition(HRAC) in Sri Lanka, the Boroumand Foundation for the Promotion of Human Rights and Democracy in Iran based in Washington DC, and the Commission for Reception,Truth and Reconciliation (CAVR by its Portuguese acronym) in Timor-Leste.
Analyzer must be implemented in the context of a series of data processing steps and good practices in order to produce defensible results. As an introduction to some of the concepts behind modeling and quantifying human rights violation data, you might find “Who Did What to Whom?” (available athttp://shr.aaas.org/www/contents.html) a useful resource.
Data processing steps are needed to address several challenges involved inaccurately quantifying data about human rights violations, including: duplicate reporting by multiple sources; representing the structural complexity of human rights violations; and consistency in meaning and counting.
Here is some more information about each of these areas:
*Duplicate reporting - When projects collect testimony about human rights events, many different narratives may describe the same events. The same killing may be reported to the project by five different witnesses or sources. When trying to count the total number of abuses, it is important to go through a process called "record linkage" to identify repeated victims and violations so that they are not over-counted. To learn more, see http://www.hrdag.org/resources/source_judgment.shtml. It is important not to lose or delete duplicate reports. In fact, information for overlapping reports can be extremely valuable. We have pioneered the application of a statistical technique called Multiple Systems Estimation (MSE)(http://www.hrdag.org/resources/mult_systems_est.shtml) for human rights data analysis, which you may have heard about. MSE uses the pattern of overlap between data-gathering projects, or systems, to make inferences about how many violations were never reported to any project. We have employed MSE in human rights data analysis projects in Colombia, Guatemala, Kosovo, Peru and East Timor.
You can read more about our data analysis projects here: http://www.hrdag.org/about/projects.shtml
* Representing the structural complexity of human rights violations - There is a considerable amount of complexity (as many have mentioned in posts throughout this dialogue) that must be managed when identifying, classifying and enumerating victims and violations:
- Victims can suffer many violations;
- The violations can happen at many different times and places;
- Each violation may be committed by one or many perpetrators;
- Each perpetrator may commit one or many violations;
- People can play different roles in different events (i.e.a victim in one event may be a perpetrator in another, and vice versa).
Over simplifying this complexity distorts the statistical results. Coded information from narratives must be entered into a specially designed database (such as Analyzer) to preserve the data integrity of the stories of human rights abuses.
* Consistency in meaning - Narrative text must be "coded." Coding is the process by which raw narrative data is classified in consistent and repeatable definitions to distil the narrative elements, including witnesses, victims, perpetrators, personal information, and numbers and types of violations. (Please see http://www.hrdag.org/resources/controlled_vocab.shtml for more information about developing a controlled vocabulary – you can also refer to my other post about controlled vocabularies below.) Each project must develop a unique controlled vocabulary based on the specific nature of the information collected and the analytical objectives of the project. Included in ensuring consistency is making sure to conduct inter-rater-reliability (IRR) exercises, which measure the consistency withwhich the data entry team codes information, thereby ensuring high data quality and therefore meaningful results.
Analyzer facilitates this process through several data processing utilities as well as providing a robust model for storing theinformation once it has been processed - based on the "who did what to whom" human rights data model. See http://www.hrdag.org/resources/human_rights_data.shtml for more here.
Projects working to accurately quantify human rights violations share the core "who did what to whom" data model that is at the heart of Analyzer. However, in addition to this core information about victims, violations and perpetrators, many of our human rights projects collect a wide range of other data specific to their contexts. Trying to anticipate the needs of every human rights project would be impossible - and would lead to an amount of detail in the database that would bog down individual projects! It is important to note that because each project is different, as we build a custom extension for each one including the data fields that they need to capture.
I hope the above (very long) post is useful! Please contact us at info [at] hrdag [dot] org if you have further questions about Analyzer or these projects.
Vijaya (Jaya) Tripathi, Benetech
Thanks for the update and
Thanks for the update and explaining Martus, Vijaya.
For the record, we should also mention the HRDAG core concepts.
Analyzer, OpenEvsys and the La Red systems are all true "who did what to whom" systems, that can represent the relationships in a complex violation with several victims and so on, but Analyzer has the added advantage of being able to merge duplicate records while keeping a trace of the originals.
Here is this data model:
Taken from: http://openevsys.org/wiki/index.php/Events_Logical_Domain_Model
For those interested, the data model is explained in the Events Standard Formats manual: see page 55 I think, available on Google Books or as PDF on our website.
The Who did what to whom book makes the case for this kind of relational model over using spreadsheets, which is the only way to represent a complex human rights event, where you can have several victims, acts, pereptrators all connected to each other.
Spreadsheets seem fine at first, but you soon run into problems. They only work really well, when you have simple events : one victim, one act, one perpetrator, one source,one intervention. Because only then the relationships are clear. And also the victims must be unique: if some victims are mentioned several times in your spreadsheet, then it will be hard to count the total victims, and it will be difficult to be sure if its two persons with the same name, or the same person mentioned twice.
I am sure many are familiar with the spreadhseet problem. An example. Organisation A does litigation, and they keep their 200+ cases on a spreadsheet. One of the columns is for the lawyers attached to the case. OK, some cases have several lawyers, so the litigation coordinator stuffs the field with several names. But makes it impossible to sort the list in alphabetical order of lawyer's name, to see what cases a lawyer has! It only works if there is one lawyer per case.
So a relational system is more powerful, where you can attach several lawyers to a case, like several books in a shopping cart on Amazon or several project experts in Basecamp. Then you can easily see which case has what lawyers, and which lawyer has what cases!
For example, for OpenEvsys we also added a document entity to the data model. So you only need to upload a document once, and then you can attach it to the events or persons concerned (a testimony may related to more than one event or case).
In some cases, spreadsheets are OK. For example, if you just need to track acts, date of act, place of act, number of victims... and the identity of the victim is not essential for your project, then its OK.
In other cases, a simple one-table database can also be fine, with a combination of free text fields, date fields, drop downs, and check boxes. Such a database is very easy to build with tools like Access, and data entry is easier than with a relational model. Martus is a bit like that, you have one main table called a bulletin, and you can customize the fields.
Spreadsheets are therefore the natural competitor of database tools like OpenEvsys. Because they are easy to use at first. I'm not saying they won't work, just that its important to see the complexity of your cases, and your documentation objectives, before choosing the tool. Its good to invest time on this, before starting: ask for advice, see what others are doing. So your choice of tool will be the right one, and will serve you well.
Daniel D'Esposito, HURIDOCS
Questions about database systems and sharing data
Thank you Jaya for introducing us to the Martus database system, and thank you Daniel for sharing lots of good information on the OpenEvSys database system. For me, and maybe for others, the differences between the two database systems are still a bit fuzzy. Can someone points out the main differences between the two database options?
Do either of these database systems allow for users to share the data with others? I can see many security issues with allowing for this functionality - but I have always been curious if it is an option. For example, can a human trafficking organization in the Philippines enter their data into a secure Martus or OpenEvSys application, store the data on a secure server, and then allow access to that data by an umbrella human trafficking organization? Is this why documentation practitioners use controlled vocabulary - to be able to combine and share data from a number of sources/NGOs?
There is a consortium of torture treatment centers in the United States that share a number of common data-points. There is one organization responsible for collecting these data-points from 30+ torture treatment centers. Though I am not exactly sure what this consortium does with the data-points, I would image they are documented in a report and shared with advocacy groups in the US. Would a common documentation database allow for this kind of sharing of data less time-consuming?
Thanks!
Kristin Antin, New Tactics Online Community Builder
Securely sharing information
Vijaya (Jaya) Tripathi, Benetech
Great question, Kristin! A few quick thoughts in response -
Securely sharing information in Martus
In Martus, you can securely share information from your account to another Martus account. You have to exchange unique account information with the person you wish to send information to so that you can create a relationship in Martus identifying that user as a “Headquarters”account, or “HQ”. This terminology is not hierarchical, but rather ‘directional’- it identifies them as someone you would like to send information to. You can share every record (‘bulletin’ in Martus) you enter with that user by calling them a ‘default’, or you can authorize them on a case by case basis. You can have as many HQs as you want. You are in complete control of who receives what information. Even if someone is your default HQ, you can still choose to not authorize them to view a given bulletin.
When the bulletin is backed up to a remote Martus server, the bulletin is stored for your account’s back up purposes, and the server also notes that the bulletin should also be available for your HQs to download.
The way that your HQs view information is by logging into their Martus account and downloading (‘retrieving’ in Martus) the bulletins they have been authorized to view from the server, over a secure connection, into their own Martus account.
Your HQ could be a colleague in a field office of your organization, a contact in an umbrella human rights organization, or a journalist you trust, or anyone else that you want to share your documentation efforts with. The important thing is that you have to specifically authorize that person to view your information.
All of these operations – backing up the bulletin to a Martus server, storing the bulletin on the server, downloading it to an HQ account – happen over secure connections. The bulletin itself is also saved in an encrypted format.
Making records, or ‘bulletins’, publicly available in Martus
Martus also allows users to publish information on the Martus Search Engine website. Every time you create a bulletin in Martus, you have the choice of saving it as ‘Public’ or as ‘Private’. If you save it as ‘Private’, it’s saved in an encrypted format, and when it’s backed up to the server it’s only available to you or your authorized HQs. When you save it as ‘Public’and back it up to the Martus server, the server stores a copy for your back up purposes, and also publishes the bulletin on the Martus Search Engine website.
Please note that, unless you specifically save a bulletin as ‘Public’ and choose to back up your bulletins to a Martus server, yourbulletins will not be published!
We encourage all of our users to consider carefully what information is sensitive and should not be published prior to saving it as Public. You also have the option in Martus to ‘disable’ the creation of Public bulletins to prevent the accidental creation of Public bulletins.
You can read more about these functions in the Martus User Guide, available on the Documentation page <http://martus.org/downloads/>
Controlled vocabulary uses:
If groups that are working together develop and use a shared controlled vocabulary, that certainly goes a long way towards improving their ability to share information effectively! Collaborating Group A and Group B can then be sure that when they refer to ‘extra judicial killing’ they have, in theory, identified the same kind of act.
It's important to remember that implementing a controlled vocabulary doesn’t stop when you finish writing the definitions down and hand the manual to your coding team. What comes next is even more important! You need to make sure 1) that your definitions are comprehensive/refined enough for your coding purposes, and 2) that your coding team applies the definitions consistently and agrees in their understanding of each term.
At HRDAG we’ve learned the importance of these two steps through our large scale data analysis projects, several of which have required the development of controlled vocabulary and this kind of follow up. I’ll talk a bit more about each of these steps in another post.
Best,
Vijaya (Jaya) Tripathi, Benetech
Thanks for the questions
Thanks for the questions Kristin!
Regarding 30+ torture treatment centers, if its a question of aggregating data from a monthly form submitted by each member, a custom tool with online forms would be the best option. But it depends on what they need to do, hard to answer without knowing exactly.
Can a human trafficking organization in the Philippines enter their data into a secure Martus or OpenEvSys application?
Yes, OpenEvsys is built as a web application, like Facebook, so its easy to share and collaborate on data. Each member would have an user account. Currently all members would see all data, but we can change this so only HQ staff can see all the data, if this is needed.
Also, it would be possible to link the secure OpenEvsys to the public website of this organisation, to publish selected cases studies for example, or to publish live charts and tables, if useful. That would be a week or two of development work.
Daniel D'Esposito, HURIDOCS
Sharing data - how about XML?
Do either of these database systems allow for users to share the
data with others? I can see many security issues with allowing for this
functionality - but I have always been curious if it is an option. For
example, can a human trafficking organization in the Philippines enter
their data into a secure Martus or OpenEvSys application, store the
data on a secure server, and then allow access to that data by an
umbrella human trafficking organization? Is this why documentation
practitioners use controlled vocabulary - to be able to combine and share data from a number of sources/NGOs?
Excellent remark, Kristin.
I've been thinking about the same issue recently. We have developed the application which is used in Bosnia & Herzegovina as well as Serbia and Kosovo. I could say it's a similar to OpenEvSys with addition of module for Trial Monitoring.
Having the same software on both sides is great if one want to exchange data. However, the real challenge is exchange between heterogeneous data sources and applications. Soon or latter, no matter how small or big Your organization is, You'll need to export/import data. Here are few examples:
In most cases, we are using good old plain text, or in some cases Excel.
Now, don't get me wrong, plain text is great, especially for ad-hoc tasks. In fact, You would be surprised to hear that many banks are still using good old TXT (because of legacy applications, but that's another issue). Nevertheless, it would be nice if we can move to something more advanced.
One solution could be the use of XML.
As you all probably know, XML is a basis for many standards. After all, if musicians and chemists have XML standards , why not some sort of standard for HR violations? Well, technically speaking, we need a XML Schema but in an essence it's a question of consensus - if we can agree what data we want to exchange (data on victims, incidents, witnesses...) and what attributes (name, address, age...) then we can make our own "standard".
Does it make a sense or it's too complicated? Or maybe we already have some sort of standard for this?
Kenan
Hi Kenan, nice to meet
Hi Kenan, nice to meet you!
Could you please tell me more about the Trial Monitoring module? Its the first time I heard about such an application, and I'm very curious to see how it works. Do yourhave a document or a screenshot?
Here is the XML Schema for OpenEvsys, and the export/import is an XML file. It relates to a data model which is based on what many consider a standard, the events standard formats.
They made need revising at one point, but they're quite comprehensive. You're right, any form of producing standards should be done by including all stakeholders, in a task force. This was how the Events standard formats were made. Some contrbuted more than others, but overall it was a collective effort, based on years of preceeding discussions, which is while they're still relevant today.
We certainly recommend to use this model for those starting a new database project, to ensure interoperablity.
I think Martus also allows export to XML.
Daniel D'Esposito, HURIDOCS
Our experience with martus
Martus, as a data capturing tool, has been flexible, secure and adaptable.
After more than 92k bulletins captures, we can assure its excellent performance.
Our data comes from documents created by one of the most oppressing police forces in Latin America during the past century. This makes the analysis, of this information, a high risk task.
In this context, Martus has helped us protect the information obtained from the documents and has enabled us to store digital images of each and every document included in the quantitative study.
It also has the advantage that it saves the data with the necessary structure to export it in formats that are compatible to databases, statistical analysis programs, spreadsheets, etc.
Our experience with this software has been very good, however we haven’t had experience with any other application of this type. Any one else has had a similar experience with this or another software?
Jorge Villagran
How did your organization decide to use Martus?
Hi Jorge,
Thank you for sharing your experience using Martus - it is great to hear that it has worked well for you. It is also interesting to hear that you are able to store digital images on the bulletins! Why did your organization decide to use Martus over other documentation options? How did you hear about it? What was the process that your organization took to develop a documentation plan? How do you think we can get this information and training out to more grassroots organizations?
Thanks!
Kristin Antin, New Tactics Online Community Builder
Some answers
Well, first of all, there are two ongoing processes in the Archive. The archival process and the quantitative process. The first one is priority because we need all the documents to be classified, properly preserved and safely stored to enable all human rights investigations, give the documents its proper validity and provide access to the public. All of these activities (both archival and investigative) I mentioned have been done simultanously because of risks, political junctures, etc proving that it is possible but difficult to keep track of progress.
The quantitative study is, on the other hand, independent from this archival process. It was intended to go deeper into the archive (in quantity) in less time. And give a global picture of what the archive was and contained. Since it was basically unexplored teritory, we didn't know what we would run into, and because of that we needed a flexible intrument to capture data.
We heard about Martus from different NGOs when the archive was found and the project was being designed. Because of the variety of information found in the archive and needed for consult, Martus didn't prove to be very useful for the qualitative process (archival-investigative). More specific documentation systems were designed depending on the information needed for consult or investigative processes.
However it was the most practical instrument for the quantitative study. It needed to be secure so that all the data could be sent to benetech for statistical analysis. It was of quick installation and use, which made it perfect for the conditions under which we were working. The info is easily exported and most of all, it's flexible. Example of that is that it's usually used for testimonies and we're using it for document data.
On your last question....well, we're wondering the same thing. We hope to present to the public everything we've done and encourage interest on the results as much as the process. You can read more about it on the papers presented at the JSM in Washington last year. http://www.hrdag.org/resources/publications.shtml. We hope, everyone can learn from this experience.
Sofia Espinosa
Questionairre vs. Semi-structured vs. Unstructured
One of the challenges we face in documenting human rights violations in Burma has to do with interview methodology. We have been training fieldworkers for a few years, and we consistently face the question of how structured the interviews they conduct should be.
On the "highly-structured" end of the spectrum is a questionairre. The advantage of this appoach is that all the fieldworkers are gathering almost the same sets of data and so analyzing the responses across various interviews is made easier. This approach is also helpful for fieldworkers who do not have a lot of confidence or experience - they have very specific guidelines to follow. The biggest downside as I see it is that it puts the people being interviewed in a box and removes their power during the interview to talk about what they believe is important. And no matter how well designed a questionairre is, it may not fully take into account the reality of a violent situation.
On the other end of the spectrum is an unstructured interview. Using this methodology, the interviewer may set the general parameters of the interview and then turn over the direction of the interview to the person telling his or her story. I have used this methodology in some interviews about attitudes toward peace and justice. I ask the interviewee to tell me about their life, starting with biographical information and childhood experience. As they go through the various stages of their life, I ask for more detail about the parts that I am most interested in (the violence they have suffered and their resistence, coping, resilience that followed in response). The last question I ask is about what the interviewee thinks should happen to the person responsible for their suffering and what they want/need as a survivor in order to feel any satisfaction.
For the human rights documentation work that is linked to advocacy (to impact countries' foreign policies or UN actions on Burma) we tend to encourage a semi-structured methodology, between these two ends of the spectrum. Fieldworkers ask about specific incidents that they are interested in (e.g. with IDP's who have recently been forced off of their land). They are trained in the "essential elements" of the 15 categories of human rights violations that their network focuses on, and then ask who, what, when, where, how, why (and how do you know) for each element of the violation. So for forced relocation, the four essential elements are (1) removal from one's home or land, (2) arbitrary nature of the removal, (3) coercion or lack of consent, and (4) state action. The interview guidelines offer suggestions for the questions to ask to establish each violation:
1. Establishing the relocation
2. Establishing that the relocation was arbitrary
3. Establishing that the relocation was involuntary
4. Establishing state action
The guidelines for all 15 categories of human rights violations follow a similar pattern, so that at the end of a one-week training, (ideally) the fieldworkers do not need to go through the list of questions above - they flow logically. We are currently working on a "fieldworkers pocket guide" that will include the essential elements for each of the 15 violations and the questions needed to establish each violation.
The overall idea with this methodology is to allow the interviewee to tell her or his story, and to kick into this more structured methodology when a violation is mentioned as part of the story. We're still rolling out this methodology through trainings and developing a curriculum to increase consistency across all the fieldworkers involved in the network. (See the link above for more information and to link to the documentation manuals developed by the Network for Human Rights Documentation - Burma).
I would be very interested to learn about how others have addressed this challenge, determined what interview methodology is best, etc. I'm also interested in understanding more about how the data gathered is going to be used impacts decisions about the collection methodology. And while I'm at it - also interested in training materials for fieldworkers.
Patrick J. Pierce
Head, Burma Program
International Center for Transitional Justice
The structured to unstructured continuum
An excellent topic. In my own work (being a statistician) I have tended to work with a structured questionnaire for the simple purpose of making sure that the particular pieces of information desired -- timing of events, place of events, actors involved, etc. -- are captured appropriately (or at all). However, I train interviewers to allow respondents to tell their story in as natural a style as possible and to follow up with questions when details are lacking. In that way, the communication is not as constrained for either party (i.e., the communication resembles a natural discussion more than an inquisition) but the essential data elements are captured. So I believe this would fall under "semi-structured".
A related issue is how the interviewers/statement takers are trained. In "traditional" (i.e., Global North) survey houses (i.e., government agencies, research centers, commercial survey centers, etc.) a consensus has grown over time that the interviewer is to serve more as a "tape recorder" in order to remove "interviewer effects" and preserve the consistency of the questionnaire across its use. In that model, the interviewer must read the questionnaire rote and has only a limited number of options if the respondent doesn't understand the question. The type of dynamic that Patrick is suggesting in his post is not allowed.
I believe that this model for the interviewer as a "tape recorder" is not viable in the context of documenting human rights violations for many reasons. One is the fact that during a fully structured interview, a respondent might be re-traumatized by what will appear to be an "insensitive" or "uncaring" interviewer (due to the inability to naturally respond to what is being said). Also, during conversation about traumatic events, a survivor needs to be able to tell his/her story in a way that is comfortable, even if that is not the most efficient way to tell the story in terms of filling out the questionnaire.
An important point is that training for interviewers who are to perform semi-structured interviews (of whatever type) requires more time so that a larger set of skills are developed. It is relatively easy to be a tape recorder; it is harder to interact with the survivor in a meaningful way, that doesn't re-traumatize them, yet allows collection of the best-quality data possible.
Jana Asher Executive Director StatAid www.stataid.org
documentation training materials
Jana and others -
Can you share materials that are used to train fieldworkers to conduct interviews (wherever they lie on the un- to -structured continuum)? I'm developing a training curriculum and some sample materials would be most helpful, and I suspect others reading this dialogue would benefit as well.
Patrick J. Pierce
Head, Burma Program
International Center for Transitional Justice
Some potential resources
Hello,
The Metagora Training Materials include some example tools -- that is, they include examples from actual projects. The link to those tools is http://www.metagora.org/training/example.html. There are all sorts of examples of training manuals for different types of data collection. I hope these help.
Jana Asher Executive Director StatAid www.stataid.org
Documentation training materials
Patrick and others,
You asked about sharing of training materials. I hope others will respond and share their training resources.
I am wondering if you do already, or would find it helpful to share documentation examples during your trainings of how others have been collecting and using documentation. The New Tactics project seeks to share the creative work and successes being carried out around the world - to give inspiration and ideas for how others can improve and share their own efforts.
I would like to share a couple of tactical notebooks written by human rights practitioners that show different ways that documentation processes are trained and implemented. The three in-depth examples below specifically engaged and trained local communities in the documentation processes.
In your trainings, do you - and others in this dialogue - use examples of how documentation is being applied? If so, what have you found to be most effective about using such examples?
If you are not using examples now, do you have ideas about how such examples could be helpful for the groups you are traning?
Nancy Pearson, New Tactics in Human Rights Training Manager
Interview training materials
Patrick, you may want to look at the Ukweli manual, written by Amnesty International Netherlands' Special Program on Africa. See here.
The SPA has also prepared a very nice training package for these manuals. Ping me for the contact.
The best training manual I know of is the DJ Ravindran manual by Forum Asia. Its a classic, a treasure. Unfortunately its out of print, and we scanned the manual. Its a huge file, but I can try to send it to you by email if you want.
As you're in Thailand, would be good to see with Forum Asia if they have the original text file, and share with us, so we could make a low-size PDF. Its a pity when valuable tools just disappear.
Daniel D'Esposito, HURIDOCS
Alternative methods of research
I'd like to know if anyone can share experience with alternative methods ot social research to the traditional documentation of events/cases/incidents...
For example, using surveys, focus groups... but in the context of human rightsdocumentation.
And what useful manuals on social research methods should we read? I found this free online primer, and I like it a lot, but there must be others.
Daniel D'Esposito, HURIDOCS
Some potential resources
I've used or advised random sample surveys on human rights violations in a variety of settings, where human rights violations are defined broadly and include social/cultural/economic violations. There are some manuals available for surveys in general, and some manuals related to surveys in developing countries, but not really manuals specific to human rights violations. However, some colleagues of mine and I did publish a book recently called "Statistical Methods for Human Rights." It is available from Springer-Verlag, and in the first chapter (Introduction) we outline some of the history of human rights violation data collection, looking both at collection of testimonies that are then coded into quantitative data and also random sample surveys that focus on human rights issues.
The book contains examples of multiple types of data gathering and analyzing. There is even a project that utilized focus groups (the Phillipines Metagora project) that is mentioned in one of the chapters. In any case, this might be a good resource for some practitioners that read this dialog.
The disadvantage is that the book is not free -- I belive it is around USD$32 on amazon.com. One of the products my organization hopes to produce in the future is a set of training modules on different types of human rights data collection that would be freely available.
There is another free resource out there that might not have been mentioned as of yet: as part of the Metagora project, a set of training materials was created. The materials are specifically about using data to inform policy processes, but in the context of human rights and/or governance data. The link to the materials is at: http://www.metagora.org/training/ .
I almost forgot -- the United Nations produces some good resources as well -- for example, Household Surveys in Developing Countries.
Hopefully some of these links/resources will provide what you need.
Jana Asher Executive Director StatAid www.stataid.org
The Iraq History Project
Dear colleagues:
These discussions are very interesting.
I’m not sure if what I will post now is useful, but I decided to share with all of you a brief overview of a project that I have run here at the International Human Rights Law Institute (IHRLI) of the DePaul University College of Law. It is called the Iraq History Project (IHP). We documented the profoundly destructive impact of political violence under the regime of Saddam Hussein and following the US-led invasion by gathering thousands of testimonies with a methodology that plays off of many issues raised here.
Over the past six and a half years, studies show that 100,000 to 800,000 Iraqis have been killed and the United Nations estimates that one out of every six Iraqis have fled their home because of violence, creating one of the world’s most significant refugee and displacement crises. All of this has occurred in a country that suffered devastating losses over three decades of authoritarian rule in which the Ba’ath Party government killed hundreds of thousands, displaced millions and forced the entire nation to live under a state of constant surveillance and brutal repression.
The IHP has collected 8,911 testimonies representing over 55,000 pages of personal narratives recounting the individual experience of torture, massacres, assassinations, rape, kidnapping, disappearances and other violations.
The goal of the project is to provide Iraqis with an opportunity to talk about their experiences and thereby document the truth of political violence while placing a human face on the suffering of the Iraqi people. In this way, the project is similar to truth commissions in South Africa, Guatemala, Peru and elsewhere as well as to projects like the Shoah Foundation’s database of Holocaust testimonies and the REMHI project in Guatemala (particularly since these initiatives were not officially sanctioned processes like truth commissions).
The project has three main objectives: documenting past and present violations by collecting large numbers of testimonies from around the country; analyzing this material to reveal patterns of violence and repression; and, encouraging the development of domestic and international policies to assist victims through reparations, memorialization, education and national reconciliation. The project seeks to contribute to an improved understanding of the scope, impact and severity of systematic political violence over the past four decades in Iraq and to aid a broad social process of transitional justice, national reconciliation and reconstruction.
Here is an overview of the IHP methodology:
For the IHP, we designed qualitative methodology based on a review of similar large scale human rights projects, such as truth commissions. The project trained an all-Iraqi team of over 100 interviewers who worked throughout the country speaking with nearly nine thousand Iraqis representing the country’s diverse ethnic/religious population.
The interviews were carefully recorded by hand and then transmitted to a central office where they were entered into a secure and searchable database using Martus. Some of this material was transferred to a secondary analytic database using Access and SPSS.
The quality of the material gathered relies to a large degree on the skills and training of the IHP interviewers. Interviewers were selected to represent diversity of gender and religious/ethnic background. They ranged in age and professional background and included physicians, professors, lawyers, and journalists.
Interviewers used social networks, victims’ organizations, and local non-governmental organizations to identify and contact potential interviewees. Interviewers were paired with interview subjects in a manner that maximized their comfort and encouraged the collection of detailed testimonies. For example, women were interviewed by other women, Kurds by other Kurds, Assyrians by other Assyrians, etc. In addition, interviewees generally worked in the governorate or region where they live.
The interview process was designed to allow victims, their families and others to talk openly about their experiences in a manner that was both personally meaningful and useful for gathering material on specific violations and broad patterns of abuse. Since it is difficult for many victims to discuss their experiences of past repression, interviewers devoted special attention to approaching interviewees with kindness, respect and patience. Interviews typically lasted many hours and, in some cases, interviews took place over several meetings.
The IHP interviewers arrived at a designated location to meet interviewees. They provided the interviewee with a clear overview of the project and would then seek to establish a positive, trusting relationship. Because it is often emotionally difficult and even traumatic for people to discuss their experiences of political violence and repression, interviewers were trained to approach interviewees with great care.
Interviewers explained that the basic goal of the project was to prepare an account of political repression in Iraq during the regime of Saddam Hussein and after the U.S. led invasion through the personal stories of victims and their families. The interviewers described how these testimonies are gathered from victims and their families all over the country and that the material is stored in a database and that some of the results are to be published in various media with the goal of informing the Iraqi people about the suffering caused by the prior regime and in the past six and a half years. Interviewers sometimes discussed the possible use of the material in courses in schools and universities as well as the hope that the project might encourage the government to create programs to address victims’ needs.
We have presented the material gathered in books, newspaper inserts and on call-in radio programs in Arabic and Kurdish that have been heard by an estimated audience of over 500,000 Iraqis.
Interviewers highlighted the fact that participation was entirely voluntary and that there were no immediate financial or material benefits of being interviewed. Interviewers explained that interviewees should only participate if they were interested in contributing their story to the larger collection of testimonies about past political violence in Iraq. Interviewers then explained that they would answer any questions potential interviewees may have. They tried to ensure that interviewees had as clear an understanding as possible of the project. Interestingly, a number of interviewees later told our team that they were pleased that the project was honest in offering no direct benefits for participation. This was especially true for victims in places like Halabja where many prior interviews have been conducted, often alongside substantial promises of aid and assistance.
The interview methodology began by allowing the interviewee to speak openly about his or her experiences. Interviewers asked interviewees to tell their story in an unstructured manner. The IHP methodology allowed interviewees to talk about their experiences of past human rights violations in the way that is personally meaningful. Interviewers worked in a focused, yet informal manner, listening closely to the stories presented and carefully recording the testimonies by hand. They would write down everything the interviewee said in a word-for-word manner, interrupting the narrative only when absolutely necessary or to slow the process down to make sure all of what was said is accurately recorded.
Interviewers were encouraged to respect the fact that every person has their own way of telling their story. The methodology focused on the specific facts of each person’s story as well as the unique ways in which each interviewee chose to tell their own story. Interviewers were trained to work with each interviewee as an individual and to help victims feel as comfortable as possible while discussing these difficult and traumatic issues.
After the interviewee finished their story with minimal questions and prompting (a process that often took hours), the interviewers began asking questions. These questions followed the testimony as it has been recorded and focused on clarifying data, such as names, dates, and other relevant information. The interviewer might ask questions about dates, times, as well as how a particular event occurred or how a series of violations progressed. The interviewer might also seek clarification on feelings, descriptions, witnesses, information on perpetrators and anything that seemed necessary to fully understand the testimony. Interviewers would then mark down each element of additional information, whether a specific fact or a lengthy description, as well as any new elements of the testimony that arose from these questions.
After completing that stage, the interviewer would then read the testimony slowly, line by line, to the interviewee, asking him or her to correct or clarify any aspect of the narrative that they wanted changed. The purpose of that stage is to ensure that the interviewee fully accepted the testimony in terms of its accuracy, style and tone as a reflection of their personal experience. In this way, each interviewee approved the text of his or her testimony.
Then, the IHP staff would thank the interviewee and return home with the relevant paper records from the interview. Each interviewer would then prepare a clean version of the testimony using set guidelines. All original paper and notes would be destroyed. The final testimony material would be coded for safety and then transferred to the main office for review and entry into the project database.
The general data on each interviewee as well as the testimony would then be entered into the Martus database by staff working under the supervision of the database manager. The database encrypted the identifying information and narratives which are stored on a server located outside of the country to protect material from tampering, theft, or accidental damage. All paper records were destroyed after being entered into the database, which is password protected and can only be accessed by authorized staff.
Following the data entry, we engaged in selective analysis of material based on specific violations, historical events and other issues.
We worked closely with colleagues all over the world on this project, including excellent assistance from Benetech.
This is an ongoing project and we will post a revised website in Arabic, English and Kurdish shortly (www.iqhp.org).
I am planning to draft a detailed review of the methodology and to make available all of our training materials on how to conduct interviews, etc.
Any comments?
Daniel Rothenberg
Managing Director of International Projects
International Human Rights Law Institute
DePaul University College of Law
Chicago, IL USA
Why do repressive regimes preserve their files?
Burmese human rights groups collect almost all of their data by conducting interviews with people who have witnessed or suffered human rights violations. In looking at comparative examples, I am consistently surprised and baffled by the data that has emerged from the files of repressive regimes.
I have visited the Guatemalan Police Archives (just after the files were discovered) and learned good lessons on how to preserve and organize that kind of material from experts at the Iraq Memory Foundation. The Ethiopian Red Terror Documentation and Research Center is now endeavoring to take on a similar project. I think there are a lot of questions to ask about those methodologies for organizing and preserving these kinds of data, but because in Burma we do not yet have access to those files, I have a different question for any of you who have worked on such project. Based on what you have found, why do repressive regimes preserve their files? And how can our knowledge of their motivations help us in accessing and understanding the data?
Patrick J. Pierce
Head, Burma Program
International Center for Transitional Justice
Thoughts on administrative records
Hi Patrick
We work with the Guatemala Archive Project and have worked with such administrative documentation in other projects. When I visited the Archive, I was astounded at the volume of documentation and grappled with the same question – why would an actor perpetrating abuses document its behavior so thoroughly?
I can only offer two personal thoughts on this that are by no means scientific. First, I believe the hubris of a dominant repressive actor orstate regime can preclude them from contemplating how incriminating such documents would be if they were ever held accountable for their actions.
Second, (and this is an insight from conversations with my team members) this documentation can be incredibly useful to such actors or regimes.For example, in certain systems it can be essential to know what operations or missions a police or military officer has successful undertaken when considering whether or not to promote him/her. Generation and storage of that kind of information is part ofwhat yields rich knowledge later when we try to understand the truth about what happened.
We recently completed a report showing that the former presidentof Chad, Hissène Habré, was informed of hundreds of deaths in prisons operated by his state security force. This study, ‘State Coordinated Violence in Chad under Hissène Habré, A Statistical Analysis of Reported Prison Mortality in Chad'sDDS Prisons and Command Responsibility of Hissène Habré, 1982-1990’, is based on thousands of documents generated by the Documentation and Security Directorate (DDS). The DDS was the security force that pursued political opponents and operated notorious prisons during the Habré regime.
The documents were discovered by chance by Human Rights Watch at the abandoned DDS headquarters in N'Djamena.
Although I hope this example is useful, I don't think it answers your last question, Patrick. I'm not sure how our understanding of their motivations can help us access the data, since in both of these examples (the Archive and the DDS documents) the documents were discovered after the actors had abandoned them and conditions on the ground changed enough that others could access them. But, both are examples of actors with structural organization that generated the documentation to help themselves function as they perpetrated abuses.
Vijaya (Jaya) Tripathi, Benetech
terror archives
Patrick:
I think your question is very interesting and important.
However, I don't think it is true that perpetrators necessarily keep records of their activities. For example, in Sierra Leone there appear to be limited paper records of the actions of different groups. When the Truth and Reconciliation Commission was created there, they had to rely on testimonies and written submissions from experts and interested parties.
However, in Iraq, as you point out, the situation is quite different, at least for those violations committed under the governments of the Ba'ath Party and Saddam Hussein (as opposed to many of the systematic violations committed post-2003). The Iraqi government was profoundly bureaucratic and it kept almost obsessively detailed records on many citizens, including various documents from security procedures. The regime committed atrocities in a manner that often followed both procedures and law, with for example, significant resources directed to special courts that provided the appearance of due process while convicting virtually everyone who appeared before its judges.
I believe that governments of this type store files of repression in more or less the same way they store other tyeps of information. It is part of the way they manage power, an element of the bureaucratization of repression as a type of governance.
What is interesting here as regards this online discussion is that the human rights community may not be addressing violations with a sensitivity to the type of regime/party/perpetrator that is responsible for atrocities. Instead, violations are typically recorded asmultiple versions of the same essential act, such that a case of torture in one place is seen as similar to a case in another.
Of course, researchers with expertise in different regions generally operate with great cultural and contextual sensitivity, but the profession of human rights may not be certain as to how to address differences in the type and operation of perpetrators.
Should a violaton be understood differently when it is carefully recorded and where the perpetrators are acting under the color of law and according to set policies?
Should human rights documentation and analysis seek a means of understanding violatons in relation to the regime type of the perpetrators?
Would this sort of focus provide greater understanding of violations? Would it help in prevention?
Daniel Rothenberg
Managing Director of International Projects
International Human Rights Law Institute
DePaul University College of Law
Chicago, IL USA
Terror and the Record
Patrick and Dan - I would add:
Dan is correct - the paper, or, perhaps more appropriately, the "bit trail" can tell us much about the nature of a historical instance of human rights abuses. For example, In Argentina in 1983 when the military junta handed over power to civilian authorities they concurrently made an attempt to destroy all records of their action. They failed to erase their crimes because documentation had been such an integral part of their terror machine (they were even purported to have run their own printing press to turn out all sorts of forged records and documents) but also because much of the ground work of the repression in Argentina was carried out by provincial and municipal police. This organizational structure left its trace in the structure of the records and many of the police fonds were remote and out of sight of the military and thus escpaed destruction. New fonds such as these continue to turn up, not just in Argentina but all over such as the case in Guatemala. The archiving tendancy of organized terror is compelling described in Francisco Goldman's "The Art of Political Murder" .
Patrick Stawski - Human Rights Archivist, Duke University Libraries
Administrative Records, take 2
Having read through all the excellent comments, I feel the need to add that there might be cases where most of the bureaucratic machine doesn't see what is being done as human rights abuses. Take, for example, a government that becomes increasingly repressive over time. They have administrative records because large organizations of any type (governmental or not) keep records in order to ensure the functions of the organization run smoothly. Any prison that is well-run will have records on each prisoner, if for no other reason that to know when they are to be released. In any case, the system is set up, including the record-keeping, before things "go awry" -- and it chugs along as usual, recording events/people/movements/etc.
In Sierra Leone, the rebel groups were operating in the jungle and had no long-standing organizational record-keeping -- so it makes sense that records weren't kept on particular operations.
Just my early morning musings.
Jana Asher Executive Director StatAid www.stataid.org
Why keep records?
That's exactly the challenge here at the National Police Archives. We all ask ourselves the same questions, and it turns out that it's not as explicit as one would hope. That's the challenge for all investigators: to detect human rights violations within the information contained in the documents. It also turns out, that as you find the information you're looking for (putting pieces together, dates, places, names) you also find the idiological and political justification for everything. As Jana said, "most of the bureaucratic machine doesn't see what is being done as human rights abuses" because they're convinced of the administration's policies, and also, the bigger institution (plainly aware) covers its back by documenting everything else, showing they have nothing to hide and everything has a reason.
Sofia Espinosa
--- What are the purposes of documentation?
Under this main theme, please discuss these kinds of questions:
[NOTE: This is a PUBLIC dialogue. Please do not expose any names or locations if there is any risk of security.]
End users of data
I believe the intended end use of the data can greatly influence how the data should be collected.
If the end use is to prove the existence of human rights violations, document those violations for historical or legislative purposes, to inform the work of a truth and reconciliation commission, or to be used in a trial of a war criminal, then the documentation efforts are likely to be scrutinized so thoroughly that any small error -- whether it really has an impact on the conveyance of the truth of the human rights abuses or not -- could lead to a disaster (i.e., the war criminal being found innocent, the TRC being discredited, and so on).
If the end use is to provide reparations and/or humanitarian aid, then that type of overly-intense scrutiny might not be present. On the other hand, mistakes would still potentially be disastrous, if they led to aid or assistance being inappropriately distributed.
In either case, you want data to be as high quality as possible. For qualitative methods, rigorous methodology that ensures (as much as possible) that key information is collected (e.g., who, what, when, where, etc.) is desired. For quantitative methods, random sample surveys, when possible, are preferable to non-random data, although care must be taken to ensure the random sample survey is implemented well.
Researchers/practitioners that focus on human rights tend to be more oriented towards data collection for the former purposes -- but the latter purposes are perhaps of more interest to those that experienced past violations. As such, we should be careful to collect data in such as way as they can be used to inform reparations/assistance whenever possible, even if that isn't our mandate.
Jana Asher Executive Director StatAid www.stataid.org
End users - what is the goal?
Jana,
It is great that you and others have raised this critical point about the need to define the end goal or purpose of the documentation. Taking the time to be clear about this end goal and purpose provides the best guide to what information needs to be collected; how it is collected - to be credible and most userful; what resources will be needed in order to apply the information to reach the goal.
I want to connect readers of the dialogue to Daniel D'Esposito two great posts that provide excellent points and information to consider:
Jana - your point about "we should be careful to collect data in such as way as they can be used to inform reparations/assistance whenever possible, even if that isn't our mandate" also points to the need for organizations to take the time to think about their long term vision, not just the short term goal of a specific project and how we might collaborate with others to maximize the use of information beting collected.
I want to share that our Tactics Database provides many great examples of how organizations have used documentation to reach a specific goal. I typed in "documentation" into the search box - this provided a variety of examples from organizations around the world highlighting many of the purposes outlined by Daniel in his "What is documentation?" post.
Nancy Pearson, New Tactics in Human Rights Training Manager
varying and shifting intended end-uses
This question of the end-use of the data being collected is an issue those of us working on Burma have been grappling since setting out to create a comprehensive database of human rights violations.
Six years ago, several groups that already had a strong track record of documenting violations came together to form a network and put their data into a common format. (The network has since doubled its membership.) The stated purpose at the time was "to create an accurate historical record" - deliberately vague and non-committal, but with an eye more toward potential transitional justice measures (a truth commission, prosecutions, reparations, etc. in a future democratic Burma) than toward present-day advocacy efforts. The groups are using Martus, which Jaya introduced to this dialogue in this comment. We found Martus ideal for this broad goal because we were very focused on not imposing too rigid a goal on the network members while they built trust among themselves and began to recognize the benefits to their organizations of participating in a network. I believe if we had been more heavy-handed about asking the individual member organizations to focus on specific issues or had given them a more rigid format to follow, we would have lost members.
Network members have now entered over 3,000 records (called "bulletins" in Martus) in the database, and the template being used is largely a big text box but it also has some fields (geographical, biographical, types of violations, dates) that help with searching data and running reports about the database contents.
With a relatively large volume of data now collected, the network has decided it does not want to sit on the data and is turning its attention to present-day advocacy. We have found that going from broad to very specific is much easier than the other way around, which I suppose is logical. In 2010, the network will publish a report on arbitrary taxation, and the data for that report was taken from the data entered previously in the "capture it all" stage, as well as from an effort over the last year to have filedworkers focus specifically on the issue of arbitrary taxation.
The network is also increasingly trying to respond to outside requests for its data for various human rights campaigns (e.g. to end the use of child soldiers, on alleged crimes against humanity in eastern Burma, etc.) and the capture-it-all approach allows them to go back and retrieve some relevant data. Some weaknesses in the data exist, particularly a lack of detail, and the network is developing more sophisticated training methods for fieldworkers to address those weaknesses. Benetech has helped tremndously with this process (and please feel free to add anything here Jaya!).
I think the jury is still out about whether the slow, capture-it-all approach was the best way to go for the Burmese groups, but so far I feel confident that it was - but it will take a lot more effort and resources to build on the base that has been established.
Patrick J. Pierce
Head, Burma Program
International Center for Transitional Justice
Shadow reports as end-use
Thanks, Patrick, for sharing this great example from Burma that highlights this important point of documentation. I am sure that many organizations are in the situation of wanting to collect as much data as possible so that they can be flexible in the future regarding the end-use options for the information. Where does an organization draw the line for the amount of data that they will collect, given their resources - and is it necessary that they do?
I wanted to share another great end-use of human rights data - 'Shadow Reports.' You will find many great examples of human rights organization using Shadow Reports to advocate for their issue at a regional and international level, in our 'Using Shadow Reports for Advocacy' dialogue. Shadow reports are submitted to human rights treaty monitoring bodies from NGOs as an 'alternative' report to the State's required report.
Kristin Antin, New Tactics Online Community Builder
document/systematize/investigate
Documentation by itself can be a process as simple as the accumulation of sources (books, newspapers, testimonies, images, etc.)
Among the human rights community, (at least in our countries) the following tends to be a habit: taking a picture of everything, collecting magazine articles, storing newspapers, books, official documents...
This information gathering is valuable, taking under consideration that it can be organized afterwards for future analysis. In our experience, we stumbled upon the need to have a minimal identification and classification of the info so that it could be of immediate and accurate use. In our day to day experience, we've learned that investigators prefer using secondary information rather that the primary source.
Internal investigators at the National Police Archive have had to do enormous efforts to get quality reports done based on that primary source. Better luck have had the external investigators who've used the organized information system created during the archival-investigative process of the Archive recovery.
What has been your experience?
Sofia Espinosa
--- What are the risks, challenges & opportunities of this work?
Under this main theme, please discuss these kinds of questions:
What are our assumptions?
I am interested in thinking through some of the assumptions we make, as human rights practitioners, about the benefits of testimony as a form human rights documentation. In what circumstances is it inappropriate or harmful for people to talk about the violence they witnessed or themselves suffered?
Security plays an important role, for example, if the story a person tells implicates someone who is still a threat to her or him. Some of the best writing I've seen about this issue is by Kimberly Theidon, an anthropologist at Harvard. See this link to her January 2007 Journal of Human Rights article, Gender in Transition: Common Sense, Women, and War (particularly pages 459-464, about the problems of safety in telling one's stories.)
There is also the question of whether talking about one's suffering is "healing" or "redemptive." Rosalind Shaw, a professor at Tufts University, has done some interesting work on this issue in the context of the Sierra Leone Truth and Reconciliation Commission, examining how those assumptions have come to appear natural and universal, and the ways they do not ring true in Sierra Leone. See this link to her paper for USIP and this link for an abstract in the International Journal of Transitional Justice.
Patrick J. Pierce
Head, Burma Program
International Center for Transitional Justice
More harm than benefit?
Good comments.
I am especially concerned about the issue you raise in your last paragraph, but I like to think of documentation via discussion with a survivor in this ethical framework: "Will interacting with this individual about the abuses they experienced create more harm to them than benefit?" For example, if I am documenting human rights violations for the purpose of a trial against a war criminal, it might be the case that there is no direct benefit to the person telling their story. In that case, if telling the story isn't healing/redemptive, then is it ethical to be asking individuals to do so? On the other hand, if the data are to be used for reparations of some type, what level of harm to the individual telling the story is permissible? Actually, types of harm other than psychological harm can be considered in the same framework, but here I'm focusing on direct psychological harm from being forced to recall a traumatic event.
One practice I try to follow--and I've seen followed by others--is to have trained counselors available to help violation survivors if the process of telling their story is harmful to their psyche. In that way, we hope to minimize the possibility that more harm than good will be done to the informant during the process of recalling the abuse. The issue here, of course, is that having a counselor handy is a "band-aid" and not a cure. But if we, as those that document human rights violations, both provide that type of support and also try to make sure that at least some of the information we collect could be used toward reparations and/or humanitarian assistance, that would go a long way towards swinging the ethical pendulum in the "more benefit than harm" direction.
Jana Asher Executive Director StatAid www.stataid.org
testimony
Patrick:
One of the more complicated areas of work for those, like me, who gather testimonies is seeking to make sense of what this at means, for all of those involved.
On the one hand, there is a large literature about testimony that suggests that speaking about past trauma can be cathartic. This tends to be produced by professionals who are not themselves victims.
On the other hand, there is the also rather large literature of testimony that arises from people looking for an environment in which their voices can be heard. Those who produce these works tend to be victims. This approach is of great significance in Latin America where the term "testimonio" has a special valence.
It is not always easy to work between those two driving forces within human rights work. Just as the idea of "victim-centered" approaches is itself complex, well-meaning, but not necessarily accurate as regards how work is conceptualized and implemented.
At the same time almost anyone who has worked in areas of systematic conflict knows that many victims desire to tell their stories, often with no evident benefit (no money, fame, job, etc.) and often where speaking about political violence may place that person at great risk.
Why is this so?
And, do we (as human rights researchers and advocates) need to understand why victims want to speak given that people are, in fact, driven by very different desires?
I am not talking here about the issue of securitya nd confidentiality which is widely discussed and always in need of attention, I am interested instead in how we make sense of the underlying reasons why people want to tell their stories.
Daniel Rothenberg
Managing Director of International Projects
International Human Rights Law Institute
DePaul University College of Law
Chicago, IL USA
Ingredients for maximizing benefits
Thank you all for raising these important questions - and especially, what does it mean for people to be involved in documentation of human rights abuses.
I would like to share an important perspective on this from one of our previous New Tactics dialogues on the "Healing of memories: Overcoming the wounds of history"
Fr. Michael Lapsley of the Institute for the Healing of Memories in South Africa posted a comment where he stated, "Every person has a story to tell. Every story needs a listener." In addition, he provided some essential ingredients for moving a story from a simple recounting to an opportunity and potential pathway to healing - for individuals, communities and nations. The ingredients include that the story is:
For example, he states, "I would like to emphasize the difference between knowledge and acknowledgment and its importance for healing individuals, communities and nations. Families can have guilty secrets. There is abuse in a family. Everybody knows. There is knowledge but no acknowledgment, perhaps even denial. What is true of individuals and families is also true of nations.
Where torture, or forms of abuse, have taken place, the torturer will tell the tortured that no mark will be left so no-one will believe that they have been tortured. Finally healing begins, when it is publically acknowledged that yes, you were tortured, and it was wrong. Torture inverts the moral order. Acknowledgment helps to recreate the moral order."
I would like to pose that the initial process of documentation of violations can provide an opportunity for at least the first step - a story being listened to. A person may even feel that the listener acknowledges the violation in an important way. This can be a first step for that person to begin their healing journey. One way to maximize the benefit and reduce the potential harm is for those documenting violations to provide that active listening and acknowledgement - a powerful combination. I made to make a special note here - that those documenting violations are also in great need of support, being listened to and acknowledged in order to reduce the impact of secondary trauma on their own lives.
I would also like to pose that some of the other ingredients for healing often take a much longer time to realize. Documentation can serve a very important role here. The long term benefits and potential uses of good quality documentation and storage of that data may be realized only 10, 20, 50 years and beyond.
For example, the Documentation Center of Cambodia (DC-Cam) has collected records of the victims of the Cambodia genocide. A unique service of DC-Cam is the Family Tracing File System. This service helps families discover the fate of their loved ones through detailed records that the Khmer Rouge regime kept on many individuals that disappeared during this time period. But another goal of the documentation was to collect evidence for a legal accounting of the crimes of the Khmer Rouge. The DC-CAM records are now serving such a role in the Cambodia Tribunal.
I'm very interested to hear how others see the interaction of this critical aspect of documentation and "Choosing the Right Approach".
Are there experiences and methods you can share that can enhance the benefits to victims and communities?
Nancy Pearson, New Tactics in Human Rights Training Manager
I think the input by Fr.
I think the input by Fr. Lapsley from the previous dialogue raises some of the concerns that I address at the beginning. I am sure that in many contexts, perhaps most contexts, silence about one's suffering can cause emotional damage, and so providing a safe forum for breaking that silence is a good thing. However, I caution against universalizing it as "human nature." Instead, I suspect that the importance put on the cathartic and healing impacts of telling of one's own suffering varies from society to society. This is, in fact, what Rosalind Shaw concludes in the USIP paper I reference above.
I also think it's problematic to apply principles about human psychology to a larger populace - a community or a nation. I don't agree that "what is true of individuals and families is also true of nations." Nations don't, in fact, have a psyche that can be "treated," and approaching human rights policies as if they do would be really problematic.
In 2003 during an assessment process to get a sense for what documentation efforts were already happening among Burmese communities and to gauge the willingness to form a network, a group of us met with refugee and migrant communities on the Thai-Burma border. After I introduced the idea of forming a network and asked for feedback - who had ever been interviewed, about what, and by whom - one woman basically said if another person comes through the refugee camp and asks her to tell her story, she's going to start charging money for it. She was half-kidding, but her point was something akin to sympathy fatigue (hearing too much about suffering) - maybe "suffering fatigue," (talking too much about suffering). She didn't need a counselor, she didn't need to be comforted, and she had originally been very willing to tell her story because she hoped it would lead to some benefit - exposure of the violence that the ethnic groups in Burma were suffering under military rule. But all she saw or perceived was rich Westerners - some journalists, some diplomats, academics - getting a dramatic story from her to put in their reports so they could raise money to write more reports (how she put it).
I'm not saying we shouldn't carry out documentation; in fact, it's the main focus of my own work. However, I do think we need to be very careful to challenge ourselves and each other about the assumptions we make about the benefits, and risks, that talking about violence brings.
Patrick J. Pierce
Head, Burma Program
International Center for Transitional Justice
Concerns - highly important
Patrick,
Thank you so much for bringing the point back to the concern. I realize that I did not bring my point back to addressing that concern.
I absolutely agree with your point of "'suffering fatigue' (talking too much about suffering)" and this is especially true when a person sees that the re-telling of their story over and over not only yields no change but feels exploitive. This is most definitely detrimental and harmful.
I wanted to point out the need to look more wholistically at those ingredients offered from Fr. Lapsley's work on the healing of memories that can maximize beneficial change (progress on one's heaing journey) that I was hoping to point out.
I appreciate you bringing it back to the concerns.
Can or do some of the emerging technologies being shared in this dialogue facilitate the cross-sharing of documentation among organizations to reduce the number of times people are asked to tell their stories?
Nancy Pearson, New Tactics in Human Rights Training Manager
professional victims
The issue of giving providing victims with an opportunity to speak is at the heart of a significabt amount of fieldwork based advocacy.
However, many of us who have worked in the area can probably recount many useful anecdotes of how this process is profoundly cathartic if not necessary for so many people around the world.
In fact, one of the odd aspects of conducting interviews in this area is how common it is to find people who have never spoken of the extreme trauma they've suffered.
And, clearly, many seek a space to speak, an opportunity to be heard, especially by someone who lives apart from their social world and is less likely to judge the person who tells his/her story.
It is very difficult to know why people want to speakabout what they have experienced. One cannot know simply by asking. And, one can't easily distinguish the factors that lead one victim to seek out an opportunity to be heard while another wants to avoid revisiting painful memories.
As advocates, we have to balance many issues from security to care. Overall, I believe we need to ground our work above all in respect.
Yet, the world of communicating complex political situations through testimony is fraught with complexity, especially in light of the usual disparities between the social power and sophistication of victims and foreign, professional human rights workers.
Most of us have probably seen or even known well those individuals who become what might be termed "professional victims" finding that their tale of abuse allows them access to attention, power, travel and all sorts of benefits that would not accrue to them if they either had not suffered terribly or had suffered but were unwilling or unable to speak about it.
Where these stories are the subject of media interest, policy vindication (or critique), etc. it is hard to control the way in which testimonies and the truth they encode play out in a world of media and political demands.
Interestingly the phenomenon is both a testament to the power of stories and often a means through which the richness of an individual's existence is reduced to their trauma, an act that runs counter to the spirit of human rights.
Daniel Rothenberg
Managing Director of International Projects
International Human Rights Law Institute
DePaul University College of Law
Chicago, IL USA
Challenges and Risks
With our HR documentation work in FIji we face quite a lot of challenges. One of the main ones is in this political climate of persecution, censorship and threats, access to information is so limited. It is very difficult to obtain information from survivors and witnesses on violations and with the censorship and control over the media it proves even more difficult.
Another challenge we tend to face is the lack of capacity building andupskilling of human rights officers in the field esp in the documentation and analysis areas.
Resources for the protection of human rights defenders
Thank you, Roshika, for sharing your concerns regarding human rights documentation in Fiji. Documentation is often a dangerous job, especially in the countries whose citizens most desperately need the advocacy provided through documentation efforts. I hope that other practitioners share their own resources and tools to this thread, but I will start with the resources that I am familiar with.
As you can imagine, the concerns that you have raised come up in many of our online dialogues. Human rights defenders working in different fields, on different issues, in different regions face these challenges of security. The NGO, Frontline Defenders, has developed rich resources to enhance the ability of human rights defenders to face these challenges:
Kristin Antin, New Tactics Online Community Builder
human rights documentation
Kristin:
That material is great! Just so everyone knows, we are almost finished with a manual in English and Arabic to assist human rights NGOs in documenting violations, analyzing the material they gather and the developing advocacy programs.
Unlike some available material, this manual focuses on the mechanics of how to understand a social problem as a human rights violation and then develop a research stratgegy involving gathering documents, conducting interviews, etc.
If anyone here is interested, please just stay in touch with me at drothenberg [at] fastmail [dot] com or drothenb [at] depaul [dot] edu
Is it possible that one outcome of this discussion could be a clearinghouse on human rights documentation materials?
Right now HREA does a great job on this, but they list so many types of sources...perhaps there is some value of a site that focuses only on the issues of documentation, including manuals and critical material.
Daniel Rothenberg
Managing Director of International Projects
International Human Rights Law Institute
DePaul University College of Law
Chicago, IL USA
re. human rights documentation
Hello Patrick,
Good comment!
Actually, we at HURIDOCS are working on an on-line resource centre for human rights documentation materials.
This would be a collaborative effort, with inputs from several
organisations (of course, we will quote sources and give due credits).
Right now, Oleg Burlaca is working on the platform on which it will
operate.
We would include resources on the following topics:
Feedback is welcome!
Best wishes,
Bert Verstappen, Programme Coordinator at the Human Rights Information and Documentation Systems, International (HURIDOCS)
New Tactics group as a clearing house on documentation materials
Daniel,
I look forward to seeing the manual that the International Human Rights Law Institute (IHRLI) at DePaul University College of Law is developing! And how great it is that it will be available in Arabic!
In response to your question - yes, New Tactics would be very happy to be a clearing house for human rights documentation material. I just noticed that Bert also added a comment about the development of another platform for this purpose. In the meantime, I would like to invite you to join the New Tactics Documentating Violations group. This is a space for online community members to continue focused dialogues on particular tactics/topics, share resources, video, images, links, etc. We also have groups on many other tactics and topics if you are interested!
Kristin Antin, New Tactics Online Community Builder
Violation-specific documentation manuals
Daniel (and all),
You may be interested in the documentation manuals developed by the Network for Human Rights Documentation - Burma (ND-Burma) on the 15 categories of human rights violations that the network focuses on (listed below and linked here: http://www.nd-burma.org/documentation/resources.html). Each manual is divided into three chapters:
1- Documenting the violation (e.g. what are the essential elements that make it a violation, what questions to ask to establish that each of those elements is there, sample good and bad interviews)
2- Analysis - identifying patterns in the data that point to violations of international law (crimes against humanity, war crimes, and genocide)
3- Advocacy - with a focus on what UN bodies are relevant and how to contact them
The 15 categories of violations are: (1) recruitment and use of child soldiers, (2) forced labor, (3) arbitrary arrest and detention, (4) rape, (5) other forms of sexual violence, (6) human trafficking, (7) forced marriage, (8) forced prostitution, (9) obstruction of freedom of movement, (10) forced relocation, (11) obstruction of freedom of expression and assembly, (12) torture and other forms of ill-treatment, (13) killing, (14) disappearance, (15) violations of property rights
Patrick J. Pierce
Head, Burma Program
International Center for Transitional Justice
violation -specific work
Where human rights violations are systematic, involve multiple violations and occur over extensive periods of time, they are extremely difficult to document as either "specific" or"quantifiable".
If one looks at virtually any case of an individual victim who has been systematicall abused, the capacity to identify the singular nature of what they experienced as well as the possibility of rendering that story quantifiable in terms of "acts" is very difficult.
So, if someone is tortured over a period of 5 minutes by one perpetrator one time, one can claim that this is a case of torture with a count of "1".
But, what if that person is tortured 5 times for (5 minutes, 10 minutes, 45 minutes, 1 hour and 4 hours) over a period of 7 days? Is that 1 case of torture or 5 cases of torture (so that the 5 minutes is counted equally as the 4 hours)?
What if that person was held for 1 month and tortured often? Is that 1 case? 5 cases? 10 cases? What if - as is common - they cannot remember how many times they were tortured?
And, what if alongside being tortured, they were: denied due process protections, raped and had possessions stolen? Do these count too? If so, how? As singular instances (what if the rape occurred many times?)
Furthermore, does one count types of torture? Numbers of perpetartors? Types of perpetrators?
And, is it useful, important or necessary to review context? For example, are antecedents to the act of torture - such as surveillance, threats, acts against family members, etc. - relevant to the case documented? And, if relevant, how so?
I have found that where political violence is systematic and occurs over long periods of time with multiple events that involve many types of violations, many perpetrators, and substantial issues of contextual relevance, it is really hard to distinguish certain violations and close to impossible to quantify violations.
The research and advocacy question, then, is what sort of information should a group collect in order to realize its objectives? Rather than imagine that a set form can be used to collect data, it is often true that useful human rights research requires sensitivity to the demands of a particular organization, project or endeavor.
denied due process protections upon arrest, beaten, tortured and raped over 3 days, what is the violation thet occurred?by five people is it one case of rape? one case of gang rape?
Daniel Rothenberg
Managing Director of International Projects
International Human Rights Law Institute
DePaul University College of Law
Chicago, IL USA
Violation specific work - and documentation systems
Daniel,
Your post certainly does raise many questions. It makes wonder how the documentation systems (Martus, OpenEvSys, etc) that have been shared here try to take these kinds of questions of multiple abuses into account.
You stated, "The research and advocacy question, then, is what sort of information should a group collect in order to realize its objectives? Rather than imagine that a set form can be used to collect data, it is often true that useful human rights research requires sensitivity to the demands of a particular organization, project or endeavor."
Here at the Center for Victims of Torture where our work is focused on helping people heal from the wounds of torture - your questions become very specific to each person and integrated into each person's journey and their healing process. As you have stated, often survivors of torture are not able to remember how many times they were tortured, how much time passed, how many people and locations were involved. Torture is intended to not only disorient but dismantle a person.
Kristin had mentioned in an earlier post that the National Consortium of Torture Treatment Programs in the United States are jointly collecting data. Here's an example for sharing a stated purpose for data collection. From the NCTTP website:
The main purpose of this Data Repository is to gather data related to torture survivors in treatment in the United States. We feel it is vital that scientific descriptions pertaining to the demographics, outputs and outcomes of the treatment of torture victims in the United States be available to the public for training, advocacy, and research.
New data is currently being collected from approximately 25 treatment centers across the United States for FY 2009.
Nancy Pearson, New Tactics in Human Rights Training Manager
some thoughts on controlled vocabulary
Dan - you raise very, very relevant questions for any project attempting to analyze human rights data!! I wanted to share some thoughts about the implementation of controlled vocabularies that draws on our experience using them, that in part speaks to your points about the difficulty of coding incidents that seem to include multiple violations/acts. In particular, I hope the thoughts about 'counting rules' in controlled vocabularies and inter-rater reliability exercises' are useful.
----
Many of us have spoken about controlled vocabularies on the dialogue, and I wanted to discuss some of the key steps that come after the development of the vocabulary itself (in case its of help to folks thinking about implementing such vocabularies in their own projects).
As we've said, coding is the process by which raw narrative data is classified in consistent and repeatable definitions to distil the narrative elements, including witnesses, victims, perpetrators, personal information, and numbers, locations and types of violations.
Each project must develop a unique controlled vocabulary based on the specific nature of the information collected and the analytical objectives of the project. (Alternatively, you can choose to use an existing controlled vocabulary such as the ones others have listed in blog posts on this dialogue.)
The task of reviewing narrative data and structuring it by coding it for certain information may seem straightforward, but in fact we and our partners have found that people can often see different things in the same statement.
We like to joke on the team that if you collect 10 human rights experts in a room and ask them to define a particular violation type, they would probably each define it slightly differently. <wry smile>
In the same way, if you get 10 people together and ask them to use a controlled vocabulary to code human rights information, they might each apply the vocabulary slightly differently and have disagreements. A disagreement may be that Coder A saw 4 abuses, and Coder B only identified 3. A disagreement may be that Coder A coded a particular incident as extra-judicial killing, where Coder B coded it as disappearance. Coder A may code an incident as rape, where Coder B coded it as sexual assault. Coder
A may code an incident as a disappearance, where Coder B codes it as being two ذ disappearance and extra-judicial killing.
It's important to be sure that your coding team agrees with one another on what a vocabulary term means and establish that everyone is applying it consistently to qualitative information. Included in ensuring consistency is making sure to conduct inter-rater-reliability (IRR) exercises, which measure the consistency with which the data entry team codes information, thereby ensuring high data quality and therefore meaningful results.
An IRR exercise can be simple. Here's an example: Let's say your project is collecting statements from individuals who have survived or witnessed (or both) human rights abuses. You have developed a controlled vocabulary that meets your analytical objectives. You have a coding team.
The simplest exercise is to photocopy the same statement (or same 5 statements), hand them to each member of the team, and ask them to code all of the human rights violations (referring to the controlled vocabulary).
Afterwards, review how often they agreed, and how often they disagreed. Use the findings of your IRR exercise to identify areas where the controlled vocabulary isn't clear. Discuss the areas where the team disagreed. Refine the vocabulary and/or do more training with the coders as necessary. Then, repeat the process.
Working towards high levels of IRR allow you to defend the findings of your analysis. If you have high levels of agreement among the coding team you be confident that your project's coding is more than a collection of subjective viewpoints among the coding team.
When you think about developing a controlled vocabulary, in order to ensure the quality of the data and facilitate consistent application of the definitions by your coding team, every violation definition must satisfy the following five properties:
* Mutually exclusive: No single violation (or victim or perpetrator) can fit into any two definitions in the controlled vocabulary
* Exhaustive: A definition must exist for every possible violation that can occur in the situation being studied. (for example, we often include 'Other' and/or 'Unknown' to cover unanticipated values.)
* Distinguished: Each definition must have an explicit characteristic that distinguishes the violation/victim/perpetrator from all others in the controlled vocabulary.
* Exemplified: Each definition must be accompanied by examples showing how to apply the definition in a specific situation.
* Countable: Each definition must contain a counting rule explicitly stating how violations, victims, and perpetrators are enumerated.
After you develop the 'first draft' of your controlled vocabulary (or after you adopt an existing controlled vocabulary from the resources others have listed in various blog posts on this dialogue!), please plan for a 'pilot testing' period where you and your coding team go through an IRR process like the one described above. That way you can refine the controlled vocabulary and everyone's understanding of how to apply it before you begin the work of coding in earnest!
We also suggest doing IRR exercises periodically once the project has started as well, especially if you hire new staff, or a new data source is introduced, or your vocabulary changes. (We do them regularly throughout our data analysis projects, too.)
Vijaya (Jaya) Tripathi, Benetech
Violation-specific documentation manuals
Thanks for sharing this, Patrick. These manuals are excellent, and very valuable and we'll be sure to reference them indivividually in the documentation library we're setting up.
Its great when human rights groups share their methodology. I know of a number of groups that have similar violation-specific manuals, at great effort. There is a lot of duplication in this area, and its great you're sharing.
Take forms for example... sure, a form has to be customized to a particular context, but if you're starting from scratch it sure helps if you have some models to start with.
We'll soon do a global call inviting NGOs to share their hidden treasures, such as training materials, forms, manuals, powerpoints, to make them available to all. Each item will be duly acknowledged.
Daniel D'Esposito, HURIDOCS
Handheld Human Rights
For Digital Democracy, the issues of challenges at risk were a key stimulus for our Handheld Human Rights project.The idea is to take a situation with the extreme security concerns, like Burma, and make human rights more accessible and actionable.
To document abuses, young people were entering the jungles with reems of paper, recording information, smuggling it out of the country at great risk and through the jungles with great difficulty, transcribing it, and processing all of it into a report perhaps 6 months to a year later. These same documentors were then asking to become Facebook friends with us.
We realized the need for more technology literacy, security and efficiency and started speaking with our local programmers, the All Burma Information Technology Student Union (ABITSU) to figure out how we could take open source solutions and localize them, plus what makes sense for their context.
The result was finding the need for a secure internal chat that reached down to the equipment people have on the ground at a reasonable cost. SMS on mobiles was the solution. Pulling these into a secure map-based chat protocol made sense and for this we found GeoChat. It leverages existing security protocols and groups, but makes the conversation much faster, meaning it can be responded to and acted on.
Once the information is verified as safe enough to be public, we wanted to make sure that information was being shared amongst groups. Initially we found a frustration that two groups would be working down river from one another on HR abuses surrounding dam construction, but they had no idea about one anothers work. Creating one system that pulls 50 years of data onto a map and timeline makes it actionable for the community based organizations, researchers, reporters, and funders. Ushahidi was a great fit and it could be quickly translated into local languages, helping bridge some of the many divides that exist amongst groups that don't share a language, religion, geography, etc. but could have a mutual interest in working together if they see a benefit.
Not reinventing the wheel is key, and there is already a lot of information available for the past, not only important info for the future. Working with systems like Benetech's Martus affords us the ability to pull in data that is solid, where private information is encrypted and public data is already verified. Much of the other information is in dead formats - PDFs or paper, and we're working with volunteers from around the world to process this.
New forms of documentation can't be overlooked either. When trying to secure a system and working with an insecure format (ie most mobiles, it's important to be creative. We are working with Nathan Frietas and his Guardian project to see how we can expand the reach of the project by securing individuals particpating. We've also incorporated smart pens like Livescribe, to work with actual handwriting and create forms so that nothing has to be transcribed. It also means working visually with interactive maps. I've written about this on this technology for HR on my blog.
Handheld Human Rights - Outline
View more presentations from Mark Belinsky.
For the future, we're excited to see how we can expand the scope, bringing in more international volunteers for crisis mapping, expanding local portals to the other borders, and working with additional partners. Let us know if you have any thoughts!
Online data security: geeky question
We see a lot of potential for online solutions, for databases or document storage solutions, as they allow sharing across geographical divides, and protect against physical attacks on premises.
But one problem is security, ie protection of sensitive information against unauthorized access. In particular the entry point to the online system via login and password. Keyloggers or screenshot tools can be used to capture password information. This is the Achilles heel.
Any ideas for a simple and low tech solution? Martus has the two-level solution, something you know (password) and something you have (keypair). How to implement this in an online solution?
One idea we have: a one time password system, meaning the users have their personal password, and a second password taken from a pre-printed list generated by a system. Feasible?
Another idea: to use the upcoming iPad as a means to interact with data. They are cheap and can be connected to an external keyboard. And I doubt there will be any keyloggers in the App store, and even if there were the iPad does not allow multitasking, so no spy apps in the background!
And ideas or suggestions?
Daniel D'Esposito, HURIDOCS
How do we secure the whole process of documentation?
Thanks for this great question, Daniel. Though I can't address your specific question about finding a low-tech solution the keylogger issue, I wanted to share some good tools for activists interested in learning more about this security issue and others.
As I mentioned briefly in a previous post on security, Tactical Tech and Frontline Defenders have put together a toolkit called Security-in-a-Box for human rights activists on digital security. There is a chapter of this toolkit on Spyware - which is the more general term the type of malicious software that can track the work that you are doing on your computer (by recording the keys that you press, the movements of your mouse, pages you visit, etc) and sends it to people that shouldn't have it. One of the tools that they recommend activists use is called Spybot, and anti-spyware software.
On a different note, I wonder if a tool like Tor that allows a user to surf the internet anonymously could be useful for human rights documentation work. This is a software that you download on your computer and turn it on when you open your internet browser. Your IP address gets routed through servers throughout the world so it is impossible for someone to track your internet activity to your IP address (your computer). Would this help when uploading data to Martus, for example?
I also wanted to share a video of a presentation given by Ahmed Motala of the UN High Commissioner for Human Rights on security concerns for human rights workers. It is nice to hear that UNHCHR is taking these concerns very seriously. I hope that they are working closely with Benetech and/or HURIDOCS!
Kristin Antin, New Tactics Online Community Builder
More on Securing the Process
A few scattered points on this Sunday evening.
Nathan Freitas, the Guardian Project
additional security thoughts
Vijaya (Jaya) Tripathi, Benetech
Great suggestions, Nathan!
I have to admit, it gives me a lot of happiness to look at this blog and see how much people are engaging with the importance of electronic security, to protect both those working to document human rights as well as those trusting them with their experiences.
A few scattered thoughts from me as well:
- Martus is one way to encrypt and securely share information while also backing it up. Martus also has a virtual keyboard (appears on the screen and you click on the keyboard 'keys' to enter data) like the one Nathan describes. Although there are 'screenshot' keylogger apps which attempt to record what letters you are clicking on, they are much harder to get right, so using the virtual keyboard is a good step in the right direction.
-There's something low-tech that is absolutely essential to keeping information secure - change passwords regularly! And make it tough to guess.
- Not sure if anyone has mentioned this yet, but Frontline is another group that provides information and trainings about how to secure human rights information. They provide a Protection Manual for Human Rights Defenders.
- Another key component is maintaining antivirus/malware/firewall
protection. Not only does that keep you safer from direct attacks, but
it also keeps your hardware running longer. I've worked with several
computers in the field that are nearly unusable, or later suffer
irreversible damage due to virus ridden systems. There are free options
available (such as AVG) as well as software you have to pay for.
- Do regular back ups of existing data. I know this has been mentioned elsewhere but it bears repeating. We've heard of real-life examples of data lost to theft, volcanic eruption, fires, eaten by termites, decay (and exposure to elements), loss (it was on a CD or in paper files which have been misplaced), hard drive failures, forgotten passwords, expired email accounts, etc. As others have noted, it's best to do back ups to an offsite location. Martus is one way to automate backups to a remote server (the Martus software and Martus server storage space is free).
- Linux-based systems such as Ubuntu are _much_ less vulnerable to traditional threats than Windows systems. Definitely check out Nathan's suggestion in the earlier post.
Vijaya (Jaya) Tripathi, Benetech
Managing and Preserving Data of Human Rights Crimes
A crime occurs today; our technology documents it and generates evidence that can be immediately analyzed and disseminated. But typically (as is the case today with Cambodia, the former Yugoslavia, Guatemala, and many other places where communties are seeking justice for past crimes) only a long way down the line, years possibly decades later, is there is a chance for justice. Will the evidence we generate through our new documentation strategies be around to support prosecution and attempts at accountability?
I've been reading with great interest everyone's comments on the opportunities afforded by new documentation technologies, from Nathan's discussion about cell phones and PDA's that generate on-the-ground data to the software tools such as Martus and HURIDOCS that manage, organize, and help interpret that data. As an archivist working with human rights organizations to preserve legacy data, I feel we need to match the need for immediate and mobile data about human rights violations and crimes with a need for stable data structures that will survive the pace of technological obsolescence and the vagaries of post-custodial information management. Whatever technology we are using today we can be sure that we will be using new technology tomorrow, and we may all be sharing information but who is taking responsibility for its long-term survival?
A case in point: in 2006 Duke's Archive for Human Rights received the legacy collection of an NGO that worked with the International Criminal Court to collect, catalog, and provide access to audio and video evidence of genocide and human right violations in the former Yugoslavia, Sierra Leone, and other areas of the world. The NGO operated from 1993 to about 2003 and collected over 10,000 tapes and developed a robust database that contained vital information needed by prosecutors: names of witnesses, locations, date, creator, rights owners, controlled vocabulary of human rights crimes, etc. As recently as 2006 the ICC contacted Duke seeking evidence in an important prosecution - this was over a decade after the evidence had been originally generated!
The challenges: The catalog data was stored and managed in a FileMaker Pro database. Since the original creation of the database FileMaker Pro has undergone something like 5 to 7 iterations; in order to simply gain access to the data we had to come up with a strategy of migrating the data forward and migrating the software backwards a few generations - this worked but just barely. We have noted content loss and file corruption and plan on creating a more stable structure for the collection metadata. The tapes themselves are now coming close to the end of their stable life-time. The long-term solution for both preservation and access is digitizing the tapes. We estimate that digitizing ~4,000 of the tapes at the lowest acceptable codex will require about 29TB of storage and cost about $50,000 a year to maintain....forever.
Some human rights organizations are thinking about these issues today. ICTJ's recent publication Documenting Truth is a case in point, but to tackle the challenges of preserving the digital records created by new and ever-changing technologies we really need to get the people designing and using the tools today to incorporate preservation and stability into their design process. How can this happen and where do we begin? I would love to begin such a dialogue between the archives community and human rights practioners.
Patrick Stawski - Human Rights Archivist, Duke University Libraries
Keeping the data viable
I believe you've raised a very good point -- that we need to think about maintaining the data we collected in perpetuity. And how do we do this when the technology for data storage is constantly changing?
I don't have any easy answers. I'm storing data in paper form (large piles of years-old surveys), in digital form (on a hard drive and back-up drive), and in summarized form (the final data taken from forms that have been destroyed). In an ideal situation, we would have whatever instruments/questionnaires were used to gather data digitalized and stored on a semi-permanent media with an upgrade cycle, as well as the data in a csv format (which has remained usable over many iterations of technology). Even this simple combination can be expensive to achieve, and doesn't account for audio and visual records.
Perhaps this is the next big challenge for the HURIDOCS and Martus folks -- creating a platform that is sustainable over time to capture and archive these various data sources in a meaningful structure for future use?
Jana Asher Executive Director StatAid www.stataid.org
Challenges of Long-Term Viability of Data
Jana - All the issues you mention:
are being tackled by many human rights practitionors in partnership with archives and archivists.
There are different models out there on how the human rights community can engage in archiving and preservation. Some organizations such as WITNESS maintain their own media archives. Some of the larger government and international human rights organizations, such as the UN bodies that are involved in human rights work or the Interamerican Commission on Human Rights, have gone this way as well. In other cases human rights documentation is being preserved and archived in partnership with major universities such as Duke, Columbia, UT Austin, and UConn. Amnesty International, Human Rights Watch, ICTJ, CIP, WOLA, and others NGO's have entered into these kinds of partnerships to preserve their records and data. Another arena of human rights work that is taking preservation seriously are the many international bodies and tribunals, such as the ICTY and South Africa's Truth and Reconciliation Commission, being established to prosecute war crimes, genocide, and crimes against humanity.
One thing that seems clear is that preservation in this digital age is going to be a challenge. These challenges include:
For this reason we need to implement technologies that are designed to produce viable, manageable, sustainable records.
Patrick Stawski - Human Rights Archivist, Duke University Libraries
Re: Challenges of Long-Term Viability of Data
I want to highlight Patrick's point about partnerships with archival organizations: In the past archivists only appeared in the picture when records became "inactive" (i.e. not in everyday operational use) primarily due to the logistics of appraisal, transfer, and access. This was usually fine for rather stable media such as paper and film but the rapid pace of technology makes this more perilous today. Organizations can partner with archival organizations that can provide assistance for preservation and head-off potential hazards as they arise. Also, transfers of materials can happen more frequently which can assist in the preservation process.
Some of the best things that can be done for preservation include:
Note that when I mention "open systems" I don't mean insecure. The word "encryption" scares a lot of archivists and preservationists because if they keys are lost so is the data. However, encryption with strong authentication measures is the best way to protect sensitive information. Encryption only means loss if the keys are lost. Early and frequent transfer of unencrypted copies to an archival partner can help prevent that loss or you could consider giving them a copy of the key.
Seth Shaw, Duke's Libraries' Electronic Records Archivist
What are the apprach to transfer these tools to the grassroot
At the first step I would like to thank you the facilitators and organizers of this online discussion on this important topic, which is the key tool for protection of human rights. And it’s very interesting topic for me as I am working for an organization who building the capacity of the local CSOs in human rights advocacy in Afghanistan, where the documentation and monitoring are playing the key role in whole advocacy process and one the proiority need of the CSOs here.
Reading the voluble inputs, comments of the expert practitioners and researcher in this discussion regarding different ways and approached for human rights documentation and also the material resources and manuals available in different websites, which are credible resources.
My comment or questin is more relevan with last point of this discussion, regarding the approaches and content and process , there are very much interesting inputs from the experts, but my cmment or question will be on how these approaches and method and tools for documentation to be reached to the organizations who are working at the community level and every day facing with violation to be documented, who cannot speak English or not have access to computer,nor have access to technical support or training?
So what would be the approaches and strategies if we want to localize these tools and resources to those who are working at the community level with limited access to information technology or other tools.
Sincerely
Khan Agha Dawoodzai-Director
Bureau for Reconstruction and Development (BRD)
Street 3, Part A, Khoshal Maina, Kabul, Afghanistan
Phone: +93 (0) 799341118,+93 (0)773705999
Email:kdawoodzai [at] brd [dot] org [dot] af
URL:www.brd.org.af
"Tools" versus "Technology"
Hello,
A great question. The featured resource practitioners for this dialog all have good access to technology -- that is, to Internet, computers, etc. So what does a dialog on human rights documentation mean in a context where there are no computers -- and possible no electricity -- and no cell phones, etc.?
Here we need to make a distinction between tools and technology. Several posts in this dialog are about basic paper-based tools -- for example, what type of questionnaire/statement form should be used when recording data collected about human rights violations.
When I'm working in the field with documenters/interviewers that only have access to paper and pencil, I try to relay the following ideas. In doing so, I try to provide the local practitioners with tools -- questionnaire formats, skills in interviewering, and knowledge of best practices -- that allow them to collect the highest quality data possible.
1. Record the story, not your interpretation of the story. The job of the interviewer is to make sure the details of the story are transmitted accurately. To do that well often requires training on how to not lead the respondent to a particular answer/statement, how to appear empathetic and build rapport no matter what the interviewers personal feeling are about the event, and so on. There are interviewer-training techniques that are appropriate (when tailored) for any culture/language. For example, making interviewers aware of what their body language says and how their voice control affects the person being interviewed can affect how well information is collected.
2. Make a safe space for the respondent. The respondent might have a story to tell that is very frightening to relay -- for example, women that have experienced sexual abuses are blamed for the abuse in some cultures, making it very difficult for them to report what happened. Interviewers can be trained in what to say, and how to say it, to make the safest environment for the respondent.
3. Make sure all the details are there. Using a form that has spaces for particular aspects of the violation--who, what, when, where, etc.--helps interviewers make sure they get all of the pertinent pieces of information related to the violation.
Yes, there are particular technology-based tools that are great when you have access to them. But the very important themes that underlie the discussions here related to how to collect information that is of high quality can apply whether there is a computer handy or not. If there is no mobile phone, use a traditional camera or tape recorded with batteries. If those aren't available, record the information on paper. While technology can make it easier to gather and analyze high-quality data, it is not required to do so. And it is possible to have great technology available and still either collect bad data or analyze good data badly. The important take-home message, I believe, has to do with understanding how to collect human rights violations data well and how to use those data appropriately.
Jana Asher Executive Director StatAid www.stataid.org
Testimony: Why victims want to speak.
Jeanne Sarson, Canada
Dear Patrick,
Although this discourse focuses on human rights violations in the public sphere I and a colleague have, since 1993, had the experience of listening and assisting mainly women speak and recover from being victims of torture inflicted by non-state actors in the so-called domestic sphere. The conflict that produces torture in the home has unique considerations because the torturer is the most ‘trusted’ person known to the victim. The gravest social difference is the patriarchal divide that exists nationally and globally that recognizes state inflicted torture as a specific and distinct human rights offence and crime whereas non-state inflicted acts of torture are often globally/nationally invisibilized by misnaming non-state actor torture as abuse or an assault of some kind.
Saying this, I will however respond to the question of “why victims want to speak” because the reasons have contextual familiarities, whether the torture is state or non-state inflicted. The reasons are generally about attempting to rebuild a more resilient and respectful relationship with Self as well as building socio-cultural-relational security. My points come from being present with women therefore my response needs to identify this sex/gendered reality
Women's reasons for needing to tell are to:
1. Undo dehumanization – To be victimized such as being tortured is dehumanizing, to tell and be listened to means that someone cares, cares enough to listen respectfully.
2. Undo objectification – Which is the feeling/perception that comes when one's humanity is denied and one becomes an object to the perpetrator(s); being listened to as a person sends the intrapersonal question of: “I’m being seen as a person first versus just the horror endured”.
3. Break their sense of emotional aloneness – That is, without anyone to help them at the time of their victimization can leave them trapped in an ongoing sense of emotional aloneness, therefore to be able to speak and be respectfully heard helps to break this emotional aloneness.
4. Break their sense of powerlessness – That is, overpowered, say in a gang raping ordeal, they are often powerless even to speak, therefore to be able to speak and be heard can help to re-stabilize their empowerment and recapture some fragment of intra-personal control.
5. Restore a sense of human dignity – Which can occur when listened to, heard/understood and believed.
6. Help formulate language – Victimization that is unconscionable is often initially felt as beyond human language to describe, given an opportunity to tell can help to increase her ability to feel competent to speak/describe her ordeals.
7. Restore personhood worthiness – Telling and being heard/understood sends the message that as a human person one is worthy of being listened to, therefore builds Self-worth.
8. Heal humiliation – Given the right to speak, be heard and be understood says that it is not her fault, that she is not to blame.
9. Heal 'something must be wrong with me' - When one woman hears that other women have endured similar ordeals this helps break an internalized belief that she did not cause the perpetrator to do as he/she did.
10. Break the silence and fear of stigmatization – Social reject hurts and causes pain similar to physical pain because social inclusion is a human survival need; exclusion also, simply put, hurts our brains as well as our bodies and our spirits.
11. Achieve both personal and social justice – Being able to tell, beheard and understood is essential to healing.
12. See the perpetrator(s) held accountable – Promotes the right to Self-justice and/or prevention of others being harmed.
13. Stimulate motivation/activism – If personal and social justice occurs from this sometimes will flow the decision to become involved in some form of activism; helping others has been shown to promote wellness.
14. Relieve survivor guilt – Telling and social activism can provide a sense of gaining justice for those who did not survive and promote a 'reason' why one survived and others did not.
15. Promote women’s human rights equality – For women telling, knowingly/unknowingly, is a challenge to the socio-cultural misogynistic-based patriarchal abuse of power with sexualized victimization being so predominately gender/sex based.
These are some insights based on my and my colleague's experiences. Some reasons for telling are intra- and inter-personnel, others are social reasons why a person, a woman, wants to speak, be heard and understood. I include being heard and understood as two separate critical components to telling because a person can tell and be told they are being listened to but not really be understood. My colleague and I are told repeatedly that “you really understand”, so this is important feedback to note. Also, it is important to note that telling can come with risks because the ‘listener’ may become seduced by the content, may become voyeuristic in their questions, or the listener's non-verbals might send a message that they cannot cope which then silences the woman’s need to tell all, to tell the minute details.
I share this input in case it may offer some insights as to why people want to tell.
Respectfully,
Persons Against Ritual Abuse-Torture and Other Forms of Non-State Actor Torture
Web: www.ritualabusetorture.org
Phone/Fax: 1-902-895-6659
Jeanne Sarson, Canada
Working with a network of NGO
Agnieszka Raczynska of Red Nacional de Organismos Civiles de Derechos Humanos, Mexico
Thank you all, for the great comments, I have been reading and learning from all of you.
I work for a NGO network in Mexico (Red Nacional de Organismos Civiles de Derechos Humanos “Todos los derechos para todas y todos”) and we have developed our own monitoring system (Sistema de Monitoreo de Derechos Humanos, based on the one that Huridocs has). It took us two years but finally we are getting to the final stage of the project. In our network there are 68 NGO that work all over the country, and all are different. Some of them have only one or two people working, other have a large staff, some work in the mountain of Guerrero, some in Mexico City, some in Chiapas, they specialize on different topics or rights (women, indigenous people, labor rights, access to justice, etc), and of course a large amount of the NGO document human rights violations and use different methods for it or have no method but steel collect valuable data.
Our main goal was to have a system that any organization could use, big or small, and those they would not need Internet to access it. We have been dealing with interesting stuff. Some of our colleagues are resilient to star “using” the system because they think that because it is a database it is something very sophisticated. It is not. Once they try it, they love it and continue using it in their every day work as a tool that helps to store and systematize all the information on human rights violations. It is difficult for some ONG that do not use a lot of technology in their every day work to start doing it because they think that this will be very difficult, and that they will have to hire someone with special skills. So we’ve been working to develop something easy to install, to crate new users and passwords, to login, to do backups, etc. It has been a challenge.
There is a question also of the “double work”. A very small amount of organization has a database. The one who have, they have been exploring the new tool and fill very happy with it, but the ones that haven’t use a database until now, are saying that it will take the double amount of time because they have to put first all the information on paper (as they always have) and then put it on the database. And this will take twice the time. But when you show them all the outputs (reports) they will have from all the information they storage in the database they get really exited and are much more motivated. Eventually they understand that this will save them time in the future.
There is also the issue of sharing information. This is not an easy one. There are NGO that are very resilient on sharing their information with others, not only for safety reasons but also there is the issue of how this information will be use in the future, who will get the credit, etc. Some users are saying that they will use the local database but are not sure about sending the information and sharing it with others.
There is also the big challenge of working with our “system developer” of the project. It has been a challenge to find a common language between us and fulfill the needs that we have and understand the possibilities of developing or transforming our ideas in something tangible.
It is a challenge to fulfill the expectations of a network of NGO, believe me. It has been a great learning for all of us and I hope we will get to the goal of having 68 users this year and be able to collect data from all the NGO. This will be great because there is no other HR network in Mexico and all this information is very valuable and we all have a lot of possibilities to use is and publicize it.
Saludos desde México!
Agnieszka Raczynska of Red Nacional de Organismos Civiles de Derechos Humanos, Mexico
Hosting multiple secure instances of the data to survive crisis
Agnieszka -
Thanks for your post - I'd be very interested in hearing more about the database platform created by your organization. Is it open-source software? Is it scalable? Is the data centralized or distributed? Are you partnering with an organization outside Mexico to backup the system periodically?
Another point to help you sell this to your constituents: if you can host multiple secure instances of the data in remote storage, then your data will be more likely to survive a crisis, whether this be a flood, earthquake, confiscation, or outright attack/destruction. The current situation in Honduras and Haiti, and in 2009, the seizure of the records of the Russian human rights group, Memorial, show that these are very real possibilities.
Patrick Stawski - Human Rights Archivist, Duke University Libraries
Re: Patricks questions on the Red Monitorig System
Agnieszka Raczynska of Red Nacional de Organismos Civiles de Derechos Humanos, Mexico
Thank you for all the interest in our project, and all your questions!
First of all, I want to tell that we have been working with a great teem (Adolfo Dunayevich and Aida María Noval). Adolfo Dunayevich has been the application developer and you can contact him for more questions about the application: adbuzon [at] gmail [dot] com
The whole application is strictly built on open source software: Postgresql + Python + other open source libraries.
Postgresql is scalable. The application can run on a pentum III/256 mb ram
Each organization runs its own installation. The application has export/import capabilities, in order to have consolidation functionality at the whole HR network.
On the technical ground, the application can dump the whole database. Is matter of each member organization to setup that kind of agreement.
Agnieszka Raczynska of Red Nacional de Organismos Civiles de Derechos Humanos, Mexico
Saludos - que buen trabajo!
Agnieszka:
Saludos desde Chicago!
Your work with the Red sounds fascinating. It is really impressive that you have created a unified data monitoring system for 68 Mexican NGOs.
That is no mean feat.
Do you have a copy of the forms you use? Do you gather testimonies as well as case specific violation data?
When you describe the problems of sharing information, is that because of security issues and contact information? Or, is it just a lack of confidence? Do you present general reports based on the data from all the partner NGOs?
Can one NGO access information collected by another regarding a similar violation?
Also, we have a manual on using the Inter-American System of Human Rights as a tool for advocacy with a special focus on indigenous issues in Mexico. If you'd like acop please email me at drothenb [at] depaul [dot] edu
It's in Spanish.
Daniel Rothenberg
Managing Director of International Projects
International Human Rights Law Institute
DePaul University College of Law
Chicago, IL USA
Re: Saludos - que buen trabajo!
Agnieszka Raczynska of Red Nacional de Organismos Civiles de Derechos Humanos, Mexico
Do you have a copy of the forms you use? Yes, you can contact me at: aga [at] redtdt [dot] org [dot] mx . Do you gather testimonies as well as case specific violation data? We gather case specific violation data.
When you describe the problems of sharing information, is that because of security issues and contact information? Or, is it just a lack of confidence?
I would say that is both: in some cases is security issues but mostly is lack of confidence. Also, collective decisions about sharing information haven’t been made yet. We will have to discuss these issues along the way and come to collective agreements on issues of concern.
Do you present general reports based on the data from the entire partner NGOs? In the future, the goal is to be able to present general reports on the human rights situation in Mexico based on the information the NGO send to the consolidated database. How it works now, for example for the reports that we present don the Inter American Commission of Human Rights or the UN, it takes us a lot of time to gather all the information from the NGO. Also, each NGO can issue their own reports for their own projects or activities. I must clarify that at this stage of the project not all the NGO are using the system, we are trying to get as much users as possible.
Can one NGO access information collected by another regarding a similar violation? No, at this initial stage one NGO cannot directly access information of other NGO. This is also part of the issue of sharing information and having agreements. It can be done in the future.
Thank you so much for all your questions! I woul love to hear more from you and your work.
Saludos,
Agnieszka Raczynska of Red Nacional de Organismos Civiles de Derechos Humanos, Mexico
testimonies...
Dear Agnieszka:
We have also done quite a bit of work using the Inter-American System.
Where our partner NGOs have presented petitions or public audiences (audiencias publicas), the material they present is gathered by each group using their own systems. Your work can likely provide enormous help for aiding orgnaizations around Mexico to work cooperatively.
As you know the Inter-American system is really slow. However, we have seen some impressive victories as a result of the politicla pressure that comes from public audiences, as well as from site visits by the Commission.
In this discussion earier, I posted a brief overview of our methodology for gathering testimonies in a conflict zone - in this case, Iraq.
We found the use of social networks and story-telling to be a very powerful means of documenting violations.
I have lots of material on how we trained interviwer, set up the database, moved information around the country, etc.
There is much to discuss..
Daniel Rothenberg
Managing Director of International Projects
International Human Rights Law Institute
DePaul University College of Law
Chicago, IL USA
Challenges of working with a network to collect data
Agnieszka,
Thank you for sharing your very inspiring work with 68 organizations in Mexico to create a network for collecting and sharing information. Your comment, "It is a challenge to fulfill the expectations of a network of NGOs, believe me." really made me think of another collective of NGOs that successfully created shared documentation and a growing archive of information.
Memoria Abierta in Argentina has created a collective archive among 7 organizations (far fewer than the number you are working together with to coordinate information). Memoria Abiera shared their experience and on-going process in a tactical notebook called, "Open Memory: Using inter-institutional cooperation to facilitate access to human rights"
Here is the link to the Spanish: Memoria Abierta: Una experiencia de Coordinación Interinstitucional para facilitar el acceso a la información sobre Derechos Humanos
They outlined a number of challenges that I'm sure you can relate to as well:
The need to Improve the actual state of the information/archives:
The need to deal with these varying conditions required several strategies
Tensions in the coordination processes itself - including:
I hope you will continue to share the process and outcomes of the efforts of the Red Nacional de Organismos Civiles de Derechos Humanos in Mexico. We all have a great deal to learn from your experiences! I hope you are able to answer some of the many questions asked by Daniel.
Nancy Pearson, New Tactics in Human Rights Training Manager
Hi Aga, thanks for
Hi Aga, thanks for describing your project in such detail!
Its an ambitious effort to unite so many NGOs around the same tool, and this really deserves a good case study, because there is a lot to learn from your experience.
I have the impression that one of the most important impacts of the project is the strengthening of the NGOs concerned, in their capacity to manage data, and in their understanding of how IT, and applying a methodology systematically, can help.
Using a "who did what to whom" system, like you have chosen to do, is always a strong learning experience for an NGO. Because its not that easy to read into a narrative and identify the rights affected, and the violations! Its only when you really get down to it any analyse cases, that you start to discover all sorts of questions that you never thought of before!!
Who did what to whom... it sounds easy, its not. Its easy to try out: take a case, and try to map out who did what to whom, using a table: victim, act, perpetrator(s), place and date. Then ask your colleagues to do the same. Do you get the same results??? I am sure that you will have some very interesting and hot debates!!!! Just try!
And if these questions are frequently debated within the documentation team, then you reach a consensus on how to record your cases consistently, meaning analyst A will come to the same conclusions as analyst B. Consistent data makes good data.
I learn something new from the specific stories that we analyze that are usually submitted by the participants, every time we do a training.
Daniel D'Esposito, HURIDOCS
Assessing impact
Thanks to all for the interesting and stimulating discussion.
I am currently looking at frameworks that could be used by NGOs for the evaluation
of their documentation systems. This work is intended to address the problems of both formative and summative evaluation. Formative evaluation is done during the system implementation and looks at issues such as functionality and usability. Summative is done after the system/database has been in use for a period of time; the objective is to provide an overall assessment of the benefits and costs.
The latter is also about sharing lessons learned – identifying what may be useful outside an organization; providing the benefit of others’ experience to NGOs embarking on their own documentation project.
In terms of evaluation, the realtime operational model has the advantage of producing quicker results (or not). But if the end use is as described by Jana - to prove the existence of human rights violations and to document them for historical or legislative purposes – the real impact (and scrutiny) of the data comes later. And the impact of an NGO’s investment in time and resources is not as visible to them in the short term.
Many of the points raised in the discussions are pertinent to the issue of course. But I’d be interested in any further comments the participants might have. What approaches should an NGO adopt in order to assess the value in their documentation work?
Good question: I think
Good question: I think there are several aspects to think about here.
First, what types of data are going to be incorporated into the documentation system(s)? For example, random sample survey data quality is judged on several factors. There is the quality of the sample frame, or list of individual units that were randomly selected to be part of the group that provides data. There is the quality of the interviews, the amount of nonresponse (to one question or the whole survey), and so on. In terms of the data stored, both the data collected via the survey and the paradata -- that is, the data about how the data were collected -- should be kept. That data includes the length of the interview, who the interviewer was, what day the interview occurred on, if others were present during the interview, if the interviewer noted anything significant about the interview, and so on. I imagine a complete set of data related to a random sample survey of human rights abuses might contain the scanned forms, the data in a database, and the paradata.
In the case of video/digital recordings of testimonies, I'd imagine important data to store would include where/when the testimony occurred, and other related information. But I am certainly no expert on those types of data.
Of course, there are lots of other types of data. An overall assessment of a project, I think, would include an assessment of the types of data collected (do they, together, provide good coverage of the human rights abuses?), the quality of each type of data, and the paradata associated with each type of data, as well as an assessment of the archiving/storage technique both for safety/confidentiality concerns and also permanency.
Perhaps the archivists could jump in here?
Jana Asher Executive Director StatAid www.stataid.org
Documenting Human Rights Violations
Leonida
Documentation
This is the process of recording or
capturing an event or an occurrence for the purpose of using it as
an advocacy tool ,an educational tool or a tool to create change
Determining what kinds of
information to collect
This is dictated by the kind of
violation being experienced , timing ( eg during a civil strife
within a country or during an invasion from a neighbouring country),
the type of perpetrators for instance is it the state ( which in
most cases has the machinery for stifling all sorts of
investigations especially through disappearance of the
investigators in a given case), the number of people experiencing
the violations ( if the number is large then the information to be
collected will be bulky), the terrain also affects information
collection in terms of accessibility to the victims, equipments
such as computers also affects information collection especially when
it comes to recording.Sensitivity of the information and whether the
information to be collected is deemed as “top secret” , this can
present problems and risks for the investigator collecting the
information .
Ways to acquire, store and organize the
information
Ways through which the information can
be acquired are through the use of videos, use of Dictaphone for
taping orally from the respondents, organizing discussion groups
with victims of a violation such as police perpetrated violence in a
given area .The information can also be got from key informants in a
given situation such as the provincial administration if it concerns
brutality among Administration Police, the area chief if it
concerns illegal swoops etc, information can also be got from
talking to people working in various departments related to where
the violation has taken place .
The best place to store the information
would be either in video tapes and having back ups of the information
stored elsewhere. The information can also be stored in computers but
with back ups in case of a virus attack of the computer system ,
reprogramming or mistaken deletion of the information.
Purposes of documentation
We document to advocate for the rights
of the marginalized and those who are going through violations.
We also document inorder to have
evidence to a claim for instance if our claim is that children are
not going to school because there are no schools in the area, then
we document the evidence that children are actually not going to
school and that schools are not available in an area.If we talk about
brutality among the police force , we document inorder to have
evidence to show the brutality.
Documentation is also a process of
raising the consciousness of the affected people to make them start
questioning why they are undergoing the brutality , start to
question why they are going through the brutality
Risks , challenges and opportunities
of documentation
The risks of documentation include the
information being considered top secret such that one becomes hunted
down by the government or the perpetrators of the violence.This puts
the investigator at a risk of execution or being injured depending on
the type of information they have access to.
The other risk of documentation is
abrupt loss of the information either through wrongful or malicious
deletion, computer corruption due to a virus, accidents such as
intrusion and vandalism.
Challenges of documentation are living
in a country where the freedom of information is repressed or where
various Acts have been put in place to deny the public or any
investigator the right to access information from various sources.
The other challenge is the lack of up
to date equipments ,an organization may wish to document rights
violations but not have the necessary equipments or the knowledge on
how to document, what to document and when to document and how to go
about searching for information
Opportunities that exist for
documentation are when a country has a constitutional review process
such that a new constitution is in process of being put in place ,
people are bound to become more vigilante to observe which rights
have not been adequately addressed by the constitution.
The other opportunity is when a new
government is in power, in many cases during campaigns parties give
out manifestos with all sorts of goodies , so when it comes maybe to
midterm into their term of in the last leg of the given governments'
term then documentation can be done to take stock of what that
particular government has done vis -a -vis its party manifesto.
Thank you
Zico Ameca and Leonida Odongo
Ebony Youth and Orphans Support
Initiative Kenya
P.O Box 17237 00510
Email: Eyosik2004 [at] yahoo [dot] com
Leonida
Very Interesting information shared
Thanks for sharing such a useful information, will be checking out more from yours.
Western Advanced Central University | Western Advanced Central University | Western Advanced Central University