Reputation Workshop: 2012
One of the most important parts of our design is the reputation model that will underpin the system. A reputation model is a way for a user community to collectively regulate and calibrate the contributions of its members. This is a well-established field of study, encompassing many years of academic research and with numerous examples of working systems deployed in the real world.
Thanks to a generous grant from the Alfred P. Sloan Foundation we hosted a Workshop on February 22-24, 2012 in San Francisco at the Fort Mason Center, in order to share with and learn from key members of the academic, nonprofit, and commercial sectors who research and use reputation systems. View the attendee list.
Note: Some social media posts have become unavailable since the publication of this record.
The day before and morning of …
En route to San Francisco for the @hypothes_is reputation workshop: http://t.co/DlsQlSA5 #repcon
— Alberto Pepe (@albertopepe) February 21, 2012
In San Francisco for a pile of events; first up is #repcon (http://t.co/keU2kCvY)
— Josh Greenberg (@epistemographer) February 22, 2012
Hypothes.is workshop at San Francisco, CA — http://t.co/uwzaQAOh
— Elizeu Santos-Neto (@elsantosneto) February 22, 2012
The workshop website, attendee list, and agenda. We’d like to thank the Alfred P. Sloan Foundation for their generous support that made it all possible.
The distinguished guests gather in the Golden Gate room at the Fort Mason Center in San Francisco, California. Hypothesis founder Dan Whaley speaks to the task at hand: how should we build a peer-review layer for the whole web?
http://twitter.com/skonkiel/status/172381822557224961
Stance in communication fundamental for processing annotations at aggregate level. (see for eg http://t.co/gg14DnVf ) #repcon
— Rob Sanderson @azaroth42@w3c.social (@azaroth42) February 22, 2012
http://twitter.com/JonMwords/status/172391585227608064
Day One of the conference was loaded with informative, thought-provoking presentations by experts from the academic and commercial worlds. Jeff Atwood, Cofounder of StackOverflow, was first up to share his experience and insight into the dynamics of reputation system.
@codinghorror showing us Area51 where members lobby for new sites. Vote for library and info science! http://t.co/xY7nZ1IQ #repcon
— Heather Ford (@hfordsa) February 22, 2012
http://twitter.com/mrgunn/status/172411754511474688
http://twitter.com/mrgunn/status/172416219905929216
Give someone superman privileges without instructions on how to use them and they'll start smashing into buildings @codinghorror at #repcon
— Dario Taraborelli (@ReaderMeter) February 22, 2012
Some Stackoverflow users have visited the site 1,000 consecutive days or more. Got the FANATIC badge. :) #repcon
— Alberto Pepe (@albertopepe) February 22, 2012
The general manager of Reddit, Erik Martin, stopped by to share hard lessons they’ve learned about online communities.
http://twitter.com/mrgunn/status/172406855929303040
#reddit enabled communities to edit the CSS which enabled them to structure comments and reputation in relevant ways #repcon
— Heather Ford (@hfordsa) February 22, 2012
wow – @hueypriest showcasing Snack Exchange, a thriving community of snack trading individuals powered by reddit #repcon
— Dario Taraborelli (@ReaderMeter) February 22, 2012
http://twitter.com/JonMwords/status/172408513857994753
"99% of the good ideas did not come from the #reddit staff" – Erik Martin on Reddit's moderation/reputation systems #repcon
— Heather Ford (@hfordsa) February 22, 2012
Double-agent Redditors go to black-hat sites offering to sell upvotes, then report the cheaters to mods, sez mgr @hueypriest. #repcon
— Jason Priem (@jasonpriem) February 22, 2012
RT @jasonpriem: Reddit has 12 employees, Stack Exchange has 50. Explains much diff. in moderation policies, observes @codinghorror #repcon
— Think like a scientist!!! (@BrianSMcGowan) February 22, 2012
http://twitter.com/JonMwords/status/172421075332898816
Then it was time to hear from a few of the most respected, and most cited, researchers in the field of reputation, Karl Aberer and Chris Dellarocas.
Agree. "@ReaderMeter: @tournesol67 – we need a serendipity dial to break the filter bubble "show me only content from weirdos" #repcon"
— interlinear annotation separator (@tilgovi) February 23, 2012
Dario Taraborelli, Wikipedia researcher, with a link to the book that Professor Dellarocas mentioned (co-authored by advisor Dr. Paul Resnick)
Building Successful Online Communities: Evidence-Based Social Design, edited by P. Resnick and Bob Kraut http://t.co/iyxg6vmH #repcon
— Dario Taraborelli (@ReaderMeter) February 22, 2012
A session on identity followed, with presentations by Drummond Reed, Kaliya Hamlin, and an overview of Wikitrust by Luca de Alfaro.
http://twitter.com/mrgunn/status/172492790696124416
http://twitter.com/JonMwords/status/172481738143043587
Reputation topic still ticking in everyone’s brain that day after all presentations are over:
http://ethnographymatters.net/2012/02/24/online-reputation-its-contextual/
@hfordsa sums #repcon day 1: thoughts on presentations by @hueypriest @codinghorror and @dellarocas. http://t.co/FcBJo0gX @ethnomatters
— Hypothesis (@hypothes_is) February 27, 2012
#repcon Shibboleth is another Verified Anonymous example in use today around the world. http://t.co/fjcz29RO
— Rob Sanderson @azaroth42@w3c.social (@azaroth42) February 23, 2012
http://twitter.com/mrgunn/status/172479844897140736
"always a trade-off between reputation algorithm complexity & social acceptability" cf. Impact Factor, h-index. Facile but grokable. #repcon
— Jason Priem (@jasonpriem) February 23, 2012
Persistent identifiers for anything are impossible, therefore any identifier should be an (identifier, timestamp) tuple. #repcon (@tilgovi)
— Rob Sanderson @azaroth42@w3c.social (@azaroth42) February 23, 2012
http://twitter.com/JonMwords/status/172514750771625984
Day Two begins with one of the field’s most well known names, Professor Paul Resnick of the University of Michigan.
Paul Resnick: you mitigate the coldstart problem if you formalize it as maximing the utility for users to join now vs joining later #repcon
— Dario Taraborelli (@ReaderMeter) February 23, 2012
Paul Resnick: use bots to substitute for people who aren't there yet #coldstart #repcon
— Dario Taraborelli (@ReaderMeter) February 23, 2012
http://twitter.com/JonMwords/status/172737230811574273
http://twitter.com/JonMwords/status/172765681274728448
Open Space sessions: tell the group what you want to talk about, then post it up on the wall!
We might want to know:
http://twitter.com/mrgunn/status/172828534572728321
At the end of Day Two, we passed the microphone so everyone had a chance to tell the group what they learned from the day’s interactions.
Fantastic discussion this evening with @ReaderMeter and @dwhly about Memento & OAC, and their utility for Wikipedia. Really excited! #repcon
— Rob Sanderson @azaroth42@w3c.social (@azaroth42) February 24, 2012
John DuBois begins Day Three.
http://twitter.com/JonMwords/status/173111364192178177
http://twitter.com/pirroh/status/173188660290789378
#repcon a must read on how humans use social signals to evaluate information: Sperber et al. on epistemic vigilance http://t.co/diRZ5USO
— Dario Taraborelli (@ReaderMeter) February 24, 2012
John Perry Barlow, Hypothesis Board Member and EFF Co-founder, provides the closing remarks for the workshop.
https://www.youtube.com/watch?v=iH5HxbzokbM
The syntheses start to roll in…
http://twitter.com/JonMwords/status/174214324674510848
#repcon a must read on how humans use social signals to evaluate information: Sperber et al. on epistemic vigilance http://t.co/diRZ5USO
— Dario Taraborelli (@ReaderMeter) February 24, 2012
Gr8 #repcon chat w/ Stack Exchange cofounder @codinghorror. Could SE power all sci comm? Says no, can't rely on for-profit system. #attaboy
— Jason Priem (@jasonpriem) February 27, 2012
http://en.wikipedia.org/wiki/User:DarTar/Hypothes.is_Reputation_Workshop
My notes and highlights from the @Hypothes_is Reputation workshop and what it could bring to #Wikipedia http://t.co/GR3ZX2SN #repcon
— Dario Taraborelli (@ReaderMeter) March 1, 2012
Interesting report on last week's insightful Reputation Workshop hosted by @hypothes_is. Thanks, @ReaderMeter! http://t.co/y9yd7d3u #repcon
— Fabrice Florin (@fabriceflorin) March 1, 2012
https://readwrite.com/2011/10/20/hypothesis_a_peer-review_layer_for_the_internet/
http://twitter.com/nettechnews/status/175665653578072065
http://twitter.com/bitcoinmoney/status/176039879694749696
Our highlight reel of the whole event…
The list of attendees with Twitter accounts…
Our twitter list of all workshop attendees… https://t.co/D2lrLKBL #repcon
— Hypothesis (@hypothes_is) February 21, 2012