论文标题
集会和网络科学:基于浏览器的技术和社会问题研究的平台和工具包
Rally and WebScience: A Platform and Toolkit for Browser-Based Research on Technology and Society Problems
论文作者
论文摘要
经验技术和社会研究处于方法论危机。越来越多的问题涉及封闭的平台,目标内容和特定于上下文的行为。盛行的研究方法,例如调查,任务和网络爬网,姿势设计和生态有效性限制。 在参与者浏览器和设备中部署研究是一个有希望的方向。这些优势可以观察个性化的体验并在实际设置中实施UI干预措施。 我们调查使用这些方法的奖学金,注释了284篇抽样论文。我们的分析证明了它们的潜力,也表明了重复的实施障碍和缺点。 然后,我们提出集会和SDKNAME,这是一个基于浏览器的研究的平台和工具包。这些系统降低了实施障碍,并提高了衡量在线行为的科学。 最后,我们根据我们的设计目标评估集会和SDKNAME。我们报告了一项为期一个月的新闻参与试点研究的结果,分析了1,817名参与者的4,466,200个网页访问。我们还通过使用这些系统对研究人员的访谈进行了观察。
Empirical technology and society research is in a methodological crisis. Problems increasingly involve closed platforms, targeted content, and context-specific behavior. Prevailing research methods, such as surveys, tasks, and web crawls, pose design and ecological validity limitations. Deploying studies in participant browsers and devices is a promising direction. These vantage points can observe individualized experiences and implement UI interventions in real settings. We survey scholarship that uses these methods, annotating 284 sampled papers. Our analysis demonstrates their potential, but also recurring implementation barriers and shortcomings. We then present Rally and sdkName, a platform and toolkit for browser-based research. These systems lower implementation barriers and advance the science of measuring online behavior. Finally, we evaluate Rally and sdkName against our design goals. We report results from a one-month pilot study on news engagement, analyzing 4,466,200 webpage visits from 1,817 participants. We also present observations from interviews with researchers using these systems.