Галерея 3450077

Галерея 3450077
Shortcuts zu anderen Sites, um außerhalb von DuckDuckGo zu suchen Mehr erfahren
Find local businesses, view maps and get driving directions in Google Maps.
2. Jan. 2023 MLS ID: 3450077 Updated: 1/2/2023 Added: 60 day (s) ago Interior Number of Rooms: 7 Interior Features: Master Downstairs, Eat-in Kitchen, Formal Dining Room, Master Bath Appliances: Dishwasher, Dryer, Oven, Washer Flooring: Hardwood Rooms Bathrooms Total Bathrooms: 2 Full Bathrooms: 2 Bedrooms Total Bedrooms: 3 Other Rooms Kitchens: 1 Exterior
Auditing for Discrimination in Algorithms Delivering Job Ads ... for.
3. Juni 2021 Ad platforms such as Facebook, Google and LinkedIn promise value for advertisers through their targeted advertising. However, multiple studies have shown that ad delivery on such platforms can be skewed by gender or race due to hidden algorithmic optimization by the platforms, even when not requested by the advertisers.
9. Apr. 2021 Building on prior work measuring skew in ad delivery, we develop a new methodology for black-box auditing of algorithms for discrimination in the delivery of job advertisements. Our first contribution is to identify the distinction between skew in ad delivery due to protected categories such as gender or race, from skew due to differences in ...
25. Dez. 2022 Around the holidays you have to spend alot of time surrounded by unwanted company. Uncle Frank from Home Alone is a prime example.Giphy Images.But, Josh Allen and the Bills have to be the complete opp...
Hilf deinen Freunden und Verwandten, der Seite der Enten beizutreten!
Schütze Deine Daten, egal auf welchem Gerät.
Bleibe geschützt und informiert mit unseren Privatsphäre-Newslettern.
Wechsel zu DuckDuckGo und hole dir deine Privatsphäre zurück!
Benutze unsere Seite, die nie solche Nachrichten anzeigt:
Schütze Deine Daten, egal auf welchem Gerät.
Bleibe geschützt und informiert mit unseren Privatsphäre-Newslettern.
Wir zeigen Ihnen, wie du deine Privatsphäre online besser schützen kannst.

Sign in

Register

Auditing for Discrimination in Algorithms Delivering Job Ads
Published: 03 June 2021 Publication History
WWW '21: Proceedings of the Web Conference 2021
Qualifiers research-article Research Refereed limited
Overall Acceptance Rate 1,899 of 8,196 submissions, 23%
[1] ACLU. Facebook EEOC complaints. https://www.aclu.org/cases/facebook-eeoc-complaints?redirect=node/70165. Google Scholar [2] Ali, M., Sapiezynski, P., Bogen, M., Korolova, A., Mislove, A., and Rieke, A.Discrimination through optimization: How facebook’s ad delivery can lead to biased outcomes. In Proceedings of the ACM Conference on Computer-Supported Cooperative Work and Social Computing (2019). Google Scholar Digital Library [3] Ali, M., Sapiezynski, P., Korolova, A., Mislove, A., and Rieke, A.Ad delivery algorithms: The hidden arbiters of political messaging. In 14th ACM International Conference on Web Search and Data Mining (2021). Google Scholar Digital Library [4] Andrus, M., Spitzer, E., Brown, J., and Xiang, A.”What We Can’t Measure, We Can’t Understand”: Challenges to demographic data procurement in the pursuit of fairness. In ACM Conference on Fairness, Accountability, and Transparency (FAccT) (2021). Google Scholar Digital Library [5] Angwin, J., and Paris Jr., T.Facebook lets advertisers exclude users by race – ProPublica. https://www.propublica.org/article/facebook-lets-advertisers-exclude-users-by-race, October 26, 2016. Google Scholar [6] Angwin, J., Scheiber, N., and Tobin, A.Dozens of companies are using Facebook to exclude older workers from job ads – ProPublica. https://www.propublica.org/article/facebook-ads-age-discrimination-targeting, December 20, 2017. Google Scholar [7] Asplund, J., Eslami, M., Sundaram, H., Sandvig, C., and Karahalios, K.Auditing race and gender discrimination in online housing markets. In Proceedings of the International AAAI Conf. on Web and Social Media (2020). Google Scholar [8] Barocas, S., and Selbst, A. D.Big data’s disparate impact. California Law Review 104, 3 (2016), 671–732. Google Scholar [9] Bogen, M., and Rieke, A.Help wanted: an examination of hiring algorithms, equity, and bias. Technical report, Upturn (2018). Google Scholar [10] Bogen, M., Rieke, A., and Ahmed, S.Awareness in practice: tensions in access to sensitive attribute data for antidiscrimination. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (2020). Google Scholar Digital Library [11] CFR. 12 CFR section 202.4 (b)—discouragement. https://www.law.cornell.edu/cfr/text/12/202.4. Google Scholar [12] CFR. 24 CFR section 100.75—discriminatory advertisements, statements and notices. https://www.law.cornell.edu/cfr/text/24/100.75. Google Scholar [13] Cohen, A., and Nissim, K.Linear program reconstruction in practice. Journal of Privacy and Confidentiality 10, 1 (2020). Google Scholar Cross Ref [14] Datta, A., Datta, A., Makagon, J., Mulligan, D. K., and Tschantz, M. C.Discrimination in online personalization: A multidisciplinary inquiry. FAT (2018). Google Scholar [15] Datta, A., Tschantz, M. C., and Datta, A.Automated experiments on ad privacy settings. Proceedings on Privacy Enhancing Technologies, 1 (2015). Google Scholar Cross Ref [16] DiversityReports.org. Diversity reports - Nvidia. https://www.diversityreports.org/company-information/nvidia, 2020. Last accessed on Feb 28, 2021. Google Scholar [17] Dominos. Gender pay gap report 2018. https://investors.dominos.co.uk/sites/default/files/attachments/dominos-corporate-stores-sheermans-limited-gender-pay-gap-2018-report.pdf, 2018. Last accessed on October 6, 2020. Google Scholar [18] Dwork, C., and Ilvento, C.Fairness Under Composition. In 10th Innovations in Theoretical Computer Science Conference (ITCS) (2019). Google Scholar [19] Dwork, C., and Roth, A.The algorithmic foundations of differential privacy. Foundations and Trends in Theoretical Computer Science(2014). Google Scholar [20] Facebook. Choose the right objective. https://www.facebook.com/business/help/1438417719786914. Google Scholar [21] Facebook. Marketing API—Facebook for developers. https://developers.facebook.com/docs/marketing-apis/. Google Scholar [22] Facebook. Simplifying targeting categories. https://www.facebook.com/business/news/update-to-facebook-ads-targeting-categories/, 2020. Google Scholar [23] Faizullabhoy, I., and Korolova, A.Facebook’s advertising platform: New attack vectors and the need for interventions. In IEEE Workshop on Technology and Consumer Protection (ConPro) (2018). Google Scholar [24] Gelauff, L., Goel, A., Munagala, K., and Yandamuri, S.Advertising for demographically fair outcomes. arXiv preprint arXiv:2006.03983 (2020). Google Scholar [25] Hardt, M., Price, E., and Srebro, N.Equality of opportunity in supervised learning. In Advances in Neural Information Processing Systems (2016). Google Scholar Digital Library [26] Imana, B., Korolova, A., and Heidemann, J.Dataset of content and delivery statistics of ads used in “Auditing for discrimination in algorithms delivering job ads”. https://ant.isi.edu/datasets/addelivery/. Google Scholar [27] Kayser-Bril, N.Automated discrimination: Facebook uses gross stereotypes to optimize ad delivery. https://algorithmwatch.org/en/story/automated-discrimination-facebook-google/, October 18, 2020. Google Scholar [28] Kim, M. P., Korolova, A., Rothblum, G. N., and Yona, G.Preference-informed fairness. In Innovations in Theoretical Computer Science (2020). Google Scholar Digital Library [29] Korolova, A.Privacy violations using microtargeted ads: A case study. Journal of Privacy and Confidentiality 3, 1 (2011), 27–49. Google Scholar Cross Ref [30] Lambrecht, A., and Tucker, C.Algorithmic bias? an empirical study of apparent gender-based discrimination in the display of STEM career ads. Management Science 65, 7 (2019), 2966–2981. Google Scholar Digital Library [31] Laura Murphy and Associates. Facebook’s civil rights audit – progress report. https://about.fb.com/wp-content/uploads/2019/06/civilrightaudit_final.pdf, June 30, 2019. Google Scholar [32] Laura Murphy and Associates. Facebook’s civil rights audit – Final report. https://about.fb.com/wp-content/uploads/2020/07/Civil-Rights-Audit-Final-Report.pdf, July 8 2020. Google Scholar [33] Lecuyer, M., Spahn, R., Spiliopolous, Y., Chaintreau, A., Geambasu, R., and Hsu, D.Sunlight: Fine-grained targeting detection at scale with statistical confidence. In CCS (2015). Google Scholar [34] LinkedIn. Ads Reporting. https://docs.microsoft.com/en-us/linkedin/marketing/integrations/ads-reporting/ads-reporting. Google Scholar [35] LinkedIn. Audience Counts. https://docs.microsoft.com/en-us/linkedin/marketing/integrations/ads/advertising-targeting/audience-counts. Google Scholar [36] LinkedIn. Campaign quality scores for sponsored content. https://www.linkedin.com/help/lms/answer/85406. Google Scholar [37] LinkedIn. LinkedIn marketing developer platform. https://docs.microsoft.com/en-us/linkedin/marketing/. Google Scholar [38] LinkedIn. Select a marketing objective for your ad campaign. https://www.linkedin.com/help/lms/answer/94698/select-a-marketing-objective-for-your-ad-campaign. Google Scholar [39] Merrill, J. B., and Tobin, A.Facebook moves to block ad transparency tools – including ours. https://www.propublica.org/article/facebook-blocks-ad-transparency-tools, January 28, 2019. Google Scholar [40] Mozilla. Facebook’s ad archive API is inadequate. https://blog.mozilla.org/blog/2019/04/29/facebooks-ad-archive-api-is-inadequate/, 2019. Google Scholar [41] Narayanan, A., and Shmatikov, V.Robust de-anonymization of large sparse datasets. In 2008 IEEE Symposium on Security and Privacy (2008). Google Scholar Digital Library [42] Netflix. Inclusion takes root at Netflix: Our first report. https://about.netflix.com/en/news/netflix-inclusion-report-2021, 2021. Google Scholar [43] Nissim, K., Steinke, T., Wood, A., Altman, M., Bembenek, A., Bun, M., Gaboardi, M., O’Brien, D. R., and Vadhan, S.Differential privacy: A primer for a non-technical audience. Vand. J. Ent. & Tech. L. 21 (2018). Google Scholar [44] North Carolina State Board of Elections. Voter history data. https://dl.ncsbe.gov/index.html. Downloaded on April 23, 2020. Google Scholar [45] Nvidia. Global diversity and inclusion report. https://www.nvidia.com/en-us/about-nvidia/careers/diversity-and-inclusion/, 2021. Last accessed on Feb 28, 2021. Google Scholar [46] Reisman, D., Schultz, J., Crawford, K., and Whittaker, M.Algorithmic impact assessments: A practical framework for public agency accountability. AI Now (2018). Google Scholar [47] Sandberg, S.Doing more to protect against discrimination in housing, employment and credit advertising. https://about.fb.com/news/2019/03/protecting-against-discrimination-in-ads/, March 19, 2019. Google Scholar [48] Sandvig, C., Hamilton, K., Karahalios, K., and Langbort, C.Auditing algorithms: Research methods for detecting discrimination on internet platforms. Data and discrimination: converting critical concerns into productive inquiry 22 (2014), 4349–4357. Google Scholar [49] Sapiezynski, P., Ghosh, A., Kaplan, L., Mislove, A., and Rieke, A.Algorithms that ”don’t see color”: Comparing biases in lookalike and special ad audiences. arXiv preprint arXiv:1912.07579 (2019). Google Scholar [50] Selyukh, A.Why suburban moms are delivering your groceries. NPR https://www.npr.org/2019/05/25/722811953/why-suburban-moms-are-delivering-your-groceries, May 25, 2019. Google Scholar [51] Shukla, S.A better way to learn about ads on facebook. https://about.fb.com/news/2019/03/a-better-way-to-learn-about-ads/, March 28 2019. Google Scholar [52] Speicher, T., Ali, M., Venkatadri, G., Ribeiro, F. N., Arvanitakis, G., Benevenuto, F., Gummadi, K. P., Loiseau, P., and Mislove, A.Potential for discrimination in online targeted advertising. In Proceedings of Machine Learning Research (2018), S. A. Friedler and C. Wilson, Eds. Google Scholar [53] Spencer, S.Upcoming update to housing, employment, and credit advertising policies. https://www.blog.google/technology/ads/upcoming-update-housing-employment-and-credit-advertising-policies/, 2020. Google Scholar [54] Sweeney, L.Discrimination in online ad delivery: Google ads, black names and white names, racial discrimination, and click advertising. Queue (2013). Google Scholar [55] Tobin, A., and Merrill, J. B.Facebook is letting job advertisers target only men – ProPublica. https://www.propublica.org/article/facebook-is-letting-job-advertisers-target-only-men, September 18, 2018. Google Scholar [56] U.S. Bureau of Labor Statistics. Employed persons by detailed industry, sex, race, and Hispanic or Latino ethnicity. https://www.bls.gov/cps/cpsaat18.pdf, 2018. Google Scholar [57] U.S. Equal Employment Opportunity Commission. Prohibited employment policies/practices. https://www.eeoc.gov/prohibited-employment-policiespractices. Google Scholar [58] USC. 29 USC section 623—prohibition of age discrimination. https://www.law.cornell.edu/uscode/text/29/623. Google Scholar [59] USC. 42 USC section 2000e-3—other unlawful employment practices. https://www.law.cornell.edu/uscode/text/42/2000e-3. Google Scholar [60] USC. 47 USC section 230—protection for private blocking and screening of offensive material. https://www.law.cornell.edu/uscode/text/47/230. Google Scholar [61] Venkatadri, G., Andreou, A., Liu, Y., Mislove, A., Gummadi, K. P., Loiseau, P., and Goga, O.Privacy risks with Facebook’s PII-based targeting: Auditing a data broker’s advertising interface. In IEEE Symposium on Security and Privacy (SP) (2018). Google Scholar Cross Ref [62] Venkatadri, G., and Mislove, A.On the Potential for Discrimination via Composition. In Internet Measurement Conference (IMC’20) (2020). Google Scholar Digital Library [63] Wilson, C., Ghosh, A., Jiang, S., Mislove, A., Baker, L., Szary, J., Trindel, K., and Polli, F.Building and auditing fair algorithms: A case study in candidate screening. In ACM Conference on Fairness, Accountability, and Transparency (FAccT) (2021). Google Scholar Digital Library [64] Zhang, J., and Bareinboim, E.Fairness in decision-making - the causal explanation formula. In Association for the Advancement of Artificial Intelligence(2018). Google Scholar Cross Ref
Browse All Return Change zoom level
Close modal New Citation Alert added!

Connect

Contact
Facebook
Twitter
Linkedin

Feedback
Bug Report

The ACM Digital Library is published by the Association for Computing Machinery. Copyright © 2023 ACM, Inc.
If you 'd like us to contact you regarding your feedback, please provide your contact details here.
Ad platforms such as Facebook, Google and LinkedIn promise value for advertisers through their targeted advertising. However, multiple studies have shown that ad delivery on such platforms can be skewed by gender or race due to hidden algorithmic optimization by the platforms, even when not requested by the advertisers. Building on prior work measuring skew in ad delivery, we develop a new methodology for black-box auditing of algorithms for discrimination in the delivery of job advertisements. Our first contribution is to identify the distinction between skew in ad delivery due to protected categories such as gender or race, from skew due to differences in qualification among people in the targeted audience. This distinction is important in U.S. law, where ads may be targeted based on qualifications, but not on protected categories. Second, we develop an auditing methodology that distinguishes between skew explainable by differences in qualifications from other factors, such as the ad platform’s optimization for engagement or training its algorithms on biased data. Our method controls for job qualification by comparing ad delivery of two concurrent ads for similar jobs, but for a pair of companies with different de facto gender distributions of employees. We describe the careful statistical tests that establish evidence of non-qualification skew in the results. Third, we apply our proposed methodology to two prominent targeted advertising platforms for job ads: Facebook and LinkedIn. We confirm skew by gender in ad delivery on Facebook, and show that it cannot be justified by differences in qualifications. We fail to find skew in ad delivery on LinkedIn. Finally, we suggest improvements to ad platform practices that could make external auditing of their algorithms in the public interest more feasible and accurate.
Check if you have access through your login credentials or your institution to get full access on this article.
Association for Computing Machinery
Request permissions about this article.
View this article in digital edition.
https://dl.acm.org/doi/abs/10.1145/3442381.3450077
This alert has been successfully added and will be sent to:
You will be notified whenever a record that you have chosen has been cited.
To manage your alert preferences, click on the button below.
We use cookies to ensure that we give you the best experience on our website.

Mobile Tablet Reviews Gadgets
To start receiving timely alerts, as shown below click on the Green “lock” icon next to the address bar
Click it and Unblock the Notifications
To Start receiving timely alerts please follow the below steps:
Krishna Janmashtami 2022: Govinda Aala Re! What is the significance of Dahi Handi
Lord Krishna was born in 3112 BCE: How is He still mythology?
In letter to Yogi in blood Hindu outfit member seeks permission to offer Janmashtami prayers at Shahi Masjid
Krishna Janmashtami 2022: Wishes, images, quotes to share on Gokulashtami
Janmashtami 2022: Chant these Mantras to seek prosperity and happiness of Bal Gopal on this Day
Janmashtami 2022: What Bhog you can offer to Lord Krishna as per your zodiac signs
Krishna Janmashtami 2022: Govinda Aala Re! What is the significance of Dahi Handi
Lord Krishna was born in 3112 BCE: How is He still mythology?
|

Updated: Friday, August 19, 2022, 17:05 [IST]

For Breaking News and Instant Updates

Read more about: krishna janmashtami
Places Where You Should See Holi in India in 2023
Prime Minister of Australia Anthony Albanese Visit India; See Photos
People from Brazil celebrate Holi at India Gate in New Delhi
Holi 2023 : Latest Visual Of Holi Celebration Across India
Places Where You Should See Holi in India in 2023
Prime Minister of Australia Anthony Albanese Visit India; See Photos

He defamed his own party by speaking against own country in foreign land.
He provided a good amount of ammo for BJP campaign for upcoming polls.
He lost all what he had gained from Bharat Jodo Yatra.
All of above.

Male

Female

Беременная латина занимается мастурбацией
Выебал красивую попку крупным планом
Дырки тайки в ожидании очередного хуя туриста

Галерея 3450077

Report Page