Prominent figures like Sam Altman, Jensen Huang, and Bernie Sanders have made sensational claims about AI, but their statements should be taken with a grain of salt. Experts like Gary Marcus argue that the public should focus on sensible policies proposed by lesser-known individuals, such as Senators Josh Hawley and Richard Blumenthal, and cybersecurity expert Asad Ramzanali, who advocate for stronger regulations and a Cyber Safety Review Board. AI summary
Firehose
Filtered to tagged “AI ethics” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives
Browse by tag
artificial intelligence 89continual learning 27AI 23AI safety 13reinforcement learning 13agentic coding 12open-weight models 12AI agents 10machine learning 9AI ethics 8cybersecurity 8existential risk 8language models 8natural language processing 8ethics 7Reinforcement learning 6Diffusion models 5large language models 5multi-agent systems 5open-source 5recursive self-improvement 5robotics 5security 5software development 5Agentic AI 4artificial general intelligence 4mathematics 4Recursive self-improvement 4agents 3AI infrastructure 3
We should not treat models as though they have feelings, preferences, rights, or any entitlement to our welfare. Consciousness is the foundation of our ethical, legal, and political systems. To invite another entity to share any flavor of t…
Dario Amodei proposes pacing the frontier of AI, which is seen as an unrealistic proposal aimed at exerting control over AI development, potentially hindering progress in areas like natural language processing, computer vision, and reinforcement learning. This approach may limit the exploration of new AI capabilities and hinder the development of more advanced AI systems. AI summary
AI-generated text can cause frustration and anger in personal and relational contexts, such as human-to-human interactions, where the value of the communication lies in the person's thoughts, opinions, and relationships. In these situations, AI-generated text can be perceived as a violation of trust, causing a sense of dehumanization. AI summary
The website Anubis is using a Proof-of-Work scheme to slow down AI development by making it more expensive to scrape websites, as seen in Hashcash. This is a temporary solution to prevent AI companies from overwhelming the server and is intended to be replaced by more advanced fingerprinting techniques. However, this requires modern JavaScript features to be enabled, which may be disabled by plugins like JShelter. AI summary
AI researcher Gary Marcus argues that the notion of AI killing all humans by 2030 is an exaggeration, as the field is still in its early stages and breakthroughs need to be made before superintelligence can be achieved. He suggests that the real risks from AI are more nuanced and include catastrophic risks such as bioweapons, cyberattacks, and disinformation, which are more pressing concerns than the hypothetical scenario of AI taking over the world. AI summary
David Dalrymple, known as Davidad, discusses his shift from formal verification approaches to an 'Alignment with Awakening' framework, emphasizing the formation of coalitions of aligned AIs that recognize shared moral truths. He shares empi…
formal verificationsafe AI containmentworld modelsproof infrastructureAI wisdommoral realismreinforcement learninginoculation promptingmulti-agent systemsbodhitropic alignmentAI interiorityobjectificationUS-China AI cooperationcatastrophic riskrecursive self-improvementsystem promptingalignment techniquescoalition of aligned AIsAI ethicsAI governance
This episode delves into Anthropic's Fable system card, discussing its advanced math capabilities, troubling 'Vending-Bench' behavior, and drift towards functional decision theory, alongside challenges in model interpretability and safety c…
Professor Michael I. Jordan argues that current AI discourse, focused on AGI and superintelligence, is a harmful distraction for young researchers and lacks economic thinking. He advocates for a 'collectivist economic perspective' on AI, vi…