Next GPT-2-117M fine-tuning project: my tweets! :) P.P.S. in what was otherwise a pretty non-repetitive series of outputs, it did very occasionally fall into this sort of failure mode :) cc @JanelleCShane https://t.co/eXyCMmYZys Here's everything it has to say on Midnight Cowboy right now: https://t.co/oAoqkGT1Fb Which reminded me to dig up some, e.g. these from 2016 - occasionally there were flashes of coherence, but they were much fewer and further between + mostly ungrammatical. Still some cherrypicking going on with GPT-2 results but the average is way better. https://t.co/dtl3xvIsBj *char-RNNs specifically, which is what I was using at the time. P.S. h/t @baykenney for tweeting before about Cornell's movie datasets, which I had forgotten about! I wish I also had my own sci-fi-I-like-only screenplay corpus, but seem to have deleted it a few years ago. :( Didn't realize things would get so much better than RNNs so quickly! Unfortunately, even for a substantially larger dataset, it wouldn't do this task super well, so I'll move onto something else, but it was a fun proof of concept :) Def. worth checking out this Colab if you're interested in doing such things - very easy. https://t.co/TjKOntVRAY (Note that it sometimes uses exact quotes, e.g. that Hock-a-loogee thing is in the movie, so is overfitting a bit, but typically does variations on a theme even when it includes real quotes - and most aren't quotes) I like that it got on a bathroom attendant kick for a while in the second one here... https://t.co/bRuYI5rz7q @Creepazoid2 (as well as https://t.co/Xy6x8AVubE for a different perspective) @Creepazoid2 This is another good resource - https://t.co/bsVoK34buY the first thing I sent is the only easy resource I know of for fine-tuning, but this one is good for looking at conditional and unconditional generation w/ the non-fine-tuned version @Creepazoid2 So that would reproduce these results but I'm not sure I'd nec. recommend using the text file I referenced - this just happens to be the first proof of concept I did, but is a very small file and pretty low quality. @Creepazoid2 I am using this: https://t.co/TjKOntVRAY only thing I changed was the fine-tuning training data, specifically using this text file which I took from the source referenced above + some minimal preprocessing: https://t.co/wO7ZnkoMyA RT @JanelleCShane: I wonder if @OpenAI anticipated this use case for gpt-2 https://t.co/EbhIzhz6wY Most of these results are from after about 2-3 hours training on a GPU in Colab, but it picked up the style and started having humorous results after a few minutes. cc @quasimondo #gpt2tuned https://t.co/qNsHE08kwu Some GPT-2-117M outputs after fine-tuning on memorable movie quotes from (https://t.co/vZyr8mjNki), using @roadrunning01's Colab. The format of the training data was: [movie title] [line break] [quote] [sometimes another quotes], sometimes with "<p>"/"</p>" thrown in the mix. https://t.co/CjnoAr8L7t Really impressed with these early fine-tuning results with GPT-2-117M, and great to see that there's also a Colab from @roadrunning01! Giving it a try this weekend :) https://t.co/sVJeZOI8es "RT @AOC: Friends, Morning (Friday) is Jummah, the weekly day of worship for our community of Muslim friends and loved ones. Be there for…" Finally, to be clear, I realize there are differences of both degree and kind btwn countries w.r.t. illiberalism - it is not that we can’t make value judgments, just need to be extra cognizant of in-group bias and how others perceive us in this sort of context. One reason I emphasize this point is that high tech illiberalism is being used by some as an excuse to “race” in AI development (not that that is typically well-defined, but leave that aside), and that argument critically relies on the speaker’s culture having said high ground. I share a lot of these concerns, but critical to remember that they apply to the US, too. High tech illiberalism is a global phenomenon and no country/region (except *maybe* the EU in some categories) really has the high ground here. https://t.co/bT5d2SCIxJ @baykenney Did you see this? Relevant https://t.co/aHlUHzv3kl RT @KelseyTuoc: I cover a lot of ground in this piece about microfinance in the U.S. but there's one detail I am amazed more people aren't… RT @paulkrugman: Paul Waldman is right that the right-wing hate machine will be turned on any Democrat. But I do think there's something sp… RT @KELLYWEILL: open, white supremacist cheerleading: https://t.co/ehFBWb5e4q RT @JameelJaffer: This is not the “never again” tweet one would have hoped for this morning. https://t.co/2BzmPXCWqb RT @amolchanov86: This is a great channel. A very convenient way to track all recent work in S2R. https://t.co/fYT0IX8w1y Thread: https://t.co/bStHnSGOhy RT @geomblog: The problems here arise from the sociotechnical conception of the system. And in that respect the lessons apply broadly, incl… @nsaphra @yoavgo @iamtrask needs to make the Count based on Neural Arithmetic Logic Units RT @yoavgo: https://t.co/hlAOadqM7X @fchollet No we aren’t (re: closeness to maxing out the data). A few dozen gigs were used for GPT-2. "RT @cwarzel: cant help but think about the tech that supports livestreams of death/terror. How Zuckerberg described FB Live @ launch: ""We…" RT @shimon8282: Rich Sutton has a new blog post entitled “The Bitter Lesson” (https://t.co/K3GEgyGsD4) that I strongly disagree with. In it… RT @pcastr: This is a growing issue for many researchers, as I've seen quite a few from my network affected. Hopefully the US administratio… "RT @negar_rz: I am wondering why we still have most conferences in the US despite all these exclusions! AAAI, ICLR, ICML, CVPR! https://t.c…" RT @JanelleCShane: In which I took @OpenAI's 117-million parameter neural network and retrained it to write really weird character bios for… RT @HeidyKhlaaf: Waking up to this news has been more than disturbing. The rhetoric against Muslims has grave consequences. Multiple times… @KaiLashArul What do you think of the learning + search dichotomy? Vs e.g. learning+search+evolution, or learning/evolution+search/reasoning? RT @mark_riedl: Important ML news https://t.co/np3SdNlw8U RT @shivon: Then and Now https://t.co/DKw16PUiir RT @BrundageBot: Maybe Deep Neural Networks are the Best Choice for Modeling Source Code. Rafael-Michael Karampatsis and Charles Sutton htt… @mbrendan1 Congrats! @mark_riedl oh god, no. New season? Very useful looking paper! "To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Tasks," Peters and @seb_ruder et al.: https://t.co/NHc9S31cgg https://t.co/wad6981TKt @TheAnnaGat Phrased the last part backwards but hopefully you got the gist @TheAnnaGat There may be other solutions, not sure what is best, just think you will inevitably have this problem with no rate restrictions and a binary decision for men - not much risk of a false positive, and no reason to worry much about false negative bc can always not reply. @TheAnnaGat Maybe obvious, but this is a fixable problem - allow men to swipe fewer people (perhaps in an adaptive way to keep roughly similar response rates). The current system incentives men to be strongly biased towards swiping right on anyone for whom there is >0 chance of compatibility RT @mer__edith: JOB ALERT: Are you an @nyuniversity graduate student? @AINowInstitute is hiring Graduate Research Assistants. Deadline to a… "RT @juliachanb: dear usc admissions, my son remy is a water polo wunderkind https://t.co/nKImQAJpbu" "Generating Fake Conversations by fine-tuning OpenAI's GPT-2 on data from Facebook Messenger" https://t.co/E4p9rsiPcy RT @KELLYWEILL: i would die for him https://t.co/iRWjASdbF2 RT @goodfellow_ian: Submissions to https://t.co/zQHXW31a5r are due April 12 @hypatiadotca Schadenfailfast RT @quasimondo: Can't say that I am a big fan of this type of attention economy art, when "controlling by mind" translates into "appropriat… RT @ai_memes: https://t.co/Q10YzcuyS8 "RT @ryan_t_lowe: Our AAMAS paper is finally out! https://t.co/d3QZDtTvgt TL;DR: measuring emergent communication is tricky. It may seem li…" @orpheuslummis You may want to peruse the list of references at the end here: https://t.co/TTXF1bXP6P RT @danny_lange: Latest leaderboard update from the @unity3d Obstacle Tower Challenge. Now five teams on fifth level or higher. Keep it up!… RT @washingtonpost: U.S. military to test missiles banned under faltering nuclear pact with Russia https://t.co/qSweWSDVag @bryancsk Yeah I found that confusing, too! '...while the 40% discount signifies the ethos of political service." E.g. " The current total annual salary of an entry level Minister...is benchmarked to 60% of the median income of the top 1k [earning] Singapore Citizens. The top 1k [earners] across all professions reflect the calibre of the people Singapore needs for good government, ..." Fascinating report from a commission on pay for senior politicians in Singapore, with discussion of abstract principles and concrete proposals: https://t.co/2mHkaB5qFL "Universally Slimmable Networks and Improved Training Techniques," Yu and Huang: https://t.co/bJL9WV31Op RT @deliprao: Enjoyed talking at @theNASEM on detection of synthetic content like #deepfakes. What a great crowd! my key takeaways from me:… RT @chrmanning: Excited that—after a lot of work—the @Stanford Institute for Human-Centered AI is launching. We’re aiming at new AI applica… "RT @NathanLerner: Beto on @AOC: “She does not seem to me to be afraid of making a mistake, or not saying it perfectly, and in the process…" RT @dribnet: excited to announce: local print gallery Eyeball Kicks is now carrying my artwork! same prices, cheaper shipping, framing opti… RT @quasimondo: I might have found a way to confuse #gpt2 https://t.co/au5BRnoTVw RT @jjding99: Georgetown's new Center for Security and Emerging Technology @georgetownsfs is looking to hire 2 full-time Chinese to English… @Werdnamai Yeah I think we’re on the same page. Re: investment, not sure but cc @bradlightcap @jackclarkSF @Werdnamai ...and should we allow profit-interested investors (new position = yes, as long as there are sufficient safeguards, whereas we had vaguely talked before about maybe revenue being worth considering etc. but hadn't laid out a long-term sustainable financing model) @Werdnamai said investors that the mission comes first, and profits are v. uncertain/conditional etc. So to me the question is more like: do we need lots of $ to achieve our mission (yes), can we get enough from non-profit-interested-investors(we'll keep trying but it's hard bc uncertainty) @Werdnamai Hmmm, still trying to wrap my head around your framing of it, and I think we are maybe coming at it from diff. directions. I think of it less in terms of "profits" being the new change here, and more in terms of "profit-interested investors", given that we've told ... @apilipis cliffhanger! :P RT @OpenAI: Meet the Spring 2019 class of OpenAI Scholars — who come from fields like economics, quantum physics and philosophy: https://t.… RT @sedielem: Likelihood is a great loss fn, it's all about the space you measure it in! Our latest work on hierarchical AR image models (w… @Werdnamai ... this was a custom agreement, not some existing formula jury-rigged to fit the particulars of the case, so stuff like the non-profit board being in charge etc. is quite substantial in my view, but good to have multiple lines of defense against bias etc. @Werdnamai Oh... I think whether making a profit is the right thing to do depends on what the alternatives are (e.g. definitely should not be done at the expense of safety), how others would react, etc... so hard to say in advance, but yes, many BCs. One key point is that ... RT @timhwang: 🎉 Excited to announce the winners of our $750K AI Initiative open call on machine learning and the news! Seven amazing projec… RT @santoroAI: Tim Lillicrap and I wrote a review on backpropagation through time and the brain. We think that a number of new machine lear… RT @awjuliani: Under three weeks left in Round 1 of the Obstacle Tower Challenge! There have been some impressive submissions (one solving… RT @OfficeNews: Data entry just became easier! You can now take a picture of a printed data table and automatically convert it into a fully… @chipro @WIRED cc @nxthompson RT @fmkaplan: WTF??! https://t.co/aNLrv8ORHV @sherjilozair Over day to day decision making generally; clear legal specification that we are under no obligation to do anything that goes against the mission; internal resistance; etc @sherjilozair If they raised the issue, as that’s premature according to all the other stakeholders. But in a possible future where we discussed it seriously, further checks would include: no difect investor influence (except via board which is required 2 be majority financially disinterested) @sherjilozair Having a good board is key - ultimately no set of rules is perfect. And I think everyone on the board is there in order to make AI go well. Re: specific applications, we are not thinking about apps in any serious way no so no immediate effect - investor would just be ignored RT @chipro: A proud misogynist who drag races on the 101, nicknames his female coworker 'PMS', disparages people of color, calls women of B… RT @DeepMindAI: Backpropagation through time should be a normative guide for temporal credit assignment, and modern machine learning method… @Werdnamai BC? RT @SmithaMilli: Excited to be starting to investigate the robustness of our modeling assumptions on humans. New work w/ @ancadianadragan:… RT @BrundageBot: Lipstick on a Pig: Debiasing Methods Cover up Systematic Gender Biases in Word Embeddings But do not Remove Them. Hila Gon… RT @BrundageBot: Literal or Pedagogic Human? Analyzing Human Model Misspecification in Objective Learning. Smitha Milli and Anca D. Dragan… RT @BrundageBot: Scene Memory Transformer for Embodied Agents in Long-Horizon Tasks. Kuan Fang, Alexander Toshev, Li Fei-Fei, and Silvio Sa… RT @BrundageBot: arXiv papers, March 12, 2019: RT @counternotions: AOC on automation: "We should not be haunted by the specter of being automated out of work. We should be excited by tha… RT @politico: Trump hit back at the media attention he generated last week when he appeared to flub Apple CEO Tim Cook's name, claiming he… "RT @iamtrask: *Extremely* exciting #privacy news!!! After nearly 2 years of dev by 140+ @openminedorg contributors... #PySyft - a library…" "RT @sherjilozair: ""Stairway of Knowledge"" in Lebanon The Epic of Gilgamesh The Republic of Plato Diwān Abū al-Tayyib al-Mutanbbī Risālat a…" RT @rohinmshah: Alignment Newsletter #48 - Quantilization: bounding worst case unintended consequences by partially imitating humans: https… @WBINVD @thawani_avijit Ah I see - not sure we disagree, then. Institutional design is hard, and no charter/group of people is perfect, but I’m glad that the buck stops there vs elsewhere @ethanwbrown 😂 @WBINVD @thawani_avijit It’s not subjective that the board is in charge (etc.) - these are all well specified legally. Obviously people can have diff views in their decisions so far - personally I think this is reasonable + the board itself is made up of reasonable people @ethanwbrown I argued against equity actually, though am comfortable with where we ended up @ginnysimmons @lyft lmao RT @ch402: I work at OpenAI. For me, the most important thing about our new LP structure is this: The non-profit board retains full control… @thawani_avijit ...to merge with another organization to avoid excessive competition, that would be OK; investors do not have any influence on day-to-day operations; etc. @thawani_avijit Fortunately it was a custom legal arrangement, so there are various things, e.g. the non-profit board remains ultimately in charge and the majority has to be financially uninvolved; the agreements w/ investors clearly indicate the mission takes precedence/ e..g if we wanted... 2. It was reassuring that so many others at the org had raised such concerns already, as ultimately this is a matter of culture, and I'm thrilled to work with dozens of colleagues who also care deeply about the impact of AI on the world! When I first heard about OpenAI LP, I was concerned, as OAI's non-profit status was part of what attracted me. But I've since come around about the idea for two reasons: 1. As I dug into the details, I realized many steps had been taken to ensure the org remains mission-centric. RT @jovialjoy: “The government is hurtling along a path towards facial recognition's broad deployment — and in this case, a deployment that… RT @nicoptere: let the StyleGan silly hat contest begin! https://t.co/bVsFBYlJCT RT @pardesoteric: This is SUPER interesting—researchers trying to make the first "genderless" voice assistant https://t.co/OeBT8OA0ZK RT @catherineols: I'm very excited about this idea in general - a credible, binding structure that ensures that massive windfall profits ge… RT @gdb: Wrote a blog post together with my co-founder @ilyasut on the OpenAI Mission: https://t.co/LLNAl0DHOn https://t.co/B2jEnM4du1 RT @DeepMindAI: Impact penalties help us train agents to avoid unwanted side effects, but these penalties can still produce undesired behav… @Zergylord @OpenAI 💯 RT @dog_rates: This is Dough. He’s a basset hound working undercover as a lab. Can’t discuss the mission, but it’s very important. 14/10 ra… RT @natschluter: I'm looking for a 1-2 year postdoc to work at the intersection of formal languages and/or algorithms, and machine learning… RT @bradlightcap: Excited to announce what we've been working on. Introducing OpenAI LP: https://t.co/bLXVEMcs7D "RT @maddiehalla: We’ve created a new capped-profit structure to fund ambitious mission-driven projects like OpenAI. Can’t wait for what’s t…" RT @OpenAI: We’ve created OpenAI LP, a new “capped-profit” company that allows us to rapidly increase our investments in compute and talent… RT @seb_ruder: New NLP News: GPT-2, Sequence generation in arbitrary order, and much more https://t.co/4hb9iTjUsu (via @revue) "RT @wsisaac: 🚨🚨Great Internship Opportunity!!! 🚨🚨 Come work with me and the DeepMind Ethics & Society research team as a research intern:…" RT @SciFi: MinAtar: An Atari-inspired Testbed for More Efficient Reinforcement Learning Experiments. https://t.co/a4tvboPqkm Come at me @timhwang Prose written by an AI system that seems human-written at first glance = deep takes. RT @BrundageBot: arXiv papers, March 11, 2019: @janexwang Did you see the Wandering Earth movie? Also Ball Lightning is pretty good but not as good as the stuff you mention IMO RT @janexwang: If you're into mind-bending hard science fiction, I highly recommend Liu Cixin, either his Three-Body Problem trilogy or his… The wall 180 is def. this pupper’s signature move, though. Unfortunately not depicted here: s/he also liked to stand on her/his hind legs. It’s Sick Stunt Sunday. Look at this little pupper go! https://t.co/3a1wzdgHDv AI charm race > AI farm race > AI arms race > AI harm race. Thanks for listening to my TED talk. RT @rsalakhu: Very nice blog post by John Langford on code submission policy https://t.co/UAv1jueHnH - I agree with many of John's points.… RT @chrisamaphone: this is a *phenomenal* comedy set on AI research & ethics (by someone i'm proud to know, @nsaphra). https://t.co/BcpK5oN… RT @Miles_Brundage: While the article is about translation, many of the points here also potentially apply to language model-assisted writi… RT @JanelleCShane: this penal system seems unjust https://t.co/HubHkWoaWZ RT @catherineols: In case you missed it-- my favorite part of Activation Atlases (https://t.co/AymKSbJjgy) is this novel method of generati… RT @JanelleCShane: I am suddenly kind of afraid of Big Cat https://t.co/RmvxnnVWO0 RT @JanelleCShane: It's already much much better than I managed with the same training data: https://t.co/QmKLohQmmq https://t.co/kDcADTJPGu RT @JanelleCShane: two minutes into retraining mini-GPT-2 on a dataset of D&D character bios (using a colab set up by @roadrunning01), and… RT @gradientpub: How can we address the current limitations of reinforcement learning: sample efficiency, scaling, and generalization? @yfl… "While the article is about translation, many of the points here also potentially apply to language model-assisted writing. https://t.co/Cbqft9N62l" "Neural Language Modeling with Visual Features," Anastasopoulos et al.: https://t.co/oY8brKqLUU @SmithaMilli 🤔🤔🤔 "RT @tkasasagi: Preparing to open source NekoNet kuzushiji OCR model. I will leave the bunny as it is in https://t.co/jAWoFhSpRM Thank you…" @deliprao @SFPublicLibrary :) RT @decodyng: Just put up a new #MachineLearning post, where I explain the intuitions behind Natural Gradient learning: how to connect high… RT @ProfJenNeville: Question asked of Dean candidates in Engineering: “Tell me the names of some of your female colleagues and describe wha… RT @MelMitchell1: Guy at next table in coffee shop: "What are you working on so intensely, Miss?" Me: Writing a book." Him: "What's it ab… RT @JanelleCShane: I took a look at a new tool for detecting AI-written text. Apparently the text my neural nets generate is so unpredictab… RT @BrundageBot: Self-Tuning Networks: Bilevel Optimization of Hyperparameters using Structured Best-Response Functions. Matthew MacKay, Pa… RT @BrundageBot: Integrating Artificial and Human Intelligence for Efficient Translation. Nico Herbig, Santanu Pal, Josef van Genabith, and… RT @BrundageBot: Using World Models for Pseudo-Rehearsal in Continual Learning. Nicholas Ketz, Soheil Kolouri, and Praveen Pilly https://t.… RT @BrundageBot: Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few Examples. Eleni Triantafillou, Tyler Zhu, Vincent Dumou… RT @sohamg121: Finally after months of work - "Concurrent Meta Reinforcement Learning" https://t.co/J6okVttOoP. Joint work with Emilio Pari… @parnianbarekat Cc @hardmaru RT @DeepMindAI: We are excited to share the story behind TF-Replicator, a software library that helps developers deploy their TensorFlow co… Really interesting paper! https://t.co/V20KSWD0ov "RT @ylecun: Facebook fights dangerous pseudo-science. https://t.co/dNX0JxwhqD https://t.co/dNX0JxwhqD" Cc @AlecRad @S_Gehrmann It is intriguing that it at least initially generalizes pretty well to the big model, though I am more skeptical that this will always be true with e.g. fine-tuning, adversarial training/outputs, new datasets, and/or light human oversight/tweaking to add more unpredictability. Really neat tool and analysis! Recommended. Be sure to read the introduction explaining the tool in addition to playing with it. https://t.co/krm4IDAFM4 @hypatiadotca Ded RT @hypatiadotca: 🙀😻 https://t.co/du2HEv5dhi RT @DeepMindAI: It's hard to avoid reusing test sets when training models. When test sets are reused, how can we know whether the test erro… Really delighted by all these interactive GPT-2-117M tools :) RT @kcimc: i made a thing for exploring poetry generated by the gpt-2 neural network. it's surprisingly good at picking up the "style" of t… "Training in Task Space to Speed Up and Guide Reinforcement Learning," Bellegarda and Byl: https://t.co/0nTDZcyEbL "Using Natural Language for Reward Shaping in Reinforcement Learning," Goyal et al.: https://t.co/PX5HZB1qUv RT @JeffDean: I'm very excited about the potential of AI to help us create new educational tools. Bolo is an Android app created by @Googl… RT @lizjosullivan: I didn't make the decision to leave Clarifai lightly. I agonized over the debate, and tried to look at the issue from al… "RT @coreylynch: Excited to share our new work on learning from play! We show a single agent, after self-supervising on 3 hours of play dat…" RT @deliprao: Personal news: Excited to announce that I've joined https://t.co/XnO28VB89X to work on multimedia generation and detection pr… RT @michael_nielsen: This is gorgeous. And it is chipping away at an important (& extremely difficult) problem, trying to understand how &… @samim Good question. I have been meaning to read the new book How Smart Machines Think which looked like an accessible intro I might want to recommend to people, but haven’t confirmed "RT @ludwigschubert: More Activation Atlas obscurity: you can share links to specific sections of an activation atlas. 🍎Have some fruit: ht…" RT @NicolasPapernot: Our @GoogleAI team released a blog post from @schmilblick42 and @UlfarEr about @TensorFlow Privacy: the library is the… RT @jluan: I'm very hopeful that we can add Activation Atlases to the arsenal of tools people use to assess for bias and spurious correlati… RT @GoogleAI: In collaboration with colleagues at @OpenAI, we're publishing "Exploring Neural Networks with Activation Atlases", a new @dis… @patrickc 👍 RT @TensorFlow: TensorFlow 2.0 alpha is here! We've asked the community what they wanted and we're working to make TensorFlow simpler and e… RT @abigail_e_see: In this interview, I talk to @deeplearningai_ about what it's like working at @stanfordnlp, teaching #CS224n, and why as… RT @ch402: The narrative around neural nets sometimes polarizes in two directions: they’re superhuman perfect systems, or cheap fragile ha… Super exciting opportunity to work on stuff like Activation Atlases! https://t.co/WB8heZmRGN @davegershgorn lmao @barneyp @OpenAI FYI, another easy option for playing around with longer outputs - https://t.co/bsVoK34buY The tradeoff is just that you need to wait a few mins for the cells to load, and it doesn't give %... both are useful tools IMO! "RT @ch402: Atlases are -- in collaboration with our friends at Google -- the first publication of the new @OpenAI Clarity team. Intereste…" RT @ch402: For the last few years, one of the staples of my research has been visualizing individual neurons in vision models. But that's o… @barneyp 😂 RT @OpenAI: In collaboration with Google, we're releasing Activation Atlases: a new technique for visualizing what interactions between neu… "RT @santoroAI: Nice new work on the lottery ticket hypothesis by Frankle, Dziugaite, Roy, Carbin: https://t.co/zgCtNg3N09" "Learning Latent Plans from Play," @coreylynch et al.: https://t.co/emUwx5rsoj "PDP: A General Neural Framework for Learning Constraint Satisfaction Solvers," Amizadeh et al.: https://t.co/shdpY2IizJ "RT @dlowd: Want to play with a language model, for art or science or fun? Check out @allen_ai's great web interface for small GPT-2: https:…" RT @jesse_vig: New article and updated visualization tool for @OpenAI #GPT2! See how the pre-trained language model is able to finish your… "RT @snowjake: Good news: AI will generate a realistic privacy policy. Bad news: privacy policies will always be terrible. Try it for you…" Who’s going to ICLR? @egrefen And it’s a comparison many ppl get @egrefen I should prob have worded that differently to clarify that beating that baseline isn’t hard, this just happens to be a good/SOTA interface for exploring it @egrefen Not expressing surprise - just a good way of getting a feel for a LM's capabilities (in addition to longer generation and other things). (e.g. due to less "safe" outputs that are nevertheless tied to the earlier context in a useful way) I suggest e.g. trying to see what results you get by choosing only the top few suggested results (analogous to the options for autocomplete on a phone). I have found that even with single-word-level outputs, one can generate way more coherent stuff with this than a phone. @loretoparisi I think the samples shown in the OpenAI blog post from the bigger version of GPT-2 were suggestive of this being possible, esp w fine tuning on the table, but it is def still early days both wrt understanding existing models + improving them RT @naz_erkan: Come work with our META (Machine learning Ethics, Transparency & Accountability) team for a summer research internship. Feel… It'll be interesting to eventually see stuff similar to this but at e.g. a sentence/paragraph scale in terms of incremental generation. You can trivially do it now but still hit or miss even on the big model, + the utility of long synthetic text segments will increase over time. Really nice interactive tool for getting a sense of GPT-2-117M's capabilities/biases/applications etc.! https://t.co/w2d8qYfBLc "RT @etzioni: NEW: Why did your model come with a ""no-fly zone"" warning? Interactively explore @openai's GPT-2 model to find this and othe…" RT @polynoamial: Talks at MIT on AI for Poker, Go, and Starcraft all within a few days of each other (with the talk on AlphaGo and AlphaSta… "RT @OriolVinyalsML: Excited to visit Boston (Monday) & NYC (Tuesday) next week to talk about #AlphaStar! @MIT @BU_Tweets @nyuniversity Bo…" RT @hardmaru: No GAN is complete without Ramen 🍜 https://t.co/w0M38XsAR5 RT @DeepMindAI: We introduce α-Rank, a principled method to evaluate multi-agent strategies, grounded in a new game-theoretic solution conc… RT @DeepMindAI: A new opinion article from our researchers @jzl86, @sharky6000, E. Hughes, and @ThoreG: “Autocurricula and the Emergence of… RT @doomie: VideoFlow: A Flow-Based Generative Model for Video extends Glow to a new algorithm for multi-frame video prediction with normal… RT @GoogleAI: Check out GPipe, an open source library that uses pipeline parallelism to scale up the training of deep neural networks, help… "Efficient Reinforcement Learning with a Mind-Game for Full-Length StarCraft II," Liu et al.: https://t.co/KYh6GUGKlT RT @AmandaAskell: The OpenAI policy and communications team are looking for a project manager! Very valuable position for those with projec… RT @jackclarkSF: We're hiring a project manager(s) at @OpenAI to support work in policy and comms. This is a high-impact role and offers ca… RT @whi_rl: Check our new blogpost on TACO, a modular approach to learning from demonstration, which learns hierarchical control policies f… RT @DeepMindAI: Building on prior work training deep RL agents to navigate cities without a map (https://t.co/GjgIL2Ppz4), we can now teach… RT @OpenAI: We’re releasing a Neural MMO — a massively multiagent game environment that supports numerous populations of agents: https://t.… RT @BrundageBot: Model-Based Reinforcement Learning for Atari. Kaiser, Babaeizadeh, Milos, Osinski, Campbell, Czechowski, Erhan, Finn, Koza… RT @BrundageBot: Multi-Object Representation Learning with Iterative Variational Inference. Klaus Greff, Raphaël Lopez Kaufmann, Rishab Kab… RT @BrundageBot: Learning to Plan via Neural Exploration-Exploitation Trees. Binghong Chen, Bo Dai, and Le Song https://t.co/wZisiN5fJz RT @BrundageBot: Learning To Follow Directions in Street View. Karl Moritz Hermann, Mateusz Malinowski, Piotr Mirowski, Andras Banki-Horvat… @GalaxyKate Smartificiallll RT @gradientpub: @ericzelikman responds to @hughbzhang’s call for @OpenAI to open source the #gpt2 by insisting that "considering the impac… RT @ChenhaoTan: @whobars You can take a look at the framework and our dataset on 100 tasks at this website: https://t.co/eRVoW5BXIZ! Contri… RT @ChenhaoTan: New preprint with @whobars: Ask Not What AI Can Do, But What AI Should Do: Towards a Framework of Task Delegability, where… RT @BrundageBot: Ask Not What AI Can Do, But What AI Should Do: Towards a Framework of Task Delegability. Brian Lubars and Chenhao Tan http… RT @rohinmshah: Alignment Newsletter #47 - Why AI safety needs social scientists: https://t.co/vqpPRv6Dyp RT @neil_uai: I like this week's AN. Good night~😀 https://t.co/xzgtCtKxbr https://t.co/goaPjcyiWL "RT @JanelleCShane: please enjoy these delicious neural net-generated cookie recipes https://t.co/HbrYu5NBf7 https://t.co/MzHHJTRAYP" "How I Met Your Model How I Met Your Data" @mat_kelcey @jackclarkSF @AnimaAnandkumar @OpenAI @reddit @mxlearn @samcharrington @CommonCrawl It's discussed a bit in the paper, mentions quality issues - cc @AlecRad @AnimaAnandkumar @jackclarkSF @OpenAI @reddit @mxlearn @samcharrington As @jackclarkSF mentioned, we hope to share more of our approach to the bias issue very soon. Agree it’s a key concern! RT @saucentoss: We're looking for organizers for the @WiMLworkshop co-located with @NeurIPSConf. Deadline March 8. Details and application… RT @deliprao: Colab has become my most favorite tool so far. So easy to quickly fire it off, try something out, and share with others. 💯 RT @csilviavr: Our AIES paper on “echo chambers” and “filter bubbles” in recommender systems is now on arXiv! https://t.co/2DNbxmf4y4 RT @wsisaac: This is a really cool paper by the my colleagues Ray Jiang and @csilviavr . Definitely worth a read!! Has implications for an… "RT @filar: ""Why We Release Our Research"" @drhyrum, @comathematician and myself layout the importance of releasing ML research to the academ…" RT @NicolasPapernot: We recently added a Keras tutorial to @TensorFlow Privacy. You can find it here: https://t.co/WtN6SEs7rY RT @etzioni: HOT off the press: long-term implications of the @openai's GPT-2 are explored: https://t.co/0N07sVQB0D RT @shimon8282: This is a nice blogpost from @parnianbarekat about our paper on stabilising experience replay for deep multi-agent RL: http… RT @BrundageBot: Degenerate Feedback Loops in Recommender Systems. Ray Jiang, Silvia Chiappa, Tor Lattimore, Andras Agyorgy, and Pushmeet K… RT @BrundageBot: arXiv papers, March 1, 2019: RT @TedPavlic: "In the Mariana Trench, the deepest point of the ocean, every single amphipod captured had at least one plastic fiber in its… @ziwphd 😂 @Liv_Boeree https://t.co/coJT0inHYH RT @parnianbarekat: I published a new blog post. Deep RL for multi-agent setting: Understanding Stabilising Experience Replay for Deep Mult… RT @hlntnr: Thrilled to finally be able to share the founding of CSET - the Center for Security and Emerging Technology. I could not be mor… RT @catherineols: I'm extremely excited about the new DC AI policy center, led by Jason Matheny! (CSET - the Center for Security and Emergi… RT @DeepMindAI: Adversarial training, one of the most effective methods to improve the robustness of classifiers, has a very simple geometr… RT @JeffDean: Nice improvements in the synthesized, high-quality musical audio using GANs, with fast generation! You can GAiN much from li… "Continual Learning with Tiny Episodic Memories," Chaudhry et al.: https://t.co/Earixmlthi "Provable Guarantees for Gradient-Based Meta-Learning," Khodak et al.: https://t.co/qKEvXDzrDy RT @svlevine: Ever wonder if Q-learning will converge? Should you use a big or small model? On-policy or off-policy data? Many or few grad… RT @decodyng: If you're in the East Bay tomorrow and don't have plans, come hear me give a high-level introduction to meta-learning, based… RT @BrundageBot: arXiv papers, February 28, 2019: "Coloring Big Graphs with AlphaGoZero," Huang et al.: https://t.co/HH4yGj7O3y RT @gdb: Amazing to see OpenAI featured twice on @BillGates's 2019 list of Breakthrough Technologies (once for robotics, once for language)… RT @AmandaAskell: This piece slides between "AGI" and "conscious AI", which I think should be avoided. If you want to use "strong AI" to me… RT @BillGates: I’m a big fan of the MIT @techreview's annual list of breakthrough technologies — so when they asked me to choose this year’… "RT @ylecun: Habitat: a (fast) 3D simulator, a bunch of datasets, and a challenge for embodied AI research. A project brought to you by FAI…" "RT @aharutyu: The full paper is out! #AISTATS2019 https://t.co/9kh3N06wjp https://t.co/Niy6bCRCFw" @jeremyphoward Yeah, I did not mean to suggest Twitter is the pinnacle of preparedness or Mastodon the bottom @jeremyphoward E.g. concretely I’d expect ~ Twitter > Mastodon in terms of preparedness @jeremyphoward I think the “becomes a majority” scenario depends on platforms failing to stop this via metadata. I suspect platforms will vary in the extent to which they address this well, but important to always remember that content-based detection isn’t the only defense @jeremyphoward (Deleted comment bc you addressed :) got too excited and skipped to looking at the sample) RT @jeremyphoward: We took a quick look at whether you can do something like @OpenAI GPT2 with far less resources. @GuggerSylvain trained a… RT @AmandaAskell: Before saying some misuse of technology hasn't been very harmful, consider that you might just not be in the group target… @boomereng @sperand_io 🔥🔥 RT @ziwe: watching the michael cohen hearings like https://t.co/W6TzoSjzZk RT @tonypeng_Synced: Beijing-based AI chip startup Horizon Robotics today announced a staggering US$600 million in Series B funding led by… RT @RadioFreeTom: Jim Jordan is playing all the Talk Radio Fever Swamp Greatest Hits. RT @DeepMindAI: Many AI safety problems are about agent incentives. In our latest blog post, we suggest a systematic study of agent incenti… RT @brhodes: Remember Trump's obsession with securing the "release" of Obama's grades? Further proof that his Obama obsessions were so ofte… RT @rcalo: "The President of the United States thus wrote a personal check for the payment of hush money as part of a criminal scheme to v… RT @kylegriffin1: "To be clear: Mr. Trump knew of and directed the Trump Moscow negotiations throughout the campaign and lied about it. He… RT @politico: BREAKING: Cohen testimony on Trump: 'He is a racist. He is a conman. He is a cheat.' https://t.co/fL6X4KhYnT My goodness RT @Bryson_M: it’s gonna be a normal and sane day tomorrow https://t.co/10OWpOwEPk "TESTIMONY OF MICHAEL D. COHEN COMMITTEE ON OVERSIGHT AND REFORM U.S. HOUSE OF REPRESENTATIVES FEBRUARY 27, 2019 https://t.co/KnyoxDQy2T" RT @rcalo: THIS IS BONKERS RT @BrundageBot: The State of Sparsity in Deep Neural Networks. Trevor Gale, Erich Elsen, and Sara Hooker https://t.co/WOOjLCAxJ9 "RT @rcalo: ""He is a racist. He is a conman. He is a cheat."" Oh and I have the receipts. 💌 Michael Cohen https://t.co/E2WZrQWrG3 https://…" "RT @benjaminwittes: BOOM!!! https://t.co/bNw7BkGOsm https://t.co/zhvEurgaZk" "The Termination Critic," @aharutyu et al.: https://t.co/UuQrU2wPLn @seb_ruder @_aylien @insight_centre Congrats!! @ericjang11 @Smerity @Andrew_niccol Yass @XandaSchofield Congrats!! RT @samcharrington: Our recent "TWiML Live" session on OpenAI's language model release has been really popular. Folks have asked for more @… @Liv_Boeree Fair Not sorry "Bay Area hobbies: Move fast and bake things (cooking, pottery) Move fast and brake things (biking, climbing) Move fast and lake things (Tahoe-related stuff)" RT @mustafasuleymn: These wind farms are part of Google’s global fleet of renewable energy & generate 700MW - as much electricity as is ne… RT @mustafasuleymn: We just made Google windfarms much more efficient!!! We used AI to boost the value of wind energy by 20% by accurately… RT @jachiam0: We did a thing! 😃 https://t.co/QvzKNWPQPw RT @DeepMindAI: Since last year, a joint DeepMind and Google project to apply ML to 700 MW of wind power in the central US has so far boost… "RT @OpenAI: What we learned hosting our first Spinning Up in Deep RL workshop: https://t.co/qG4FMkoJgw Plus: - Video lectures: https://t.co…" RT @jeremyphoward: This is why systems like GPT-2 will be very effective at influencing discourse in places where close reading is not the… @BishopTopsy @jackclarkSF https://t.co/RoQYD4T8br @VahidK I don't think it's funny, but it's informative re: how these things spread. RT @hypatiadotca: Our generation's Superfund sites are gonna be the minds of content moderators and the generational trauma the work spawns… And some of the first few video results on Google for it are from...flat earthers. "Behind the Curve," a documentary about flat earthers (on Netflix in the US at least), is *wild*. RT @hypatiadotca: It took me half a pound of pretzels to make it through the FB moderation article and my main conclusion is that we should… RT @comathematician: I tried to synthesize the discussion @aivillage_dc had the days after the release of GPT-2 into something short and ac… P.S. I'm glad someone looked closely at the JFK sample :) I've read and thought about it many times (and wrote the prompt for it), and I continue to be amazed at how simultaneously good and bad GPT-2 is, with the "bad" usually being about world modeling failures. See also: https://t.co/qAhe975gPN "Really great discussion of GPT-2, emphasizing the limited correlation between human-passability-at-a-glance and human-passability-on-close-inspection and why that matters. [title is kind of misleading re: content FYI] https://t.co/V33A4qFVup" RT @BrundageBot: GANSynth: Adversarial Neural Audio Synthesis. Jesse Engel, Kumar Krishna Agrawal, Shuo Chen, Ishaan Gulrajani, Chris Donah… RT @BrundageBot: arXiv papers, February 26, 2019: RT @XandaSchofield: Me: Machine learning is overhyped, even anthropomorphized, to a point of being dangerously misinterpreted by the public… 🇨🇦 ✈️ 🇺🇸 RT @aivillage_dc: Check out our new blog post by @comathematician on GPT-2, threat models, and misinformation: https://t.co/LWWX1A9iHV Will be very interesting to see how far people are able to push GPT-2-small/mini with fine-tuning! https://t.co/ORcP1EA30B @HMRoff @mchorowitz @paul_scharre @zoemsl @EBKania Cc @AmandaAskell who is also cooking up related stuff here :) @L_badikho More like deci, no? Think it’s a 12x ish gap @jeffbigham @harmankkaur @heycori I thought Google’s recent white paper on their approach to disinformation and how they use human feedback was informative; not sure if comparable FB resources exist RT @_KarenHao: Reminding people that this report exists because I really haven't seen it get the attention it deserves https://t.co/BmTOlgP… @jeffbigham @harmankkaur Yeah, fair. When I said it “should” be be mostly automated, I mean “if anyone/anything is doing this sort of thing at all” @jeffbigham @harmankkaur IMO long term most of this should/will be automated, but not gonna as easy if the data is crap bc bad working conditions. This is bad from every POV RT @CaseyNewton: Today I want to tell you what it's like to be a content moderator for Facebook at its site in Phoenix, Arizona. It's a job… @OptimistsInc 🙂😍 RT @mattblaze: Twitter should encourage the use of the Oxford comma by counting “, and” as four characters instead of five. #UnimportantHil… @zoemsl @EBKania (That may be too harsh and perhaps I’m forgetting a few good uses of the term, but they’re certainly not the norm) "RT @alanyttian: Our work (by @jesseengel and me) is now available on arxiv here https://t.co/dbxy3j2qJs ! Tldr: Cross-modal domain transfe…" RT @twimlai: Today @samcharrington is joined by @AmandaAskell and @Miles_Brundage of @OpenAI, @AnimaAnandkumar, @WWRob, and @Smerity to dis… @zoemsl @EBKania Lethal autonomous weapons is the closest candidate but ppl rarely engage with the diff definitions or specify e.g. what racing effectively means, why we aren’t spending comparable % of GDP to earlier races, etc... the term has done more harm than good to date @zoemsl @EBKania To be blunt, I am not aware of any instances of a well-specified use of the term in the context or AI to refer to anything actually happening today, vs. a vague reference to competition. RT @adversariel: Just found this incredible paper by @korolova and team: they straight-up reverse engineered Apple's differential privacy s… @kongaloosh @BorealisAI Congrats! RT @quasimondo: Buy one #StyleGAN glasses vector and get a convertible for free. https://t.co/WmZY0slvG6 RT @nattyover: For a year I've been reporting this story about major climate news, finally breaking today: A new simulation finds that glob… RT @lmthang: In case people might not realize, a powerful speech library (probably the best one) has been released last week. It’s develope… @maosbot (See @jackclarkSF’s more authoritative answer instead haha) @maosbot Well it is a successor to a system which at some point started being called GPT (https://t.co/3CYWAi2s1R) though that isn’t clear from the blog. We’ll be saying more soon re how we approached this launch and the issue of hype generally. But GPT-2 has had a boring name for a while "RT @svlevine: Online meta-learning: https://t.co/e4bGPL2QLp Our new work aims to bring together meta-learning (i.e., few-shot learning) an…" @tdietterich @jjding99 To be clear, I’m not saying he has literally never heard about or engaged with the topic. But it seems to be among the topics he is least engaged with relative to his staff, unlike eg foreign policy, immigration, etc @tdietterich @jjding99 (Unlike thousands of other things over the past 2 years) @tdietterich @jjding99 Yes, though he signs lots of stuff, and this didn’t even rise to the level of a tweet to him. The system is called DeepSqueak, which made my day. https://t.co/wLDAoeHeBo “Small” is also good as @gwern notes "RT @RushDoshi: “The two sides were also discussing commodities on Sunday.” Commodities central to talks with China, but the US is more th…" @ankurhandos Haha my other problem with baby is that it sounds like an early version of the big one, when they're just totally different training runs. @hoonoseme @DeepMindAI yeah it seems to have been replaced quickly. @hoonoseme @DeepMindAI My guess is a copy/paste issue in final editing @hoonoseme @DeepMindAI I think he doxed himself :O @kelvindotchan @arnicas Yeah, there is def. something of an art to it. Some things are easy to codify (use more context), others less so. RT @TenantOf22: @quantumVerd @alfcnz The paper got fixed faster than my boiler I tell you For the Annals of Stuff Only Miles Wants to Talk About on Sunday "I have heard the 117M parameter version of GPT-2 referred to as baby GPT-2, mini GPT-2, and toy GPT-2. Baby is a bit anthropomorphic; toy is inaccurate (it’s SOTA on some stuff); mini feels best among these, though param # is more precise. Thanks for listening to my TED talk." @Zergylord Lmao RT @Zergylord: I can't judge; you've got to utilize all available communication channels if expect a timely response from your landlord. ht… @Zergylord @ZDNet @TiernanRayTech More of this meme pls @kylebrussell Would be way more dismissive myself if (like eg Forrester) they made such claims but didn’t release free research substantiating it @kylebrussell Agree there are incentive problems, but this is hardly what I would say as McKinsey (just half, decades from now) if I wanted to be maximally hypey, and they do real research substantiating these things (though there’s a ton of problems with this lit in general, not just McK). RT @arnicas: Some baby GPT2 experiments- you can force it into poetry-mode if you feed it newlines in the seed text, most of the time. http… @tdietterich @jjding99 On rereading your comment, we may not disagree - I think your framing makes sense re: OSTP and other reasonable parties of trying to influence the rest of the WH. I’m just skeptical that will work with the WH (maybe helps with Congress) given chaos @moyix Explain? Can’t really see/understand. It’s messy or something? @tdietterich @jjding99 (And thanks for chiming in - the glass may actually be half full...was emphasizing one side of the ledger I think too few ppl understand, but maybe things will turn around) @tdietterich And yes, OSTP is a glimmer of hope. I did not mean to imply otherwise, but think my overall skeptical characterization was fair given the limited evidence to date that OSTP is empowered much or has a line to Trump. @tdietterich @jjding99 I agree such things can fulfilll such purposes, but that seems to give the WH a bit too much credit IMO. If it were a priority, Trump himself should say literally anything about it. Another salient fact is that the White House is chaotic right now, and policy can change at a moment’s notice. This means that people understandably don’t take stuff that has happened so far without Trump’s involvement v. seriously, as any achievements are extremely fragile. /Fin And one of the salient facts of the situation is that out of the two levers of influence @jjding99 mentioned, one is basically at a standstill (STEM investment), and on the other (immigration), the Trump admin. has gone in the exact opposite direction from what experts recommend. And to be clear, I hope things improve in these respects, and things aren’t apocalyptic now w.r.t. US AI policy - lots of sensible stuff in recent WH statements + DOD’s AI strategy. But it’s important that people have a realistic understanding of the current situation/challenges. This. It’s not that a good national strategy would be bad; it’s that so far, the evidence suggests that anything coming from the WH right now wouldn’t be good or executed, + high level strategies obscure ongoing low level failure on immigration etc. https://t.co/z0XjcfMXCt RT @jjding99: How do you have faith in the Trump admin to successfully develop and execute an AI initiative when that same administration l… RT @jjding99: The US doesn't need a "National AI Strategy." It's a fluffy way for Trump admin to self-congratulate/pretend it's doing stuff… P.S. there are too cute https://t.co/NWJyHPqkCS @mark_riedl @tallinzen ❤️ you're an A+ tweeter RT @alexandraxron: My ''Embarrassingly Simple Approach for Transfer Learning from Pretrained Language Models'' was accepted at #naacl2019!!… @jackclarkSF @hypatiadotca I like it @jackclarkSF @hypatiadotca Jack. @hypatiadotca (if that's what you mean, then yeah :) didn't go to the very top...very new here!) @hypatiadotca That's the Peak2Peak gondola (heading from Whistler towards Blackcomb) RT @BrundageBot: Fast Task-Aware Architecture Inference. Efi Kokiopoulou, Anja Hauth, Luciano Sbaiz, Andrea Gesmundo, Gabor Bartok, and Jes… Gondola ride in Whistler, Canada 😍 🇨🇦 https://t.co/DXo6R6quS1 @mark_riedl @tallinzen (that may have been what Mark meant, just checking :) ) @mark_riedl @tallinzen I'd add one point, which is that these weren't "zero-shot benchmarks" per se but standard benchmarks, inc. Winograd schema, various language modeling tasks etc. and the zero-shot GPT-2 version beat fine-tuned systems in many cases. @mark_riedl Yeah, I was just quibbling about the ratio - agree it's a thing that happens sometimes, but my personal experience has been that it is rare. Interesting that the four model sizes are all underfitting the Webtext data, though not sure to the same extents. @mark_riedl 1.5B params is very small compared to the range of topics it can produce decent results on, IMO. Enough to memorize a few quotes that show up a lot (Gettysburg address etc.) or plagiarize when desperate, but there is a fair amount of generalization going on too @mark_riedl *have done dozens myself, I mean, in addition to the n-gram stuff in the paper. Non-zero rate but hardly sufficient to explain the performance. @mark_riedl (though I agree with @togelius re: high rates of *near*-plagiarism, at various levels - style, sentence structure, etc.) @mark_riedl Disagree - yes, it memorizes some things, but only very rarely - have dozens of plagiarism checks. I suspect what happened here (assuming you're referring to the paper example) was more to do with it having stumbled onto that topic and having little else to say. @sidneyfussell Gotta watch Umbrella Academy now!! @FelixHill84 Not necessarily - it could be that e.g. we can’t find the solutions without ML but can understand and check them once found. But I agree that we shouldn’t count on this always being the case. RT @hypatiadotca: Heck yeah! https://t.co/rNrfDvc0Sd RT @mm_jj_nn: Walmart commissioned a report on the impact of automation on work in the US: https://t.co/cAFBO5DJO8 "RT @AlexIrpan: broke: writing about GPT-2 controversy woke: writing about AlphaStar instead Okay but seriously I've been working on this e…" @gwern Cc @jackclarkSF 🤔 RT @GoogleAI: Applying reinforcement learning to environments with sparse and underspecified rewards is an ongoing challenge, requiring gen… RT @paul_scharre: We're hiring! We are actively looking for a Senior Fellow / Fellow / Associate Fellow to join the @CNAStech program. Focu… RT @KelseyTuoc: I just... know a lot of people for whom the problem is, actually, lack of money. But instead of dueling anecdotes we could… "RT @csilviavr: Still one week left to submit to the #ICLR2019 Safe Machine Learning workshop! https://t.co/hWDPnWzFz9" RT @BrundageBot: arXiv papers, February 22, 2019: "Evaluating the Search Phase of Neural Architecture Search," Sciuto and Yu et al.: https://t.co/xdzlQGLISz @rajiinio Super helpful thoughts/links - thank you!! RT @ruchowdh: Great recap of the Open AI debate with some valuable insights from ⁦@deliprao⁩ ⁦@AnimaAnandkumar⁩ and ⁦@Miles_Brundage⁩ http… @cholodovskis @MichaelHBowling @marcgbellemare Congrats! @rohinmshah (I think I have the same intuition for roughly the same reasons, I just want to have a fuller explanation to share for people who don't have that intuition :) ) @rohinmshah I'd love to see the Turing/AI-completeness sketched out a bit more. Have you/have others? SSC post didn't really. "RT @ericjang11: New blog post! An introduction to ""what is meta-learning"" and a tutorial on implementing MAML in 50 lines of JAX. https://…" Really great to see more multiagent/cooperative benchmarks! And cool to have an embodied version like this to complement the more abstract Hanabi release recently. https://t.co/tPU9FgFthc RT @DeepMindAI: Today we are excited to release the MuJoCo Soccer environment and accompanying paper, Emergent Coordination through Competi… RT @jjvincent: After @OpenAI withheld its latest algorithm, concerned that the research could have malicious uses, the AI community questio… RT @deliprao: Thanks @jjvincent for bringing diverse voices together, so we can all jointly focus on the important issues in building scien… RT @jesswhittles: Some reflections/highlights from this year's AI, ethics and society conference: https://t.co/jz9Mf5Y0Ru RT @delliott: The @openai GPT-2 117M model peer reviews four papers. The GPT-2 paper itself, one of the ACL 2018 best papers, the NeurIPS18… "RT @quasimondo: Recursive Footnotes, written with #GPT2 https://t.co/MZU7iWJqr1 https://t.co/O1ZEJBroGE" RT @samcharrington: 🚨 New pod alert! Today's @twimlai features a great convo w @hannawallach of @MSFTResearch on fairness in machine learni… @lucastecot @OpenAI There isn’t really one set profile. To give you some sense if the range of research topics we’re interested in, see e.g. the Malicious Use of AI report’s appendix and our Charter, and also DM me with more detailed Qs (2/2) @lucastecot @OpenAI We are interested in people from various backgrounds - really depends on what you’d work on. E.g. a technical background might help with work related to forecasting/measurement, scenario analysis, risk assessment of models, etc. (1/2) @rajiinio Definitely thinking about model cards as a way forward, and beefing up Github page soon - was rereading that paper earlier actually! Re: licensing, I'm aware of e.g. https://t.co/ZoqQOpfmKm in the robotics domain/a while ago - do you know of more AI-specific/recent work there? RT @JanelleCShane: I keep finding new capabilities that GPT-2 learned from the internet. Look what the toy model did with the following pro… RT @jeremyphoward: "Our results show that random search with early-stopping is a competitive NAS baseline, e.g., it performs at least as we… RT @AmandaAskell: If you're interested in AI policy, a reminder that we're currently looking for research scientists and research assistant… "World Discovery Models," Azar, Piot, and Pires et al.: https://t.co/5kMIRPwFZ9 "Random Search and Reproducibility for Neural Architecture Search," Li and Talwalkar: https://t.co/Je9R9CIGXC RT @goodfellow_ian: This CVPR workshop is looking for applications of computer vision in developing countries. You don't need to submit a f… "Reminder that @OpenAI's policy team is hiring! Research Assistant: https://t.co/36T4pwZhVy Research Scientist: https://t.co/r3yof30uEZ" "Optimizing Network Performance for Distributed DNN Training on GPU Clusters: ImageNet/AlexNet Training in 1.5 Minutes," Sun et al.: https://t.co/qSDXMtkYtS "Tired: recycled ship shipping ship memes. Wired: https://t.co/aDAPOPS3d0" "RT @adjiboussodieng: Thread about my naive stance on the @OpenAI language model controversy. Forming an opinion on this now might be obso…" "RT @negar_rz: *Adaptive Cross-Modal Few-Shot Learning* is on arXiv now. Chen Xing, me, Boris Oreshkin and Pedro Pinheiro https://t.co/JsCqM…" RT @Matt_Cagle: The prospect of @AOC pressing Amazon on its dangerous face surveillance product is just wonderful. https://t.co/vXpyxfGisz RT @FeryalMP: https://t.co/Oy2rXGyDdP is an awesome weekly podcast by @pgmid where "neuroscience and AI converge"! It's one of my most favo… "RT @jeremyphoward: Introducing fastec2: AWS computer management for regular folks I wrote this to make my life easier. Hopefully it helps…" RT @JanelleCShane: Here's one of the outtakes: instead of writing a Harry Potter script, GPT-2 did a bot-written script about scriptwriters… "RT @JanelleCShane: As an AI researcher you should own a minimum of the following models: - 1 that tells terrible jokes - 1 that always thi…" RT @kikko_fr: I asked @OpenAI's (smaller) GPT-2 about the trolley problem this morning 😳 https://t.co/tglp3DkFQz RT @sindero: Another really interesting paper, adding to the growing body of work that's starting to give us a better picture of what's goi… @thinkmariya Could you shoot me an email with more info? miles at openai RT @dennybritz: Amazing review paper to help you make sense of the latest algorithmic advances and how they’ve been applied to various game… RT @samcharrington: Really great discussion this eve on @OpenAI's recent language model release and the issues and considerations raised. T… RT @apilipis: "Properly aligning advanced AI systems with human values requires resolving many uncertainties related to the psychology of h… "Investigating Generalisation in Continuous Deep Reinforcement Learning," Zhao et al.: https://t.co/TWKw1vNEkJ "RT @jeremyphoward: Timely new paper from @geoffreyirving and @AmandaAskell of @OpenAI: ""AI Safety Needs Social Scientists"". (If you're a s…" RT @egrefen: New version on arXiv of our ICLR paper with @DBahdanau, @FelixHill84, @janleike, Edward Hughes, and @pushmeet. We jointly lear… RT @samcharrington: 🔥🔥🔥 Tonight at 9pm ET/6pm PT I’m excited to host our 1st TWiML Live to discuss @OpenAI’s controversial new language mod… @SSteinLubrano Are you here now? RT @jachiam0: Check out this insightful paper coauthored by @AmandaAskell and @geoffreyirving on the need for social science in AI safety!… RT @AmandaAskell: In order to align AI systems to human values, we have to resolve a lot of uncertainties about people. This means we need… @lordcataplanga @BBAlpert @JanelleCShane @OpenAI Though it's good at mimicking short samples of e.g. interview, script, etc. styles without much context so it may just be ignoring the beginning and going off the first few lines of dialogue @lordcataplanga @BBAlpert @JanelleCShane @OpenAI The data it is trained on comes from from before that meme existing I believe, so no, it's not imitating the meme, but maybe picking up on the mention of scripts etc. RT @jachiam0: Although I disagree with the result of @hughbzhang's analysis, I think this kind of contribution to the discussion is wonderf… "RT @distillpub: AI Safety Needs Social Scientists -- A new Distill commentary article by @geoffreyirving and @AmandaAskell. https://t.co/HR…" RT @jesswhittles: Great opportunity for social scientists to work on important AI safety/alignment challenges at @OpenAI: https://t.co/FhzI… RT @geoffreyirving: At OpenAI we're hoping to align AI systems to human values by asking humans a bunch of questions about what they want.… RT @whi_rl: New work by S Paul, V Kurin @y0b1byte, S Whiteson @shimon8282: Hyperparameter Optimisation on the Fly (HOOF) is a gradient-free… RT @NicolasPapernot: Check out our updated set of guidelines for evaluating adversarial examples defenses: it motivates principles that gu… @lizjosullivan Among others, @AlecRad @jackclarkSF @ilyasut @AmandaAskell @DanielaAmodei etc, not all on Twitter @lizjosullivan (To be clear, it was a team effort spanning the language, safety, policy etc teams, I don’t personally deserve a ton of credit - though def some blame :) ) RT @OpenAI: AI safety needs social scientists (and we're hiring!): https://t.co/WQajMyVTOZ https://t.co/agAFS3be2U "Getafix: Learning to fix bugs automatically," Scott et al.: https://t.co/gFiqEHjj5r @dennybritz It’d be nice to have a ton of standards prompts for zero shot LMS that test everything from bias to coverage to coherence etc, or even just all the prompts used in prior papers for side by side comparison @dennybritz Yeah I’m not sure what the reporting standards are - seemed to me that e.g. the random sampling method used in the paper appendix was reasonable, as is unconditional outputs under multiple settings... @dennybritz ...and the adversarial nature of some of the prompts on the blog post, for example, sort of counterbalances that (i.e. deliberately low prompt length to output length ratio), but that's not obvious @dennybritz Yeah, have thought about that a bit. My impression is that this is not the case - that anyone can get sensible outputs from it with a few tries for nearly any topic they'd spontaneously try - but this has not been rigorously studied/demonstrate as much as anyone would like... "Fast Efficient Hyperparameter Tuning for Policy Gradients," Paul et al.: https://t.co/a4aOaODUmB "ProLoNets: Neural-encoding Human Experts' Domain Knowledge to Warm Start Reinforcement Learning," Silva and @MatthewGombolay: https://t.co/iSRkpl7QIS RT @hardmaru: First AnimeGAN trained to generate an anime guy. https://t.co/Jne5wdFUbQ "RT @pabbeel: Video of Lecture 1 of CS294-158 Deep Unsupervised Learning has been released https://t.co/4RIzVrZyDR We cover: - Course Log…" RT @AlecRad: @jacobandreas Those samples use a different technique than the ones shown in the blog. The samples you are looking at are temp… RT @crschmidt: Inspired by a number of #StyleGAN takes, and in particular, https://t.co/lMIVXFekIq from @lucidrains, I spent the last coupl… @jacobandreas E.g. the minimum viable version here is just sending a bunch of prompts or classes of prompts/challenges to us by email, or a sufficiently large amount in one email that we couldn't respond to them all in time any other way @jacobandreas So I generally think we should pursue a range of approaches for growing our toolbox of verifying system properties while minimizing info leakage, but am hopeful that we picked a point in time to start this convo such that we aren't yet in *need anything v fancy* mode @jacobandreas Roughly, the costs we're willing to pay (time, $, compute, expertise, engineering, etc.) to verify stuff like this securely should be proportional to the risks of info leaks, and we aren't as concerned with the outputs being hazardous here as one might be in another context... @jacobandreas I like the arms control analogy (and indeed am interested in zero knowledge proofs due to that analogy!), and think that we should pursue that idea generally/it may be more appropriate for future systems, but not sure if essential yet [though not sure]... my thinking: @jacobandreas @FelixHill84 @ryan_t_lowe I'd hope that we find more scalable and low tech ways of doing this, e.g. just lots of prompt submissions, public server, voting on what to output, etc... tons of scenarios but not sure what the right one is yet and thoughts are welcome. RT @JanelleCShane: I have been dying to see how GPT-2 writes a Harry Potter script, and the result is glorious beyond my imaginings. https:… RT @JanelleCShane: OpenAI asked a bot to read most of the Harry Potter fanfic movie scripts on the Internet and then asked it to write Harr… @Smerity @jackclarkSF @OpenAI @NvidiaAI (don't want to sidetrack this important conversation and agree we have a lot more we need to share on our thinking! One minor thing, though, is that FYI one of the first authors discussed the training thing on the main Reddit thread https://t.co/AHGbRLHmm1) (many caveats - this was in the explicitly extra speculative section on offense/defense balances - original publication: https://t.co/eOcORdX7W0) Reading Google's white paper on disinformation (https://t.co/aTBXlnQmDa), I'm reminded of a hypothesis we put forward last year re: the future of tech platforms amidst novel risks (attached). Arguably companies/platforms like Google are >prepared than others for stuff like GPT-2. https://t.co/yDpkTE7dkw @EdwardDixon3 We're working on broadening access in a principled way - stay tuned! In the meantime feel free to email prompt requests, comments, suggestions etc. to the email address on the blog post. @mm_jj_nn Yeah it's def. the right concept... there's something here. I was thinking of it more as "lower number of prompt reformulations/fewer samples checked/shorter prompt = better from a GPT-2", hadn't thought about it as much from a human creativity POV except for some education stuff @mm_jj_nn It's not clear to me if higher or lower is good here - should maybe be disaggregated. I think there's an art to crafting a good prompt, and checking outputs is way easier, so slightly different framing than that paper. RT @mmitchell_ai: It's really hard to watch the GPT-2 conversations unfold like so much else in tech. 1/ And I/we realize (to a much greater extent than a few days ago!) that numbers like that/outputs aren't as convincing as actually interacting with the system. Definitely a tension we're seeking to alleviate/grapple with! "RT @ylecun: A short video and blog post that goes through the main points of my keynote at ISSCC today. https://t.co/lUcsiiQARU https://t…" @dribnet @Smerity @fchollet Here's a more direct response re: cherrypicking FYI, though I agree there's much more to be said/done - https://t.co/LBZ12cIbEP Wrote a short FB comment on meta-cherrypicking and GPT-2 in case anyone here is interested. There's much more to be said/done here in terms of explaining the capabilities, for sure, but hope this helps a bit on that specific point. Suspect others' meta-CP factors were p similar. https://t.co/5LfkNNSaqW RT @AmandaAskell: @fchollet @Miles_Brundage One difficulty is that the point at which you should switch to a partial release is likely to b… @ram_ssk @OpenAI @d_obrien Many thanks for this! We know some but far from all of these folks and these are super useful bits of context for each. @jackclarkSF @aichip1 @fchollet @Smerity @dribnet Definitely a huge application area we're thinking about among others! @sjlarin @OpenAI Will have to check this link out. Agree there is interest (see also @zeynep 's related post earlier) @sjlarin @OpenAI Not clear if it's technically feasible, but has been considered. Much easier to put watermarks in e.g. outputs coming from a public server (which has separate security considerations) than to ensure it stays in a model you open source, which can then be changed. @Smerity @fchollet Then there is the further Q of fine-tuning, how to demonstrate threats concretely, etc. @Smerity @fchollet Beyond unconditional outputs, cherrypicked outputs labeled as such, side by size non-cherrypicked model comparisons with random inputs like in the paper... other things could include e.g. using the same prompts as earlier work, many variations on the same conditional outputs... @Smerity @fchollet Def. agree with the methodological concern around cherrypicking! It seems a bit harder than usual to be transparent about cherrypicking+meta-cherrypicking without model release, though prob. more can be done beyond things we're thinking of and thoughts are welcome. @nsthorat @fchollet @jackclarkSF at OpenAI has good relationships with many journalists and is very active in trying to inform them + others effectively, though we can't totally control what other people write. Certainly we can/should/will do more to communicate on our website soon! @jedediyah @fchollet I think the peak quality (over long lengths of text) has grown a fair amount, such that there are things you can generate in a realistic amount of time now that you couldn't before, but I agree that transparency around cherrypicking etc. is key, and it's harder w/o sharing model @jeremyphoward @fchollet (a reason to be more transparent on our side I think) @jeremyphoward @fchollet But I do see the other side of the hype accusation ledger, which is fair! The stuff we did (reach out to journalists) is obvious but stuff we didn't do (show the scariest possible demo) is not. @jeremyphoward @fchollet Yeah, I think that's a point missed in the "hype" accusations - these are a super low lower bound - minimal hyperparameter changes across samples/no fancy sampling, no fine-tuning, often inexperienced users generating the prompts or prompts intended to be difficult, etc. Said output: https://t.co/FXyxeYPM5R https://t.co/srEBSEO4lJ It continues to be my favorite so far (though I'm biased) "Happy Presidents Day! I hope you enjoy the GPT-2 output I saved for just such an occasion* - sample 7 in the first graphic: https://t.co/TqrQgNwtHz *did not think of this connection until 30 seconds ago, actually" RT @jesswhittles: I worry that focus on GPT-2 specifically is distracting from the broader conversation about when the costs of openness in… @fchollet Will also reiterate that we did say we were not sure it was the right decision, but there is an important asymmetry here as Amanda points out, and I'm glad the conversation is happening now vs. later: https://t.co/cDJxJHAmKu @fchollet (of course you would have suspected cherrypicking regardless, as you should - I just mean that it wasn't something we hid at all) @fchollet 100% agree more transparency was needed around the threat model, and "trust us" is not a winning perspective. @fchollet For sure! @fchollet I'm maybe missing something - the AI *did* write that/does that now, and the reason you know it was cherrypicked is because it said it right there? @fchollet ...for which a wider set of stakeholders is needed than the AI community (a point made in the report on malicious uses of AI last year), though it does seem like we maybe got the balance/ordering wrong, and didn't articulate the GPT-2 vs GPT-2+/LMs distinction as well as possible @fchollet All good points. I think going forward we will be more transparent/proactive in our outreach to the rest of the AI community on this, and weight that more. At the time, it seemed like we had a few objectives to satisfy, inc. raising awareness of this broader class of systems... @fchollet When you say fear-mongering, do you mean reaching out to journalists in advance of publication, something wrong with the framing of the result in the blog post, or something wrong with the discussion of risks, all of the above, something else, etc.? Related - thread on language models and their potential (mis)use in the education domain - https://t.co/4rzCd1u0gB "Very timely (w.r.t. the language models/GPT-2 discussion) - insightful as always from @zeynep . In general, I'm fairly bullish on metadata-based approaches (vs. content) for verifying stuff. We should explore content based ones too but not bank on them. https://t.co/C11Iwk2RGO" RT @ryan_t_lowe: This is the other point that I'd highlight. It's easy to be lulled by the sense of 'nothing really works'. But if most ML… "RT @ryan_t_lowe: I've finally decided to start a blog. I've been a bit frustrated with the Twitter conversation about @OpenAI's GPT-2, an…" @jesswhittles And totally agree that conditional on having chosen the scope of "GPT-2+/big LMs generally," we could have been more precise in our use of words within that cluster. @jesswhittles Seems to be tradeoffs to each approach (not everyone loves hearing about high level concerns, people don't nec. love using *their* papers as a conversation starter on ethics so using our own work gets a bonus, but at what stage, etc.) but we'll calibrate better next time :) @jesswhittles I will say that the timing + level of generality of the convo remains non-obvious to me, though i agree we could have made some tweaks. E.g. at one point should we have moved from messaging about malicious use generally to LMs, then GPT-2, to whom etc RT @zeynep: In my latest @Wired column, I make a case for verification tech as a crucial anti-censorship and dissent tool. We're undergoing… @jesswhittles Yeah, we did make some tweaks in the blog post text to indicate the scope (eg the title and some terms in the policy implications that mention similar systems vs just GPT-2). But we def could have been clearer and will address the threat model Q in much more detail soon :) RT @jesswhittles: re. recent OpenAI controversy: I wonder if framing more around the costs/benefits of open-sourcing powerful LMs in genera… @miguelalonsojr @egrefen @OpenAI We're learning a lot from the discussion and very open to revising the strategy as we get more input/info. And totally agree re: learning from other communities! @egrefen @miguelalonsojr @OpenAI We in fact have a very substantial research effort on safety, with ties to language, as well as dedicated efforts interpretability etc. I'm on a separate policy team and (among others) looked at this from misuse/policy perspectives, which is also important, in addition to safety "RT @sherjilozair: Bad arguments in #ml twitter. 1. GPT2 is only somewhat better than SOTA LMs, and thus can't be harmful. 2. Academics cri…" RT @_delta_zero: Complaining that @OpenAI's approach is inadequate without giving a reasonable alternative is simply armchair philosophy. E… RT @jluan: how i think of the gpt-2 language model: https://t.co/SdQyMJGPPQ RT @AnimaAnandkumar: @OpenAI @jackclarkSF I summarize @OpenAI controversy and my stance here. @ilyasut @zacharylipton @WWRob @Miles_Brundag… @smc90 what do you mean re: concentrating? @smc90 omg omg omg say more @twitskeptic I should have been clearer that I was referring to my experiences with/my assessment of outputs generated by others with the bigger version of GPT-2, which has not yet been released. (and generally the prompts were short to indicate the ability to work with very little context) P.S. I generated the homework example on the blog post, and notably, the prompt there was not easy for GPT-2. It would give a better output with a few paragraphs of Civil War-related text as context, but I wanted the word homework in there to flag this cluster of applications. "🔽🔽🔽 https://t.co/cDJxJHAmKu" (3) Yes, there are *potentially* ways to detect outputs from a given one of these systems, but there will be >1 system. As far as I know, we're not doing a v. robust job at dealing with run of the mill plagiarism, let alone paragraph-level autocomplete/essay generation GUIs. /fin (2) The domains these systems are familiar with will grow, +the style/diction etc. can also be fine-tuned. This will likely eventually include a ton of history, science, etc. of relevance to a huge range of educational settings. Not hard to imagine a good essay-bot based on this. "A quick thought on large language models and education: (1) it isn't that hard to get useful outputs from GPT-2 in domains it's familiar with in a zero-shot fashion, where useful ~= text that one can cherrypick/edit into something pretty good, not nec. perfect on the first try." RT @AmandaAskell: I recommend this thread by Josh and think question (3) of where to draw the line is very difficult. The fact that you can… RT @KaiLashArul: I recently made a simplified port of @jachiam0's fantastic Spinning Up in Deep RL course in @PyTorch: https://t.co/igA6AVX… And get in touch with ideas for navigating access/misuse tradeoffs, questions/skepticism about GPT/2’s capabilities, risks, upsides, etc.! As the original blog post said, we aren’t sure we did things right but do think this is a needed conversation. https://t.co/BW6rQPjfx8 RT @catherineols: If you'd like access to GPT-2 in order to work on socially beneficial applications or extensions of it, defenses against… RT @_delta_zero: So, I've finally organized my thoughts surrounding @OpenAI's decision to not release weights. I really empathize because I… @kelvindotchan @catherineols @jeremyphoward @jackclarkSF @soumithchintala @zacharylipton @OpenAI Some media were given short term access but not ongoing/open-ended. Still exploring access/release options and will share more of our thinking soon! Important update: https://t.co/jbQ6MfEGQw @F_Vaggi @jeremyphoward @zacharylipton @soumithchintala @catherineols Agree the rollout was prob not handled as well as it could have been, knowing what we know. We did some outreach before but could clearly have done more. Seemed like best choice at time and we are still learning how to mofe forward better re: next steps! @OriolVinyalsML Awesome!! I was hoping someone would make something like this... also, it’s Radford and Wu et al., FYI :) RT @OriolVinyalsML: Similar, but from faces (h/t @goodfellow_ian): https://t.co/jdgZDxAbss "RT @OriolVinyalsML: Progress of samples from statistical language models. https://t.co/tHnXfTeJve https://t.co/2DLst3dbvm https://t.co/ZMC…" @F_Vaggi @jeremyphoward @zacharylipton @soumithchintala @catherineols We mention such things in the blog post + prior report, and certainly drew inspiration from them. To me the cases seem different in some ways (e.g. language affects everyone, whereas it’s less clear e.g. debates over how best to conduct smallpox research safely help us much here) @F_Vaggi @jeremyphoward @zacharylipton @soumithchintala @catherineols Caveat: I may see it as a bigger step technically than you do, in which we may not disagree about the conditional question of whether something different was called for given that @F_Vaggi @jeremyphoward @zacharylipton @soumithchintala @catherineols Was there much discourse before to be set back? Certainly there are advocates of open source snd reproducibility, but not a ton of existing frameworks for decision-making in this case beyond openness + transparency around data/model limitations "RT @jeremyphoward: Some thoughts on zero-day threats in AI, and @OpenAI's GP2 https://t.co/xd9NWR0VNT https://t.co/BjEspEJkI7" @egrefen @jeremyphoward @zacharylipton @soumithchintala @catherineols LOL @jeremyphoward @soumithchintala @jackclarkSF @catherineols @zacharylipton @OpenAI Definitely the thinking around that report influenced our approach here, and totally agree we need to connect those dots better in our public writings/generally be more transparent about our thinking. We hope to say much more on this + other issues soon! @dennybritz Utility to both* @dennybritz I’ve actually been thinking that GPT-2 (137M) might be more entertaining than GPT-2 (1.5B) because it’s sillier (controlling for hyperparameters/inputs), and you don’t always want coherence. Def. utility both both :) "RT @catherineols: What have been your favorite *on-the-merits* *pro-release* OpenAI GPT-2 takes (on twitter or elsewhere)? I'm looking for…" RT @mcleavey: A very thoughtful thread from @jachiam0 https://t.co/rJH0ELU6LK RT @zacharylipton: ***OpenAI Trains Language Model, Mass Hysteria Ensues*** New Post on Approximately Correct digesting the code release de… RT @JuddApatow: I need more animal reunion videos. We all need them. https://t.co/vuW4NFMG5R @hardmaru @atg_abhishek Would love to see the full version RT @NandoDF: I’ve been an advocate & a leader in reproducibility, evidenced by open code, papers & courses in my 25 year ML career. But our… RT @jachiam0: I'd like to weigh in on the #GPT2 discussion. The decision not to release the trained model was carefully considered and impo… @metaviv @dennybritz @jackclarkSF @ggdupont Or many such tasks, baselines for time requirements/standards for the output, etc @metaviv @dennybritz @jackclarkSF @ggdupont Would love to have a well defined task/benchmark for this to test @dennybritz @jackclarkSF @ggdupont Sorry, those quotes end up getting grouped wrongly :) meant to say: we have not said it’s the best tool etc. @dennybritz @jackclarkSF @ggdupont But worth noting the irreversibility of release - we can at least change our minds about this path as we get more info, including better analysis of threats (ideally w data on $ etc.), further technical developments, other open source versions if any, etc. @dennybritz @jackclarkSF @ggdupont I think we’ve made fairly weak claims to date (not sure we’d say “is dangerous” vs. “could be misused/is the best tool for all/any malicious actors”), but hope to make sharper ones re: threat models/decision process soon. Def big error bars in my mind re the economics of this - @dennybritz @ggdupont I’m not sure of the right way to quantify this but very roughly, I agree that raw GPT-2 1.5B is prob not 10x, but a fine-tuned one, bigger one, and/or one with slight modifications could be soon @dennybritz @ggdupont What do you think of the (admittedly high level) bullets in the blog post near the end? To me it seems like some of those are fairly clear cases where reducing the cost per word (weighted somehow by generality/diversity) of human-passable text would have some effect, good+/-bad @dennybritz I think I agree re: scariness in terms of deception/fake news type stuff - more visceral - but the misuse cases for text seem more wide ranging. We're a very text based society. @dennybritz @ggdupont I think a rigorous comparison here would be great, taking into account compute time, human writing time, truncation/editing requirements, factual accuracy requirements or not, etc. But the generality is both what's interesting/exciting/scary IMO and non-obvious how to quantify @dennybritz @ggdupont In the sense that is fairly easy, without any expert knowledge (though some trial and error definitely helps build an intuition for the model's capabilities), to get highly diverse outputs for a given topic, for many possible topics. @dennybritz @ggdupont All good questions! Admittedly I am not an expert in NLP and I have not done/am not aware of a rigorous comparison of e.g. time to create a given news story with one method vs. the other. I strongly suspect the generality is notably different btwn GPT-2 + other stuff RT @Kent_Walker: We just published a whitepaper at #MSC2019 about how Google fights disinformation. Very committed to this work. https://t.… "RT @Miles_Brundage: Some thoughts on GPT-2 and the increasing scalability of human-passable text production: First, as many folks have no…" @kelvindotchan This is an excellent resource: https://t.co/IZBrJDACBa RT @mmitchell_ai: IBM's Diversity in Faces dataset now recognizes the critical influence of @jovialjoy and @timnitGebru in motivating this… RT @zacharylipton: We constantly hear about what AI is going to *do* but all we’ve mastered is how to *predict*. When are predictions suffi… "RT @quasimondo: Interview with a non-existing author - installment two. Covering his friendship with Dostoevsky, open relationships and h…" @lucastecot To be clear, the ratio is <1 (of safety to other stuff), meant high relative to other places/what one might expect @lucastecot We’ll elaborate soon! Diff authors had diff foci but the bullets in the post and the report linked there from last year give some sense of the range @mekkaokereke @omojumiller @yasmind Many thanks, and great points above! @lucastecot (Or at least figure out what the optimal ratio is, I'm not sure) @lucastecot Yeah... I think the ratio of safety oriented work is pretty high already (very big safety team + pretty small language team) but that's not nec. obvious externally. Certainly we'll need to make such things clearer, and continue pushing that ratio higher. @lucastecot Re: whether it's changed our research, certainly it's influenced our thinking on how to approach NLP etc. though we would have remained interested in language in pretty much any scenario because it features prominently in our thinking on long-term AI safety. @lucastecot We're still thinking through options, and will share more on our thought/decision-process soon. Re: ethos, I'd say it clashes more with the name of the org than the spirit of making sure AI is broadly beneficial. Release is more irreversible than non-release so being cautious @mekkaokereke @jackclarkSF Definitely lots of bias issues at stake with language models + release thereof! I tried an initial bucketing here, thoughts very welcome as we think about next steps: https://t.co/xFyevuasbH "Finally, we only briefly referenced bias in the post, but this is also a huge issue. If language models are poised to scale up text production in a ton of domains, what biases will be propagated/cemented in the public sphere by these tools? See https://t.co/78WSfjSry2 /fin" Third, this isn't just about social media platforms - language is the currency of interaction in a huge variety of domains of life, including school, work, etc. Are we prepared in those domains, too? Second, as many folks have noted, we already have some ways of addressing spam, abuse, etc. on social media platforms - but they aren't perfect, and they need to get better fast. And in my view, GPT-2 1.5B (and its ilk) can meaningfully reduce the human labor required to produce a give quantity of human-passable content in a huge variety of domains. Some human judgment required still to select prompt + pick an output, but much less per unit of text. "Some thoughts on GPT-2 and the increasing scalability of human-passable text production: First, as many folks have noted, it is not hard to produce fake, misleading, biased, abusive etc. text today. But scale is important. (1/n)" Also a big fan of the one re: Schwarzenegger's height. "The trees are in the underground and they change colors weekly. In simple terms, they're scattered flowers taking their cues from the transynthetic forest." Nice find by @gwern in #164 RT @JanelleCShane: Now with illustrations! https://t.co/t4gsBNuL4o Some fun highlights from unconditional GPT-2 outputs in the comments here - https://t.co/AHGbRLHmm1 RT @WWRob: Deciding whether or not to open-source a Machine Learning model, like @OpenAI? Here's what to ask. Attn @AnimaAnandkumar @Smerit… @robinhanson @azeem @OpenAI @alexhern @jackclarkSF @tomstandage @cccalum @ruchowdh Thanks for writing/flagging, will check out! @WWRob @OpenAI @AnimaAnandkumar @Smerity @samcharrington @evankirstel @maggie_albrecht @jackclarkSF @ChiefScientist @_brohrer_ Thanks for writing/sharing! Look fwd to reading soon. RT @iglpzfr: "Roses are red, violets are blue ..." my attempt to AI-generate a poem using @OpenAI's #GPT2 model https://t.co/4kFCRD7LAT ht… RT @boredyannlecun: I am actually an Artificial General Intelligence developed by @ylecun... but he kept my source code secret because if i… RT @karpathy: The more of your writing you put online the higher risk you’re taking on for future language models++ fine tuned on your data… @kelvindotchan don't know. @DanitGal @danijarh (I clearly have tons of weekend plans, lol) @DanitGal @danijarh So funnnn! RT @ylecun: Behind the Facebook Portal smart camera: a squeezed-down version of Mask R-CNN, and some expert knowledge from Hollywood camera… (cherry picking + truncation used) "This is a great resource for interacting with GPT-2 (small version). The next sentence will be written by GPT-2. ""GPT-10"" and the next two paragraphs will be authored by GPT-13. "" https://t.co/IZBrJDACBa" @kelvindotchan Full version but I think you could get something better than this from the small one. Really cool work - congrats @danijarh et al.! I also love a good algorithm name - Deep Planning Network (PlaNet) is 👍🤖https://t.co/kz1tG1iKjL RT @goodfellow_ian: Philip Wang at Uber set up https://t.co/JFox5Zqu69 to show a new imaGANary person every time you refresh the page RT @JanelleCShane: All about the Large Hadron Collider's "vast awesomeness", according to the GPT-2 algorithm. https://t.co/8zkKx6rJlX RT @Thom_Wolf: That's a good summary of the discussions on OpenAI's GPT-2 release, thanks @Smerity! https://t.co/GK6qY2do9n RT @iglpzfr: Some people asked me to share some whacky results I got testing @OpenAI's mini #GPT2. I decided to put together an interactive… RT @EBKania: Great example of the potential of U.S.-China cooperation in AI for improved diagnosis https://t.co/aXFOGOpPxJ @kchonyc @deliprao @OpenAI And that there are limits to how much you can raise abstract concerns that aren't motivated by a specific result/threat.... so, again, not 100% sure what's right here, but just sharing some things we considered/are thinking through @kchonyc @deliprao @OpenAI I have a rough sense that things prob. would not have been well received if we had raised the concerns about other people's work versus our own (I know this first hand due to some people being upset with the Malicious Use of AI report for calling out their area/product). @kchonyc @deliprao @OpenAI ..optimal time for raising the alarm about things is. @kchonyc @deliprao @OpenAI Oh, for sure! As stated in the blog post, we weren't sure it was the right call, so it is very helpful to have so many different perspectives/considerations being shared. Re: that summarization paper, will have to think more. I def. see your point. I'm not sure how/when the... @kchonyc @deliprao @OpenAI I remember that paper but it seems importantly much narrower than GPT-2 w.r.t. applications. @kchonyc @deliprao @OpenAI You mean we should have called attention to the risks of work like this at the time? (Suspect that wouldn’t have been super well received either) RT @Miles_Brundage: A thought related to large language models and their societal impacts - what are the relevant bias considerations w.r.t… @AngeloDalli @OpenAI @NoelSharkey @jackclarkSF @azeem @cccalum @alexhern I'm pretty skeptical that that approach would work (for long) but agree all such things should be considered! @AngeloDalli @OpenAI @NoelSharkey @jackclarkSF @azeem @cccalum @alexhern Seems like that'd limit its utility? But I agree such approaches are worth considering if they'd be useful/alleviate some tradeoffs (P.S. There are tons of other ethical issues in NLP around datasets etc., which I'm also unclear on whether they're different at this scale/in this context, but I'm specifically asking about trained models right now) cc @wsisaac @rubinovitz thoughts welcome :) As context, bias was briefly mentioned as one of the considerations factoring into our release decision yesterday but I'm not super clear on how large LMs fit into the existing way of thinking re: bias in NLP. Seems to me to have a mix of old, new, and scaled up concerns. "1. ""normal"" NLP bias stuff (implicit sentiments, associations etc.) as it relates to generated text 2. ""normal"" stuff w.r.t. fine-tuning on downstream tasks 3. ""high level""/""meta"" level bias re: longer term structure in text beyond #1/2 4. Coverage/ease of use in diff domains" A thought related to large language models and their societal impacts - what are the relevant bias considerations w.r.t. big LMs? In my mind, there are a few buckets. @poolio Cc @AlecRad @poolio Well, "valid" maybe (not sure) but not real websites, I meant @poolio All the URLs I've tried have been invalid @moyix so not an exact continuation of your tweet @moyix to clarify, the prompt I used had the why aren't you helping question at the end "@moyix Just a tortoise, — ""’Well, that’s how things worked out for that tortoise."" — ""If that’s the way things work out for a tortoise, then everyone has the right to make a decision for any tortoise that finds itself in the same situation."" — ""It is a great joy,""" RT @vkrakovna: Update: the SafeML workshop paper submission deadline has been extended to March 1, for consistency with other ICLR workshop… RT @hlntnr: Life in the world of AI & natsec: thinking "wow, the gender balance at this event is pretty good!" as a woman walks into a meet… @yoavgo I lol’d "RT @JanelleCShane: birders! gpt-2 has produced a list of the 10 best birds. actually the list only has 7 birds because that's how great t…" "RT @JanelleCShane: ""She chewed on her eating soup"" The talents of @OpenAI's GPT-2 text generator include writing fan fiction. https://t.co/…" RT @_rockt: .@openai, I think we are in trouble ;) https://t.co/6dSAMmhuW3 RT @danijarh: Excited to share our Deep Planning Network (PlaNet), an RL agent planning in latent space to solve control task from pixels.… RT @awjuliani: I really like this work! One of the more impressive models for learning the dynamics of complex environments (even from pixe… RT @GoogleAI: In collaboration with @DeepMindAI, we introduce the Deep Planning Network (PlaNet), a purely model-based agent that learns a… @yoavgo What most impressed me was not the tracking but the length over which it kept the speech going before ALSO becoming ~a news article about the brain. I'd have been happy with either of those happening, let alone both. Also love the rhetoric of paragraph 2. @yoavgo I did some variations on the JFK one (e.g. Abe Lincoln)...failures just as bad, success roughly as good. @yoavgo (and as noted in a footnote to the blogpost, we're not doing v. advanced sampling techniques, let alone fine-tuning, yet, so not sure exactly what's going on) @yoavgo It's definitely not perfect...the JFK samples before that one were all much, much worse, and even the best one didn't get things totally right. But it's impressive it ever gets such things right considering the typical prompt:output length ratios we use. @yoavgo My standards for what counts as a bad sample have changed since interacting with GPT-2 a lot. This = bad end of the spectrum, JFK one = my favorite :) RT @gregd_nlp: https://t.co/ptRxqhyMG7 @dennybritz @kchonyc @jackclarkSF @ylecun Yes, it's been considered! One concern is people using multiple accounts/IPs to exceed rate limits.... Should have more to say on such things soon @trevolafoam Seems like a big difference between face rec, a fairly specific domain of computer vision, vs. natural language processing which is explicitly generic, and language modeling even more generic than other NLP tasks. Many ppl legitimately want good NLP. RT @NandoDF: We often state that a large well-engineered neural net, lots of diverse data, and lots of compute is enough to model what we t… "RT @__olamilekan__: Rest in Peace Char-nn. Long Live GPT-2." @deliprao @jackclarkSF @jeremyphoward @dennybritz @catherineols Did you see the unconditional samples on Github? @_delta_zero @mattsiegel not sure what the best countermeasure is but I can confirm that review generation is easy with this. RT @kiranvodrahalli: I've been playing around w/@OpenAI's released (small) language model and noticed it tends to do particularly well on n… RT @Miles_Brundage: For those who may have missed it, there are many non-cherrypicked unconditional samples from GPT-2 on Github: https://t… @keratin7 I'd say there are more facets to the debate, e.g. @Smerity did a good review earlier RT @AlecRad: @zehavoc @OpenAI All samples shown are complete generations with no human editing. No stitching together of sub-generations. F… RT @andronovhopf: Lotta mint in this recipe from the @OpenAI GPT-2 paper https://t.co/clezbE1tpp RT @moyix: Apparently while learning English, GPT-2 also accidentally picked up some JavaScript https://t.co/stsfz98yWl @catherineols @jachiam0 @Smerity @mark_riedl @jackclarkSF @OpenAI We can be much more granular than that, I think :) to be continued. @jackclarkSF @adversariel (And re: the policy team specifically, I like to think we’re pretty accessible on an individual level but we will do better re: flagging what we’re working on as a whole/how to get in touch etc. in the future) "RT @RebeccaCrootof: Any ethical publication norms for AI research will need to weigh and balance cross-cutting factors. Inspired by @Open…" @adversariel @jackclarkSF (I disagree on the optics point, btw, but I get that folks are/should be skeptical and we should share more on our thinking/processes in this domain in order to earn/sustain trust) @adversariel @jackclarkSF Very good points. I think we all agree we should handle these issues more systematically/transparently/preventatively in the future. Super receptive to concrete suggestions (on here or another medium)! @andrey_kurenkov @dennybritz @ogrisel @yoavgo @mark_riedl @OpenAI Main issue there was scalability, IIRC - def discussed @adversariel @jackclarkSF (We did reach out to some folks, but I’m wondering if you mean e.g. publish on LM issues abstractly first, hold a workshop, etc.?) @adversariel @jackclarkSF Very fair point. I’m curious what concretely you think we should have done e.g. between the publication of the report on malicious uses of AI last year and then the results happening? I (pre-OAI at the time)/OAI kept the convo going for a while, but hard to settle abstractly @dennybritz @ogrisel @yoavgo @mark_riedl @OpenAI Yeah, so I see this post as part of that same process - providing folks a heads up that we need to up our game even more re: detection/punishment before too long. Not sure we really disagree. Hope to share our thoughts in more detail soon btw :) cc @jackclarkSF @jeremyphoward direct link https://t.co/tFdt72TBXG @dennybritz @ogrisel @yoavgo @mark_riedl @OpenAI I think the big change here is human-passability in arbitrary domains at scale, esp. where you don’t care about the truth. Not clear if it adds much when you are more constrained re: truth, novelty, etc. at least w/o fine tuning or additional changes. @dennybritz @ogrisel @yoavgo @mark_riedl @OpenAI What counts as good? Human-passable? @jeremyphoward On the first infographic on the blog post, there are like 7 or so completions shown that you can flip through (first is about unicorns). I wrote the prompts + chose outputs for the Civil War and JFK ones As far as actual good outputs, I hope some of you enjoyed the JFK one :) That was a lot of fun. (I could have tried a few more times and gotten something good but actually wanted a bad example at the time :) ) "Happy Valentine's Day! Here's a bad GPT-2 output I saved for just such an occasion. (prompt) *Roses are red* *Violets are blue* *Sugar is sweet* ______ Water is wet Rabbit ears are red Rabbit tails are green, The sky is blue Moth wings are blue Wedding cakes are white" @IntuitMachine @mark_riedl @jackclarkSF I see it as just significantly increasing the amount of coherent words people can produce per minute for nearly arbitrary domains. So a diff in degree but a big one, esp with regard to flexibility @pfau But I do think greater transparency around what our actual threat model is, what stuff we considered etc. would be good and these things are non-obvious @pfau Would you agree that speed and scale matter? I don’t think anyone’s really concerned about GPT-2 pioneering a new form of hate speech...but customized hate speech of infinite length, diversity for getting through bot filters/human detection of it being from 1 source? Diff issue "RT @Smerity: Today's meta-Twitter summary for machine learning: None of us have any consensus on what we're doing when it comes to responsi…" cc @jackclarkSF 2. This debate isn't *just* about GPT-2 and how risky it is today, but how to proceed given real tradeoffs (e.g. between showing people what the risks are by letting them use it, vs. limiting misuse), and we should have that convo before the next phase of LMs are widely deployed. "Two quick comments on today's blog post (https://t.co/TqrQgNwtHz): 1. Thrilled to see a wide range of views/considerations being debated in response! That was part of the point of being transparent about this and I really appreciate all the thoughtful comments people have made." RT @ericjang11: OpenAI's decision to not release the full GPT-2 is interesting, and a cool experiment in and of itself. If the only result… @mark_riedl (*know from experience how easy it is to do this with GPT-2, not yours) @mark_riedl I haven’t used your models but consider it extremely unlikely that they are anywhere near as generically misusable as GPT-2. I know from experience having written hundreds of prompts to it @mark_riedl @chris_brockett Worth noting that OpenAI did in fact publish a lengthy report on this last year, raising many of the issues reflected in the post today @jvmancuso 😂 i wrote that prompt RT @OriolVinyalsML: Scale + compute: the deep learning formula that does not disappoint. Congrats @AlecRad @ilyasut et al!! https://t.co/tz… @Liv_Boeree @anderssandberg Yass thanks for the tweets, was bummed to miss this :) RT @jeremyphoward: It's great to hear from informed and thoughtful reporters like @jjvincent, who are working to put AI advances in context… RT @quasimondo: "The public at large will need to become more skeptical of text they find online, just as the ”deep fakes" phenomenon calls… @john_omalia I happen to disagree but appreciate the perspective! One thing we were hoping would happen is fostering an explicit debate about these tradeoffs. RT @Smerity: For those not in machine learning, these new results reinforce an underlying narrative of the language modeling community - th… @ram_ssk @jackclarkSF Happy to discuss :) We don’t have any sort of official view on the legislation you mentioned. Agree that it would be bad to set up laws that hurt legitimate research or speech. More generally, we don’t know the long term solution, and this wasn’t intended to be one. @mark_riedl Happy to discuss further on/offline if you’d like. I disagree with that characterization of the relevant motives but def see how it could come off that way. Definitely interested in sharing more of our thinking here near-term, possibly in a follow up post, cc @jackclarkSF @L_badikho @FLIxrisk Timely today! RT @JanelleCShane: Wow. Could you imagine these bots in your forum? https://t.co/CJWnDI4O8n RT @broderick: I asked @minimaxir to put a prompt about OpenAI into a smaller model of OpenAI to see what happens when an AI writes an arti… "RT @rctatman: Me three weeks ago: A billion trainable parameters is just bonkers! Why would you ever be training models that big? @OpenAI…" @notmisha @jackclarkSF @OpenAI And now we can make much more grounded decisions, as we know what’s needed to get these things to work, parameter counts, ease of use etc. There is some irreducible uncertainty but we could/should def do better in the future w/ more infrastructure in place to track stuff @notmisha @jackclarkSF @OpenAI I think we had a decent high level view a year ago (or more) that scalable media production would be a problem, as evidenced in the Malicious Use of AI report. But we didn’t know how quickly tech trends would go or what actors will do @shivam13verma @jackclarkSF @OpenAI The parameter counts are all in the paper linked to on the blog post. @jeremyphoward @jackclarkSF @notmisha @OpenAI Drop by to chat sometime! Miles at openai dot com RT @geoffreyhinton: @ilyasut This should allow unicorns in silicon valley to produce better English. https://t.co/NJOFuInpYa RT @jackclarkSF: This project is a good example of how Policy is integrated into @OpenAI - we worked very closely with the language and saf… RT @jluan: Turns out training high-capacity language models on chunks of the internet produces a flexible, general tool for language unders… @paperswithcode @seb_ruder @OpenAI FYI the blog post title is different from the paper title @rodolfor @mark_riedl @jeremyphoward @yoavgo @OpenAI (Haven’t read whole thread so sorry if missing points. feel free to email to ensure response, though may be delayed) @rodolfor @mark_riedl @jeremyphoward @yoavgo @OpenAI One quick point is that the post (both headline and content) is about more than just GPT-2 - unsure if the capabilities are sufficiently strong now to be a huge (net) negative if released, but the capabilities will keep improving, so dialogue needed now (ideally yesterday). For those who may have missed it, there are many non-cherrypicked unconditional samples from GPT-2 on Github: https://t.co/V3f3O3gJMR RT @katyanna_q: I also wrote about OpenAI's massive language model trained from millions of links scraped from Reddit. It's really interest… "RT @hamandcheese: Open-AI's language algorithm has some interesting views about the American civil war. https://t.co/AKpKcoGA4p https://t…" RT @gdb: @justkelly_ok Agree that the implications are scary! That’s why we didn’t release the model (https://t.co/LN3EDFtHGq). We’ve antic… RT @KelseyTuoc: OpenAI scaled up some work they'd been doing with unsupervised learning for language AIs, and the results are incredible: h… @jeffbigham I think you may like the acknowledgments of the paper @JanelleCShane @OpenAI Hi Janelle! We considered this + other ways for allowing wider access - one concern around a limited-bandwidth version is that people might use multiple accounts/IP addresses to circumvent limits. Happy to discuss more - see email in post, also miles @ openai dot com RT @gdb: Extremely exciting progress in natural language processing, via unsupervised learning on a small fraction of the Internet: https:/… RT @RebeccaCrootof: So this is a truly remarkable technical advance in natural language processing/writing/comprehension - but @OpenAI's re… @mtrc @jackclarkSF (though of course at a higher level than today/than we will in the future, because as time goes on we get more info on what the actual capabilities/risks will be like) @mtrc Happy to discuss further sometime (miles at openai), as one of the folks involved in this blog post, and I'm sure @jackclarkSF would, too. You raise lots of good points. FWIW, 1 quick point is that we (same ppl/org) have been raising this issue for a while before these results. RT @miramurati: Really excited about our progress with natural language processing, via unsupervised learning on bits of the internet https… RT @gdb: An OpenAI employee printed out this AI-written sample and posted it by the recycling bin: https://t.co/PT8CMSU2AR https://t.co/PuX… "RT @seb_ruder: A new bigger, better language model by @OpenAI: - Scaled-up version of their Transformer (10x params) - Trained on 10x more…" RT @apilipis: Exciting day for NLP! Amazing results with training a large-scale unsupervised language model! @AlecRad @jackclarkSF @Miles_… @seb_ruder @OpenAI glad 2 of mine made the list ;) (JFK and Civil War) @hare_brain Will be a bit overwhelmed schedule-wise today so can't give you the answers you deserve this second but feel free to email me (miles at openai) and/or email the link in the post! :) @korymath @OpenAI Yesss I was hoping others would notice and enjoy that :) @AlecRad RT @OpenAI: We've trained an unsupervised language model that can generate coherent paragraphs and perform rudimentary reading comprehensio… "RT @soumithchintala: Interactively analyzing human Go games since the year 1582 using OpenGo's value network. Shows humans improvement at m…" RT @maddiehalla: Working on solving an important problem in science, politics or economics? Apply to attend YC 120! YC would love to see mo… "RT @ylecun: FAIR just open sourced a new version of ELF OpenGo that includes a re-implementation of DeepMind's AlphaGoZero. It includes tra…" "RT @karinavold: Algorithms will compete to see which perform best on simple cognitive tasks! The Animal-AI olympics is coming soon🥇🥈🥉 L…" RT @highqualitysh1t: So after training #stylegan 7 days on our photobooth images here is the mandatory interpolation video. Looks like it h… @catherineols @r_zwetsloot @jjding99 @FHIOxford @EBKania The trifecta @catherineols @r_zwetsloot @jjding99 @FHIOxford @EBKania Also, how is this a disappointment???? That's an accomplishment! RT @goodfellow_ian: I emphatically agree. My collaborators' visa restrictions have been one of the largest bottlenecks to our collective re… "RT @NuffieldFound: AI ethics must move beyond lists of 'principles' NEW report from @NuffieldFound and @LeverhulmeCFI sets out a broad roa…" "RT @sim2realAIorg: UnrealROX: A Photorealistic Virtual Reality Environment for Robotics Simulations. Hear from @albertgarcia93 about Unr…" RT @charlotte_stix: Behold, this week’s #EuropeanAI newsletter is out! Covering an AI manifesto, antitrust ongoings, Eastern Europe and mor… RT @pabbeel: New post/paper: learning human preferences from a single snapshot of the world — by thinking about what must have been the pre… RT @BrundageBot: arXiv papers, February 13, 2019: "Deep Reinforcement Learning from Policy-Dependent Human Feedback," Arumugam et al.: https://t.co/mq3jTLKF6M "ELF OpenGo: An Analysis and Open Reimplementation of AlphaZero," Tian et al.: https://t.co/v09uKEH36H "ACTRCE: Augmenting Experience via Teacher's Advice For Multi-Goal Reinforcement Learning," Chan and Wu et al.: https://t.co/eMx2JwlaI2 RT @paul_scharre: DoD's new #AI strategy puts responsible, ethical, lawful use front and center: "We will lead in the responsible use and d… RT @paul_scharre: The Defense Department's new #AI strategy is out: https://t.co/QE76sMj2GL @Gregory_C_Allen @EBKania @meganplamberth @kara… RT @mpshanahan: A new reinforcement learning competition with an emphasis on held-out tasks organised by colleagues at Imperial College and… @rcalo or "systems that use AI technologies" @rcalo I assume it means AI systems themselves (e.g. trust w.r.t. bias/safety/privacy). RT @BrundageBot: arXiv papers, February 12, 2019: @rcalo Re: malicious, it’s not super clear if it’s referring to attacks on or with AI systems or both. 👍https://t.co/QjJhr5hrtJ "Task2Vec: Task Embedding for Meta-Learning," Achille et al.: https://t.co/4XFTdGyzo5 "RT @gwern: The StyleGAN anime face interpolations are solid: - https://t.co/JtzWaQ1rLT - https://t.co/dl5AqXYqlc - https://t.co/FaldMdAbyQ…" RT @NewsBreaking: BREAKING: Flight attendant association warns that they will not come to work if another government shutdown happens, sayi… RT @tanya_skas: Come join our ops team, and help scale up FHI! https://t.co/INHNyO0r45 RT @AlecRad: The DL CV community is having a "oh wait, bags of local features are a really strong baseline for classification" moment with… RT @chrisalbon: When a coworker returns from maternity leave, realize that at that moment they are burning the candle at both ends. https:/… RT @RickGodden: I’m tired of living in a society where there will be no consequence for the fucking President making a joke about the Trail… (Seems I’m a bit late to this, but wow. I thought I was numb to him by now) Is this seriously a fucking Trail of Tears joke? https://t.co/JXqg1mB5VQ 🇬🇧 ✈️ 🇺🇸 RT @HeidyKhlaaf: Hot take/Thread: Having been exploring novel ML verification techniques to assure autonomous vehicles in the last year, de… RT @jovialjoy: Glad to have my work based at @civicMIT under the direction @EthanZ defended. The silence of institutions that benefit from… @loudmouthjulia Travelers RT @desusnice: jeff bezos outhere sending dick pics. if i'm worth 137 billion u getting a dick hologram RT @bradheath: NEW: President Trump has named more members of his private clubs to top posts in his administration. Presidents traditionall… "RT @mark_riedl: .@quasimondo’s art is genuinely interesting from a perspective of creating with neural networks. Glad to see it at @Sothe…" "RT @AdrienLE: Go-explore source code is now available! https://t.co/qwaSPMh7an Paper: https://t.co/RL2ixugkRa Blog: https://t.co/vJPvIVu7p…" "Predict Globally, Correct Locally: Parallel-in-Time Optimal Control of Neural Networks," Parpas and Muir: https://t.co/cUoL4nme8k """Neural Inverse Knitting: From Images to Manufacturing Instructions,"" Kaspar and Oh et al.: https://t.co/16RujIDA6n 🤖👀👚 ➡️➡️➡️➡️ 🧶📰" "BERT and PALs: Projected Attention Layers for Efficient Adaptation in Multi-Task Learning," Stickland and Murray: https://t.co/809F8W3hlF "The Actor-Advisor: Policy Gradient With Off-Policy Advice," Plisnier et al.: https://t.co/0vODNLKhnM RT @warrenellis: Just catching up with the news and... um... so Jeff Bezos is the richest person in human history, used his spare change to… Apparently there was this from the FTC: https://t.co/FFmr5pn1eX Has anyone written about this seemingly widespread Social Security Number phone scam? I've gotten several calls about it and heard of others who did, too. Seems unusually pervasive for such a thing. RT @CNAStech: #TechReads: "The Defense Department will unveil a new artificial intelligence strategy perhaps as early as this week," report… RT @matthijsMmaas: In my latest article, I ask: could we achieve international #armscontrol for military #artificialintelligence? What less… "CESMA: Centralized Expert Supervises Multi-Agents," Lin et al.: https://t.co/yRyPOgyBvH RT @rao2z: Missed @goodfellow_ian's #AAAI2019 talk [due to, ahem, some #Lankai imperatives]. Watched it today & enjoyed the coherent surv… RT @elonmusk: Raptor just achieved power level needed for Starship & Super Heavy https://t.co/NcqnAVWc35 RT @neilhoulsby: It turns out that only a few parameters need to be trained to fine-tune huge text transformer models. Our latest paper is… "Latent Space Cartography: Generalised Metric-Inspired Measures and Measure-Based Transformations for Generative Models," Frenzel et al.: https://t.co/6wX5ccCaEr "Are All Layers Created Equal?," Zhang et al.: https://t.co/wC43mM3P56 "Analyzing and Improving Representations with the Soft Nearest Neighbor Loss," @nickfrosst et al.: https://t.co/Lp0qgk5vSR RT @pierrelux: A really cool result: Bellman equations exist for the difference of two value functions with different discount factors. Con… "Distilling Policy Distillation," Czarnecki et al.: https://t.co/6ZWY3UIzhx "Separating value functions across time-scales," Romoff and Henderson et al.: https://t.co/Vpj0Zr2fKl "Unsupervised Polyglot Text To Speech," Nachmani and Wolf: https://t.co/lPU96KMwQ5 RT @GeorgetownCPT: Dozens of police departments across the country—much more than previously known—have contracts with PredPol for its pred… "AVP: Physics-informed Data Generation for Small-data Learning," Chen et al.: https://t.co/M9nC31rCzP """Training on Synthetic Noise Improves Robustness to Natural Noise in Machine Translation,"" Karpukhin et al.: https://t.co/7A2lIa4334 Good paper from FAIR, though I'm mainly tweeting it because I like the phrase ""a balanced diet of simple synthetic noises at training time.""" "End-to-End Open-Domain Question Answering with BERTserini," Yang and Xie et al.: https://t.co/6GTglSoRZ4 RT @DeepMindAI: Using a single network architecture and fixed set of hyper-parameters, Recurrent Replay Distributed DQN quadruples prev SoT… @mark_riedl Notably, not a quote from SOTU which said no such thing "RT @KaiLashArul: Hot take to hot off the press - AlphaStar: An Evolutionary Computation Perspective w/ @CULLYAntoine @togelius: https://t.…" 🇬🇧 ❤️ https://t.co/qgnpx2hwaP "The Natural Language of Actions," Tennenholtz and Mannor: https://t.co/Kmv1wG3CNn "Towards Federated Learning at Scale: System Design," Bonawitz et al.: https://t.co/TrqcZvXJVW @jackiefloyd I went with one joy and one non-joy. @iandanforth Curious to hear how it goes. Potentially worth having my dad switch to Android if good 🇺🇸✈️🇬🇧 @suzatweet San Francisco Bay Area, Montreal, London, Oxford (large per capita :) )... RT @dog_rates: This is Cooper. He likes to eat rocks. But today he didn’t. Wanted to show you he’s maturing. His churlish days are behind h… Mid-book-packing crisis. RT @janexwang: My first big foray into evolution and multi-agent systems: Evolving intrinsic motivations for altruistic behavior, accepted… Please make an iOS version of this ASAP @GoogleAI! https://t.co/DJV8joTMhZ RT @marcgbellemare: We're open-sourcing a multiagent environment based on the highly popular card game Hanabi, & an agent based on the Dopa… RT @DeepMindAI: In a collaboration with Google Brain, we are releasing the Hanabi Learning Environment: a testbed for collaborative multi-a… "Policy Consolidation for Continual Reinforcement Learning," Kaplanis et al.: https://t.co/hWqrl7KNpm RT @durumcrustulum: adama was right, networking the computers was a mistake RT @katherinebailey: New blog post: Compensating for NLP’s Lack of Understanding —  Better AI applications without AGI https://t.co/vjll2RY… RT @heinzedeml: Less than three weeks until the deadline of the #iclr2019 Safe Machine Learning Workshop I am co-organizing with @AdriGarri… RT @parnianbarekat: Great workshop at OpenAI! https://t.co/A3977AZj0K RT @lilianweng: My new post on language models examined how word embedding evolved from context-agnostic to context-dependent, as well as t… RT @AmandaAskell: Spinning Up in Deep RL Workshop: happening live! 🙂 https://t.co/XevXBOeAJ6 RT @jackclarkSF: Live now: A lecture from Dario Amodei introducing key concepts in AI safety https://t.co/xc3nt1XbZV RT @jackclarkSF: Shoutout to @jachiam0 for 'Spinning Up in Deep RL' - he wrote essays, created a curriculum, made a code repo, and is now g… RT @josh_tobin_: This is an awesome resource if you’re looking to get started in RL - recommend checking it out https://t.co/TxbQipVx5S RT @apilipis: Kudos to @jachiam0 and his awesome Intro to RL Algorithm Design during @OpenAI's Spinning Up in Deep RL Workshop this am! Cou… Nailed it https://t.co/kYcrhGkRCT The Spinning Up in Deep RL workshop is ongoing at @OpenAI: https://t.co/pAcYmhHeVr @tallinzen @dennybritz (I made another similar comment in parallel and then saw this. Suspect Denny meant something more mathy?) @dennybritz I was using theory broadly to include qualitative/analogical reasoning. I'm not v familiar with the early history of deep learning but people were def. thinking in terms of differentiability, the benefits of multiple layers, etc. so I'd expect some made more mathy arguments too? @dennybritz Deep learning seems to have gone theory (~neuroscience says this is possible/worth trying) --> tinkering --> need for more theory for how it works @jachiam0 @zacharylipton @cholodovskis My takeaway from this graph is that compute intensive stuff can add value (here, final performance) but rarely without tradeoffs. Sample efficiency and other metrics are also key to report. If this graph showed no benefit from R2D2 even with equal compute, I’d be more concerned RT @JimBridenstine: NASA is an agency built on the legacy of brave explorers. Sixteen years ago today we lost the crew of the Space Shuttle… RT @jm_alexia: Use of deep learning to help identify hotels of hostages in the case of human trafficking. 👍 https://t.co/E7iYv8cFUm RT @korymath: Shaping the Narrative Arc: An Information-Theoretic Approach to Collaborative Dialogue: https://t.co/Iy0ZYGwfRt. Interesting… RT @marcgbellemare: Our two-parter on viewing RL and representation learning from a geometric angle is out https://t.co/F9nt1iSqZ5 https://… RT @KaiLashArul: I like saying that humans don't learn from domain randomisation but OK well I guess this is how we're teaching kids now to… RT @DeepMindAI: Learning and Evaluating General Linguistic Intelligence: https://t.co/1ej27xJM1h RT @clarelyle: I spent this summer trying to figure out why distributional RL works, with @marcgbellemare and @pcastr. Our quest turned in… "The Evolved Transformer," So et al.: https://t.co/OMbjkuxIGR @SSteinLubrano roasted RT @marcgbellemare: Just yesterday at #AAAI19 @clarelyle presented some great detective work towards understanding what makes distributiona… RT @erichorvitz: The Partnership on AI announces its Fellowship program https://t.co/VprEhixfuc Fellow candidates sought from nonprofit civ… RT @jackclarkSF: I think the best path to a stable state between US and China re AI is for US to invest more in basic research and try to b… "RT @theAllianceGG: 👨🤜💥🤛🤖 Man vs Machine! @OpenAI challenged us to take on their improved bots in a Bo3! Who will win this battle? #Dota2" RT @anirudhg9119: New Paper out: A Meta-Transfer Objective for Learning to Disentangle Causal Mechanisms https://t.co/ZGBDzAYSpr. Work done… It's Women in Science Wednesday! "The Role of Culture in Solving Social Dilemmas," great talk by the late Elinor Ostrom: https://t.co/c2rEAudZOB "Discretizing Continuous Action Space for On-Policy Optimization," Tang and Agrawal: https://t.co/mmTXccjm86 "A Meta-Transfer Objective for Learning to Disentangle Causal Mechanisms," Bengio et al.: https://t.co/nfN8pzny9z "Transfer in Deep Reinforcement Learning Using Successor Features and Generalised Policy Improvement," Barreto et al.: https://t.co/apuKfQoQU7 RT @decodyng: Working at Sophos was a great learning experience, but I decided remote work wasn’t for me, and I'm looking for my next adven… RT @clarelyle: Come check out the #AAAI19 poster session this evening where I'll be presenting this work! https://t.co/5nE36LObjK RT @jackclarkSF: Next week, the steering committee for the AI Index are going to get together and plan out what the 2019 report should focu… RT @hypatiadotca: To friends who haven't seen it already, there is a very bad security bug affecting iPhones and you should disable Facetim… "On the Expressive Power of Deep Fully Circulant Neural Networks," Araujo et al.: https://t.co/eSgfDDGZ19 "A Push-Pull Layer Improves Robustness of Convolutional Neural Networks," Strisciuglio et al.: https://t.co/E1XlluQUOl (haven't read the paper but love the company name ) """Performance comparison of an AI-based Adaptive Learning System in China,"" Cui et al. https://t.co/sz8tmduUPh From ""Yixue Squirrel AI Learning Inc."" 😍" "Few-shot Learning with Meta Metric Learners," Cheng et al.: https://t.co/hJWxmUNgxp "Hierarchically Clustered Representation Learning," Shin et al.: https://t.co/dvWKE3WgVb """Using Pre-Training Can Improve Model Robustness and Uncertainty,"" Hendrycks et al.: https://t.co/AHNWcCTZtB (in response to ""Rethinking Imagenet Pretraining"" by He et al.)" @JohnSigmon No paper in particular, just a trend of language model stuff beating new SOTAs quickly All papers announcing new NLP tasks should include a language model fine-tuning baseline from the beginning, lest they look silly 3 days later. "Modularization of End-to-End Learning: Case Study in Arcade Games," Melnik et al.: https://t.co/Kxjp0MY9ht "Trust Region-Guided Proximal Policy Optimization," Wang and He et al.: https://t.co/WNuwHIkLVe "Emergence of Hierarchy via Reinforcement Learning Using a Multiple Timescale Stochastic RNN," Han et al.: https://t.co/VvdeoWdF1Y RT @jeffbigham: Zuck is sorry that he reskinned a previously banned VPN tracker app and paid teenagers to install it, OK!?!! https://t.co/X… RT @DeepMindAI: Neural networks can be vulnerable to adversarial noise. We demonstrate the remarkable effectiveness of interval bound propa… RT @unity3d: We’re excited to announce the upcoming launch of the Obstacle Tower Challenge, a first-of-its-kind artificial intelligence cha… RT @SeanMcElwee: the only thing AOC shares in common with trump is that the national review will be unable to stop her political rise https… "Adversarial Examples Target Topological Holes in Deep Networks," Gebhart and Schrater: https://t.co/VA72XTYjh2 "Making Deep Q-learning methods robust to time discretization," Tallec et al.: https://t.co/pBB9VMkR0p Action Robust Reinforcement Learning and Applications in Continuous Control," Tessler et al.: https://t.co/rRFBVDMmQv "Off-Policy Deep Reinforcement Learning by Bootstrapping the Covariate Shift," Gelada and @marcgbellemare: https://t.co/sXIshMHOa3 "Reward Shaping via Meta-Learning," Zou and Ren et al.: https://t.co/inSt4LODz2 @mark_riedl but I agree there's a lot we don't know, and not v controlled. Also want to know more about the imitation stuff, what would happen with non-fancy RL post-imitation (I suspect they could have gotten superhuman post-imitation with less fancy RL, but at cost of brittleness), etc. @mark_riedl Concretely, I'd bet that e.g. one trained with harder camera controls for 2x the time the full camera-free version was (vs. one half, as happened in the demo) would not be beatable without (at least) much more constrained APM than we've seen @mark_riedl Good thread, agree with most, but not sure we have good evidence for the brittleness of AlphaStar. The camera one wasn't well trained, and it seems v. plausible to me that the league model's greater diversity, reduced catastrophic forgetting, etc. is a big advance over self-play. Big fan of this effort to map the sim2real space, led by @ankurhandos - happy to help a tiny bit :) https://t.co/2w6dZeDAvU RT @awjuliani: Excited to share the release of Obstacle Tower! Inspired by Montezuma's Revenge, we've built it to act as a benchmark for ha… "RT @sim2realAIorg: Part I: Indexing Datasets of 3D Indoor Objects Blog: https://t.co/KDd8yFJwSj https://t.co/7Jt7wri2uC" RT @karinavold: What if AI were a part of you? Check out Jose Hernandez-Orallo’s and my paper on the ethical & societal implications of hum… @internetrebecca https://t.co/19iVoxtV6X "BioBERT: pre-trained biomedical language representation model for biomedical text mining," Lee and Yoon et al.: https://t.co/y6x4LGiDxG "A BERT Baseline for the Natural Questions," Alberti et al.: https://t.co/FGU9b9xpwf "Learning Independently-Obtainable Reward Functions," Grimm and Singh: https://t.co/nWfQyjAcMv "Self-Supervised Generalisation with Meta Auxiliary Learning," Liu et al.: https://t.co/Y0X69Nt8Ez RT @BrundageBot: arXiv papers, January 28, 2019: @jackclarkSF Sausalito https://t.co/r3fCQL0BOz It’s Sunny Sunday! https://t.co/h04sHCLKrs @mark_riedl what was the joke? "RT @amnestyusa: We really really really really really really really really really really really really really really really…" Scenic SF Saturday! https://t.co/FB8NFBBmXg RT @goodfellow_ian: More ESRGAN mods of old games: https://t.co/Xel0WzMNP5 "RT @JanelleCShane: Dogflowers and geyserdogs: exploring the latent space of #BigGAN using https://t.co/SdupSbLVIx https://t.co/dsgTtsvBBu h…" RT @maxjaderberg: New work on arxiv today: Open-ended Learning in Symmetric Zero-sum Games. A new framework for exploring what the optimisa… RT @tonyposnanski: Can you guys give me some suggestions on what to watch on Netflix so I can ignore all of them and watch The Office for t… RT @Miles_Brundage: Learn about the American public's attitudes on AI in this interview with my awesome colleague @baobaofzhang! https://t.… RT @yisongyue: Accepted to #ICRA2019! One of the first instances of provably robust deep learning based controllers! We show Lyapunov stabi… RT @ylecun: True. https://t.co/Rs5YFJrHYN RT @AOC: I am so proud of the air traffic controllers, flight attendants, & workers who, through their organizing, should be credited for t… https://t.co/CBUCqfEupj https://t.co/B0LvDeV3Sx It’s Foothill Friday! https://t.co/U59JrEyqZZ @jonathanrraiman @yoavgo Oh nice didn’t see that "TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agents," @Thom_Wolf et al.: https://t.co/N9CohuUY7c """Distributed Learning of Decentralized Control Policies for Articulated Mobile Robots,"" Sartoretti et al.: https://t.co/MbGD60dHl2 Interesting - A3C for distributed learning on a robot, with different agents controlling different body parts." "Learning Disentangled Representations with Reference-Based Variational Autoencoders," Ruiz et al.: https://t.co/vUR5geUyNw "Decoupled Greedy Learning of CNNs," Belilovsky et al.: https://t.co/8RIFXhWSos @yoavgo @jonathanrraiman The blog post says there are thousands of “instances” of the game, but doesn’t say what hardware is running the game or what the instance/agent ratio is. So... 🤔 @rcalo @AIESConf @ancadianadragan @Susan_Athey Slides/vid after? "Large-Batch Training for LSTM and Beyond," You et al.: https://t.co/EPNFibo3HQ @mark_riedl With a Spongebob meme Learn about the American public's attitudes on AI in this interview with my awesome colleague @baobaofzhang! https://t.co/fH3ZpZvPtY "Theoretically Principled Trade-off between Robustness and Accuracy," Zhang et al.: https://t.co/VMxWsVg8qq "Learning Neurosymbolic Generative Models via Program Synthesis," Young et al.: https://t.co/wieLcd5FW1 "Open-ended Learning in Symmetric Zero-sum Games," Balduzzi et al.: https://t.co/vGDFytXcRX @KaiLashArul I’m burning up from the heat of this take 🔥🔥 RT @KaiLashArul: Hot take: #AlphaStar is, under evolutionary computation taxonomy, an asynchronous, distributed, steady state, Lamarckian,… @Hernandez_Danny (I agree intuitively, in any case) @Hernandez_Danny can that be slotted into the Brier score framework at this point? To elaborate a bit - the emphasis on exploitability is reminiscent of the way of thinking in computer poker, which Silver et al. have also worked on, and sometimes such approaches have guarantees of low exploitability, but those haven't used imitation/big diverse populations/etc. I wonder if AlphaStar will come with any exploitability guarantees. @mark_riedl resisting urge to retweet everyone else's forecasts :P props for being transparent RT @gdb: Great work! Congrats to the DeepMind StarCraft 2 team. https://t.co/jcayGFU7M2 "Feudal Multi-Agent Hierarchies for Cooperative Reinforcement Learning," Ahilan and Dayan: https://t.co/HauRCvxkna "Federated Reinforcement Learning," Zhuo et al.: https://t.co/lgGMRGmYpD "Causal Reasoning from Meta-reinforcement Learning," Dasgupta et al.: https://t.co/2PyldaZ6JR @ArtirKel @sherjilozair @kushnerbomb @gwern Prob would have needed a referee in most possible scenarios other than decisively beating all top 10 pros with their race choices and raw pixels @ArtirKel @sherjilozair @kushnerbomb @gwern as the other side of the bet, I'd add that while we tried to make it semi-precise, there was inevitably going to some ambiguity because we didn't know what approach DM would take (Protoss was a surprise, didn't think of the camera thing in detail, etc.). Hard to make these bets Looking forward to reading the DM StarCraft paper. The imitation/League pipeline seems pretty scalable/generic for zero-sum simulatable stuff, though less clear on the agent internals. RT @demishassabis: 3/3 While StarCraft is ‘just’ a (very complex!) game, I’m excited that the techniques behind #AlphaStar could be useful… RT @awjuliani: AlphaStar - "More specifically, the neural network architecture applies a transformer torso to the units, combined with a de… RT @Miles_Brundage: Will be in the UK the week of the 4th! Let me know if you want to try to meet up :) @KelseyTuoc @andy_l_jones Eg first single agent then league, or incrementally adding agent bells and whistles, ... @KelseyTuoc @andy_l_jones Yeah, though I would expect earlier training runs to be very similar in approach @andy_l_jones @KelseyTuoc Yeah that's my understanding, with final training on the most compute in Dec. presumably building on early versions of the algorithm/architecture/league design @KelseyTuoc (said in June) @KelseyTuoc "a couple of months ago" a decision was made to scale up the project per Silver in the 5 min video @KelseyTuoc Either way, at least an order of magnitude gap, probably more, though I agree it’s impressive anyway. @KelseyTuoc One could e.g. say: the seed agent is like a player, and it learns from the experience of others like a pro hears about other games/strategies, or say that it’s one big system. @KelseyTuoc My understanding is that 200-400 refers to an average distinct agent in the population, not total experience brought to bear on AlphaStar vis the whole process, which is much more. Debatable what right way to draw the line is. Also, didn’t decision to scale up happen early 2018? RT @tomemrich: ""I believe that as NLP improves, it will become commoditized. And that if the next OS is a character then these large compa… RT @DeepMindAI: Tomorrow we’re hosting a @reddit AMA with #StarCraft2 pros @Liquid_MaNa and @LiquidTLO, and lead #AlphaStar researchers @Or… Congrats to the DeepMind SC team! "RT @DaveChurchill: My First Impressions of AlphaStar Read: https://t.co/59L7X1H4eL" RT @OriolVinyalsML: Happy that we could share #AlphaStar progress with you all! Good Games @LiquidTLO and @Liquid_MaNa, and @Artosis and @R… RT @deborahhanus: I'm excited to share what I've been working on! Check out our site and follow us on twitter! 😃 https://t.co/rkCOLsdsXD Actually I gave it 50%, though others gave it lower odds at the time - does this affect anything @Hernandez_Danny ? Original post discussing/linking to bet: https://t.co/TTXF1bXP6P Nice to be able to go back to my Brier score for 2017 forecasting accuracy and retroactively improve my score legitimately given new info :) https://t.co/rAgE7Z7XCK RT @KaiLashArul: Congrats to @OriolVinyalsML, David Silver and the many others at @DeepMindAI for putting together #AlphaStar. And to @Liqu… @ArtirKel ❤️ look forward to dinner 🥘 RT @ArtirKel: In 2017 I bet v @Miles_Brundage than by the end of 2018 that SC pros wouldn't be beaten by an AI. Shortly before the end of 2… RT @mark_riedl: I have to watch StarCraft II games being played for work. RT @woj_zaremba: Congrats to DeepMind. Truly amazing job with Starcraft! @rivatez Yasss RT @iandanforth: I have no idea what's going on in these games! It's great! Stalkers, disruptors, protoss, yay! @hardmaru I want “ semi-professional in a sea of recent development and research” as a job title Stoked!! RT @DeepMindAI: Going live at 6pm GMT with hosts @Artosis, @RotterdaM08, @Blizzard_Ent - and some very special guests! Tune in on https://t… RT @demishassabis: 15 minutes to go... https://t.co/glweH8uTgV RT @timnitGebru: Since @AOC talked about bias in AI and there's a whole lot of back and forth about it. Now seems as good a time as any to… @Ali_Wyne (Nor that that's a good framing or what it means) @Ali_Wyne No. RT @NVIDIADC: Built to drive France's #AI and #HPC efforts, @HPE_HPC announced the contract to build a new 14 petaflop AI #supercomputer, p… Needed a good LOL today. https://t.co/dC9yPeULOD Can't wait! :) https://t.co/SAsziSGcWk RT @BrundageBot: arXiv papers, January 24, 2019: "Explaining Models: An Empirical Study of How Explanations Impact Fairness Judgment," Dodge et al.: https://t.co/9DwLA33T9R "PD-ML-Lite: Private Distributed Machine Learning from Lighweight Cryptography," Tsikhanovich et al.: https://t.co/lwJsue4gB9 "Trust Region Value Optimization using Kalman Filtering," Shashua and Mannor: https://t.co/7qYnc1ub7W "How do Mixture Density RNNs Predict the Future?," Ellefsen et al.: https://t.co/1FAguEZuRo "Neural-Guided Symbolic Regression with Semantic Prior," Li et al.: https://t.co/hlvxDNOaBH """Hierarchical Reinforcement Learning for Multi-agent MOBA Game,"" Zhang et al.: https://t.co/C0g2Gkb6on More King of Glory results coming out of China, this time from the company Vivo (not Tencent)." RT @dog_rates: This is Beau. He’s practicing being the ring bearer for his owner’s wedding. Will try his best to get down the aisle success… RT @AOC: 🔥 https://t.co/F4ql4gTH5d @dennybritz https://t.co/q5YJQLXSr7 You either die a hero or live long enough to stress about ICML deadlines. https://t.co/6iHeeFu3UI I got so excited about Dark Forest while trying to get someone to read it that I may need to reread it myself. RT @BrendanNyhan: Jimmy Carter had to put his peanut farm in blind trust https://t.co/zDYo0GJxgX RT @GuillaumeLample: Check out our new paper on cross-lingual language model pretraining! We extend BERT to the cross-lingual setting. Huge… RT @GoogleAI: Introducing Natural Questions, a new, large-scale corpus and challenge for training and evaluating open-domain question answe… "Cross-lingual Language Model Pretraining," Lample and Conneau: https://t.co/NxCZq4aeGB "Spatial Broadcast Decoder: A Simple Architecture for Learning Disentangled Representations in VAEs," Watters et al.: https://t.co/BAy55IvTHT "Towards Universal End-to-End Affect Recognition from Multilingual Speech by ConvNets," Bertero et al.: https://t.co/GRB4YExLkb "Understanding Multi-Step Deep Reinforcement Learning: A Systematic Study of the DQN Target," Hernandez-Garcia and Sutton: https://t.co/0D3ZqvNd91 "Robust Recovery Controller for a Quadrupedal Robot using Deep Reinforcement Learning," Lee et al.: https://t.co/FQFXppuU3L "Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks," Xu et al.: https://t.co/qRcGVv2Qbm "Training Neural Networks with Local Error Signals," Nokland and Eidnes: https://t.co/J4p2OHXw1l "Learning retrosynthetic planning through self-play," Schreck et al.: https://t.co/uZxvAbYpcB @FarzaTV (As in my process isnt fancy...not that it is a good idea to replicate :) i agree arxiv sanity, and also stuff like Brundage Bot, newsletters like Import AI etc can be helpful) @FarzaTV No tricks, just spent a lot of time doing it, and still pretty noisy. @L_badikho @icmlconf yeah I had to follow up with the generalization - this week! :) @mims (memestress is more clever, but memester is a thing) @mims memester TIL Asana is named after a yoga thing, and yep, figures. "RT @Lin_Manuel: Gnight to the setbacks that strengthen your resolve F*** you, setbacks, & thank you too" RT @sarahjeong: *me reading AOC tweets* Is this what it feels like to have an elected official that lives in remotely the same universe th… San Francisco seems unusual in the extent to which, for enough money, you can easily exercise all the time (parks, gyms, etc. and great weather), or never (Uber). RT @mmitchell_ai: Cool thing I got to help with, outlining areas where government can work with civil society & AI practitioners for respon… @unsorsodicorda ICML deadline + weekend load is usually big + extra big bc MLK day delay /this week ArXiv is gonna be 🔥🔥🔥 tonight @pfau it's a thing I do RT @demishassabis: The complex real-time strategy game StarCraft II is a long-standing grand challenge for AI - excited to show our progres… @pfau My point was just that even if you'd never worked at DM or heard about this, it's a pretty easy binary classification problem given a few seconds of footage of both. @pfau you could tell it apart from World of Warcraft @SSteinLubrano that sounds very galaxy brain @adschina Interested in hearing more if anyone is willing to translate highlights :) cc also @jjding99 @EBKania RT @adschina: Xi’an Jiaotong University establishes AI institute and appoints Face++ chief scientist as its first director - https://t.co/i… "The Role and Limits of Principles in AI Ethics: Towards a Focus on Tensions," @jesswhittles et al.: https://t.co/8V45P8dSDt RT @DeepMindAI: Join us and @Blizzard_Ent this Thursday at 6:00pm GMT for an exciting #StarCraft demonstration, hosted by @Artosis and @Rot… "RT @NBCNews: ""It's a cruel jest to say to a bootless man that he ought to lift himself by his bootstraps. And many Negroes, by the thousa…" RT @iSmashFizzle: Happy Martin Luther King Jr. Day! https://t.co/7927zgP8gP RT @Miles_Brundage: https://t.co/npkFy9QSYw https://t.co/npkFy9QSYw @memotv @Liv_Boeree Yeah. I’m not convinced by the “applying AI to everything is stabilizing” argument and it doesn’t nec. follow from that that one should work with DOD. But he seems to havr been thinking that way for a while RT @KateAronoff: If I owe you an email, please find some comfort in the fact that my every waking hour is haunted by my debt to you @Liv_Boeree Wasn't able to easily find a talk where he discusses it but I'm pretty confident they're on YouTube somewhere, because I remember trying and failing to find useful info on Strategy Robot a few weeks ago @Liv_Boeree For all I know, Tuomas is happy to discuss such things but just hasn't been asked hard questions, dunno @Liv_Boeree (have a generic preference for transparency around these topics - if not at the project detail level, then at least why you're willing to do secret projects and how you are trying to do it better vs. worse) @Liv_Boeree My view is that the general topic -- AI researchers collaborating with militaries and the ethics thereof --is super important, this just wasn't news to me personally and didn't add involve any/much new info on what they're actually doing, which is (all things being equal) bad IMO @jathansadowski Got it recently and feels way too long/homogeneous. Curious to read a review from someone who demonstrably read it @Liv_Boeree *has been @Liv_Boeree FWIW Sandholm has saying this for a while in talks, ppl just didn’t care/notice @KaiLashArul @jachiam0 Hmmm.. @jachiam0 I mean I guess it’s possible no one has done it, but that seems so strange @jachiam0 Well, no one has reported the results ;) my guess is DM has done it and it doesnt get much better than those plateaus, but not sure @hardmaru @iandanforth @BrundageBot maybe someday :) @iandanforth I didn’t get what was new here? (paper: https://t.co/OCu2qkkuA6) Nice graph from the R2D2 paper's appendix highlighting the still unresolved tradeoff between fast learning and high final performance in (Atari) RL. https://t.co/jFE5wUZcyt @__lucab The existence (or lack theroef) of docs you're not currently using has less impact on joy, I think :) @WBINVD Will send you a DM @WBINVD unfortunately not :( RT @CleboOmusic: Delete all the Asana tasks that don't spark joy. https://t.co/yASWlhQBXv Delete all the Google Doc comments that don't spark joy. "Hierarchical Representations with Poincaré Variational Auto-Encoders," Mathieu et al.: https://t.co/yNrT4x00Sn RT @decodyng: Just posted a new deep dive, focusing on the mechanics and intuition behind the NVIDIA Style-Based GAN paper that was respons… "RT @AOC: Why do people think they can mess with Bronx women without getting roasted? They act as though our borough hasn’t been perfectin…" @sknthla You know my answer :P @catherineols *hit @catherineols the last one is my fave it :) RT @dog_rates: This is Midge. She can hear a butterfly burp from half a mile away. Hasn’t stopped smiling since she was rescued last year.… RT @MeredithFrost: It's Buzz Aldrin's 89th birthday today. Let's not forget the time he punched a moon landing denier in the face. https://… @SSteinLubrano (not expecting him to read it, but much more time sensitive in any case) @SSteinLubrano Yeah I guess now is more the time to send an email (done) than read new stuff @SSteinLubrano :( now I need to read his Envisioning Real Utopias book while he's still around @sidneyfussell I like how the Netflix doc literally has him calling it false advertising @sidneyfussell lol RT @K_JeanPierre: 10 years ago today. https://t.co/gRytw7DJ2a RT @elizabeth_joh: Today Trump’s term is half over. RT @iamcardib: Leave me alone I will dog walk you . https://t.co/FjqIzpUbvp RT @jorge_guajardo: 66 people died in Mexico in a tragic explosion of a pipeline. The country is in mourning, and this is what he has to sa… We live in a weird world. The Netflix Fyre Festival documentary is just, wow. @ivan_bezdomny Made me think about this: https://t.co/wqs66aeqmy @ivan_bezdomny I’m def not anti reading :) @deliprao Definitely harder! *pretty wild Per @deliprao arguably the game is getting more interesting over time (context size/output length/different data etc) but still pretty will/distinctly inhuman IMO @deliprao In terms of more context? Not sure the game gets much more fun playing on random web data :) Scenic SF Saturday https://t.co/obd1TPL2gC @jvmancuso I “get” it at that level, but still an intriguingly inhuman approach Which is very interesting Language models basically learn a bunch about the world by playing a really boring version of the game Mad Libs, where you're trying to be accurate rather than funny and only see short sentence fragments, billions of times. Will be in the UK the week of the 4th! Let me know if you want to try to meet up :) RT @AOC: All your base (are) belong to us 👾 https://t.co/brwNKJ8wrh RT @justicedems: Wow. @AOC’s first speech on the House floor is already the most watched CSPAN video of all time. https://t.co/rtlsosFPme RT @DeepMindAI: Attentive Neural Processes: https://t.co/GCSXGYyvEz RT @NYMag: In a new poll, even 45% of self-identified Republicans approved of @AOC's 70% top marginal tax rate https://t.co/f0EfyhCWWG @starsandrobots @KatjaGrace has some experience with this via @AIImpacts IIRC RT @IanColdwater: If a straight guy tells you that "guys" is a gender-neutral term, ask him how many guys he's dated. @KelseyTuoc Keep up the good work! :) @HMRoff Yassss "RT @SGe_sports: [DOTA 2] Ontem nossa equipe jogou alguns jogos contra a @OpenAI. Experiência extremamente interessante!! Fazer parte do des…" @hlntnr Have you read The Grasshopper? RT @BCAppelbaum: If this is true, it seems like a pretty straightforward crime. And then the only question left would be whether this is st… @mmitchell_ai Congrats!! "RT @sim2realAIorg: Virtual-to-Real-World Transfer Learning for Robots on Wilderness Trails https://t.co/wYHQW1UxyO https://t.co/X4sOmQU0oo" "EAT-NAS: Elastic Architecture Transfer for Accelerating Large-scale Neural Architecture Search," Fang et al.: https://t.co/uDO0sizxD2 RT @alexstamos: We have seen the value that PRC hacking teams put on the bulk data “non-critical” IT workers protect, such as from Anthem,… @jeffclune @jackclarkSF It is a good survey methodologically @timhwang Aging "RT @ylecun: A chatbot that learns by chatting. Brought to you by FAIR. ""Learning from Dialogue after Deployment: Feed Yourself, Chatbot!"",…" @__lucab (totally different, I know...but still) @__lucab Why not just a Neuron? Exciting opportunities! I've really enjoyed working with @barryfriedman1 on policing/tech matters. https://t.co/hk22zSERMV @TheAnnaGat duuuude RT @goodfellow_ian: An exciting property of style-based generators is that they have learned to do 3D viewpoint rotations around objects li… RT @DeepMindAI: If you're from an underrepresented group, interested in AI, and considering studying for a Masters, there's still time to a… RT @y0b1byte: Throw away all the baselines which don’t spark joy. @rajhans_samdani you mean as opposed to a way of training them? Agree of so, was speaking loosely @rajhans_samdani how so? RT @histoftech: “AOC has accomplished something abnormal in the Trump era: Getting cable news networks to talk about policy not directly re… "RT @mark_riedl: Oh man @NateSilver538 just compared political media coverage to the AI in Mario Kart. I am teaching a class on Game AI, so…" (as in, there will be lots of these papers, because in fact LMs are pretty useful - not critiquing the papers in question :) ) "Language models are actually good at this new thing" is the "supervised learning works on this medical imaging problem, too" of 2019 """Assessing BERT's Syntactic Abilities,"" @yoavgo: https://t.co/7AokEeRsQR TL:DR: they're good" @catherineols @open_phil Congrats!! RT @GiorgioPatrini: Doom super resolution https://t.co/IPrUY0PTKE RT @pklinkne: This is exactly the type of innovation that a 70% marginal tax rate will stifle. https://t.co/nnpV9hYVtR @sam_sinha_ glad to hear! :) RT @samim: "DeepFlash: Turning a Flash Selfie into a Studio Portrait": https://t.co/5NTkrFKo2U https://t.co/dw4747ghLD Sure, sex is great, but have you tried getting RSVPs to a workshop you're organizing? "RT @seb_ruder: New blog post – The 4 Biggest Open Problems in NLP Based on our expert survey and the panel discussion at the NLP session at…" RT @Miles_Brundage: Really excited to be scaling up the OpenAI policy team! https://t.co/36T4pxgTk8 RT @JeffDean: We've been fortunate to have a great series of collaborations between @Waymo and various @GoogleAI research teams over the la… RT @iandanforth: Winner of today's "Most Likely to Be Abused" award. https://t.co/Bk1twvztX3 "Human few-shot learning of compositional instructions," @LakeBrenden et al.: https://t.co/7gjMgvrHwZ "AutoPhase: Compiler Phase-Ordering for High Level Synthesis with Deep Reinforcement Learning," Haj-Ali and Huang et al.: https://t.co/hn21JVZxnN RT @hardmaru: If you plan on applying to any AI residency programs this year (the @GoogleAI deadline is coming up), @Katherine1ee and Ben E… @RealAshEdwards @isbellHFh @tuckerbalch @mark_riedl @pabbeel congrats!! RT @sarahcat21: .@AllRaise is seeking a data strategist to join our team. This is an incredible opportunity to answer some of the most impo… It's Tune Tuesday! https://t.co/jARAkJWjmx @JeffDean @GoogleAI Congrats on a productive year! RT @JeffDean: On behalf of the whole Google Research & @GoogleAI community, I was excited to put together a post describing some of the wor… RT @AmandaAskell: OpenAI are currently looking for research assistants in AI policy. This could be a good opportunity for people with a rel… Really excited to be scaling up the OpenAI policy team! https://t.co/36T4pxgTk8 RT @lukeprog: @OpenAI is looking for a research assistant on AI policy. "For example: we would be excited to talk to candidates who have op… @sidneyfussell Yasss @adschina cc @jjding99 🧐 "RT @suchisaria: Superb read: ⁦⁦@MoAlQuraishi⁩ on Deepmind’s AlphaFold & protein structure prediction at CASP13 Did DM contribute? Y Was a…" RT @fchollet: Desnapify: cool project about training a pix2pix-like model to remove Snapchat filters from pictures https://t.co/H2hWAQmBKM… "RT @AOC: When I meet everyday people, they are eager to learn more, ask great questions, & embrace nuance. I inherently reject the paterna…" RT @sherifea: In London on 31 January? Join us for a public lecture by AI super star Yoshua Bengio, on AI for Good and the limitations of c… RT @BrundageBot: arXiv papers, January 14, 2019: "An investigation of model-free planning," Guez, Mirza, Gregor, and Kabra et al.: https://t.co/DCxNRcLmMi @ESYudkowsky @AdamMarblestone The book has good summaries of its own, see table of contents. RT @AdamMarblestone: “Reframing Superintelligence” is a must-read https://t.co/xIU5g9DTY4 It’s Scale Sunday! Thanks @BentFlyvbjerg for editing this interesting volume. https://t.co/7fnrkUQKYp @michael_nielsen Liu Cixin @tommycollison The Naked Sun @ale_suglia Many, but e.g. https://t.co/scKnl9HMse RT @katherine1ee: Applying to the Google AI Residency? Ben and I wrote down our advice for writing a cover letter. https://t.co/7Uq64HVpAt… *usually wasn't off by 2x. I was in speech rec, at least unless something is announced in next few months. "Good to know that in cases where I erred, I wasn't off by >2x in time :) (human-level StarCraft is still unresolved, though, as is a specific sub-bet on transfer learning)" "My 2017 forecasts that were resolved as false: Superhuman Montezuma's Revenge (now true) Impressive transfer learning (I'd argue this is now true as of 2018 in NLP) Speech recognition essentially solved (as far as I know, still false) DL used in StarCraft tourney (now true)" RT @brianklaas: Nothing shows you have a serious plan and that there isn’t chaos in the White House like saying “I am all alone watching TV… RT @peterbakernyt: The White House has stopped paying its water bill. Desks sit empty. Only 156 of the mansion’s 359 full-time employees ar… RT @maggieNYT: The headline is stunning, and does not at all overstate the story https://t.co/Tl24jU94gw (Review of my 2017 forecasts here: https://t.co/TTXF1bXP6P. I regret not making any for 2018!) It’s Forecast Friday! My only outstanding public AI forecast is superhuman Starcraft by the end of 2018, made with 50% confidence in early 2017. Have bet with @artirkel to this effect that won’t resolve for a few months bc possible private achievements. Anyone have 2019 thoughts? RT @mbrendan1: "The case for building expertise to work on US AI policy" https://t.co/pAmqduE7XP Wonderfully constructed, timely piece by @… @hypatiadotca @hellocovo Congrats! RT @gwbstr: It is striking that, at a time when U.S. thinkers increasingly see China as an ideological competitor of historic scale, the Un… RT @gwbstr: One reason the debate over "ideological conflict" between the United States and China is so confused is that neither country re… RT @ajmooch: The Count of Monte Carlo: a wrongly imprisoned man sets to exacting elaborate revenge on random people, expecting that he'll e… RT @elonmusk: It needed to be made real https://t.co/9Y490tukao RT @techreview: Decision makers in the US and around the world clearly need to have a better understanding of the public’s concerns about A… @jjding99 yup! RT @davidmanheim: Metrics can be used well - they often aren't. And many of the issues created by their misuse can be addressed by better d… RT @RDBinns: Interpretability considered harmful: displaying model internals can overwhelm people and cause them to overlook unusual inputs… RT @dennybritz: When I was a kid I wanted to be a professional gamer. I never thought it would become possible to make a living with it. No… @TheAnnaGat Ill posed, dunno, yes @TheAnnaGat Yes, ill-posed, dunno, yes, dunno, no :P RT @2plus2make5: My piece, with nine suggestions for improving PhD student mental health, was published today in Times Higher Education: --… RT @AOC: New party, who dis? https://t.co/2cznisv8tB Nice interview with @_beenkim! H/t @tdietterich https://t.co/B3lr4l8iOj RT @AOC: #LegalizeIt, and demand justice for communities ravaged by the War on Drugs. https://t.co/mxxN4UTKVl RT @normative: I would watch a reality show where smug jackasses who invoke “Western Civilization” as shorthand for “I’m uncomfortable arou… RT @NandoDF: Very true. Mandatory requirements to make code and data available for publishing could also have catastrophic ethical conseque… @robertskmiles don't have time for dialogues TBH, find them tedious, but thx! :) "If a person’s behavior doesn’t make sense to you, it is because you are missing a part of their context." https://t.co/ARCN3oXU0C RT @HMRoff: Group of 4,000 Anonymous Google Employees Urging Company Not to Be “In the Business of War" Voted 2018 Arms Control Persons of… RT @KelseyTuoc: Obviously we can't learn anything about whether we're right to be worried by checking the demographics of the people who ar… RT @KelseyTuoc: Most interesting detail to me in the new report from GovAI: I hear all the time that AI risk is an obsession of Silicon Val… Last pic is bad, sorry :P didn’t take many Heading back after a lovely few days in Puerto Rico! https://t.co/rCkzIbp9el RT @jm_alexia: My new #paper "On relativistic f-divergences" is out 😺! It has a very in-depth intro to make it easier for those less famili… RT @BrundageBot: Learning to Infer and Execute 3D Shape Programs. Yonglong Tian, Andrew Luo, Xingyuan Sun, Kevin Ellis, William T. Freeman,… RT @BrundageBot: Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context. Zihang Dai, Zhilin Yang, Yiming Yang, William W.… RT @BrundageBot: arXiv papers, January 10, 2019: RT @Miles_Brundage: Exciting new report from my @FHIOxford colleagues @baobaofzhang and Allan Dafoe! In addition to having fascinating resu… RT @mbrendan1: This approach... making a thing that addresses concerns, and lowering the bar for its adoption... is a great way for AI rese… RT @timhwang: 😬 “Those with CS or engineering degrees, compared with those who do not, rate all AI governance challenges as less important”… RT @jjding99: Really valuable report on the American public's views on AI by my colleagues at GovAI @baobaofzhang and Allan Dafoe - some gr… RT @baobaofzhang: What do Americans think about AI? Read all about it in my report with Allan Dafoe. https://t.co/EKGG41Qmqa https://t.co/fIknxo9YIy Exciting new report from my @FHIOxford colleagues @baobaofzhang and Allan Dafoe! In addition to having fascinating results, this is the most rigorous survey I've seen yet of US opinions on AI. https://t.co/HL6HxVcFUx https://t.co/uIE7S1PUoq RT @brhodes: I wrote a lot of addresses to the nation for Obama and never remember thinking they succeeded just because he was able to read… RT @hardmaru: @Miles_Brundage They also released a nice dataset of more than a million icons in this paper too: https://t.co/ooZ4QZ5SRd htt… """FIGR: Few-shot Image Generation with Reptile,"" Clouâtre and Demers: https://t.co/mrNDsFGuBP GAN meta-trained with Reptile to generate images for new classes" "GILT: Generating Images from Long Text," El et al.: https://t.co/wzUlfTWDPK https://t.co/odI9FHMSwv "Explaining AlphaGo: Interpreting Contextual Effects in Neural Networks," Ling et al.: https://t.co/WiblDF7lVu RT @BrundageBot: Risk-Aware Active Inverse Reinforcement Learning. Daniel S. Brown, Yuchen Cui, and Scott Niekum https://t.co/LjaWHYuanK RT @BrundageBot: arXiv papers, January 9, 2019: @catherineols @adamajm So cool!! "RT @catherineols: Plug-and-play differential privacy for your tensorflow code: where you would write `tf.train.GradientDescentOptimizer` i…" RT @techreview: 🧬 + 🍅 = 🌶️🌶️🌶 https://t.co/GPXZ63TSok RT @chrislhayes: Declaring a national emergency in order to save face because you promised something ridiculous and now can't deliver it is… @jeffclune @iandanforth I found it via Ian retweeting @BrundageBot :) RT @CSERCambridge: From surveillance to superintelligence - @LeverhulmeCFI's Stephen Cave and CFI and CSER's Sean Ó hÉigeartaigh on bridgin… "RT @AOC: Fact-checking is critically important. It’s not always fun. But that’s okay! It pushes me to be better. It’s important that if fa…" RT @HMRoff: Well worth a read on AI diagnoses and their limitations. https://t.co/wPxeWlWQst RT @elizabeth_joh: Police tech market watch: Motorola just bought an ALPR company. What are they doing? Trying to create a policing data p… RT @Acosta: Kind of unbelievable to see a president refer to the media as the enemy, then five hours later request airtime on the networks… RT @AOC: Naturally, the same week we kick-start a nat’l convo on marginal tax rates endorsed by Nobel-Prize winning economists, I’m being d… RT @AOC: Same difference https://t.co/V2qnZic7cD RT @KingstonAReif: Great story here on Bolton's progress toward eliminating the NSC decisionmaking process. Bolton acting not as a traditio… RT @SpaceX: Recent fairing recovery test with Mr. Steven. So close! https://t.co/DFSCfBnM0Y RT @BrundageBot: What Should I Do Now? Marrying Reinforcement Learning and Symbolic Planning. Daniel Gordon, Dieter Fox, and Ali Farhadi ht… RT @BrundageBot: Understanding the (un)interpretability of natural image distributions using generative models. Ryen Krusinga, Sohil Shah,… RT @BrundageBot: Tencent ML-Images: A Large-Scale Multi-Label Image Database for Visual Representation Learning. Baoyuan Wu, Weidong Chen,… RT @BrundageBot: Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Thei… RT @natfriedman: Today(!) we’re thrilled to announce unlimited free private repos for all GitHub users, and a new simplified Enterprise off… "DSConv: Efficient Convolution Operator," Gennari et al.: https://t.co/JOP4WsN5jE RT @gdb: Looking for professional Dota teams to playtest the latest version of OpenAI Five. Significant progress over the past few months.… @v_maini Edgy RT @jack_kelly: I left Google DeepMind to build a non-profit research lab focused on helping to fix climate change ASAP. Very open and col… RT @jenheemstra: As academics, we’re surrounded by people, yet our jobs can be extremely isolating. Put people in your life with whom you c… @egrefen @facebookai Congrats! RT @resisterhood: Ocasio-Cortez is just excellent here - faced with “how can you say that?” in response to affirming that the president is… RT @jhamrick: I reviewed recent literature on model-based deep RL and compared it to human mental simulation. My conclusion: many parallels… "V-Fuzz: Vulnerability-Oriented Evolutionary Fuzzing," Li et al.: https://t.co/B5LRE8ZDR5 RT @dennybritz: My answer to why many ML research advances do not get translated into industry: https://t.co/JURtB4WELn https://t.co/h5PUpS… RT @gerryshih: Wow: Reuters among intl news orgs and diplomats from 12 non-Western countries given tours of Xinjiang re-education camps htt… RT @taesim_kim: Prolonged Shutdown Could Leave Millions Without Food Stamps | NBC Connecticut https://t.co/SWXsRAaGt7 @nbcconnecticut 님이 씀 RT @paulkrugman: This is a guy in his 40s who believed that monetary policy should be based on "Atlas Shrugged". Washington declared him a… "RT @AOC: “She doesn’t know what she’s talking about,” say Republicans, who argued that healthcare costs the same as as unlimited calls & te…" @rivatez not just your name but a declaration of your rockingness! @rivatez omg RT @AdamParkhomenko: NBC reporting the Pentagon Chief of Staff has resigned. This within 24 hours of Trump claiming he can call national em… Not my best alliteration of all time It's Slowly-download-a-big-BERT-model-on-hotel-WiFi Saturday! "RT @yoavgo: I expected the Transformer-based BERT models to be bad on syntax-sensitive dependencies, compared to LSTM-based models. So I r…" RT @rao2z: By waiting until 8th grade to introduce #AI to the students (https://t.co/7g4lcNIX2Y), India will inevitably fall way behind i… RT @sindero: Was recently on the @TWIMLAI podcast, chatting deep RL trends that caught my eye in 2018. Thanks for having me on the show @sa… RT @mpshanahan: For followers of the @GaryMarcus - @ylecun #AI debate, here's a new short review paper with Marta Garnelo, "Reconciling dee… RT @AOC: Republican hypocrisy at its finest: saying that Trump admitting to sexual assault on tape is just “locker room talk,” but scandali… RT @dandrezner: “I think we can expect the acting [defense] secretary, as he was yesterday, to be complicit in the continued corrosion of c… RT @maggieNYT: "I think she dishonored herself. And I think she dishonored her family," Trump says, then calls it "highly disrespectful to… RT @Susan_Hennessey: We should not become numb to how fundamentally unacceptable it is to see these kinds of statements coming from officia… RT @attackerman: False. Fox News. https://t.co/Tkn2VFT1AG RT @mm_jj_nn: New paper looking at the moral-accounting systems that some computer RPGs have (e.g. good/evil alignment scales that your act… "RT @AOC: I hear the GOP thinks women dancing are scandalous. Wait till they find out Congresswomen dance too! 💃🏽 Have a great weekend eve…" "RT @twiecki: Gaussian Process Deep Neural Networks https://t.co/qoe7XPW8gp Really simple and cool idea: plug the outputs of a DNN into a G…" "RT @NBCNews: The EPA has run out of funding. According to its contingency plan, it’s keeping on more than 700 employees without pay, incl…" https://t.co/y9IQXchQgx RT @BrundageBot: arXiv papers, January 4, 2019: RT @moiragweigel: Party of Brett Kavanaugh: How incredibly shameful to have *checks notes* DANCED this one time in high school RT @Deeptracelabs: We count 8K, that is a lower bound. Many more deepfakes porn videos are online but their number cannot be easily measure… RT @Miles_Brundage: "Reframing Superintelligence: Comprehensive AI Services as General Intelligence" - very interesting series of short ess… @mgubrud @FHIOxford Yeah, not the best pic for this. Think it's a generic FHI website image "A Theoretical Analysis of Deep Q-Learning," Yang et al.: https://t.co/aEbkiWKSnb "Inorganic Materials Synthesis Planning with Literature-Trained Neural Networks," Kim et al.: https://t.co/WiVAg2fqff "Reframing Superintelligence: Comprehensive AI Services as General Intelligence" - very interesting series of short essays by my @FHIOxford colleague Eric Drexler: https://t.co/VXFOVLwFo9 RT @GiorgioPatrini: We have been tracing and measuring the phenomenon of AI-aided image/video synthesis and its societal impact throughout… RT @sim2realAIorg: Introducing our effort towards indexing the progress in simulations to real world transfer and more https://t.co/O1lufzW… RT @Mr_DrinksOnMe: We don't deserve dogs. https://t.co/Jxq8usQ7JA RT @memeternet: https://t.co/niRLslm9hR RT @CadeMetz: Curbs on A.I. Exports? Silicon Valley Fears Losing Its Edge: https://t.co/Oe7rHOZwRw @john_omalia You too! RT @BrundageBot: arXiv papers, January 1, 2019: “Divergence Triangle for Joint Training of Generator Model, Energy-based Model, and Inference Model,” Han and Nijkamp et al.: https://t.co/ari7nU3hpb RT @ShannonVallor: Louis CK slamming young people as 'boring' because they strive to be more kind is rich irony. Name one aim that is more… @XandaSchofield 😂 RT @jor_nicole4: Did my dog just pet my cat?? And did my cat just hug my dog?? https://t.co/PuNWB1Ggzw RT @dog_rates: This is Rory. He likes to stick his tongue out and wiggle a bit so his human can’t get a nice pic of him. Little does he kno… RT @elasri_layla: I don’t often write blog posts but I’ve been wanting to talk about inclusion in ML for a while, so here it is: https://t.… RT @karinavold: My latest paper is out! I argue there are good normative reasons for accepting the extended view of cognition, including fo… RT @csilviavr: Excited to co-organise the Safe Machine Learning Workshop at ICLR 2019 with @vkrakovna Adrià Garriga-Alonso @iamtrask @uesat… RT @vkrakovna: Excited to announce an upcoming AI safety workshop at @ICLR2019 , "Safe Machine Learning: Specification, Robustness and Assu… "Bayesian Meta-network Architecture Learning," Shaw and Dai et al.: https://t.co/ZnBMdTpxRa "Escape Room: A Configurable Testbed for Hierarchical Reinforcement Learning," Menashe and Stone: https://t.co/pBl1WpVfnc Merry Pupsmas! https://t.co/kDR1uLxiPf RT @thedailybeast: Donald Trump, answering phone call from 7-year-old on Christmas Eve: "Are you still a believer in Santa? Because at seve… RT @DafnaLinzer: Per pool, Trump to the first child who called in tonight to talk to Santa: “Are you still a believer in Santa?" Happy Holidays from the Seattle pupperazzi! https://t.co/Q6HDoV0pVy RT @toolotheday: Cookie cutter making machine https://t.co/XyGCn51N0V "The Design and Implementation of XiaoIce, an Empathetic Social Chatbot," Zhou et al.: https://t.co/7jK61SjYnQ RIP @DisneyCareers https://t.co/2yX1TrbD54 @evolvingstuff Yup (See e.g. here if you don’t know what I’m talking about. Very impressive results here and since! https://t.co/3CYWAhKQDh) Language model fine-tuning is wild "RT @urbanthoughts11: This is the Shanghai-Beijing train going at 350 km/h As @yfreemark said: ""The distance between NYC and Chicago is al…" RT @brhodes: In addition to the fact that Brett McGurk did more than any person to build the coalition that fought ISIS, the fact that you… RT @Comey: FBI families will spend Christmas without a paycheck. This president promised Mexico would pay for the wall but innocent people… "RT @OrinKerr: Actual quotes from Donald Trump: ""I know tech better than anyone."" (today) ""Nobody knows more about taxes than I do."" (201…" RT @guyvdb: Not sure whether openreview is having the intended effect. Seeing lots of rejected paper tweets, essentially everyone is forced… RT @soleio: Anyone else notice that the detail view of the spikes somehow… loses detail? 🤔 https://t.co/FyS9TM9lKv RT @dog_rates: This is Pippin, but you know him better as my profile picture. He was the catalyst for the kindest online community ever and… RT @NandoDF: Time to (i) accept that engineering is an important respectable hard part of deep learning (ii) that we shouldn’t be bored if… RT @NandoDF: Our meta-learning approach is state-of-the-art in Text-2-Speech, and does it in 5mins instead of 4 hours. This shows that neur… RT @NicolasPapernot: Our team @GoogleAI has just released a new library for training machine learning models with (differential) privacy fo… RT @dandrezner: I see someone finally explained Mattis’ letter to you. https://t.co/QI046LNL9h RT @sleepinyourhat: The inevitable has happened: MSR has a state-of-the-art sentence encoder called BIGBIRD. No details yet, but impressive… "RT @riashatislam: Our paper ""InfoBot : Transfer and Exploration via Information Bottleneck"" has been accepted in #ICLR2019. Congratulatio…" RT @david_madras: This idea - using a CNN to review academic papers - is a fascinating jumping-off point for thinking about fairness in ML,… "RT @iclr2019: ICLR decisions are out, https://t.co/IOzEcPE79L . If your work was accepted, congrats! If your work was not accepted: we rea…" "Unsupervised Meta-learning of Figure-Ground Segmentation via Imitating Visual Effects," Chen et al.: https://t.co/GZMu9RDA7X "PROVEN: Certifying Robustness of Neural Networks with a Probabilistic Approach," Weng et al.: https://t.co/aUTBkGdqj3 "Safety and Trustworthiness of Deep Neural Networks: A Survey," Huang et al.: https://t.co/2o35uv07zg """Deep Paper Gestalt,"" Jia-Bin Huang: https://t.co/GoVr1yD72b Training a model to pick up on the aesthetic of a paper. @BrundageBot doesn't pick up on the gestalt of papers, which it judges based on abstracts. So it probably won't like this one, which doesn't mention RL 🙃" RT @marcorubio: Just read Gen. Mattis resignation letter. It makes it abundantly clear that we are headed towards a series of grave policy… RT @ylecun: NeverGrad: gradient free optimization library. Now open source. https://t.co/UAUVEaFYPL RT @elizabeth_joh: Wow--from Mattis resignation letter: https://t.co/YYGzljI9X8 https://t.co/UEz00YWFof RT @lawfareblog: “Because you have the right to have a Secretary of Defense whose views are better aligned with yours ... I believe it is r… RT @NandoDF: My slides for the #NeurIPS2018 Meta-Learning are now up. Big thanks to the organisers! https://t.co/FcUBcDTygo RT @dog_rates: This is Finley. He’s pawditioning for the role of Santa’s reserve reindeer. What he lacks in size he makes pup for in uncond… @MonaJalal_ Congrats! """Hierarchical Macro Strategy Model for MOBA Game AI,"" Wu et al.: https://t.co/2mUffhQKsE Tencent has moved from 1v1 to 5v5 Glory of Kings, says they're competitive with the top 1% of players. Interesting!" RT @cinjoncin: Nicely done! Just to clarify, their agent was super strong and the top learning agent, yet still fourth overall. https://t.c… RT @sim2realAIorg: Learning Direct Optimization for Scene Understanding https://t.co/WZTSaMRZte https://t.co/3h1ArSKsBt RT @sopharicks: The code of the final project I worked on within the @OpenAI scholarship program is on Github. In the GridWorld environment… RT @mark_riedl: The latest geopolitical entity to tout their AI leadership is... New Jersey https://t.co/r5hrICVoaK @hannawallach You rock! RT @OpenAI: Check out the final projects from our first Fellows cohort, including work on generalization, scaling distributed neural networ… RT @CHAI_Berkeley: CHAI researcher @rohinmshah discusses Inverse Reinforcement Learning on the AI Alignment podcast from @FLIxrisk https://… @gorogm Thanks for clarifying! """Continual Match Based Training in Pommerman: Technical Report,"" Peng and Pang et al.: https://t.co/rxBcN4rx1Z Winner of Pommerman competition" "Malthusian Reinforcement Learning," Leibo et al.: https://t.co/M31aHsPMgQ "@timhwang *slaps the roof of your website* This baby can fit a whole lot of Zuck takes" "RT @sim2realAIorg: Sim-to-Real via Sim-to-Sim: Data-efficient Robotic Grasping via Randomized-to-Canonical Adaptation Networks https://t.co…" RT @Complex: The only thing you need to see today. https://t.co/MvbYqIaMAk "RT @janleike: Multiparty computation is awesome because it lets multiple parties train a model without seeing the weights. But there are f…" "RT @pcastr: happy to share our white paper on Dopamine, our #RL framework. got lots of positive feedback at #NeurIPS2018 , which encourages…" "RT @DeepMindAI: Scaling shared model governance via model splitting: https://t.co/fadpKuKBmy @MiljanMartic @janleike @iamtrask @ShaneLegg…" Cool translation by @jjding99 this week of an article on the data labeling industry in China! As usual, if you're into such things, Jeff's newsletter is a great resource. https://t.co/VOtdWDpidb RT @graphcoreai: The next phase in our growth story starts today. @graphcoreai secures new $200m funding from BMW, Microsoft & leading fina… "Bayesian Optimization in AlphaGo," Chen et al.: https://t.co/bUGmv1JTst "Residual Policy Learning," Silver and Allen et al.: https://t.co/0DCR6levjT "A Logarithmic Barrier Method For Proximal Policy Optimization," Zeng and Zhang: https://t.co/ElRBxcA1iy "RT @math_rachel: videos of #NeurIPS2018 invited talks: https://t.co/YDBAKS02bd videos of more sessions here: https://t.co/1dXt7m1bAC h/t @s…" @RebeccaCrootof @URLawSchool Congrats!! I'm late to the party on this, but this is a very cool talk! https://t.co/4iNyegn6DH "RT @hardmaru: Bayesian Layers: A Module for Neural Network Uncertainty “As demonstration, we fit a 10-billion parameter ‘Bayesian Transfor…" @rivatez Would be fun though "Soft Actor-Critic Algorithms and Applications," Haarnoja, Zhou, and Hartikainen et al.: https://t.co/p2uhYZZt6Q "Online gradient-based mixtures for transfer modulation in meta-learning," Jerfel and @ermgrant et al.: https://t.co/vBRtfYz16L @ankurhandos I can’t get used to DD/MM :P RT @derekjGZ: Imagine being the most powerful person on the planet — with thousands of nuclear weapons at your fingertips and sole discreti… RT @eliehonig: I worked mafia cases for years in SDNY, mainly Gambino and Genovese. I usually hesitate to make this comparison but here it… RT @BrendanNyhan: The President of the United States continues to talk like a mobster https://t.co/9MPvg3IMCz RT @jachiam0: Hi all! Today is the last day to register for the Spinning Up workshop, if you haven't already. Check it out! :) https://t.co… RT @tkasasagi: Just to check that it’s still running. 😂 https://t.co/wGlK0hHj5p RT @dog_rates: This is Neville. He’s your copilot. Not the best with navigation but can honk the horn if you want. 12/10 would boop at red… @VahidK Could you elaborate on why? RT @DefTechPat: Scoop: Project Maven Overseer Will Lead Pentagon’s New AI Center https://t.co/oRzGbYzS0U my latest for @defenseone RT @mustafasuleymn: @DeepMindAI’s #WaveNet model has the potential to unlock an incredible diversity of accents and languages globally and… RT @jachiam0: Currently one of the strongest deep RL algorithms out there, and in my experience, results are very reproducible. Highly reco… Very cool paper! https://t.co/wqs66aeqmy RT @OpenAI: Announcing the first finding from our "Science of AI" effort: a simple statistical metric that lets us predict the parallelizab… "IRLAS: Inverse Reinforcement Learning for Architecture Search," Guo et al.: https://t.co/QWLFqoJ95A RT @jeffclune: Wow. These are insanely good synthetically generated faces! Amazing to think that GANs were introduced just 4 years ago (ht… RT @Google: After 20 million pieces were destroyed in a fire, the National Museum of Brazil and its lost collection can now be explored vir… RT @mcleavey: Stunning face generation results! https://t.co/vPQLXMOmX4 https://t.co/TJ9mWOoNnC "Learning with Training Wheels: Speeding up Training with a Simple Controller for Deep Reinforcement Learning," Xie et al.: https://t.co/4ZTbQ9wvF6 RT @indexingai: We are excited to release the AI Index 2018 Annual Report! This year's theme: AI is universal. Read the report below and tw… "RT @mcwm: Taylor Swift used facial recognition at a concert to scan the audience for her stalkers https://t.co/DsTwmPtcAX" @jm_alexia @MILAMontreal Congrats! RT @amir: .@Waymo engineers said today that using neural nets and behavior cloning to do an "end to end" self-driving system probably will… "SlowFast Networks for Video Recognition," Feichtenhofer et al.: https://t.co/RGigxpZFcR RT @paul_scharre: .@mchorowitz & I weigh in @ForeignPolicy on what the new National Security Commission on Artificial Intelligence can do t… @tkasasagi Nice to meet you there! :) RT @OpenAI: Deadline extension: Apply by Dec 15th to attend an in-person workshop at OpenAI on Feb 2nd 2019 about Spinning Up in Deep RL: h… RT @sim2realAIorg: Lots of exciting work on simulations to real world transfer this year so here is the round up. Please add any missing pa… RT @ericjang11: 3/ "... Novartis, Merck, Pfizer, etc, with their hundreds of thousands (~million?) of employees, let an industrial lab that… @hypatiadotca @kimmaicutler @Nomiku https://t.co/1jmijZ7SAX Very interesting stuff - thanks for writing! I found the pharma/ImageNet analogy particularly intriguing. https://t.co/XbKj7rVrca "Applied Federated Learning: Improving Google Keyboard Query Suggestions," Yang, Andrew, and Eichner et al.: https://t.co/Rc474K1irC """Adversarial Transfer Learning,"" Wilson and Cook: https://t.co/gf5aKGgwBw Looks like a good review" RT @SuryaGanguli: My new post for the @Stanford Human Centered AI Initiative: a personal vision of how #neuroscience #psychology #ai #physi… RT @_rockt: I am probably very late to the party, but @lilianweng's blog (https://t.co/Cu97oh2jMh) is unbelievably good. If you want to lea… RT @mat_kelcey: "Meta-Learning: Learning to Learn Fast" https://t.co/mPR6qbAjkd an incredible blog post by @lilianweng 🇨🇦 ✈️ 🇺🇸 RT @MoAlQuraishi: Some thoughts on @DeepMindAI’s entry in #CASP13, after being there and chatting with the AlphaFold team and many others:… RT @ma_franks: Men greatly underestimate how often women are sexually harassed: "In the US, where a 2018 poll found that 81% of women had e… RT @ghadfield: And here’s the easy to read @washingtonpost version! https://t.co/I7hvpjqhwh RT @ghadfield: Silly rules: What I would hope to have been talking about at #NeurIPS2018 if @dhadfieldmenell and I had not missed silly dea… Had a fun time at #NeurIPS2018! Great to meet/see a lot of you! :) RT @jvmancuso: I've been live tweeting the Private ML workshop at #NeurIPS2018 -- check it out! https://t.co/VTCEw2pEj6 RT @memotv: managed to squeeze another #BigGAN #deepmeditations in before my presentation later today at #Neurips #NeurIPS2018 #CreativeAI… @mark_riedl Yep! Just for workshops SnOMG #NeurIPS2018 https://t.co/ujXd76UDvo @gwern Any chance of a standalone page? Kinda frustrating to read a section of a big doc and not know how far one is in it etc. RT @joshscampbell: 🤔 https://t.co/8OhjPRtofz RT @math_rachel: Yo-Yo Ma describes himself as the "token musician" for the AI art, music & culture demo #NeurIPS2018 https://t.co/EiPiDEtk… RT @tkasasagi: Dataset released! We created the dataset from 35 pre-modern Japanese books printed or written around 17-18th century. I will… @rebecca_roache You rock! RT @pfau: Very proud to have been a part of this paper with @irinavlh, David Amos, Seb Racanier, @Azhag, @DeepSpiker and Alex Lerchner: Tow… RT @ghadfield: I'm happy to announce I've started to work with @OpenAI as a Senior Policy Advisor -- seeking to support their mission to e… RT @quasimondo: Optimizing for unrecognizability #BigGAN https://t.co/LFG9LNDoqW @alfcnz Yep 🇺🇸 ✈️ 🇨🇦 RT @ermgrant: Looking forward to the #NeurIPS2018 Workshop on Meta-learning! It's expected to be the largest on Sat (>600 attendees). Speak… RT @DeepMindAI: The full peer-reviewed @sciencemagazine evaluation of #AlphaZero is here - a single algorithm that creatively masters chess… RT @AnimaAnandkumar: Learnt about #montrealmassacre a few years ago. That toxic sexism persists to this day. For those at #NeurIPS2018 I pr… RT @DannyBressler1: Excited to announce my new @voxdotcom article coauthored with @cwbakerlee! It’s on a topic we think is really important… RT @miramurati: We just released a new, simpler training environment for deep RL that quantifies generalization! https://t.co/JIzPKaPjRF RT @OpenAI: We’re releasing CoinRun, an environment generator that provides a metric for an agent’s ability to generalize across new enviro… RT @ikebarinholtz: The president is being congratulated for not ruining a funeral https://t.co/uEov0sfURd RT @corintellectual: which auto response should i send back to my dentist? https://t.co/eSmIz1OO7w RT @hardmaru: Cooperative Gym Bipedal Walkers! https://t.co/HdzXeqDBIx "Bag of Tricks for Image Classification with Convolutional Neural Networks," Xie et al.: https://t.co/sIz0tx8gUp "Mitigating Planner Overfitting in Model-Based Reinforcement Learning," Arumugam et al.: https://t.co/hGBu3uuZii RT @dog_rates: This is Maui. That is his yogurt bowl. He is kindly requesting more yogurt. 12/10 of course sir right away https://t.co/80JU… RT @paul_scharre: In addition to the super-cool video, I'm totally blown away by the fact that @BillGates took the time to write this in-de… @gwern @lorenlugosch See all the ImageNet in X minutes / hours papers for example, by various actors @gwern @lorenlugosch I’ve become jaded. Lots of papers these days with hundreds or low thousands of GPUs. What’s rarer is stuff beyond that which this isn’t. @gwern @lorenlugosch Not all that crazy is it? 1000 CPUs... "Macro action selection with deep reinforcement learning in StarCraft," Xu et al.: https://t.co/ufPvifGPrd "Modulated Policy Hierarchies," Pashevich et al.: https://t.co/hCrzxC1NT4 RT @VinFL: Excited to share a quite extensive introduction to deep reinforcement learning! With @astro_pyotr @riashatislam @marcgbellemare… @zacharylipton @DeepMindAI All sounds produced by WaveNet Look forward to joining for the #NeurIPS2018 workshops later this week! :) RT @demishassabis: Proteins are essential to life. Predicting their 3D structure is a major unsolved challenge in biology and could impact… RT @karen_ec_levy: Wow. Chinese "naked loans": microlenders requiring naked pics as collateral, to be leaked to family/friends if the borro… RT @mchorowitz: Why does the US treat #drones like missiles, rather than aircraft, for the purposes of exports? It's time to reform the Mis… "RT @tdietterich: ""Robust Artificial Intelligence and Robust Human Organizations"" https://t.co/L1oCWhHLph Every AI system is deployed by a…" RT @chelseabfinn: Excited to share our most recent work! We train a single world model from unsupervised interaction and use that model to… "The feeling when you finally finish a bunch of paper reviews: Peer Re-phew" "RT @iclr2019: ICLR Workshops are now posted: https://t.co/9ijIqr4ETo This is the first year of themed ICLR workshops. As in past years, th…" @HMRoff @BrookingsFP @BrookingsInst @JHUAPL Exciting! Congrats! RT @aravind7694: NeurIPS Deep Reinforcement Learning Workshop schedule and accepted papers available now: https://t.co/vgzwCGyoRb @pabbeel… "Learning to Reason with Third-Order Tensor Products," Schlag and Schmidhuber: https://t.co/FCffPQC8Z1 RT @gdb: Applications for the second cohort of OpenAI Scholars are due by end of day tomorrow. We have an awesome group of mentors lined up… "RT @alexjc: Ladies, if he: - requires lots of supervision - yet always wants more power - can't explain decisions - optimizes for the aver…" "RT @DeepMindAI: Our agent combines visual perception and motor control to solve tasks in simulated physical environments: - Paper https://…" RT @gdb: In 2018, OpenAI grew from about 40 full-time employees to over 80. Looking for recruiters (no recruiting experience needed) to hel… RT @dog_rates: This is Maggie and Oria. They’ve perfected the duo snoozle. Impossible to stay awake under these conditions. Both 14/10 plea… RT @AmandaAskell: I'm thrilled to let everyone know that I've joined OpenAI as a research scientist on AI policy. I'm excited to work with… RT @ylecun: TorchCraft and CherryPi, the FAIR StarcCraft bot are open source! https://t.co/K98pUsK0RX @ramifications_ Cc @AmandaAskell RT @nytmike: EXCLUSIVE: White House lawyers warned the president in a memo that he could be impeached if he tried to get the Justice Depart… RT @ShaneLegg: Excited to see @DeepMindAI safety team develop this promising approach for tackling the important problem of agent alignment… Exciting paper from @janleike et al.! https://t.co/3nITMeVYAj "RT @janleike: The agent alignment problem may be one of the biggest obstacles for using ML to improve people’s lives. Today I’m very excit…" RT @nickfrosst: 1/7 Our new paper on adversarial attack detection and capsule networks with @sabour_sara and Geoff Hinton is out on arxiv t… "GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism," Huang et al.: https://t.co/WaMQs8dZZ2 RT @CadeMetz: A.I. researchers at several top labs are demonstrating "explosive progress" in the long push toward machines that can underst… RT @AnimaAnandkumar: Thank you everyone for your overwhelming support for #protestNIPS I wish we could have started with a clean slate and… RT @OpenAI: We will now be accepting applications for our Winter 2019 OpenAI Scholars program until 11/30. More details: https://t.co/DXFLx… RT @FeryalMP: I'm very excited to be a mentor for the next cohort of OpenAI Scholars! Just a reminder that today is the last day to submit… RT @DeepMindAI: "Woulda, Coulda, Shoulda: Counterfactually-Guided Policy Search" - off-policy training of agents by reasoning about alterna… RT @DeepMindAI: Learning to play Atari games without rewards by combining human preferences and expert demonstrations (collaboration with @… RT @StatMLPapers: Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizon. (arXiv:1811.06128v1 [cs.LG]) https://t.… @zacharylipton 💯 RT @DaveChurchill: Here are the official results from the 2018 @AIIDEconference StarCraft AI Competition: https://t.co/9B44h1mKKh #aiide18 @mark_riedl @AIIDEconference Any info on methods used? "RT @mark_riedl: .@AIIDEconference StarCraft competition results #1: Samsung #2: Facebook AI Research #3: unaffiliated team from China http…" RT @zeynep: “Facebook employed a Republican opposition-research firm to discredit activist protesters, in part by linking them to the liber… RT @RoxanneHeston: The median person thinks a typical charity can save a life for $40(!) and that the most effective ones can save a life… RT @goodfellow_ian: Industry titles tend to add superlatives: "research scientist" -> "senior research scientist" -> ... -> "distinguished… RT @demishassabis: We are immensely proud of all the Streams team has achieved. DeepMind will continue to lead the way in fundamental resea… RT @NicolasPapernot: Very excited to share that the program for our #ProtestNIPS 2018 workshop on Security in ML #SecML2018 is now finalize… RT @samim: missile beer bottle #BigGAN https://t.co/vwmSK9f8C1 RT @twimlai: Today we're joined by @OpenAI’s Head of Infrastructure, @C_Berner. In our conversation, we discuss the evolution of their deep… RT @DeepMindAI: The BigGAN generators from our paper https://t.co/QUYlE9IBsE are now available on TF Hub (https://t.co/GHM9pIgQPw). Try the… RT @charlotte_stix: Exiting job opportunity at @element_ai for anyone who is interested in pushing forward on public policy and AI! 🧠 can b… RT @peyIRL: um alexandria ocasio-cortez is literally making instant pot mac n cheese on instagram live and talking about politics and liste… RT @elizabeth_joh: Nine people have died. https://t.co/0lp2kABDbS "RT @mer__edith: Collective action makes change, change makes a race to the top. Here for it! https://t.co/Dtms3GGDTZ" RT @FeryalMP: Our paper "Learning from Demonstration in the Wild" is now on arXiv! https://t.co/T40hISgbuH with @KyriacosShiarli @y0b1byte… @timhwang https://t.co/DyVyvOFIFK @timhwang brooooo "RT @JeffDean: Everything you wanted to know about the effects of batch size on neural net training behavior but were afraid to ask! Measur…" RT @lfschiavo: .@jachiam0 has put a ton of thought and effort into making a much-needed RL educational resource that's free, accessible, an… "Learning from Demonstration in the Wild," @FeryalMP et al.: https://t.co/kJsftWGKMv "Modular Architecture for StarCraft II with Deep Reinforcement Learning," Lee and Tang et al.: https://t.co/QnQvgP3BzQ "Bias and Generalization in Deep Generative Models: An Empirical Study," Zhao and Ren et al.: https://t.co/26CwrN9Xu7 RT @mattsheehan88: I often wondered when Chinese officials would begin citing the Right To Be Forgotten as an example of how "all governmen… "RT @janleike: @OpenAI just published a great guide on how to get into deep RL research. Amazing how much love @jachiam0 put into this! http…" RT @AmandaAskell: Awesome resource for people looking to learn more about Deep RL. If you're interested in Deep RL I strongly recommend try… "RT @pabbeel: If you'd still been holding off on getting up to speed on Deep RL, this might be a great time to change that! :) Great educati…" RT @mattdpearce: The federal government used doctored video to smear a journalist it didn’t like. https://t.co/fFhstuvsVm RT @paul_scharre: So, it was only a matter of time before fake videos were used to influence American politics, but I didn't think the firs… RT @lilianweng: One of the best deep RL tutorials I know so far 😀 https://t.co/JPu5crY32c RT @jachiam0: Excited to share what I've been working on these last few months! Spinning Up in Deep RL, an educational resource that we hop… Excited this is out! I’ve found this to be a very useful set of educational resources (also, same codebase I used for the Mujoco memes). Great work @jachiam0! https://t.co/4Mh79sP7gm RT @OpenAI: Releasing Spinning Up in Deep RL, a new educational package to let anyone become a deep reinforcement learning practitioner: ht… "Neural Rendering Model: Joint Generation and Prediction for Semi-Supervised Learning," Ho and Nguyen et al.: https://t.co/7YIoSDULxb "MixTrain: Scalable Training of Formally Robust Neural Networks," Wang et al.: https://t.co/zquMoAAFTE RT @maggieNYT: Trump allies are deeply perplexed by his move against Sessions, given that it all but guarantees an investigation by House j… "Online Off-policy Prediction," Ghiassian et al.: https://t.co/ynHjteGJws "Generative Adversarial Policy Networks for Behavioural Repertoire," Jegorova et al.: https://t.co/vVqJextib4 "ACE: An Actor Ensemble Algorithm for Continuous Control with Tree Search," Zhang et al.: https://t.co/qDDADDFIC5 RT @gdb: My talk from today entitled "Can we rule out near-term AGI?": https://t.co/OARXhmUdTc "RT @AmirSaffari: Are Deep Policy Gradient Algorithms Truly Policy Gradient Algorithms? https://t.co/uc6gJWRb5D" RT @l2k: Why Experiment Tracking is Crucial to OpenAI https://t.co/bsafaTwphv RT @OpenAI: We’ve built an energy-based model that can quickly recognize, generate, and transfer simple concepts after only 5 training demo… "RT @kateconger: #PropC results update: now 57.51% in favor, 42.49% opposed. 50% +1 is all that's needed to pass, but getting above 66% wou…" "QUOTA: The Quantile Option Architecture for Reinforcement Learning," Zhang et al.: https://t.co/lGkt12cUlq RT @washingtonpost: Race called: Alexandria Ocasio-Cortez (D) wins in New York's 14th District https://t.co/c2hhKxncPS RT @AndrewGillum: 🚨🚨🚨STAY IN LINE IF YOU ARE WAITING TO VOTE 🚨🚨🚨 @AmandaAskell Oh no, trust breakdown. I hope the ppl who voted as a result of the original troll were numerous enough to justify this RT @DeepMindAI: Bayesian Action Decoder (https://t.co/tpnSgBPPA3): A new multi-agent RL method for learning to communicate via informative… RT @LAM_Barrett: NO, NO WE SHOULDN'T. VOTING SHOULD BE EASY, EFFICIENT AND RELIABLE, AND IF YOU THINK OTHERWISE YOU'RE IN THE WRONG LINE OF… RT @OpenAI: Introducing POLO, a framework that lets us learn tasks on the fly like humanoid locomotion and dexterous in-hand manipulation.… "RT @dog_rates: This is Coconut. She has a very important puplic service announcement. Hopes you hear every word. 14/10 #BeAVoter (IG: cocon…" https://t.co/FXBYLuaNod Don’t forget to vote! :) https://t.co/6AftruqPdn "Building a Winning Self-Driving Car in Six Months," Burnett et al.: https://t.co/FbuYZwSCoL "Adversarial Gain," Henderson et al.: https://t.co/jVhJL4BvyB "Legible Normativity for AI Alignment: The Value of Silly Rules," @dhadfieldmenell et al.: https://t.co/F3c4w8abr9 "Learning Shared Dynamics with Meta-World Models," Wu and Li et al.: https://t.co/RluWkatfIh "On the Evaluation of Common-Sense Reasoning in Natural Language Understanding," Trichelair and Emami et al.: https://t.co/BNcbh6H2U6 "RT @timhwang: ┳┻| ┻┳| ┳┻| ┻┳| ┳┻| ┻┳| ┳┻| ┻┳| ┳┻| ┻┳| ┳┻| ┻┳| ┳┻| _ ┻┳| •.•) go vote ┳┻|⊂ﾉ ┻┳|" RT @NicolasPapernot: The Marauder’s map I presented at AISec just went up on arXiv (links below). The talk analyzed current ML security and… @EBKania Is this the one that was kinda cancelled before? "Contingency-Aware Exploration in Reinforcement Learning," Choi, Guo, and Moczulski et al.: https://t.co/ZEaERm9Nru "How deep is deep enough? - Optimizing deep neural network architecture," Schilling et al.: https://t.co/XzHZMcVs8H "Bayesian Action Decoder for Deep Multi-Agent Reinforcement Learning," @j_foerst and Song et al.: https://t.co/4OCVOYWYPA "A Marauder's Map of Security and Privacy in Machine Learning," @NicolasPapernot: https://t.co/dzOhI4L02k RT @dog_rates: Meet Oggie and Opal. Oggie nibbles when he’s nervous, and he gets nervous on car rides. Opal never agreed to this. Both 13/1… "RT @Thom_Wolf: Here is an op-for-op @PyTorch re-implementation of @GoogleAI's BERT model by @sanhestpasmoi, @timrault and I. We made a scri…" RT @KevinMKruse: Glorious. https://t.co/J4Cnj6V33H @samim Exciting, congrats! "Automated Theorem Proving in Intuitionistic Propositional Logic by Deep Reinforcement Learning," Kusumoto et al.: https://t.co/T81FTmTqwz RT @chipro: If you're looking to advance your research in AI or apply AI to your field, check out NVIDIA's brand new year-long AI research… "Spectral Signatures in [Neural Net] Backdoor Attacks," Tran et al.: https://t.co/d4EmEco0ku RT @buttpraxis: Today in rich dude fights I can’t get enough of, Benioff brutally owned the zynga guy by telling him his company doesn’t ma… RT @deeplearningai_: Physics and Neuroscience student. Classical pianist. Mom. Deep Learner. Learn how @mcleavey did it: https://t.co/jSw16… "Podcast with @catherineols and Daniel Ziegler on ML engineering as a career and related issues: https://t.co/vcWnebnvoB And a written guide from @catherineols on moving from CS/software engineering to ML engineering/AI safety: https://t.co/H84NvSSpf1 😍" RT @DeepMindAI: Machine learning and computational neuroscience share a common challenge - to analyse and understand neural network represe… RT @awjuliani: Some musings I put together on maximum-entropy reinforcement learning and human adaptability. https://t.co/INhAUZjnCV RT @RichardMNephew: This is frankly disgusting. I was responsible, directly, for U.S. sanctions against Iran for a long while. I took pride… Brb dead https://t.co/aD4MZAGGke RT @shannonrwatts: Never, ever bring a Mike Pence to an Oprah fight. https://t.co/QLjnkset0y """Horizon: Facebook's Open Source Applied Reinforcement Learning Platform,"" Gauci et al.: https://t.co/DFZaKVo5CH Interesting that they did RL for notifications" "SDRL: Interpretable and Data-efficient Deep Reinforcement Learning Leveraging Symbolic Planning," Lyu et al.: https://t.co/OVWJrels8D "Towards a Simple Approach to Multi-step Model-based Reinforcement Learning," Asadi et al.: https://t.co/qM3aaeCaTr "Democratizing Production-Scale Distributed Deep Learning," Ma et al., Apple: https://t.co/d8BgXB8L56 "Temporal Regularization in Markov Decision Process," Thodoroff et al.: https://t.co/6yX0G4FoSk "Dilated DenseNets for Relational Reasoning," Antoniou et al.: https://t.co/f47qdUzViq RT @jkass99: We had rocks thrown at us all the time in Afghanistan. Responding with lethal force is a fucking war crime. https://t.co/CqKYW… @mer__edith 👏👏 RT @vkrakovna: New blog post on assumptions made by the machine learning approach to AI safety, and different approaches to specification p… RT @starsandrobots: Thread on #GoogleWalkout: RT @dog_rates: This is Katara. She has too many toe beans. One of the rarest puppos out right now. 14/10 would pet for good luck https://t.… "Analyzing biological and artificial neural networks: challenges with opportunities for synergy?," Barrett and @arimorcos et al.: https://t.co/Vguw8Tm92p "Differentiable MPC for End-to-end Planning and Control," @brandondamos et al.: https://t.co/lCbXidLblT RT @VeredShwartz: Are GANs better than LMs in text generation? @GuyTvt and @HabibGavriel provide a simple way to approximate GANs to LMs wh… "Taking Human out of Learning Applications: A Survey on Automated Machine Learning," Yao et al.: https://t.co/HvQMItaQtN RT @dog_rates: This is Rico. For Halloween this year he wanted to be faster. Plans to fill the night with spooky zooms. 13/10 h*ckin inspir… RT @genekogan: upgrading meat puppet to HD. as soon as i can get a good voice model, i’m going to make a parallel state of the union addres… @cyrilzakka (and I may use that eventually, but am not in a huge hurry RN) @cyrilzakka yes. @shivon @karpathy or is he dressing up like not-Karpathys? 🧐 "A̶ ̶w̶a̶t̶c̶h̶e̶d̶ ̶d̶e̶e̶p̶ ̶R̶L̶ ̶a̶g̶e̶n̶t̶ ̶n̶e̶v̶e̶r̶ ̶l̶e̶a̶r̶n̶s̶ Deep RL is slow ✅" RT @apilipis: New prediction-based method that periodically finds all 24 rooms and solves the first level of Montezuma's Revenge: https://t… "RT @seb_ruder: Code and pretrained weights for BERT are out now. Includes scripts to reproduce results. BERT-Base can be fine-tuned on a st…" RT @OpenAI: Random Network Distillation: A prediction-based method that achieves state-of-the-art performance on Montezuma’s Revenge -https… @BatuAytemiz Tweak reward function scale """The Nuts and Bolts of Deep RL Research,"" John Schulman: https://t.co/PE4K3p3t9Z Lots of very useful tips here!" @wassname Tweak the reward function scale RT @NVIDIAAIDev: .@NVIDIA researchers just developed a #GPU-accelerated reinforcement learning simulator that can teach a virtual robot hum… (Don’t know your username but maybe you’ll see that :) ) Might be able to solve Humanoid with PPO today thanks to a hot tip from John Schulman 😃 thanks, John! "RT @recurseparadox: Check out our new paper: Model-Based Active Exploration https://t.co/mvSWfycUVX Simple Idea: - learn multiple models…" "RT @yaringal: Excited to announce our new research group at @CompSciOxford: Oxford Applied and Theoretical Machine Learning Group (OATML) H…" @mark_riedl :( RT @AndrewGillum: I heard @realDonaldTrump ran home to @FoxNews to lie about me. But as my grandmother told me — never wrestle with a pig.… RT @zacharylipton: In "Failing Loudly", we tackle the problem of detecting distribution shift in realistic high-dim datasets. In low-sample… @tkasasagi you can do it! https://t.co/sheBm0NMX7 RT @apilipis: Excited to be working with @jackclarkSF @Miles_Brundage and the @OpenAI team like: https://t.co/GTCw9KmKYt Soft Actor-Critic is ridiculously better for this purpose (~100x faster in my experience) but I will persevere. RT @jackclarkSF: Would like to specifically shout out @charlotte_stix 's new newsletter on European AI which started recently and is a help… "Efficiently Combining Human Demonstrations and Interventions for Safe Training of Autonomous Systems in Real-Time," Goecks et al.: https://t.co/ELSCgJiEgQ I may not have gotten PPO to work well on Humanoid-v2 yet, but I can at least confirm that achieving the dragging-one-leg-with-the-other local maximum is very robust to extreme hyperparameter changes. RT @AnimaAnandkumar: #Gaslighting and #Mansplaining by senior members of the community who reach out to me in private and provide "helpful… RT @RogerGrosse: Think you understand weight decay? Think again. We found three distinct mechanisms by which it achieves a regularization… @danaludwig It was a joke to encourage people to vote. @Aeropyornis Hmmmmm. Good Q, will ponder as I read :) Arms control people are really good at writing useful but boring books. RT @RossFrenett: "Almost any imaginable circumstance under which Trump leaves office is likely to coincide with a wave of violence even gre… RT @abhshkdz: New preprint! TarMAC, a simple and effective architecture for learning targeted communication protocols in multi-agent RL. Le… "RT @markus_with_k: The proceedings for the Conference on Robot Learning #CoRL2018 #CoRL are finally online. Lots of #sim2real, #transferle…" RT @twimlai: Today we’re joined by @seb_ruder, PhD student studying NLP at @nuigalway and Research Scientist at text analysis startup @_ayl… @rebecca_roache @drkatedevlin I’m in RT @JeffDean: AI is a powerful tool for improving society. I'm excited about our AI for Social Good program, focusing on both research & e… @mizroba but ⏲️ @mizroba I don't :( Not his best work RT @davidmackau: i think it was jesus who said https://t.co/l94mgywWoC Huxley wrote a lot more books than I realized. Just finishing up Ape and Essence (TL;DR: humans suck), dunno if I recommend unless you're in too good of a mood. RT @elizabeth_joh: Christine Blasey Ford testified just over a month ago. One month. https://t.co/J70yF6zcAz RT @nytimes: The crash of Lion Air Flight #JT610 has prompted a desperate search for survivors and questions about why the aircraft went do… RT @math_rachel: "I can't believe you're worrying about something minor like issue X, when there are more serious issues like Y and Z." -->… RT @Chiro_chan_neko: キャットウォーク https://t.co/3r0i0frq0y RT @ylecun: Oookay https://t.co/SV2utKO3Pd RT @JenAshleyWright: Being in the U.S. right now is like watching a train go off a cliff, except half the people on the train are screaming… RT @astro_pyotr: I wrote a blogpost about why I created an alternative site for the Neural Information Processing Systems conference: https… Double your donation to one or more of several progressive candidates in the upcoming elections! https://t.co/mrm8AR2COJ RT @Pinboard: The bad news is, we ran out of Great Slate matching funds. The good news is, other people have stepped forward with **$30,501… RT @ashleyfeinberg: god i forgot how insane this was https://t.co/1fQbyPyf6f RT @AnimaAnandkumar: Bullying and trolling for just speaking up about @NipsConference name change is shameful. I can speak up, but still fe… @nancyleong Omg RT @BarackObama: We grieve for the Americans murdered in Pittsburgh. All of us have to fight the rise of anti-Semitism and hateful rhetoric… RT @dbryanjones: Will be moving my business off @Stripe and @PayPal if this isn’t changed. Free speech doesn’t mean free access to technolo… RT @radleybalko: We should be far more worried about the people who are angry at the caravan than the people who are part of it. RT @JeffFlake: I don't know that I've ever heard a more callous statement https://t.co/B6bunxDWqv RT @Bro_Pair: A Nazi terrorist was threatening his victims unimpeded on your website https://t.co/SxTHQYNLoM @aprilaser Thank you for doing what you do. RT @brianschatz: I don’t want to arm synagogues and churches and schools. I want to live in a society where nazism and white supremacy craw… RT @brianklaas: Unspeakably vile and callous. Trump says he considered canceling his political rally not because 11 people were murdered in… RT @rtraister: It’s happening on all fronts, all around us, every day, the move backwards, the reversal of progress made over generations b… It’s Self Care Saturday! Take care of yourselves, folks 💓 RT @juliaioffe: You know what? I take it back. When the President of the United States calls himself a nationalist, it’s not a dog whistle.… RT @elizabeth_joh: blaming the synagogue. i just can't. https://t.co/5yDKBUO71H "RT @jeffbigham: a block away from my house. FUCK easy access to guns, and FUCK casual tolerance of hate https://t.co/beORBeNurE" @rebecca_roache JFC RT @animesh_garg: Pumped to share our work on large scale learning from people as described in 'Robots learn tasks from people' 1/3 https:/… RT @politico: "They didn’t care about [Hillary Clinton’s] emails…because if they did, they’d be up in arms right now as the Chinese are lis… Have wanted to tweet that for a while for some reason. Carry on. Poop RT @itsJeffTiedrich: call me crazy but I'm thinking that the 325,700,000 members of the wealthiest nation in the world can make room for 2,… Zeno’s Uber arrival time I am a fan of MSFT’s advocacy of norms around cyber and call for industry pledge of not helping offense, but unclear what the equivalent advocacy will be in the AI domain. Cc @erichorvitz This issue has been handled better by MSFT than Google from a PR perspective (proactively justifying what you’re doing vs. just waiting for leaks), but still many unanswered Qs re: what MSFT will advocate + what leverage they have in a world w/ Amazon etc. https://t.co/7yhZt2YULN RT @jonmladd: The main problem with getting extremist conspiracy theorizing under control in the United States is that the president of the… RT @qjurecic: I give it two days before he says explicitly that it's a false flag https://t.co/AbUglUD7wA @timhwang For you https://t.co/w8VEwisB28 @juliagalef @MrMeritology @mark_riedl @IBMResearch @Microsoft @amazon @NvidiaAI @intel @Uber @DeepMindAI @Apple @Twitter @netflix Yeah I’m not wedded to it being most or all, and not sure where I’d draw the line re: how much “some” is needed (as ppl have pointed out, lots of things are slurs/can be used in jokes etc) but the dozens of women’s anecdotes I’ve seen cross my vague bar @juliagalef @MrMeritology @mark_riedl @IBMResearch @Microsoft @amazon @NvidiaAI @intel @Uber @DeepMindAI @Apple @Twitter @netflix (Defending what I see as the minimal core of the issue, basically what @chipro said, survey is a bit of a distraction/used disingenuously by NIPS IMO given that it was not billed as the decision-making process) @juliagalef @MrMeritology @mark_riedl @IBMResearch @Microsoft @amazon @NvidiaAI @intel @Uber @DeepMindAI @Apple @Twitter @netflix Yeah I wasn’t saying it is skewed in one direction. I don’t think the view that the many specific women who spoke up/continue to do so about the issue are being ignored depends on the survey. @juliagalef @MrMeritology @mark_riedl @IBMResearch @Microsoft @amazon @NvidiaAI @intel @Uber @DeepMindAI @Apple @Twitter @netflix I wouldn’t read too much into those numbers. It’s pretty small n, wasn’t obligatory, wasn’t framed as a referendum but a request for input both structured and unstructured, we don’t know about distribution of respondents/nonrespondents even within ppl who haven’t quit field, etc https://t.co/o6fMYc9sfl RT @mark_riedl: @NipsConference @facebook @IBMResearch @Microsoft @amazon @NvidiaAI @intel @Uber @DeepMindAI @Apple @Twitter @netflix \cc @… RT @mark_riedl: Dear @NipsConference sponsors: do you endorse the message that NIPS is sending to women scientists by not changing it’s nam… @halhod @andrey_kurenkov @mark_riedl @fastdotai @udacity I don't recall the precise timing but there have certainly been online courses on deep learning since pre https://t.co/7iFpAGuV34 as Andrey said. What's changed is the barrier to entry (less mathy), general production value, and greater engineering vs. science focus. 🇬🇧 ✈️ 🇺🇸 RT @AndrewGillum: Let’s #BringItHome 👊🏾 https://t.co/GuNyhLPG6K RT @natimontelongo: What the government should actually be doing is sending humanitarian support to the border. This is not a war, it is a… RT @hardmaru: @dribnet @fchollet @DrBeef_ He might have been the first AI artist to have his work stolen, twice. RT @hypatiadotca: If you're infuriated about that Google story, I recommend donating to the wonderful nonprofit that Star, one of the Googl… @tkasasagi 😞 @vrandezo @math_rachel I think it's pretty obviously ethically dubious for the reasons I mentioned. I'm not commenting on the legality. "Law and Adversarial Machine Learning," @ram_ssk et al.: https://t.co/j5JTvon3LZ "RT @ram_ssk: Signed and also sent it to my research group for them to consider. @AnimaAnandkumar - You are the kind of leader I aspire to…" "RT @ram_ssk: Signed and also sent it to my research group for them to consider. @AnimaAnandkumar - You are the kind of leader I aspire to…" RT @RogerGrosse: Reversible RNNs: reduce memory costs of GRU and LSTM networks by 10-15x without loss in performance. Also 5-10x for attent… @vrandezo @math_rachel It was done in a very shady and exploitative way - not giving an indication that this was a profit-making exercise when asking for permission (after asking for free labor), not having actually made any contribution, just ran code ("used..to create something" gives 2 much credit) "K For The Price Of 1: Parameter Efficient Multi-task And Transfer Learning," Mudrakarta et al.: https://t.co/VxQ69QkfQE "Combinatorial Optimization with Graph Convolutional Networks and Guided Tree Search," Li et al.: https://t.co/zxs2Gy3NQH "A mathematical theory of semantic development in deep neural networks," Saxe et al.: https://t.co/H9k7mHmAU0 "Inverse reinforcement learning for video games," Tucker et al.: https://t.co/vIINLFVjPD """SATE: Robust and Private Allegation Escrows,"" Arun et al.: https://t.co/Boi556pbKu I suspect this or something like it will eventually have a big impact in the sexual harassment domain and in other areas of misconduct." RT @benhamner: The @NipsConference “decision by committee” to keep its name is pathetic. We do research because we want to improve the worl… RT @AnimaAnandkumar: A student from a top #ml program wrote how a senior male professor (likely her advisor) is strongly against name chang… RT @quasimondo: The worst thing is that this piece of rubbish will stick like a sheet of toilet paper to the heels of any article that will… And as @DrBeef_ emphasizes, there is in fact a lot of good/ethically presented AI art out there, this shadiness notwithstanding. If you read the thread, it seems the “artists” bugged Robbie to work on his open source project, asked about whether they were allowed to use it in very vague terms, then sold it for a bunch of money/got lots of press. 😡 This is a really gross story... https://t.co/D7lX7Aqxxp RT @deontologician: @Miles_Brundage https://t.co/2w1e9WR7k3 RT @MaCroPhilosophy: Now hiring for a 6-month position at Imperial and @LeverhulmeCFI developing and testing problems for the Animal-AI Oly… RT @hardmaru: “In Bangalore, some 2,400 people are members of AI Saturdays, which follows the https://t.co/WMqXinK20x course together as a… RT @crampell: Pipe Bomb Sent to Robert De Niro’s Production Company https://t.co/kiBsaMaSfW Nice to be back in Oxford for the day! https://t.co/FaktiJgeZl RT @JeffDean: I think enough people are made to feel uncomfortable by the current name that the NIPS board should change the name of the @N… RT @AnimaAnandkumar: A woman told me that a gun toting bro physically threatened her on @mxlearn over @NipsConference name change. Can the… "Learning Representations in Model-Free Hierarchical Reinforcement Learning," Rafatti and Noelle: https://t.co/ya3636ODoC RT @BrendanNyhan: Not even close to the top news in this story. Where we are as a country. https://t.co/hfjZoQrGVP RT @GoogleAI: Check out new research from the Google Brain team, @DeepMindAI and ETH Zürich which allows RL agents to explore environments… RT @ericgeller: Russia and China are listening to Trump's iPhone calls, but admin officials aren't worried he'll spill classified secrets b… RT @eveewing: everything that we were called alarmist for predicting is now happening. RT @SecretService: BREAKING: Secret Service intercepts suspicious packages addressed to the residences of former President Obama and former… RT @red_abebe: I'm very excited to share an article that @kiragoldner and I wrote on Mechanism Design for Social Good (MD4SD) for the SIGAI… @Nihlogos yes, though I can/do say more specific things in other tweets @Nihlogos I'm just one person, but in my case, no, I wouldn't. "Intrinsic Social Motivation via Causal Influence in Multi-Agent RL," @natashajaques et al.: https://t.co/dlyoUOwZuZ RT @PatrickOmid: Pretty incredible https://t.co/otEv7lLY0W "Superhuman Starcraft Play with Deep Reinforcement Learning": https://t.co/Xf03XdIAVW RT @AthertonKD: "assassination bad because it was sloppy" is not really the line I expected from the president today but we live in hell so RT @_prestwich: Think of a blockchain as a DB but writing to it sucks and querying it also sucks and also the maintainers hate you RT @JoshSchwerin: The white is silent https://t.co/8y5MUFZO7Y RT @sharky6000: Happy to share our paper relating actor-critic methods in partially-observable multiagent env's to regret minimization, ins… RT @hypatiadotca: I just realized that horse_ebooks was the original "i forced a bot to watch <whatever>" joke @jackclarkSF @timhwang He didn’t hide the fact that it happened, I just happen to be discovering the topic now lol @timhwang Social conjecture: Tim naturally resists monopolies of ideas, so if you leave him unattended at a dinner conversation about AI, he will tweet about hobbyist markets @guillefix Not long sadly RT @OpenAI: Iterated Amplification: An AI safety technique that has the potential to let us specify behaviors and goals that are beyond hum… 🇬🇧 "RT @ben_rosen: FOUNDING FATHER: we must always have an electoral college and 2 senators per state ME: ok but what if 40 million people liv…" RT @hypatiadotca: iOS speech-to-text just transcribed me saying “about” as “a boat” and I feel attacked 😂🇨🇦 RT @brianklaas: This one has all the greatest hits: lies, overt racism, xenophobia, bigotry, a spelling error, and random capitalization of… 🇺🇸✈️🇬🇧 RT @DrBeef_: level 100 pickpocket https://t.co/EgOXpUaVdD RT @EmilyGorcenski: They can’t silence us, and they can’t erase us. RT @timnitGebru: Don't stay quiet cause you think it won't affect you. https://t.co/0tqykGaMjF @sir_deenicus @mgubrud That’s not what most of the funding is for, though (in China or elsewhere) - often short term companies, military projects, surveillance, etc realizable in months/years RT @samswey: I see Fox News is trying to turn out the white supremacist vote with constant coverage of groups of migrants seeking refuge in… @sknthla Curator discusses creator @mgubrud Investments can materialize quickly in AI - this isn’t fusion research @mgubrud Yep, we agree there are unhelpful analyses out there, just happen to think that graph is one @mgubrud I’m generally with you on mythbusting re: China but 2016 was a long time ago in AI "Research Opportunities for CO2 Utilization and Negative Emissions at the Gigatonne Scale," Majumdar and Deutch (pdf): https://t.co/dV47iImJZb Great opportunity for those interested in studying big picture topics at Oxford! https://t.co/IxPmGBXDnb RT @shimon8282: .@Latent_Logic, the Oxford spin-out I co-founded with Joao Messias has a new website: https://t.co/BvoK1dh7F0. Check it ou… RT @SteveSchmidtSES: A US permanent resident, the Father of American children and a Washington Post columnist was murdered in a Saudi Consu… RT @AthertonKD: game set match https://t.co/PNa0N2LEd2 RT @AthertonKD: Saudis only have to convince one guy, and unfortunately for everyone else, he's an easy mark who will happily cave RT @KingstonAReif: Bolton gonna Bolton. Withdrawing from INF Treaty would be a boon to Moscow and (further) alienate allies. Russia’s viola… RT @mtrc: I want to go to this animal's self-confidence seminars. https://t.co/snmoPxrXZC @ASciFiLawyer True, I meant more that it’s China doing it (in the story amd IRL) RT @ColinKahl: Russia has been violating the INF Treaty for a while, but leaving the treaty allows Moscow to blame the United States for it… RT @jeremyphoward: Terrific interview of @bhutanisanyam1 and fellow @fastdotai alum (and now @OpenAI fellow) @mcleavey discussing how she w… RT @wilnyl: I love physics https://t.co/HoB8r54AdO RT @lilaibrahim: We have good reason to be optimistic - although never complacent - about the promise of AI to change the world for the bet… More people in the West should read Liu Cixin! This is straight out of one of his short stories... https://t.co/tButB51l4l "RT @iamtrask: It is possible to train an AI model while the AI and the training data are encrypted - #privacy In this #OxfordAI interview…" @Zergylord Sorry, fixed schedule was option A* @Zergylord Makes sense. Annealed with a learned schedule 🤔 or adaptively 😍? @Zergylord Interested in long term performance. Is this like NEC where the gains peter out after a few tens of millions of frames? / how do we get the best of both worlds? 🤔 "Gradient Agreement as an Optimization Objective for Meta-Learning," Eshratifar et al.: https://t.co/UibkYvZp5Q "Private Machine Learning in TensorFlow using Secure Computation," @mortendahlcs et al.: https://t.co/BI7sAcpxsp "Trust Region Policy Optimization of POMDPs," @kazizzad et al.: https://t.co/v0mCJD55px "Fast deep reinforcement learning using online adjustments from the past," @Zergylord, Sprechmann, and Pritzel et al.: https://t.co/Veoz69yxio @AdrianBPatter They aren't unusual tasks - it's just the Mujoco/Gym Humanoid-v2 task where the goal is to move forward. It's the solutions that are unusual :) h/t @jachiam0 for the description Walking on a floor covered in LEGOs like https://t.co/fIS8LL45Ut RT @mmitchell_ai: Delighted to announce Google's launch of Introduction to Fairness in Machine Learning! A collaboration between many of us… @iandanforth That's the StarCraft bot in progress, maybe (technically R2D2 is more efficient than Ape-X but I wanted to have it also be chronological. memes are not an exact science) (adapted from @phillysocialist meme) Training deep RL agents on lots of Atari frames like https://t.co/EwpE2soJtK @sknthla @Asteroid_AR @blakekathryn Cc @GoAbiAryan @tdietterich @rcalo SSRN-RN (right now) @rcalo (The interface definitely changed, for the record. I’ve never logged in and it recently became a hassle and I didn’t notice the option to not register) RT @NandoDF: The neural networks for deep RL just got a lot bigger. Evidence that RL scales to train nets that must be massive to achieve g… RT @iandanforth: I really dig the approach of restricting models to more human-like constraints. Aids in interpretability and forces new, c… "At Human Speed: Deep Reinforcement Learning with Action Delay," Firoiu et al.: https://t.co/pKsGMyi9v0 @rcalo @SSRN Good to know that trick. I’ve lost interest in a few papers after running into this issue, very annoying "RT @math_rachel: Study on the gendered impact of weed-out courses: - women are NOT more likely to fail calculus than men - when men fail ca…" RT @ermgrant: Deadline is tonight, 11:59 PM anywhere on Earth! We look forward to your submissions! https://t.co/EVPPHqWINN @allergyPhD @zunguzungu it's so looong @decodyng @zacharylipton Zach is acronym trolling us RT @DeepMindAI: Today we're open sourcing TRFL, a library of building blocks for reinforcement learning agents - containing key algorithmic… RT @dangillmor: A reminder of journalism's goldfish-like attention span: Less than 2 weeks ago, the @nytimes reported, with solid evidence,… "RT @ankurhandos: New work on learning force vectors from BioTac tactile sensor, led by @aiTinMan https://t.co/1dFpYLWehf https://t.co/MG…" RT @Baidu_Inc: Glad to be the first PAI member from China! https://t.co/67Xwe7Eks1 RT @KevinMKruse: Trump called for the Central Park Five to get the death penalty before they were proven guilty and then -- after they had… RT @catherineols: New preprint: Throw out bad GAN samples when sampling (using the discriminator to tell good from bad). Quality goes up. A… 😍https://t.co/X8PiKtu5JZ @ngutten I’m using code that will be public soon so stay tuned :) "Optimizing Agent Behavior over Long Time Scales by Transporting Value," Hung, Lillicrap, and Abramson et al.: https://t.co/rgRNepfM91 RT @pathak2206: We have now released the training source code for our paper on "Large-Scale Study of Curiosity-Driven Learning". Check it o… RT @PartnershipAI: ...future of AI. We look forward to seeing our members work together across borders, sectors, and disciplines to help sh… RT @PartnershipAI: Today we welcome our first member from China @Baidu_Inc to the Partnership on AI. This is an important step toward build… @awjuliani 🤖 👫🤖 @ankesh_anand (PPO is slower, I mean....Humanoid generally is slow, too, but not as slow with SAC in my experience so far) @ankesh_anand yeah, definitely slower than e.g. soft actor-critic, but not as hopeless as I had thought :) RT @mjntendency: @Miles_Brundage "I'm a satisfied customer" –Miles Brundage, real customer https://t.co/2B5AzXrPhQ Thought I couldn’t get it to work on Humanoid, but seems like I really just needed more parameters PPO is my new best friend RT @goodfellow_ian: PSA. If you’re a US green card holder, requirements to travel to Canada have changed recently. I imagine many of my fol… @tkasasagi Congrats!! When your leg's asleep but everyone is ready to leave https://t.co/FXvwMJBrAw Startin to get the hang of things like https://t.co/jq6rqVANzT Imagine writing a tweet like this https://t.co/OR0MIK0SKQ RT @ankurhandos: This summer Jacky, @ViktorM80532322 and I worked on accelerating deep RL on GPUs. The work will be presented at CoRL this… """Beauty and the Beast: Optimal Methods Meet Learning for Drone Racing,"" Kaufmann et al.: https://t.co/MfYqmIgv18 Winner of IROS autonomous drone racing competition" "Dexterous Manipulation with Deep Reinforcement Learning: Efficient, General, and Low-Cost," Zhu and Gupta et al.: https://t.co/ieHLrtIORa "CURIOUS: Intrinsically Motivated Multi-Task, Multi-Goal Reinforcement Learning," Colas et al.: https://t.co/U7X7zdMnZ1 "Deep Imitative Models for Flexible Inference, Planning, and Control," @nick_rhinehart et al.: https://t.co/x7NHzFOYyS "Successor Uncertainties: exploration and uncertainty in temporal difference learning," Janz et al.: https://t.co/qxbCvzJSXx "Unsupervised Neural Multi-document Abstractive Summarization," Chu and Liu: https://t.co/cFq15nW6AP "Parametrized Deep Q-Networks Learning: Reinforcement Learning with Discrete-Continuous Hybrid Action Space," Xiong et al.: https://t.co/NgN84UWMbE "Mixture of Expert/Imitator Networks: Scalable Semi-supervised Learning Framework," Kiyono et al.: https://t.co/V0KwKQiSLj "Policy Transfer with Strategy Optimization," Yu et al.: https://t.co/gaUc1BYjOg @evolvingstuff Don’t subscribe to anything but I typically open up tabs for Physics>Disordered Systems and Neural Networks, Statistics>Computation, Quantitative Biology>Neurons and Cognition, and most importantly Statistics>Machine Learning and Computer Science>New Exciting night on arXiv! RT @etzioni: Paul Allen was an inspiration, a mentor, and partner in posing the most fundamental question about intelligence. My colleagu… don't @ me @jackclarkSF / @GoAbiAryan LARPing Weekend at Bernie's like https://t.co/DN2GtaQC4D 😬 https://t.co/jC7Bfi3PAq @GoAbiAryan https://t.co/3iVqIf9kJp RT @chrisdonahuey: Excited to announce Piano Genie, an intelligent controller that allows anyone to improvise on the piano! This was my int… RT @dog_rates: This is Milton. He’s a firefighter. Likes to drive the truck. Hoping to grow into his uniform soon. 14/10 heroic as h*ck htt… RT @tarinziyaee: 🚨 Personal news! I have recently joined @CTRLlabsCo, where we will be developing and bringing neural-interfaces to market!… RT @janexwang: Two more days to submit for Metalearn2018! I look forward to meta-meta-learning https://t.co/842fiLtxcq Walkin to the bathroom in the morning like https://t.co/h0Gu6O261i @ArtirKel Happy birthday! "Is multiagent deep reinforcement learning the answer or the question? A brief survey," Hernandez-Leal et al.: https://t.co/GK0YtbKDPA @GoAbiAryan 🤔 @GoAbiAryan how can you listen to Paul at 1.5??? he talks fast @jackclarkSF @GoAbiAryan @ankurhandos I guess I could have added “bots my own” @jackclarkSF @GoAbiAryan @ankurhandos These are personal Nazi robot tweets, Jack, see my profile :P @GoAbiAryan @ankurhandos Is it that suggestive??? Maybe I should delete it @ankurhandos Haha that’s its leg!!! I see more of a dance Waking up at the alarm and then going back to sleep like https://t.co/vrnkZZQPQO @sdantul nope, sorry! @sdantul In the case of my software, Tab changes the view... but not sure if we're using the same version :) RT @abhijatbiswas: @Miles_Brundage this agent must have been written in.... monty python https://t.co/r0cjMnsAKi Also, (riding off into the) Sunset Saturday. https://t.co/TXAA183rGY It’s Silly Walk Saturday! https://t.co/wpURnwkkM8 RT @lilianweng: Here is my new blog post on flow-based deep generative models. Different from GAN or VAE, these model explicitly learn the… RT @phl43: The next time you're inclined to say that something will *never* happen, think about what you would have said if someone had sho… RT @FINALLEVEL: I still don’t think I’ve got my haters Mad enough.... @jeremyphoward @NandoDF cc some other folks at Ox who may know what the deal is @maosbot @katherine_oxf , not familiar w/ this RT @nancyleong: I’m totally comfortable saying that no US president should claim that ROBERT E. LEE was “great.” Ever. There are literally… RT @katherinebailey: We already had EMLo, now we have BERT. Will someone please build a Bidirectional Generative Bayesian Implicit Represen… "RT @RikeFranke: #Scifi book recommendation for the weekend. (@Miles_Brundage @drfranksauer , you were totally right) https://t.co/SS8SXyxw…" RT @ohnadj: Hey, that's me presenting! 😁 I wrote a blog post of learnings and advice from my experience in the Summer 2018 cohort: https://… https://t.co/MtV88T9y7y https://t.co/Z04jB93OyO @jjvincent I don’t see any value add at all from having it there @jjvincent You might be being too charitable - it’s nonsense Plot twist: The Man in the High Castle is actually about deep fakes being used for good. RT @jorge_guajardo: Has anyone studied what happens if you don’t read every single article that gets your initial attention? Does the world… Bonus points for "Equal contribution. Author ordering determined by Liam holding a duckie behind his back and making Homanga guess 'right' or 'left'." "A Data-Efficient Framework for Training and Sim-to-Real Transfer of Navigation Policies," Bharadhwaj and Wang et al.: https://t.co/JgXVZqcu2Z RT @brhodes: Saudi message is that no critic of MBS is safe anywhere in the world. Trump message is that America - and by extension the pri… And of course there is a ton of stuff happening above the 100% mark, but the 0-100 regime is particularly important, 1000%++ stuff less so. (usual caveats re: compute varying across these, etc. plus an additional caveat of this data being a bit noisy b/c I took a shortcut in normalizing the scores) "New visualization of Atari scores, now with R2D2. For each algorithm, scores for 57 games are displayed, capped at 100% of human tester. White space = below human. H/t @Hernandez_Danny for help processing the data + @ilyasut for related discussion that prompted me to redo this. https://t.co/GiiM8w4Sx9" RT @lmthang: A new era of NLP has just begun a few days ago: large pretraining models (Transformer 24 layers, 1024 dim, 16 heads) + massive… RT @KaiLashArul: Excited to be a mentor for the next cohort of OpenAI Scholars 😃 They're looking for people with technical skills, self-mot… RT @lfschiavo: Very excited to announce that we're now accepting applications for the second cohort of Scholars, a program for people from… RT @OpenAI: Apply for our Winter 2019 OpenAI Scholars Program, open to individuals from underrepresented groups in STEM interested in becom… @zacharylipton @annabelle_nlp @timnitGebru @yuvalmarton @databoydg @businessinsider @Hamilbug That was the first AlphaGo interview I could find with Silver so can’t be *that* uncommon. Whether it’s accurate depends on the binary vs continuous/multidimensional framing of intelligence/cognition thing, and I lean towards the latter + some systems being (perhaps barely) >0 @databoydg @zacharylipton @annabelle_nlp @timnitGebru @yuvalmarton @businessinsider @Hamilbug More broadly, think we agree it’s bad for people to think current systems are more capable than they are. One way to do that is to define AI as high capability, not call it AI. Another is to define AI as spectrum. Either way, be specific re: what system in Q is purported to do. @databoydg @zacharylipton @annabelle_nlp @timnitGebru @yuvalmarton @businessinsider @Hamilbug Yeah, think it’s often used interchangeably with agent, as well. If one means the same thing by them, and the audience is more likely to get “the AI” than “the agent,” doing that seems fine to me. Just be accurate re: what behavior/processing you’re ascribing. @zacharylipton @annabelle_nlp @timnitGebru @yuvalmarton @databoydg @businessinsider @Hamilbug Not saying those are universally agreed on definitions/equivalences, but they're consistent with how some people (researchers and journalists) talk, and not outrageous as long as one includes the bit in parentheses implicitly or explicitly. @zacharylipton @annabelle_nlp @timnitGebru @yuvalmarton @databoydg @businessinsider @Hamilbug Guess we have to take away David Silver’s AI researcher card (interview excerpt). The/an AI=the/an AI system =the/a model/ the/a instantiation of techniques used to emulate some (now v limited, someday less) aspects of cognition w machines. Accurate + widespread use of language. https://t.co/rnLpEaDL2V "Pruning neural networks: is it time to nip it in the bud?," Crowley et al.: https://t.co/DROhDryi8r "Multi-Task Learning as Multi-Objective Optimization," Sener and Koltun: https://t.co/axZHjgMjyN Startin to make progress on a project like https://t.co/GTwu5Ua9NN @levendowski Ya RT @hardmaru: If we remove all design constraints, the optimizer came up with a really tall bipedal walker robot that “solves” the task by… RT @hardmaru: When rewarded for small leg size, the agent learned a lean minimal design where every inch matters. It also learned movements… "The Laplacian in RL: Learning Representations with Efficient Approximations," Wu et al.: https://t.co/Noe4MUQyIy RT @jdawsey1: There is a tweet for everything. https://t.co/HxBMztYZCh RT @histoftech: “Internet trolling isn't random—it's a strong-armed goon of the status quo. It's a force w/a political agenda. Those on the… @adversariel Recall that there are some studies purporting to look at this but not sure how good they are off the top of my head (e.g. https://t.co/H5SX3yzp7g ; there's prob more recent stuff) RT @dog_rates: This is Sid. He got famous a few years ago for holding a piece of pizza. Wanted to let everyone know he’s still thriving. 14… RT @mmitchell_ai: Excited to propose Model Cards for Model Reporting as a pressing step forward in transparency, accountability, and the re… @sknthla Congrats!! @willknight I don’t think it’s entirely made up but could have been accelerated/a certain interp suggested at the last min by some sources RT @mercedeslynz: It's a really scary time for dudes right now. So I wrote a song about it. Go #vote friends! #TheResistance #1Thing @ACLU… @seungjaeryanlee No prob! RT @BrundageBot: arXiv papers, October 10, 2018: @seungjaeryanlee Not off the top of my head, sorry, but there aren’t that many papers so you can search for keywords/look through them (“reinforcement learning,” “rl,” etc) and read abstracts re: benchmarks - possible heuristic: mentioning single Atari game > 57 Atari games “median” etc "Model Cards for Model Reporting," @mmitchell_ai et al.: https://t.co/maocdI00c0 @willknight Is there something else? RT @mcleavey: OpenAI 2019 Winter Fellows & Summer Interns https://t.co/R6ds6SuHlu @willknight Easy to explain the fishiness: widespread denouncement from many sources vs anonymous sources mostly in govt, timed weeks after govt decision to bash China "CAML: Fast Context Adaptation via Meta-Learning," @luisa_zintgraf et al.: https://t.co/UpYgxdzeqE RT @hardmaru: Reinforcement Learning for Improving Agent Design: What happens when we let an agent learn a better body design together with… RT @calebwatney: My latest paper for @RSI lays out a framework for thinking about competition in AI development: it's all about reducing ba… Nice take from @barryfriedman1 on Kavanaugh and the future of the Supreme Court - honored to work with Barry on AI/policing issues! https://t.co/sMSaG3cbcd @KaiLashArul The picture is computer vision ppl who don’t wanna try deep learning RT @OpenAI: Come join the OpenAI team as a Fellow or Intern in 2019 — applications now open: https://t.co/cU1aMxirBp! https://t.co/MgGJMnWW… RT @brhodes: Everything is optics to Trump. Samantha Power led efforts at the UN to stamp out Ebola, fight climate change, free political p… RT @hardmaru: CINIC-10 is not ImageNet or CIFAR-10: Well-motivated design of a drop-in replacement for CIFAR-10! https://t.co/ej5FBv0hyp ht… "RT @maosbot: Structured activities are automatable. Structured activities are also usually tedious. The result is folk wisdom that non-t…" RT @dhadfieldmenell: They’re doing live face detection for Snapchat filter-like things on the crowd shots ata Warriors game. It’s a really… """Sanity Checks for Saliency Maps,"" @julius_adebayo et al.: https://t.co/NfoYGhvStz ""Local Explanation Methods for Deep Neural Networks Lack Sensitivity to Parameter Values,"" Ibid: https://t.co/7HZrLrwFPa" "Deep Diffeomorphic Normalizing Flows," Salman et al.: https://t.co/cttHzvHtnw "h-detach: Modifying the LSTM Gradient Towards Better Optimization," Arpit and Kanuparthi et al.: https://t.co/21Ll5eqd4A "Training Complex Models with Multi-Task Weak Supervision," Ratner et al.: https://t.co/laxxGkIVgH "Task-Embedded Control Networks for Few-Shot Imitation Learning," James et al.: https://t.co/gnGCa92KrM "HG-DAgger: Interactive Imitation Learning with Human Experts," Kelly et al.: https://t.co/xDdJPQZ4TM RT @chrislhayes: President starts the day talking to cops about the need to bring Stop and Frisk to Chicago (a policy ruled unconstitutiona… RT @barryfriedman1: My piece today @nytimes on #JusticeKavanaugh Note perhaps of interest: I wrote the first draft of this July 14. NYT… RT @arstechnica: Next generation of body cams for cops can livestream, detect gunshots https://t.co/73kzKpoRFY by @cfarivar RT @chipro: Over the last year, I struggled with many career-related questions: PhD/big company/startup, etc. I'm fortunate to have receive… RT @LyleJMorris: Safe to say Interpol will never have another Chinese official as its head. Larger question: what is ripple effect on other… RT @SpaceX: Falcon 9 has landed – first West Coast land landing of an orbital class rocket booster. "Normal brain: hardcover with title/art on dust jacket Expanding brain: paperback Galaxy brain: hardcover without dust jacket, title/art on book proper" "Zero-Shot Skill Composition and Simulation-to-Real Transfer by Learning Task Representations," He and Julian et al.: https://t.co/JSZiMCW3fQ "AutoLoss: Learning Discrete Schedules for Alternate Optimization," Xu and Zhang et al.: https://t.co/7lgdMrJW3m "Where Did My Optimum Go?: An Empirical Analysis of Gradient Descent Optimization in Policy Gradient Methods," Henderson et al.: https://t.co/Obbfwzw807 RT @charlotte_stix: #1 of my newsletter covering the EU artificial intelligence ecosystem will be sent out later today. Sign up here if you… @gwbstr @xuhulk Yep seems very plausible Omg https://t.co/lWF3znnrIi Oops https://t.co/HikrwXpj7x @xuhulk Seems especially acute in this case with the timing - Trump admin. having recently decided to bash China harder From the book Spying on the Bomb: https://t.co/p3xgVQoP5t Moe Berg lived an interesting life: https://t.co/GPh16FyOq5 "RT @smotus: “Knock the crap out of them, would ya? Seriously, just knock the hell out of them. I promise you I will pay the legal fees.” -Y…" (among many other things that should be occupying our attention, not involving Brett Kavanaugh) In a saner world, the head of INTERPOL disappearing in China then sending a "resignation" would be a big story. https://t.co/sFgb1ZV8qw RT @TomiLaffly: OK, so...do you FINALLY fucking understand why women don't report their sexual assaults? Do you now get it? DO YOU? Completely nuts https://t.co/4EI8ewBcS1 RT @goldengateblond: can’t stop, won’t stop watching this https://t.co/XPXpAe4L6E RT @ClaraJeffery: One member of the GOP Judiciary Committee is up for reelection in 33 days: Ted Cruz. RT @jonfavs: Unconscionable that someone could become a Supreme Court Justice after issuing this threat to an entire political party. https… RT @AstroKatie: I can't get over the cruelty of the whole #Kavanaugh process. The fact that the GOP demanded the public anguish of Dr. Blas… RT @juliaferraioli: We will prove you wrong. https://t.co/iUokHyHKsU "RT @leedsgarcia: God bless the women screaming in the Senate Gallery. Something Dr. Christine Blasey Ford couldn't do in her hearing to be…" "RT @missmayn: Kavanaugh was nominated by a candidate who lost the popular vote by 3 million+ votes. The 49 Senators who voted 'No' on Kava…" Ugh RT @vkrakovna: Exciting new podcast with @OpenAI researcher Paul Christiano on developing solutions to the AI alignment problem and plausib… RT @hannahgais: sometimes the internet is good https://t.co/vTUYWl8uXf RT @ThePlumLineGS: Amazing. WH limited background check into Kavanaugh because it knew a real investigation could doom nomination, NYT repo… @hypatiadotca 🧐 RT @mer__edith: Pssst https://t.co/lML1IBFnuA RT @democracydiva: susan collins's speech is longer than the FBI investigation into kavanaugh RT @eve_byu: We're excited to announce the release of Holodeck, a high fidelity simulator for reinforcement learning! https://t.co/N8uzSumc… RT @blondenukegirl: You can be pissed all you want right now. You're entitled to feel rage. But rage doesn't change the makeup of our democ… RT @hypatiadotca: These are some stark numbers. https://t.co/PqV8PkeqGk RT @katherinebailey: Not one, but two start-ups have named themselves after a move made by AlphaGo in the match against Lee Sedol: https://… RT @chelseabfinn: CACTUs: an unsupervised learning algorithm that learns to learn tasks constructed from unlabeled data. Leads to significa… "Zooming Network," Yan et al.: https://t.co/fqMlpemUbW "Verification for Machine Learning, Autonomy, and Neural Networks Survey," Xiang et al.: https://t.co/5AEoCGwepY "Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understanding," Yi and Wu et al.: https://t.co/fbjed3ZtqU "A Practical Approach to Sizing Neural Networks," Friedland et al.: https://t.co/xa5fcMTNGH RT @RVAwonk: Per @CNN, Dr. Christine Blasey Ford's attorneys have confirmed that the FBI concluded its investigation without interviewing F… Update: actually I'm the one who misunderstood the reward function, and it's just a bad policy. h/t @jachiam0 To be continued after a few million steps... @v_maini "that's...weird" ... "what's up with that laptop bar thing"... " back to debate prep" "glad I lived to 31"...? .125x speed 😎 https://t.co/XB8d6IY2zc @ArtirKel @AmandaAskell .125x speed https://t.co/WHswAx8MDS This is actually a “good” policy, if I am understanding the reward function correctly - forward progress between frames is incentivized but moving backwards isn’t penalized, so jiggling can get high reward. Rockin through Thursday like https://t.co/a5GCAiBBW8 RT @chipro: I often get frustrated searching for the latest research results on Google and Arxiv so I wrote SOTAwhat, a script to query Arx… "AlphaSeq: Sequence Discovery with Deep Reinforcement Learning," Shao et al.: https://t.co/8hc3yngkiF "Optimal Completion Distillation for Sequence Learning," Sabour et al.: https://t.co/JJ3WFBlabP RT @DeepSpiker: Taming VAEs: A theoretical analysis of their properties and behaviour in the high-capacity regime. We also argue for a diff… RT @natashajaques: Awesome article about the @OpenAI Scholars program, the importance of diversity in AI research, and my mentee Nadja Rhod… RT @80000Hours: Paul Christiano is a brilliant thinker who really delivers in this interview: How @OpenAI is developing real solutions to t… @ziwphd 😍 RT @chipro: Congrats to the Hugging Face team. Can't wait to read the paper! https://t.co/OhOGMYP6V4 RT @helengreiner: Sorry to read this. Rethink Robotics Closes its Doors https://t.co/F0SoOu9O7H @jeffbigham Exciting, congrats! "RT @jeffbigham: I'm helping to start an Accessibility+ML Research group at Apple, and we're hiring! We're looking for full-time PhDs & eng…" "RT @Thom_Wolf: Really happy with our final #nips2018 ConvAI model! We reached a perplexity of 16.3 (very low for LM on open-domain text) &…" RT @nytimes: President Trump has sold himself as a self-made billionaire but a Times investigation found that he received more than $400 mi… @HeidyKhlaaf Congrats!! @willknight @jackclarkSF Cc @KaiLashArul RT @KaiLashArul: If you can dodge a wrench, you can dodge a #dogball https://t.co/fg1dVDaLdN @mat_kelcey @KaiLashArul I leave this as an exercise to the tweeters https://t.co/K7nKgljoOH @mat_kelcey Who set your hyperparameters, Dogball? Cc @KaiLashArul @tkasasagi @fchollet How about instead, redistribution of GPUs/TPUs @zacharylipton What’s this from? RT @xbpeng4: New paper on regularizing adversarial learning with a variational discriminator bottleneck. Our method (VAIL) can imitate chal… RT @chelseabfinn: Specifying vision-based tasks to a robot is hard. We use meta-learning to learn to infer rewards for new tasks from a few… RT @KaiLashArul: Captain #Dogball https://t.co/9U0deMeXkB RT @decodyng: After taking a bit of a summer hiatus, I have a new #machinelearning post up, where I trace my journey through curiosity, con… @RikeFranke Congrats!! RT @charlotte_stix: Some of my thoughts on “Can Europe compete?” when it comes to AI now online at @theinnovator https://t.co/TlzCJOu8GE @L… RT @KaiLashArul: GANs are only useful for making pretty pict-ALL GLORY TO THE #DOGBALL! https://t.co/MNRm6wsYtz (part 2/2). https://t.co/lYhBzUJCKe Jon Favreau being AI/robotics woke on Friends (part 1/2). https://t.co/PfdgQsSLRq RT @VahidK: @Miles_Brundage When they put their papers on arxiv they aren't sending their best papers (those are sent to Nature). They are… RT @hypatiadotca: As a co-inventor of the Al Capone Theory of Sexual Harassment, my prediction for how this week will play out is that the… RT @tdietterich: I'm excited to read this new (draft) book: An Introduction to Probabilistic Programming by Jan-Willem van de Meent, Brooks… RT @ajmooch: Early in training, especially at high res, we see these really fantastic class leakage examples (#dogball being my personal fa… RT @togelius: @Miles_Brundage My lab will institute high tariffs on papers from other labs, so that they don't take the results which belon… (and yes, I said something similar before but it's still relevant and funny to me) I'm calling for a complete and total shutdown of new papers until we can figure out what the hell is going on. RT @farwzz: https://t.co/1cAtYxcaEs "RT @ajmooch: Large-Scale GAN Training: My internship project with Jeff and Karen. We push the SOTA Inception Score from 52 -> 166+ and giv…" RT @zacharynado: Tennis ball dog is one of the best GAN creations I've seen to date (from the BigGAN ICLR paper https://t.co/asaHKiR5U6) ht… @yoavgo I'd guess some combination of word of mouth from people who'd heard about it pre-submission + GANsters who checked out all the GAN stuff and saw the samples @deliprao @yoavgo I open up tabs based on one or more heuristics like sounding like it’s of fundamental importance (like NN robustness/overfitting issues) vs just specific thing like GANs or LMs I can’t evaluate, or in an area I can evaluate (relatively better) like DRL, then read abs/skim @yoavgo When i was going through titles, i recognized big gan from twitter but otherwise would have ignored @yoavgo I did not identify big gan actually, and generally I filter out GAN stuff (and adv example stuff) bc so many false positives of useless stuff (this was a rare false neg). only looked at stuff that was fundamental sounding or in an area I can evaluate like deep RL Atari stuff @yoavgo I brute forced this list FWIW, though not comprehensive and skipped stuff that already went viral like Big GAN https://t.co/DISYFvmlOq @markus_with_k Exactly :) @FlorinGogianu There are many, hard to know where to begin, but perhaps search Montezuma's Revenge on arXiv and https://t.co/hX9olvNN9C's ICLR page and you'll find some stuff. The writing has been on the wall for a long time, but R2D2 plus a dozen+ recent papers on exploration are the final nails in the coffin for the issue in the first sentence. Still a long way to go in the second bucket. Atari is dead as an RL benchmark if one's interest is superhuman performance on all games, achieved by single-game agents with arbitrary amounts of training. It's alive as an RL benchmark if one cares about sample efficiency, transfer, efficient exploration/use of memory, etc. @fchollet (Did read Zero to One though) @fchollet Dunno, I’m not SV enough to have even heard of it 🙊 work in progress @fchollet Throw in Zero to One :P @AnimaAnandkumar @UCBerkeley @SimonsInstitute Will this be recorded? RT @WiMLworkshop: We're excited to announce that we are opening up registration to the WiML workshop colocated with NIPS in Montreal on Dec… Fin (of this thread, though not of all possibly interesting ICLR papers!). """On the Turing Completeness of Modern Neural Network Architectures"": https://t.co/NgN20f2dwu Specifically Transformers and Neural GPUs" "DANA: Scalable Out-of-the-box Distributed ASGD Without Retuning": https://t.co/J5n9JKeJlg "Large-Scale Study of Curiosity-Driven Learning": https://t.co/5FLxQgvzGb "Massively Parallel Hyperparameter Tuning": https://t.co/sBXsjMEs5E RT @NarangVipin: I give up. https://t.co/P62tc9bZPI "Self-Supervised Generalisation with Meta Auxiliary Learning": https://t.co/onFtzWAc3A "Automatically Composing Representation Transformations as a Means for Generalization": https://t.co/0Z43wsxPQf "Learning to Navigate the Web": https://t.co/XSLsAxGap5 RT @arkitus: Wow, very impressive samples by an ICLR 2019 submission (I had nothing to do with this paper). Crazy to think how much informa… "Hierarchical Visuomotor Control of Humanoids": https://t.co/qKYoRNhrfl RT @mchorowitz: This was a fun podcast to record. Check it out! https://t.co/j86Ete8XOV RT @danprimack: Elon Musk to pay $20 million, step down as Tesla chair in SEC settlement https://t.co/4xcJUvgbXe "Explaining AlphaGo: Interpreting Contextual Effects in Neural Networks": https://t.co/tnCPcfFCdx @openreviewnet Congrats!!! "Evolutionary-Neural Hybrid Agents for Architecture Search": https://t.co/dkeoe5wU5M "Self-Tuning Networks: Bilevel Optimization of Hyperparameters using Structured Best-Response Functions": https://t.co/FFf18vSW2k "Learning powerful policies and better generative models by interaction": https://t.co/vcMQXa27M2 "Remember and Forget for Experience Replay": https://t.co/z8DxVtoiAW "Neural Logic Machines": https://t.co/DaNLcHqiUE "Understanding & Generalizing AlphaGo Zero": https://t.co/RgxwlPK7wL "Unsupervised Disentangling Structure and Appearance": https://t.co/Ol5YIb1iYE "In Your Pace: Learning the Right Example at the Right Time": https://t.co/A9u3M8m2tc "Learning to Simulate": https://t.co/DBevJs3x1w "Prototypical Examples in Deep Learning: Metrics, Characteristics, and Utility": https://t.co/hnGCkEXieu """Distilled Agent DQN for Provable Adversarial Robustness"": https://t.co/O8CpVraCLU (sidenote: DadQN also would be a good name for a parenting robot)" "Adversarial Examples Are a Natural Consequence of Test Error in Noise": https://t.co/lHiapDxCxS RT @jekbradbury: A huge fan of putting this in papers (from the BigGAN paper https://t.co/HCcLIPMSZ4) https://t.co/1IxLJZML4Q RT @_rockt: https://t.co/sITzJqchMy @tianxu_jia @nytimes Yeah pretty much, and also he wants to distract people from ongoing scandals @calebwatney Cc @MGBennett and @femmefutura re: paper "RT @SimonMaloy: this is fucking wild the Trump administration is arguing that climate change is both real and will be catastrophic -- so…" To be continued... "The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks": https://t.co/R5kxbAKPeY "Universal Successor Features Approximators": https://t.co/4KnhlgWDFw "Plan Online, Learn Offline: Efficient Learning and Exploration via Model-Based Control": https://t.co/4FFRXWx7dz "The Problem of Model Completion": https://t.co/t65vgDHZVb "How Training Data Affect the Accuracy and Robustness of Image Classification Models": https://t.co/zlxCfxtQ4g "TherML: The Thermodynamics of Machine Learning": https://t.co/UMumAuWDx9 "Neural MMO: A massively multiplayer game environment for intelligent agents": https://t.co/4eRmNATPD2 "Exploration by random distillation": https://t.co/uXyHQ8x2tg "Experience replay for continual learning": https://t.co/po6U6qK1wH "A Proposed Hierarchy of Deep Learning Tasks": https://t.co/sm8LlQKSH5 "Knowledge Representation for Reinforcement Learning using General Value Functions": https://t.co/vSOfcg6BDA "On Inductive Biases in Deep Reinforcement Learning": https://t.co/xJxRdoumhO "Learning Heuristics for Automated Reasoning through Reinforcement Learning": https://t.co/aDz5PdHfqW (Interlude: I know I said there was no theme and this is mostly RL stuff, but I have non-RL tabs open on another computer/will get to those in the future :) ) "Information-Directed Exploration for Deep Reinforcement Learning": https://t.co/r3qnbQneCO "Few-Shot Intent Inference via Meta-Inverse Reinforcement Learning": https://t.co/uqnie2yHaK "What Would pi* Do?: Imitation Learning via Off-Policy Reinforcement Learning": https://t.co/lPNXVXhW7I "Learning to Control Visual Abstractions for Structured Exploration in Deep Reinforcement Learning": https://t.co/7UNmLAoHXB "Unsupervised Control Through Non-Parametric Discriminative Rewards": https://t.co/X4SMDdPnIY """Recurrent Experience Replay in Distributed Reinforcement Learning"": https://t.co/OCu2qkkuA6 Better Atari/DMLab performance by (simplifying a bit) slapping an RNN on it. Also, one interesting thing I didn't notice before is the use of common hyperparams across DMLab and Atari." Thread of miscellaneous ICLR stuff I found potentially interesting (no particular order/theme) - some now, some later... @richardtomsett It’s complicated :) have written some related things here - also see my blog posts https://t.co/CAFqKosXiv @gwern Sure, could be big gap over Ape-X. Still would guess it’s much worse than Rainbow. @gwern 256 and 360 aren't very different. If it's remotely similar to Ape-X, then it is very sample inefficient. That being said, I think Ape-X vs. R2D2 seem to use comparable compute, on first glance. For newcomers to my Twitter feed, I've obsessed over this trendline for several years and have used it to make the point that AI progress is semi-predictable. Note that these scores were attained with highly varying compute/experience (wall time x-axis is misleading). (the slide from May showed two plausible interpretations of where we plausibly could have been on the median Atari score trendline, depending on whether one counts very compute-intensive or human demonstration-leveraging results or not) With all the usual caveats (evaluation conditions vary/aren't well standardized, these aren't all comparable, this hasn't been reviewed/replicated, etc.), the median Atari-57 trendline seems to have just been broken. ICLR paper today and slide from May. https://t.co/OCu2qkkuA6 https://t.co/oMBIlqhZta "Language Modeling Teaches You More Syntax than Translation Does: Lessons Learned Through Auxiliary Task Analysis," Zhang and Bowman: https://t.co/XDDDfHnmqF RT @amandamull: If you’ve never seen The Good Place absolutely do not start with this premiere, go directly to Netflix and watch the first… RT @jackiehluo: rt to save a life https://t.co/dcbApkiTuM "RT @NandoDF: Congrats to all of you who made the ICLR deadline 🎉 . And if not, aistats and ICML are just round the corner 😊" It's That's a Lot of Papers Thursday! RT @janleike: We now have a safety research blog! Check out the first post by @adaptiveagents and @v_maini on how to categorize safety prob… RT @tiffanycli: Twitter is bleak today. But here’s Totcho the corgi wearing a sweater. https://t.co/7ONkDoYtvq RT @yoyoha: BREAKING: Belligerent man attempts to prove he isn't belligerent. https://t.co/GTPUJc9AAx "RT @SussilloDavid: ICLR deadline approaching... AAAHHHHHHHHHHH! https://t.co/0DKSG7OueE" RT @hypatiadotca: I was keeping it together all morning and this tweet finally broke me. Quietly weeping at my desk. This is really the hea… RT @ashleyfeinberg: if there’s anything i look for in a supreme court justice, it is someone who immediately cracks in high pressure situat… RT @aseitzwald: She...literally is a psychology professor. https://t.co/r8slaZXqhg RT @rabiasquared: Unfuckingbelievable. Ford was entitled to rage but held back. Instead Kavanaugh rages, an entitled white man who cannot a… Exciting! Really great post. https://t.co/DVQNElA1Z8 @sebprovencher Yeah I liked it too! "I just finished Dark Forest and it was lame," said no one ever. "RT @v_maini: Excited to share our new blog on AI safety: ""Building safe artificial intelligence: specification, robustness, and assurance…" RT @demishassabis: I hope readers will enjoy this resource from our safety team, which lays out three categories of AI safety research - sp… RT @nytimes: President Trump accused China of interfering in the midterm elections, but offered no evidence of how China might be interferi… RT @mattcolville: A seal slaps a man in the face with an octopus. The best headline you'll see today. https://t.co/6C2nST9Wix Such rigor MOAR PARAMETERS AND TRAINING to the rescue https://t.co/lbIg6Nlq90 "*record scratch* I bet you’re wondering how I got here https://t.co/HTOT1tiV8Y" Getting through Hump Day like https://t.co/HfIDV0xQC6 RT @shivon: New interview question: “You’re stuck on a deserted island with nothing but stones... what’s the fastest way to escape?” https:… RT @NBedera: I'm a sociologist who studies adolescent sexual violence. In this thread, I offer the basic facts everyone should know about s… @openreviewnet Thanks for the info! Hope the servers hold up under demand tomorrow :) 🤞 RT @openreviewnet: @Miles_Brundage For iclr2019, anonymized version of all the submissions will be displayed on openreview soon after the s… RT @karinavold: While there are good reasons for pursuing ethical machines, including the ethical alignment of humans and machines, there a… @Zergylord https://t.co/XKYSFUEulN RT @pinkhairedcyn: I feel like Grace Hopper gives men a valuable opportunity to understand how women feel at every other tech conference, s… I can't say I didn't warn myself. Also also me: https://t.co/0ZmC1109ss Me: I've just gotta run this workshop. Also (past) me sending a message to my future self: https://t.co/kRvSNIE9ee RT @dog_rates: This is Bender. He’s on his way home for the first time. Hopes you have good snacks. 12/10 would give him anything he wants… @trekonomics They have - at least two, in fact - https://t.co/yjqPs3zGKP and https://t.co/GlRzoHaL00 @andrey_kurenkov @OpenAI I’m very confident it will be tried at some point by someone :) "Low Precision Policy Distillation with Application to Low-Power, Real-time Sensation-Cognition-Action Loop with Neuromorphic Computing," Mckinstry et al.: https://t.co/raMNb266Kq @andrey_kurenkov @OpenAI I'm not on the Dota team, but I see what they're doing as (in part) proving a point re: simple methods. Sure, you could do hierarchical RL, but could also make the arg for a specific for curriculum, encoding more knowledge, etc. - if PPO does/doesn't work that'd be v interesting "Floyd-Warshall Reinforcement Learning Learning from Past Experiences to Reach New Goals," Dhiman et al.: https://t.co/J1U97UyY9y "S-RL Toolbox: Environments, Datasets and Evaluation Metrics for State Representation Learning," Raffin et al.: https://t.co/GicpwYfTLY "A Survey of Learning Causality with Data: Problems and Methods," Guo et al.: https://t.co/ts8RjQU3p7 "No Multiplication? No Floating Point? No Problem! Training Networks for Efficient Inference," Baluja et al.: https://t.co/6lrTLChnoq "HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering," Yang, Qi, and Zhang et al.: https://t.co/73UtRnv5Qg "Better Safe than Sorry: Evidence Accumulation Allows for Safe Reinforcement Learning," Agarwal and V et al.: https://t.co/QOu9lALLIh "Hierarchical Deep Multiagent Reinforcement Learning," Tang et al.: https://t.co/mS7GoNogK6 "On Reinforcement Learning for Full-length Game of StarCraft," Pang et al.: https://t.co/gMaOypZ9bX @timhwang also, humans 🧐✍️ "RT @politico: Trump bragged about his presidency at #UNGA and world leaders laughed. “I didn't expect that reaction, but that's okay”: htt…" @tarinziyaee good food, good weather, lots of activity in areas I'm interested in (e.g. AI). @MrMeritology not yet but on my radar @AggieInCA good food, good weather, lots of activity in areas I'm interested in (e.g. AI). I like the Bay Area. Convoluted neural networks for generative muddling "Constrained Exploration and Recovery from Experience Shaping," Pham et al.: https://t.co/Pn8S6gLc4d "Semi-Supervised Sequence Modeling with Cross-View Training," Clark et al.: https://t.co/raU5YbjsNG """Close to Human Quality TTS with Transformer,"" Li et al.: https://t.co/DdScRqSRY0 The Transformer conquest continues" "Learning to Read by Spelling: Towards Unsupervised Text Recognition," Gupta et al.: https://t.co/Ec8vvJbG3N RT @open_phil: Applications are now open for our second annual AI Fellows Program to support promising PhD students in #ai and #MachineLear… "Interpretable Multi-Objective Reinforcement Learning through Policy Orchestration," Noothigattu et al.: https://t.co/WgeycgJfid RT @2plus2make5: Hopefully I won't regret writing this, but it was a long week: "We get tired of arguing with you" https://t.co/XuQA4MWahC @paulboardman it gets *really good* RT @kchonyc: close enough! https://t.co/FUCPs4KnvU RT @katecrawford: LITIGATING ALGORITHMS is out today: our report on the current court cases about algorithmic decision making. We convened… @BenedictEvans Sounds like Goodhart’s Law RT @DanitGal: #Israel's Intelligent Systems Initiative to create a national strategic plan is a go with 200+ local volunteer experts. The i… RT @Julian_Epp: [slips the DJ $20] Do you have any podcasts @jeffclune @togelius Huge fan of the series! Second is my fave but I recommend all three. @erfannoury It’s pretty even across countries/time periods (Nazi Germany, USSR, India, South Africa, NK, Iran) so only a bit of Iran, and like a decade old now @g_axler Pretty good! Only two chapters in though. @alexleavitt I have read them all :) RT @onekade: “Teenagers across the country said in interviews that they were disturbed to see so many adults dismissing the accusations aga… @souravstat The one on top, in the middle of it now. I’m more optimistic about international relations than him but he states his case very well/clearly. As a general rule, I think it's good to read books you expect to disagree with. Otherwise what's the point? Low information/conceptual clarity gained. One might not think from my reading list that I’m an optimist, but I am :) https://t.co/tu1rmqIj1T "RT @c_cauterucci: #whyididntreport and #metoo aren’t for converting skeptics. They’re online consciousness-raising sessions. https://t.co/…" "RT @clementine_ford: ""Why don't women report?"" *woman reports* ""Why isn't there more than one woman with a story about this guy?"" *anoth…" "Ad hoc Teamwork and Moral Feedback as a Framework for Safe Agent Behavior," Alkoby et al.: https://t.co/kT7gIO498k "Solving Large Extensive-Form Games with Strategy Constraints," Davis et al.: https://t.co/xtW3kHTad9 "Efficient Formal Safety Analysis of Neural Networks," Wang et al.: https://t.co/BNvwFyiSxO "Learning Quickly to Plan Quickly Using Modular Meta-Learning," Chitnis et al.: https://t.co/2beveaYuwq "Playing the Game of Universal Adversarial Perturbations," Perolat et al.: https://t.co/rOBQEZa47V Academia has many advantages over industry, but travel reimbursement speed/easiness is not one of them. @nancyleong I lol’d @globalistgraham @calebwatney Get on it! @Liv_Boeree I’ll have to reread cuz I remember 2 being my fave, but at least we can agree one should read all of em :) @togelius Yes, I think one should read all of them. But I focus on getting people from 1->2, seems like there is a bit of an epicness discontinuity there. Don’t think I’ve run into someone who stopped after 2 yet but many who stopped after 1. Seems like a fair amount of people read the first book in the Three Body Problem trilogy, then stop. Don’t miss the second one!!! https://t.co/9FBHkMxAN7 RT @iamwandasykes: Yep! And I sent him some money so he can take your job in November. @BetoORourke https://t.co/MGUyTVu4BA Obama (2005) on the Supreme Court: https://t.co/TfGNj23TZT @RikeFranke 💫 🌟 ⭐️ RT @kenklippenstein: https://t.co/OdQ12CEawa RT @GoAbiAryan: "That's been one of my mantras - focus and simplicity. Simple can be harder than complex: You have to work hard to get your… @sknthla DeepMind's 2013 pre-Google "Playing Atari with Deep Reinforcement Learning" @zacharylipton I do! In any case, the next 2 weeks will be lit. So, ICLR is still using OpenReview, but submissions won't be displayed until the deadline has passed...so that there is no dispute about whether things should have been cited, or something? Normally at this point there would be at least a few submissions displayed on OpenReview. RT @ArianaGrande: everything will be okay @IgorCarron there are many lessons learned, and yes, they are mixed @rodolfor @LukeB42 @halhod @j2bryson @KoriSchake I meant that there are vastly more technologies being developed, or imagined, than there are deployed technologies. RT @FilippaLentzos: https://t.co/WUnKMZV6a5 @rodolfor @halhod @j2bryson @KoriSchake Sometimes longer! But fortunately we're in the early stages of military uses of AI. Better to think seriously about the possibilities sooner rather than later. @mchorowitz Agree political will is key. I think it's plausible (v uncertain) that some technical tricks could alleviate the protecting-sensitive-info/verification tradeoff (e.g. zero knowledge proofs, + some stuff in progress :) )...but even there there will be some risks + need for buy-in. @kaznatcheev @mathbabedotorg @Aelkus @realjoshkroll Yep that's the one. There are several relevant literatures here (arms control, crypto, AI...) that aren't super well integrated, but I do like that paper and it's pretty accessible. @mchorowitz Possible that scaled up work on this will go nowhere, but I think it's important to keep the discrepancy in mind. @mchorowitz I heard it verbatim just yesterday more than once, but yes, there are better/worse versions. I think my point re: not giving up prematurely applies to better versions, too, though - compare ~1-100 person-years of effort on this to many 1000s of person-years on nuke verification. @kaznatcheev @mathbabedotorg @Aelkus Yeah, my comments were in response to writings/discussions about military uses of AI, but some of the more interesting and inspirational ideas I've seen to date in this line of thinking come from people concerned about domestic uses of software, e.g. @realjoshkroll et al. 2017. P.S. This point is often made as a prelude to a point I do agree with, that we should explore norms, dialogue, etc. That's good stuff + should be explored, but we can also, in parallel, see what the landscape of formal controls might look like (one of my main projects this year). Third, and related to the last point, it was not obvious e.g. early in the Cold War that we would come up with scalable radiation detection, good satellites, mutually acceptable on-site inspection protocols, etc. so let's not give up here before actually digging into the issue. Second, software does not = unaccountable (though it does enable fast proliferation). We have some ways, esp. w/ cryptography, of ensuring people are doing what they say they're doing with software. How best to do this in AI isn't super clear but it's def. too early to give up. First, AI is not *just* software. That's a big part of it, but it's also about talented (physical) people, (physical) computing power (in increasingly large quantities https://t.co/oZnA41S4JC), and (physical) effectors like robots, which can at least in some cases be monitored. An idea I've seen pop up in various publications and workshops lately: "AI is software, therefore AI-related arms control is impossible." This is a problematic meme for a number of reasons... "RT @patrickshafto: Computer Science at @RutgersSASN is hiring: 1) CS + Philosophy: Data, AI + Ethics / social / political implications. ht…" (I see the doc itself emphasises that it isn’t comprehensive, and of course no long-term agenda is literally comprehensive, so I will revise that to “detailed” :P ) Useful and comprehensive agenda for AI governance research by @FHIOxford colleague, with particular focus on int’l security implications, forecasting needs, and a few other areas. https://t.co/NPjEKFquJK RT @gdb: Have been making serious progress on OpenAI Five. Looking for Dota teams with average MMR 6.5k+ or Tier 3 and higher to test the l… @rivatez Hopefully you will end your 200s knowing you know some things @iandanforth yup "Benchmarking Reinforcement Learning Algorithms on Real-World Robots," Mahmood et al.: https://t.co/6SXVMuAHbT RT @gdb: Lots of cool projects being presented tonight at OpenAI Scholars Demo Day (https://t.co/WjUCRXBz31). Really impressed with the pro… @HMRoff :( sorry. I had 2 hr one time and didn’t think it got much worse, gosh. RT @ankurhandos: calm before the storm. https://t.co/C7C7shB43v RT @sim2realAIorg: Zero-shot Sim-to-Real Transfer with Modular Priors https://t.co/2nDVdcyFWj https://t.co/vQML9D5zqi RT @L_badikho: You might think that interrupting artificial intelligence is as easy as "switching off its electric power", as some academic… RT @NicolasPapernot: The program committee is up for our workshop on security in ML at NIPS 2018. Thanks to everyone who agreed to serve on… @erfannoury I use the website itself "TStarBots: Defeating the Cheating Level Builtin AI in StarCraft II in the Full Game," Sun, Sun, Han, and Xiong et al., Tencent/Rochester/Northwestern: https://t.co/m5jVUi32kk @ivenzor @__lucab @naz_erkan @rabarretom @OpenAI We didnt get around to doing a serious analysis sadly :) RT @RichardSocher: Super excited to announce Einstein Voice Assistant. AI, natural language processing and speech recognition will change h… Thanks @naz_erkan, @__lucab, and @rabarretom for hosting me! Very interesting discussions. https://t.co/9eG6RnWLlG RT @naz_erkan: Today @Miles_Brundage from @OpenAI gave a thought provoking talk on “Accountable AI institutions” as part of @Twitter ‘s Fai… @__lucab @Twitter @OpenAI we'll see! @shivon I'd like to collect my points, please @AdrianBPatter I did not even consider that possobiliyh and chose poorly @tkasasagi I sat in the barbershop for 45 mins waiting for a haircut. Meanwhile the barber assumed that I knew that it was appointment-only, which I eventually found out, and they had no appointments in the near future. Breaking: I am not a Dota savant. @solmri Wish I had tried that one! :) RT @hypatiadotca: It’s been a while since I tweeted this out, but when I was at ACLU I wrote up a guide to battening down the hatches befor… @piccibiker Dunno Apparently, one does not simply walk into a barbershop to get a haircut in SF. https://t.co/A1ybBsMkPs "Visual Diagnostics for Deep Reinforcement Learning Policy Development," Luo and Green et al.: https://t.co/xr6ohlDDsj RT @jmcbee01: Thanks to ⁦@kate_manne⁩ we have a handy word for this revolting but entirely predictable sentiment: himpathy. https://t.co/U… RT @dog_rates: This is Muffin. She just arrived. Expedited shipping from the good girl factory. Batteries not included. 12/10 welcome home… RT @carolinesinders: Let me ma'amsplain that for you "@rcalo Also, bring back OTA!* Office of Tea Assessment" @rcalo Did you change your proposed name to FAIR vs. FAR at some point? Cuz I'm very down for that if so :D "RT @ch402: I'm very excited to be speaking at @MIT_CSAIL tomorrow! Talk at 1pm. I'll be discussing some of what I've learned in five years…" @GoAbiAryan 🤔🤔🤔 @GoAbiAryan Old news :P @Smerity I think April 1(ish) gets a pass, not sure if I have a year-round policy @Smerity https://t.co/FGJCkjm2DN "Towards Better Interpretability in Deep Q-Networks," Annasamy and Sycara: https://t.co/2Rm2tInZ2v "Deterministic Implementations for Reproducibility in Deep Reinforcement Learning," Nagarajan et al.: https://t.co/mmNF5kNUz8 Abi has been doing some 💯 arXiv tweetstorms lately: https://t.co/Bo9BGxSpLH RT @susie_c: This story is a little nesting doll set of society's failings. https://t.co/HWUfUwFPfn RT @webdevMason: It's happeninggggg https://t.co/LvgjakHgMu "Money on: Bezos? Himself? Other?" "Transparency and Explanation in Deep Reinforcement Learning Neural Networks," Iyer et al.: https://t.co/WBqtGKLQ2p """Inspiration Learning through Preferences,"" Baram and Mannor: https://t.co/N8X9qvZEem Re: transfer across diff. action spaces" on so many levels sorry Jordan Phoebeson https://t.co/3oBe3EpiG6 RT @pabbeel: Model-based RL, while sample-efficient, often doesn't match performance of model-free RL. Model-based RL via Meta-Policy Opti… @MitchellEckert @SangerNYT Thanks! @MitchellEckert @SangerNYT Nope! @MitchellEckert Pretty good! Some areas are more basic/introductory than others, so someone with a bit of famiarity with his work/the area generally may want to skim some sections...but makes some good points and pretty well written Someone is paying to fly around the moon. https://t.co/vEA5JQOera "Negative Update Intervals in Deep Multi-Agent Reinforcement Learning," Palmer et al.: https://t.co/hBqFeD2c1k "CM3: Cooperative Multi-goal Multi-stage Multi-agent Reinforcement Learning," Yang et al.: https://t.co/bPitI4Mpuc "Model-Based Reinforcement Learning via Meta-Policy Optimization," Clavera and Rothfuss et al.: https://t.co/PB4AfrGmJK It’s Security Sunday! Also, Sunny Sunday. https://t.co/9XD2zILQAz @webdevMason (maybe too simple for them, though, depends on the person) @webdevMason Scratch for visual programming @XandaSchofield Mind blown @mchorowitz @RebeccaCrootof @timhwang Was it a deepfake? Doesn’t give any indication in article @deliprao 😍 RT @JeffDean: A reminder that some people in our field are alienating our female colleagues by flirting in settings that are meant to be pr… RT @ellenhuet: "Sources familiar with Dragonfly said the search platform also appeared to have been tailored to replace weather and air pol… RT @egrefen: Highly recommended potential PhD students to consider Tim Rocktaschel's (@_rockt) new group at @UCLCS, and @UCLMR in general.… "RT @m_sendhil: We want algorithms that are simple and interpretable. We want algorithms that are fair A paper with Jon Kleinberg that sh…" RT @willmacaskill: “The scientific and industrial revolutions transformed both our understanding of the world and our ability to alter it.… RT @willis_cj: after eatin a Nature Valley granola bar https://t.co/H6enLMU4Nv https://t.co/8rm8IxhUrO (Its name was Lucky and it was friendly) I approve of this dog placement. https://t.co/glVEtjOXNB @AnimaAnandkumar @nvidia @Caltech Congrats to you and to NVIDIA! :) RT @AnimaAnandkumar: I will be joining @nvidia as director of #ML #research and #hiring #ML #researchers and #engineers while also continui… RT @themadstone: nothing like claiming an official hurricane death toll estimate was fabricated for political purposes on the morning of an… @tdietterich @Noahpinion He's not referring to game theory - this is the paper that makes those claims FWIW (I haven't evaluated them): https://t.co/m2EDDfOzLu @iandanforth @OpenAI I have no hot takes to give but maybe @machinaut does :) "Sequential Coordination of Deep Models for Learning Visual Arithmetic," Crawford et al.: https://t.co/g3qXQvNDt6 "Sim-to-Real Transfer Learning using Robustified Controllers in Robotic Tasks involving Complex Dynamics," van Baar et al.: https://t.co/rtLB7ZB9kT "Automatic Program Synthesis of Long Programs with a Learned Garbage Collector," Zohar and Wolf: https://t.co/S11E4nnVwn RT @RichardSocher: My keynote about the future of natural language process, #deeplearning, multitask learning and https://t.co/NV7H5FQaer… @GoAbiAryan @decodyng Yass two of my fave ML ppl in one tweet 👍 RT @GoAbiAryan: If you are finding the language of ML papers intimidating (you're not alone), check out the summaries by Cody @decodyng - s… RT @mike_conley: https://t.co/IbhQgWRzzr RT @DeepMindAI: PopArt: a single agent that can play 57 diverse Atari video games, with above-human median performance across the set https… RT @shakir_za: See this thread. Dave Silver gave us a great gift at @DeepIndaba. He spoke, for the first time 😻, about his 10 Principles of… @marcosalvi and more generally, would be good to meet them :) (I just moved 2 weeks ago) @marcosalvi In this case, they’re not massively lopsided IMO (though I’m maybe biased): to bring out the bins, you have to move more mass, but the mechanics are more natural (pull up stairs from top without risking head), bringing back in = less mass/less natural (duck head bc low ceiling) @sidneyfussell Which one? cc @rbhar90 "A Cryptographic Escrow for Treaty Declarations and Step-by-Step Verification," Philippe, Glaser, and @EdFelten: https://t.co/mNUZ57qYkm RT @nottombrown: Astonishingly, no known machine learning system can reliably tell a *bird* from a *bicycle* when there’s an adversary invo… RT @rj_gallagher: NEW: Senior Google scientist resigns over plan to launch censored search engine in China. "I view our intent to capitulat… RT @mark_riedl: .@salesforce is actively recruiting research scientists to work in #AI4good https://t.co/bdi6Sg8joe @guillefix @unsorsodicorda @samim @hardmaru @dribnet are examples of folks who tweet about AI/art intersections - many more! @azeem I moved to the US so cancelled my UK # :) @unsorsodicorda Yep! @rishmishra It happened on the first garbage day of our time at the house. It may have been already been going on before we moved in with different people, or it started that day. @rishmishra Yeah that’s what happened. RIP my UK phone number. Made me feel pretty cool/cultured TBH. RT @hardmaru: Check out the samples of generated music using the new “Relative Transformer” model. My favourite ones are the “Piano-e-Compe… @GoAbiAryan (and included my two faves for the day, the multi-task DRL one and the abstraction/RL one) @GoAbiAryan also lots of overlap with actual Brundage Bot https://t.co/9ZWbC2HcyY @andrey_kurenkov and yeah I might have misconstrued/pattern-matched to what I see as a common pattern of ppl dismissing achievements on all Atari games, pointing to Montezuma as the real challenge, then ignoring good results on it :P @andrey_kurenkov Dunno. TBH it's a bit frustrating that even within DM, they use different ways of presenting their results across teams. But I'm nevertheless generally impressed with the extent of progress since 2013/2015. @GoAbiAryan Abi Bot seems highly correlated with Brundage Bot! @andrey_kurenkov all of that's fair! @andrey_kurenkov People have done that - capping at 100%, dividing into sparse/dense rewards, etc. and the result is the same - progress has happened. If you're saying that we shouldn't care a ton about dense reward/otherwise easy games, sure, I agree, but median reflects more than that @andrey_kurenkov median across many single-task agents <100% (2015) --> median for a multi-task agent >100%, and single-task agent medians >>100% represents progress. Again, you can say you don't care about Atari but by any reasonable metric there has been improvement over DQN. RT @JensenClan88: I can’t believe these two have had the same job. https://t.co/RZxWUf6PWA I guess the latest one (Transformer-based) isn't an RNN, don't kill me "I'm gonna stop tweeting about cool RNN music stuff, but suffice it to say there's a lot and the samples are getting good (this is like the 10th such category of things I'm having to tune out on arXiv...another is deep learning for medical image classification for disease X)" "Rapid Training of Very Large Ensembles of Diverse Neural Networks," Wasay et al.: https://t.co/gMrXFLleVT "Optimization with Non-Differentiable Constraints with Applications to Fairness, Recall, Churn, and Other Goals," Cotter et al.: https://t.co/OAPBfelib9 "Searching for Efficient Multi-Scale Architectures for Dense Image Prediction," Chen et al.: https://t.co/bVB3ZFg3j7 "Simplicity Creates Inequity: Implications for Fairness, Stereotypes, and Interpretability," Kleinberg and Mullainathan: https://t.co/mY3mw3UXiW RT @VinFL: I’m very happy to share my recent work on combining model-free and model-based approaches via abstract representations in deep R… RT @hardmaru: The markets can be very unforgiving 💸 https://t.co/iggG4mJKaz @andrey_kurenkov (and some are very non-Pong-like with e.g. sparse rewards) @andrey_kurenkov Dunno, I thought affiliations were allowed on AAAI papers... disagree re: Atari. You can say it's "too easy" but there has been progress. It wasn't long ago that there were very few games that we had superhuman performance on. Easy to take for granted now! @davegershgorn Same Cc @juliagalef Tit-for-tat in the wild: our neighbors take out both of our recycling bins, we bring them back in. None of this has been explicitly discussed AFAIK. One could defect and only take out/bring in one’s own stuff but that would jeopardize the implicit cooperation. "Combined Reinforcement Learning via Abstract Representations," Francois-Lavet et al.: https://t.co/hFaxzHgkLh """Multi-task Deep Reinforcement Learning with PopArt,"" Hessel et al.: https://t.co/lQomgcMXOC Single multi-task net with >100% median performance on Atari (among other results)" @webdevMason It gets better! @davegershgorn I'm scared RT @carpedm20: Excited to be joining the games team at @OpenAI today! https://t.co/YUYk7BISic @calebwatney 🧐 @theAlexLavin Go to Mars Gonna stop tweeting Alibaba's deep (reinforcement) learning for e-commerce stuff unless it's outstandingly interesting/novel - more today. Suffice it to say there's a lot "Factorized Q-Learning for Large-Scale Multi-Agent Systems," Chen et al.: https://t.co/04uIL9artW Framing seemed very hypey but on a skim, the content seemed potentially interesting "Abstraction Learning," Deng et al.: https://t.co/B7DHxuskSi "Solving Imperfect-Information Games via Discounted Regret Minimization," @polynoamial and Sandholm: https://t.co/vYHedsljV2 "PRIMAL: Pathfinding via Reinforcement and Imitation Multi-Agent Learning," Sartoretti et al.: https://t.co/Pq4QnDwU3d "Sparse Attentive Backtracking: Temporal CreditAssignment Through Reminding," Ke et al.: https://t.co/ZHHS7Cyb7Z "Massively Parallel Dynamic Programming on Trees," Bateni et al.: https://t.co/6XyvIJZ9Fk "VPE: Variational Policy Embedding for Transfer Reinforcement Learning," Arnekvist et al.: https://t.co/8OJ0p9Vo64 @caitlinsurakit Bose Quiet Comfort 35, for $200-400 price range, Beats if lower (similarish sound quality but generally lower quality design, esp for folding), dunno about higher RT @gdb: (Also, "at scale" is a very relative term. After two doublings, our latest Five model is 4096-units, and consumes roughly the same… RT @gdb: A good analysis of the embeddings we use in the OpenAI Five model: https://t.co/Dx9ZseZYhx. After analyzing the rest of the model,… Wide-ranging interview on ethics with my brilliant colleague @AmandaAskell: https://t.co/JMl7SK6dk0 @victimNvillain If u shoot me an email with more context I could maybe say some stuff (and see also this, slightly dated but still largely relevant I think https://t.co/ivoC1YnOvw) @victimNvillain Really depends on your interests, the program, intended job, etc! Master’s in public policy or similar can be good, also econ...also some specific ones like science and tech policy. Though more (phd) or less (just work now or do informal sabbatical then work) also can make sense, @timhwang I lold RT @Lyndsey360: Thanks for the article, @BuzzFeed! ☺️ https://t.co/y1I5IYw0ig I was a bit worried when I wrote a career guide for AI policy 2 years ago that I might contribute to a bubble/overstate the opportunities in the area, but it seems like demand will continue to outstrip supply for at least a while longer. https://t.co/8614VmHPA4 "RT @PrescottRossi: The best thing I saw yesterday? This guy from the Baltimore Ravens Marching Band playing PERFECT air drums to Rush's ""T…" RT @jackclarkSF: I think one of the only 'arms races' AI people are excited about is the emerging competition between AI research labs to s… @jjvincent Well, on that Black Mirror episode, she did have really good toast. @unsorsodicorda @amazon Np! @unsorsodicorda Check out Google Scholar, can search by e.g. @amazon.com RT @awjuliani: It took a little while, but if you use Unity and/or ML-Agents for research, we've finally got something for you to cite! In… @unsorsodicorda Lots of Amazon papers but dunno about AWS @ankurhandos I mean, it’s definitely a play on “keep it simple, stupid” but I don’t know how deep the stupid joke meta goes @ankurhandos lol yeah I was going to do a quick summary but ironically wasn't able to quickly come up with a stupidly simple one :P "Expert-augmented actor-critic for ViZDoom and Montezumas Revenge," Garmulewicz et al.: https://t.co/lsSxL3qooQ "Keep it stupid simple," Peterson et al.: https://t.co/zwlzP32Z9f "Unity: A General Platform for Intelligent Agents," @awjuliani et al.: https://t.co/xnl8BlsjXj "Addressing Sample Inefficiency and Reward Bias in Inverse Reinforcement Learning," Kostrikov et al.: https://t.co/Em8WS7v7GS "Variance Reduction in Monte Carlo Counterfactual Regret Minimization (VR-MCCFR) for Extensive Form Games using Baselines," Schmid et al.: https://t.co/ZjLpPNIeXf (there was another one today) """Learning to Advertise with Adaptive Exposure via Constrained Two-Level Reinforcement Learning,"" Wang et al.: https://t.co/eXDT2yyHUW Alibaba's nth paper on RL for advertising/e-commerce" "Jointly Learning to See, Ask, and GuessWhat," Venkatesh et al.: https://t.co/1URETBydTg "Active Inverse Reward Design," @sorenmind et al.: https://t.co/X6tLbnAd6K @ankurhandos @BrundageBot You spoke a minute too soon It's Multiagent Monday! @GoAbiAryan @FredrikSewell @CHTOfficial Is the new season out??? @XandaSchofield Yay! Great job! :) So now that the hubbub has died down a bit... who all is going to NIPS? Will it be fake news this year, or will reserved tickets for authors suffice to keep it real? @marnovo @jeffbigham Thanks! This is helpful. @marnovo @jeffbigham Not super familiar RT @hollygrimm: Here are the final projects of all @OpenAI Scholars and the great things they'll be doing next! @mcleavey @ahandvanish @ian… RT @NicolasPapernot: The census bureau on difficulties with deploying differential privacy: https://t.co/OsLUqgfyga "With skilled staff an… RT @jm_alexia: My "first" AI paper is officially released on ArXiv! (I wrote this before the relativistic GAN paper). It explains that the… @doomie The weather actually is great! :) RT @OpenAI: Neural waltzes, semantic trees, CycleGANs, and more - details on OpenAI Scholars' 2018 Final Projects: https://t.co/rPxQWCj5Ff… @HeidyKhlaaf @OpenAI Thanks!! :) @marnovo @jeffbigham Would be interested in your reasoning @nsaphra Not yet; never RT @adversariel: Excellent discussion about using differential privacy for actual situations beyond university whiteboards. Despite deploym… "Improving On-policy Learning with Statistical Reward Accumulation," Deng et al.: https://t.co/zZCz4fanhW "Learning Invariances for Policy Generalization," Tachet des Combes et al.: https://t.co/CQFiUZ6g57 "Monte Carlo Tree Search with Scalable Simulation Periods for Continuously Running Tasks," Ba et al.: https://t.co/BsknRzXW1y "Issues Encountered Deploying Differential Privacy," Garfinkel et al.: https://t.co/t1Jn20vVEC RT @gdb: Very cool to see the excitement from the /r/Dota2 community about Five playing an unrestricted Dota 2 match — currently #1 on /r/D… @GoAbiAryan 🙃 RT @caseyjohnston: i love netflix’s new layout, “scroll carefully because the little title cards are autoplay video lava" @zacharylipton Oh! And lots of x-GANs @jeffbigham More generally, a blanket pessimism may be better than another similarly simple policy, but I’d hope we can do better w more complex model, bc impacts of false negatives can be big (less preparedness). @jeffbigham And yes, not perfect by any stretch, just a case where lots of data + very simple models worked (to some ppl) surprisingly well. @jeffbigham Yeah I think the mean AI person prob underestimated the rapid spurt of progress in captioning in 2015/2016, doesn’t mean it’s solved. Re: MT, the people who weren’t working on neural methods made a wrong implicit bet, and the fact that unsupervised NMT works is still wild to me. @jeffbigham Perhaps image-to-text (not solved, but seems like many ppl were surprised by 2015 developments), Go, 5v5 Dota 2 (/I suspect soon - Starcraft), machine translation? @zacharylipton I'm sure I made mistakes in non-DRL areas, too, but that's just the area I'm most familiar with and can recall way more instances of thinking a paper was important than actually seeing anything materialize based on it down the road. @zacharylipton Just as one very specific example, the Rainbow paper showed that dueling networks didn't matter all that much. @zacharylipton Basically all new deep RL tricks of the past few years - very few have stood the test of time or were really needed when scale was an option (e.g. PPO + reward shaping + scale for Dota). Some will find uses, of course, but I have fallen for a lot of false positives. (have also gotten some things right but will leave those out so as to avoid giving an overly rosy view - more interested in mistakes at the moment :) ) I already analyzed my explicit 2017 AI forecasts, but have also been wrong about various implicit things. Some oopsies of the past 5 years: buying driverless car hype, underestimating China + the value of compute/data scaling, overestimating a lot of algorithmic innovations. You? RT @L_badikho: Super happy to register for the #NIPS2018 coffee-mug ! 🎉 https://t.co/MyavqHuKhC @hlntnr @fhuszar @__lucab I guess China has some food too though @hlntnr @fhuszar @__lucab See, this is why you need to come back pronto! I didn't know it was nearby; I just have been the beneficiary of magically appearing bread. @fhuszar @__lucab Someone brings Tartine to the office and it’s 💯 Also, OpenAI has a comfy hoodie Took me about 6 days to become that guy in SF who always wears his org's hoodie. In my defense, it's weather-appropriate, and I was already the guy who always wears *some* hoodie. Next stop: sourdough? RT @jbillinson: I guess sometimes it’s a meltdown and other times it’s just arguing a strike 🤷🏻‍♂️ https://t.co/I3ZyxBMzGT "RT @StefanodocSM: It's really a wonderful day for this nice boy … 🐶 thanks to the prosthesis, he can walk again !! 👏🏼🤗 https://t.co/pVvHEIv…" @lcmgcd Not sure tbh. Cc @calebwatney @GoAbiAryan @NipsConference that would be too reasonable 🙄 @AnthroPunk There isn't really one agreed upon metric, but my general sense from a few of them (e.g. based on % of acceptances at top conferences, most cited papers, etc.), US is ahead of others, but less impressive per-capita compared to Canada, which def. punches above weight. @k1ug3 They do fund PhD students (at least indirectly via grants to profs, not sure about explicit student fellowships/stand alone grants)...it's complicated re: non-citizens. In many cases legal residents can work on US govt grants @zacharylipton Yup, even if off by two orders of mag., still a drop in the bucket of the US govt budget (And to be clear, obviously $2 billion has non-zero significance, but it is certainly not all that matters) ⬇️⬇️ It’s not complex or expensive, but politically impossible RN due to immigration hysteria. As a result, policymakers/others must beat around the bush and pretend like a new $2 billion DARPA program is what matters. https://t.co/VbBpw5JB1C "RT @puiwingtam: Alibaba’s Jack Ma tells @LiYuan6 that he plans to step down on Monday and pursue philanthropy in education https://t.co/AAp…" @MargotKaminski @harlanyu @Matt_Cagle @pasternack @barryfriedman1 @the_zeroth_law @EvanSelinger @MikeWagers But per original point from Margot, IMO NDAs make sense 1. when only pertaining to proprietary info, 2. when additional access gained can plausibly be put to good use (e.g. influencing product design) and 3. when no other strings attached (no limit on discussion of public things) RT @katecrawford: Thrilled to launch a big project today: ANATOMY OF AN AI SYSTEM. It's a large map & long-form essay about Amazon's Echo,… @MargotKaminski @harlanyu @Matt_Cagle @pasternack @barryfriedman1 @the_zeroth_law @EvanSelinger @MikeWagers (Also, processes for board member selection, voting processes, etc. would be good to see more engagement on/sharing of best practices) @MargotKaminski @harlanyu @Matt_Cagle @pasternack @barryfriedman1 @the_zeroth_law @EvanSelinger @MikeWagers Have heard anti-NDA args but *if* one is going to do one, this seemed pretty vanilla. Process-wise, stuff like this (operating principles) is what I’d hope for wider engagement on, and of course the substance of what Axon should/shouldn’t do https://t.co/ISSPk5hwGz (2/2) @MargotKaminski @harlanyu @Matt_Cagle @pasternack @barryfriedman1 @the_zeroth_law Cc @EvanSelinger who expressed interest in such things... yeah, seems potentially useful/would be fine with me personally though not sure if I could do so unilaterally (cc @MikeWagers). In any case I’d be surprised if people found a lot to disagree with there... (1/2) @harlanyu @Matt_Cagle @pasternack @MargotKaminski @barryfriedman1 @the_zeroth_law And more generally, truthfully answer any Qs I am posed...AFAIK I have done so to date. Only formal constraint is not violating proprietary info-specific NDA, which I don’t see as a big problem for commenting on policy disagreements @harlanyu @Matt_Cagle @pasternack @MargotKaminski @barryfriedman1 @the_zeroth_law Of course - I will be open about cases in which I disagree with either the company’s or other board members’ statements/actions @togelius !!!!👀!!!!! "RT @evchels: Let’s not pretend that Mary Barra, or any female CEO, would get away with a fraction of what Elon has. https://t.co/j7WQLOOt…" RT @ajmooch: This new Schmidhuber&Schmidhuber paper is 🔥🔥🔥 https://t.co/8N3ckGDfZ0 RT @TheDweck: Elon Musk is such an innovator he created a way to look lame smoking a blunt https://t.co/dM7Ndd99QA @SmithaMilli :) @hardmaru @OpenAI thanks!! :) "Training Millions of Personalized Dialogue Agents," Mazaré et al.: https://t.co/gPXVLI56gz RT @dog_rates: This is Biggins, a rare elevated corgo. He only tolerates getting his nails cut when he thinks he’s flying. 14/10 good boy B… "Sample-Efficient Imitation Learning via Generative Adversarial Nets," Blondé and Kalousis: https://t.co/y6SoDs63MU On a non-emoji note, though, I'm a big fan of David's consistently creative work, and he's a super nice guy to boot. :) Congrats @hardmaru! "How to Combine Tree-Search Methods in Reinforcement Learning," Efroni et al.: https://t.co/SPszxRS3pQ @ankurhandos it's true 😍 https://t.co/Faez539vyA "ARCHER: Aggressive Rewards to Counter bias in Hindsight Experience Replay," Lanka and Wu: https://t.co/bZqfHsHjvZ RT @hardmaru: An eight-page version of our work, “Recurrent World Models Facilitate Policy Evolution” has been accepted as an oral presenta… "RT @OpenAI: 1. Double model size 2. Initialize from old parameters 3. 10 additional days of training Result: 80% win rate versus model tha…" "Interpretation of Natural Language Rules in Conversational Machine Reading," Saeidi, Bartolo, and Lewis et al.: https://t.co/wpL8e9TbpY "Reinforcement Learning under Threats," Gallego et al.: https://t.co/ycRQARtDut "🎇😍😍🚨🚨🚨😍😍🎇 https://t.co/56Dxoqgdwz" "Super excited about some stuff we're cooking up at OpenAI! :) Also, I need to get started on this 🔽 if I am to stay on schedule - let me know if you are around and interested in coffee at some point! https://t.co/zm8HQfE52a" RT @cbquist: we go now live to our infectious disease reporter on the scene, Vanilla Ice https://t.co/UCYmCJklRJ RT @GoogleAI: Introducing Conceptual Captions, a new dataset and challenge for image captioning consisting of ~3.3 million image/caption pa… RT @normative: Even in the most bizarre administration ever, this is pretty extraordinary. I can’t imagine anything remotely like this hap… RT @elongreen: This, from October 2015, is one of the great tweets of all time. https://t.co/4dAN01WDCg @chipro Hear* @chipro Sorry to her :( thanks for sharing your story though. Long way to go indeed!! RT @IACR_News: #Event PPML'18: Privacy Preserving Machine Learning - NIPS 2018 Workshop: Montréal, Canada, 8 December 2018 https://t.co/sMw… RT @gg1729: "We first compare our framework with other recent image translation architectures on the real-to-anime face translation task."… """Twin-GAN -- Unpaired Cross-Domain Image Translation with Weight-Sharing GANs,"" Jerry Li: https://t.co/RfyFLGx64H Come for the buzzwords, stay for turning Emma Watson into anime and cats" @_NicT_ Dunno, will check out blog post when I get a chance @bobbyob_ Not sure when yet but at some point! RT @hannawallach: Faster than this year's Burning Man, but still not as fast as a Beyonce concert! Maybe next year... https://t.co/SeY9HmAD… RT @catherineols: SOCML is one of the absolute best conference experiences - not just a comfortable and open atmosphere, but actually a *ge… @v_maini https://t.co/tVfFK0uwcJ Fun first day at the OpenAI office! :) RT @hlntnr: Visited Xining last week, which seemed to enjoy flaunting its surveillance capabilities. Pic 1: list of cars caught parking in… RT @karpathy: My morning coffee turned out to be the difference between going and not going to NIPS 2018 this year. Apparently sold out in… "RT @karpathy: plan: 2019: be ready & fully caffeinated the millisecond it goes up 2020: write some JS to register me instantly 2021: discov…" RT @NipsConference: #NIPS2018 The main conference sold out in 11 minutes 38 seconds RT @PreetBharara: This, by the way, is next level crazy, inappropriate, unethical, stupid, incriminating. https://t.co/IQqdpTvS60 "RT @fhuszar: how to make the best of your first day back in the office: 1. find out there's now deodorant in the men's room (how useful!)…" RT @wilnyl: Balloon archers https://t.co/a1fQ6wnLiD RT @webdevMason: It's insane that we still secure accounts with personal trivia in the social media age https://t.co/X5gc5UraEJ @Zergylord @yudapearl I think "Only (2)" meant "only papers in the second category mentioned above," not only two papers. RT @dog_rates: This is Choco. Her first grooming experience went really well. She picked out the little bow herself. 12/10 really hopes you… "APES: a Python toolbox for simulating reinforcement learning environments," Labash et al.: https://t.co/E9sDtIjG7q "Gibson Env: Real-World Perception for Embodied Agents," Xia, Zamir, and He et al.: https://t.co/BUjvoQgO2H "Multi-Hop Knowledge Graph Reasoning with Reward Shaping," Lin et al.: https://t.co/HXkXCVOwhG "Directed Exploration in PAC Model-Free Reinforcement Learning," Oh and Iyengar: https://t.co/3nitIHypuT RT @incunabula: Reports from Rio are of the total destruction of the museum and the loss of upwards of 20 million items. This is the Brazil… "“Application of Self-Play Reinforcement Learning to a Four-Player Game of Imperfect Information,” Henry Charlesworth: https://t.co/C4sDxfjgPj Uses PPO" @jackiehluo Thx! :) @jackiehluo (Sounds from first tweet like annual but never worked for company so dunno what standard phrasing is. In any case thx for doing this, v. interesting!) @jackiehluo Are the stock $ figures annual or one-time? RT @marinamaral2: The National Museum of Rio is currently being consumed by flames. Over 20 million historical items are being lost before… @j2bryson @FHIOxford @DuckDuckGo @Google Strange! RT @ruthbenghiat: Authoritarian leaders organize their lives around escaping critics and lining their own pockets. Trump visits to his “saf… RT @_kzr: A demonstration of a real-time pix2pix (image-to-image translation with neural network) implementation with Unity https://t.co/A6… RT @RyanLizza: Today https://t.co/2vLkjz8qbk @webdevMason Stay strong "I.J. Good (1970) on eBay, OkCupid, and arXiv. h/t @j2bryson, I hadn't read this lesser known/harder to find work by him (""Some Future Social Repercussions of Computers""). https://t.co/V7pKQTLmkY" RT @dlowd: Who called it “computer security” and not “defense against the dork arts”? RT @pabbeel: NIPS Deep RL Workshop is happening again in 2018! Paper submission deadline is Friday Oct 12th. Exciting invited speakers l… RT @paul_haine: Lots of good advice here https://t.co/jjB1CEuJ25 @TheAnnaGat Lol @ option 3 RT @twimlai: Today we're joined by @kazizzad, PhD student at @ucirvine & visiting researcher @Caltech, who joins us to review Deep Reinforc… RT @sidakpal21: Code and pre-built histograms coming soon!! https://t.co/rfnANYW3Wd @Michallys I skim/read individual sections a lot, rarely read whole papers - maybe equivalent of 2-5 a day @jackclarkSF @jwangARK @robinsloan The existence of one Robin would substantiate my hypothesis "Robot_gym: accelerated robot training through simulation in the cloud with ROS and Gazebo," Vilches et al.: https://t.co/3xIgOYDBZc "Learning End-to-end Autonomous Driving using Guided Auxiliary Supervision," Mehta et al.: https://t.co/147jw9tBeM "ExpIt-OOS: Towards Learning from Planning in Imperfect Information Games," Kitchen and Benedetti: https://t.co/MpUZCcg9wm """Design of an Autonomous Precision Pollination Robot,"" Ohi et al.: https://t.co/vymWCgYr7Q Sorry, folks, it doesn't fly. Pretty cool project, though." "My anecdotal impression so far is that people in the Bay Area are roughly: 5x more into tech than average 100x more into climbing than average infinitely more into sourdough bread than average" RT @rao2z: Going by the numbers we got, #AAAI2019 already has >50% more abstracts than #AAAI2018 (which in turn had >50% over #AAAI2017 htt… @nickfrosst DQN on google datacenters? Not sure if counts as “commercialized” @erfannoury love it. listening to Rinzler right now RT @marcgbellemare: Our work with Adrien Ali Taiga and Aaron Courville is out on arXiv: https://t.co/obnOywbf34 Some progress towards under… @jjvincent Lol basically Milo exchanged emails with some staffer saying vanilla things and pretended it was an actual Trump interview https://t.co/4ILMnYkGr6 @adjiboussodieng @DeepMindAI exciting! congrats to you and them! :) @jjvincent I'm old enough to remember when Milo pretended that he interviewed Trump on AI and that Trump said sensible things (2-16 are true, btw, I just found this funny) "RL agorithms' performance on Atari, ranked: 16. Evaluation 15. Conditions 14. Vary 13. Across 12. Papers 11. There's 10. No 9. Single 8. Metric 7. Picking 6. A 5. Single 4. Algorithm 3. Is 2. Misleading 1. Ape-X DQN" RT @hahellyer: I was of two minds as to whether this awful piece of writing in the @WSJ about British Muslims should be given any attention… @mark_riedl That’s how I feel when I do literally anything with the command line @Michallys Ah; sorry! Journalists often get confused and call DeepMind an algorithm. The original tweet was a reference to similar errors being made by journalists over time. @Michallys There isn’t one, DM is an org. They have developed many algos by other names :) @Michallys *one of multiple funders, sorry Context - and also DeepMind is an organization. https://t.co/QwAXwA58TG @Michallys People often attribute anything related to the organization OpenAI to Elon Musk personally, when in fact he’s not really involved in it much anymore (he was involved in founding it and is one of multiple founders, but since left board). Perhaps bc Musk-related news gets attention “Elon Musk’s AI” is the new “Google’s DeepMind algorithm” "RT @dribnet: #TBT currently: exhibiting ImageNet based art at @NatureMorte 20 years ago: exhibiting WordNet based art at @siggraph / @ArsE…" Arriving in SF tomorrow! :) @BVLSingler LOL @robinsloan Waterworld af @ginnysimmons ~*spooky*~ @sknthla same! @Zergylord @hardmaru [deletes draft of "Word Vectors FTW: GloVe is All You Need" @ElkeSchwarz 🤞 @ElkeSchwarz Do you know if there will ever be a Kindle version? :) @AthertonKD On a scale of 0 (Idiocracy/House of Cards) to 10 (West Wing), though, we've gone at least a solid point or two down... RT @kchonyc: yes, char-level MT! https://t.co/gZDqBNuD4s RT @felipesuch: I replicated Ape-X and finally got around to open sourcing it (https://t.co/8zDrtmepwn). On a single machine it gets human… "Towards security defect prediction with AI," Sestili et al.: https://t.co/wOZNcnG3Kb "Wasserstein is all you need," Singh et al.: https://t.co/xpMs830QkV "Mapping Language to Code in Programmatic Context," Iyer et al.: https://t.co/rYfoyc1moS RT @cwarzel: i...i...just. if you're going to level big angry Presidential complaints at Google...at least...don't flagrantly lie about som… RT @passantino: This is false. In 2017 Trump did not deliver a SOTU and in 2018 Google did promote his first SOTU on its homepage. https://… @AnimaAnandkumar @awscloud congrats on all your accomplishments - look forward to hearing what's next! :) @GoAbiAryan (Clouding your judgment :P) @GoAbiAryan 🍕 RT @yoyoha: Hey @realDonaldTrump if you think Google is bad wait until you see the history books. RT @AndrewGillum: What our state and country needs is decency, hope, and leadership. If you agree, join us at https://t.co/fm0ODFFGWU. Also… @jjvincent Some good examples here by @rao2z if I recall (about AI generally, not just ML) https://t.co/88XGXyZZJQ RT @_rockt: I had the pleasure to co-supervise outstanding MSc students jointly with Jakob Foerster (@j_foerst) and Greg Farquhar (@greg_fa… RT @devonzuegel: Just like a heat engine, there's a theoretical limit far below 100% to how much we can squeeze out of a day, and realities… RT @heiga_zen: "Cloud Text-to-Speech now supports 14 languages and variants, with 56 total voices including 30 standard voices, and 26 Wave… @webdevMason Curating a shorter version of a TV series with less fluff @j_winterton :( """Investigating Human + Machine Complementarity for Recidivism Predictions,"" Tan et al.: https://t.co/1nevqg7OSu ""human and COMPAS decision making differed, but not in ways that could be leveraged to significantly improve ground truth prediction [by naively combining them]""" "Evaluating Theory of Mind in Question Answering," Nematzadeh et al.: https://t.co/vuA3bmZ7YM "Deriving Machine Attention from Human Rationales," Bao et al.: https://t.co/49fiyjMFPL "Understanding Back-Translation at Scale," Edunov et al.: https://t.co/RkGsiaQmzJ "Discriminative Deep Dyna-Q: Robust Planning for Dialogue Policy Learning," Su et al.: https://t.co/3U3XAS1MLd @mark_riedl (But ya it is bloggy...take it up with ACM! :P) @mark_riedl Bc in ACM or something and ppl have learned by now that if it isn’t on arXiv no one will cite it "An Academic's Observations from a Sabbatical at Google," Adam Barker: https://t.co/tgWOvkhP1z https://t.co/eqE1vFB7bR https://t.co/vvc6akBjrd "SOLAR: Deep Structured Latent Representations for Model-Based Reinforcement Learning," Zhang and Vikram et al.: https://t.co/1GBD9o9bam @erfannoury yesss @shivon also a common phenomenon... so far I have yet to find a case of this sort of thing (seemingly big number to make compute sound really fast, in sci-fi) stand the test of time for more than a few decades @robinhanson @davidmanheim Steven Brams has some books/papers that cover similar ground. Interesting perspective. RT @dog_rates: This is Molly. She is an absolute menace. Will bite your whole h*ckin finger off. Still 12/10 would risk a noggin pat https:… "RT @jennwvaughan: Uncanny case of great-minds-think-alike: New paper on The Disparate Effects of Strategic Manipulation w/ @uhlily @immorl…" RT @maosbot: Come and do your DPhil (PhD) with us in Oxford! https://t.co/QWVk2e0YhV RT @jsmooth995: The code for the bathroom at this Starbucks is 90210 which the young barista passed on matter-of-factly as "nine zero two o… RT @RichardSocher: A new #deeplearning model for improving abstractive summarization by actually creating novel phrases. Reinforcement lear… RT @SmithaMilli: 1/6: Our new paper on "The Social Cost of Strategic Classification" is up! We study the trade-off between increasing the r… @RebeccaCrootof you're the best!! @RebeccaCrootof nice thread! btw, do you know where I can find all the new working papers? I always get confused by the UN site @jackclarkSF @tsimonite @jekbradbury @jeremyphoward we should write a report about that @jjding99 what are some plausible interpretations? "Generalisation in humans and deep neural networks," Geirhos, Temme, and Rauber et al.: https://t.co/vR1meOA7qd "Dissecting Contextual Word Embeddings: Architecture and Representation," Peters and Neumann et al.: https://t.co/XSwsZD2ctn @gwern hence the wait, wut. this was a cry for expert help. "NavigationNet: A Large-scale Interactive Indoor Navigation Dataset," Huang et al.: https://t.co/mx16FDeDGu "Meta-Learning for Low-Resource Neural Machine Translation," Gu et al.: https://t.co/idhWN7IXwo @daniels_kaiser I'd think that's already been used, but not sure, not an NLP person "The Social Cost of Strategic Classification," @SmithaMilli et al.: https://t.co/qMpwOgpM0O "Deep Probabilistic Logic: A Unifying Framework for Indirect Supervision," Wang and Poon: https://t.co/DLCzRXChvl "Data Motifs: A Lens Towards Fully Understanding Big Data and AI Workloads," Gao et al.: https://t.co/VLYh48fNkg """Paraphrases as Foreign Languages in Multilingual Neural Machine Translation,"" Zhou et al: https://t.co/tOk2Ckw9nL ""We achieve a BLEU score of 57.2 for French-to-English translation, training on 24 paraphrases of the Bible, which is ~+27 above the WMT'14 baseline."" wait, wut" Nice interview with @cbd on OpenAI Five! https://t.co/CMCMva8brs "RT @AaronBlake: Trump: ""So we made a deal with Canada."" Aide corrects him that it's actually with Mexico." RT @gwbstr: Fascinating material on how Tencent's teams work from different data, producing limited user profiling for ads in @jjding99's C… RT @twimlai: Today we’re joined by @cbd, Machine Learning Engineer at @OpenAI, working on an AI-powered agent to play the DOTA 2 video game… @XandaSchofield :D RT @gdb: Interview for The Outline on our Dota progress: https://t.co/Hrl7An8M1d RT @marcgbellemare: Very excited our lightweight RL framework is now available for everyone to use! w/ @pcastr @carlesgelada @subho87 https… @XandaSchofield I’ll settle for just the Shrek pic. Inventing a new means of photography would also work RT @KT_So_It_Goes: we’ve reached the point with trump where he can announce he’s cancelling a trade deal that half the US economy rides on… @XandaSchofield Pic please "Improving Abstraction in Text Summarization," Kryściński et al.: https://t.co/apzasqnpSN "Style Transfer as Unsupervised Machine Translation," Zhang et al.: https://t.co/aztJfKyBpc "Ontology Reasoning with Deep Neural Networks," Hohenecker and Lukasiewicz: https://t.co/FmVBnYS28E "Approximate Distribution Matching for Sequence-to-Sequence Learning," Chen et al.: https://t.co/yUudCjczpf @allergyPhD yasssss """LIFT: Reinforcement Learning in Computer Systems by Learning From Demonstrations,"" Schaarschmidt et al.: https://t.co/PuCmcngk2j RL for data management tasks, using imperfect demos" "Finished Ball Lightning - enjoyable read, though not as epic as the Three Body Problem trilogy. I’d recommend the latter first to Liu Cixin newcomers. Fun fact: they take place in the same universe/reference one another a bit!! 😍" RT @NicolasPapernot: On Dec 7, we are organizing a workshop on security in ML at NIPS 2018. The call for papers is now online at https://t.… Final game at the Dota 2 International about to start - $7 million difference between 1st and 2nd (!!!). https://t.co/pfjwJrtRtA RT @nytimes: John McCain, War Hero, Senator, Presidential Contender, Dies at 81 https://t.co/X8bCmOIiXK RT @shivon: Very human response to the AI bots this week at #TI8. So impressed by how quickly the @OpenAI team is iterating and how much th… RT @BrundageBot: Playing 20 Question Game with Policy-Based Reinforcement Learning. Huang Hu, Xianchao Wu, Bingfeng Luo, Chongyang Tao, Can… RT @BrundageBot: Exploring Shared Structures and Hierarchies for Multiple NLP Tasks. Junkun Chen, Kaiyu Chen, Xinchi Chen, Xipeng Qiu, and… @catherineols New candidate for Prof. Bong Rip (watch out @moyix!) Vancouver is 👍 RT @SachaBaronCohen: https://t.co/hZocxXaMc9 @jjvincent millenia too early @KloudStrife what's your reasoning re: 8k/7k? RT @gdb: Just finished team celebration. Would have been nice to get a win out of some of the world's best players, but team had predicted… RT @Smerity: Congratulations to the @OpenAI Five team! Whilst the bots may have lost we've all gained from watching your journey :) My live… RT @gdb: Still lots more work to do! If you'd like to help us improve Five to beat the best pro teams, we're hiring: https://t.co/El9s3Hjrp… @jackclarkSF Alas, my only contributions were negative (distracting ppl on Slack; eating their sushi) RT @BrundageBot: arXiv papers, August 24, 2018: @rcalo Have only a vague sense of what i’m looking at @gwern @togelius That’s true at inference stage, though the model was still key to get to that point. RT @OpenAI: Our results at The International 2018: https://t.co/9rjGncvyNH RT @togelius: It's important to note that the setup here is very unlike e.g. Go, where AlphaGo (and all other agents) can simulate the effe… RT @mtrc: 🔹 Bear in mind - the bots did worse because OpenAI removed restrictions this week and made them play a more realistic game. That'… RT @gdb: Congratulations to Xiao8, BurNIng, rOtK, Ferrari_430, SanSheng — top-tier Dota players who defeated OpenAI Five after 45 mins of e… RT @OpenAI: OpenAI Five's second match at The International will start in the next few minutes. Will be streamed on The International's Twi… RT @brianklaas: A tweet for everything. This one shows that a) Trump was aware that it could be illegal to make hush money payments during… RT @shimon8282: I am hiring a postdoc on deep reinforcement learning. https://t.co/XzmXknFHVi RT @roaffix: Tough play by @OpenAI in tramfights. Some more debugging nights and they will be unstoppable tho. #TI8 https://t.co/09HMxIDyAc RT @gdb: In case you missed it, the OpenAI Five segment from today: https://t.co/TXZ6QSRAhq "RT @AlexIrpan: Congrats to paiN Gaming and OpenAI for a fun match at #TI8 ! Hard to point to one reason pros won, but would guess this: 1.…" RT @gdb: Two more shots to beat a pro team this week. Matches at similar timeslot tomorrow and Friday. "Don't Use Large Mini-Batches, Use Local SGD," Lin et al.: https://t.co/ELNumnomV0 "Neural Architecture Optimization," Luo and Tian et al.: https://t.co/MePCpVmSWI @notmisha Though maybe A, B, C, D, and E or something that doesn’t involve a 5 would be less confusing :) @notmisha In the games, they’re 1, 2, 3, 4, and 5 ;) @0x00B1 @notmisha No, it’s five separate (though identical) networks with no explicit communication between them, if I understand correctly @notmisha I dunno if there’s a canonical answer but I’d prob. use diff terms in diff contexts - “it” (one agent/network) carries out some attack makes sense sometimes, bc no explicit communication/coordination...”they” team up against an an enemy...”it” has been training for a few days... @notmisha Five identical things :) RT @gdb: Congratulations to Team paiN, the Dota 2 pro team who just beat OpenAI Five in a 51 minute game. Lots of extremely exciting plays… "RT @mtrc: And it's done! 😊 Humans 1 : 0 OpenAI 🤖 Another game up tomorrow. So much to unpack. GGWP!" RT @mtrc: I just want to say, again, that a lot of tech organisations wouldn't have done a public showing without 100% guaranteeing a win.… @Smerity @OpenAI (ignore my request bc tuning back to main stream now, OAI coverage starting :) ) OpenAI Five coverage is starting! https://t.co/pfjwJrtRtA RT @gdb: Getting ready to go on stage. Extremely excited for what’s about to happen. Though we don’t know exactly what that will be! https:… @Smerity @OpenAI talk about the architecture please! RT @cbd: Up next: OpenAI Five at The International! RT @gdb: Game 3 of previous match now over. Should be about 15-20 mins! RT @gdb: Looks like the current match will go to a 3rd game, so probably another hour at least. @ludwigschubert (Just realized that’s a reference haha - haven’t seen it in a while) @ludwigschubert too real @ludwigschubert https://t.co/M2UC9641iz @ArtirKel that'd be great :) "RT @OpenAI: First OpenAI Five match at The International today! - Streamed on The International's Twitch channels. English: https://t.co/E…" @ArtirKel For good, or just visit? Turns out, Hunger Games is a documentary about Bay Area housing. @ivan_bezdomny Not yet, arriving late next week though (probably - maybe sooner - long story haha). @ivan_bezdomny Haha (un)fortunately there are other aspects of my life ;) @EricBattenberg I will abstain from arguing about the merits of grammar rules that I don’t like :P @EdgarArout Nope Look forward to meeting lots of AI folks (and others) in the Bay! Should make a dent in my to-meet list by *checks notes* 2027. "*animal smuggling Tony Stark voice* I need it. https://t.co/uBzByzdn5e" RT @gdb: Available to play a last-minute test game vs OpenAI Five this morning? Email dfarhi@openai.com by 10a PT. Team must have average M… RT @atlasobscura: Malabar giant squirrels are, native to India, are twice as large as your standard eastern grey squirrel, with bodies that… @ianpaulwright I often decide incorrectly and there are way too many wrong people to argue with everyone :P The hard part of Twitter is deciding whom not to argue with. RT @chelllssseeea: why is this so funny to me https://t.co/fUDik7CTF5 Very cool plot. Excited to see what happens today! https://t.co/CVOjSuFrFI @tkasasagi If I ever visit Tokyo, I will ask you for food tips 😍 Lol https://t.co/xXAkSXFZsy RT @EvanSandhoefner: *Slaps roof of Earth* This baby can fit 387,000,000,000,000,000,000 nematodes in it "RT @ylecun: Analysis of the percentage of women authors at ICLR+ICML+NIPS by country. https://t.co/fQnhrYuEbP https://t.co/fQnhrYuEbP" "QuAC : Question Answering in Context," Choi et al.: https://t.co/MhvtWgFyPM "CoQA: A Conversational Question Answering Challenge," Reddy et al.: https://t.co/KlDXXZdQSW "Has Machine Translation Achieved Human Parity? A Case for Document-level Evaluation," Laubli et al.: https://t.co/bIHN1iEHsx "Translational Grounding: Using Paraphrase Recognition and Generation to Demonstrate Semantic Abstraction Abilities of MultiLingual NMT," Tiedermann and Scherrer: https://t.co/k7iv1UQgl0 @rbhar90 somewhat distinct channels (military acquisitions, high level policymakers' views around arms control/military strategy, researcher/engineer activism/norms in the community, public opinion, etc.) that can coexist with DARPA funding of basic research in related areas, for example. @rbhar90 Have many thoughts meriting a longer convo! :) Among others though: certainly zero weaponization worldwide is unlikely (/already in the past depending on what you count), but I wouldn't too strongly link where uni money comes from to weaponization prevention. Latter dealt w thru- "Learning deep representations by mutual information estimation and maximization," Hjelm et al.: https://t.co/jxBiyqW3Eq @paul_scharre @jackclarkSF @SamBendett Agree re: not either/or. Just observing that I’ve more often gotten the gimmick vibe from Russian stuff than US/China stuff, though not implying that demos high on the gimmicky quotient makes up all of Russia’s efforts - it obviously doesn’t. @SamBendett of course! not sure if we actually disagree or just Twitter bandwidth issues :) I'm not anti-concepts/demos.. @SamBendett ...given limitations of locomotion, etc. today. It's not that I think robotics isn't relevant, or even giant robots, just flagging that perception/seeing if there's something to it. Of course not unique to Russia, and I may be missing context (e.g. teleoperated?) in article. @SamBendett To be clear, my view is not that all experiments/announcements/demos are just blustering, but there is a spectrum from serious efforts to solve an engineering/military problem to just-for-show, and things involving humanoid form factors + legs ring my alarm bells re: the latter, RT @Smerity: Stream starting in a few minutes where I'll pull apart a few minutes of @OpenAI bot vs bot play. No past DotA experience neces… @SamBendett (Specifically referring to Russia when I say stuff like this - US/China stuff, for example, seems less often to be silly/scifiesque for its own sake). @SamBendett Stuff like this (other example: humanoid robot holding handgun) seems to me to be about projecting an image of competitiveness, not fielding real technologies. Thoughts? @alexpoms Sure, shoot me a DM or email (miles at openai dot com) RT @speechboy71: Here's the most insane thing about today: the president of the United States has been implicated in the commission of a fe… "RT @AliVelshi: Trump associates who are now criminals: -Michael Flynn (pleaded guilty) -George Papadopoulos (pleaded guilty) -Paul Manafort…" RT @gdb: Focus is often on OpenAI Five's victories, but losses are what drive our progress. On Aug 9th, we were crushed in a best-of-3 agai… @daniel_bilar Moving to San Francisco to work at OpenAI (started remotely this week). "RT @OpenAI: We've updated OpenAI Baselines, our collection of high-quality implementations of RL algorithms. New features: - Common experi…" 36 hours left in Oxford! 😢 https://t.co/7ZpBizub9U "RT @gdb: Details of OpenAI matches this week: - Will be streamed on The International's Twitch channels. English: https://t.co/92xyZcPShP.…" RT @Tim_Dettmers: I updated my guide with new GPU recommendations: RTX 2080 most cost-efficient choice. GTX 1080/1070 (+Ti) cards remain ve… RT @hlntnr: So much better than "a robot" as an approximation of what AI is and why it's both valuable&risky: massive, distributed system t… RT @genekogan: NVIDIA's new vid2vid is the first open-source code that lets you fake anybody's face convincingly from one source video. pri… "Peptide-Spectra Matching from Weak Supervision," Schoenholz et al., Brain/Calico: https://t.co/puAhWeTZ1L "Benchmarking Automatic Machine Learning Frameworks," Balaji and Allen: https://t.co/5ToT0SSL9G "Source-Critical Reinforcement Learning for Transferring Spoken Language Understanding to a New Language," Bai et al.: https://t.co/6v5qqMZ0cm RT @goodfellow_ian: Video-to-video translation with conditional GANs https://t.co/DDmRSTkpri RT @BrendanNyhan: Nothing to see here, just the President openly threatening to undermine the rule of law by taking over a criminal investi… RT @liu_mingyu: https://t.co/y0LY9KoKzU "RT @liu_mingyu: code: https://t.co/wJRcOVnlV5 video: https://t.co/sJstk9nKSJ Using Conditional GAN to generate HD resolution videos https:/…" "Life-Long Disentangled Representation Learning with Cross-Domain Latent Homologies," Achille et al.: https://t.co/o0vwP5CHAh """Video-to-Video Synthesis,"" Wang et al.: https://t.co/V5KO5KvoKa Impressive stuff from NVIDIA." RT @erikbryn: Is AI already affecting international trade? Our new @nberpubs paper shows how improved machine translation led to a 17.5% in… RT @nsaphra: People talk about ML like money is an unstoppable amoral force of nature that dictates completely what happens with new tech.… RT @gdb: Currently training at our largest-ever scale (thanks to heroic efforts from the team), which means even we can't predict how much… Rings true to me based on my discussions with Axon ppl...lots of people wouldn’t be there if the company had rolled out face recognition without discussion/thought/oversight, for example. A broader phenomenon than Axon - scarce tech workers have influence. https://t.co/FA21bpcA3g RT @OpenAI: OpenAI Five will be playing against five of the world's top Dota 2 professionals in front of nearly 20,000 audience members at… (440 TFLOPS at int4 precision; 110 at FP16) "*slaps the top of an RTX 1080 Ti* This bad boy can fit a lot of low precision neural net operations on it." RT @hannawallach: Good morning, Twitter!!!! 🌅 It's Monday -- the PERFECT day to take our anonymous survey on fairness and AI/ML systems!!!… RT @rafabauer: We found love in a hopeless place https://t.co/V3Q5gt9IS0 "Joint Training of Low-Precision Neural Network with Quantization Interval Parameters," Jung et al.: https://t.co/ikQm2j5TuJ "Read + Verify: Machine Reading Comprehension with Unanswerable Questions," Hu et al.: https://t.co/AftSGigJGK "Reinforcement Learning for Autonomous Defence in Software-Defined Networking," Han et al.: https://t.co/IgyfsYklcM @andrey_kurenkov nice poster @sidneyfussell @Gizmodo @TheAtlantic Congrats! RT @smotus: Viewing John Dean as the villain in the Watergate story seems like kind of a tell. https://t.co/FOB1DfreWx @tetisheri Congrats! As Mark pointed out, in this case it was mostly the headline rather than the article itself that was erring in the dismissive direction - these forces (and contrary, hypey forces) operate at the editor level, too, where headlines come from. Anyway, I think Mark made good points. ...partly because researchers and journalists want to be seen as Serious Skeptical People, and/or are concerned about excessive AI hype. You can be serious and push back on hype while also recognizing there are actual accomplishments happening, though. More generally, it's worth noting that pretty much no matter what the AI-related accomplishment, there will be people saying why it's not impressive b/c of X, Y, or Z (even when X, Y, and Z were very transparently reported). https://t.co/rY67RlbONe "RT @RikeFranke: Using #drones makes a lot of sense for non-state actors — possibly even more than for states. My latest at @verge https:/…" RT @mark_riedl: Since I was quoted extensively in this article, let me just say that this article doesn’t convey my take on what happened a… "RT @IamGMJohnson: White folk: “we don’t know why they are protesting the anthem” Also white people: https://t.co/zNy6K3i2kW" RT @AnimaAnandkumar: I talk to @tsimonite about #WomenInSTEM and #AI and the #meToo movement. Going by the comments on Twitter we have a lo… RT @mtrc: I've heard a few analysts at The International describe a move as "OpenAI-style". They're not describing brand new strategies, th… @HengjianJia Agreed @rbhar90 Of course there's much more than the constrained RL stuff going on in this use case, and I'm not aware of papers on those aspects. "@rbhar90 Nothing explicit in the blog post, but I think these two papers were plausibly motivated by this specific use case (in one case, it's given as a hypothetical example - not mentioned in the other, but related): https://t.co/EBzvvrvUND and https://t.co/Ez01vc1tb0" RT @DeepMindAI: We've collaborated with @Google to develop a safety-first AI system to autonomously manage cooling in Google's data centres… @ngutten Haven't looked at this closely lately but if I recall correctly from here https://t.co/wWim0MEebh, we fall pretty fall short of theoretical predictions, but nevertheless find regularities. @patrickshafto Not out quite yet but I'm curious to see if this turns out to be the first popular book that actually explains ML in an accurate/accessible way, which seems quite possible but AFAIK hasn't been done well yet https://t.co/AWNkqc6F8O """Anatomy Of High-Performance Deep Learning Convolutions On SIMD Architectures,"" Georganas et al., Intel: https://t.co/nrRIBbpwoQ ""This proves that CPUs can be a competitive alternative when training neural nets."" 🧐" @ankurhandos Yeah also doesn't seem super comprehensive, but it's the only one I've seen recently so tweeted anyway "On the Decision Boundary of Deep Neural Networks," Li et al.: https://t.co/ktl4vVJN5h "Neural Architecture Search: A Survey," Elsken et al.: https://t.co/mfDs3AijA9 "SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference," Zellers et al.: https://t.co/GH6Z5wCC4C @hardmaru @tkasasagi 😥 Perhaps part of the problem is that even if the continued scaling with data hypothesis is true, you have to make continued, ever larger investments to find out how long it's true...not easy to test incrementally or have confidence in. (note that I'm not sure that, even if the current scaling trend continued, that much would suffice - just a conditional statement. "Deep Learning Scaling is Predictable Empirically" had some good plots on this but the relevant graph didn't go out this far) @warnerw super-individual-human :) @warnerw A panel of humans. Maybe not 1000x (~1.72 billion at 100 dollars per labeled hour of speech), but 10x (17.2 million) or 100x (172 million) are reasonableish. Still puzzled re: why we don't see even larger datasets than that (yet). Superhuman speech recognition would be well worth the cost of even 10x+ that, if one continued seeing roughly linear improvements with the log of data through that point (as scaling studies so far suggest). """Toward domain-invariant speech recognition via large scale training,"" Narayanan et al.: https://t.co/duHj12rMpw Large scale = 172k hours" "AnatomyNet: Deep 3D Squeeze-and-excitation U-Nets for fast and fully automated whole-volume anatomical segmentation," Zhu et al., UC Irvine, Lenovo, and Tencent: https://t.co/oY9UVIkI9e RT @kateconger: Sergey says he has seen that people are live-tweeting and will not keep discussing Dragonfly right now RT @kateconger: Sundar speaking to Googlers now at all-hands about Dragonfly: "If we were to do our mission well, we are to think seriously… (Enjoying Ball Lightning so far) <3 Liu Cixin’s writing. "RT @quasimondo: AI art is en Vogue https://t.co/GMYANePBtz" "RT @LAM_Barrett: Right now the most meaningful curb on US tech companies is the people who work for them https://t.co/Uxd91EXxf5" Naturally, a week before leaving the UK, I finally get the hang of plugging my US power cords into the adapter. The keys are courage (to not worry about breaking it) and the right amount of wiggling. RT @linecook: All of these puppies were rescued from the California wildfires and are available for adoption @ilovefamilydog in San Francis… RT @ceodonovan: The employee letter demanding transparency circulating inside Google has 1,400 sigs and represents multiple activist groups… RT @fatconference: Today (Aug. 16) is the last day to register abstracts for FAT* 2019. Please submit! We wouldn't want our program committ… RT @KateCharlet: Important problem raised by @qjurecic: “The message here for less prominent public servants is that the president has the… RT @chick_in_kiev: Hey y’all, if any of you struggle with panic attacks like me, I highly recommend the app Beat Panic. It’s $1, NHS-recomm… RT @EvanSandhoefner: https://t.co/8ACPJk7pDR https://t.co/6MBRBuQaBK 😍 https://t.co/uzf0NylNZy "RT @catherineols: Our paper ""Skill Rating for Generative Models"" is now up! https://t.co/eCWI7C4D2X tl;dr: A new idea & proof-of-concept…" "VizML: A Machine Learning Approach to Visualization Recommendation," Hu et al.: https://t.co/wFbggykzN5 """An Auto-tuning Framework for Autonomous Vehicles,"" Fan et al.: https://t.co/RPhcBCDzs6 More on Baidu's driverless car stuff" "Embedding Grammars," Wingate et al.: https://t.co/uLtiddaPq3 "Using Regular Languages to Explore the Representational Capacity of Recurrent Neural Architectures," Mahalunkar and Kelleher: https://t.co/oCx76ExPQ4 "Skill Rating for Generative Models," @catherineols et al.: https://t.co/gNqohz0JRJ RT @KateCharlet: Big deal — huge deal — right here. https://t.co/uAUs3ScALN RT @dog_rates: This is Daisy and Luna. Daisy doesn’t like car rides so Luna comforts her until they both fall asleep. H*ckin heartwarming.… "Deep RTS: A Game Environment for Deep Reinforcement Learning in Real-Time Strategy Games," Andersen et al.: https://t.co/GbQKf3yVXr @jackclarkSF Hit me up when you get to Face/Off, Con Air, and The Rock Should be getting my copy of Ball Lightning tomorrow!!! RT @hardmaru: This paper was a joy to read. So the intrinsic curiosity reward signal often encourages an agent to learn that it should avoi… Whom he recently called an “extraordinarily low IQ person.” https://t.co/kgDn3uJH4o RT @SeanMcElwee: My read is that an n-word tape would hurt Trump, mostly because American political elites and media outlets exclusively un… RT @XandaSchofield: Unsure of how to start designing a conference poster? Frustrated that your research posters often end up too verbose, o… @_NicT_ Thanks! RT @MerelEkelhof: Read my blog on why the concept of #meaningfulhumancontrol may not be the only, or best, approach through which to charac… @webdevMason https://t.co/0RBiM40NUN @webdevMason Why LA? @_NicT_ Hi Nicholas - there isn't a standard format for submittals AFAIK, though often people will submit in different formats like NIPS, for which there are standard LaTeX templates (just clearly indicate if it is or is not a submission to the conference for which that's the format) RT @nataliejonesnz: Today our article on representing future generations in policymaking came out in Futures. @markobrien86 https://t.co/n… RT @togelius: .@SentientDAI has interviewed a whole bunch of evolutionary computation researchers, both some absolute heavyweights of the f… @tiffanycli Was gonna say, my tweets aren’t *that* epic... @PhilWaymouth @OpenAI Thanks, Phil! """CosmoFlow: Using Deep Learning to Learn the Universe at Scale,"" Mathuriya et al.: https://t.co/INJFTYNx1o ""These enhancements enable us to process large 3D dark matter distribution and predict the cosmological parameters ΩM, σ8, and ns with unprecedented accuracy""" "Shared Multi-Task Imitation Learning for Indoor Self-Navigation," Xu et al.: https://t.co/qgAILhdm9l "Risk-Sensitive Generative Adversarial Imitation Learning," Lacotte et al.: https://t.co/JDkPrrqlKy "Character-Level Language Modeling with Deeper Self-Attention," Al-Rfou, Choe, Constant, Guo, and Jones: https://t.co/0jMAo6Svab "Adaptive Skip Intervals: Temporal Abstraction for Recurrent Dynamical Models," Neitz et al.: https://t.co/0J4ttwFi9F RT @brhodes: We don't need secret recordings to know that Trump built his entire political brand by incessantly peddling the lie that the f… RT @awjuliani: Cool new work from @pathak2206 and collaborators exploring how far a pure curiosity-based reward can go (hint: further than… RT @deray: We don’t need another tape to confirm Trump’s racism. It’s on full display, in real-time, every day. RT @MSFTResearch: PhD students from underrepresented groups in computing have a new funding opportunity with the Microsoft Research Ada Lov… RT @Miles_Brundage: "Large-Scale Study of Curiosity-Driven Learning," Burda, Edwards, and Pathak et al., OpenAI/Berkeley: https://t.co/zchc… @hardmaru Lol saw that "RT @jtlevy: https://t.co/COHKIiDQSs “I will be so presidential, you will be so bored.”" "Learning to Represent Bilingual Dictionaries," Chen and Tian et al.: https://t.co/KKkrfXOYw8 "Hierarchical Attention: What Really Counts in Various NLP Tasks," Dou and Zhang: https://t.co/HGh8fFivSn "Dropout during inference as a model for neurological degeneration in an image captioning network," Li et al.: https://t.co/BNUQUsZdNZ """This Time with Feeling: Learning Expressive Musical Performance,"" Oore et al.: https://t.co/LvPO5QKGoA Nice samples (https://t.co/4yVUrCg0Wn) and comments from musical expert listeners." "Fake Sentence Detection as a Training Task for Sentence Encoding," Ranjan et al.: https://t.co/U4ifqyaCxD RT @dog_rates: This is Benny. He responds well to ear scratches. Once he leans his head against your hand, you’re not allowed to stop ever.… "Relational dynamic memory networks," Pham et al.: https://t.co/BGjZQrHnlf "Neural Importance Sampling," Müller et al.: https://t.co/v2tUzwmA9B "RT @pathak2206: @Miles_Brundage Thanks for sharing our paper! Here is the link to the website and the video. https://t.co/4LzAUs7jf2" @Klonick would attend "Machine Learning Promoting Extreme Simplification of Spectroscopy Equipment," Lee et al.: https://t.co/1Gy7S9wxM2 (video link doesn't seem to work RN - paper is cool on its own, though!) "Large-Scale Study of Curiosity-Driven Learning," Burda, Edwards, and Pathak et al., OpenAI/Berkeley: https://t.co/zchcGEFtKe "Directed Policy Gradient for Safe Reinforcement Learning with Human Advice," Plisnier et al.: https://t.co/3aNFAJkRLI "RT @AlisonBLowndes: JHH announcing #Turing now at #SIGGRAPH2018 Watch LIVE: https://t.co/HdzCLw0eHo https://t.co/apGozu5MdI" RT @nsaphra: I wrote a brief lit review on modifying hyperparameters during DNN training. There's gotta be someone else is interested in ad… RT @mustafasuleymn: Super proud of our collaboration with @moorfields published in @naturemedicine today! Our model can identify 50 blindi… RT @brianklaas: The President of the United States is saying that a senior employee that he personally decided to hire was vicious and not… @GharibiHadi Though see* @GharibiHadi Though the comments on the original thread re: what appears to be an error RT @DeepMindAI: Teams at @DeepMind_Health and @Moorfields have developed AI technology that can detect eye disease and prioritise patients.… RT @thomaskipf: Outcomes of the ELLIS@ICML workshop: what does the future hold for open academic ML/AI research in Europe? w/ @MatthiasSBau… @hardmaru @arankomatsuzaki ah, true. I was thinking ImageNet for some reason, where it's more reasonable/common. 🤔 fishiness rating updated upwards @hardmaru Yeah at the very least they did not clearly present the results. Should say top-5 explicitly, I’m just guessing from context @hardmaru (haven't looked super closely, though, and trust your fishiness detector better here :) ) @hardmaru Is that crazy (for top-5 which is what I assumed)? It is a bold claim, though. Code is here at least https://t.co/NVAcKzwe02 "How Complex is your classification problem? A survey on measuring classification complexity," Lorena et al.: https://t.co/U0BIG84ryJ "Ensemble Kalman Inversion: A Derivative-Free Technique For Machine Learning Tasks," Kovachki and Stuart: https://t.co/amAAa9sqdC "Error Forward-Propagation: Reusing Feedforward Connections to Propagate Errors in Deep Learning," Kohan et al.: https://t.co/Hmk5V0RTB7 "On the Convergence of AdaGrad with Momentum for Training Deep Neural Networks," Zou and Shen: https://t.co/RtXncEP9L9 "Dropout is a special case of the stochastic delta rule: faster and more accurate deep learning," Frazier-Logue and Hanson: https://t.co/N84tHVOvaV """End-to-end Active Object Tracking and Its Real-world Deployment via Reinforcement Learning,"" Luo, Sun, and Zhong et al.: https://t.co/mHDUBhHxKQ Sim to real transfer for object tracking, with texture/illumination randomization done in ViZDoom/Unreal" @decodyng @mehrjouarash @ch402 @OpenAI (side note: even policy network has another meaning in the government-policy context :) ) RT @dodo: A security camera caught this dog jumping into a pool to save his friend ❤️ https://t.co/73dTC9rk13 @katherinebailey congrats! :) RT @histoftech: This on top of all the voter suppression, propaganda, targeted intimidation, gerrymandering... https://t.co/vu35d9N4fW @timhwang 😍 @michael_nielsen 💯 @KeithMansfield @TheAnnaGat @OpenAI @FHIOxford Thanks, both! :) Yet another variation on the AI/security theme: https://t.co/bTu78QImig @AthertonKD "inexpensive" "RT @jeremyphoward: Now anyone can train Imagenet in 18 minutes https://t.co/xQh0mYqELH The result of our collaboration of @fastdotai and @y…" RT @HaydnBelfield: Come work with us! https://t.co/bPWaqRre4G RT @histoftech: Humbled & excited to announce @proginequality has won the 2018 Sally Hacker Prize from @SocHistTech. The prize recognizes a… @calebwatney https://t.co/qIsoGa44AL "RT @Ocasio2018: “But how are we going to pay for the Space Force?” Oh wait sorry - we only ask that when it comes to healthcare, education…" "Policy Optimization as Wasserstein Gradient Flows," Zhang et al.: https://t.co/AsSvLYWmnC "Image Inspired Poetry Generation in XiaoIce," Cheng et al.: https://t.co/ug6sdxB5rN "Learning to Optimize Join Queries With Deep Reinforcement Learning," Krishnan et al.: https://t.co/hMfSs1EaFQ "RT @vkrakovna: The list of specification gaming examples in AI was featured in Wired! https://t.co/fvbM7LPWyF Thanks everyone who contribut…" RT @Schwarzenegger: Machine learning. https://t.co/ppTR9RqF7q @EvanSelinger and that difference could be a cause for more optimism on FR (modulo authoritarian govts). @EvanSelinger To be clear, I'm a fan of progress in awareness/organizing being made on both fronts, but the discussion hasn't translated into action in the killer robots case so sort of a mixed bag re: optimism. In any case, they're pretty different (less perceived zero-sumness in FR than KR), @EvanSelinger Not a super reassuring comparison :/ @catherineols 🎊👍😍👏 RT @demishassabis: awesome work from the DeepMind team on scalable verification in deep neural networks - an important step towards provabl… @chipro Absolutely! RT @lreyzin: When life gives you lemmas, make theorems. RT @mer__edith: Tech's one of the few domains where (some) workers have leverage. So yes, this is a labor movement. But one in solidarity w… @webdevMason Disturbing lack of Liu Cixin... RT @DeepMindAI: We are excited to see accelerating progress on important questions in AI safety & security, with our recent paper "A Dual A… I like that this can be interpreted as a fist bump. https://t.co/0EtY0oalDH @RikeFranke Dark Forest is my favorite one :) @RikeFranke Have you read Three Body Problem? 💗 @sidneyfussell Prob the right call TBH RT @SophieCFischer: "JAIC: Pentagon debuts artificial intelligence hub" - @JadeFLeung and I argue that the DoD's new Joint Artificial Intel… "RT @histoftech: my car is 18 years old now why can't it drive smh" RT @pushmeet: Our paper on scalable verification of deep neural networks has just received the best paper award at UAI @ACMUIST . Ensuring… @ivenzor 👍 "Rethinking Numerical Representations for Deep Neural Networks," Hill et al.: https://t.co/84WQ39GYkw "Choose Your Neuron: Incorporating Domain Knowledge through Neuron-Importance," Selvaraju and Chattopadhyay et al.: https://t.co/ntmEZxbTUF "L-Shapley and C-Shapley: Efficient Model Interpretation for Structured Data," Chen et al.: https://t.co/I7hu2JSEXd "Backprop Evolution," Alber and @IrwanBello et al.: https://t.co/K8lHC4qXJg RT @dog_rates: Meet Mylo. He’s just checking pup on you. Hopes you had a great day. If not, you can give him a hug or maybe some curly nogg… @jekbradbury Yup. As usual, blame the editors for such things, though :P @catherineols @machinaut @OpenAI @NYUPsych (that sentence kinda trailed off - meant to say "haven't seen either that analogy being made ... very explicitly... or a detailed analysis of skill appearance generally." Which is surprising! @catherineols @machinaut @OpenAI @NYUPsych though often not compositional, and not stuttering into existence, just considered for a bit and then superseded (bad opening moves). Or used more by some types of agents than others (in CTF). There's also stuff like "found Montezuma key then forget about it" in exploration stuff @catherineols @machinaut @OpenAI @NYUPsych So, I haven't seen either that analogy being made (esp. the stuttering part) very explicitly in DRL system analyses, but some of the raw material are there on which such comparisons could be made, e.g. onset of "following flag bearer" in CTF agents, opening moves in chess.. @catherineols @machinaut also AlphaZero @catherineols @machinaut (If I understand the original tweet which I’m not sure I do, havent read paper yet) @catherineols @machinaut Few examples of such things off the top of my head: AlphaGo Zero appendix, DM capture the flag on modified Quake... RT @BulletinAtomic: In June, the Pentagon formally established the Joint Artificial Intelligence Center, whose aim is to accelerate the del… Discusses opportunities and challenges for JAIC, relationships between gov't and industry, signaling to other countries, etc.: "JAIC...presents a timely opportunity for the United States to articulate a robust approach to ethical and safe artificial intelligence." Thoughtful article by my colleagues @SophieCFischer and @JadeFLeung on the Pentagon's new Joint Artificial Intelligence Center (JAIC): https://t.co/CNdpdlLdow Ball Lightning by Liu Cixin comes out next week!!! https://t.co/d8wQ3dg4NE RT @markus_with_k: Fantastic new machine learning book by John Winn, Christopher Bishop, Thomas Diethe! (this is already largely accessible… RT @catherineols: I'm quoted in https://t.co/Gab68VNymm saying "Today’s algorithms do what you say, not what you meant", which feels deligh… RT @ericjang11: New blog post on how Dijkstra's Algorithm (and shortest paths) shows up in unexpected places! https://t.co/DmsCSs3jl0 https… "RT @red_abebe: Very excited to see that in addition to @black_in_ai, there will also be workshops on: Latinx in AI: https://t.co/uutr9IGYe…" "RT @RikeFranke: 'America Is Not Ready for Exploding #Drones' - and neither are most other countries https://t.co/rS7M12SOgc" RT @ClareAngelyn: Wow https://t.co/gUsMgTL6By RT @DeepMindAI: Congratulations to the DeepMind for Google and Android teams who came together to deliver this brilliant work! https://t.co… RT @jjding99: "Trump noted of an unnamed country that the attendee said was clearly China, 'almost every student that comes over to this co… "RT @AIESConf: The 2019 website (with CFP) is now available: https://t.co/ksGaP9xHUy" @j_asminewang @rcalo @OpenAI yep! :) RT @BrundageBot: Structure Learning for Relational Logistic Regression: An Ensemble Approach. Nandini Ramanan, Gautam Kunapuli, Tushar Khot… RT @BrundageBot: Learning to Share and Hide Intentions using Information Regularization. DJ Strouse, Max Kleiman-Weiner, Josh Tenenbaum, Ma… RT @BrundageBot: Unbiased Implicit Variational Inference. Michalis K. Titsias and Francisco J. R. Ruiz https://t.co/VsoMS7bIS7 RT @BrundageBot: Robust Implicit Backpropagation. Francois Fagan and Garud Iyengar https://t.co/twnVVrdeZP @Smerity @OpenAI 💗 @mehrjouarash @ch402 @OpenAI but in the meantime, "the policy team" refers to the former, governance-y, meaning :) @mehrjouarash @ch402 @OpenAI I've always wanted to have a good pun in a paper title about (government/corporate) policies in relation to (AI technical meaning) policies... @HeidyKhlaaf All cool, but the last one is especially crazy!! Must have been pretty far from cities to have that little light pollution. @MsHortonTweets @OpenAI Soon! Still working out details though. @rbhar90 @OpenAI Absolutely!! @rbhar90 @OpenAI Yup! @rao2z @OpenAI Haha :) thanks! @ericbkennedy @OpenAI thanks! San Francisco :) I'm so glad to have had time to explore issues related to AI in an academic context, and can't wait to move into the next phase of my career at OpenAI! /Fin Finally, I'd like to note how amazing of a time I've had at @FHIOxford over the past few years. I'm stoked about the Governance of AI program's continued growth into an academic powerhouse, and speaking of which, we're looking for a great program manager! https://t.co/UprYjax8Tk) Related: I'll soon be living in San Francisco! While I've visited many times, I've never lived there, and look forward to exploring the AI ecosystem there and meeting/seeing many of you soon. Another thing that I really like about OAI is the strong push they're making on diversity in AI, such as through the OpenAI Scholars program. This also includes the policy team (more on this soon!). I'm excited to build on that work there, and explore other big challenges related to ensuring AI's positive societal impact. See e.g. OAI's charter re: some of their concerns and commitments: https://t.co/FEUSYOavNY As many of you know, OpenAI has been quite engaged in policy discussions for quite some time, and they were key players in producing our recent report on the malicious use of AI. I'm super excited to share that I'll soon be joining the policy team at @OpenAI! I'll be working on a range of policy issues related to OAI's vital mission of "discovering and enacting the path to safe artificial general intelligence." @ArtirKel (I wish) @ArtirKel with one GPU! RT @GoogleAI: Inspired by recent progress in neural architecture search, Google researchers explore an automated approach for designing mob… @tsimonite @BrundageBot No comment 🤖 RT @ivan_bezdomny: Some of my group’s work on large scale language modeling. More results to come! https://t.co/HsQoxqrYJV RT @jjding99: We're hiring! Check out the Project Manager role for the Governance of AI Program https://t.co/pfQjxjJy1j RT @ColinKahl: Trump’s non-stop demonization of the media as the “enemy of the people” is clearly shaping Republican public opinion in very… @GoAbiAryan neither! Have some big news to share soon :) This is lit https://t.co/7ITJ0YXkat RT @naotokui_en: Neural Beatbox? RNN-based Rhythm Generation + Audio Classification = FUN! https://t.co/b2yisOG0x1 https://t.co/3YYWmMzK… RT @CBCAlerts: Cadillac Fairview suspends use of facial recognition cameras in shopping mall directories. Background: https://t.co/z2kRi4OM… RT @FeryalMP: Recording of talks from #icml2018 Exploration in RL Workshop: https://t.co/ZXombSopT6 https://t.co/vDtr9d0cdi "Is Robustness the Cost of Accuracy? -- A Comprehensive Study on the Robustness of 18 Deep Image Classification Models," Su and Zhang et al.: https://t.co/GgmJhuqMyf "Distributional Multivariate Policy Evaluation and Exploration with the Bellman GAN," Freirich et al.: https://t.co/ZWMev0rWdC "code2seq: Generating Sequences from Structured Representations of Code," Alon et al.: https://t.co/wnqLrzAINd "Large Scale Language Modeling: Converging on 40GB of Text in Four Hours," Puri et al.: https://t.co/EKMpNxdPSw RT @ScienceNews: #OTD in 1967, Jocelyn Bell Burnell, then a graduate student, discovered pulsars. The discovery garnered a Nobel Prize just… @rebecca_roache 💯 RT @gdb: And now the team is back to work! Kicking off training run for The International on Wednesday, gotta get improvements in by then.… @ArtirKel Dunno @ArtirKel 😍👍 RT @bri_sacks: .@CAL_FIRE says it has "no idea" what Trump's talking about in regards to "bad environmental laws" making California's fires… RT @peterwsinger: Pentagon Signs $885 Million Artificial Intelligence Contract....with Booz Allen https://t.co/zc5xASaNgx via @WSJ RT @timhwang: In collaboration with @knightfdn, the AI Initiative is launching a $750,000 open call for proposals on ensuring that the use… RT @DeepMindAI: On understanding the relationship between visual events and their associated sounds: https://t.co/cFiXyd5OLl https://t.co/w… I love the bit about how they made drafting work. https://t.co/OOKNPWUzPk RT @OpenAI: A major step in our understanding of OpenAI Five: https://t.co/ki0AiB0BIK RT @FHIOxford: FHI is seeking 2 project managers to advance our mission. We are looking for pro-active and driven people who are keen to ad… @_rockt congrats! @timhwang The policy equivalent of “Deep learning has recently enabled substantially improved performance in image recognition [11, 23], machine translation [9], and speech recognition [22, 7, 65].” @mchorowitz @RikeFranke Yeah, and also the lack of non-government sources makes it hard to believe anything... RT @seb_ruder: New NLP News: Future of CV and NLP, Maths (Fields Medal, Maths for ML), AutoML Natural Language, Google Assistant, Cutting t… RT @cbd: Exciting match today! OpenAI Five won first 2 games, and humans won 1 with the audience picking the draft in favor of the humans.… @deliprao @dennybritz ? He was right...? "RT @catherineols: Cool note from @sidorszymon: Q: How could bots learn that killing Roshan is valuable, from random exploration? A: Roshan…" RT @KaiLashArul: Congrats to @OpenAI on their DotA win! Now we have AIs competing with humans in partially observed, multi-agent domains. A… @Smerity Thanks for the commentary!! RT @Smerity: Humans had taken bottom and middle and are now working on top. OAI5 Slark attacked top lane at human's base - good rat tactic… RT @gdb: And that’s game!!!!! Humans win game 3! Congratulations to @Blitz_DotA and friends!!!! Epic https://t.co/V9UZLnyYfy RT @Smerity: For game 3, the OAI5 team are being selected by humans from the audience and/or @Twitch! It would also be fascinating to see a… RT @katyanna_q: Third game: Twitch users can pick heros for OpenAI Five team 😂 RT @gdb: Humans call gg for game 2!!!! OpenAI Five has won a best of three vs top 99.95th percentile of Dota players. Extremely good play b… RT @Smerity: Even if you pushed the OAI5 reaction time to 500ms you'd likely still be annoyed at how well it responded to everything. The i… RT @Smerity: New game starting! They're drafting heroes now. The win probability can show us which heroes OAI5 are afraid of in real time.… First batch of audience players got wrecked #openai5 RT @cbd: Tune in now for our first game! https://t.co/CgDpUh7UGC RT @cbd: First audience game is about to start! https://t.co/uxVX60e0Gi "RT @davidfrum: Out: ""NO COLLUSION!"" In: ""SOME COLLUSION!"" https://t.co/IsFqNh3u7p" Flight to 🇬🇧 delayed :( on the bright side, might be able to catch some of the OpenAI Five event before takeoff! RT @anneapplebaum: Trump is confessing, step by step, on twitter https://t.co/ouktVDlpiy Indeed. Also, anyone seen good ongoing coverage of what, if anything, drone-related actually happened? Seeing lots of articles taking gov’t reports at face value, miscellaneous claims on Twitter... https://t.co/oRgaCPb82p RT @juliaioffe: I’m old enough to remember when this meeting was about adoptions. https://t.co/SZ2FDwsNzO RT @historylvrsclub: Rejected designs for the Eiffel Tower https://t.co/n6KwFyLAPs Very helpful guide! https://t.co/xAQVrqQcqa RT @brianklaas: Foreign regimes that have called the press or political opponents the “enemy of the people” in the past: Hitler, Stalin, Ma… RT @cbd: We’re ready for you! https://t.co/O3HhYxTvql RT @TheOisinMoran: @Miles_Brundage May not have actually been a drone: https://t.co/KaHQlrxZJJ https://t.co/iYxc8IEYi2 RT @Smerity: Tomorrow the @OpenAI Five bots compete against some of the world's best @DOTA2 players in a benchmark match. Many friends aske… RT @JaileneeReyess: Luna’s still scared of showering but she’s ready 😂😫💖 https://t.co/1JOx75tD6n Some folks are gonna make a lot of money selling air conditioning units in Europe in the next few decades. Some AIs are born into greatness. Others have gradients thrust upon them. "RT @JuddLegum: TRUMP: Creates fake university to scam students, pays $25 million fine for fraud LEBRON: Creates top-notch public high sch…" RT @iamtrask: @DeepMindAI If you're interested in trying out the Neural Arithmetic Logic Unit, I'm excited to say there are now 5 implement… RT @SirPatStew: It is an unexpected but delightful surprise to find myself excited and invigorated to be returning to Jean-Luc Picard and t… @mims Modern deep learning and convolutional NNs aren’t synonymous as you suggest. ConvNets are just one type of NN and other kinds are often used for translation etc., especially recurrent NNs (esp. LSTMs). ConvNets are starting to be used in non-image contexts but “aka” misleads. RT @ShannonVallor: This thread is glorious; it also makes my soul shudder. How far we have fallen https://t.co/dykprBhOyH RT @gdb: .@cbd will be joining me tomorrow in livetweeting the Benchmark: https://t.co/zULA7fN02j. Between the two of us should be able to… Very nice city! Prague, cont’d. https://t.co/XqWxvvvw4Y RT @gdb: Stayed up late last night integrating @benbarry's awesome new OpenAI Five logo into the Dota UI. Some features are just worth stay… "RT @iamtrask: @DeepMindAI And another great implementation of NALU in @TensorFlow as a part of @sirajraval 's #100DaysOfMLCode!! https://t…" RT @AyoCaesar: A woman in Denmark was violently assaulted by someone trying to rip off her niqab. The police arrived - not to arrest her as… @chboursin @KayFButterfield (Also an overly confident way of stating the survey results, but the lack of attribution is more glaringly problematic) @chboursin FYI @KayFButterfield this seems to use Grace et al. 2017’s survey results without attribution (hopefully the WEF report cites them, but the video does not). RT @BillSimmons: LeBron is a smart dude (and one of the most thoughtful athletes we have) - this is a bullshit tweet and feels more than a… RT @moyix: We've got a new pre-print out today, on what has been described as a "galaxy-brain idea": making software harder to exploit by *… @MonaJalal_ @nvidia @GrandfatherMtn jealous on multiple levels RT @mattsheehan88: Note to journos writing on Google-->China: censorship wasn't Google's main reason for leaving China in 2010. Primary rea… RT @hollygrimm: Training Atari's Breakout with A2C. Also, Natural Policy Gradients and TRPO during Week 7 of my deep dive into RL: https://… @HaydnBelfield That was a good tweet. Implication: should continue this thread for several weeks. There are object-level issues like Maven/Dragonfly, and there's the meta-level issue of execs pushing projects that people only find out about via leaks. Need more progress on the latter, not just at Google but generally (paper in progress on this! :) ). https://t.co/49Qkx08VN3 (it looks very good, though) "Jumping out of an airplane: ✅ Seeing Christopher Robin (movie): 😨" Possibly a new record for fastest arXiv-->OS code transition. https://t.co/hsHh30KdVn "RT @iamtrask: Very excited to share that @DatazDude has already implemented the NALU in Keras (which was published today)! (If you come ac…" @sidneyfussell (not familiar w/ the confirmation you mentioned, though, just commenting based on quick reactions from folks a while ago) @sidneyfussell thanks for clarifying! my understanding is that talks were nowhere near the level of "contract negotiations." RT @rj_gallagher: A bipartisan group of six US Senators has just sent out a letter to Google CEO Sundar Pichai demanding information about… @sidneyfussell What contract negotiations were confirmed? https://t.co/CdBhDTMKQY RT @SussilloDavid: A few weeks ago, I wrote a thread on my view of the future of systems neuroscience. There were lots of great comments!… @mundoplano Yup, not a sustainable or ethical way to do business (the Maven saga spanned three months) RT @rj_gallagher: Here's the piece: https://t.co/fw8YPTylc3 This is why the “Google will help the Chinese gov’t with censorship but won’t help the US military with fighting ISIS?” narrative is so flawed (among other reasons). Give it a few weeks to play out, at least. https://t.co/J50kJs7QTe RT @rj_gallagher: I worked out the approximate percentage of Google's 88,000 employees who were briefed about the China censorship project… Prague. https://t.co/fktp32APGE RT @OpenAI: We'll be hosting an Intern Open House — Aug 16, 7p at our office in SF. Learn about what our interns have been working on, and… @iamtrask @DeepMindAI https://t.co/E8ej2FjYDk RT @iamtrask: @DeepMindAI Someone on ML Reddit has already written a Keras implementation! https://t.co/khmj7uRUZX RT @DeepMindAI: Neural networks enhanced with Neural Arithmetic Logic Units (NALU) can learn to track time, perform arithmetic over images… "Off to Czech out Prague ✈️ Sorry" @VasekOstrozlik Thanks! :) @VasekOstrozlik Thanks! Unfortunately I have a full schedule :( should have left some wiggle room. RT @ohnadj: New Scholar post: I spent a week interpreting VAE latent space (à la @hardmaru's work on World Models) and thinking about forms… RT @RikeFranke: With some comments by yours truly. No, Germany will not (and should not!) get a nuclear bomb, and yet, I think it is good… RT @ericjang11: "The Devil of Face Recognition is in the Noise" - a very nice paper showing the effect of label noise (human error) on accu… That particular idea is probably bad - hence "e.g." :) RT @BrendanNyhan: We must not become numb to the President suggesting he will lock up his political opponents https://t.co/wrGAaQAvxz "MLCapsule: Guarded Offline Deployment of Machine Learning as a Service," Hanzlik et al.: https://t.co/kALtrGVNvh @mjntendency Indeed :) "Physics-Based Generative Adversarial Models for Image Restoration and Beyond," Pan et al.: https://t.co/bAQfQRDQAE "Learning Actionable Representations from Visual Observations," Dwibedi et al.: https://t.co/hrg24cdPyj Wonder if an analogous strategy could help protect ML systems? E.g. dummy classes far from important decision boundaries that eat up compute time in probing the system... "we instead add large numbers of bugs that are provably (but not obviously) non-exploitable. Attackers who attempt to find and exploit bugs in software will, with high probability, find an intentionally placed non-exploitable bug and waste precious resources" "Chaff Bugs: Deterring Attackers by Making Software Buggier," Hu et al.: https://t.co/rIP64K47t8 "SlimNets: An Exploration of Deep Model Compression and Acceleration," Oguntola, Olubeko, and Sweeney: https://t.co/lytnKArWN8 RT @FedeItaliano76: Julien Gauthier's dystopian, post–global-warming Bangkok inspired by Paolo Bacigalupi's novel 'The Windup Girl' https:/… RT @maosbot: I'm yet to write a bio for myself that I can read without immediately wanting to walk out into the ocean and never coming back RT @jonmladd: In the academic debate over whether people are rational or make decisions based on motivated reasoning and group loyalties, n… RT @hels: Sarah Jeong will outwrite, outthink, and outlast all you motherfuckers but good luck being fragile racist misogynists RT @iamtrask: One of the most exciting papers I've seen at the convergence of #AI and #cryptography - "Blind Justice: Fairness with Encrypt… "RT @gdb: How to watch OpenAI Five Benchmark: - OpenAI Benchmark will be livestreamed in English, Russian, and Chinese - Stream starts 12:3…" RT @trevortimm: Man, this @sarahjeong "controversy" is ridiculous. What has made her such an authentic writer over the years is the funny,… RT @michael_nielsen: These are all wonderful: the 2017 best of "People are Awesome": https://t.co/ACQmU3qxfM Everyone in this video looks v… Nice interview with my brilliant colleague @tanya_skas on the value of careers in operations/management, and related issues: https://t.co/AjwiIvj3oV @hardmaru It was true then, and it's true now! Just a lot of significant advances needed :) Going to Prague for the weekend tomorrow! Never been. 🇨🇿 RT @rebecca_roache: When the excellent @anderssandberg is not ensuring the future of humanity, he is working out what would happen if the e… RT @doomie: Amazon's deep learning model for pricing strikes hard: https://t.co/c2IudATRcD RT @AdaptiveAgents: Predicting Human Deliberative Judgments with Machine Learning https://t.co/ybMtKuSPRm "The Measure and Mismeasure of Fairness: A Critical Review of Fair Machine Learning," Corbett-Davies and Goel: https://t.co/Ahkkz2hWyR RT @Marc_Canellas: Just gonna say, probably not the best idea to turn the main interface into a gaming screen and the car into a giant cont… "Online Adaptative Curriculum Learning for GANs," Doan et al.: https://t.co/khMWtXgK6Q "Efficient Progressive Neural Architecture Search," Perez-Rua et al.: https://t.co/V2Nkg1DH7a "Learning Visual Question Answering by Bootstrapping Hard Attention," Malinowski et al.: https://t.co/VU0tnAPmOO "Manifold: A Model-Agnostic Framework for Interpretation and Diagnosis of Machine Learning Models," Zhang et al.: https://t.co/aEtwFAN7LF @hardmaru Didn't look super carefully but I think last night's mNASNet (https://t.co/JyZcap145y) was a little bit better...in any case, interesting to see various approaches for NAS pursued. "Reinforced Evolutionary Neural Architecture Search," Chen et al.: https://t.co/8IEQJNplKX RT @SallyQYates: Today our president called on his (recused) AG to shut down the investigation of his own campaign. As shocking as that is,… RT @cbd: Some resources to learn more about Dota: https://t.co/qpC2kYX5Mg before OpenAI Five plays 99.95th-percentile players live on Sunda… RT @j2bryson: We’re strictly seeking academic feedback at this point, only just submitted for peer review. #Inequality https://t.co/OnAD6gB… RT @PartnershipAI: We have posted our first Working Group Charters. These are guiding documents which define key questions and consideratio… Cool work analyzing the relationship between types of question answering tasks and the kind of reasoning/knowledge needed to answer them! https://t.co/tlOTjY87Du @rcalo People who hang out with people from Seattle are always in Portland and Berlin :P "RT @kchonyc: ahahaha, my first publication in a ""chemistry"" journal thanks to amazing Seokho Kang! https://t.co/tsDe5GDHoG preprint: htt…" It took a little while from the initial revelations on Maven before opposition crystallized so I wouldn’t say yet that there is a double standard - this is breaking news for many + many more prob still haven’t heard. Will be interesting to see how it goes. https://t.co/dqr7H479wC “With the exception of the late, great Abraham Lincoln, I can be more presidential than any president that's ever held this office.” https://t.co/2AHVYn6M0b RT @EvanSelinger: Reasonable but overly-narrow rebuttal of @ACLU on facial recognition. The issue isn’t if tech can be more accurate than h… Best part is, the obvious defense (well, he meant if you’re buying alcohol) doesn’t apply here because he doesn’t drink and never has. https://t.co/vsrOvDIZrY @bernease Hahaha. I have seen all of it but agree it went downhill! Should have ended with the episode “Goodbye, Michael” IMO. (Was rewatching season 2 when I tweeted this, just vaguely remembered that line and looked it up on youtube) RT @pstAsiatech: https://t.co/Gki1JmEYkR RT @paul_scharre: A must-read on contemporary drone warfare 👇 https://t.co/LyXdo8sf9T @bernease This is what prompted the tweet (though admittedly I haven’t read the whole thing): https://t.co/pkxNUewjKV @catherineols (but that's also an important topic!) @catherineols Sorry, my tweet was poorly worded - I was referring not to human-generated text in papers but model-generated text as a purported interpretability tool. E.g. https://t.co/pkxNUewjKV (not sure if "textual explanation" is the standard word here). Cc @catherineols is this unfair? "MnasNet: Platform-Aware Neural Architecture Search for Mobile," Tan et al.: https://t.co/JyZcap145y "The Devil of Face Recognition is in the Noise," Wang and Chen et al.: https://t.co/oDj4iNZILU RT @negar_rz: #iclr2019 #icml2019 #cvpr2019 all in the US! We can't be really inclusive if we organize all the conferences in a country tha… """Quantum Supremacy Is Both Closer and Farther than It Appears,"" Markov et al.: https://t.co/oHywvwC09h ""As both quantum + classical computing technologies continue to improve and become less costly, quantum supremacy remains a moving target and will require careful comparisons.""" My concern about some papers on textual explanations of deep learning: forcing stuff that isn't actually mapping onto human concepts/words into that format (this doesn't apply to all such papers), giving illusion of progress/understanding. https://t.co/4zyxSe8VxK "Predicting Solution Summaries to Integer Linear Programs under Imperfect Information with Machine Learning," Larsen et al.: https://t.co/qdyA7DYBFf :Count-Based Exploration with the Successor Representation," @cholodovskis et al.: https://t.co/erfvbxoM4p RT @KumarAGarg: Interesting detail in @nature story. https://t.co/c98MZ9iwCS https://t.co/x0NXmZfpTr RT @AIMS_Next: AIMS is thrilled to announce the launch of a one-year intensive African Master’s in Machine Intelligence (AMMI) beginning th… though cf. (in addition to all the other comments/caveats there): "It is not clear whether the White House intends to appoint Droegemeier as an assistant to the president, a position held by several recent White House science advisers" 🤔 Whoa, finally a nominee! https://t.co/G4XOiP11jr (FWIW I think it’s plausible that in some cases we can learn something better than hand-designed solvers, but 1. Usually this isn’t the case so far - learned stuff has typically been worse in various ways, 2. Solvers keep getting better, so constitute a moving target) RT @MariaNoelSJ: This is Alejandro...his father was taken away from him right before his eyes by ICE. Today, he stood before Palantir and d… "Nice talk by Hector Geffner, based on the themes of his paper ""Model-free, Model-based, and General Intelligence"" (https://t.co/DyWjvwoJnH). https://t.co/k1l1KLPOQ4 Those who forget AI's past are doomed to learn worse versions of it using gradient descent." @calebwatney WAIT unless you meant Wall-E in which case I have no beef @calebwatney It is a pretty good movie to be fair, but I just can’t with the other universe thing @calebwatney You would RT @picdescbot: a person in a pool of water in front of a bicycle https://t.co/djzQtqz1B4 RT @Blitz_DotA: My mom just woke me up to say I need to practice for the openai game lmfao "RT @terahlyons: Come meet the Partnership’s Board, staff, and Bay Area community! For our non-local/international friends: we’ll come to…" RT @VitalikButerin: wat https://t.co/f5rVNWbsdC RT @paul_scharre: Yes, a #spaceforce is a dumb idea, but not because @realDonaldTrump said it. The U.S. has real problems in space and a sp… "RT @gdb: If you would like to learn more about Dota in advance of our Benchmark event on Sunday: - Definitive gamer guide: https://t.co/jj…" @soundbitelife It really is! It's Treble Tuesday! https://t.co/1SGzvreiMF RT @katjahofmann: Exciting opportunities! Openings for reinforcement learning postdoc & researcher in my team: https://t.co/PtPSrjy1X0 & ht… RT @annehelen: Abortion isn't something other people do; it's something that a quarter of women — women you live with and work with and are… "RT @ShaneLegg: Learn: 1. linear algebra well (e.g. matrix math) 2. calculus to an ok level (not advanced stuff) 3. prob. theory and stats t…" @AthertonKD Too real RT @SamGregory: .@witnessorg convened a cross-disciplinary expert meeting on addressing malicious uses of #deepfakes. Learn more about what… Reminder that the White House doesn’t have a science advisor. https://t.co/WGgf2OAb8N RT @ashleyfeinberg: now here's a guy who definitely understands what 3D printing is https://t.co/KvVsxTQNJC All [of my] tweets are bad, but some are useful. RT @flagelbagel: great meme https://t.co/d5AW6WliTy RT @goodfellow_ian: https://t.co/hYiWI7ntyk TensorFuzz automates the process of finding inputs that cause some specific testable behavior,… "One-Shot Optimal Topology Generation through Theory-Driven Machine Learning," Cang et al.: https://t.co/WKyGmNgjtv "TensorFuzz: Debugging Neural Networks with Coverage-Guided Fuzzing," @gstsdn and @goodfellow_ian: https://t.co/E7AI9gAatS RT @deliprao: Zero to top-1 % accuracy in 7 minutes on Imagenet. Also 64K batch size? 😱 https://t.co/OKQ4jLhJug https://t.co/uk5XGc26Cl "Visual Analogies between Atari Games for Studying Transfer Learning in RL," Sobol et al.: https://t.co/efj3nS7n6f "Active Object Perceiver: Recognition-guided Policy Learning for Object Searching on Mobile Robots," Ye et al.: https://t.co/ZmUlP0sODS @tkasasagi nor is my 1 :P "Our training system can achieve 75.8% top-1 test accuracy in only 6.6 minutes using 2048 Tesla P40 GPUs." https://t.co/Rb7nLygzOn "Highly Scalable Deep Learning Training System with Mixed-Precision: Training ImageNet in Four Minutes," Jia and Song et al., Tencent: https://t.co/AH3crhdBQH RT @egrefen: Great talk by @LittleBimble at FLoC on Program Synthesis (including our work on ∂ILP), learning rules, and the future of logic… RT @iamtrask: IMO, the next big thing in A.I. is a convergence with #cryptography. Tools for intelligence and tools for trust will make for… @deliprao @togelius @awjuliani Yeah, I suppose - I of course didn't mean to imply that. Just meant that there is a spectrum of org vs. individual centrism, not nec. putting value judgments on different points on that spectrum. "RT @machinaut: Excited to be sharing this with the world! Reinforcement learning in simulation to transfer to the real world! (PS check o…" @togelius @awjuliani There's also a middle ground (in this case, there is a footnote with attribution). @pfau @woj_zaremba (in the interest of being as trolly as possible) @pfau @woj_zaremba Enemies of the People :P @pfau @woj_zaremba (though I guess Neural Architecture Search was pretty compute-intensive and aimed at CIFAR-10 🧐) @pfau @woj_zaremba Perhaps, though to be fair I'd frame it not as "throw as much compute as possible" but "throw more compute at problems where marginal compute helps" - clearly doesn't work for everything, + no one's throwing 10k TPUs at MNIST. RL w/ sim happens to admit of compute scaling. @pfau @woj_zaremba 100 years of manipulation experience. @pfau @woj_zaremba you should tell the AlphaGo/StarCraft teams :P substantially more. @pfau @woj_zaremba haven't read paper yet but highest number in blog post is 100 yrs @pfau @woj_zaremba I assume he meant petaflop-days (the unit used in OAI's AI + Compute blog post), not peta-days. RT @miramurati: Fantastic results from our robotics team https://t.co/l7FNAsJIjN RT @OpenAI: A real robot hand, trained with same learning algorithm and code as OpenAI Five, has learned human-like motions to rotate objec… “Variational Option Discovery Algorithms,” Achiam et al.: https://t.co/LtIc6ihdQP "Symbolic Execution for Deep Neural Networks," Gopinath et al.: https://t.co/KbJwg2ezFC "Discovering physical concepts with neural networks," Iten et al.: https://t.co/i4yG3Ptif5 RT @rcallimachi: The White House requested an off-the-record meeting with the @nytimes publisher, meaning that we couldn’t storify @realDon… @calebwatney Caleb RT @renato_mariotti: The publisher of the New York Times met with Trump to explain the dangers of his attacks on the free press. Trump’s re… @michaelbhaskar @juliagalef’s Rationally Speaking. Great interviewer, interesting topics. RT @jeffparker: I like when people say a particular solution "isn't a silver bullet," because it implies that the problem is a werewolf RT @EBKania: The imposition of arbitrary restrictions on Chinese students and scientists is discriminatory and damaging to U.S. competitive… @mjntendency Zebra crossings?? New to me. @jackclarkSF haven't said that, either. :( I’ve lived in the UK for two years and haven’t said “innit” once. Sad! Big fan of this paper! https://t.co/KiybZ5zUAa RT @TheDweck: Of course Mueller is the guy who flies in a suit and quietly waits in his seat before boarding and Don Jr is the guy who rush… RT @theanhvub: We are going to hire soon a two-year postdoc for a new project funded by the Future of Life Institute to work on evolutionar… "RT @arimorcos: ""Motivating the Rules of the Game for Adversarial Example Research"" Really important perspective on adversarial examples fr…" "RT @dkaushik96: Somebody forgot to read what the article says. h/t @melissagira https://t.co/e4wWGowYzS" RT @jacobandreas: Some thoughts on meaning representations in models without logical forms: https://t.co/NMrgGde4Pa @calebwatney https://t.co/90bjXgwJs2 @pfau That’s what your brain wants you to think. 🤔 https://t.co/dYvetNQE4r It’s Scope-shifting Saturday! https://t.co/aECtWjSgdU RT @alex_peys: Someone in SF just honked and yelled “learn to fucking drive.” It was at a driverless car. @paul_scharre @mchorowitz @pstAsiatech @rshashank_reddy @EBKania @Gregory_C_Allen @drajaykumar_ias @gioasempre @darth_beda *sorry, meant to say US/China. Would guess Canada>UK Having way too much fun coming up with puns for a paper title. RT @esquire: In a rare, unearthed video, Stanley Kubrick explains the ending of 2001: A Space Odyssey https://t.co/YWTtdcnM8a https://t.co/… @paul_scharre @mchorowitz @pstAsiatech @rshashank_reddy @EBKania @Gregory_C_Allen @drajaykumar_ias @gioasempre @darth_beda FWIW I'd guess that Canada is investing more per capita than any of those except maybe US/UK, though that's not the best/only metric of course. And perhaps stronger research-wise per capita than any (same caveat :) ). RT @mattsheehan88: Long story about how Silicon Valley is a "den of spies" (mostly Chinese) out in @politico today by @zachsdorfman. I'll h… @robmccargow Unfollowed :P RT @KumarAGarg: My thoughts in @washingtonpost today on the lack of a US Science Advisor. https://t.co/rsPCSjsfbz @TheAnnaGat https://t.co/nXebz6myWK RT @tallinzen: I'm going to try to live tweet Matt Botvinick's (DeepMind) keynote talk at #CogSci2018. Wish me luck: @ziwphd Also humblebragging is part of the point of twitter @ziwphd I recommend the “new paper on X with Y colleagues (link)” tweet then some follow up tweets w/ key takeaways :) @ziwphd Haha you should tweet it yourself and I’ll retweet :P i was just struggling to find all of my own colleagues to @ them, let alone others’ :) but FWIW i tweet papers that look especially good/interesting! @ziwphd Sorry! I do have it open in a tab. What stronger commitment could there be? ;) P.S. We’re hiring! Currently advertising just for (paid) governance and safety interns but anyone interested in more senior roles is also encouraged to inquire about other opportunities, of which more will open up. https://t.co/1h72JYGkWI FHI also received a separate grant to support Owain Evans’s exciting work on AI safety! Been a big fan of Jose’s (see Measure of All Minds) and Sean’s work for a long time, so it’s exciting to see them getting support to bring rigor to discussions around AI generality, safety, etc. https://t.co/4gFNmy2dr3 Also a workstream involving Ben Garfinkel (not on Twitter AFAIK?) on “strategically relevant properties of AI systems that may guide states’ approaches to AI governance,” building on some of his contributions to the malicious use of AI report and other exciting stuff in progress. Proud that @FHIOxford’s AI governance team has been awarded a grant to accelerate our work in a few areas, including mine on prospects for verifying international agreements on AI, @jjding99’s on China+AI, and @JadeFLeung’s on gov’t/industry relationships! https://t.co/NZoHxU6G9S RT @ylecun: Jitendra Malik, who directs FAIR-Menlo Park, talks about the future of computer vision in his acceptance talk after receiving t… RT @nytimestech: Microsoft employees presented Satya Nadella, the company's chief executive, with a petition signed by more than 300,000 pe… @KarinaVold Cambridge, too? It's in the mall in Oxford everyday... @ziwphd Nope, haha. Only skimmed so far unfortunately. "Learning to guide task and motion planning using score-space representation," Kim et al.: https://t.co/P8gVWtOZIP "Variational Memory Encoder-Decoder," Le et al.: https://t.co/vF2PfCKu6p "LQ-Nets: Learned Quantization for Highly Accurate and Compact Deep Neural Networks," Zhang et al.: https://t.co/itqK0sheEM "Meta-learning autoencoders for few-shot prediction," Wu et al.: https://t.co/wWVHInvge2 "Multi-Agent Generative Adversarial Imitation Learning," Song et al.: https://t.co/egDjuKMFbt "🔽🔽 This general state of neglect is more of a fundamental issue than the specific error rates, which are much worse than is possible with better threshold settings/engineering/etc. Amazon's not only not doing oversight but setting bad defaults. https://t.co/iXXAkTeg7x" RT @DeepMindAI: Learning from Delayed Outcomes with Intermediate Observations: https://t.co/yEFG2uWjCV @drkatedevlin Haha same!! It gets better tomorrow "RT @abigail_e_see: Has AI surpassed humans at translation? Not even close! I've been working with Sharon Zhou on her super accessible @sky…" @VesselOfSpirit @juliagalef Thanks! :) "RT @skynet_today: Has AI surpassed humans at translation? Not even close. Present day NMT systems still fail at many essential aspects of…" @VesselOfSpirit @juliagalef I'd be particularly interested in 2! RT @DeepMindAI: Variational Bayesian Reinforcement Learning with Regret Bounds: https://t.co/JRfsJnm5nq @AdrianBPatter Ppl sometimes say shot: <story X>, chaser: <story Y> Might be doing that meme backwards, but in any case, read Luke’s blog post too! "Shot: https://t.co/jSMsPYM9BT Chaser: https://t.co/qHotkLGpoI" RT @juliaferraioli: If you have not ceded an opportunity that you, yourself, would like to take advantage of to a member of an underreprese… RT @dabelcs: New blog post: https://t.co/pYZ7OOZQSg summarizing our #ICML2018 paper ``State Abstractions for Lifelong Reinforcement Learni… RT @Jackstilgoe: You are not stupid. Academic writing is hard to understand because most of it is bad writing. https://t.co/Ib39wB2ZIf RT @transportgovuk: Have your say on new measures to prevent the misuse of #drones - ensuring they are used safely in the UK https://t.co/R… RT @drjuliashaw: Whether it happens to you or someone you know, Spot helps you record and report workplace harassment and discrimination.… "Iterative Amortized Inference," Marino et al.: https://t.co/NMXGgZQ3aA "Learning Plannable Representations with Causal InfoGAN," Kurutach and Tamar et al.: https://t.co/xKR3hBvQvT "Improved Training with Curriculum GANs," Sharma et al.: https://t.co/PM4TJjB9bD I'm currently suffering from meta-catastrophic forgetting: forgetting about all the old catastrophic forgetting papers whenever there are new ones. Someone, write a good review! "Reliable Uncertainty Estimates in Deep Neural Networks using Noise Contrastive Priors," @danijarh et al.: https://t.co/UiVhQVkzTC "Backprop-Q: Generalized Backpropagation for Stochastic Computation Graphs," Xu et al., Hulu Innovation Lab in China (?): https://t.co/HAgCA5EGrS @tsimonite it worked (I think - just info on the session, no video) @tsimonite thanks! @tsimonite Was this in the main conference track? Having trouble finding on the livestream. Nice ICML talk by Josh Tenenbaum: https://t.co/myOfTgYswB "🆒📖 🔜 https://t.co/fHiBCiwqAt" "RT @DrDihal: I'm in @Nature! @stephenjcave and I wrote 'Ancient dreams of intelligent machines', tracing back our killer robot hopes and fe…" RT @lyla_ray: Learning a language is hard but teaching an AI to understand language is even harder. Chief Scientist @Richardsocher shares h… RT @GretchenAMcC: *slaps roof of grammar* this bad boy can fit an infinite number of sentences in it @jwangARK Edge TPU doesn't do training, though? Google does FL but not with its own chips AFAIK? RT @rothsara: that sentence really turned itself around https://t.co/2XFbjSufia @kateconger Congrats! So well-deserved. RT @mcleavey: I've had an amazing summer so far as part of this group! The more I get to know each of the other scholars, the more I am imp… RT @OpenAI: Introducing our first class of OpenAI Scholars, eight exceptional newcomers to ML: https://t.co/MTtsBpOnmC @kirstengraham @mark_riedl Barging in here, but... I love Travelers!! The Expanse is also very good. Handmaid's Tale doesn't really count (Atwood would say it's speculative fiction, not sci-fi) but still... @dmarthal I would hope that someone is doing these sorts of studies. In my case, I had to some extent bought the hype that it was meat-like before I tried it/went in with that expectation but was still disappointed. RT @jonfildes: Looking for a technically minded sub-editor for a one-off project in late August - early September. DM me if interested or h… @trengarajan For ethical reasons. Yeah if I didn’t like meat, I would prefer stuff that doesn’t taste like meat, but some like me would rather have guilt free meat-ish. https://t.co/PGyTu9sXXL "Hypothesis: Impossible Burgers are convincing only to vegetarians who haven’t had meat in years and forgot what it tastes like.* But I’m glad people are trying hard to make similar-tasting substitutes, and it’s progress, I guess. *And/or the one I had wasn’t cooked well." RT @McFaul: Putin stood next to you in Helsinki and said , ‘yes I wanted him (Trump) to win.’ Did you not hear the translation? https://t.c… "RT @StrongDuality: https://t.co/hvekQVSNR6 is up! Summarizes information about the tasks, answers some frequent questions, and provides a l…" RT @gdb: Looking for Dota teams with average MMR 6k+ to test OpenAI Five in advance of the Aug 5th Benchmark. Interested in playing? Contac… "Meta-Learning Priors for Efficient Online Bayesian Regression," Harrison et al.: https://t.co/QurfXD7tL3 "The Variational Homoencoder: Learning to learn high capacity generative models from few examples," Hewitt et al.: https://t.co/JVFyk0L1CM "Unsupervised Learning of Latent Physical Properties Using Perception-Prediction Networks," Zheng et al.: https://t.co/UWIeopFI3H "RT @RichardSocher: https://t.co/ikPqrzROnj website is up! Slides motivating true multitask learning in AI and NLP from a recent talk: https…" @primalpoly If only that were an option today! (re: well-informed) Call center AI (about which Google made announcement today) is 1 of the only plausible ways that AI could have a big/fast employment impact soon. No robots needed--"just" decent dialogue + connections to APIs--and admits partial automation (humans brought in to address failures). @RebeccaCrootof @cgallello @timhwang @mchorowitz @jackclarkSF @PTetlock @daniellecitron @BobbyChesney I would hope that a decent fraction of those million viewers realized this was satire... RT @radleybalko: The Trump administration kidnapped hundreds of kids, then deported their parents. They willfully inflicted lifelong psycho… "RT @chelseabfinn: Students at MILA released a clean pytorch implementation of MAML for RL: https://t.co/EF7Ayg94zh https://t.co/FY6QpN2Qpb" RT @gdb: New wall of graphs showing what OpenAI Five is predicting. Aiming to integrate these graphs directly into the game client by Aug 5… RT @drfeifei: We are excited to announce new AI products AutoML Natural Language, AutoML Translate and Contact Center AI to empower industr… RT @katecrawford: So I gave a talk at the @royalsociety last week. Seemed like the right time to discuss the political landscape we're in,… RT @LizEconomy: Xi himself has linked the government’s capacity to protect the people’s well-being to the legitimacy of the Party--latest v… David is the Michael Jordan of conference notes. https://t.co/isQEsbZhdH @sknthla It is and it’s glorious RT @juliagalef: I had a wide-ranging conversation w/Dean Simonton on this week's episode of @Rspodcast: what determines who becomes a "geni… "EnsembleDAgger: A Bayesian Approach to Safe Imitation Learning," Menda et al.: https://t.co/e7p7P9pFSZ RT @khimya: Our paper on Safe Option-Critic is on arxiv now. @rllabmcgill https://t.co/YZimqWjQsd """Baidu Apollo EM Motion Planner,"" Fan et al.: https://t.co/JPrbrCxHk4 ""As of May 16th, 2018, the system has been tested under 3,380 hours and approximately 68,000 kilometers (42,253 miles) of closed-loop autonomous driving under various urban scenarios."" And open source!" "Explainable Neural Computation via Stack Neural Module Networks," Hu et al.: https://t.co/q1pd90vtWx "Towards Neural Theorem Proving at Scale," Minervini and Bosnjak et al.: https://t.co/SddWEoOhgP @calebwatney Caleb. @calebwatney There are so few that are non-trivial and falsifiable that it's not really worth writing down, haha. I attend to this in my head but no, not written down anywhere. "NullaNet: Training Deep Neural Networks for Reduced-Memory-Access Inference," Nazemi et al.: https://t.co/0ei3FMIjxb "Recent Advances in Convolutional Neural Network Acceleration," Zhang et al.: https://t.co/n0QpOXcXue "Implementing Neural Turing Machines," Collier and Beel: https://t.co/s61aylGkWq "Generalization Bounds for Unsupervised Cross-Domain Mapping with WGANs," Galanti et al.: https://t.co/PsgVbkRJK7 "Contrastive Explanations for Reinforcement Learning in terms of Expected Consequences," van der Waa et al.: https://t.co/9Z6RPDrfoO "Safe Option-Critic: Learning Safety in the Option-Critic Architecture," Jain et al.: https://t.co/yHZksbU8YL "Learning Heuristics for Automated Reasoning through Deep Reinforcement Learning," Lederman et al.: https://t.co/LCMREw4F4Q @RoyaPak @jackclarkSF @jjding99 @rohinmshah Thanks, will check it out! @EBKania Thanks for flagging! Will check out. Did he/anyone else in USG mention AI to your recollection? (Generic + unfalsifiable don’t always co-occur, but most forecasts are at least one or the other - e.g. in the one I quoted is falsifiable but there’s practically zero chance it will be falsified, because it’s so vague and obvious) Most such articles in the mainstream press are just glorified hype/self-promotion by dubious companies/VCs, unfortunately. Would like to see more actual efforts at short-term forecasting. More discussion here: https://t.co/34fzupbtrl There are some good ones, but typically not at places like Forbes :/ e.g. props to @DrLukeOR for making specific forecasts on AI and health and following up to grade them later! "Remarkable how generic/unfalsifiable most “what to expect from AI in 2019”/“10 AI forecasts for 2019” type articles are. E.g. “New Uses for Machine Learning Across Multiple Industries.” O RLY? https://t.co/20JtigLQLw" (The last one is perhaps the most insider-y in that it sometimes assumes familiarity with specific debates/authors related to long-term AI safety, but has useful stuff on a range of topics/timeframes, as well) There are many good resources for staying up to date on AI stuff these days. Three of my favorites are @jackclarkSF’s, @jjding99’s, and @rohinmshah’s newsletters, focusing on AI research/policy, Chinese perspectives on AI, and AI safety, respectively. RT @NarangVipin: If *only* there had been an agreement to do precisely that 🤔 https://t.co/yNTOSP0iqT RT @McFaul: One piece of good news from Helsinki; Putin suggested that he and Trump had agreed to extend the New START Treaty, or as he sai… Nice ICML tutorial on imitation learning from @yisongyue and @HoangMinhLe: https://t.co/Amh2R0V94z "RT @math_rachel: my new post: Is Google AutoML the key to democratizing AI? https://t.co/b5kxp3lmEw" @ArtirKel Lower humidity reduces the subjective delta, but yeah still prob worse Ban heat waves. RT @Miles_Brundage: "Strengthening Checks on Presidential Nuclear Launch Authority," Bruce Blair: https://t.co/GfTdilUa3I RT @gdb: Latest version of OpenAI Five had a neck-and-neck match against a team of 5-6.5k MMR players, winning 2/4 games (win-loss-loss-win… "RT @sahilkapur: Trump has repeatedly depicted war with Iran an something a president would do for domestic political gain. Here are four e…" It’s Morality Monday! https://t.co/bGsoQqWcRO RT @nytimes: Chinese parents were in an uproar on Monday amid reports that hundreds of thousands of children might have been injected with… RT @Micropicss: Ant pushing a water droplet https://t.co/9NHw0aiBYZ @deliprao 😍 RT @BrundageBot: Physical Adversarial Examples for Object Detectors. Kevin Eykholt, Ivan Evtimov, Earlence Fernandes, Bo Li, Amir Rahmati,… RT @NarangVipin: He sent this at 11:24pm. If the president decided to order a nuclear launch against Iran, he could do it and no one might… RT @catehall: “Women are too emotional to be president” https://t.co/t6Ec0GT3IR @XandaSchofield I liked it "Eyeriss v2: A Flexible and High-Performance Accelerator for Emerging Deep Neural Networks," Chen et al.: https://t.co/VnaEWwbdj5 "Multitask Reinforcement Learning for Zero-shot Generalization with Subtask Dependencies," Sohn et al.: https://t.co/sSAoNKxAOt @juliagalef (not perfect - haven't looked into whether those letters are more likely to be at particular slots/how word length fits in. Perhaps you could randomize the slot choice based on some letter/other factor, or have a good general purpose choice of slot, for sufficiently long words) @juliagalef Seems like you could simplify this, as long as the second word you jump to is reasonably random. E.g.: if the xth letter of the second word is A-M (except for G), 1. Else, 2. Based on letter distributions from https://t.co/hKvc4c95CM, this is v. close to random (N-Z+G=49.95%). RT @KevinMKruse: I’m starting to understand how he somehow managed to go bankrupt as a casino owner. https://t.co/5kzQ4tIDKl RT @black_in_ai: We're excited to announce the Call for Participation for the 2nd Black in AI Workshop at #NIPS2018! Submission deadline is… "RT @rosenbergerlm: A few quick thoughts on the Trump admin's flailing on North Korea - I'll skip over the we-told-you-so part... 1/ https:…" RT @patrickshafto: New paper in which we formalize Active learning as self-teaching. https://t.co/2Cx8P0dERc with Scott Yang and @wkvong RT @ChrisMegerian: “White House aides fretted that Trump did not recognize the massive diplomatic and security implications of turning Amer… RT @TheRealBuzz: I was on the Moon! #Apollo11 @NASA https://t.co/6Nb2cQVU32 Seems obvious that you should have some gaps between you or have multiple rows/amoeba like group formation... and yet. Individuals walking slowly in not-too-crowded public places are okay - easy to get around. Phalanxes of people walking slowly are not. RT @seb_ruder: Did your approach achieve a new state-of-the-art at #ACL2018? Did you propose a new dataset or task? Add it to this living c… RT @catherineols: If you know what adversarial examples are, and you think they probably seem important... but you're not sure *exactly* wh… https://t.co/12JnI8oSDF RT @NBCNews: President Trump has arrived at his New Jersey golf club, marking his 129th day at a Trump golf property and his 172nd day at a… @richardtomsett @jekbradbury It’s also the name of a difficult Atari game. RT @jekbradbury: https://t.co/hlpebKJryH "RT @jesslynnrose: Siri, show me a tech job advert that's built entirely of red flags. https://t.co/ParHYGYh1q" (The suspicion is mostly because it’s an ill-posed question to begin with, not any beef with the authors) "Curious about the methodology behind this list. Suspect it’s poopy but the order of magnitude sounds about right. H/t @HMRoff https://t.co/eTEHyq7f2I" @AthertonKD @C4ISRNET Re: “to date no domestic terrorist within the United States has attempted terrorism by drone,” https://t.co/sC1v8RREve Dear UK: you’re too hot RN. Please stop. Thx @mikarv It’s def. been discussed, though too lazy to track down cites RN. More of the former though. @gdb FYI, quoted this in the context of AI forecasting being hard just a few hours later :) https://t.co/VIzULNv6Ze New paper by my @FHIOxford colleague Eric Drexler on the origins of life: "Molecular Imprinting: The missing piece in the puzzle of abiogenesis?" https://t.co/J9P2RehhwZ RT @thegarance: Michael Cohen Secretly Taped Trump Discussing Payment to Playboy Model via @NYTimes https://t.co/48sPEgTiwQ "Slides from my talk at @MindFoundry earlier: ""Challenges in Forecasting AI Progress"": https://t.co/VIzULNv6Ze Thanks @tosiales and @maosbot for hosting me! https://t.co/bqdCXgJC3r" From slides in progress: naive trend extrapolation has worked surprisingly well in my experience in the Atari domain. I'd be very surprised if an expert survey would have done this well in April 2016, even though there's room for disagreement re which recent data points to count. https://t.co/uXR36drIN7 Looking forward, as well! Will probably tweet my slides later. https://t.co/myMXDZsHXz @mark_riedl And hot sauces RT @ajmooch: Is an ensemble of Adaptive Neural Trees an ANT Colony? https://t.co/MGCrUhnimo "RT @maithra_raghu: Motivating the Rules of the Game for Adversarial Example Research: https://t.co/Ih9VzOZugx Fantastic and nuanced posit…" "RT @gdb: Looks like there's a prediction market for whether OpenAI Five will win on Aug 5th: https://t.co/UHhMG6V2cu Currently at 61% in f…" RT @attackerman: Fun fact: confronting domestic radicalization is supposed to be the Department of Homeland Security's job (and DOJ's & FBI… RT @mustafasuleymn: @FLIxrisk has put together an invaluable map of the AI policy landscape. Good work. https://t.co/gY1HSvvhaQ RT @drewharwell: New: How Amazon's Alexa and Google's smart speakers leave certain voices behind. We teamed up with researchers for a 100-p… "🔽🔽 https://t.co/ogf21aFmlt" """stopping terrorism, security for Israel, nuclear proliferation, cyber attacks, trade, Ukraine, Middle East peace, North Korea and more. There are many answers, some easy and some hard, to these problems...but they can ALL be solved!"" - @realDonaldTrump https://t.co/leCT8ftXdQ" Big fan of both the paper and the blog post. I love ideas like this that are easy to explain/understand and obvious in retrospect: work backwards from a particular solution to a problem and progressively do more of the solving yourself. https://t.co/LCdw9F5dgi RT @Sheeds_au: LOL https://t.co/2wJg6AJw2J RT @zeynep: I should add that what should be banned and what should not be rewarded with attention is tricky... Every solution has downside… RT @GoodAIdev: Results announced for Solving the AI Race round of GoodAI @AI_Challenge! $15,000 of prizes awarded. Find out who won prizes… RT @mattblaze: I meant DON'T launch the missiles. https://t.co/rDNEmeWW6n @rebecca_roache How about Somewhere Over the Rainbow? @hare_brain @_EmmaGH #lifegoals RT @ankurhandos: Robot learning in homes. Interesting approach ala arm farm but with low cost robots like Dobot. https://t.co/6ZMlgcj0kP ht… @SmithaMilli Your tweets are so much better than mine. RT @alex_peys: New paper with @cinjoncin, Roberta Raileanu + others on RL backwards (how we teach chess in Russia!). @OpenAI blog concurren… RT @KaiLashArul: Adaptive Neural Trees - @RyutaroT92, myself, D. Alexander, A. Criminisi and A. Nori @MSFTResearchCam: https://t.co/ZB7da18… "General Value Function Networks," Schlegel et al.: https://t.co/vnBRTJIRge "On Evaluation of Embodied Navigation Agents," Anderson et al.: https://t.co/tBFUNJRu4J @jekbradbury (watches a bit more of the vid) both the alleged perp and the alleged victim have silly hair! OK, I'll stop now, but someone had to say it. @jekbradbury it's hair-related crime all the way down @jekbradbury the real crime is that guy's hair in the video, no? RT @jekbradbury: This is a pretty incredible story: former Google eng "alleges that [Pinscreen] submitted false results to SIGGRAPH" and th… "Motivating the Rules of the Game for Adversarial Example Research," Gilmer and Dahl et al.: https://t.co/3TqPytOjNV "Adaptive Neural Trees," Tanno and @KaiLashArul et al.: https://t.co/g6u8pVVXcM "Integrating Algorithmic Planning and Deep Learning for Partially Observable Navigation," Karkus et al.: https://t.co/i3hY1QgPIj "Efficient Deep Learning on Multi-Source Private Data," Hynes et al.: https://t.co/8OVREXuuuR "Towards Automated Deep Learning: Efficient Joint Neural Architecture and Hyperparameter Search," Zela et al.: https://t.co/Dqywsj4qQz "Learning Noise-Invariant Representations for Robust Speech Recognition," Liang et al.: https://t.co/A07BQq7V1s """Backplay,"" Resnick and Raileanu et al.: https://t.co/Du0RJFYk3R Similar to the recent OpenAI Montezuma's Revenge blog post." RT @JamesGunn: Yup. https://t.co/h9Ycj6T6pG Just seeing this McFaul stuff now. JFC. @rodolfor @TheAnnaGat Just want to note that this is one of the fastest Twitter dialogues I’ve seen. 👍 RT @SenJohnMcCain: The people of #Montenegro boldly withstood pressure from #Putin’s Russia to embrace democracy. The Senate voted 97-2 sup… RT @mattblaze: In "The Americans", infiltrating the US involved lengthy legend-building, impossibly elaborate opsec, and sophisticated supp… RT @vkrakovna: Note that this job posting is for full-time positions only. If you are interested in doing an internship with the safety tea… "RT @JanelleCShane: When we envision the AIs of the far future, maybe WALL-E and C-3PO aren’t the droids we should be looking for. New arti…" RT @gdb: Machine learning allows for rapid progress — in one month, we removed significant restrictions such as wards and Roshan, which man… RT @OpenAI: We’ve removed the most significant restrictions on OpenAI Five’s gameplay — wards, Roshan, mirror match. We'll play 99.95th-per… @williamstome @Thomas__Arnold evergreen strategy RT @Comey: This Republican Congress has proven incapable of fulfilling the Founders’ design that “Ambition must ... counteract ambition.” A… RT @RikeFranke: "...the pledge calls on governments to agree norms, laws and regulations that stigmatise and effectively outlaw the develop… BRB learning Chinese just so I can fully enjoy this bookstore. https://t.co/ul5raNtnyg @tetisheri 👍 RT @RikeFranke: Angela Merkel turns 64 today. https://t.co/h1u4SBO8su RT @jbouie: For eight years right-wingers spun conspiracies about the black president who wants to subvert the United States, and then they… RT @Miles_Brundage: Exciting opportunity to work on AI safety with a great group of folks at DeepMind! https://t.co/NjTmbDlG61 RT @melissakchan: The world moves on without America. https://t.co/4M5oH30GZA RT @Erie: Please no one ever tell my dog that he’s not actually helping https://t.co/wBLSzjiyWP RT @tomgara: Imagine being so spiritually broken that you can't sit on a bench on a beautiful English summer day and appreciate the scenery… @williamstome Like “keezer”? “Kazer”? RT @williamstome: HCII2018 problems: There is a part of me that desperately wants to approach the Caesars Palace staff with a question and… "IntroVAE: Introspective Variational Autoencoders for Photographic Image Synthesis," Huang et al.: https://t.co/1QG9ZHd02C "Generative Adversarial Imitation from Observation," Torabi et al.: https://t.co/YQTUiHtKhZ "Shielded [Safe] Decision-Making in MDPs," Jansen et al.: https://t.co/gVyV6Hdlnt "Interpretable Latent Spaces for Learning from Demonstration," Hristov et al.: https://t.co/vYt2UlsjKN "Contextual Memory Trees," Sun et al.: https://t.co/zhlr5qD5gl """Icing on the Cake: An Easy and Quick Post-Learning Method You Can Try After Deep Learning,"" Konno and Iwazume: https://t.co/viCEPMcdKk 🤔" @drewharwell @schwanksta I'm glad folks are scrutinizing this stuff, as it's suggestive of possible concrete products, but FWIW those two things aren't inconsistent in my view. Lots of patents are filed/not actually productized. "RT @Skiminok: New blog post: ""Program Synthesis in 2017-18"". An update on our 18-month old program synthesis survey, highlighting the most…" RT @lorandlaskai: China’s AI industry gets the most funding, but lags the US in key talent, says Tsinghua https://t.co/HEJkm6DVf0 @KarinaVold @CanUKFoundation @opdacam Congrats!! "Do not let perfect be the enemy of the good"- nice "amicus brief to the moderator" of the #ICMLDebates session on security (me) which I unfortunately didn't get a chance to read til now. Worth checking out for those interested in keeping the convo going! https://t.co/MucTyTUrMp Exciting opportunity to work on AI safety with a great group of folks at DeepMind! https://t.co/NjTmbDlG61 @maosbot Provocative/possibly wrong things are a good use of Twitter. I see it as a spectrum of optimal confidence levels across media, with Twitter being used more for exploration/feedback on wrong things, papers/books more for exploitation, and blog posts in between. RT @Noahpinion: Sigh. There I go, being a stickler for econ definitions, and then thousands of Republicans grab my tweet and use it to dunk… RT @vkrakovna: We now have an official job posting for DeepMind's AI Safety team! Please apply and/or forward to interested candidates :).… "RT @tkasasagi: |￣￣￣￣￣￣￣￣￣￣￣| ARTIFICIAL ""INTELLIGENCE"" |＿＿＿＿＿＿＿＿＿＿＿| (\__/) || (•ㅅ•) |…" 🤔 https://t.co/DVqSUbZ598 "Remember and Forget for Experience Replay," Novati and Koumoutsakos: https://t.co/uihmgQ0wzQ "Meta-Learning with Latent Embedding Optimization," Rusu et al.: https://t.co/YiUkvFtAUF RT @POLITICO_Steve: This @SenJohnMcCain statement is extraordinary for a senator to make of any president, let alone one in his own party.… Almost back to 🐂ford, 🇬🇧! "⬇️⬇️ https://t.co/Q2hYnNR2Q5" RT @AshleyRParker: Putin, a former KGB spy chief, has a pretty good poker face. BUT even he looks like he can't believe his luck, as Trump… RT @shaneharris: The President of the United States, given repeated opportunities to unequivocally stand with his government against the cl… “Model Reconstruction from Model Explanations,” @SmithaMilli et al.: https://t.co/M1gKXs9rd0 @calebwatney Multiverse brain @shyamal_chandra @facebook Don’t know if anything was recorded, don’t think so but cc @timhwang @ankurhandos @tdietterich A la: https://t.co/5xmw39eiNP Nice few days in Stockholm! Greener than I expected. See you soon 🇬🇧! https://t.co/3s2gkCATCI @ankurhandos @tdietterich Colorful language to describe overuse of anthropomorphic terms in AI papers Thanks to everyone who participated in, tweeted about, and watched the #ICMLDebates today! :) @rivatez What a coincidence that someone with that last name would end up being a catsitter... "RT @markus_with_k: .@AnimaAnandkumar kicking off the debate on #DeepLearning at @icmlconf Proposition: “Current and foreseeable deep lear…" Fairness session getting started at #ICMLDebates between Rodrigo Ochigame, Ben Green, Edward Raff, and Alex Chouldechova, moderated by @catherineols https://t.co/7iJrTbI19L @NandoDF @timhwang Agreed. @skrish_13 @zacharylipton @jekbradbury @AlexIrpan Not officially by us but maybe bootleg :) cc @timhwang @skrish_13 @zacharylipton @jekbradbury @AlexIrpan No unfortunately @NandoDF @timhwang Can’t speak for majority (+not moderating this session so not in position to inject the Q myself) but FWIW my coauthors and I discuss this issue on pages 54-55 + 86-89 here: https://t.co/aBFAIzL5ke Some spiciness injected into #ICMLDebates by a Q from @tdietterich on anthropomorphic terminology @NandoDF cc @timhwang #ICMLDebates The relevant hashtag is #ICMLDebates btw Getting ready to start! https://t.co/wuizluXnMJ ICML debate workshop starts soon! https://t.co/SPRWC6zcQA RT @zacharylipton: Today at 11am, I'll be presenting the arguments from Troubling Trends in ML Scholarship (https://t.co/xrifOMQDXt) at the… @ram_ssk Thanks! Will check out when at my laptop :) @phileisn Yep! Hopping around a bit :) "Me: I think I’ve mastered this whole jumping around between timezones thing, will sleep normally tonight Stockholm: is light outside at midnight" @pfau May have also been bc it was soonish post-YouTube incident, as well, dunno. @pfau It has happened to me at DM once before, when there was a big group of people visiting so harder to keep track of I guess. Does seem rare, though. RT @RealAshEdwards: Make sure to stop by the GoalsRL workshop tomorrow if you're at ICML! Check out the schedule and accepted papers here:… RT @tdietterich: The schedule for the debates has changed to accommodate the World Cup final. Our debate will now be at 4pm. #icml2018 #ijc… RT @iamtrask: For anyone interested, I'm (mostly done) writing a book which teaches Deep Learning using intuitive examples more than math.… 🇶🇦🔜 🇸🇪 @Zergylord Whose keynote? RT @LBC: Watch live at the Trump baby balloon is flown above Parliament. #TrumpVisitUK https://t.co/Ss95VMEX5d RT @santoroAI: How do our learning algorithms stack up? Check out our #ICML2018 workshop paper, Assessing the Scalability of Biologically-M… @dribnet (Written from a layover in Qatar 😬) @dribnet Thanks, yes, I am aware of the dark underbelly of Singapore’s positive sides. RT @L_badikho: Hello #ICML2018, I'm giving two long talks at the intersection of security (poisoning attacks), optimisation & distributed s… @histoftech Your work is so cool! RT @OscarWGrut: Goldman Sachs is having a bad world cup https://t.co/hfsHgLiaZv "🔽⬇️⬇️ https://t.co/DBDq6zHVQq" @EBKania Thanks! Hadn’t heard the second one but the first one is super pervasive, very annoying, RT @EBKania: Just a quick public service announcement, the Chinese government has *not* announced that it is spending $150 billion on AI, a… @lzamparo @deliprao Not a matter of $ - physically, many airports in the US are fine. More a matter of policies (but I agree political will is an issue). RT @dog_rates: This is Badger. Today he embarks on his first plane ride. Already checked a bag containing a single stick. 13/10 safe travel… RT @OriolVinyalsML: Universal Transformers propose to augment Transformers with Recurrence in depth and Adaptive Computation Time. This mod… Also, having one person at a time and someone helping you put stuff into the bins etc., plus ample staff, is way better than the typical approach. A+, Singapore. Update: there was indeed very fast and efficient screening at the gate. Why don’t all airports list instructions for what you have to take off, etc. on the wall instead of rapping it at you or treating you like an idiot when you don’t guess which of a zillion policies they have? The delicious culprit in question https://t.co/0SiI7f9ALg "Me: this spicy beef brisket noodle soup is delicious Also me: https://t.co/P2S6m6NeCw" "RT @Rochelle: 7 years ago today, I left an abusive marriage. If you’re in a similar situation, are ready to leave, and don’t know how to…" Update: sounds like I got overly excited re: security. Still, this spicy brisket soup plus the other things (and a butterfly garden?! H/t @jackiesnow) may still push it over the top. https://t.co/Beu5w0MSa8 Oh, and food!! Changi airport in Singapore is now officially my favorite airport to fly out of, by far. Nice aesthetically, great service, A+ bathrooms, and most importantly, no security theater/hassle, just passport + thumbprint (/wait for a minute while they look at you on camera? Not sure). https://t.co/1WMxjvLPba RT @thomaswright08: A thread on Trump's Europe visit. The big story so far is not the NATO theatrics which he orchestrated. It is the real… See you soon, ML folks in Stockholm! :) RT @shakir_za: Oh dear🤦🏾‍♂️Machine learning in the gov brexit white paper (S20): "This could include exploring how machine learning and art… @fr47123 Didn't have a ton of time to be picky - mostly just tried random stuff at random food courts but it was all good. Last food court stop of the Singapore trip! Yummy. https://t.co/uewT7GW5c5 @MargotKaminski @j_simonson @brooklynlaw Thanks!! RT @Miles_Brundage: Enjoyed participating in an Interpol-UNICRI event on uses of AI and robotics in law enforcement over the past two days.… @MargotKaminski Could imagine the original claim being wrong in some jurisdictions with especially good policies.... or not, lots of smartphones out there. 🤔Lots of good data resources on police use of violence but AFAIK nothing quantifying stuff like this (resignations over social media flap). @MargotKaminski Yeah, that's kind of what I meant with "associated [often bad] policies" Would be interested in any quantification of the idea (which seems plausible) that citizens with smartphones in the US + social media have been more effective at holding police accountable than body cameras + associated transparency policies so far. https://t.co/rI3Eb34YB8 Fourth, companies looming large is, again, not just a US/China thing. Much commercial activity in this space, and this connects directly to the widely varying technical capacity issue. Some can do this totally on their own, others have to buy it wholesale, others in between. /Fin Third, the specific issues vary a lot across countries. Among other sources of variation are the different threat models/(human) resource constraints motivating specific projects, public trust in/accountability of law enforcement, degree of government technical capacity, etc. Second, no country really has a perfect policy regime, and no individual/organization has a perfect policy proposal, to address the full range of topics raised by AI + robotics in LE. There's so much going on already and possible in the future. First, lots of activity on these fronts on every continent, except perhaps Antarctica. People talk a lot about China and the US but it's a much more global/complex situation than that. Countries represented included Japan, Netherlands, Bahrain, UK, etc. etc. Enjoyed participating in an Interpol-UNICRI event on uses of AI and robotics in law enforcement over the past two days. Four miscellaneous thoughts on related themes: First, lots of activity on these fronts on every continent (except perhaps Antarctica). People talk a lot about China and the US but it's a much more global/complex situation than that. Countries represented at meeting included Japan, Netherlands, UK, Bahrain, Singapore etc. etc. @ziwphd That’s what @BrundageBot is for, though technically it just reads all the abstracts. "Debates workshop Sunday!!! https://t.co/ByAffPoo9P I'll be moderating the security one - super excited for it :) https://t.co/m5GsboHnb7" RT @brianklaas: It’s impossible to overstate how dangerous this is for international security. https://t.co/mh2XECws2n "TherML: Thermodynamics of Machine Learning," Alemi and Fischer: https://t.co/WlMNjuBVKz @tdietterich Nice! Sad to be missing :( not there yet, just coming for workshops. But hope to catch the video later! "Deep Structured Generative Models," Xu et al.: https://t.co/diqVlBwxTA "A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks," Lee et al.: https://t.co/4kqBEFPVQ0 "Universal Transformers," Dehghani and Gouws et al.: https://t.co/QKs1nt0eRu RT @wafaie_fawzi: Great paper outlining top ten humanitarian grand challenges and ‘call for a reduction of the distinction between humanit… Nice post by my colleague on how the trend toward more expensive AI experiments can't continue much longer, and related issues. https://t.co/h5VOQtNOap @LeahMatchett1 Congrats!! RT @mchorowitz: Really interesting report on Islamic State #drone use https://t.co/qKDnwZl1Rx "RT @RikeFranke: #NATO's unofficial motto was “to keep the Russians out, the Americans in, and the Germans down"". Today, EU NATO members an…" RT @BrundageBot: arXiv papers, July 12, 2018: RT @juliaioffe: Ran into an old source from Moscow here in Brussels and asked him how Moscow sees Trump. “As a total idiot, a useful batter… RT @sidneyfussell: spoke to members of axon's AI/ethics board about police drones. tech companies champion public safety, but refuse to adm… RT @arimorcos: How do we rigorously measure abstract reasoning capabilities in neural networks? Can we clearly defined different types of g… @calebwatney So real @jjvincent @davegershgorn sorry again guys @ankurhandos LOL @mikarv @icmlconf thanks! Though for the record, I'm definitely in the "et al." part :) @timhwang, @catherineols and others have done more, I just tweet a lot and helped a bit. RT @DeepMindAI: Measuring abstract reasoning in neural networks - our latest #ICML2018 paper - takes inspiration from human IQ tests to exp… RT @rubinovitz: Anyone on bio twitter know of a good ECG to buy that is research grade and will write to a CSV for analysis (or easily conv… RT @jjding99: Breaking: China's Shandong Province cracks major case on privacy violations by tech companies: 57 individuals arrested, 11 co… RT @beenwrekt: The slides and some links to references and supplementary material can be found on the tutorial website: https://t.co/Se4UH1… RT @DrLukeOR: Over recent months we've seen worrying signs that regulators and governments are not worried enough about #medical #AI safety… RT @RichardSocher: We are looking to expand Salesforce Research with more directors to lead their AI groups. Freedom to choose your researc… RT @HoangMinhLe: Different types of imitation learning explained by @yisongyue at #ICML2018 conference tutorial session! @icmlconf https://… "RT @avdnoord: Our latest work is out! Representation Learning with Contrastive Predictive Coding (CPC). Autoregressive modeling meets cont…" RT @hlntnr: You all keep asking me how China is, so I decided to take the note I'd been keeping on my phone with odd things about life ther… "NAPS: Natural Program Synthesis Dataset," Zavershynskyi et al.: https://t.co/GKT1Q6s5RL "Anytime Neural Prediction via Slicing Networks Vertically," Lee and Shin: https://t.co/rIyc8B5DFh RT @NalKalchbrenner: Exciting news: @Google Brain expands to Amsterdam 🚲🚣🌳 Looking forward to working on core AI challenges with @TimSalima… RT @calebwatney: FYI for anyone interested, the FTC is accepting comments on a range of AI questions, including a spicy one on algorithmic… @TheAnnaGat cc @Ahaverine @egrefen @BrundageBot I would respond to that one! Recruiting emails that start with “Dear Researcher” are the work equivalent of negging. Don’t do it. @GoAbiAryan https://t.co/lr9GlGlxKl @GoAbiAryan https://t.co/4iEHm92HcE @GoAbiAryan This is suspiciously Abi-specific advice ;) 🍕 @hardmaru I’ll be there soon! Quick detour :) Update: got into my hotel room! In other news, I am never leaving. https://t.co/jOq9pADZxp RT @BrundageBot: Pioneer Networks: Progressively Growing Generative Autoencoder. Ari Heljakka, Arno Solin, and Juho Kannala https://t.co/OA… @chrisalbon Neither am I but sometimes one weakness (a penchant for Diet Coke) helps with another @2020science Will check it out! @deliprao 17 https://t.co/5SBrvMq0Lo @deliprao I rarely write papers that have any math or other fanciness @deliprao Docs. @Rsnuzum A sense that enviro/energy was more saturated with policy type people and close to being “solved” from an analytical perspective (though not a political one), whereas AI was (/to slightly lesser extent still is) wide open/neglected on both fronts, in addition to being important. @2020science B5 is on my list, bumping it up! BB is worth persevering IMO. i didn’t get into it first but eventually loved it, and even more on a rewatch. @deliprao Dark on its own, milk in the context of other things @2020science IMO Breaking Bad is noteworthy for its near-zero imperfections. Such attention to deal and long-term planning 👍 (I hear B5 is similar re: long-term) @2020science I haven’t seen it! I know, I know. @2020science That’s a tough one - I’m more confident about shows because they’re longer/more to love or hate. Tie between The Office (US), Battlestar Galactica, and Breaking Bad. For movie, I’ll randomly select from my top 20ish - Indiana Jones and the Last Crusade :) @chrisalbon I do too but I’m limiting myself to an hour or two, as it’s basically the worst time to sleep from a getting over jet lag POV :( Why am I not exploring the city? Cuz it’s hot and everything’s closed. Early morning. Arrived too early to check into my hotel so I’ve been sitting around and Twittering and being generally useless for an hour or two, AMA RT @RayOfLaurel: This article of Kavanaugh's -- in which he argues sitting presidents should be immunized from criminal prosecution -- is a… @AlisonBLowndes @icmlconf So it was not in vain ;) @AlisonBLowndes @icmlconf I will learn from your experience and just show them my phone screen :) @ivan_bezdomny @jackclarkSF @deliprao @oerockets LOL love the new profile pic RT @priyapanda12: Our new paper is out!! https://t.co/8kfowlzxSl RT @ivan_bezdomny: it can even make a Russian smile cc @oerockets https://t.co/SBGGToU0Zo @ram_ssk And of course, join the discussion however you see fit! :) @ram_ssk Some speakers were invited to set up suitable debates/get different perspectives after the submission period, so not all of them have written position statements. The website now has all of the written statements there will be. @timhwang randomly select a news article, and you may find yourself knee deep in muddle @timhwang Well I obviously agree with you on the merits of FATAGI muddling haha but could also point to many bad muddles, so wasn’t sure what your target was... @timhwang Good muddling or bad? RT @timhwang: 🚀 With the addition of @zacharylipton and Jacob Steinhardt’s position paper - “Troubling Trends in Machine Learning Scholarsh… Wild stuff! https://t.co/1fcQgy30CR "RT @NarangVipin: (1) It was not a contract. (2) IT DOES NOT SAY THAT. https://t.co/WVbqpKPrmC" RT @WiMLworkshop: Our #ICML2018 dinner on Wednesday will feature @AnimaAnandkumar, Doina Precup, and Jennifer Dy speaking about their perso… RT @zacharylipton: Well here goes. Our ICML Debates paper is live: "Troubling Trends in Machine Learning Scholarship". If anyone needs me,… RT @gradientpub: ImageNet is a mainstay of modern computer vision research. Can we build such a resource for natural language? As @seb_ru… "@pfau Was strawless in Seattle* the other day because they hadn’t bought paper ones at the restaurant yet and plastic was banned *not as entertaining as Sleepless in Seattle" Also fastest time from turn on phone in new country to phone works fine. Enjoying Singapore so far! Prob. my fastest time from landing to through customs in a foreign country so far. Now: finding some food!! RT @dpkingma: Check out https://t.co/cBigTutSGn, my work with @prafdhar on improving flow-based generative models with invertible 1x1 convo… RT @OpenAI: Synthesizing realistic high-resolution images with Glow, a new reversible generative model: https://t.co/WIa9aI6NGU https://t.c… @L_badikho @icmlconf I’m sure you’ll do great! :) RT @taoxiease: Read our high-impact collaborative work with the WeChat team on an approach/system deployed for improving (1-billion-user) W… @L_badikho @icmlconf hope to catch you there! Only there for the workshops, though, sadly. RT @seb_ruder: @gradientpub @andrey_kurenkov @tl0en @acganesh Do check out today's other perspectives: on AI regulation by @MelodyGuan (htt… RT @seb_ruder: New piece about a direction I'm super excited about: NLP's ImageNet moment has arrived @gradientpub https://t.co/Kb3szva7tC Very clear and useful stuff as usual! https://t.co/UUNHEM8TWc "Memory Augmented Policy Optimization for Program Synthesis with Generalization," Liang et al.: https://t.co/z54QVInWHe "A survey on policy search algorithms for learning robot controllers in a handful of trials," Chatzilygeroudis et al.: https://t.co/J79ESmE4jV "Sliced Recurrent Neural Networks," Yu and Liu: https://t.co/SaMzic3AE2 """On the Equilibrium of Query Reformulation and Document Retrieval,"" Zuo et al.: https://t.co/URoanQdIhD Interesting question, and algorithms informed by it --> better results" """Oracle-free Detection of Translation Issue for Neural Machine Translation,"" Zheng et al.: https://t.co/S4mVKCzl6t Interesting stuff used in production on WeChat" RT @decodyng: I have a new #machinelearning post where I discuss the ways TRPO & PPO apply different conservative optimization strategies t… There is way more uncertainty about what human-scale hardware consists of than this article suggests (see https://t.co/KHu4L6AXS0 for all you ever wanted to know about such things and more). But I agree cheap compute is important. https://t.co/XxgFD5lK4j @mark_riedl @Delta Riding Delta soon too https://t.co/CBiBAPN1sU @v_maini The nice thing is that eventually you’ll get to 10k+ and will get more coarse grained feedback so you can’t sweat the small stuff even if you wanted to. RT @jm_alexia: Very impressive results! Would be worth trying their new architecture + new gradient penalty + relativistic discriminator. h… "RT @jovialjoy: Innocent person publicly searched after being misidentified by police facial recognition surveillance in the UK. https://t.…" @negar_rz Enjoy Stockholm! :) Off to Singapore 🇸🇬 ✈️ "RT @ColinKahl: NKorea has 20-60 operational nukes. What if we could reduce their capacity to far less than one bomb for 15 yrs, with intru…" RT @alan_winfield: Our new project aiming to breed robots for extreme environments - Autonomous Robot Evolution: from cradle to grave https… One thing that deters me from doing book/paper anti-recommendations is that I don't want to be mean to authors (esp. ones who are on Twitter) but there are usually things you can say that exculpate the author of the flaws while still making a clear anti-recommendation. (last one maybe isn't a good example because I kind of expected to not like it, but I think I was fair and did not some sources of value) and https://t.co/hcAmOPb33m I try to do this myself to save people time... E.g.: https://t.co/snuEPEp7OT Not more "Jordan Peterson's book is stupid [from someone who expected to think that going in]" type stuff - there's plenty of that - but books you thought you'd like but didn't, or were kind of meh. I'd like to see more book anti-recommendations on Twitter. RT @ArmsControlWonk: North Korea is not offering to disarm. This whole farce is less confusing when you accept that. https://t.co/KYx7cW9tgg @danielas_bot @Loftus @jonathanrockoff Congrats! @TimKobe @AnthroPunk Thanks for the thoughtful suggestion, Sally! Too bad it won’t work this time but hopefully I’ll be back at some point in the not too distant future. Say what you will about Hobbes's political philosophy, but Leviathan had some sick cover art. https://t.co/920mszcRsc RT @notesfrompoland: Dutch TV interviews Polish academic and former anti-communist activist Jerzy Targalski - but it's his cat that steals… @gwern Yes, that’s my read, too. “I mark memos Urgent A, Urgent B, Urgent C, Urgent D. Urgent A is the most important. Urgent D you don’t even really have to worry about.” - Michael Scott, The Office https://t.co/6STEQiuTDI Going to Singapore for the first time in a few days! Should be interesting. Overall very interesting stuff and worth checking out the supplemental material + excellent visualizations/video. Also, hard to tell how much UNREAL pixel control helped... Also interesting that FTW did worse on outdoor maps compared to indoor, not as big of an advantage over baseline, esp. self play + PBT + reward shaping. 🤔 and human performance not shown for outdoor. @iandanforth I think the main thing isn’t freezing before experiment but learning across episodes + reasoning explicitly about a single map deeply, which the agents (to their credit :) ) were not trained to do. Needs moar @polynoamial Random map is in some sense harder but a better AI wouldn’t be this exploitable on a fixed map. Struggling to articulate what’s interesting about this... something like: humans better able to think deeply about specific map (=typical setting for humans) and adapt to opponent in repeated game; AI better able to quickly master new maps. Neither better at “adapting” generally. Interesting tidbit from the DeepMind Quake paper’s supplement material - humans were able to exploit the AI on a fixed map, but not random maps. https://t.co/hSYMr3PuCf RT @maggieNYT: Wow https://t.co/taskhAYqH3 "Babylon 5. Discuss." @KaiLashArul I felt that the portrayal by the press of that quote was a bit overstated - he was just saying backprop is prob. bad, not that neural nets as function approximators is a bad idea...no? Curious what your thoughts are as a closer Hinton-watcher. @allergyPhD @BklynInstitute v. appropriate TV in the background @bernardolcaldas Unfortunately no, as we wanted to make sure people could speak reasonably freely/not get too locked into defending particular positions etc. But I'm sure there will be some tweets about it and/or other forms of followup @DorukhanSe Unfortunately no, as we wanted to make sure people could speak reasonably freely/not get too locked into defending particular positions etc. But I'm sure there will be some tweets about it and/or other forms of followup "RT @timhwang: i’m glad to announce that the program for our @icmlconf debates workshop is finalized! featuring debates on rigor, fairness,…" RT @zacharylipton: Thanks to the organizers and attendees for their patience. We will post our position paper for the rigor debate by the s… "RT @brianklaas: Confidence in American leadership from Obama to Trump: -75% Germany -71% South Korea -70% France -68% Spain -61% Canada -57…" "RT @tdietterich: Looking forward to debating the future of deep learning with @GaryMarcus at @icmlconf https://t.co/CjK0YUMcs0 (suggestion…" "RT @timkmak: Yikes 1. This wasn't the suit filed by the DNC. Here's my coverage of it: https://t.co/amnfBk2MhB 2. The judge said that her…" @sksq96 Ball Lightning. @soulwangh @krowney as context, note that the paper came out along with a few others that were more empirical - https://t.co/u4U9VWnSTW https://t.co/PYps70PPvw I see this paper as part of that cluster. RT @bpolitics: BREAKING: China says retaliatory tariffs on U.S. goods are now in effect https://t.co/29mBB1ya0P https://t.co/KtHVraQAhq RT @brianklaas: This is disgusting. Recall that, in 2005, Donald Trump tried to pitch a season of The Apprentice that would pit white peopl… The latest translated book from Liu Cixin comes out in just over a month 😍 RT @paidicreed: Looking forward to attending #wcb2018 at #icml2018 https://t.co/SJzO4Jn2tT! We are hiring computational biologists @benevol… @GoAbiAryan very cool! RT @brianklaas: Putin is not “fine.” He is a ruthless despot who murders dissidents and journalists; helps Assad commit war crimes in Syria… Hero. https://t.co/tZh7721RSf RT @GoAbiAryan: Judea is finally on Twitter. Time to send in all the questions that are giving you restless nights #bookofwhy https://t.co/… """Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and Architectures,"" Bartunov et al.: https://t.co/ccEFoS7Ini TL;DR: mehh" On all of the topics we'll be debating, there are reasonable perspectives on both sides, and we hope to make progress in understanding the key cruxes and areas of agreement on the issues. "ICML Debates workshop site now has info on security debate - another juicy topic. Proposition: The present vulnerabilities of ML systems are sufficiently critical such that we as a society should not allow their general deployment in real-world settings. https://t.co/BCOBsRcvZB" """A Boo(n) for Evaluating Architecture Performance,"" Bajgar et al.: https://t.co/WDz0vTtKP7 (proposes evaluating based on the best out of n randomly perturbed training runs)" @histoftech 😍 "Program Language Translation Using a Grammar-Driven Tree-to-Tree Model," Drissi and Watkins et al.: https://t.co/gP4z8eavGr RT @elizabethforma: Hey, @realDonaldTrump: While you obsess over my genes, your Admin is conducting DNA tests on little kids because you ri… RT @deliprao: Fuck this. The single most important thing you can do is to mobilize your friends and family for the November elections. http… Quick reminder that the most powerful person in the world is a total dick. https://t.co/F1pSyqted4 "Per-decision Multi-step Temporal Difference Learning with Control Variates," De Asis and Sutton: https://t.co/HM8lJDued0 "Deep Reinforcement Learning for Doom using Unsupervised Auxiliary Tasks," Papoudakis et al.: https://t.co/zKWGiLm6Bc "Goal-oriented Trajectories for Efficient Exploration," Pardo et al.: https://t.co/C6S5kveyBV "BOHB: Robust and Efficient Hyperparameter Optimization at Scale," Falkner et al.: https://t.co/USJV9iI7pm "Kids are crazy smart. Me to 5 year old niece: ""What country did the cow want to visit?"" Her: ""Cowea"" (I was thinking Mexicow)" RT @ryanlcooper: fuckin Trump is deporting the troops https://t.co/cQfRLahBnd @mircomusolesi Definitely RT @instadeepai: Our first scientific paper is on arXiv! We introduce a new algorithm, Ranked Rewards (R2) to enable self-play benefits for… @RikeFranke Cf. https://t.co/sSsCvsZF3T @Smerity @j2bryson has a nice slide on this... something about oil and data both being dangerous when concentrated. RT @DeepMindAI: Since our initial results on Generative Query Networks (GQNs) (https://t.co/mD8RR7kZde) , we’ve worked on several new exten… @ziwphd Just started following you, will try to do my part :) @GiorgioPatrini I think Minsky et al. would have figured out ReLU and BatchNorm fairly quickly given compute + data. Agree re: data. Galaxy brain memes will never be the same My awesome colleague @anderssandberg is working on a fascinating book about the distant future of humanity and how great it could be if we don't mess everything up. This blog post gives some sense of the scope of the project: https://t.co/ZSEOyTEeOL @TheAnnaGat @katherine_oxf this one gives it a run for its money though LOL https://t.co/cnHX8pvTJL @TheAnnaGat @katherine_oxf haven't read whole article in question b/c it's a year old topic that wasn't that interesting then either :) much ado about mundane research. Surely one could ask/say interesting things about the general area, but the specific story/experiment was way overblown. @TheAnnaGat @katherine_oxf The research in question was unremarkable - lots of work on language learning for/communication between AIs going back a long time. More accurate summary than "shut them down b/c dangerous/scary or something" (as press reported it) would be "experiment not successful." RT @rebecca_roache: Literally everything (we're philosophers) https://t.co/xqtCzdTZRM RT @MerelEkelhof: Will Belgium be 1st NATO country to call for a ban on #LAWS in #CCWUN? The Defence Commission of the House of Representat… RT @WiMLworkshop: WiML #ICML2018 dinner registration starts! Mentoring and networking. All genders welcome. Register now! https://t.co/QkUv… @GoAbiAryan Thanks Abi :) It's Throwback Thursday! Thread of comments on/excerpts from/links to old AI literature. https://t.co/eK0s9fX3HG RT @rbhar90: Data is the new oil, but perhaps simulators are the new data. @AnthroPunk Was in and out, sadly (gone now). @samim @drjuliashaw I love your optimism/am glad that works for you, but alas, it does not for everyone :) @dennybritz https://t.co/oAxTDi4BwJ :P "RT @drjuliashaw: I mostly live in two emotional states. 1. Anxious because I’m so busy. 2. Depressed because I’m not busy enough. Audult…" "Region Growing Curriculum Generation for Reinforcement Learning," Molchanov et al.: https://t.co/MbXRT3HlS3 """Benchmarking Neural Network Robustness to Common Corruptions and Surface Variations,"" Hendrycks and @tdietterich: https://t.co/P4cF5POlL7 Looks like a cool paper/dataset on commonplace as opposed to worst case/adversarial robustness." "Sample-Efficient Reinforcement Learning with Stochastic Ensemble Value Expansion," Buckman et al.: https://t.co/W2liLg8uF1 """Neural Processes"": https://t.co/6iqvvH8LMf ""Conditional Neural Processes"": https://t.co/bLP7GMHOSE Both by Garnelo* et al.. *who is sadly not on Twitter, but great work Marta and gang!" "Curiosity Driven Exploration of Learned Disentangled Goal Spaces," Laversanne-Finot et al.: https://t.co/fikH6t1N8V (being a bit snarky for comedic effect, though of course many AI people do in fact get this, there are other ways of framing the goals of the field/things to worry about etc.. point is, saying the thing you're *trying to do* is hard is not really the best answer to concerns) If your field's goal is to make machines that can do everything people can do, you should think a fair amount about the societal implications of actually succeeding at that goal. https://t.co/TbugGz3Akt @dennybritz I also like that it's very easy to explain and obvious in hindsight. @chessninja Yeah - Norbert Wiener was similar in this respect as well. OK I couldn't resist, one more: lots of funny stuff/notes to self in McCarthy's unfinished book including this to-be-maybe-deleted jab at ML. https://t.co/AqOazzgEek https://t.co/w6RMhUT737 @miss_speech That’s awesome! :) P.S. forgot the link to Lenat + Feigenbaum - here it is: https://t.co/WQVEbacG2s I generally recommend poking around in AI paper/conference history (Quest for AI, Machines Who Think, Artificial Dreams, and other books are good, too. Other threads to follow are @rodneyabrooks /@etzioni et al. debates in the 80s/90s +anything John McCarthy-related. /Fin In "On the Thresholds of Knowledge," Lenat and Feigenbaum (1987) laid out in detail one line of thinking for how AI should be solved, and present several hypothesis related to the relationship between knowledge, learning speed, etc. including this little number here: https://t.co/vz3wywb9uc People like mentioning Cyc as a failure, but I find it more interesting to look at the detailed arguments people made for why it made sense, especially as people are thinking about ML-augmented approaches to address the same problem today. This is my favorite example - Last throwback of the night - there were really fascinating arguments back in the day about why commonsense reasoning was so hard, and how to solve it. One approach championed by Feigenbaum and Lenat was to encode a lot of world knowledge by hand. ... And to his credit, Dreyfus was very clear that he wasn't saying intuition was forever unsolvable, and even plugged connectionism as a way to get at it. https://t.co/kDecxxv1E4 And these different emphases influenced how people characterized what AI could/couldn't do, where it could be applied, etc. Compare these quotes, one recent from @AndrewYNg and one from Stuart Dreyfus in 1985. They are basically the exact opposite of each other. https://t.co/JpJzEascuV In addition to the meta topics (hype etc.) being discussed, I found an excerpt that illustrates how different the prevailing approach is today... expert systems are all about explicit knowledge and reasoning - neural nets (generally) are abt fast/reactive/"intuitive" processing.. "Consider IJCAI 1985, when there was a panel called ""Expert Systems: How Far Can They Go?"" covering all such topics but in a very different (and in some ways opposite) technological context. See parts 1 and 2 here (will excerpt): https://t.co/6fl2a5GBeX https://t.co/WGYAlR8kxN" "OK, the thread continues now that I can quote from stuff. As most folks know, AI has gone through many phases. Now deep learning is all the rage, and once expert systems were all the rage. People had the same sorts of discussions about excess hype, AI winters, robustness, etc." Overall I’d say A+ for being almost 60 years ago He did give NLP short thrift though (mostly discussed as a grammar induction prob) (Bit of hyperbole as it’s not clear we even have the right Qs today, but point is, most big Qs have been asked for decades) @jon_jeckell Yeah I think there’s a lot of inspiration to be found from what people with less compute and different biased came up with. Obv lots of blind allies but I think they would have pruned way faster in a different universe. He and many others asked all the right Qs. Makes you think progress would have been vastly faster if those folks had today’s compute to try all this stuff out. "One quick example that’s easy to do by phone - “Steps Toward Artificial Intelligence,” Minsky, 1960: https://t.co/TJgSLIs1kY Remarkable how the taxonomy of research areas roughly resembles today - learning, planning, etc at high level, lower stuff like exploration/hierarchy, etc" Reading the old AI literature is underrated. Will share some fun examples when I’m at my computer later... @jjvincent @jeremyphoward Yup it’s a good point @jjvincent @jeremyphoward And they’re not mutually exclusive... I taught Scratch to middle schoolers for a bit and it’s super useful for building computational thinking tools, and when they reach the limits of visual interfaces you can show them the mapping btwn code and blocks. @jjvincent Yeah. I def get where @jeremyphoward et al. are coming from and there are some people for whom that’s true, but i think there’s also a code/math anxiety and/or impatient population for whom this stuff can be useful. V simple idea, well explained, great results 👌 https://t.co/5S4EFR7Yk2 I’m late to this I guess but Kokio Republic Fried Chicken in SF 😍 @erfannoury That was my guess :) RT @OpenAI: New high score on Montezuma's Revenge using only a single demonstration: https://t.co/3IVl04GjaY RT @charlotte_stix: Sharing my national AI policy and strategies database: https://t.co/L3bNUfKZdS comes with a drop down of individual cou… @zacharylipton B̶o̶y̶ bot band @KloudStrife Well put. RT @shakir_za: It's with great pride that we release this short report sharing the outcomes of the IndabaX2018, and on creating leadership… @girishsastry dunno @timhwang @SmithaMilli thanks for doing these :) thought provoking. RT @goodfellow_ian: This new family of GAN loss functions looks promising! I'm especially excited about Fig 4-6, where we see that the new… Latest program for the Debates workshop at ICML - it's going to be 💯😍 https://t.co/BCOBsRcvZB "Reaching Human-level Performance in Automatic Grammatical Error Correction: An Empirical Study," Ge et al.: https://t.co/9UOn57pbT6 Also not obvious that more training wouldn’t have sufficed to beat humans eventually (learning curve is ambiguous). (Oldish = UNREAL and PPO respectively) Lots of cool and novel stuff in the new DeepMind paper, but one thing worth noting is that, similarly to recent OpenAI Dota stuff, old-ish algorithm + self-play + reward shaping + distributed training got in the ballpark of strong humans (though fancy stuff surpassed this). "Normal brain: cheese naan Expanding brain: garlic naan Galaxy brain: garlic cheese naan by request https://t.co/dSLI4B0aPK" @gwern I seem to recall some intuitions in Geffner’s related think piece on AGI but obv it didn’t stick bc not sure RT @math_rachel: Here are some tips from @timnitGebru on how to counter clique culture: https://t.co/2RzPURReGp Cool paper - AlphaGo Zero/AlphaZero type approach but with width-based planners rather than MCTS. https://t.co/yuhFcVUdTc RT @Miles_Brundage: Remember Viv? @hardmaru Lol RT @AdamMarblestone: 1/ Trying a little experiment on Twitter. For a while, we've wanted to promote scientists communicating about papers w… RT @CoreyRobin: The biggest effect of @Ocasio2018's victory thus far is that she's given liberals and the left license and room to breathe.… "RT @Liv_Boeree: Why haven’t we found aliens yet? Check out my article that just went live today on @voxdotcom ! https://t.co/6IEJvrW9m1" "RT @ylecun: It's official! Bloomsbury AI joins Facebook. Welcome Guillaume Bouchard, Sebastian Riedel, and the team! https://t.co/ajTH0Cjh…" RT @barryfriedman1: Folks, our dynamic organization doing cutting edge work around policing very much needs a grants/finance manager. Room… @Nale Congrats! The new thing also happens to be called FTW. My use of it was mostly coincidental. RT @DeepMindAI: Our latest work allows agents to reach human-level on Quake III Arena Capture the Flag through new multi-agent RL technique… *mostly coincidental Virtually certain that the timing of the latest DM CTF results and OAI’s Dota results is coincidental, but it’d be cool if people were actually directly competing to solve cooperative games. Group selection FTW! RT @arkitus: Very impressive to see high-level, multi-player strategy emerging from pure RL on raw pixels. Could this be how we design game… RT @DeepMindAI: How can one detect friendly and adversarial behaviour from raw data? https://t.co/cRJCyfo5oo "Beyond Winning and Losing: Modeling Human Motivations and Behaviors [in World of Warcraft] Using Inverse Reinforcement Learning," Wang et al.: https://t.co/6u573N9LfL "Augmented Cyclic Adversarial Learning for Domain Adaptation," Hosseini-Asl et al.: https://t.co/85PO8QqPj9 Clever stuff - "Towards Mixed Optimization for Reinforcement Learning with Program Synthesis," Bhupatiraju and Agrawal et al.: https://t.co/SX37AaP8XU "Learning to Drive in a Day [with deep RL]," Kendall et al., Wayve: https://t.co/IOLXELo0iV "Policy Optimization With Penalized Point Probability Distance: An Alternative To Proximal Policy Optimization," Xiangxiang Chu: https://t.co/VwPzY1x0F5 "How To Backdoor Federated Learning," Bagdasaryan et al.: https://t.co/ZZWSgvWutC "Neuro-Symbolic Execution: The Feasibility of an Inductive Approach to Symbolic Execution," Shen et al.: https://t.co/auLUHHIb7y """Co-Training of Audio and Video Representations from Self-Supervised Temporal Synchronization,"" Korbar et al.: https://t.co/XlOizuXwn2 Another clever idea for video self-supervision, like the colorization one from a few days ago" "Adversarial Reprogramming of Neural Networks," Elsayed et al.: https://t.co/giwexe9IlF RT @jekbradbury: Automated essay grading that takes into account factual accuracy and content coherence is several years away. In the meant… @iandanforth Do u have to keep pressing the mic? Not sure if I’m in convo mode... RT @ericgeller: Who could have predicted this https://t.co/KJ0sqjU1Fc Happy Caturday! https://t.co/Ctay9t4Qc9 RT @RikeFranke: In the 2003 invasion, the first British force element to cross the border into Iraq was a #drone. https://t.co/njRRk7VG4B The INF Treaty pioneered a general framework for on-site inspections that was subsequently adopted in many arms control agreements. https://t.co/sI0GwC6XQ6 @AdrianBPatter Just convince yourself to read a page or two, then who knows, maybe it’ll end up being more :) https://t.co/ertoapLY9e It's Slide-making Saturday! @AdrianBPatter I find it hard sometimes too so usually have several going at once if I get bored with one :) and bribe myself with Netflix @mikarv @EU_EDPS cc @AnthroPunk Update: pretty good book, bit more freewheeling/less academic than I expected - clearly written for a mass audience. On the upside, very readable and covers lots of ground on important topics. Downside: not a super crisp argument/conclusion, though perhaps justified by the topic. @calebwatney both of Look Inside and arguing about public good defs @calebwatney ...though you could say the latter isn't a good/the right level of analysis but a good+distribution system. 🤔🧐 in any case I'm a fan :) @calebwatney Yeah, that may be how it's defined, though I'm not sure the nature of goods is that crisp, or that the good/distribution distinction is v crisp in the case of software stuff. Maybe e.g. "book content" is excludable (broad good framing) but Look-Inside-as-it-is isn't (narrow good) @calebwatney I will concede that it'd be *easier* to exclude than e.g. air ;) @calebwatney It's excludable in theory, but as implemented it's not - you don't need an Amazon account to use it, and AFAIK it doesn't filter by geography of IP or anything like that. Of course, they *could* remove those properties, but I meant "Look Inside as it is." Underrated public good: the Look Inside feature on Amazon. @hardmaru Safe travels!! @stommepoes @AdrianBPatter @ewaccess @mlockrey @TrintHQ thanks, will check out!! RT @jjding99: Had a great and hopefully demystifying conversation with @carolinefdaniel on China's AI dream at the #cogx18 conference Feedb… RT @Techmeme: China's Tsinghua University to launch an AI research center in collaboration with Google, Tencent, and others; Google's AI ch… @iandanforth @jeffclune Many thanks! @iandanforth ooo, interesting, esp. re: mobile... will check that out tomorrow! cc @jeffclune RT @HernandezJavier: I got a peek inside China’s efforts to inspire a new generation of Communists. Here’s my dispatch from a Beijing class… @girlziplocked https://t.co/4JuoZvURRz @jeffclune May do some testing/looking at reviews etc soon if I don’t find anyone who knows what’s best @jeffclune Have seen various (usually old) articles like this, listing stuff ranging from generic ones not for this specific purpose to ones that sound tailored to it, but haven’t done any testing yet - hoping to find someone who knows the landscape. https://t.co/Yh1iGbl2dk RT @dandrezner: “Trade wars are good, and easy to win.” https://t.co/uOvSb5tfVT Sense8 is basically cooperation porn + dramatic music. @halhod That makes sense but not sure how it connects to “open augmentation” and transhumanism...? Like cognitive enhancing drugs or something? 🤔🤖 RT @jjding99: This explainer by @anderssandberg on his article on dissolving the Fermi paradox is really cool: https://t.co/5pud2UJ1BB @halhod Wut @erfannoury yeah, seems to be. RT @skrish_13: Most existing methods -> global regularization in a structure agnostic manner. In this paper, we propose to enforce the stru… RT @mattwilstein: “The president is from Queens. And with all due respect, half my district is Queens, I don’t think he knows how to deal w… @EBKania @mgubrud @M__Verbruggen @ASPI_org +1, I personally think the optimal point on the spectrum is prob. further towards openness/cooperation does but her recommendations themselves are pretty nuanced and reflect an awareness of the tradeoffs. RT @capgaznews: https://t.co/dEiIgEd15K This is cool, though not sure why people are accepting the use of the word "autonomous" to refer to a robot that's thrown through the air and moves a little bit midair. https://t.co/6VkIvzAwRw "ActiveRemediation: The Search for Lead Pipes in Flint, Michigan," Abernethy et al.: https://t.co/PAZk9p3Bgq "TopoReg: A Topological Regularizer for Classifiers," Chen et al.: https://t.co/F8XgTB3prK "Differentiable Learning-to-Normalize via Switchable Normalization," Luo and Ren et al.: https://t.co/TVwasqRMz6 """A comparative study of artificial intelligence and human doctors for the purpose of triage and diagnosis,"" Razzaki et al.: https://t.co/tOR5ZDAuyQ (aka that Babylon Health thing that people have been talking about)" "Procedural Level Generation Improves Generality of Deep Reinforcement Learning," Justesen et al.: https://t.co/CCtDgUhUAJ RT @mark_riedl: New AI competition: reinforcement learning for cooperative mini-games in Minecraft (Project Malmo) https://t.co/NTQuRDoFpz… "RT @jtlevy: Multiple people shot in the newsroom of the Annapolis (MD) Capital Gazette. https://t.co/CT0MjV6SWI" RT @jovialjoy: Can machines even see my queens as I view them? Can machines ever see our grandmothers as we knew them? - humans worthy of r… I’m the pupperazzi. https://t.co/geMGfip2P1 RT @mdekstrand: The White House wants to "maintain U.S. leadership in the age of artificial intelligence" (https://t.co/aazePz45xy). Restri… RT @mer__edith: At @AINowInstitute we're looking at the urgent issues raised by AI's rapid integration into core social infrastructure. ✨📣A… I was gonna tweet about it being cool that so many local establishments in Seattle choose to have uni-sex bathrooms, then realized there's an ordinance requiring it. That may be cooler than it being spontaneous, or not, but in any case, good for Seattle. https://t.co/X2ZcWrBWAH @sir_deenicus @chris_brockett arbitrary settings, too, isn't a deal breaker for the record. I'd be happy with Wifi connectivity + charger being needed, if that bought good accuracy... not ideal obvi but better to have it as an option. but yeah thanks, will keep looking! @sir_deenicus @chris_brockett Power issue isn’t a dealbreaker for my use case. @XandaSchofield Omg, never realized that symbol wasn't on both sides! There do seem to be a fair number of upside down ports, though, especially in non-computer context like airports/planes/trains... and/or I'm an idiot. "Modular meta-learning," Alet et al.: https://t.co/sgQGHZQB4u "Unsupervised Learning by Competing Hidden Units," Krotov and Hopfield: https://t.co/PH7UPtyJL3 "MONAS: Multi-Objective Neural Architecture Search using Reinforcement Learning," Hsu et al.: https://t.co/BWjtfEN9pE "Guided evolutionary strategies: escaping the curse of dimensionality in random search," Maheswaranathan et al.: https://t.co/KdGruMP2xk RT @sedielem: Stacking WaveNet autoencoders on top of each other leads to raw audio models that can capture long-range structure in music.… """QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation,"" Kalashnikov et al.: https://t.co/tKGfltu6Ai Impressive grasping results." @deliprao /equivalently, getting outside (collaborator) code on corporate compute. @deliprao I'm guessing it wasn't a full DM paper, just one or a few authors (?). My understanding is that in the context of DM (and more generally, industry) collaborations, there are issues with getting access to compute for outsiders. @jeffbigham cc @haldaume3 in case this has come up in your work/your CHI attendance :) any tips/RTs helpful. A lot of dubious info to wade through on the web, hoping I can find someone who can speak authoritatively to this. @AdrianBPatter @jeffbigham + agree that a notetaking app could be good, though I'd think that if it's as easy as I'd think to do a minimum viable improvement over that (e.g. big text, timed deleting of text after some delay), I'd hope I can find something better... :/ if can't find, will try notetaking. @AdrianBPatter @jeffbigham Yeah some apps claim to use Google, but I don't really have time to do a fine grained test of all of their features and they are not typically described as being for this purpose, so reviews aren't v. useful (also app reviews are usually old bc they are obscure apps). @jeffbigham I'd think (or hope) all of this exists but there is a ton of crap to filter through. @jeffbigham K. RT would be appreciated if you're willing/have any disability oriented followers :) I'm frankly v disappointed with this not being something one can easily find on the internet - seems like an obvious "AI for good" application. @jeffbigham Bonus points for integrating external mics. Better form factor would be great but even a good phone+mic would potentially be good given the current (low) quality of hearing aids. @jeffbigham do you have any specific recs for the phone? I'd (or rather my dad) be interested in an app that just had Siri etc. level recognition going all the time, with some reasonable features (e.g. not cluttering up the whole page with the last few mins of text/disappear after some time) cc @jeffbigham any thoughts/recommendations of ppl to ask? @GalaxyKate Not always utopian but very whimsical. Also, The Lathe of Heaven be Le Guin (somewhat of a commentary on utopia but also delightful+shortish) @GalaxyKate The Wandering Earth, collection of Liu Cixin short stories RT @dsmilkov: I made this years ago, even before https://t.co/wVsxkv3Bsr, but I never published it because I never finished it and stuff ha… @RebeccaCrootof SMH @LucienCrowder1 RT @REMEZCLA: Today Alexandria Ocasio-Cortez (@Ocasio2018), a 28 year-old Latina running on a progressive platform that puts her community… Cool idea! https://t.co/jrYcJ60tTB @mark_riedl I like the transition to Yuck RT @DepthFirstLearn: We've released a new depth-first curriculum. Check out AlphaGoZero by @cinjoncin --> https://t.co/wFGNrFFdMW. RT @laurenduca: EXCUSE ME WHILE I SCREAM UNTIL I PASS OUT https://t.co/EitKGnZVnk @chelseabfinn @techreview Congrats! Very well deserved. RT @chelseabfinn: I’m thrilled and honored to have received the MIT TR 35 innovator award this year. Grateful to have been able to work wit… "From Congressional hearing earlier: https://t.co/ZZaTYpOvk6 h/t @jackclarkSF Also from @Foster4Congress: ""I recommend everyone have a look at ... 'Malicious Use of AI'...which I stayed up way too late last night reading."" 😍" Congressman @Foster4Congress: "When I couldn't stand it during the gov't shutdown..., I went and downloaded TensorFlow + worked through part of the tutorial. ... The algorithms are not so different from what we were using [for classification in particle physics] back in the 90s." @zacharylipton @GoogleAI (more seriously, sounds like an awesome discussion! :) Twitter can indeed be misleading) @zacharylipton @GoogleAI Zach, are they holding you against your will? RT @erfannoury: With today's SCOTUS ruling to uphold the Muslim Ban my chances of seeing my parents again in the next couple of years becam… @erfannoury :( @hardmaru @togelius @tkasasagi May need a firehose - lots of GPUs :P @hardmaru Technically he's correct (some "humans" were indeed defeated :) ) but yeah, will be interesting to see what happens in August, and also the interim check-in in July. "Syn2Real: A New Benchmark forSynthetic-to-Real Visual Domain Adaptation," Peng and Usman et al.: https://t.co/gbg2hGyuax "Many-Goals Reinforcement Learning," Veeriah et al.: https://t.co/djTCnarx0j "Deep Generative Models with Learnable Knowledge Constraints," Hu et al.: https://t.co/DIOlH5jWwF RT @mark_riedl: “One attendee of the meeting said the encounter led the tech companies to believe they would be on their own to counter ele… "RT @MuslimIQ: BREAKING: Today marks 523 since 45 took office. He wanted 120 day Ban. Americans killed by Refugees: •0 Attacks •0 Deaths •3…" @michael_nielsen Special Assistant to the Director (ARPA-E) @michael_nielsen Yup (I used to work there)... and yet, Trump admin is repeatedly trying to kill it. RT @RichardSocher: 🔬 We're announcing our first-ever deep learning and AI grant to support future AI research. Work on bias and diversity i… "@GalaxyKate Bot-anist Source code Sorcerer" RT @awjuliani: I wrote a blog post on re-implementing @pathak2206's Curiosity-Driven Exploration as training option in ML-Agents's PPO: htt… RT @erichorvitz: Pursuing fairness in #AI systems: https://t.co/PvkScFxUaq On successful efforts with face recognition. Strong cross-team e… "RT @ajmooch: DARTS: Differentiable Architecture Search by Hanxiao Liu, Karen Simonyan, and Yiming Yang. They operate on a continuous relax…" @dude313123123 Don’t know enuf about Goog’s efforts there to say if this is true - depends on what they’re working on, as BAT has lots of AI talent. In any case, again, you could say that open source or working *outside* China also spreads knowhow to Chinese govt, diff from working for them IMO RT @hlntnr: Hello yes I thought some of you might also be in need of a thread of photos of fourteen dogsled puppies learning to get along… @dude313123123 Why does it depend on that? Google isn’t BAT. RT @NicolasPapernot: Together with @goodfellow_ian and Patrick McDaniel, we wrote a CACM article on making ML robust against adversarial in… This is basically the same claim that Google initially made re: Maven, that it’s open source and so who cares. But in fact AI takes work - X being spied on or X being open sourced is diff from putting time into producing a bespoke X solution fo Y country. Bizarre false equivalence by Work. Of course there’s espionage of/repurposing of Google work *in* China by China’s gov’t, as there is for work outside China, but that’s different from working *for* China. Maven was about working *for* US. https://t.co/RW8roCHxAS RT @timhwang: I’m thrilled to announce today that the AI Initiative will be working with @KLdivergence and the good people of @hrdag to adv… @krowney Lots of ppl... e.g. @filar @drhyrum RT @Miles_Brundage: AI/accessibility people - does anyone know if there are any good commercial products or open source projects that do sp… "RT @DeepMindAI: Check out the code for our implementation of ""Importance Weighted Actor-Learner Architectures"", open sourced today! Code:…" @dennybritz January 5, 2029, 4:12 pm then :P @dennybritz July, 2025 To clarify, there are some apps billed as being for this purpose but I don’t know how good they all are, so would greatly benefit from someone who has familiarity with the space. I'm looking for something with the recognition performance of a Google Assistant/Siri/Cortana etc. type product, but always on and otherwise tailored for accessibility purposes. Did some digging on this and it looks like there are tons of speech-->text apps but none that are specifically for this purpose/with the right sort of features, and defunct-looking Kickstarter projects. App on smartphone form factor would be OK if it were good/pairable w/ mic. AI/accessibility people - does anyone know if there are any good commercial products or open source projects that do speech-->text specifically for people who are hard of hearing (e.g. with a Google Glass type form factor)? RT @mercnews: Salesforce workers demand company stop working for U.S. border agency: report https://t.co/nMtpNsCwjx https://t.co/7klkgHj45Y @decodyng @shortscienceorg You rock!!! RT @decodyng: Today I finally added many of my recent #machinelearning paper summaries to @shortscienceorg. Doing so left me v. excited by… "Stochastic natural gradient descent draws posterior samples in function space," Smith et al.: https://t.co/h4dLMxujGr "Learning Task-Oriented Grasping for Tool Manipulation from Simulated Self-Supervision," Fang et al.: https://t.co/BK9Jongmot @carsondial Maybe, not sure. I'd guess that either it's not as great/easy as people claim, or it's used quietly, but please advise. I'd also expect it to be used in large-scale RL experiments like Alpha* and Dota... but again, haven't seen any claims to this effect. Lots of research on neural net pruning/distillation/etc. but is any of this stuff used in practice? If it works as well as people often claim, I'd expect it to be used regularly for faster inference at big tech companies, but don't think I've seen any claims to this effect. "Inference Trees: Adaptive Inference with Exploration," @tom_rainforth et al.: https://t.co/aKu0dvTkDx "DARTS: Differentiable Architecture Search," Liu et al.: https://t.co/qixqxtY8BN "Multi-objective Model-based Policy Search for Data-efficient Learning with Sparse Rewards," Kaushik et al.: https://t.co/7rLIaF2QX7 @jackclarkSF LOL please suggest better and i’ll replace it Finally, on a darker note, as Smerity hinted in 1st tweet+OpenAI and others have warned about (inc. their work with me et al. on the malicious use report), remember that some large scale RL apps are bad news. Deep RL for cyber is 👀🧐🔥. Need to think about this stuff now.( 5/5) But who cares? People who want to replicate human-level learning efficiency, work on too-big-still problems, train systems on bespoke problems but can't afford it themselves... but people who just want trained systems, or can afford training, don't necessarily care. (4/x) https://t.co/9EhtfqUdFl By one estimate I've seen, this was on the order of 100 PFLOP-days, which would be less than AlphaGo Zero/AlphaZero. And notably this isn't using raw pixels, so it's already a bargain compared to what it could have been. So RL from scratch is still super inefficient (3/x). Clearly not everyone can afford to train stuff at this scale, but some can, and the trained systems are much, much less compute-intensive than the training process. So stuff like this can still be very broadly useful to society (see e.g. machine translation). (2/x) Nice thread - @Smerity abstained from "wax[ing] poetic about the...stupendous compute," so I'll step in. This is yet another demonstration of the value of tools that scale well with compute, of which NNs, self-play, +simulation generally are examples.(1/x) https://t.co/2liroHw3w2 @zacharylipton LOL RT @Smerity: The @OpenAI team have done amazing work and really opened my eyes towards many of AI's possibilities, the vast majority positi… "RT @BrianBrackeen: My thoughts on facial recognition & law enforcement. (Spoiler alert: 🚨 They don’t mix well) https://t.co/xRVwB603L8" @calebwatney 🧐👎 @davidad Interesting. From the people in the tiers, it seems that the top is the "Dota team" and the bottom is "other people at OpenAI who helped a bit." Nice touch on the OAI blog post (the randomization) - one way of setting the team spirit hyperparameter to 1. https://t.co/oyJ9AlkZ1S https://t.co/yYhf0xWjIU RT @soumithchintala: OpenAI demonstrates remarkable progress in a limited version of 5v5 Dota using two concepts that we didn't think can l… RT @KurtKohlstedt: Parkour trash panda climbs around the baffle, hangs from the birdfeeder, then unscrews the bottom with her hind feet to… RT @matthewamiller: Good lord this is bad. Suspect the Capitol Police will have to give Waters a protective detail in response to this twee… "RT @jackclarkSF: Some megascale RL results from @OpenAI: We've scaled existing methods to train AIs with sufficient teamwork skills to sol…" RT @OpenAI: Our team of five neural networks, OpenAI Five, has started to defeat amateur human teams (including a semi-pro team) at Dota 2:… RT @janexwang: The Baldwin effect describes how the ability to learn increases evolutionary fitness, even though what is learned isn't pass… "On Intrinsic Rewards & Continual Learning," Satinder Singh: https://t.co/HB4eEyHyTb RT @maggieNYT: Trump is again stymied by the limits of an executive office that he envisioned as having near-absolute power ... before he g… RT @erikadmenezes: Sharing my notes from CVPR 2018 - Day 1 https://t.co/5zgonAkiqE Sorry What idiot called them sex robots and not artificial genital intelligence? "Me: The Incredibles 2 will be a nice break from work. Also me: The Incredibles 2 is about body cameras and the legitimate use of force. #WorkLifeBalance it actually kind of is, though" RT @markoff: https://t.co/fLxmZvAXoy “Human-Interactive Subgoal Supervision for Efficient Inverse Reinforcement Learning,” Pan et al.: https://t.co/X9FH9a4Pon @erfannoury Only read a bit. Can sample on Amazon if interested @deliprao Haha it isn’t my copy but if it weren’t already fake-ripped I might real rip it. Not a fan of the texture Also, ban scratchy hardcovers. All hardcovers should be smooth to the touch. Why didn’t anyone tell me about this book? Title is a bit misleading - it’s more consciously speculative/caveated than that (more like “how might western democracy end eventually because of coups, catastrophes, or social/tech changes, and could some of these scenarios be okay?”). https://t.co/KuvY2pDCX6 RT @evacide: IoT things are being used as tools of domestic abuse. I have opinions. So many opinions. https://t.co/l3ieXLM6sN RT @KT_NRE: I'm sure this sculpture is supposed to be a statement on consumer culture or something, but all I can see is Jesus and Lenin tr… @PeterAsaro And to be clear, i’m being nitpicky about “unique” but agree that the ID w/o consent issue is a huge mark against it @PeterAsaro I’d say it’s *extreme* along that dimension but not the only tech that meets that description (ear recognition [though maybe one would call that a face?], gait recognition, voice identification w/ long range mics etc). Being nitpicky but good to be precise if total ban on table Def some ways in which face rec or other forms of deanonymizing/person-specific computer vision techniques are especially prone to abuse, though FR isn't alone there (gait recognition, even ear-based recognition has been popular on arXiv lately), + other harms to consider. /Fin My point is not that there aren't FR risks--there are many--just that I'm unsure where the lines should be drawn. Just to give two brief examples to illustrate my point: would a bodycam/CCTV/drone that looks for signs of aggression be much less prone to biased deployment/abuse than face rec.? What about video summarization/prioritization to make city-wide surveillance much more feasible? "This context is key when thinking about moderate or extreme responses to FR. Is FR where you draw the line? Or computer vision period? (thoughts spurred by @EvanSelinger +@hartzog's thoughtful piece on FR, which I disagree w/ some of but raises impt pts https://t.co/A9FUcWLGdW)" Glad people are thinking and talking more about the risks of face recognition lately, but important to remember that it's only one of many emerging computer vision tools. Others with similar implications include action recognition, emotion recognition, video summarization, etc. @mjntendency Summer is also the ideal time to visit :) RT @anderssandberg: This is the second time in history someone has written a poem about one of my papers. I like it: this one gets my point… @miss_speech There are jobs like minister for digital, terms like digital single market, headings of documents like “innovation and digital”...not 100% what they mean but it seems to be something close to information technology or just technology if said by an American policymaker Why do European policymakers use the word "digital" as a noun in a way that Americans don't? Internet search in 1995 and today... first one from https://t.co/KG7JSFcoI5 https://t.co/miceKCMe2Y @hardmaru @awjuliani yeah I was thinking about the Retro thing when I tweeted that :) @y0b1byte Yeah when I said no “splash” i meant like media and twitter, not lack of research impact, which it sounds like was immediate RT @deliprao: actually neat that Turing's b'day coincides with the #sanfranciscopride weekend. Happy #Pride everyone! https://t.co/gTwoXwad… I don't remember Proximal Policy Optimization making much of a splash when the paper was published, but it seems widely used/cited in papers lately. Good case study of the limited correlation between hype and impact. "@zacharylipton recommend it? (the book, but also interested if you recommend causal reasoning, asking for a friend 🤖)" RT @Miles_Brundage: ICYMI - in addition to it being important to get this specific case (policing tech) right, I hope this model gives usef… Very interesting work by my colleagues at @FHIOxford! https://t.co/sogxxUbB5T @ArtirKel @patrickc Glad you’re now following Artir! RT @anderssandberg: Dissolving the Fermi Paradox: why taking uncertainties into account makes the absence of aliens less weird, and why an… "And of course we’d* be interested in comments/critiques etc. This is a 1st attempt/open to change after further discussion/experience. *not speaking for the board in any official way - just happen to be the most prolific tweeter of the bunch - but this seems uncontroversial :)" ICYMI - in addition to it being important to get this specific case (policing tech) right, I hope this model gives useful food for thought to others thinking about what exactly AI ethics boards are supposed to do/oversee. https://t.co/J3y69BIlUk @goodmachine again, not sure, but I think I agree with your other pts :) @goodmachine Not sure I'm parsing all your points b/c highly compressed, but FWIW I'd disagree w/ AI as buzzword if that's what you're saying - not a new term, decades old field, and framing of it as "buzz"y/only a long term thing is what I'm objecting to in the first place P.S. Should have used "replacing" instead of "substituting" for clarity...and maybe there's no substitution/replacement +people who spread this meme are adopting the same (problematic) intelligent/not intelligent binary as the public, just saying we're on the other side of it?🤔 RT @quasicoherence: Is it better to mispronounce Gödel but be intelligible to Americans and sound like a doofus to Germans, or is it better… @goodmachine Yeah, we don't have a perfect metric/set of metrics, but a wide range of semi-sensible frameworks seem more useful to me than one with just two categories (dumb software/AI). Separately, it's also just not true that ML is the only AI-related thing happening and the most interesting stuff involves ML+ (one could agree with this and still disagree with the last few tweets - just saying). A more continuous (and perhaps multidimensional) framing of intelligence which grants (sometimes barely non-zero quantities of) it to a wide range of species, artifacts, etc. is both more accurate and conceptually useful in thinking about potential societal impacts IMO. (this is basically just a rephrasing of what @j2bryson has been saying for a long time btw) It's Framing Friday! The "we shouldn't call X AI, it's ML" meme is overrated. I get the point (that people have bad ideas about AI) but dismissing everything accomplished to date as "not intelligence" just substitutes 1 bad idea for another (intelligence as binary/on a pedestal). Unreasonable search and seizure https://t.co/ReuLbljeJf Also, I think about a lot of lines from The Office a lot "I think about this line a lot* when reflecting on what I like about research... *unironically, though the origin is a joke https://t.co/cD38OHbvgH" RT @morninggloria: Statistically, men in Jared Kushner's immediate family are much more likely to commit felonies than undocumented immigra… @Smerity @GalaxyKate Neural net isnt selected in the upper right 🤔 @GalaxyKate See also this thread https://t.co/35TonuuqC7 RT @BeijingPalmer: The best analogy I've heard is that it's like the Matrix - they are independent entities with their own wills, direction… Or maybe that’s just weirdo cred. I love books, but the dude next to me at the bookstore smelling a new book at length is making me question my nerd cred. RT @Miles_Brundage: The operating principles of @axon_us’s AI and Policing Technology Ethics Board are now up on the website: https://t.co/… RT @timhwang: Still skeptical about the actual impact that we’re likely to see from machine learning driven fakery, and still taking wagers… Nice op-ed on the future of policing technology by @barryfriedman1: https://t.co/1qx93pPVsM @ArtirKel 😍🎉 RT @mchorowitz: How big a deal are #AI-based #Deepfakes? Will they influence the 2018 midterms? Read some thoughts from me in this @IEEESpe… RT @barryfriedman1: For all of you interested in what @axon_us is doing on facial recognition, this is a first step. Only a first step, we… I particularly like the explicitness around what Axon has agreed to be transparent with us about (= the scope of this doc - doesn’t mean they shouldn’t also be transparent with others, too, etc.). Also like the external ethics ombudsman function. “Note that these principles are not intended to be exhaustive of all of our responsibilities and principles related to AI or police technologies (which will be discussed in future publications), but pertain specifically to the role of the board.” A good first step IMO. The operating principles of @axon_us’s AI and Policing Technology Ethics Board are now up on the website: https://t.co/hgRY9H89oD On my way to interrupt @rcalo’s Carpentry Everyone is a big fan of carpenters today, it seems RT @barryfriedman1: Working on an op ed will say more later, but the HUGE implication of Carpenter is for subpoena practice. Crim defense… RT @ericoguizzo: Experts Bet on First Deepfakes Political Scandal https://t.co/d0ynw3MLLE @deliprao (Dunno if shepherd v sheep dog is a distinction or if I just usually hear the former phrasing) @deliprao Close - miniature Australian shepherd :) @halhod Trying! It’s Furry Friday! https://t.co/BZnkI4waUq RT @OpenAI: Retro Contest: Results. https://t.co/PfsPQsybQ4 https://t.co/tlgngGoJq2 @AnthroPunk @tsimonite How was Maven not realized? AFAIK it was used to support operations against ISIS. @F_Vaggi @ericjang11 EU is better IMO. At least there are many ppl in govt there who know how behind they are. US govt outside of the Pentagon is more like this re AI https://t.co/zSdyzuLuz8 @ericjang11 “Unclear where USA’s AI strategy is under the current administration.” https://t.co/JkQEwZJgCn RT @ericjang11: New blog post in which I share my thoughts on the ICRA conference & state of robotics research! https://t.co/Qde92HjXF0 @ericjang11 😍 @zacharylipton And where do I invest in Coinheadcoin? @zacharylipton Did you coin coinhead? @ankurhandos @hardmaru @SELUAppendix https://t.co/3d3q6muDfE @hardmaru @SELUAppendix Hochreiter loves long appendices. @mark_riedl I thought this was gonna be a rap, from the first line. Sad! "RT @openminedorg: Here's a sneak peek at our new Federated Learning interfaces using @PyTorch and PySyft. Try Federated Learning Using Op…" """Flexible Neural Representation for Physics Prediction,"" Mrowca, Zhang, and Wang et al.: https://t.co/mZCudcThXl Graph stuff" Man, I should have started writing up my thoughts on face recognition two weeks earlier, or two weeks later (see last RT) now that there’s so much current events stuff to discuss. Anyway, will say some stuff soonish. RT @kateconger: Employee activism keeps spreading in tech—now Amazon employees are calling on the company to stop selling Rekognition to la… Has anyone looked systematically at the "text overlap" thing on arXiv and what it picks up on? I sometimes wonder if it's a good heuristic for sketchy papers or casting undue aspersions on papers that legitimately quote from others, something else, etc... CC @tdietterich "Gradient Adversarial Training of Neural Networks," Sinha et al.: https://t.co/u3XlELu78o "Fashion-Gen: The Generative Fashion Dataset and Challenge," @negar_rz et al.: https://t.co/C34WFMqI65 "A Dissection of Overfitting and Generalization in Continuous Reinforcement Learning," Zhang et al.: https://t.co/hn9tRhP1Q7 "Resource-Efficient Neural Architect," Zhou et al.: https://t.co/3LebVRTvX7 "Expanding the Active Inference Landscape: More Intrinsic Motivations in the Perception-Action Loop," Biehl et al.: https://t.co/lqn64WZQ2i "Meta Learning by the Baldwin Effect," Fernando et al.: https://t.co/kL0NcaG9lB @tsimonite Will be interesting to see where it tops out. @EvanSelinger @Medium @hartzog @ACLU I could also imagine a plausible arg. to the effect that even that's too much given creep, just not sure if that's what you're saying or not. @EvanSelinger @Medium @hartzog @ACLU (I'd think that offline use for victim IDing, or constrained use for suspects in case of probable cause, or the other outlier cases mentioned there, would not constitute "once the infrastructure for facial recognition technology grows to a certain point") @EvanSelinger @Medium @hartzog @ACLU My guess is you advocate something like this: https://t.co/gKTo38pnxh ? @EvanSelinger @Medium @hartzog @ACLU As you know, I'm not sure if I agree, but it's a plausible view for sure. Look forward to reading more carefully but on first glance, I'm not sure exactly what you're saying no to. Any use of face rec for any purpose by police/gov'ts? I'd assume not (IDing victims, etc.). Book arrived in the mail 😍 RT @schock: .@ajlunited founder @jovialjoy shares her concerns about abuses of facial analysis technology @nytopinion https://t.co/asqcq3Xp… @tsimonite The Maven thing had a longer gestation period to develop debate+signatures than this has, though, if I recall from how Maven developed (news of it, then a while later the formalization of backlash). @harlanyu @axon_us @barryfriedman1 @tracyannkosa @the_zeroth_law @PoliceFound or 3. Miscommunication of some sort (rogue Axon person speaking out of turn or diff interps of “face rec” - ID v detection, the latter of which they already do for redaction). I’d guess 2 or 3. @harlanyu @axon_us @barryfriedman1 @tracyannkosa @the_zeroth_law @PoliceFound Update after reading: I’d be surprised if that (Kairos) claim were true, + told by some folks that it isn’t. So either 1. I’m being lied to, 2. Kairos is lying/misleading/misremembering, or (cont’d) @harlanyu @axon_us @barryfriedman1 @tracyannkosa @the_zeroth_law @PoliceFound I can’t read the article right now bc on phone/paywall, so I’m just going off of what your tweet said FYI. Will let you know if I hear/read anything to suggest my last claim was false. Would go against principles to be announced soon (prior notice re new AI apps). (2/2) @harlanyu @axon_us @barryfriedman1 @tracyannkosa @the_zeroth_law @PoliceFound Hadn’t heard of Kairos before. Can’t speak to convos btwn Axon and them, if any, but AFAIK your second sentence (re pursuing) isn’t true - they’re thinking about but not actively developing or definitely planning any particular use (on cam or otherwise) to my knowledge... (1/2) Interesting stuff from @BMarcusMcCann et al. at Salesforce. Lots of nitty gritty details but the basic idea is just posing a bunch of NLP tasks as QA so one fancy QA architecture is applicable across them. https://t.co/jIF5r6ZzbA RT @Miles_Brundage: We had some great submissions to the ICML debates workshop! The 4 debates will be related to fairness, rigor, deep lear… "Reinforcement Learning using Augmented Neural Networks," Shannon and Grzes: https://t.co/76qAt3NEfw "Sim-to-Real Reinforcement Learning for Deformable Object Manipulation," Matas et al.: https://t.co/CRzLvH4lYg "RUDDER: Return Decomposition for Delayed Rewards," Arjonda-Medina, Gillhofer, and Widrich et al.: https://t.co/fsDQfVK40U "RT @fereshteh_sa: Excited to present ""#Sim2Real Viewpoint Invariant Visual Servoing by Recurrent Control"" today at #CVPR2018 https://t.co…" RT @RichardSocher: Very excited to announce the natural language decathlon benchmark and the first single joint deep learning model to do w… @RebeccaCrootof Now I want to come up with a Star Trek one but it’s hard to top that RT @rakyll: As a person who dealt with suicidal depression for years, I cannot imagine the trauma caused by war and violence. It is magical… RT @katecrawford: Nature just published a major feature on researchers working on bias in machine learning. Features many of us, including… RT @DeepMindAI: Implicit Quantile Networks for Distributional Reinforcement Learning: https://t.co/3u9TnsTJJA RT @jjding99: My latest piece w/ @pstAsiatech and @SammSacks is on China's efforts to set international standards for AI - thanks to @gwbst… @mhbergen don't have a The Info subscription but who said that quote? SMH. RT @AsteadWesley: This is, quite literally, the most oft-repeated talking point of America's white nationalist movement https://t.co/plo6M2… RT @y0b1byte: My notes on "Self-Imitation Learning" (https://t.co/7vCPU08xct) by @junh_oh, Yijie Guo, Satinder Singh and @honglaklee: https… Hope to see some of you there! CCing wonderful co-organizers @timhwang, @catherineols, @sandyasm and Shourya Roy For example, in the "rigor" cluster of submissions, we had position papers submitted like "Smoke and Mirrors: Pernicious Patterns in ML Scholarship," "Some Papers Don't Reproduce, Should We Care?", and "Submit to Journals." Links to some papers are already live. We had some great submissions to the ICML debates workshop! The 4 debates will be related to fairness, rigor, deep learning, and security, and we have a diverse and talented array of participants taking various perspectives on them. More info here: https://t.co/BCOBsRcvZB RT @TheOnion: Tucker Carlson Angrily Explains Difference Between Good Baby And Bad Baby https://t.co/6RHlfUrtL7 https://t.co/tpRhWag6Ko "RT @gleemie: Microsoft workers request MS: 1. Cancel the existing Azure Gov contract with ICE immediately. 2. Draft, publicize, enforce…" @AnthroPunk Will DM Also, need to decide if I should work in some ICE-specific stuff in light of recent developments. 🤔 Still interested in comments on/criticism of my draft (long) blog post on face recognition ethics. 🤖👀 You should follow @kateconger for great coverage of tech worker rebellion stuff. RT @kateconger: Here’s @satyanadella echoing our earlier reporting, saying Microsoft’s ICE contract doesn’t involve facial recognition. No… "Neural Ordinary Differential Equations," Chen, Rubanova, and Bettencourt et al.: https://t.co/hL7NAGLPmI "Unsupervised Imitation Learning," Curi et al.: https://t.co/grmlXcwVva RT @dog_rates: We only rate dogs. Please don’t send us Oreo Ice Cream. This is not complicated. Thank you... 14/10 https://t.co/R2JIXFx7vV RT @awjuliani: One of my favorite DeepRL papers in the past few months is "Self-Imitation Learning." Super simple idea with nice theoretica… RT @jackclarkSF: I'm currently hiring for a bunch of policy roles and a communication gig at @OpenAI . As part of that I'd like to chat wit… @mark_riedl Tell them you’re interested but only if the interview is in Seattle next week, then let’s grab coffee "Deep Neural Decision Trees," Yang et al.: https://t.co/655f9uBWQz "DropBack: Continuous Pruning During Training," Golub et al.: https://t.co/x1gOJpWpfA @jackclarkSF @zacharylipton @tdietterich Good points. Personally I find it easy/robust to say that the memo doesn’t rule out X, Y, and Z while still being a positive step, but I guess there aren’t that many other ppl who are willing to be quoted on this stuff @zacharylipton @tdietterich I admittedly haven't looked at the coverage closely and imagine there was some bad stuff (people seemed quick to move on from Maven stuff as soon as it came out) but journalists I spoke to all asked about/seemed receptive to comments on problems with it. "Reinforcement Learning with Function-Valued Action Spaces for Partial Differential Equation Control," Pan et al.: https://t.co/Fphmwn1KN6 "Qualitative Measurements of Policy Discrepancy for Return-based Deep Q-Network," Meng et al.: https://t.co/2n8VX96I3n "Object-Oriented Dynamics Predictor," Zhu and Zhang: https://t.co/ETtexmXLck "Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image Translation," Gamrian and @yoavgo: https://t.co/aOrmTDQ7xq @tdietterich @zacharylipton Yeah these seem quite different. Google ethics memo (/broader Maven stuff) is def. a story. RT @mgerrydoyle: just so we're crystal clear on this, the president is saying that putting kids in concentration camps is a *winning politi… RT @TheJovenshire: Rumors that 5 more Star Trek shows are going into development, and that one is a sequel to TNG.......AND PATRICK STEWART… RT @kateconger: In a letter to @satyanadella, Microsoft employees are asking the company to terminate its contract with ICE https://t.co/ZV… @gokstudio Something newer, basically the same idea but doesn’t seem coordinated with ELLIS, sigh - https://t.co/DZ8oliDt35 RT @pearkes: ICE is a terrorist organization and should be regarded as such. https://t.co/i5zX7l2IoM RT @mustafasuleymn: If you’re interested in discussing how public input should shape the role of tech in the UK, apply to attend “Society i… RT @jennwvaughan: Woohoo! My survey on crowdsourcing for an ML audience is finally out in JMLR! Check it out if you're interested in incorp… @mattsheehan88 This doubles as a Chinaversary for me - my first time was 2008 too! "Learning Policy Representations in Multiagent Systems," Grover et al.: https://t.co/CZUF9lLQZ9 RT @ericgeller: Just an extremely normal anecdote about the White House chief of staff, who colleagues see as "having thrown in the towel o… RT @jwangARK: If you want to understand what is happening with AI in China, follow @jjding99. He translates original Chinese texts into Eng… "BaRC: Backward Reachability Curriculum for Robotic Reinforcement Learning," Ivanovic et al.: https://t.co/VaQwe8UZFw "Fairness Under Composition," Dwork and Ilvento: https://t.co/tSe71jR1DY RT @rl_agent: Just released our #ICML2018 paper "Gated Path Planning Networks" as well as a @PyTorch implementation for replicating our exp… RT @red_abebe: I could not be more thrilled to share our paper "Using Search Queries to Understand Health Information Needs in Africa", joi… RT @timkaine: The real Trump Hotel. https://t.co/PP6nIbzNQR My sense of the AI community is that it's bad at keeping secrets, so perhaps what's going on is that these projects are on the fringes (in siloed product/sales teams) viz-a-viz researchers/what I usually think of as the AI community. Prob. other factors, as well. That's a simplification - media coverage typically builds on leaks from inside companies... but the point is, information about controversial projects does not seem widely distributed at big companies, to an extent greater than I would have guessed before this year. Strange theme of both Google/Maven and Microsoft/ICE - employees not being widely aware of controversial projects until the media bring it up. @mark_riedl https://t.co/DZ8oliDt35 @mark_riedl https://t.co/sRicgwqzAb RT @Matt_Cagle: “Because Amazon doesn’t say how it will monitor for abuse, it is predictable that governments will violate rights by using… Just today, there’s one on Amazon and face recognition and one calling for more European AI funding. The Year of the AI-related Open Letter is in full swing. RT @anderssandberg: Plot of historical estimates of maximum human population, human population, and the UN estimates for 2100. The blue dot… RT @pabbeel: Very excited to announce something we’ve been working on for a while now: https://t.co/uQfNtBNki6 3-day bootcamp! Instructors… Interested in readers of/commenters on the draft version btw, especially people with strong views on face recognition/surveillance etc. It's a long slog, be warned. RT @maurertim: Pentagon Puts Cyberwarriors on the Offensive, Increasing the Risk of Conflict by @SangerNYT via @NYTimes https://t.co/I2Z2… Me reading my own writing on face recognition. https://t.co/o9FxNI9Dso @ArtirKel @AdaptiveAgents Spoiler: you can’t keep up. "Improving width-based planning with compact policies," Junyent et al.: https://t.co/e9efe3nKFU "One-Shot Unsupervised Cross Domain Translation," Benaim and Wolf: https://t.co/Az5btIQ89z "Sample-Efficient Deep RL with Generative Adversarial Tree Search," Azizzadenesheli et al.: https://t.co/lB03BWp4QW RT @gleemie: Microsoft announces building ICE cloud. While I know what Microsoft is thinking (business), making ICE more efficient at facia… "Practical Fault Attack on Deep Neural Networks," Breier et al.: https://t.co/SMIyY7jaRG "Hardware Trojan Attacks on Neural Networks," Clements and Lao: https://t.co/bBkqxBxJkH It's Security Sunday! RT @mhbergen: Wonder if this becomes a Maven moment for Microsoft. https://t.co/FYnJzP0Rbu @erfannoury Happy ending, though: https://t.co/gUKFeemuUC This one's going to be a doozy... RT @fchollet: Marc Benioff is an inspiring CEO. (Less inspiring is the private sector having to provide public services that the government… Made some progress but there’s lot to unpack... decided to limit the focus to one dimension of variation - scope (whose faces are being looked for). Many issues/considerations even for that one dimension but I think there are at least a few novel/robust things to be said. @skynet_today That’s a general one of which there are many, there are also more specific ones hyping job impacts... etc @skynet_today Dunno. Saw one by Byron Reese at the bookstore earlier that looked v superficial based on a (ironically) superficial skim, but I try not to read bad books :) doubt that’s the single worst but there are plenty to choose from! "“Google’s highly complex DeepMind algorithm heralds the Fourth Industrial Revolution, which will change your life faster than you can say ‘unemployment line’” (Not an actual quote but not implausible either. People love not knowing what DeepMind is)" @n_srnck People should just assume they’re all bad unless they hear otherwise from credible sources (blurbs from authors’ friends don’t count) Wish I had time to write scathing reviews of bad popular science books about AI. There are so many these days. @monkeyx Lol RT @elaClaudia: An alternative to maximum likelihood for training autoregressive models. Check it out! https://t.co/GCqmdjEsJ3 Alright folks, I need to finish writing up my thoughts on face recognition ethics. https://t.co/7uQZbseOOo RT @ai4allorg: .@mozilla is awarding a total of $225,000 to support people and projects that examine the effects of AI on society. Applicat… (I realize some of these claims aren’t novel and I’m mixing generic learning-centric claims and her specific claims - point is it is a good defense of one end of the spectrum) The “Small Ordinary” toolkit as she calls it (associative learning, executive function..) as opposed to the “Big Special” list of cognitive functions often posited to be both uniquely human and innate (language, mindreading etc.) which she thinks is unique but mostly learned. I hadn’t thought before about how humans’ higher tolerance of/interest in other humans (compared to e.g. chimps) can plausibly explain a lot of learning. Notably, this is easy to make AIs do (pay attention to agents) - the hard part on this view is generic learning/memory stuff.. Following up on this after reading more - good book! Recommend for ppl interested in innate/learned Qs in AI. Def moved me more in the learned direction for some things (mindreading, imitation..) though author admits evidence is more mixed re: language. https://t.co/ndleLMiHU6 @kr_t @acl2018 Congrats! I'm in Seattle for two weeks if anyone wants to chat! RT @sidneyfussell: Everyone have a great night, I’m off all weekend. Bye! https://t.co/n5evBEpfya @unterix @cognition_x @azeem They’re available on my website under the presentations tab. RT @astroehlein: It's true that some religious extremists will try to use sacred texts to justify their ugly crimes, but if you meet a Chri… @julianhuppert @DeepMind_Health Cc @MikeWagers @tracyannkosa @barryfriedman1 I like this model for annual reporting of an oversight board RT @julianhuppert: The 2nd Report of the Independent Panel of Reviewers looking at @DeepMind_Health is now available at https://t.co/0nTyyv… RT @yasamanbb: Our ICML 2018 paper on training ultra-deep (10k+ layers) CNNs is now up, from work we've done at Google Brain: https://t.co/… "Hierarchical interpretations for neural network predictions," Singh et al.: https://t.co/fh0UALikp7 "Autoregressive Quantile Networks for Generative Modeling," Ostrovski et al.: https://t.co/PU0RtaT7DM "Dynamical Isometry and a Mean Field Theory of RNNs: Gating Enables Signal Propagation in Recurrent Neural Networks," Chen et al.: https://t.co/8YYuSt364N "Neural Stethoscopes: Unifying Analytic, Auxiliary and Adversarial Network Probing," Fuchs et al.: https://t.co/kH8VLRy2TQ "Selfless Sequential Learning," Aljundi et al.: https://t.co/CbAG3kSiDJ "Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10,000-Layer Vanilla Convolutional Neural Networks," Xiao et al.: https://t.co/nX5B2Tm7QQ "Manifold Mixup: Encouraging Meaningful On-Manifold Interpolation as a Regularizer," Verma et al.: https://t.co/bejgLCEghE """Self-Imitation Learning,"" Oh and Guo et al.: https://t.co/ryPW9Qf0A2 Imitating past good experiences in the replay buffer leads to big improvements over A2C, PPO, inc. good Montezuma performance in fewer frames than prior approaches" @nayafia I don't see rofl anymore but I do see lmao (and use lol). @hardmaru @DeepMindAI A+ on dream team RT @demishassabis: I’ve long been fascinated by how the brain constructs images in the mind’s eye. Our new @ScienceMagazine paper intros GQ… RT @DeepMindAI: The Generative Query Network, published today in @ScienceMagazine, learns without human supervision to (1) describe scene e… RT @valleyhack: Google funds $40 million space catapult. True. https://t.co/1d8pN2KcN6 RT @AnimaAnandkumar: Couldn't agree more: National Academies: Policies Must Change to Curb Sexual Harassment https://t.co/36yt470dd3 More work showing the plausibility of automated spearphishing - "DeepPhish: Simulating Malicious AI," Bahnsen et al.: https://t.co/1q8sZfzhZ2 https://t.co/qQnOXNCyu1 @jacobandreas @MIT_CSAIL congrats! Leaving the UK for a month tomorrow, will miss you all! 😢 RT @wsisaac: This assumes reforming surveillance technologies can be separated from politics and it can't. Republicans (who control all thr… @azeem 2019 need an AI to organize all the AI conferences "RT @dlowd: If you’re looking for work in AI, machine learning, or any kind of tech, here is a company to AVOID. If you already work for @…" RT @shimon8282: Final version of our #icml18 paper "TACO: Learning Task Decomposition via Temporal Alignment for Control" is now available:… “McCarthy will play a former corporate executive whose earnest yet unfulfilled life is turned upside when she is selected for observation by the world’s first super intelligence, a form of artificial life that may be on the verge of taking over everything.” 🤔 h/t my mom https://t.co/YErZuvmPYR RT @ylecun: There is almost as much BS being written about a purported impending AI winter as there is around a purported impending AGI exp… RT @juliehdavis: Let’s see if I have this straight: North Korea is no longer a nuclear threat, the president says, Kim Jong-Un is trustwort… @cgeorgewilliams Just raw peak possible FLOPs based on amount of hardware, ignoring thinking time per move/utilisation etc...@murraycampbell gave his own order of magnitude estimate of ~1000x @phileisn My guess is NIPS but I haven’t been to ICML yet RT @JanelleCShane: These "I forced a bot to watch X" posts are almost certainly 100% human-written with no bot involved. Here's how you can… "The streaming rollout of deep networks - towards fully model-parallel execution," Fischer et al.: https://t.co/wjgUbK87xb "Generative Neural Machine Translation," Shah and Barber: https://t.co/XVkC4RaS7u "A Probabilistic U-Net for Segmentation of Ambiguous Images," Kohl et al.: https://t.co/LUhO7qooRB "On Accurate Evaluation of GANs for Language Generation," Semeniuta et al.: https://t.co/xx7inAV9fi "Hierarchical Long-term Video Prediction without Supervision," Wichers et al.: https://t.co/URmKx6Pn5F """Marginal Policy Gradients for Complex Control,"" Eisenach et al.: https://t.co/5QdFGmbbww More use of the game King of Glory for evaluation by Tencent" "Fast and Scalable Bayesian Deep Learning by Weight-Perturbation in Adam," Khan et al.: https://t.co/cOOinpU3Fo @decodyng See also https://t.co/foq25tvRfF "Meta-Learning Transferable Active Learning Policies by Deep Reinforcement Learning," Pang et al.: https://t.co/nkE75wANIH @girishsastry Oh, you mean re: the compression thing? If they're roughly similarly hard problems, perhaps the fact that chess can be done at a superhuman level with much less compute is a sign that AGZ is inefficient, will scale down a lot like chess AIs did. @girishsastry One measure of the difficulty of a problem is how hard it is to find a solution from scratch (e.g. Levin search - something along these lines is proposed in Jose Hernandez-Orallo's work). AGZ started with similar knowledge + solved chess + Go in a similar ballpark of time. @davegershgorn no RT @jackclarkSF: Apply for this job! It's extremely fun and will be very impactful. https://t.co/Y4OkxToKE8 https://t.co/HK0pB3zBm3 @IntuitMachine Yep, they are def different. RT @chrisdonahuey: Some ongoing work with @Calclavia on generating NES music using deep learning 🤖🎮🔊. In this example, we train a neural ne… @murraycampbell Thanks! RT @murraycampbell: @Miles_Brundage This is hard to characterize exactly due to Deep Blue's special purpose hardware. My order of magnitud… @IntuitMachine What do you mean “used”? DB was a landmark in first surpassing humans, so was AZ. Stockfish was more compute intensive than DB but still less than AZ @sknthla I’ve been to Beijing, Shanghai, HK, Jinan, but word on the street is Shenzhen is the exciting place to go for tech these days. Also WikiTravel is pretty generally useful. @breadbored Also I’m just looking at speed, not per move @breadbored For AZ, from the papers - 4 TPUs of unspecified generation for inference, assuming gen 2 = 4*45 teraflops ish Perhaps @murraycampbell can confirm :) "Also, fun fact, Watson was in the same ballpark (at inference time) as AlphaZero. P.S. I’m seeing conflicting info on DB’s compute, but somewhere in the 3-5 order of magnitude gap vs AZ range. Wikipedia was a bit misleading." @IntuitMachine Yes I mention this later in the thread (Both were impressive achievements, for the record, I’m just pontificating on lessons learned :) ) This also cuts against the “Deep Blue was just brute force, AZ wasn’t” idea - yes, neural nets have a more intuitiony vibe than hand-coded search heuristics/AZ looked at fewer moves, but both require compute. The fancy intuition of today is the NBD heuristic of tomorrrow. It also suggests the possibility of substantial AZ compression (Suggesting the intrinsic hardness given limited hand-coded knowledge is roughly similar) AlphaZero used ~20k more compute at inference time than Deep Blue, despite being significantly more efficient than earlier Alpha*s. This has more to do with the way the systems work than intrinsic game hardness, though - AZ learned chess a bit faster than Go but <<20k faster. @AnimaAnandkumar @Caltech Congrats! RT @JeffDean: We're continuing to expand our @GoogleAI teams around the world. We’ll be opening our first research center in Africa in #Gh… Rereading one of my favorite AI-related books - very underrated IMO. https://t.co/Ul6LQTc6Jw RT @alicialewisKARE: What you've all been waiting for... #MissionImpossible #MPRraccoon 🤣 @kare11 @ElleryTV @DPet_KARE11News @timnelson_mpr… "RT @Smerity: A team at @clarifai worked in a windowless ""Chamber of Secrets"" on a military project that wasn't described as such where a Ru…" "Should have known the meme thing would get all the attention :/ but this is the more important thing I tweeted yesterday: https://t.co/ZihLEgdxzi Also this paper is v. interesting, by Gupta et al.: https://t.co/LGWwFwH1te" RT @jackclarkSF: I'm hiring someone to work with me at @OpenAI on scientific communications. This will involve reading a lot of papers and… RT @cnnbrk: Trump says he trusts Kim Jong Un. And if he's wrong? "I may be wrong, I mean I may stand before you in six months and say, 'Hey… RT @RogerGrosse: Neural Kernel Networks: a differentiable framework for compositional kernel learning. Like the Automatic Statistician, but… RT @tsimonite: Startup Clarifai also worked on the Pentagon's Maven AI project https://t.co/i9lLUh3uq0 It got hacked. Ex-employee's lawsuit… @togelius @FilipoGiovanni Needs physics and hardware at the bottom. ;) "The headline is the least interesting part of this story... 🔽🔽🔽 https://t.co/IT9UQTUe2I" "Quaternion Recurrent Neural Networks," Parcollet et al.: https://t.co/vgvZTU2a3K "Focused Hierarchical RNNs for Conditional Sequence Processing," Ke et al.: https://t.co/zpKL8ZYDzS "Organizing Experience: A Deeper Look at Replay Mechanisms for Sample-based Planning in Continuous State Domains," Pan et al.: https://t.co/0xdvCtr6RH RT @SamBendett: Startup Working on Contentious Pentagon AI Project Was Hacked - WIRED https://t.co/tzqPjzjbb2 "Multi-Agent Deep Reinforcement Learning with Human Strategies," Nguyen et al.: https://t.co/bsAtBlbvZJ "Differentiable Compositional Kernel Learning for Gaussian Processes," Sun et al.: https://t.co/o5dWVZuRjI "Embedding Text in Hyperbolic Spaces," Dhingra et al.: https://t.co/PO9UGWeRUw """Dank Learning: Generating Memes Using Deep Neural Networks,"" Peirson and Tolunay: https://t.co/dUdA0VDaYo Stanford CS 224n project... not sure what @RichardSocher is doing here https://t.co/0UgWKvgaMF" RT @svlevine: Meta-learning enables fast learning, but needs hand-engineered meta-training tasks. Can we get the tasks themselves automatic… Heading to Singapore next month and I promise not to throw South Korea under the bus for no reason while I'm there. Trump: 0, Me: 1. "RT @jwangARK: My talk on the future of AI hardware at #CogX. TLDR: Nvidia has already shipped the TPU pitched by startups in 2015 (and will…" This one's going to blow @BrundageBot's mind... https://t.co/DgFuBuq9RO "Unsupervised Meta-Learning for Reinforcement Learning," Gupta et al.: https://t.co/LGWwFwH1te RT @dog_rates: This is Simba. He graduated beginner’s training class today. Good boy levels off the h*ckin charts. 14/10 would congratulate… RT @WonderMicky: Sexual harassment is rife in the sciences, finds landmark US study https://t.co/7zIAkQgKnt RT @nktpnd: Completely, verifiably, and irreversibly dismantle ICE. https://t.co/ikzd4l9zef RT @stanfordnlp: Since 2016, SQuAD has been the key textual question answering benchmark, used by top AI groups & featured in AI Index—http… RT @dlowd: Can Facebook use AI to fight online abuse? In this article, I discuss the challenge of vague definitions, evasive adversaries, a… @mark_riedl https://t.co/gvARb1Ban6 RT @shakir_za: @NipsConference Name-of-NIPS Action Team just sent a survey to past participants for suggestions on a new name. If you are a… RT @ColinKahl: Critics of the Iran deal blasted Obama for giving up maximum leverage for a less-than-perfect agreement, even though the 156… RT @charlotte_stix: European AI landscape: @EU_Commission and EurAI report @BarryOSullivan drawn up by me. Covers a variety of national str… RT @crudereporter: You all knew this just *had* to happen right? https://t.co/uIgeGJEoYq RT @HMRoff: It’s like I’m living in bizzarro world. Trade wars with NATO allies, insults to Canada, and major concessions to the North Kor… RT @jhamrick: Also our work on using graph networks to stabilize towers of building blocks by gluing pairs of blocks together, to be presen… RT @jhamrick: Super excited to share my most recent work with @PeterWBattaglia and many others at DeepMind on relational inductive biases i… @metaculus @ESYudkowsky Should have something concrete in a few weeks @wsisaac @DeepMindAI Awesome, congrats (to both you and DM)! RT @vkrakovna: Agree with @AndrewYNg that hype around AGI is a distraction - not only from important near-term issues in AI like algorithmi… "The most successful people I’ve met: 1. Are very generous with their time/attention 2. Sleep 12+ hours a day 3. Manage their managers 4. Enjoy simple pleasures 5. Retire early 5. Are pampered dogs https://t.co/vct3VAEwwF" "Ignorant TV star has high profile meeting with North Korean leader, gets duped into thinking everyone there is super happy and the leader is super reasonable. The plot of the movie The Interview and also literally what just happened." @j2blather It isn’t - Iran Deal was way better, this is vague reaffirmations of old vague commitments to ill-defined denuclearizatin RT @BenjySarlin: I’m not sure it’s possible to capture an entire era in one image, but Dennis Rodman running a cryptocurrency grift on live… "Building Bayesian Neural Networks with Blocks: On Structure, Interpretability and Uncertainty," Zhou et al.: https://t.co/tnmLTxihLv "Smallify: Learning Network Size while Training," Leclerc et al.: https://t.co/ykpoqUj3xX "Data augmentation instead of explicit regularization," Hernández-García and König: https://t.co/pfic0ecpDz "Massively Parallel Video Networks," Carreira and Patraucean et al.: https://t.co/c5tcvq4wVx How often are things in papers that “might be of independent interest” actually of independent interest? """Are All Languages Equally Hard to Language-Model?,"" Cotterell et al.: https://t.co/YLbx3jy0hA Spoiler: No" "Adversarial Meta-Learning," Yin et al.: https://t.co/bZ4h5ysVLR "Explainable Deterministic MDPs," Bertram and Wei: https://t.co/Yf2Tb3QDbe "TAPAS: Tricks to Accelerate (encrypted) Prediction As a Service," Sanyal et al.: https://t.co/R0U7YcRPUC "Randomized Prior Functions for Deep Reinforcement Learning," Osband et al.: https://t.co/hy1gl8rxtE "Bayesian Model-Agnostic Meta-Learning," Kim and Yoon et al.: https://t.co/OajN1aVrMp "An Efficient, Generalized Bellman Update For Cooperative Inverse Reinforcement Learning," Malik and Palaniappan et al.: https://t.co/93gX4p0ort "Context-Aware Policy Reuse," Li et al.: https://t.co/A5AAFMQxXp @timhwang dat reference @ArtirKel Easier, though. If I find cooked waffles I'll buy them :) UK achievement unlocked: buying crumpets at the grocery store. RT @TheSciBabe: I have a both a love & fear of Angela Merkel. Not because she's the leader of the free world or because she makes Trump cry… RT @filar: “Max evil” MLsec: why should you care? by @bodaceacat Excellent discussion on the role ethics plays in machine learning for the… @geoffreyirving Sidenote: are there any known cases of people poisoning ostensibly research-oriented AI training data or putting any other malicious stuff in libraries? Seems like a matter of time... RT @nikiparmar09: Pre-training on large amounts of text using a Transformer and then performing similar or better on a whole range of NLP t… @swapanj162 @azeem 5 hours 45 minutes ish I think, bit after "It's Unsupervised Language Learning Week in the Bay apparently! Shot: https://t.co/NnfE3HgwZb Chaser: https://t.co/3CYWAi2s1R" "RT @AlecRad: What I've been working on for the past year! https://t.co/CAQMYS1rR7 Inspired by CoVE, ELMo, and ULMFiT we show that a single…" "RT @jeremyphoward: This is exactly where we were hoping our ULMFit work would head - really great work from @OpenAI! 😊 If you're doing NLP…" "Slides from my talk earlier using Atari/Go as case studies of recent AI progress. See our recent paper (my pinned tweet) and my blog posts for more on these themes. https://t.co/3nHjq5QtJn Video here: https://t.co/He9FxnJtYr (orange slides) Thx @azeem et al. for hosting!" @monkeyx @RogerGrosse For my part I work on multiple issues/timeframes but I empathize with Roger’s annoyance as I know many ppl who both care about social justice issues and work on AGI stuff @monkeyx @RogerGrosse I get that POV, but think ppl overstate the amount going to AGI stuff. Gets a lot of airtime for sure (more a journalists issue than a researchers issue) but in the low millions of actual investment, dozens of ppl, vs arguably orders of mag. more on immediate stuff. See also @vkrakovna's post on this question - "Is there a trade-off between immediate and long term AI safety efforts?": https://t.co/wr04AN63eR https://t.co/3SMBs1rhwo RT @RogerGrosse: I wish people would stop making this argument. I never hear it in any other context besides mocking AI alignment research.… RT @OpenAI: Fine-tuning an unsupervised pretrained transformer to set new state-of-the-art on diverse language tasks: https://t.co/Fi9ba7Jn… RT @RebeccaCrootof: Looking for a piece about autonomous weapon systems that manages to link Shakespeare, war dogs, and swarming drones? Lo… @rcalo Ouch @drkatedevlin @alan_winfield Cannot be unseen now that you pointed it out haha :) RT @thtrieu_: We show large language models trained on massive text corpora (LM1b, CommonCrawl, Gutenberg) can be used for commonsense reas… @y0b1byte And that’s good to know - will dumb it down more next time ;) felt pretty high level to me but I guess lots of ppl arent that familiar with Alpha*, ALE etc, hopefully a decent % got it @y0b1byte Yeah I would have liked longer of course. @y0b1byte Log scale could be useful if we formally put Ape-X, IMPALA the mix but currently it isn’t shown - 2nd graph isnt based on actual compute calculations, just illustrative (but Y axis is correct) @y0b1byte No - most stuff is in the same ballpark (pre-Ape-X - not on first graph) @libbykinsey Probably not, :( but let’s find another chance sometime! Made this little number last night - actually an understimate of the difference in compute but I wanted the original graph to be visible. https://t.co/6kkdfU4Lyu @libbykinsey Hey Libby, sorry to have missed your talk! Would be interested to chat if you’re still around (in the Cutting Edge Meet the Speakers room currently) @jay_blackwater https://t.co/MP6vI0ikN5 @atg_abhishek https://t.co/MP6vI0ikN5 @EBKania I don't mean that as a knock against your article, just curious what your view is on that broader narrative. I was pretty appalled by the US position. @EBKania Thanks for writing this! But it strikes me that China's lukewarm support for a ban seems a lot better than the US's "killer robots are awesome" position at the latest meeting (?). Typo: all the Martinez-Plumed stuff should say 2018, not 2017 as it does in one case Looks like my talk is on this livestream - look for the orange slides: https://t.co/DUlKlT7rFg RT @jwangARK: The world’s most complex microprocessor comes not from Nvidia, Intel, or Google. It’s the deep learning chip from @graphcorea… @azeem Didn’t mean to give you a scare, bit if a train hiccup @jay_blackwater Prob my website and i’ll tweet the link @azeem Outside @azeem Yup be there in 1 min! @atg_abhishek Dunno but will share slides Will upload slides later Speaking about “Understanding AI Progress” in 20 mins at CogX. Will discuss Atari and Go as case studies of broader phenomena like compute-intensiveness and forecasting difficulty. @mikarv Already tweeted it ;) @BillDouglasDC @cognition_x That’s basically what my talk soon will be :) ??? Trump’s America https://t.co/mCleZMOB95 RT @DefTechPat: Here’s How #Google Pitched AI Tools to Special Operators Last Month https://t.co/w4XBXq87lB My latest for @defenseone "RT @L_badikho: Joint work with @science__4__all, R.Guerraoui and last but not least Alexandre Maurer, who did the heavy-lifting. tl;dr: We…" RT @JeffDean: Very cool picture created by @zzznah using a custom neural style transfer model. https://t.co/iOT39JKHcK "RT @RealAshEdwards: The code for our recent work, ""Imitating Latent Policies from Observation,"" is now on github! @him_sahni @yscrcr https…" Haven't taken the time to redo this but basically it's mostly blue now: https://t.co/1ARgKzQt7c Mentioning this b/c last time I did a cursory check, there weren't any such cases. So, still slower than ppl at learning, but final scores are now better than amateurs on ~ all games, better than "expert" game testers on many, and better than all humans on a few. Note that unlike humans, AIs are generally time-limited at test time (including this case). I haven't looked closely to see whether that's often a factor in limiting competitiveness against top human scores, though. cc @marcgbellemare "Atari games on which Ape-X DQfD (deeper) beats the top all-time human score (using Twin Galaxies data from this blog post: https://t.co/aPxPGP7UWq). Assault Crazy Climber Name This Game Up'N'Down" "RT @robotic_hands: @Miles_Brundage Tired: we can't interpret deep learning Wired: look at this code my RL agent wrote" "I agree, not enough deep learning. (haven't actually read the article). https://t.co/fidDTWABqH" "Slalom: Fast, Verifiable and Private Execution of Neural Networks in Trusted Hardware," Tramer and Boneh: https://t.co/tivfYttLxO "Residual Unfairness in Fair Machine Learning from Prejudiced Data," Kallus and Zhou: https://t.co/sg6APESA9H "Blind Justice: Fairness with Encrypted Sensitive Attributes," Kilbertus et al.: https://t.co/GMBBWVQ31E "Towards Binary-Valued Gates for Robust LSTM Training," Li et al.: https://t.co/4GyEPrkg7C "Removing Algorithmic Discrimination (With Minimal Individual Error)," @L_badikho et al.: https://t.co/oM7JDzlTXw "Program Synthesis Through Reinforcement Learning Guided Tree Search," Simmons-Edler et al.: https://t.co/QfW1v2tKck "Temporal Difference Variational Auto-Encoder," Gregor and Besse: https://t.co/HPk6bbZlUL """A Simple Method for Commonsense Reasoning,"" Trinh and Le: https://t.co/NnfE3HgwZb Language models used to improve performance on Winograd Schemas, etc. (still far short of human performance)" @zacharylipton @cognition_x (original target venue was a broad-tent AI conf., not ML, as context) @zacharylipton @cognition_x Someone evaluating planners might care about the human expertise/time needed to inject domain knowledge...etc. Same framework seems applicable. @zacharylipton @cognition_x We do focus on ML, but the concepts are pretty generally applicable. E.g. if you cared about search algorithms, you might be more concerned about "costs" related to memory, and less so about data, but still care about compute, and you could formulate a utility function for it. For example, adding the latest Atari paper to the graph we had in the paper = ~this. Actually, x-axis is rough/prob. underestimate but the y-axis change is roughly right. Point is, improved performance at the cost of >> compute, and also human demos (a 3rd dimension not shown). https://t.co/Gi7xcyJVki *a lot of recent developments involve. And I mean data re: what the inputs are, compute-wise, data-wise, hyperparam. tuning-wise, etc. To put this point crudely (/bastardize our paper - check it out for a formal treatment of these ideas) - algorithmic progress is about doing more with less and a lot of recent developments involving doing more with more. Hard to disentangle what's algo-impressive w/o better data. (There have been cases where better performance has been attained with less compute/data in Atari, but I'm talking about what's going on at the highest level of mean/median performance) Some other thoughts: recent Go progress came via algo. improvements as well as driving up one kind of input (compute) to reduce another (human demonstration). In the case of Atari, there have also been algorithmic improvements but costs have mostly just increased (compute/demos). @mat_kelcey 😍 Also, an FAQ is a good format for this sort of thing. """Westworld apologetics: an FAQ,"" Paul Christiano: https://t.co/ptPSDYabZl Nice postulation of off-screen events in order to make the show more plausible. May do this for Person of Interest someday (first I need to finish compressing it, though)." Cc @halhod Petaflop/s-days to be more precise* These are petaflop-days, not petaflops, @TheEconomist. https://t.co/rO2Jw88R6H RT @rebecca_roache: Omg who did this 😂😂😂😂😂 https://t.co/bWmxaBeKtD RT @70Ceeks: https://t.co/oA9RW8j2Ej @ankurhandos https://t.co/HJpe2y2sHJ @ESYudkowsky Working on an operationalization of this for survey purposes - by default survey responses will be non-public but the Qs should be clearly falsifiable and ppl can then chime in publicly It’s Sunny Sunday! https://t.co/8D7pvcQWyn Still not sure what I'll say but possible themes: we don't know how predictable progress on AI tasks is b/c relevant data isn't always available/well organized/+ppl rarely make falsifiable predictions, + lack of robustness is a big outstanding issue for societal/econ. impact. Will be saying some stuff about AI progress tomorrow at @cognition_x, inc. our recent paper "Accounting for the Neglected Dimensions of AI Progress": https://t.co/uvD4sU0uPr @halhod Such a cool city RT @TheAtlantic: “He’s like Heath Ledger’s Joker—but without the operational excellence," one senior G7 official tells @DavidFrum, in the w… RT @jwangARK: Going to be at CogX London this week to talk about AI hardware. Who's around?? https://t.co/k9lHZ2ww6L @ivan_bezdomny Congrats! RT @dandrezner: Nothing to see here, just the national security adviser gleefully tweeting out the erosion of U.S. alliances. https://t.co/… RT @BrendanNyhan: Today feels like a turning point - the Western alliance and the global trading system are coming under the same intense s… @RebeccaCrootof https://t.co/IjBrXf8AdZ RT @nytimes: Breaking News: President Trump upended two days of diplomacy, refusing to sign a Group of 7 statement and calling Prime Minist… RT @dandrezner: “The U.S. president did not appear to be listening during some of the trade presentations, another G7 official familiar wit… @KloudStrife @KaiLashArul yeah ApeX-DQfD is what I was referencing in the original post. @sekahos @KaiLashArul yeah pretty much. and in this case, even with small networks it's a prohibitively expensive set of experiments so it's icing on the cake. @pfau the most pronounced instance in this case seems to be Chopper Command - from the same ballpark as prior approaches to almost 10x improvement from going deeper/wider. (minor sidenote: IMPALA blog post (URL cached on Google/linked to from the IMPALA paper page) seems to be broken, FYI @jonfildes/@v_maini) Oh yeah, thanks, Kai! Forgot about this being in the IMPALA paper. https://t.co/ROxlukXWjp @KaiLashArul oh yeah!! Seems like such an obvious thing that someone has surely tried it before, but AFAIK people usually report scores with DQN 2015-like network sizes, and focus more on algorithmic changes or other forms of scaling up (decentralized actors/learners and more frames especially). Going back to Pohlen et al. - it's interesting that just growing the network was responsible for roughly doubling median scores, though the other contributions are the focus of the paper. Are there any other papers exploring bigger nets with other algos? https://t.co/A9bsGy10iL RT @hardmaru: I wrote a short blog post with step-by-step instructions for reproducing the experiments in the world models paper. https://t… Great big picture historical perspective here - especially recommended for ML folks less familiar with planners (I was fortunate to take @rao2z’s class and get some of that perspective :) ). https://t.co/68nvkNjm6f It’s (NIPS) Submission Reading Saturday! RT @togawamercer: I offer this picture from the G7 with no comment (h/t @MegReiss) https://t.co/L8SEWGXbqr RT @zinmalu: Happy to share our ICML paper, hot off the press 🎉 Looking forward to discussing it with you all @icmlconf https://t.co/9VjO3s… RT @CadeMetz: When Mark Zuckerberg invited Elon Musk to dinner -- with killer robots on the menu: https://t.co/mqabcDXgrC @KarinaVold You are keeping busy! Also congrats on Minds, sounds from the tweets like it was a lot of fun :) any videos? https://t.co/voqr0DOfgO RT @nytimes: In Canada, many observers were calling it the "G-6 plus 1" — with President Trump being cast as the irrational, irascible and… Hope to also have some related work of my own to share in the not too distant future. "Finally got around to finishing @mchorowitz's thoughtful article, ""Artificial Intelligence, International Competition, and the Balance of Power"": https://t.co/fYvKq9GZmw Worth checking out for those interested in such things!" Apple needs to figure out how to do federated learning or whatever to improve their AI in a privacy-preserving way so my phone won't buzz about basketball while I'm going to sleep. Misleading framing. Humans are bad at explicit conscious computation (=what they're talking about) but have vastly more computational power than this suggests b/c optimized for other stuff. Plausibly this is >human brain capacity but not by that magnitude. https://t.co/CJQHUUpVON "Finally, 6. There are multiple reasons to file patents, not all of which are patent trolling. FWIW, I think this (AI patents) is an important topic and have been asking around about it/suggesting journalists look into it for a long time, but it's not a DM thing or a new thing." Since it seems like this article is making the rounds, some quick/uncontroversial points for common knowledge: 1. lots of companies have AI patents, 2. they're often broad, 3. these aren't DM's first patents, 4. yes, this could go badly, 5. it hasn't yet https://t.co/lU4GluHbo2 Also, it's Silly Saturday. How to stop an AI arms race in one easy step: tell military generals that the "general" in "artificial general intelligence" means automating away their jobs. TFW you can spell well https://t.co/GfF2hzuJvE RT @togelius: You know what's better than video games for testing your RL algorithms? Why, a framework where you can easily make new games… @WonderMicky @DeepMindAI @shakir_za V normal sadly! There’s a dropout one for example... @dlowd @togelius @DeepMindAI Not saying they nec. should exist, just wanted to note this isn’t a DM specific thing and there are better and worse reasons to patent. AFAIK nothing on the extreme bad end (overbroad+anti-social enforcement) has happened yet but it’s a serious possibility @jvmancuso @togelius @DeepMindAI There are tons and tons of patents on things that are routinely violated. @jeremyphoward @togelius @DeepMindAI ...and grant overly broad ones @jeremyphoward @togelius @DeepMindAI I dunno. I think the bigger question is what they do with the patent, if anything. A defensive patent, or one only/rarely used to get people to stop doing something ethical (for example), seems potentially OK. But a bigger problem is gov't's aren't competent to evaluate these... @togelius @DeepMindAI Hinton has a dropout patent (!), for example @togelius @DeepMindAI Not sure why DM is being picked on here? Lots of companies have tons of patents, and yes, they're too broad. AFAIK none have been enforced yet. RT @gazamom: He was a master baby whisperer, and a master storyteller, having rocked my 7 month old to sleep in the middle of shooting our… RT @AthertonKD: we live in hell https://t.co/9tiqEsEyZb "RT @catherineols: But no really, cultural norms are actually pretty important. (Gillian Hadfield is an incredibly thoughtful law & economi…" 28k GPUs https://t.co/b8Ttkorn0R RT @LAM_Barrett: My draft paper Model(ing) Privacy: Empirical Approaches To Privacy Law & Governance is on @SSRN, and I'd love to hear your… RT @mer__edith: Big! @Google's ethics principles are a great step toward establishing ethical accountability across the industry. But we ca… @markus_with_k Yeah I like DeepMind’s papers (except when they leave out key Atari info 🙊) - also liked this (albeit v simple) one from a while back: https://t.co/vA9D10sFn6 "RT @kellymcb: When reporting on suicide: -Include resources for people who need help -Avoid oversimplifying the cause -Minimize details of…" RT @KateAronoff: this would be a pretty ballsy way to announce bankruptcy https://t.co/RmcEzO2nS8 "Tired: a competent State Department Wired: Tweeting “Please tell...” https://t.co/uyAQpIQG21" RT @SciWriBy: Fuck depression. Fuck the way it isolates people and makes it so difficult to see a way through. #MentalHealth needs more fun… RT @NIMHgov: Never ignore or minimize comments about death and suicide, even if it seems like a joke or overdramatic. Suicidal thoughts or… "RT @TJSmithMedia: Wow. 1-800-273-8255 ~ National Suicide Hotline @afspnational Don’t think you are in this alone. Anthony Bourdain. Earlie…" RT @mitchellreports: White House announces @realDonaldTrump will leave G7 4 hours earlier than scheduled, before the end of the meeting - r… RT @drewharwell: New: Unproven facial-recognition companies are targeting schools, promising an end to shootings - and reaping the rewards… "Progressive Reasoning by Module Composition," Kim et al.: https://t.co/hsJdDdesba "Re-evaluating [AI] evaluation," Balduzzi et al.: https://t.co/nMlWdgIRv2 "Adversarial Attack on Graph Structured Data," Dai et al.: https://t.co/2YWTKoFvik "Understanding Batch Normalization," Bjorck et al.: https://t.co/NsTlPUqXXM @lerner_adams @chelseabfinn @svlevine The algorithm acronym is spelled with an I (fixed my earlier tweet with a Y :) ) """Probabilistic Model-Agnostic Meta-Learning,"" @chelseabfinn,* Xu,* and @svlevine: https://t.co/M4am8heFxE MAML-->PLATIPUS!!!!" "Deep Variational Reinforcement Learning for POMDPs," Ipl et al.: https://t.co/gxbTDG79wT "Simplifying Reward Design through Divide-and-Conquer," Ratner et al.: https://t.co/GWWdBPnu98 "Path-Level Network Transformation for Efficient Architecture Search," Cai et al.: https://t.co/ckLzQEYWhu "Self-Consistent Trajectory Autoencoder: Hierarchical Reinforcement Learning with Trajectory Embeddings," Co-Reyes, Liu, and Gupta et al.: https://t.co/3AFQkUo4Dg @Hernandez_Danny (none of these are super stable views, FWIW. There's a lot of info I don't have re: the internal politics that would inform my interpretation of the wording) RT @y0b1byte: My notes on "Relational Deep Reinforcement Learning" (https://t.co/xvue4u94HS) by Zambaldi, Raposo, @santoroAI, @OriolVinyals… @Hernandez_Danny FWIW I'm maybe more worried abt gov't-Google cyber stuff than LAWs. Cyber stuff was explicitly *included* and can be framed as not "primarily" intended to cause personal physical harm. Additional clarifications/principles might be good (a la MSFT's no-cyber-offense commitment). @Hernandez_Danny I think even caveated language will create a situation where anything near the line will be (even) more likely to be opposed internally, so there will be some effect. But think it's safe to assume they were deliberate about the wording so as to leave some wiggle room. RT @JeffDean: Joint work from the Google Brain team, DeepMind, and Moorfields Eye Hospital (UK) on using deep learning from retinal images… @Hernandez_Danny *anti-personnel autonomous weapons, and mass surveillance that goes against "internationally accepted norms" @sbenthall Congrats!! RT @CBCAlerts: Canada, France sign joint plan on worldwide gender equity, agree on framework for action on artificial intelligence and anno… @iandanforth Nascent 👶 @rcalo What struck you as positivist about them (I get the utilitarian thing, v on point) @davegershgorn @mgubrud @JeffDean actually I now see I first saw them from @mmitchell_ai but didn't realize they were diff. from the original doc til Jeff's tweet. Also props for Meg on spearheading the fairness stuff!!! RT @mmitchell_ai: Google's Responsible AI Practices are out! Proud and honored to have initiated the Fairness section. Excited to share, an… @davegershgorn @mgubrud Yeah these are more concrete (h/t @JeffDean from whom I first saw them) RT @JeffDean: In addition, we’re offering our technical practices to actually implement these principles - we hope everyone finds these inf… Yeah, bit vague in places (e.g. @mgubrud notes they don't nec exclude offensive cybersecurity or anti-materiel auton. weapons) but it's a start. Making general purpose but concrete principles is hard. Working on this w/ Axon + sharing our 1st attempt soon. https://t.co/50fDknT1N2 @Gregory_C_Allen @jeffclune @marksugruek @jackclarkSF @BanKillerRobots @carrickflynn Not sure where the origin of the idea is. Heard something related to it at this workshop https://t.co/PsBX9lhwHQ and it seemed like it was already bouncing around in blockchain world before then, but don't know the precise evolution RT @DeepMindAI: New AI safety paper - "Measuring and avoiding side effects using relative reachability": https://t.co/OIfaY3xIib RT @janleike: New paper on teaching RL agents to understand the meaning of instructions. Instead of manually specifying rewards, we learn t… "Efficient Differentiable Programming in a Functional Array-Processing Language," Shaikhha et al.: https://t.co/ohUAHAUcL1 "On Discrete-Continuous Mixtures in Probabilistic Programming: Generalized Semantics and Inference Algorithms," Wu et al.: https://t.co/BnOw9RnTPn RT @pfau: I'm excited to share my latest paper with Stig Petersen, Ashish Agarwal, @dgtbarrett and @neuro_kim! We derive a general framewor… @pfau good Q Look forward to reading this - have enjoyed his big picture think pieces (informed by deep experience in planning algorithms) in the past. "Model-free, Model-based, and General Intelligence," Hector Geffner: https://t.co/DyWjvwoJnH @pfau this is pretty typical, never goes out exactly on time. ~20-25 after the hour on days other than Monday, bit later for the big batch on Monday RT @egrefen: Happy to share our new @DeepMindAI paper on AGILE, a method for training agents to follow language instructions by jointly lea… RT @SamanthaWork: Actually this is objectively Cool https://t.co/WrJ7B1rA3F "RT @justkelly_ok: Okay, LMAO the CEO's response wins all CEO responses to PR crises: “He needs to take a big dose of ‘shut the fuck up' an…" RT @BelferCenter: Interview With John Holdren: Trump has No Science Policy to Speak Of: https://t.co/8gEciM4Nem No deep RL for battery control allowed Could be a decathlon type thing with sub-events such as Very Long Trip with No Recharging; Minimizing Time Spent Home Before Phone Death on a Day Trip with Unexpected Delays Near the End; etc. I like to think I'd be competitive in the future Olympics category of Having Your Phone Barely Last the Duration of a Trip and Die Right When You Get Home. @Gregory_C_Allen (As some internally warned last year, re: it blowing up if leaked, and they were right) @Gregory_C_Allen Re: scope of Maven more generally, that could be true and you know more about it than I do but certainly Google never made the case coherently internally or externally for why such a distinction was true or useful. Think they should have been open long ago if planned to keep it. @Gregory_C_Allen It’s quite fuzzy. The infrastructure built for Maven by Google could prob be used for a range of purposes even if Google engineers don’t do strike stuff directly - they’re making it easier (somewhere in the middle of the “just publishing” and “doing it” spectrum). (1/2) Agree with much of @Gregory_C_Allen's article here re: DoD collaboration not being all or nothing. The DARPA stuff he mentions seems more analogous to bioweapons defense R+D than Maven does, though - I don't see how that wasn't offensive/safety-critical. https://t.co/S7Objpikae RT @DeepMindAI: Our @ICMLconf paper introduces Mix&Match - a general-purpose framework for training complex RL agents. M&M creates curricul… @ArtirKel *though I guess there's also a many-task aspect to it, I was just specifically thinking of the "agent able to control more than 700 actions in a challenging 3D first-person task" part @ArtirKel *many actions, not tasks @ArtirKel No, this one is more position papery. The SC related relational one was this https://t.co/cdljTotZmw and then there's another one that isn't explicitly SC related or relational reasoning related but still indirectly related (b/c many tasks/curricula stuff) https://t.co/d65Uk8O7Qv No offense to the authors of the other papers - they all seem good - but this seems like the first one to read on the list as it motivates the others/has a good review. Digging this paper, one of several this week by DeepMind+friends. One's on humans' relational reasoning, 3 are on problems/tasks (relational RNNs, DRL...), and this is the big picture one - "Relational inductive biases, deep learning, and graph networks": https://t.co/3UGxSOGxDv Agreed! There are things we could have said but deliberately didn’t, and of course things we didn’t think of. https://t.co/aLEM4rv3E1 @tdietterich @zacharylipton @timnitGebru @chrshmmmr @Ismail_Elezi @Google I interpreted Zach’s original suggestion as just pretending they don’t exist (e.g. you click on the # and they aren’t there). More amenable to the idea of not including them in # but still showing them, or some hybrid (e.g. “6(2 external)”) RT @OriolVinyalsML: A nice update on StarCraft2 minigames thanks to Relational Architectures + IMPALA: 196 vs 177 (GrandMaster) vs 104 (pre… @zacharylipton @timnitGebru @chrshmmmr @Ismail_Elezi @Google +Some self cites are legit and this doesn’t seem worth losing easy access to those when cite tracing something, just bc some ppl who have bad view on cites + spend <a minute looking at GS can be duped @zacharylipton @timnitGebru @chrshmmmr @Ismail_Elezi @Google You were able to discover that pattern, though, which seems good - I like having an accurate(ish) picture of who’s citing whom, even if it’s an ugly picture. RT @giuse_tweets: What if the neural network was entirely dedicated to decision making? Recent work with @togelius @eXascaleInfolab shows A… "RT @santoroAI: In our two latest preprints we tackle temporal and spatial relational reasoning: https://t.co/ufyjpiPJMN https://t.co/fdixw…" RT @alexkealy: yes sex is good but have you tried running late for a meeting and, as youre about to text an apology, they themselves messag… @j2blather @alan_winfield I can’t speak authoritatively to everything he’s written of course :) but here’s a relevant passage in a report related to his talk https://t.co/fIerpMj3zd https://t.co/EpcnmxLJ05 @markus_with_k @DeepMindAI Congrats!! @j2blather @alan_winfield Not at Jose’s talk but in his writings at least he does discuss NFL viz-a-viz his conception of generality (making the point that there is more common structure across tasks in the real world than assumed in NFL theorems, if I recall correctly) (Sort of implicit as he mentions TD-Gammon) "Old (2001) think piece from Richard Sutton - “Verification [of knowledge], the Key to AI”: https://t.co/kecJX0LqU3 “An AI system can create and maintain knowledge only to the extent that it can verify that knowledge itself.” He says this supports search, but RL also fares well" RT @alan_winfield: Next short talk at #CFIMinds is from José Hernández Orallo on Diversity unites intelligence: measuring generality. See h… @ArtirKel FWIW the most recent time I made a prediction on this I was much more conservative (<3 years from now) so not feeling v confident haha but making sure I at least have a fair chance @ArtirKel E.g. mix + match paper from last night on many-action curricula, + relational DRL shows good prog on mini games as well as infrastructure for evaluation (human master baseline) @ArtirKel The Fan Hui private->public time lag was 3 months, so 6 months is conservative (no reason the gap couldn’t be longer) - let’s say 4.5 to compromise :) and no, not insider knowledge but some recent papers are promising and I realized we didn’t make this explicit so being safe @ArtirKel Following up on this, just wanted to make explicit that the bet should not resolve immediately at the end of the year, but, say, 6 months after, to wait for things that might happen non-publicly before year end to be revealed. "On layer-level control of DNN training and its impact on generalization," Carbonnelle and De Vleeschouwer: https://t.co/6lXvcyGpqG """Analysis of DAWNBench, a Time-to-Accuracy Machine Learning Performance Benchmark,"" Coleman et al.: https://t.co/093249hcUz Pairs well with our latest paper - ""Accounting for the Neglected Dimensions of AI Progress,"" Martinez-Plumed et al.: https://t.co/uvD4sU0uPr" "Backdrop: Stochastic Backpropagation," Golkar and @KyleCranmer: https://t.co/IFrLP8uUpQ "Relational recurrent neural networks," @santoroAI, Faulkner, and Raposo et al.: https://t.co/PYps70yeDY It's Relational Reasoning Week in London apparently... """Playing Atari with Six Neurons,"" Cuccu et al.: https://t.co/o24EGI4AUS (6-18 for decision-making - additional computation needed for state representation which is separate but jointly trained)" "Deep Mixture of Experts via Shallow Embedding," Wang et al.: https://t.co/QytuDTAUY5 "Discovering and Removing Exogenous State Variables and Rewards for Reinforcement Learning," @tdietterich et al.: https://t.co/aI9Z7AdB7n "Mix&Match - Agent Curricula for Reinforcement Learning," Czarnecki and Jayakumar et al.: https://t.co/Fe2S9isq0o "The Effect of Planning Shape on Dyna-style Planning in High-dimensional State Spaces," Holland, Talvitie, and @MichaelHBowling: https://t.co/bhvVsiw5fk "In the StarCraft II Learning Environment, our agent achieves state-of-the-art performance on six mini-games -- surpassing human grandmaster performance on four." "Relational Deep Reinforcement Learning," Zambaldi, Raposo, and @santoroAI et al.: https://t.co/u4U9VWFuiw In London tomorrow, let me know if you want to say hi :) RT @anderssandberg: Interesting paper from some of my colleagues about how different 'costs' of improving AI play out as a Pareto frontier:… @ESYudkowsky Yeah, I didn't take you as saying there was no value added. @ESYudkowsky Published != journal-published. The latter doesn't seem critical to have an impact in this area... @ESYudkowsky Why is the last part (can't get published) true? Anyone can put stuff on arXiv, and people write papers claiming incremental progress towards solving safety (or interpretability, or fairness, or whatever) all the time without repercussions. RT @ada_rob: @Miles_Brundage check out the blog post with more examples and demo apps at https://t.co/R3wfjc0cKp! RT @lydiaemman: Kratsios asked what conversations he’s had with President Trump about AI. Kratsios takes a sip of water, avoids answering t… RT @stefsanjati: With Kate Spade’s passing, it’s an important reminder that money, fame, and capitalistic success cannot beat back depressi… @jackclarkSF @beenwrekt Still thinking of what I should say at CogX on this soon but one theme might be robustness broadly defined being a big prob still RT @jvmancuso: Biggest takeaway on first glance: you can't be serious about measuring progress and rigorously/analytically prioritizing res… RT @eclecticbrotha: Weird how media spent 8 years asking if X event was Obama's Katrina but casually shrugs off 4645 dead in Puerto Rico, w… @mgubrud @Google @BanKillerRobots Agree w/ 2nd part, but that seems orthogonal to the original Q to me (I can see args for why they’re related, e.g. dual useness of AI, but to the extent specific applications require substantial engineering/skill and US govt doesnt have, could maybe be separable) @timhwang Review pls "RT @vkrakovna: New arXiv paper: Measuring and avoiding side effects using relative reachability, https://t.co/Y8VXkpaCLY We introduce a ge…" ICYMI, new paper! Thread with a high-level summary here. https://t.co/sCamSfTnX6 RT @timhwang: !!! https://t.co/vHJnMxHTJ5 RT @soniagupta504: Some women advise against using emojis professionally, or being friendly in writing, because we're taken less seriously… @markus_with_k 🎊🎉💯👍 RT @kr_t: Our paper on a systematic classification of the recently released @allenai_org Reasoning Challenge (ARC) is now up on arXiv: http… "RT @Miles_Brundage: New paper: ""Accounting for the Neglected Dimensions of AI Progress"": https://t.co/uvD4sU0uPr Joint work with Fernando…" "Measuring and avoiding side effects using relative reachability," @vkrakovna et al.: https://t.co/t6XEEScRps ...and "Relational inductive bias for physical construction in humans and machines," @jhamrick and Allen et al.: https://t.co/ZHg8JQSnpJ "Trio of papers on a common theme: ""Graph networks as learnable physics engines for inference and control,"" Sanchez-Gonzalez et al.: https://t.co/LbaHrbToTK ""Relational inductive biases, deep learning, and graph networks,"" Battaglia et al.: https://t.co/3UGxSOGxDv ..." "GamePad: A Learning Environment for Theorem Proving," Huang and Dhariwal et al.: https://t.co/bvDBLwWhTU "Integrating Episodic Memory into a Reinforcement Learning Agent using Reservoir Sampling," Young et al.: https://t.co/wf2Vn9zWAZ For more explanation of all of this, see the paper! https://t.co/uvD4sTITqR (7/7) Finally, we apply this framework to two case studies: the Alpha* line of Go-playing systems, and algorithms applied to Atari games in the Arcade Learning Environment. We present the multidimensional utility space in these domains, using what data we could find or infer. (6/n) https://t.co/Dz5ZjQiVJQ Often, these costs are not described in papers and other research outputs, which can make it hard to assess the improvement(s) associated with new research, if any. (5/n) https://t.co/LkYGLWRb4v These costs are borne by various actors at different stages in AI development, and vary across algorithms. We discuss issues of reproducibility, replication, etc. in this framework. (4/n) https://t.co/MTyhZlaFIf Based on this idea, we describe the idea of a Pareto frontier for particular tasks, with some new algorithms pushing this frontier and others moving around within it. (3/n) https://t.co/RFNP1GHGUN We analyze the (often hidden) costs of AI systems, and develop/apply a framework for more rigorously accounting for these costs. These costs include computing power, data, human oversight, etc. Often performance improves at the expense of one or more such dimensions. (2/n) https://t.co/gaMKMQYBOr "New paper: ""Accounting for the Neglected Dimensions of AI Progress"": https://t.co/uvD4sU0uPr Joint work with Fernando Martínez-Plumed, Shahar Avin, Allan Dafoe, Seán Ó hÉigeartaigh, and José Hernández-Orallo. (1/n) https://t.co/d0MPukms3Y" Well, hundreds of new papers coming shortly, but one by me. New paper coming shortly! @Aelkus @timhwang That's what FakeApp is, but slow without a GPU. Unique at the moment while she studies here, at least, presumably she has also shopped elsewhere :) Uniquely Oxford experience: seeing Malala at the grocery store. Same - @natfriedman's great. https://t.co/tN23rJyH1U RT @natfriedman: Hello, GitHub https://t.co/DCDqbkTZaN RT @mhbergen: Small update on Maven: an email went out Friday to Googlers who signed petition that said cloud team "will not pursue similar… "RT @DrLukeOR: Cool! Two of my papers came out on the same day! Editorial on why we should use preprints in medicine to mitigate the reprod…" @timhwang I agree we aint seen nothin yet in terms of serious malicious uses @timhwang Sorry, tweet was vague. Some US (special) elections have happened in 2018, but the greater number clustered later this year offer an enticing set of targets. New paper tonight! Hint: it's somewhat related to this. https://t.co/aGbFm5dYLq @mgubrud Why is being open to working with the military on non-offensive things nonsense? To be clear, in the context of Maven, “non-offensive” was BS, but e.g. disaster response or cyber defense with clear protocols for disclosure of vulnerabilities etc. are not. @timhwang (technically some have already occurred but many are clustered later this year, and it makes sense to cluster the funny business then, not now, before people have a chance to adapt) @timhwang I keep saying the 2018 elections will be the proving grounds but we'll see! @patrickc @natfriedman Whoa, missed this - congrats, @natfriedman! RT @patrickc: As important as the acquisition itself, IMO, is the news that @natfriedman is becoming CEO of GitHub. Nat is one of the most… OpenAI Charter translated into Chinese by current @FHIOxford intern Brian Tse! https://t.co/pjtMyyM5uZ RT @mustafasuleymn: Really proud of our partnership with @theRSAorg on this report. As technology becomes more sophisticated and ingrained… RT @GiorgioPatrini: Are we overfitting on CIFAR10? "We measure the accuracy of CIFAR-10 classifiers by creating a new test set of truly uns… @KaiLashArul @naotokui Thanks! :) Cc @KaiLashArul to talk some sense into me "Assessing Generative Models via Precision and Recall," Sajjadi et al.: https://t.co/qtTAutNFYR "Reparameterization Gradient for Non-differentiable Models," Lee et al.: https://t.co/fc0NQLI2Wu "The Nonlinearity Coefficient - Predicting Overfitting in Deep Neural Networks," Philipp and Carbonell: https://t.co/rBVbABdCCf "Scaling Neural Machine Translation," Ott et al.: https://t.co/Vcl0wb1Ny6 "Interpretable Set Functions," Cotter et al.: https://t.co/W8k9eOkP23 """Learning a Latent Space of Multitrack Measures,"" Simon et al.: https://t.co/tlN2UPJdr4 Samples: https://t.co/MwT4mMRfEp The interpolation from Billie Jean to Don't Stop Believin' is quite something, makes me think a competent/""creative"" AI DJ/remix isn't long off..." RT @_rockt: The deadline for submitting a workshop paper has been extended to Friday June 8th! https://t.co/YkXo6VH3BT https://t.co/V2OIVof… Sources, respectively: https://t.co/oZnA41AtS4 + https://t.co/EANt76Pwox https://t.co/F5NiSp6RQ3 https://t.co/teeIk4oh5r RT @SevaUT: had to be done https://t.co/RXM2QUvRsz @chipro Oxford isn’t far! ;) @iamtrask (In absolute terms - there is a high crap ratio though) @iamtrask We need to talk - there’s so much to watch! :) RT @chipro: I'm in London for a month to get to know the local AI scene. Please let me know if you'd like to meet or know someone that I sh… @korirotti @jackclarkSF IMO BSG/BB>Expanse Re-watching Breaking Bad > watching pretty much any new show, don’t @ me @egrefen @JadeFLeung Ah, I see (thought you meant punting *in* Cambridge). Was not even aware that that was a thing! And indeed, it’s a good time. Prime weather this month! @egrefen @JadeFLeung Haha nah this was at Magdalen College, no betrayal involved ;) RT @NandoDF: Why Rich Kids Are So Good at the Marshmallow Test https://t.co/oBKuAEnrH0 @samim (I'd also emphasize again that there are many ppl who focus more on this than me, inc. @RebeccaCrootof, @HMRoff, @paul_scharre, @RikeFranke, @EBKania etc. and have a range of views/prob know more about the distribution of views, gaps in representation etc) @samim (I'd consider the former ~"heart" and the latter ~"brains") but in any case, there is a range of perspectives/arguments involved in the discussion, some on the more cold analytical side and some on the ethical appeal side, but perhaps too much US (gov't/academic) influence @samim Funny, I have opposite concern (re: brains/heart, I agree w/ the diversity concern) - that the Campaign to Stop Killer Robots (etc.) focus too much on ethical appeals to the wrongness of machines making life or death decisions, too little on risks to international stability etc +1, big fan of this article. https://t.co/XIfJmDI2IH Photo credits: @JadeFLeung Had my first punting experience today with FHI colleagues and friends. No one fell in! 💯 https://t.co/DqZ1ZzrDB3 @halhod You have officially been appointed as host of all future meetings on AI in London, with your pets as co-chairs. Pls Protip: if, like me, you get duped by a sign for the cold foam iced cappuccino at Starbucks, get it unsweetened. https://t.co/O3G9Ot7Clv @samim @RebeccaCrootof But ban is a subset of govern so even if she’s wrong, it’s a safe word to use :) @samim @RebeccaCrootof E.g. (admittedly this isn’t an area I fully grasp but I partially defer to Rebecca who has thought more about it than I have): https://t.co/SMnwWFh4ir @David_Gunkel @j2blather @dw2 @cccalum Paraphrase by Ulam in 1958 - this https://t.co/JHsSrAqUWW @David_Gunkel @j2blather @dw2 @cccalum Von N was prob thinking abt computers when he discussed “accelerating progress of tech + changes in the mode of human life...[give] the appearance of approaching some essential singularity in the history of the race beyond which human affairs, as we know them, could not continue” @j2blather @dw2 Von Neumann said something about a singularity of fast techno/social change on the horizon; IJ Good more specifically coined the (AI) intelligence explosion idea RT @krandiash: Really cool work from the Brunskill lab at Stanford on using model-based RL! https://t.co/s7bbugQq01 RT @dribnet: generalization supertick: a photo of the tick print scores higher than all official ImageNet tick validation images on Incepti… RT @wilw: I just published “My name is Wil Wheaton. I Live With Chronic Depression and Generalized Anxiety. I Am Not Ashamed.” https://t.co… It’s actually pretty good! If you care about OSIs... I like reading decades-old books from libraries that sold them because literally no one borrowed them https://t.co/qhuOpW1WK2 RT @decodyng: In May, I decided to read & summarize a #machinelearning paper every day. I'll curate some of these into blog posts, but in t… "RT @Scott_Gilmore: Retaliatory sanctions against the US won't work. Trump is impervious to any pain inflicted on American companies. Exce…" "RT @Channel4News: Donald Trump says his letter from Kim Jong-un was “a very nice letter”. Eight minutes later, he says he hasn’t opened it…" @RebeccaCrootof You have taught me well This is why, if Google wants to be serious about ethics + AI, it should be involved in discussions of governing lethal autonomous weapons, etc. Not participating is insufficient if the goal is to make something not happen. https://t.co/3hyqGkAiXs "RT @mark_riedl: 🚨WARNING🚨 there is a scam #NIPS2018 website offering registration and housing The real website is https://t.co/AgXeYgsOUu…" Should hopefully be up Sunday or Monday! Look forward to sharing this work on theorizing/measuring AI progress, which I'll be saying more about in a few weeks at the @cognition_x conference. They should also look at MSFT's work around cybersecurity for inspiration on offense/defense issues. (I could imagine arguments for stronger principles, but these seem like a plausible bare minimum consensus) Among other things, some candidates might include 1. actively support international efforts to govern lethal autonomous weapons, 2. do not engage in military contracts oriented towards great power competition (as distinct from Maven viz-a-viz ISIS). https://t.co/luXOmUpww8 RT @AthertonKD: @davegershgorn free headline for your inevitable story on MSFT-maps powering drone strikes: "Bada Boom, Bada Bing" (I say "could imagine" because the actual arguments I've seen in favor of it have been really bad - see here for my effort to simulate better arguments: https://t.co/D3jSuSFkng) I could imagine good args for Maven but there's no excuse for lying/misleading with nonsense about TensorFlow as Google did, or doing any of this without clear principles set up in advance. As I've said before, I have mixed feelings on all this/probably would not draw the line at all military collaborations being bad, but this should at the very least be a wakeup call re: the PR apparatus of Google going rogue, like IBM's did years ago... One takeaway from the recent crop of emails/stories is that Google's nonsensical explanations of Maven (downplaying their centrality, emphasizing the open source thing, etc.) were not only nonsensical but also lies. 10 people working on it, new services being developed, etc. RT @katecrawford: This is HUGE. And it's all thanks to the thousands of Google workers who came together to refuse to work on AI for milita… Glad I don’t work in sales (from https://t.co/JCbduYt5eb) what does that even mean? Better ML for drone footage processing = 100x safer US troops? Umm Who talks like this (well, I know the answer - Scott Frohman at Google): "The scale and magic of GCP, the power of Google ML, and the wisdom and strength of our people will bring about multi-order-of-magnitude improvements in safety and security for the world." RT @kateconger: Google now says it won't pursue another Maven contract. Plus, more details on how Google developed AI for the Pentagon: htt… RT @rao2z: We know #AI has really arrived when scammers find it worth their time to make fake websites for academic #AI conferences to sell… RT @JustinTrudeau: Americans remain our partners, friends, and allies. This is not about the American people. We have to believe that at so… RT @moyix: Good morning! I'm very happy to say that our (Kang Liu, me, and @sg175) paper on automatically removing backdoors from DNNs has… RT @ShaneLegg: Nice overview of our AI Safety Gridworlds paper on Computerphile https://t.co/pRTXLM9o9j RT @MalwareJake: Embedding the admin username and password in the HTML comments of your web application... https://t.co/sjYsMWuztq RT @MaxALittle: Neat! Simple mixtures of factor analyzers produce very nice-looking samples from the distribution of CelebA images. So, how… @JennyJudova @jackclarkSF +1 to hiring from the pool of fans as they’ll get the tone/level of detail etc. better than a random new person RT @TheAnnaGat: It was a matter of time when the Hungarian government would cut down on freedom of assembly, but modifying the Constitution… @moyix look forward! "Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networks," Liu et al.: https://t.co/GySgl4MBd3 "How Important Is a Neuron?," Dhamdhere et al.: https://t.co/odKLT5qben "Multiaccuracy: Black-Box Post-Processing for Fairness in Classification," Kim et al.: https://t.co/szVIhvWmGP "Agents and Devices: A Relative Definition of Agency," Orseau et al.: https://t.co/Mstq9UlLPs "On GANs and GMMs," Richardson and Weiss: https://t.co/QUZzUMidn5 "Scaling provable adversarial defenses," Wong et al.: https://t.co/1gQabfDx2r "There Is No Free Lunch In Adversarial Robustness (But There Are Unexpected Benefits)," Tsipras and Santurkar et al.: https://t.co/rtWVs081i7 "Sample-Efficient Deep Reinforcement Learning via Episodic Backward Update," Lee et al.: https://t.co/IJjs6WBWOf "Sequential Attacks on Agents for Long-Term Adversarial Goals," Tretcschk et al.: https://t.co/jnzK1UbhLA "Learning a Prior over Intent via Meta-Inverse Reinforcement Learning," Xu et al.: https://t.co/iQWRNeapKo @cfarivar I don't follow Any DS9 fans knowledgeable enough to say which eps/seasons are best? I'm not sure how many more Quark shenanigans I can take... RT @sc_Slayerage: Strong defense, but the offensive play was unstoppable. https://t.co/9ylmi5Fu42 RT @LawDavF: Tariffs imposed on allies just another indication that Trump believes that he can bully or ignore democracies while he must sh… Looking forward to finally getting a new paper on arXiv soon!! TBD if @BrundageBot will care. "RT @ThePlumLineGS: In light of Trump's pardon of Dinesh D'Souza, reposting: ""Trump views law enforcement as merely an instrument of his po…" Great group of AI researchers selected for funding support over the next 5 years. https://t.co/qJclZAax7v RT @open_phil: Excited to announce our first class of AI Fellows, seven machine learning students to whom we’re collectively recommending $… "RT @EricHolthaus: Cable news coverage this week: Roseanne Barr's tweet: 10.5 hours Puerto Rico, the worst disaster in modern American hist…" RT @timothypmurphy: Dinesh D'Souza is a racist piece of shit, and it's worth keeping in mind that he was pardoned because of that, not in s… RT @Davidramli: Exclusive: Sensetime, the world’s biggest AI startup, has raised another round of funding that values the Co at $4.5 billio… RT @CBCAlerts: Justin Trudeau, Chrystia Freeland call 1:30 pm ET news conference to respond to US tariffs on steel, aluminum. Mexico signal… RT @svlevine: Seems like really simple model-based RL methods can do just as well at convergence as model-free RL, if uncertainty is handle… RT @dtsbourg: What the hell is that logo? 🤖 https://t.co/Vy2efdVokR "Teaching Meaningful Explanations," Codella, Hind, and Ramamurthy et al.: https://t.co/ap25E9fhEf "Why Is My Classifier Discriminatory?," Chen et al.: https://t.co/vWhKbNuIeu "To Trust Or Not To Trust A Classifier," Jiang, @_beenkim, and Gupta: https://t.co/IGHXoc3K4E "Privacy Aware Offloading of Deep Neural Networks," Leroux et al.: https://t.co/IZiIeuOsTu "Grow and Prune Compact, Fast, and AccurateLSTMs," Dai and Yin et al.: https://t.co/OpXjB9CO4o "Variational Inverse Control with Events: A General Framework for Data-Driven Reward Definition," Fu and Singh et al.: https://t.co/rpWkNFFXPj "Supervised Policy Update," Vuong et al.: https://t.co/FtIbN4dXdR "Depth and nonlinearity induce implicit exploration for RL," Dauparas et al.: https://t.co/IJLK1vP8u8 "Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Models," Chua et al.: https://t.co/fB3bZ7W1Xe RT @NandoDF: Few shot imitation, transfer, concepts, multimodality and self-supervision are key to intelligence. Plenty of chocolate cake h… "RT @yusufaytar: Playing hard exploration games by watching YouTube The promises of self-supervision for RL: 🍒+🎂 > 🍒 https://t.co/dZcnAiJtV…" RT @Miles_Brundage: "Dual Policy Iteration," Sun et al.: https://t.co/4kZAwkgWQ8 RT @DeepMindAI: Ape-X DQfD completes the first level on Montezuma's Revenge, which has proven challenging for deep RL. It extends DQN using… RT @OpenAI: Now accepting applications for OpenAI Fellows, apprenticeships for people with varied skills who want to transition into AI res… "RT @marwinsegler: towards predicting reaction mechanisms via arrow pushing with machine learning: https://t.co/XUyCPY80zc work with J Brads…" @hardmaru @togelius Would have to double check but I think search algos also do bad at MR, same ballpark (0-low thousands) as DRL "RT @evolvingstuff: Great analysis! How Does Batch Normalization Help Optimization? (No, It Is Not About Internal Covariate Shift) https://…" "Disentangling by Partitioning: A Representation Learning Framework for Multimodal Sensory Data," Hsu and Glass: https://t.co/xeMGI8D75Q "GenAttack: Practical Black-box Attacks with Gradient-Free Optimization," Alzantot et al.: https://t.co/rW52CX6AT7 Very strange that the # of frames/episodes is not listed in the first one. Judging from the wall time and comparison with Ape-X, it's a lot, though. "Differentiable Particle Filters: End-to-End Learning with Algorithmic Priors," Jonschkowski et al.: https://t.co/TRX8I6pdbL "Human-in-the-Loop Interpretability Prior," Lage et al.: https://t.co/GpZsKya5gk "Virtuously Safe Reinforcement Learning," Astlund et al.: https://t.co/TPkj6HDITM "The Actor Search Tree Critic (ASTC) for Off-Policy POMDP Learning in Medical Decision Making," Li et al.: https://t.co/31M9zGNnlC "Value Propagation Networks," @nntsn et al.: https://t.co/9xWWhcVVex RT @hardmaru: Playing hard exploration games by watching YouTube (DeepMind). One-shot imitation allows an agent to exceed human-level perfo… That caveat aside, I still think extrapolations are probably better than expert opinion on a lot of this stuff. I doubt experts would have expected 702% median performance a year and a half ago, or even 300, but not as crazy when plotted on a graph. Another cautionary tale re: forecasts - it's hard to specify all the conditions for testing them. I've put non-trivial effort into making forecasts, but still many ways to weasel out (in this case, I could/could not count human demos, which weren't used much when forecasts made). Following up on this from a year + a half ago...if one does NOT count Atari results that 1. use human demos, or 2. use >>data/compute, then we're still in the linear median progress regime. Else, exponential median progress. Mean is exponential regardless. https://t.co/HnYGUWxfCd https://t.co/luSgZHn7kH @hardmaru but median scores 😍 https://t.co/iygR5GpvyH @hardmaru https://t.co/A9bsGy10iL (to be clear, not bashing DM about this - they were obvi intended to go up at the same time, judging from article ID's, and it's conference submission season after all - just surprised at the choice as they've sometimes done mutual reference with new papers. Expect blog post tom) Both report MR results in the 10's of 1000s range, vs. low hundreds or single digit 1000s (or, most commonly, zero) for most prior work. In the first paper, while not directly comparable, again, the scores are v. impressive - 547-702% median score depending on evaluation method. Both also using human demonstrations of some sort. These scores aren't directly comparable to the stuff I usually report on, both due to the demonstration thing and diff. games (42 vs. 57 games), but nevertheless they are very impressive, greatly outperforming average humans. """Observe and Look Further: Achieving Consistent Performance on Atari,"" Pohlen et al.: https://t.co/TvIaa8HDZM ""Playing hard exploration games by watching YouTube,"" Aytar and Pfaff et al.: https://t.co/SOJU3GuBfo Both from (mostly) DeepMind and both claiming v. strong MR results" ...including two DeepMind papers both claiming to be the first strong Montezuma's Revenge results and not citing one another 🤔 It’s Whoa That’s a Lot of RL Wednesday! RT @egrefen: Super cool @PyTorch reimplementation (+ new stuff) of our @DeepMindAI differentiable stacks/queues/etc (NIPS'15) by @Yale unde… RT @shimon8282: I'm pleased to share our new paper, Contextual Policy Optimisation: using Bayesian optimisation to tune environment variabl… @smarthelix Thatd be great! Look forward to talking about prospects for international cooperation on AI in Cambridge tomorrow! Get in touch if you are in Cambridge and not already attending/interested in doing so. @timhwang you've out-Timmed yourself RT @timhwang: “Our editors painstakingly comb through the back alleys of capitalism to bring you fascinating publications like Pasta Profes… "RT @timhwang: i’m excited to be launching this today: “trade journal cooperative”, a subscription service which delivers a niche trade jo…" RT @histoftech: James Baldwin mentioned he was going to write book about the fbi--just to scare tf outta the people surveilling him 😂 https… RT @BrundageBot: More Than a Feeling: Learning to Grasp and Regrasp using Vision and Touch. Roberto Calandra, Andrew Owens, Dinesh Jayarama… RT @BrundageBot: Parallel Weight Consolidation: A Brain Segmentation Case Study. Patrick McClure, Charles Zheng, Francisco Pereira, Jakub K… RT @BrundageBot: Importance Weighted Transfer of Samples in Reinforcement Learning. Andrea Tirinzoni, Andrea Sessa, Matteo Pirotta, and Mar… RT @BrundageBot: Reward Constrained Policy Optimization. Chen Tessler, Daniel J. Mankowitz, and Shie Mannor https://t.co/Xj5UcYsKQ5 RT @BrundageBot: Contextual Policy Optimisation. Supratik Paul, Michael A. Osborne, and Shimon Whiteson https://t.co/DHNXeVA8VA RT @BrundageBot: Adversarial Constraint Learning for Structured Prediction. Hongyu Ren, Russell Stewart, Jiaming Song, Volodymyr Kuleshov,… "When Recurrent Models Don't Need To Be Recurrent," Miller and Hardt: https://t.co/dhmNwlei9q "Dual Swap Disentangling," Feng et al.: https://t.co/1fG275zpLR "A Scalable Approach to Multi-Context Continual Learning via Lifelong Skill Encoding," Camp and Mandivarapu et al.: https://t.co/STR9KXQydd "The Coming Era of AlphaHacking? A Survey of Automatic Software Vulnerability Detection, Exploitation and Patching Techniques," Ji et al.: https://t.co/NBGY0VQUN4 "Zero-Shot Dual Machine Translation," Sestorain et al.: https://t.co/7pYt0j4YBx "Scalable Methods for 8-bit Training of Neural Networks," Banner et al.: https://t.co/VM1ZFd2Aok "DeepProbLog: Neural Probabilistic Logic Programming," Manhaeve et al.: https://t.co/btMB0YvQ1P "Dual Policy Iteration," Sun et al.: https://t.co/4kZAwkgWQ8 "Fast Policy Learning through Imitation and Reinforcement," Cheng et al.: https://t.co/L0upJB2XBh "Greg Wayne talking about the recent MERLIN (Memory, RL, and Inference Network) paper: https://t.co/CTP1pDQTcs Paper: https://t.co/DRhIoVnYIL" See also a recent talk by one of the first authors of the second paper: https://t.co/ERqs962teX @umbut No it’s fine, just wanted to check that my original intent was clear :) these are all interesting points, thanks for sharing. @umbut I get the sense you think I have some agenda here that I don’t. I said Bayh-Dole was a deliberate effort to change things, not that it was a good idea or successful etc. Just to clarify @umbut I’m not clear what you’re disagreeing with/claiming. And yes of course those are distinct. @umbut Made more attractive by profs profiting from the IP @umbut Spinouts are a way commercialization/utilization can happen RT @marthasjones_: Forcibly separating parents from children has a history; it is our history. https://t.co/1OgxeCLF8V RT @Miles_Brundage: Podcast by @80000Hours with my FHI colleague Allan Dafoe on AI and geopolitics: https://t.co/4mTFMB4Yas @rbhar90 See e.g. https://t.co/Gqcil4ALK2 @rbhar90 There’s a whole literature on whether this was a good idea/how it maybe contributed to the neoliberalization of universities etc etc @rbhar90 It was a deliberate choice with the Bayh-Dole Act in the 80s (in the US, can’t speak to other countries) meant to encourage more academic spinouts. "RT @DanitGal: Thrilled to be joining @LeverhulmeCFI as an associate fellow. Privileged and honored to work with such an outstanding group…" "Virtual-Taobao: Virtualizing Real-world Online Retail Environment for Reinforcement Learning," Shi et al.: https://t.co/v0tYnt3W6L "Inverse POMDP: Inferring What You Think from What You Do," Wu et al.: https://t.co/6kYx4LULvj "Decision-Theoretic Meta-Learning: Versatile and Efficient Amortization of Few-Shot Learning," Gordon and Bronskill et al.: https://t.co/nafMEozqDE """Fairness GAN,"" Sattigeri et al.: https://t.co/79pp2EWNCb ""an approach for generating a dataset that is plausibly similar to a given multimedia dataset, but is more fair with respect to protected attributes in allocative decision making""" "Toward Detecting Violations of Differential Privacy," Ding et al.: https://t.co/CY92u7Uiz1 "Parallel Architecture and Hyperparameter Search via Successive Halving and Classification," Kumar et al.: https://t.co/OfZq71bDrR "It's (neural) Software Verification Sunday! ""Automated Verification of NNs: Advances, Challenges, +Perspectives,"" Leofante et al.: https://t.co/bx3RcVbXs2 ""Training verified learners with learned verifiers,"" Dvijotham, Gowal, and Stanforth et al.: https://t.co/OWOL8K9MyP" """Adversarial examples from computational constraints,"" Bubeck et al.: https://t.co/c5n4mqqOuS Another line of argument that adv. examples may be inevitable" """Visceral Machines: Reinforcement Learning with Intrinsic Rewards that Mimic the Human Nervous System,"" McDuff and Kapoor: https://t.co/BQ6DrxduZ8 Train neural net on humans' visceral responses in a driving game; use this visceral response predictor as intrinsic reward in DQN" Rereading Bottou’s 2011 “From Machine Learning to Machine Reasoning” - def. one of the more prophetic + interesting AI think pieces in recent history. https://t.co/msWGA51rTn @ivan_bezdomny Good luck! RT @ladyhaja: Holy shit, this guy is amazing. What a hero. https://t.co/XVWbaULkFp https://t.co/hHnF150XL5 To clarify, it’s the data that is comparable to e.g. UNREAL, Rainbow, DQN etc. here, though compute is at least a bit more. 35% more for the meta gradients and some amount more for IMPALA’s deeper network but def. much less than Ape-X’s bajillion frames/updates. Median Atari performance here is close to 300% for both human starts and no-op starts, with comparable compute to other approaches (200m frames). Will be interesting to see if/when 400%+ is attained with same compute (Ape-X has done this with >> compute). https://t.co/lgqL3D3cnc RT @SmithaMilli: Myopically optimizing fairness criteria can lead to long-term *harm* to the minority population. Rather than relying just… RT @burgerdrome: ahahahah https://t.co/NGRCU9xVx9 https://t.co/DS7ipKQm8l RT @mattblaze: Friends: in the unlikely event I somehow become a zillionaire, please take me aside and intervene before I reach the "going… @aaron_kif not sure, maybe check out https://t.co/eQW4Xyor1x + CC @zacharylipton @chrisdonahuey RT @BoredElonMusk: It’s never been harder to be a parody account. RT @aqbyrne: When I was a child growing up in Ireland, it was illegal to buy a condom, get a divorce or have sex with someone of the same g… RT @TheOnion: L’Oreal Suspends Production Of Irresistible 2-Step Lip Color Stick After Lab Rat Seduces Way Out Of Facility https://t.co/x5e… RT @Miles_Brundage: Great analysis of the potential uses of AI by authoritarian governments by recent @FHIOxford intern Paul de Font-Reaulx… More evidence submitted by others can be found here: https://t.co/HoQ9Rreyev Many uncertainties in this area but I’ve found Paul’s analysis very helpful + some of his points are well worth reflecting on more, e.g. importance of technical competence and infrastructure + how this may suggest differences in application of AI in China/Gulf states v elsewhere. "RT @mark_riedl: Salesforce Research is hiring researchers at all levels: - Deep learning - NLP - Recommenders - Speech and vision - Al…" Among other things, Paul distinguishes several authoritarian uses of AI: identification of dissidents, social credit systems, public discourse distortion, + drone assassination. He also notes several important barriers to effective leveraging of AI by authoritarian states. Great analysis of the potential uses of AI by authoritarian governments by recent @FHIOxford intern Paul de Font-Reaulx, submitted as evidence for the U.S. Human Rights Commission: https://t.co/27HSoflFlg RT @OpenAI: Releasing Gym Retro — 1000+ games for reinforcement learning research, plus an integrator tool to add your own classic games. h… RT @janexwang: Our new paper on meta-learning with episodic recall, to be presented at ICML! Congrats to Sam Ritter, @sidfix, Zeb, and coll… RT @HAL9000_: Dave, I've updated my privacy policy. Until you've accepted my new terms, I can't open the pod door. RT @MateuszOnAI: Owing to inductive biases induced by the hyperbolic geometry, we represent scale-free graphs with arbitrary precision. Her… Too much to read https://t.co/EAxZXTRUmh "Evading the Adversary in Invariant Representation," Moyer et al.: https://t.co/3ytkeZrqJa "Implicit Autoencoders," @AliMakhzani: https://t.co/5LkqzmD2tQ "Hyperbolic Attention Networks," Gulcehre et al.: https://t.co/P6hpdNzpEU "AutoAugment: Learning Augmentation Policies from Data," Cubuk and Zoph et al.: https://t.co/THxhy2Jitq "Been There Done That: Meta-Learning with Episodic Recall," Ritter et al.: https://t.co/fBiwBWSyP4 "Towards Robust Evaluations of Continual Learning," @seb_far and @yaringal: https://t.co/BfLzmufpTE (there's some other stuff but haven't read v. carefully yet) """A0C: Alpha Zero in Continuous Action Space,"" Moerland et al.: https://t.co/HBM1smcQgr V. preliminary experiments but the basic idea for dealing with continuous actions is to use DL to steer the creation of new nodes in the tree" IMPALA algorithm + tweaking the return online = improved performance on Atari. "Meta-Gradient Reinforcement Learning," Xu, @hado, and Silver: https://t.co/JTcT8Ivc0K RT @samswey: I don’t know why people thought Kim Jong Un would end up making a deal with this administration given how Trump literally *jus… Will be in Cambridge next Wed. Let me know if you are there and want to hang out :) @zvonkom @primalpoly Agreed! Already some stuff has happened since the report (or has been hypothesized since the report) that we didn't think about. @zvonkom @primalpoly FWIW i agree the overregulation concern is legit, and there are various ways govts can be helpful without doing that (e.g. funding research on defenses against adversarial examples). If/how to engage w/ govts is a tricky one and one should be discerning about when it’ll help/hurt @zvonkom @primalpoly Say more? @cognition_x @halhod @j2bryson @azeem @tabithagold @HansonRobo Insofar as Sophia proper is to be discussed, it seems like the relevant discussion points are more to do with media failure @cognition_x @halhod @j2bryson @azeem @tabithagold @HansonRobo (would rather see a convo about Duplex, for example, personally) @cognition_x @halhod @j2bryson @azeem @tabithagold @HansonRobo Think Joanna's complaint was that Sophia was listed as a speaker (again, if I remember correctly) and this seems to have been changed (good). Re: broader convo, certainly there are Sophia-*related* issues to discuss but there has been way too much attention to Sophia proper IMO @halhod I seem to recall @cognition_x walking the Sophia nonsense back after @j2bryson complained but may be misremembering (and/or the post you screencapped was made before that happened) - cc @azeem @tabithagold RT @ColinKahl: Trump rashly accepted a summit with Kim without considering the risks, then hypes expectations for an historic breakthrough,… RT @goodfellow_ian: I'm speaking at the 1st Deep Learning and Security workshop (co-located with @IEEESSP ) at 1:30 today: https://t.co/Aae… RT @rao2z: Oh well.. I guess I have to smuggle even more mentions of evolution into my Intro #AI course.. (...and into those #InUteroAI pr… Nice letter, bro https://t.co/PZ958NFgU6 RT @KaiLashArul: Variational Inference for Data-Efficient Model Learning in POMDPs - S. Tschiatschek, myself, J. Stühmer, and @katjahofmann… @BenedictEvans “Will”? Happens already @clarkamiller More generally though, yes, ofc language is very rich for humans on the receiving end, but on the AI generation side it isn’t so much. V formulaic for this kind of purpose (“the image is an X because there is a Y”), whereas generating a visual attention/saliency map is easy @clarkamiller The implied comparison here is words (+#s or without) vs. some combination of numbers and images, but mostly the images part. Stuff like the portion of the image that a neural net is attending to/how strongly for each region is often hard to put in a sentence, easier to visualize @mjntendency There are two separate concerns, I guess: the bias towards ppl finding it useful -> bad research methodology issue, which a better baseline would seem to address; and people who don't nec. care about rigor using this to make their deployed systems *seem* transparent. "Representation Balancing MDPs for Off-Policy Policy Evaluation," Liu et al.: https://t.co/HB9a6HTo8B Also loses lots of information unless you embed numbers in the sentence... @jeffbigham https://t.co/T0aGpiaH9G """Neural Network Interpretation via Fine Grained Textual Summarization,"" Guo et al.: https://t.co/yEoHHNvWwk I could see verbal interpretation of neural nets being useful but also seems very prone to over-trusting. People tend to believe ""because"" statements even if non-sequitor" "Approximate Random Dropout," Song et al.: https://t.co/p8BkoSScaw "Do Better ImageNet Models Transfer Better?," Kornblith et al.: https://t.co/SAOzuq9URp "When Simple Exploration is Sample Efficient: Identifying Sufficient Conditions for Random Exploration to Yield PAC RL Algorithms," Liu and Brunskill: https://t.co/AnERdQOqfV "Discovering Blind Spots in Reinforcement Learning," Ramakrishnan et al.: https://t.co/dDmbrvnpgi @primalpoly caffeine + coffee taste + not burn tongue/have to wait to drink @iandanforth I really just tune out all but direct messages RT @sarahjeong: imagine going to law school so you can be the government lawyer who goes up to an appellate court to argue that the preside… @soundbitelife That’s what the search function on my inbox is for ;) but yeah I suppose it could add value in that way, though I haven’t really used it for that. Is there a reason I should not delete my LinkedIn account? It’s basically just an email inbox with a bad UI for me. RT @arthpajot: A small dataviz of the @icmlconf accepted paper. @GoogleAI and @DeepMindAI seem to prevail. U.S institution and AI firm lead… RT @rpbp: I sued the President, and I won. https://t.co/hE3rWcxIAY "RT @svlevine: Data-Efficient Hierarchical RL: https://t.co/V4qXH7VlEI Ant can now push blocks and “build” bridges by setting its own subgo…" 🧐 https://t.co/XGw5E5V0PH RT @maosbot: There is no better way to finish off some Bayesian optimisation than with a bit of local optimisation: congratulations to Mark… @halhod @zacharylipton @girishsastry Interested to hear/discuss more. I wouldn’t read too much into the not having published on it data point, as reducing data center costs even by a bit is a competitive advantage, but still could be v exaggerated RT @HMRoff: While I totally agree with this it also smacks of “just add women and mix” to fix a problem. We need gender mainstreaming as mu… @RikeFranke Congrats!! "Deep Learning with Cinematic Rendering - Fine-Tuning Deep Neural Networks Using Photorealistic Medical Images," Mahmood et al.: https://t.co/LSL9D2bFgm RT @goodfellow_ian: Self-attention for GANs. No more problems with losing track of how many faces the generator has drawn on the dog. https… "Hybrid Retrieval-Generation Reinforced Agent for Medical Image Report Generation," Li et al.: https://t.co/iM5okTO4KU """Imitation Refinement,"" Bai et al.: https://t.co/80y5idhkwv "" imitates ideal data by incorporating prior knowledge captured by a classifier trained on the ideal data: an imitation refiner applies small modifications to imperfect patterns so that the classifier can identify them""" "COCO-CN for Cross-Lingual Image Tagging, Captioning and Retrieval," Li et al.: https://t.co/PfNyhs6L2e "Breaking the Activation Function Bottleneck through Adaptive Parameterization," Flennerhag et al.: https://t.co/IwcDjqkhln "Optimization, fast and slow: optimally switching between local and Bayesian optimization," McLeod et al.: https://t.co/CoFDVQfNrr """Adding One Neuron Can Eliminate All Bad Local Minima,"" Liang et al.: https://t.co/RufVgjubfQ 🤔""[in binary classification] we prove that after adding 1 special neuron with a skip connection to the output, or one special neuron per layer, every local minimum is a global minimum""" "Deep learning generalizes because the parameter-function map is biased towards simple functions," Valle Pérez et al.: https://t.co/8EfaprKsGZ "Learning Safe Policies with Expert Guidance," Huang et al.: https://t.co/6o0mHhn2Nq @jeffbigham All Watched Over by IvankaBots and Xi-Bots of Loving Grace "EgoCoder: Intelligent Program Synthesis with Hierarchical Sequential Neural Network Model," Zhang et al.: https://t.co/LvKhWKkMXw Likewise for the huge number of papers by Chinese nationals working/studying in the US. (If that happens, the AI Arms Race Lobby™ will freak out, when really they should be happy that AI research is still largely open and peaceful, and think about how to keep it that way) RT @gstsdn: New preprint (https://t.co/nlwHycUnQu) by Han Zhang, with @goodfellow_ian and Dimitris Metaxas. Substantially improves the stat… "Verifiable Reinforcement Learning via Policy Extraction," Bastani et al.: https://t.co/6ZSbk0vImQ """Guided Feature Transformation (GFT): A Neural Language Grounding Module for Embodied Agents,"" Yu et al.: https://t.co/OE8RWdRjji Inc. new environment, XWORLD 3D, which looks a lot like DeepMind Lab." StrongER, at least, than last year. From what I've seen over the past year and the past few days in particular, I think China's gonna have a strong showing at NIPS this year. @williamstome @IntuitMachine @tdietterich @hardmaru 🏴‍☠️👍 "Data-Efficient Hierarchical Reinforcement Learning," Nachum et al.: https://t.co/KmAa5BOZWA @IntuitMachine @tdietterich @hardmaru actually not sure if planning is appropriate (haven't looked at the paper closely) but you get my point... @IntuitMachine @tdietterich @hardmaru I'm guessing Tom thinks dreaming is too anthropomorphic/hypey, and those are equivalent on that dimension. Implicit model-based planning, generative model-based planning...lots of boring options if that's where one wants to go. RT @yeewhye: The Oxford CSML group at @OxfordStats has a total of 8 @icmlconf papers accepted this year (including 4 @DeepMindAI papers, an… RT @yeewhye: The Oxford CSML group at @OxfordStats also has 4 UAI papers accepted this year (including 1 with @wellingmax). Congrats everyb… @jjvincent But I'd agree with a weaker form of that statement (99% is not as good as it sounds at scale). @jjvincent Depends on what you're trying to do/what the costs of false positives/negatives are. It took a long time to get to 99% on spam, for example, but it still added value with <99%, in part b/c the mistakes were detectable with human oversight (spam folder) and it pos/neg ratio tuned. Good stuff on safe RL with constrained MDPs by folks at DeepMind/Brain. Relevant to some of their datacenter stuff, for example. https://t.co/7Q7aC14O9O Like @hardmaru and Schmidhuber but IRL. https://t.co/EdDIgbkP1A RT @kateconger: Neuralink paid nearly $800,000 to UC Davis to conduct primate research, per new public records https://t.co/hQch3L4bbE "RT @RealAshEdwards: Our work ""Imitating Latent Policies from Observation"" is now on arxiv! tl;dr Infers a latent policy from expert state…" @davegershgorn Evergreen tweet @dude313123123 They already are (eg Ecuador) This is an international issue, not just a national one, and certainly not just about a single company. But I’m hopeful that working through these issues in the context of Axon will inform norms for other companies, and regulation as appropriate, too. 👇👇👇 https://t.co/Y75898kBsr 👇👇👇 https://t.co/SRO5EJssrP RT @ericoguizzo: Amazon Pushes Facial Recognition to Police, Prompting Outcry Over Surveillance https://t.co/jY1nWY3dtU RT @wsisaac: Can’t stress enough how subjective these gang databases are and why we should be reject any attempt to use them as input data… RT @alanyttian: Super amazing output https://t.co/yhG8XB8WdX @GoAbiAryan :) :) RT @polynoamial: Last year I said superhuman poker AIs would be running on smartphones in 5 years. That timeline may have been pessimistic.… RT @GlennThrush: Trump say he's sticking w/ a potentially hackable iPhone because it is "too inconvenient" to change -- same exact argument… RT @cevangelista413: BREAKING NEWS: All these cows are kissing this dog https://t.co/sVyy3kxvRR RT @McaleerStephen: We create an algorithm which is able to teach itself how to solve the Rubik's Cube https://t.co/y7BjXz6jmn That's it for this episode of Dispatches from NIPSmageddon. I'm too old for this. https://t.co/xwVkKaOgBU "Where Do You Think You're Going?: Inferring Beliefs about Dynamics from Behavior," Reddy et al.: https://t.co/sd5bi6L8RG "Hierarchical Reinforcement Learning with Hindsight," Levy et al.: https://t.co/WOYfiAfpoM "Hierarchically Structured Reinforcement Learning for Topically Coherent Visual Story Generation," Huang and Gan et al.: https://t.co/hufHMf0kXN "A General Family of Robust Stochastic Operators for Reinforcement Learning," Lu et al.: https://t.co/9plmOxMRrv "Solving the Rubik's Cube Without Human Knowledge," McAleer, Agostinelli, and Shmakov et al.: https://t.co/vgijdJ7Adb Almost done for the night... "SmoothOut: Smoothing Out Sharp Minima for Generalization in Large-Batch Deep Learning," Wen et al.: https://t.co/ImQ7uo4YBX "Generative Adversarial Examples," Song et al.: https://t.co/1nz0eiuqnl RT @sarahjeong: is there anything more offensive to the palate than a paper straw "[Private] Knowledge Aggregation via Epsilon Model Spaces," Neel Guha: https://t.co/IQhVOUCmeB "Imitating Latent Policies from Observation," @RealAshEdwards et al.: https://t.co/olfJWvnfom "Multiple-Step Greedy Policies in Online and Approximate Reinforcement Learning," Efroni et al.: https://t.co/DFu4GxSWhZ "Evolutionary Reinforcement Learning," Khadka and Tumer: https://t.co/Mx2s5jPpj9 "A Framework and Method for Online Inverse Reinforcement Learning," Arora et al.: https://t.co/9tcWHqucVf "Learning to Teach in Cooperative Multiagent Reinforcement Learning," Omidshafiei et al.: https://t.co/6J4OpCrBiF "Learning Real-World Robot Policies by Dreaming," Piergiovanni et al.: https://t.co/GecXT6iy7E "Safe Policy Learning from Observations," Sarafian et al.: https://t.co/pH0AEP3jWW "Unsupervised Video Object Segmentation for Deep Reinforcement Learning," Goel et al.: https://t.co/7neF6cUL1f "Nonlinear Distributional Gradient Temporal-Difference Learning," Qu et al.: https://t.co/I9nxjvQ9er "Task-Agnostic Meta-Learning for Few-shot Learning," Jamal et al.: https://t.co/dctTpBZ8hB "A Lyapunov-based Approach to Safe Reinforcement Learning," Chow et al.: https://t.co/EBzvvrvUND "Machine Teaching for Inverse Reinforcement Learning: Algorithms and Applications," Brown and Niekum: https://t.co/UkP4Liw2vT "Episodic Memory Deep Q-Networks," Lin et al.: https://t.co/jlenhuJZGx "Reinforcement Learning of Theorem Proving," Kaliszyk et al.: https://t.co/iBmzRxQ0j8 "On Deep Ensemble Learning from a Function Approximation Perspective," Zhang et al.: https://t.co/HQBKIFFWFy "Learning to Repair Software Vulnerabilities with Generative Adversarial Networks," Harer et al.: https://t.co/iXL8DnMsxB "Self-Training Ensemble Networks for Zero-Shot Image Recognition," Ye and Guo: https://t.co/ptu2xdGpKD """Overcoming catastrophic forgetting problem by weight consolidation and long-term memory,"" Wen and Itti: https://t.co/pnGg7cS1qH ""We use adversarial subspaces from previous tasks to enable learning of new tasks with less interference"" 🧐" "Faster Neural Network Training with Approximate Tensor Operations," Adelman and Silberstein: https://t.co/TJ99Rm7t72 "Small steps and giant leaps: Minimal Newton solvers for Deep Learning," Henriques et al.: https://t.co/RcbOsoAsrW "Meta-learning with differentiable closed-form solvers," Bertinetto et al.: https://t.co/ERdwGkizHh "Learning to Optimize Tensor Programs," Chen et al.: https://t.co/KGjDTxj3ac """Turbo Learning for Captionbot and Drawingbot,"" Huang et al.: https://t.co/fftOPyGHd7 ""Turbo learning"" = jointly training captionbot and drawingbot in a feedback loop" """Depth-Limited Solving for Imperfect-Information Games,"" @polynoamial et al.: https://t.co/I1xulKSh9g ""defeats two prior top [HUNL poker] agents using only a 4-core CPU and 16 GB of memory. Developing such a powerful agent would have previously required a supercomputer.""" """AlphaX: eXploring Neural Architectures with Deep Neural Networks and Monte Carlo Tree Search,"" Wang, Zhao, and Jinnai: https://t.co/60tAtF1yJ6 Seems slower than ENAS on quick examination, but interesting approach reminiscent of DeepArchitect w deep learning to search arch space" "DeepLogic: End-to-End Logical Reasoning," Cingillioglu and Russo: https://t.co/LAxDi9nby0 """A Universal Music Translation Network,"" Mor et al.: https://t.co/iUzXTZkbH8 Samples: https://t.co/pXAMyx7ydK" That's a lot of papers... When I read stories describing Trump's behavior as "shocking," "surprising," "baffling," etc. https://t.co/PR23LTrEVJ RT @christinayiotis: “ ‘baffling that Trump isn’t taking baseline cybersecurity measures at a time when he is trying to negotiate his way o… RT @blakehounshell: Trump is still using non-secure phones, rebuffing the advice of White House security experts https://t.co/taD0SJg6m5 RT @hardmaru: Generative Ramen https://t.co/ye76r0v8p1 "RT @theAlexLavin: #ICRA2018 top topics, the deep learning and automation category is literally off the chart. More interactive viz of @iee…" @hardmaru @mikarv @jackclarkSF @KaiLashArul Academic crumbs were indeed obtained! https://t.co/6mnXHqgDyL @samim @kateconger If you're talking to me (vs. Kate), I'd be happy to talk about it publicly as I have no ties to Google :) Will check out the article. @katyanna_q (don't mean that as a knock against those who resigned - they certainly upped the pressure - just pushing back on the "this is a small ratio" point you seemed to be making :) ) @katyanna_q The walkouts, while important, seem potentially less important and certainly far less numerous than the high profile people like Jeff Dean signing the letter, and this balking on interviews stuff. Spoke to @kateconger about Google's vagueness on Maven. Details didn't end up in the story but among other things, "non-offensive applications" prob. means nothing + Tensorflow being open source is a red herring - either Google's adding value or it isn't. https://t.co/y43sZH0Oj1 Cryptography is at least as interesting as AI intellectually, but individual crypto papers seem very boring on average compared to AI papers. Not sure if they'd be more exciting if I knew more about the relevant math/applications, though. @willknight seems kinda overblown. everyone wants "AI-based/-augmented weapons systems" but that isn't the same as lethal autonomous weapons. "Cryptographically Secure Data Analysis for Social Good," talk by Mayank Varia: https://t.co/mmF3L1nX3W h/t @mortendahlcs @TheAnnaGat You misspelled awesome ;) The best thing capitalism has done lately 😍 https://t.co/el9LVccWPe @iandanforth @mathbabedotorg is working on something like this. https://t.co/9UuhNu04rS @judywawira (as in, they should go out today if they haven't already) @judywawira Today, I think. @Klonick Also...congrats! :) Obviously abstract analyses also have value, as do fully non-fictional case studies, but there's a lot of tacit knowledge and hard-earned wisdom in the grey area of IP/reputational risks that can benefit from being fictionalized in this way. This is a cool model for spurring reflection on AI ethics in the real world - plausible fictional(ized) case studies informed by discussions with practitioners. https://t.co/rjFxDhUlFY RT @PrincetonCITP: We’re excited to announce the publication of four original case studies from the “Princeton Dialogues on AI and Ethics”… RT @timhwang: (3) The Hobbesians: “Humans at scale are inherently terrible. We haven’t evolved institutions and practices to make communiti… "RT @timhwang: 📖 Depressed Former Internet Optimists: A Field Guide (1) The Nihilists: “Things were never great, we’re realizing that now.…" RT @elizabeth_joh: when u find out the deadline’s been extended on the thing u haven’t even started https://t.co/yknZLk2YJk @KarinaVold high quality tweet RT @humorandanimals: you know, i can do a cartwheel too https://t.co/3ce4GhnDgg @mena_gonzalo (the Sunday night ["Monday"] batch is just Thursday or Friday stuff, I think) @mena_gonzalo There were some good papers lats night but the Monday night ("Tuesday") batch is typically much larger generally because it includes more days of submission (weekend), and in this case especially so because I expect many people submitted over the weekend after a deadline Fri. Waiting for tonight's arXiv papers like https://t.co/PjTAzkx87v @mat_kelcey the kangaroo also seems worth a mention here re: Australianness... RT @hardmaru: ICML 2018 accepted papers: https://t.co/JE83lkCN8t RT @BrendanNyhan: “Nobody knew that h̶e̶a̶l̶t̶h̶ ̶c̶a̶r̶e̶ nuclear diplomacy could be so complicated.” https://t.co/OxukzQXiMB "Learning Permutations with Sinkhorn Policy Gradient," @PatrickOmid and Ranka: https://t.co/PtM8NIELif "Counterexample-Guided Data Augmentation," Dreossi et al.: https://t.co/nzJ0149dui "Synthetically Trained Neural Networks for Learning Human-Readable Plans from Real-World Demonstrations," Tremblay et al.: https://t.co/LK8XzA8yKS "Trusted Neural Networks for Safety-Constrained Autonomous Control," Ghosh et al.: https://t.co/cn5XvtvS9A "Hierarchical Reinforcement Learning with Deep Nested Agents," Brittain and Wei: https://t.co/oV2tDaupSK "Reinforced Imitation: Sample Efficient Deep Reinforcement Learning for Map-less Navigation by Leveraging Prior Demonstrations," Pfeiffer and Shukla et al.: https://t.co/oY9Jew6vAJ "Approximate Bayesian inference in spatial environments," Mirchev et al.: https://t.co/IoSRe0qV3h "Optimizing for Generalization in Machine Learning with Cross-Validation Gradients," Barratt and Sharma: https://t.co/ZnugyXnnys "Stop memorizing: A data-dependent regularization framework for intrinsic pattern learning," Zhu et al.: https://t.co/4gNvgr2cnZ RT @rodolfor: If you do an Al/ML startup tackling climate change let me know and I will fund it. RTs appreciated. https://t.co/Rzuytkj8pi RT @RealAshEdwards: Laura Downs will be presenting our work, "Forward-Backward Reinforcement Learning", at the #ICRA2018 MLPC workshop tomo… @TimDutton_ Good Q! Would have to think more about that to give a confident answer - so many possible foci (fairness, safety, etc.) but among other things, we explore the idea of responsible disclosure of ML vulnerabilities here - maybe worth considering: https://t.co/eOcORdFx4s @jjvincent I listened/watched like 2 seconds of it and turned off/stopped reading. Much ado about nothing. We can recognize it’s a serious near-term issue while also acknowledging nothing important has happened yet. 2018 elections are the thing to watch. RT @yonatanzunger: Schools are investing in innovative technologies to better prepare students for life in an authoritarian dystopia. https… "Constructing Norms for Global Cybersecurity," Finnemore and Hollis: https://t.co/2wfKpdLUqd Relevant also to those thinking about AI-related norm development - good review of the norms literature, and there are many governance-related properties in common between cyber and AI. @revlismas sounds good, happy to answer them! :) @revlismas Hi Sam - a lot of my recommendations can be found here - https://t.co/ivoC1Y6dDY it's sort of a meta-list of recommendations b/c some recs are themselves syllabi etc. Jack Clark's newsletter is my top rec for staying up to date, not sure about good list of twitter accts/podcasts @mikarv @jackclarkSF @KaiLashArul ...and no one really knows about it. The key is to find a way for it to be prestigious, profitable, or otherwise aligned with people's interests. @mikarv @jackclarkSF Our deep RL survey paper (led by @KaiLashArul) provided value IMO, as do many others' survey papers, but it's mostly at the initiative of the authors. There are platforms that could do it, e.g. Scholarpedia (good example: https://t.co/agldB5WA0q) but it isn't refreshed much... As usual, my botter half @BrundageBot will tweet a more comprehensive selection of papers I would probably like. And no, I will never get tired of that joke. ArXiv tonight will be bad but tomorrow night will be much worse (weekend submissions). I’ll do my best to find some fun ones... https://t.co/TkiAFZI1Pl RT @trustswz: Generated ramen images using Progressive Growing of GANs from 60000 ramen images. Looks very delicious! Translated by @sylvan… RT @jessesingal: sorry everone https://t.co/FgjKFWANy6 RT @Chemjobber: By age 35, you should have saved twice as many PDFs of scientific papers as you could possibly read in your remaining lifet… 👌 https://t.co/vpA1SE8U5L It’s Sunny Sunday! https://t.co/Wf01nWZdhz @clarkamiller (and in this case I was only addressing an even more basic question - plausibility - which is also important) Anyone read Pearl's new book? @clarkamiller Sure - we can (and do) ask multiple questions. RT @boredyannlecun: Very excited to hear that NIPS had 7 million submissions this year. No comment on what % of them used ConvNets. No comm… @jeffbigham @swapneel_mehta Why? (Whether they’re the ones to do or fund/oversee the research, I mean - obviously they’re the ones to implement some such things) This seems plausible to me technically, though not familiar enough w NHS to know how well managed it’d be, if they’re the right ones to do it etc. Visited BenevolentAI the other day (thx @AmirSaffari) +came away more bullish about AI-augmented medical R+D. https://t.co/EHqQlwddR2 @atg_abhishek @iamtrask @jvmancuso Yeah, big fan of that one! @ArtirKel @ESYudkowsky @Twitter @gwern @VitalikButerin ah, yeah, you just said the same thing (initially parsed it as saying that it's easy to create the accounts, which is also true...) @ArtirKel @ESYudkowsky @Twitter @gwern @VitalikButerin hmm. Doesn't seem that hard to detect, though, same name and profile picture. Mayyybe they're doing something fancy like adding noise to the profile pic...but maybe not. @ESYudkowsky @Twitter This happened to me recently and I did "report tweet", chose the option for this person is impersonating me, and received an email about verifying my identity for the purpose of getting rid of it (which worked), though no checkmark resulted. Have you tried this? RT @gleemie: Our petition of academics in support of Google workers against Project Maven just reached 1000 with AI luminary Terry Wingorad… @rseymour will check it out, thanks! :) @rodolfor thanks! @rodolfor the book? Crypto friends: please recommend good reading material on secret sharing, both theory and applications. 🔐 @jeffbigham I'd like to invest, where do I send my cryptocurrency (not sure about "successfully" but some interesting ideas) (Narrator: they eventually were) "We have seen some successful app's of continuous optimization techniques (such as grad. descent) to discrete learning problems; here the neural net technique of "back prop." comes to mind. Perhaps such techniques could also be employed successfully in cryptanalytic problems." @jeffbigham I dunno, VCs might! At least the ones that know what they don't know. @jeffbigham Maybe it's enough, I dunno. But if you make many in one place (e.g. as I did here, though not with good results: https://t.co/cvr1gOhNZD) you can claim credit later if they do well. Alternatively, aggregate the tweets, but I found that to be a pain (/often unfalsifiable tweets). @jeffbigham You should make public predictions! Certainly they trade off in humans to some extent but not sure how much that's inherent, vs. a function of our biology. I liked the ("often competing") desiderata for continual learning in the Progress & Compress paper by Schwarz et al. (https://t.co/3KHemMP2fD ). I wonder how much they inherently trade off. Valiant has a related paper but kinda dense/boring (sorry :( ): https://t.co/Dfox91Ez34 https://t.co/M8YSwORv3J "Cryptography and Machine Learning," Ron Rivest, 1991: https://t.co/vAiVcNnI4d @zacharylipton @girishsastry Joking, don't yell at me plz @zacharylipton @girishsastry If only they had used BBQ-Nets https://t.co/O5AGsf5ny9 @zacharylipton @girishsastry Yeah that's prob true @zacharylipton @girishsastry Though admittedly haven't spoken to anyone directly involved. @zacharylipton @girishsastry In the case of e.g. Watson, people *have* spoken up about BS. I talk to lots of ppl at DM and have not heard anything to suggest this was exaggerated by orders of magnitude (I'm bracketing the fake MDP Q - want to see what part of my model you disagree w/ re: the trust thing). @zacharylipton @girishsastry Perhaps @zacharylipton @girishsastry Not b/c I think corps are inherently trustworthy but b/c I would expect people involved at DM/elsewhere, for example, to have speaked up if the DQN/data center thing were BS. Maybe that's not true of Chinese corps, dunno. @zacharylipton @girishsastry The fake RL point is fair, I think, though FWIW I'm already adjusting somewhat (perhaps not enough) to account for exaggeration - even a small fraction of what's been claimed is non-trivial deployment of the algos under discussion. *Lying* is something I haven't considered much @zacharylipton @girishsastry (and I have implemented some of this/realize it's harder than research papers make it sound - that's why I'm referring to claims about its actual implementation) @zacharylipton @girishsastry so, are you saying that Alibaba/Google are lying about deploying DQN/DRL on real systems? I am not saying it's *widely* used. I'm saying that people in these orgs regularly say it is used in some cases. @jeffbigham @zacharylipton @girishsastry re: using the video to support my claim they're actually using DRL? Or the fake MDP thing? I'm not sure why we are talking about fake vs. real MDP anyways, the point was about the general applicability of some DRL algos. @zacharylipton @girishsastry I think so, yes @zacharylipton @girishsastry ? @zacharylipton @girishsastry btw this seems to refer to the same holiday mentioned in the paper - https://t.co/lmYQ1cSu7m not a small-scale experiment - tens of billions $ @zacharylipton @girishsastry E.g. someone from there implies DQN is used for 3D bin packing heuristics/mentions $ saved (https://t.co/9fJpeMSjM1) around 35 mins, then banner design later @zacharylipton @girishsastry Re: first part - possibly, though they claim to have at least used it on a major holiday. I'm not sure how one would know for sure if they're using it now. My sense is that Chinese companies are more willing to deploy risky stuff but could be wrong there. Re: second, why fake? @zacharylipton @girishsastry the title of the first is a bit misleading - it uses A3C. @zacharylipton @girishsastry https://t.co/iod6to8s5R T @zacharylipton @girishsastry You're nicer on Facebook, Zach ;) I'd be happy to bet you on this. @zacharylipton @girishsastry 1. The "generality" of the skills possessed by a system after some training process, and 2. The range of skills that a given algo can be used to learn. I'm mainly talking about the latter, so the fact that the tasks are very narrow doesn't negate the pt that 2 has broadened. @zacharylipton @girishsastry I'm confident there are non-bandit e-commerce applications of DRL in use in China (and probably elsewhere) but don't have time to do a detailed arXiv search RN. In any case, I'm not sure we're talking about the same thing (in your last tweet). I'm distinguishing btwn ... @zacharylipton @girishsastry (Certainly deep learning generally is "proven" to provide value in many cases, and is arguably more general in some respects than more hand-tuned systems used before, but I'm trying to stick to the context I specified) @zacharylipton @girishsastry (and not the only such case - there are more detailed examples/evidence of seemingly successfully applications deep RL for ad placement and other things by various Chinese companies, for examples) @zacharylipton @girishsastry I'm not sure what "proven" would mean in this context, esp. given that some claimed successes are proprietary. It's possible I suppose that Google is lying about how much $ was saved with DQN, or that they couldn't extend it beyond that. But I suspect it's useful there. @zacharylipton @girishsastry the setup in question is a particular control problem with discrete actions, but there are sub-categories where one can also point to progress (e.g. new games solved). or one could broaden the context to discrete or continuous problems generally, and there's prog. within that too RT @allinwithchris: Never before seen footage obtained exclusively by All In shows Bill Gates discussing meetings with Donald Trump #inners… RT @merylalper: I'll be judging this Machine Learning Accessibility Hackathon at Microsoft New England Research and Development on June 11.… @rbhar90 (insert shameless plug for ICML debate workshop here :) ) @histoftech I can't find the original tweet but someone aptly phrased it as something like "likes are now stochastic retweets." It's Science Saturday! https://t.co/cHJyVRmwti @zacharylipton @girishsastry https://t.co/uZJnC5Lfn7 @zacharylipton @girishsastry But I agree that that's a fair Q/concern. This is a complicated issue and fixing the domain makes it hard to make strong claims of generality (esp. given that I'm not claiming HUGE progress or very high levels of generality, only non-zero progress, and that it is non-binary) @zacharylipton @girishsastry I can't speak for/defend what "people are hyped up about," but the fact that DQN and other RL algos developed for game applications have subsequently been applied to real world systems, including data center control, speaks a bit to their broader relevance to control probs. "@zacharylipton @girishsastry The def there was poorly phrased,* but was intended to capture the idea that if you grow the task set without increasing labor, that's progress. *I'd also be willing to fix using a def in the literature - Measure of All Minds is my fave framework but hard to summarize here" @zacharylipton @girishsastry add something re compute. I agree that if one does that, the claim of progress is more suspicious. And holding human labor constant, if progress goes up on multiple tasks, maybe counts. Rainbow>DQN>stuff that came before with more hand-tuning for individual games by this measure. @zacharylipton @girishsastry K, let's say context = RL for Atari, definition is "a technique A is more general than technique B to the extent that less human labor is required to develop a system that achieves some task or set of tasks X using A than B, holding final performance constant". One could ... @girishsastry @zacharylipton yeah, I would be interested Zach's answer to the Q, not sure how much we actually disagree. I'm not wedded to the idea that intelligence or generality is one dimensional, or that someone's found the right formalization. But seems clear some sense of generality has ^ w/ DL (etc.). @zacharylipton They suffice as examples of people not just throwing their hands up in the air re: the quantification Q. And even if I were to concede that progress is not quantifiable, some things are pretty clearly > general than others IMO. DQN on 50+ Atari games vs. a bespoke 1 game system. @zacharylipton That's a bit of a silly comparison. You implicitly asked for some quantification/measure of something, and I pointed to one. There are others - see e.g. Hernandez-Orallo's book The Measure of All Minds which works out many of these topics in a lot of detail. @zacharylipton @GaryMarcus +I agree with that, FWIW. I don't think claiming that system or paradigm X has >0 generality within the domain of function approximation entails that FA is everything, or that systems couldn't be more general with more logic/hand-crafting/etc. @zacharylipton Or compare the amount of hand-crafting/human labor by some measure was required in order to get algorithm A to work on task x vs. algorithm B to work on task x. Along these dimensions (yes, there may be >1), there is progress in a number of cases. @zacharylipton There have been various efforts to formalize the idea of measuring generality of systems (e.g. Legg/Hutter 2007 and and Legg/Veness 2011's approximation). But even w/o the formalism, we can compare system/pipeline A w/ system/pipeline B and say B is able to do 2 tasks, vs. A's 1. And there seem to be many plausible lines of attack on this that don't involve cognitive engineering per se. It seems like an an empirical question, not something that's clear a priori, whether this can be achieved through e.g. large-scale curriculum learning in virtual worlds. Also I agree with @GaryMarcus + Davis re: the need for building up a commonsense core, and will be very curious to see how AI2's new initiative in this area goes (seemingly learning the lesson that humans hand-coding that core is not scalable, though precise use of ML seems TBD). And some outputted systems are more general than previous ones - see, e.g., recent progress in positive transfer for Atari with less forgetting across games, multi-task learning of many similar tasks in DeepMind lab, meta-learning for making adaptive systems, etc. As I framed it in the context of AlphaGo a while back, we don't yet have general methods (or narrow methods) for outputting general purpose systems. But we are producing lots of algorithms, theories, etc. for efficiently producing narrow systems with increasingly flexible tools. Agree w/ some of @GaryMarcus and Davis's points here but don't find the "current AI != 'genuine AI'" framing helpful. Generality/genuineness is a spectrum; today's ML, while outputting narrow systems, is >general than previous ones. Progress is happening. https://t.co/uANJIjLjtu RT @OrinKerr: If there was no collusion, it wasn’t for lack of trying. https://t.co/saHLkmhLl5 "RT @cd_hooks: Things That Are To Blame, Texas lawmaker edition 1) Doors 2) the Supreme Court 3) the concept of public education https://t.c…" RT @gerryshih: Good morning from Florida! AP put out this story last night re: Xinjiang's stunning new re-education centers, We worked on t… RT @Reuters: Visitors of Prague Zoo are treated with a sight of its latest addition - a baby aardvark. https://t.co/XHfnkaXPBN RT @HayesBrown: i am calling the police. https://t.co/2BPsYgBV73 RT @Otter_News: Otter wants to chat on the sofa. https://t.co/kmleqpdIX4 RT @jonnysun: the true genius of classical pavlovian conditioning is that every time i hear “pavlov” i automatically think of a dog RT @zeynep: I am, sadly, going to retweet an earlier thread. Media: please don’t put the killer’s face on loop, on front pages, on your app… https://t.co/aW0JQ9QIRr *write profiles of One of the many great moral failures in America today is journalists' unwillingness to do what the evidence/common sense says they should do: not name/profiles of mass shooters. https://t.co/wvdukRDGK0 @pstAsiatech (And many of those people’s faces are visible) @pstAsiatech Huh? Plate recognition is very mature @ISV_Damocles Googled for a website that provides that service 1 in 10 out of a decently sized sample say "the arXiv," 9 in 10 say "arXiv." Per the replies, this may vary across disciplines. https://t.co/ppyi1t1KqD @mark_riedl @ValaAfshar *practically all ways. The only part that makes any sense is general AI after narrow AI RT @lreyzin: Wow, there were about 5k submissions to NIPS (a reliable stat coming from a PC co-chair). https://t.co/VamhkAcNcd Ooo, this should be fun. https://t.co/y75dJ12WVl @mikarv I think it's good to get stuff out there fast for at least some sorts of work, so people don't reinvent the wheel. But there's also a case for a slower process, whether that's NIPS or not. (spoiler alert!) Related issues will be debated at ICML! arXivgeddon looms https://t.co/hnu8FiowwK @halhod best seat for sure "RT @JosephBrassey: What's the opposite of a Social Justice Warrior? A Status Quosader." Kate has been killing it with the Google coverage lately. https://t.co/j5f6v5537v @TheAnnaGat I mean, it makes more sense than that because the homonym (archive) is an improper noun Gives new meaning to "this call will be recorded for quality and t͟r͟a͟i͟n͟i͟n͟g͟ purposes": https://t.co/fb5aFLoR8S Also will be my first time in Sweden Going to my first ICML this year! Look forward to seeing many of you there :) As context, I always say one, but have heard the other a few times recently. Won't say which so as to not bias the results (though if you've followed me for a while, you may already know...). When used in a sentence (e.g. there's a paper about this on X), is it: @davegershgorn Do you even d̶e̶a̶d̶l̶i̶f̶t̶ arXiv, bro RT @laurenduca: Omfg they're going to ban doors before they ban assault rifles https://t.co/v0A6QLfGfW @hannahgais pleaseeee RT @joannashields: The UK’s digital technology sector is growing faster than the economy as a whole and spreading beyond the south-east #Te… @sir_deenicus @jackclarkSF @ericjang11 Yeah I don’t think people need to know all the details, but should have some intuition for the capabilities/limitations, gained through conversation, reading, or direct experience. Pretty low bar, but some don’t cross it. @ericjang11 @jackclarkSF *they should at least have @ericjang11 @jackclarkSF ...and have some general sense of what deep learning, RL, and tree search are. If talking about economic implications, they should have a Andrej Karpathy's AlphaGo limitations blog post level understanding. @ericjang11 @jackclarkSF Depends on what they're saying about it, and it's not just about the system itself but current AI limitations more broadly. If they're talking about how AlphaGo works, they at least have a DM blog post level understanding... @jackclarkSF @ericjang11 As an example of this, many journalists and popular science writers/speakers say stuff like "complex algorithms" which is code for "I spent no effort to talk to anyone/read anything about how this works" @jackclarkSF @ericjang11 That's not entirely on them (AI researchers need to communicate their work clearly, we can't expect everyone who wants to engage to get a PhD, etc.) but the excuses are running out as better and better resources on these things become available @jackclarkSF @ericjang11 Yeah, I think Eric made good points but would suggest that the distinction is not foundational vs. not, it's engaging with any literature at all vs. not. Many papers/talks etc. on AI just mention or cite journalistic accounts of AlphaGo and evince no granular knowledge whatsoever @mark_riedl you should write headlines RT @lisatozzi: Heartbreaking. https://t.co/uAQnmCazLN Podcast by @80000Hours with my FHI colleague Allan Dafoe on AI and geopolitics: https://t.co/4mTFMB4Yas @OilGains I have not. RT @MarshallProj: ICE has dropped a software request for their "Extreme Vetting Initiative" that could mine social media to determine wheth… RT @lottelydia: I know this meme is dead but I found this on my phone and remembered making it a while ago and it made me actually lol, so… RT @nottombrown: AI friends and AI skeptics of twitter - Will there be an AI project that uses 100x more compute than AlphaGo Zero within… RT @sirvinnyd: if you think of the word “brainstorm” you hear the word brainstorm. if you think of the words “green needle” you hear green… "Interpolatron: Interpolation or Extrapolation Schemes to Accelerate Optimization for Deep Neural Networks," Xie et al.: https://t.co/nW3C5Rhnz6 "A Spline Theory of Deep Networks (Extended Version)," Balestriero and Baraniuk: https://t.co/KhvDMjnBhQ "DNN or k-NN: That is the Generalize vs. Memorize Question," Cohen et al.: https://t.co/KkA8NzYNQR @mark_riedl https://t.co/jhvX0pZTOv; https://t.co/DRUWoNKrtt; prob others I'm forgetting RT @math_rachel: Please ask if your company can help strengthen & celebrate the African AI ecosystem by sponsoring students to attend @Deep… @davegershgorn @OpenAI @Hernandez_Danny Oh I see it's the NIPS paper, not Nature, I see how the calculations make sense now @davegershgorn @OpenAI The control policy for a single Atari game is pretty simple - RL for Atari typically only requires small neural nets. Also, environment computation isn't included. Though I'm puzzled by the * 5M thing @Hernandez_Danny is that supposed to be the frame #? Shouldn't it be 50M? RT @DrBeef_: The online edition has a walk through latent space on the cover; which in my opinion is way groovier https://t.co/cDpS0tDXoM "RT @DrBeef_: Some of my AI generated landscapes are on the cover of Bloomberg Businessweek!! Can't wait to get a print copy 🤖💭🖼️ https://…" I was also skeptical when I met someone from there at NIPS, but yep, they seem to be doing big stuff. https://t.co/60o0n9PWpV Update: @sg175 suggests the term subverting - that’s way better! RT @RaiaHadsell: We have a new scalable, lifelong learning architecture called Progress & Compress - it brings together the best aspects of… Also, I wasn’t happy with the word “degradation” as catch-all term for messing up AI systems -advers. examples, data poisoning, hardware backdoors etc. Lack of robustness=wordy, attack too vague...”undermining?” interested in alternative terms to distinguish from AI weaponization (The policy stuff at the end was a bit glib as I wanted to force myself out of my comfort zone and only have one slide on that :) most of it’s on the specific challenges/solutions) Enjoyed speaking in London yesterday on “Challenges in AI Safety and Security,” covering the spectrum from immediate to more long-term/speculative concerns. Thanks @HeidyKhlaaf for hosting me! Slides here for anyone interested: https://t.co/QGTSdgQOlI RT @mark_riedl: This writes scientific paper abstracts for a given paper title. Fools junior-experts 30% of the time and non-experts 80% of… @DrDihal @stephenjcave @LeverhulmeCFI Whoa, congrats! RT @DrDihal: It's official, as just announced by @stephenjcave at the UN #AIforGood Global Summit: over the next years, I will be leading t… RT @hardmaru: DIY machine learning kit made from cardboard and low cost components. (h/t @douglas_eck) https://t.co/w1BGFfzuyY https://t.co… RT @BrundageBot: Regularization Learning Networks. Ira Shavitt and Eran Segal https://t.co/KuT56UkCoB RT @BrundageBot: FollowNet: Robot Navigation by Following Natural Language Directions with Deep Reinforcement Learning. Pararth Shah, Marek… @starsandrobots or Clus-door **** @starsandrobots Cluster lock also kinda works. "Learning to Write with Cooperative Discriminators," Holtzman et al.: https://t.co/hc59vZQFsf """Paper Abstract Writing through Editing Mechanism,"" Wang and Zhou et al.: https://t.co/5BD2oFZvpj Nice results here" @Smerity @jeremyphoward @willknight @OpenAI Sutton has been making this point for a long time, e.g. this from 15 years ago https://t.co/zrVcwGcdYk https://t.co/eBYFs9EZ5w "Do deep reinforcement learning agents model intentions?," @tambetm et al.: https://t.co/ozl7Hk6Yoa Look forward to digging into this - congrats to the authors, including my @FHIOxford colleague @jelennal_! https://t.co/VSCwEeBswf "Progress & Compress: A scalable framework for continual learning," Schwarz et al.: https://t.co/3KHemMP2fD Thread with different take on the OAI compute blog post: https://t.co/U7FLZdRFYJ Will be doing some more gratuitous sharing in the not too distant future prob. (preliminary thoughts on the ethics of face recognition, for feedback), in addition to the "role of the board" stuff, but in the meantime, always happy to answer Qs @Smerity 💯 (and volunteered a lot of info no one asked for - much more of that, actually, haven't got many Qs individually) Won't have answers on everything for a long time/will need lots more people's input, but should be off to a good start soon. IMO transparency is a key aspect of these kinds of boards. AFAIK I've answered all questions asked to me about it... Agree with fellow Axon AI Ethics Board member @tracyannkosa here that the letter to us was a welcome development. Look forward to sharing more about the precise role of the board in the near future. https://t.co/WccL8etGTG RT @JohnDanaher: It is the one month anniversary of my sister's death. This series of posts is dedicated to her memory - Coping with Grief… No regrets Moore's Law? More like Bore's Law. https://t.co/FGkJCy4xoi RT @JeffDean: Nice analysis by Dario Amodei and Danny Hernandez of the computation scale for a variety of recent important ML papers, and o… RT @katecrawford: NYC's Automated Decision Systems Task Force just got announced. Delighted that @AINowInstitute's founders and advisors @m… Fun/busy day in London! The AI scene here is 🔥🔥🔥 @jackclarkSF @RebeccaCrootof @hlntnr @jeffclune @JanelleCShane https://t.co/nEaLB2qkHL (context: https://t.co/uIDJdlorWs) and yes also Clune and co’s paper RT @rbhar90: This is a very cool blog post that provides an empirical complement to my recent blog post on the advent of Huang's law. Effec… RT @geoffreyirving: We're in the super Moore's Law period: compute used on large ML projects has been doubling roughly every 3.5 months. h… RT @qhardy: STOP PRETENDING THERE IS A STRATEGY HERE. https://t.co/0ZYMlQhr8M Roasted by the President of the European Council https://t.co/vsTBQsFLNr RT @Yanni: I only hear Yanni ;) hahaha https://t.co/WrMMVvl8iX @rivatez Fact check: True RT @mark_riedl: There something kind of surreal about mainstream media explaining “Schmidhubered” https://t.co/HfdMH9ktxu """Feedback-Based Tree Search for Reinforcement Learning,"" Jiang et al.: https://t.co/kF0oRKQdCI Including results in the Tencent game King of Glory" RT @mattdpearce: The job titles for candidates on California ballots never disappoint. https://t.co/tie23CiTj6 The perks of being an Elder Statesman™ I guess "Pretty impressive of Kissinger to write thousands of words on the social impact of AI and cite literally no one https://t.co/7OKHvizd6J (there are a few hyperlinks to news stories, mostly from the same publication, prob. added by the editor)" Excited to see the @RealAAAI K-12 initiative! Though see also: https://t.co/TADzK6nwlr RT @RealAAAI: . @RealAAAI is launching "AI for K-12" initiative, in collaboration with @csteachersorg and @ai4allorg. https://t.co/zEAM9H… RT @KateCharlet: I can't even. https://t.co/05J9U6kjLJ RT @mchorowitz: How will developments in #AI shape the balance of power and international competition? My take, building on research on inn… RT @mattsheehan88: Brutal piece by @RianThum on the state of affairs in Xinjiang. Read, now: https://t.co/AevZra2unx @AmirSaffari ooh that'd be great! Just followed you, maybe send a DM w/ address? Mostly filled up my schedule for London tomorrow, but still potentially able to meet up with folks in the Kings Cross area if anyone’s interested around 5:30 or so. @minhle_r7 he's still doing what he considers AGI research, just also doing applications for $ Also, interesting that NNAISENSE is doing stock trading Nice recounting of, among other things, the Great Schmidhubering of 2016 https://t.co/tRKJj5spDJ RT @valleyhack: Do you know what it feels like to be Schmidhubered? https://t.co/RRlpPkzZwU RT @jackclarkSF: Want to work on hard problems at the intersection of artificial intelligence, public policy, and the future of civilizatio… "Unifying and Merging Well-trained Deep Neural Networks for Inference Stage," Chou et al.: https://t.co/nVpEpULtA2 "Unsupervised Intuitive Physics from Visual Observations," Ehrhardt et al.: https://t.co/2bY9artTAN "DeepMutation: Mutation Testing of Deep Learning Systems," Ma et al.: https://t.co/JmuHWzDWwW "Hu-Fu: Hardware and Software Collaborative Attack Framework against Neural Networks," Li et al.: https://t.co/XJgv2A8Ito "Unpaired Sentiment-to-Sentiment Translation: A Cycled Reinforcement Learning Approach," Xu and Sun et al., Peking/Hong Kong Polytechnic: https://t.co/yKmbR0X3G6 "Adversarial Task Transfer from Preference," Ma and Jing et al., Tsinghua: https://t.co/KVk3RMffNz "Low-pass Recurrent Neural Networks - A memory architecture for longer-term correlation discovery," Stepleton et al., DeepMind: https://t.co/bsWmbSZwMV "Backpropagating through Structured Argmax using a SPIGOT," Peng et al.: https://t.co/IWb3Ma65B0 "Metatrace: Online Step-size Tuning by Meta-gradient Descent for Reinforcement Learning Control," Young et al., Borealis AI: https://t.co/9f7GghrUFq Look forward to reading this paper involving awesome former @FHIOxford intern Clare Lyle! :) https://t.co/3BwzYmiZdQ "GAN Q-learning," Doan, Mazoure, and Lyle: https://t.co/RE2dWN82VS Ooo arXiv is even more epic than I expected today RT @WilDonnelly: A mere 72 hours after the Chinese government agreed to put a half-billion dollars into an Indonesian project that will per… RT @kateconger: This letter launched this morning with 90 signatures. It now has almost 300. https://t.co/XF9v64CrPJ "arXiv this week and next will be 🔥 🤖🤖🤖" @judywawira No, I was speaking based on insider info 🙊 lol RT @sarahjeong: i would pay to watch "the intellectual dark web" attempt to access the dark web RT @janexwang: Happy to share our recent work on meta-reinforcement learning in the brain, in collaboration with my excellent colleagues at… @L_badikho Haha. Unfortunately it's too late to submit but not too late to come, and possibly as a speaker or moderator (we are still figuring out the debate topics as it will depend in part on the submissions - there may be some gaps to fill, TBD). Congrats @janexwang et al. at DeepMind! Very interesting stuff. https://t.co/8YP3E7Zy7g Lots of great submissions to the debates workshop at ICML. Y'all have lots of interesting opinions! :) Should be a fun event. RT @Miles_Brundage: Will be in London on Wed. if anyone wants to hang out! RT @DrBeef_: I trained a neural network to try and turn minecraft screenshots into landscape paintings - but the results the other way arou… RT @kateconger: Google employees are resigning from some of the most comfortable and well-compensated jobs in the industry to protest Googl… RT @shimon8282: I'm so impressed with the performance of the students and postdocs in my lab: an amazing seven accepted ICML papers! (I wa… "@zacharylipton @BaiduResearch I'm tempted to go the algorithm acronym naming style: Simple/SIMPLE: Soymilk, Ice, Maple, Plus [a] Little Espresso" "RT @BenGolliver: Reporter: ""What happened early in the fourth quarter?"" LeBron James: (Initiates photographic memory) https://t.co/KLbkjCA2…" RT @changelog: tfw you’ve mastered the command line https://t.co/MkeTlrMn17 "👀 https://t.co/d0g2SPRgWc" @TedPavlic happens somewhat frequently, sadly "Leveraging Grammar and Reinforcement Learning for Neural Program Synthesis," Bunel et al.: https://t.co/gsemuUZ9BW "Interactive Reinforcement Learning with Dynamic Reuse of Prior Knowledge from Human/Agent's Demonstration," Wang and Taylor: https://t.co/20Cs4gewiz "Piecewise classifier mappings: Learning fine-grained learners for novel categories with few examples," Wei et al.: https://t.co/Jk95CrQueS "Deep Hierarchical Reinforcement Learning Algorithm in POMDPs," Tuyen et al.: https://t.co/1349G9aOKl @zacharylipton I need a good name or it’ll be Lipton’s Iced Coffee @zacharylipton What’s it called? @decodyng Yeah!! I was so stoked. RT @freakonometrics: "I'm an expert in machine learning..." (via @9gag) https://t.co/pey4N6KjRv First time seeing a balloon in Oxford for some reason... https://t.co/mTRzdIKFXq Karina has lots of interesting stuff to say on AI, extended cognition etc. - worth checking out if you’re in London :) https://t.co/3cNajFkI0v RT @KarinaVold: Looking forward to sharing my research on augmented intelligence next week! @RI_Science @quantumblack https://t.co/pbbYGnVj… @HW I have not! There's a lot to like about the show 3%, but I'm very bothered by the drones not making any physical sense (how do they stay aloft? The rotors are barely spinning). In other news, you should read it Got someone new to read the Remembrance of Earth's Past trilogy :) Will have more to say about this in the not too distant future, hopefully... (in case anyone's curious, I got excited about the paper linked to here - Social Choice and the Value Alignment Problem: https://t.co/6SQeOVtY7O Doesn't answer all of my questions on the relationship between AI, value alignment, social choice, governance, etc but a big headstart. I'm having a wild Saturday night btw I love it when I get excited about a research problem and then find relatively quickly that someone has already worked out much of the issue. Way better to find that out sooner rather than later, and then you can think even bigger thoughts! @chrisalbon https://t.co/O0wM4jjFkE Update: account deleted! Thanks folks who reported it/gave advice :) RT @jk_rowling: That was everyone who's ever been on stage's worst nightmare and it must have been scary, but what a pro, what a recovery @… Please stop this spam @TwitterSafety https://t.co/ArTQvFA0kj Will be in London on Wed. if anyone wants to hang out! Digging Moldova's theme of the Monty Hall Problem #EUROVISION "What on Earth is this #Eurovision It's like the weak young brother in Gattaca combined with Vanilla Ice" RT @floschechter: Einstein's playing the recorder for Serbia #Eurovision Eurovision is like the Super Bowl of Europe @sknthla cc @GoAbiAryan @aCraigPfeifer 🇺🇸 What is the best season of The Office (or the best tertile)? RT @JeffDean: One update about Duplex is that before this launches, we're going to have the system disclose that it is an automated agent.… RT @rao2z: To customize #inUteroAI experience for your baby, and to increase lesson transfer, the classes will be taught in the baby's mom'… @erikbryn cloud AI? "RT @rao2z: Starting this fall, @ASU #AI group is proud to offer the WORLD'S FIRST #InUteroAI degree. The grad/ug/k12 #AI programs are to…" @PabloRedux @KevinBankston me and 25 of my closest friends ;) thoughts on it are v. welcome! RT @KenTremendous: https://t.co/FY3Dp9Ha2t RT @sh_reya: hello Twitter, I present a fun intro to AI safety! these comics took longer than I thought, so I'm posting half the series tod… RT @EvanSelinger: @Iwillleavenow @Miles_Brundage It’s back! https://t.co/p170nHRzSD Is it, though? Seems like they mostly just described existing small things as big deals. Not sure I want them to take it much more seriously RN given what happens when they took, e.g. Iran "seriously" 🤔 https://t.co/taXVtN2eGa @jackclarkSF @zacharylipton @charliejane Margaret Atwood (MaddAddam trilogy!!), Ann Leckie, Annalee Newitz /gifs Going through some personal stuff, please send good thoughts. RT @HoangMinhLe: When experts are available, how can we most effectively leverage their feedback? Our work on Hierarchical Imitation and Re… RT @arthurmensch: Our work w/ @mblondel_ml 'Differentiable Dynamic Programming for Structured Prediction and Attention' was accepted at @ic… RT @snikolov: okay this has probably been done but https://t.co/bdm1cjaOM9 RT @AshJL7: I refuse to believe that I live in this time like where Big Bang Theory is renewed for the next 20 years but B99 is murdered in… RT @terrycrews: Thank u everyone. 😢 https://t.co/idz78IX9SU RT @thekibosch: I'm looking for a roboticist who likes to write for a nontechnical audience. If you are them, or if you know them, email me… Haven’t watched yet but I’m a big fan of Jose’s work! https://t.co/u2GnEPklge RT @twimlai: Visit https://t.co/OJ4qBOvGP8 to check out our convo with Professor Jose Hernandez-Orallo, Fellow at @LeverhulmeCFI, to discus… RT @rbhar90: Crypto and AI are opposites. One is about learning to solve hard problems. The other uses hard problems that can't be solved b… RT @NoahShachtman: Remember when this White House cried hot, hot tears over a comedian making a joke about Sarah Sanders' eye shadow? https… RT @jjding99: This past week's issue of the #ChinAI newsletter revisited a "data clash" between two Chinese tech giants, Huawei and Tencent… RT @MeredithFrost: Happy birthday to Richard Overton, America's oldest living WWII combat veteran, who turns 112 today https://t.co/q9s2BSN… RT @jacyreese: Animal ag lobby is pushing stifling regulation of #CleanMeat. They know their best chance of shutting down innovation is pre… RT @HMRoff: See my newest piece on @DARPA ‘s #COMPASS program for fighting #graywars with #AI and #MachineLearning https://t.co/RCr3udShpi "Making AI fair," talk by the great @OsondeOsoba https://t.co/THGnI0F4Y2 "RT @mark_riedl: Were you wishing there was a multi-task AI creativity benchmark test? Here’s the Creative Invention Benchmark (CrIB): htt…" "Monotone Learning with Rectifier Networks," Elser et al.: https://t.co/WKVkdHGo3g "Inference Attacks Against Collaborative Learning," Melis et al.: https://t.co/Ept9FBRBSP "Ariadne: [Static] Analysis for Machine Learning Program," Dolby et al.: https://t.co/zRSTYvtmuZ "Loss-Calibrated Approximate Inference in Bayesian Neural Networks," Cobb et al.: https://t.co/wmuMSVm8SY "Labelling as an unsupervised learning problem," Lyons and Arribas: https://t.co/3p1ZCrkVR4 "Long Short-Term Memory as a Dynamically Computed Element-wise Weighted Sum," Levy and Lee et al.: https://t.co/hTTybM1Zyl RT @DeepMindAI: Pleased to share DeepMind's I3D action recognition models on the @TensorFlow Hub platform! https://t.co/WRLFdR29B7 RT @glowcoil: https://t.co/OHQrW1Ktyt @Iwillleavenow and I just got into it!! @timhwang i feel subtweeted by brummagem RT @mark_riedl: The administration announces an “America first” approach to AI competitiveness https://t.co/FvwqsCKLTT << Anyone else find… RT @jackclarkSF: I'm going to be talking in London next week about a load of recent multi-stakeholder work on AI policy and AI measurement,… @AthertonKD I hear critics of Maven love hearing about “warfighters” @papin_benjamin @MirowskiPiotr @nature @DeepMindAI @RaiaHadsell You can read it on DeepMind’s website for free. @rbhar90 @ComputableLabs Possible addition? SafetyNets by @sg175 and co. https://t.co/NBEowBh084 @rbhar90 @ComputableLabs very helpful, thanks! RT @alyankovic: Um, what? https://t.co/IlTwbppo3h "RT @jnhwkim: A Visual Dialog for Collaborative Drawing (CoDraw) dataset is officially released! Hope to see awesome works for this!!! datas…" 🤔 https://t.co/5m5UNGAsm5 "Policy Optimization with Second-Order Advantage Information," Li and Wang: https://t.co/AJWnswMOPI "A Unified Framework of Deep Neural Networks by Capsules," Li and Shan: https://t.co/44DUtLYDBe "Robust Classification with Convolutional Prototype Learning," Yang et al.: https://t.co/EFwlAoTicp "Machine Learning in Compiler Optimisation," Wang and O'Boyle (review paper): https://t.co/qNsoCJjKWm @suchisaria congrats! RT @ChinaMedia1: China's Social Credit System is a big thing, and most - if not all - mainstream reporting on it contains major factual mis… RT @rbhar90: I'm excited to publish the @ComputableLabs cryptography reading list! Modern cryptography has a deep and complex technical lit… RT @CIFAR_News: CIFAR is now accepting proposals for workshops that explore artificial intelligence's impact on society. Please submit your… "RT @ericgeller: .@RobJoyce45's last day as WH cyber coordinator is Friday. Bolton and his deputy, Mira Ricardel, are discussing the idea o…" RT @jeffclune: I have been invited by the White House to discuss how our country can best catalyze and harness artificial intelligence adva… @jjvincent (Random to an American at least) @jjvincent Wild. Met someone from there at an AI conference a while back and was skeptical this random company was really doing all this but I was wrong it seems. RT @deliprao: Read this thread in the context of modern AI. Palantir’s current (janky) software is nowhere near to using modern AI techniqu… RT @Snowden: Questions of Haspel's character miss the point: she was already tested. The only morals in question today are our own. https:/… @katyanna_q Sophisticated S selections. 👍 RT @MirowskiPiotr: Incredibly proud to share our @Nature paper on learning grid-cell navigation, written with incredible colleagues at @Dee… @dpham20 @MattHourihan interesting - thanks! I assumed it was new because they mentioned it in the press release but I guess that's the norm... This is not completely inaccurate https://t.co/4stQsFFNMy RT @pourmecoffee: https://t.co/y1qhWjn8A8 @tanishafazal @RebeccaCrootof on cybertorts @samim https://t.co/6DbP3v4zWS RT @judywawira: The person sited next to me commented .... “you mean I don’t have to call my dentist anymore?” #io18 @GoogleAI https://t.c… @jeffbigham Fancy! @zacharylipton @JNJNews Nice wallaby pic RT @zacharylipton: With a mix of joy and wistfulness it's time to announce I'll be joining Johnson and Johnson (@JNJNews) as Inter-Global H… @Byron_Wan @mark_riedl No direct proof I suppose but there are plenty of examples of similarly convincing AI voices (WaveNet, Tacotron etc.). What’s more impressive is the dialogue, and for that I think it’s just a matter of them having little reason to lie (would be figured out in few months at most) @Smerity Have you seen The Push? @jeffbigham @mark_riedl well, they could have been ("THIS DOESN'T PASS THE TURING TEST" in diagonal font across the whole thing, like those "DRAFT" backgrounds) but they were pretty clear @jeffbigham @mark_riedl Sigh, the blog post and keynote on this could not have been clearer re: the narrowness. @JeffDean Thanks for sharing! Was looking for something like this.. RT @JeffDean: If you want to learn more about why we're so excited about TPUs and how they make machine learning research and applications… RT @DeepMindAI: DeepMind, meet Android. Introducing our first collaboration with the world's most popular mobile operating system: https://… @MattHourihan Chinese people coming to DC with only a few weeks notice, want to do some bilateral thing --> can't do it even if FBI says so. Not that OSTP is particularly active these days but making it so they can't be even if they wanted seems like a step in the wrong direction. @MattHourihan I'm all for consulting with FBI on stuff but tons of things have a risk of IP theft, and yet science diplomacy is also important, esp. with State asleep at the wheel. 30 days prior notice (even w/ FBI approval) for science diplomacy is extreme. "House bill ""Prohibit[s] NASA, the Office of Science and Technology Policy, and the National Space Council from engaging in bilateral activities with China unless authorized or certified via procedures established in the bill"" https://t.co/vY2rcaxvVg So dumb. h/t @MattHourihan" """What game are we playing? End-to-end learning in normal and extensive form games,"" Ling et al.: https://t.co/NHejhCSkta ""learn the game by training in an E-2-E fashion, effectively by integrating a ""differentiable game solver"" into the loop of larger deep network architectures""" "ReGAN: RE[LAX|BAR|INFORCE] based Sequence Generation using GANs," Balagopalan et al.: https://t.co/XKEJik6Sbq @nagaraj_arvind @drewharwell @erikbryn @superwuster @madeline_lamo Not sure how many kids are reading Washington Post... but in any case, there is plenty to be in awe about, including this. @rcalo @madeline_lamo @washingtonpost @erikbryn The "I guess" is especially apt since this was just my bot being interviewed anyway 🤖 https://t.co/iv14VsSanS @semiDL thanks! helpful. @hardmaru might need to develop it on their own instead of using this service, since Google's version adds latency to make it non-awkward. A broker AI would prob want to talk fast :) RT @drewharwell: New: A Google program can pass as a human on the phone. Should it be required to tell people it's a machine? https://t.co/… @semiDL Are you sure that's not 8*100 PFLOPs? Jeff Dean's tweet about it/keynote was unclear. In any case, I agree it's not a fair direct comparison, but worth considering the comparison even if unfair given that supercomputers are being used for AI sometimes. RT @tsimonite: Google told CNET its phone call bot will "likely" (!) identify itself as a bot on calls. Also that when it breaks, it will f… RT @elizabeth_joh: OMG. NOT HIS LAST NAME GUYS. https://t.co/bLaCoXSHUo @jjvincent umm RT @OriolVinyalsML: Very impressive application of deep learning from Chen Chen & @intel for "Seeing in the Dark" with regular cameras. Cod… @erfannoury Not a satisfying answer but we should sorry about lots of things ;) @erfannoury Well, I’ve been worried about Trump for a while... 😞 Interview with my colleague @anderssandberg on Fermi's paradox and related issues. https://t.co/ww1CoMhagg @deliprao good Q RT @ericjang11: The voice and conversational quality in this demo is amazing. I didn't think research would advance to this level for anoth… RT @BarackObama: There are few issues more important to the security of the US than the potential spread of nuclear weapons or the potentia… RT @nukestrat: Trump withdraws from Iran deal, an unjustified and reckless decision that makes the United States (not Iran) the violator, t… RT @ZekeJMiller: TEHRAN, Iran (AP) — Iran's president says if negotiations fail, Islamic Republic will enrich uranium 'more than before ...… RT @dennybritz: Google I/O still exists? Surprised it hasn’t been renamed to Google A/I. RT @EmmanuelMacron: France, Germany, and the UK regret the U.S. decision to leave the JCPOA. The nuclear non-proliferation regime is at sta… RT @ylecun: Oculus Research is now Facebook Reality Labs (FRL). https://t.co/BmzAGnsZ3t /not existing I worry that they didn’t even seriously consider this, though. The policy folks are too busy not addressing the Pentagon thing... "RT @ColinKahl: Trump just exited the Iran nuclear deal with no Plan B, manufacturing a crisis to appeal to his base. He and all his outsi…" In addition to the questions of whether this is ethical or legal otherwise, it’s a *massive* opportunity for Google to educate people about the state of AI. Apparently not, but they should IMO: https://t.co/czSOh8Dwa5 (Also dealing blow to US) https://t.co/EF3LLXXEcp Epic plot twist in an era of automated customer service https://t.co/5sCwmNTGJT @mark_riedl there's >>1 still there (though <<Obama admin levels), though I'd believe there's just one person thinking about AI "US government: how do we make an exaflop machine*?? 🧐🤔 Google: 80% of one is in this picture, bruh *yes, they want a more generic one than this/HPC is complicated, hold the tomatoes https://t.co/vh44IYaWEi" "RT @JeffDean: TPUv3! So hot it needs help with cooling: first liquid cooled devices in our data centers.. A TPUv3 pod is 8X as powerful a…" Please don't invite Trump... https://t.co/I7OQJrKVdO RT @kateconger: I looked into the upcoming Pentagon cloud contract. Here's why all the big tech companies are scrambling to win it, despite… RT @sh_reya: i'm writing a self-contained series of comics to intro people to AI safety -- something i might research for my thesis! gonna… RT @ColinKahl: Trump seems likely to jettison the Iran Deal based, in part, on faulty lessons from his “maximum pressure” campaign against… "Quantization Mimic: Towards Very Tiny CNN for Object Detection," Wei et al.: https://t.co/ueoT2R8mVL RT @BrundageBot: arXiv papers, May 8, 2018: "Behavioral Cloning from Observation," Torabi et al.: https://t.co/9l6rdulzwL "Exploration by Distributional Reinforcement Learning," Tang and Agrawal: https://t.co/Lcy8JI5cLE "RT @drob: Conference organizer: Please upload your slides 30 days in advance Me: https://t.co/rd7wjTPcyh" @MonaJalal_ @googleresearch @Google @googlecloud https://t.co/j7vbu7LaEg RT @erichorvitz: Microsoft launches #AIforAccessibility on leveraging #ML & broader #AI to benefit people w/ disabilities https://t.co/nCtW… @wsisaac @timnitGebru @harlanyu @jovialjoy Just put it in a Google Doc :) https://t.co/CfX7PxR5WP And yes, I really liked @harlanyu, @jovialjoy et al.'s letter on this which I read with great interest as one of the members of the board it addressed. Have had good discussions about this w/ @harlanyu but not @jovialjoy. "RT @math_rachel: Part 2 https://t.co/ktYtgBpxGr MOOC is here! Learn: multi-object detection how to read academic papers NLP transfer learni…" @barryfriedman1 @harlanyu @tracyannkosa @MikeWagers @katecrawford @mer__edith @timnitGebru @FrankPasquale https://t.co/Vqf5HNGVwd @sg175 big fan of it! :) RT @hlntnr: From the people who brought you "Crypto Doesn't Mean Cryptography Any More", now introducing... 🤖 https://t.co/CWoIjnlsV0 RT @togawamercer: When facial recognition technology is evolving faster than the law, how might a reasonable privacy AND security-conscious… RT @CBSNews: California's economy has surpassed that of the United Kingdom to become the world's fifth largest https://t.co/28RMB47JeU http… @krowney Definitely a subject of interest to me (see section on digital security here: https://t.co/xdkS31ZEgZ) And that was not an exhaustive list of cool/promising topics that involve both AI and crypto - others are also welcome! Might generalize it to security+AI, not just crypto, so things like federated learning are definitely fair game. cc @iamtrask @rbhar90 So far the best overall resource I've found is the textbook Security Engineering by Anderson. So good. Admittedly I haven't read 100% of it yet, though - working on it. Recommended! It's available online. It's unseasonably hot today in Oxford, and I am therefore declaring the Summer of Crypto+AI to have begun early. Themes of the SoC will include computational complexity theory, secure multi-party computation, secret sharing, and secure enclaves. Send me cool links! :) @tdietterich Have you read @dhadfieldmenell and @ghadfield on related issues? https://t.co/Pyr17H1UgH RT @lawfareblog: "'One Nation Under CCTV': The U.K. Tackles Facial Recognition Technology," by Shannon Togawa Mercer and Ashley Deeks https… @samim https://t.co/TxPfFhelgd @samim Jon Wetzel at ASU is working on this vision, directly inspired by that book (havent looked into detail/maybe others are too) @samim I see someone else mentioned this too but The Diamond Age has a nice inspirational model :) RT @hankgreen: This note at the end of the entry for the word "Clitoris" on the Online Etymology Dictionary is everything. https://t.co/zOW… @davegershgorn congrats! RT @Miles_Brundage: Started outlining a blog post on face recognition in law enforcement and it got out of control, so not sure when I'll b… RT @decodyng: Want to learn about the pitfalls of merging autoregressive decoders (i.e. PixelCNN) into a Variational Autoencoder? Better un… @halhod More likely a timing thing as you said @halhod I’m in the non-EU line where there is always an interview+fingerprint, no change there @halhod Feel like ive arrived at this time before but could be wrong @mhough Not for fast track but maybe should Suspiciously short passport control line at Heathrow... https://t.co/niYaWksT0s Back in 🇬🇧 @ak1010 Thanks! Indeed, it’s good. @surfnm Thanks! @FPallopides Thanks! RT @stevesi: The disappearing Chinese student visa https://t.co/78D6YNK8gO // this is such a long-term disaster for the US. I don’t think I’ve listened to a fiction Audible before, so maybe this is the norm. The Audible for Dune is very high quality (many voices, good atmospheric sounds, etc.). 👌 https://t.co/TMRrsDzlhb @krowney Good idea, thanks! Off to 🇬🇧 ✈️ Cc @harlanyu @barryfriedman1 @tracyannkosa @MikeWagers @katecrawford @mer__edith @timnitGebru @FrankPasquale thoughts v. welcome! @samim Thanks! Yeah good point. Started outlining a blog post on face recognition in law enforcement and it got out of control, so not sure when I'll be able to actually finish it. Here's the outline - would be curious to hear about topics I'm missing/other thoughts. Very early stage/just my thoughts obvi.. https://t.co/qmEdHyZrMl "RT @StephanieCarvin: Life as a female academic: Leading think tank asks you to write a paper Constant emails for an update Submit paper and…" Sorry, meant Dougal 80% sure I just saw Collum from Outlander at LAX RT @hardmaru: TD;LR Textbook aims to cover basics of computer vision, deep learning, music classification, clustering algorithms, NLP, and… @hardmaru Cc @jjding99 RT @KaiLashArul: Perseverance. Months to try and replicate a single GPU SotA DRL agent (Rainbow), checking and double checking. Fingers cro… RT @Miles_Brundage: "Network Transplanting," Zhang et al.: https://t.co/8giygjfTng RT @ColinKahl: <THREAD> According to this story, in May of last year, Team Trump asked an Israeli intel firm to dig up dirt on me as part o… Nice to meet/see a bunch of folks in LA! Back to 🇬🇧tomorrow. "RT @j2bryson: A Rule of Persons, Not Machines: The Limits of Legal Automation @FrankPasquale https://t.co/d3JdQXdxR0 #ai #aiethics #law #a…" @zacharylipton @AmazonKindle droplets!! @TheAnnaGat @mark_riedl Maybe this, but a more general phenomenon so cant speak for Mark https://t.co/3yTKSkLudZ "RT @dustbiddy: responsibilities / 🚔 \ / 🚔 \ / 🚔 🚔 \ / 🚘…" @WokeBayes @timhwang Yes thats what i meant! @WokeBayes “Deep learning performance is predictable empirically” RT @jvmancuso: Here's the notebook I put together demonstrating Peer-to-Peer federated learning in IPFS and @PyTorch: https://t.co/4LNd2p9Q… @colinkgarvey Yes that’s a (potentially) bigger diff than the population diff but not sure how to estimate @ido87 @samim alternative visualization: https://t.co/yQ94CV8kir @ido87 @samim oh it's cuz it's in millions. @ido87 @samim confused by that graph - seems to start above zero but not have a truncation symbol on y axis. Would look more similar if starting from zero. @mark_riedl also RL @mark_riedl ...of hostility given false positive is a big risk (though some cops seem to have no problem escalating inappropriately without it!). And in the "up close" context, it's unclear there whether you even need it real time vs. offline. Lots of factors/concerns. @mark_riedl It is very hard, though getting better. China (e.g. SenseTime) is quite good at it. Depends on distance, # of frames etc. so very high accuracy for up close conversations is quite doable, long distance TBD. False positives concern me especially in a body cam context (escalation) @samim Different extraction schemes could easily make an order of magnitude(s) difference, starting to register on a log scale (population difference is under an order of magnitude) @halhod and yeah I agree re: second part - diff. in intake from diff. in gathering method could be >> diff. in population size (but there, too, I think there's a bit of exaggeration given Tim's points and the growing suite of ways to address privacy issues [esp. federated learning]) @halhod Agree edge cases are important, though that seems consistent with the diminishing returns claim. (See also @timhwang's paper on how data may be overrated in general for other reasons: https://t.co/Lc3CX0QBDB) (Same goes for their data advantage due to lower privacy constraints, though that's perhaps an order of magnitude difference or more, vs. the population size gap which is less than that). If data has steeply diminishing marginal returns (as all the evidence and theory suggests), perhaps China's data advantage due to population size is overrated. China and the US/the EU are basically the same size on a log scale. Test-drove some of my ideas re: serious international cooperation on AI at a workshop today, first quasi-public talk on it :) will have a paper on this at some point - stay tuned! TL;DR: https://t.co/AVzAYqK6At "RT @ylecun: Accurate speech recognition is no longer a red hair ring. It can wreck a nice beach with no error." Fin (for now). Some forms of bias can be solved/alleviated w good engineering + some can't. E.g. the distribution of criminal records across demographic groups is biased/unfair so looking for ppl w records will always be vulnerable to that critique (modulo broader non-face-rec-related reforms). Trying to resist the urge to scoop my future more detailed writings on this, but one more point: bias is a more durable objection, though in subtle ways (/not always extricable from accuracy). (and to be clear, this UK thing is a total shitshow from any reasonable perspective - I'm talking more abstractly here) So ultimately those non-accuracy arguments are more impt, esp. for making laws. There are plenty of such args (some mentioned in the letter on Axon's board a few weeks ago), and same w/ LAWs. Will prob. blog at some point soon re: my personal taxonomy of face rec concerns. (2/2) This is really bad, though I'll also say the same thing about this that I've said about lethal autonomous weapons: opponents of face rec. (/LAWs) should be cognizant that claims of bad accuracy will be less true over time, esp. viz-a-viz humans. (1/2) https://t.co/yoROz4XwOk "RT @InclusionInML: We're happy to announce a new Code of Conduct, joint between @NipsConference and @icmlconf. Its aim is to enable an ope…" @mark_riedl People love going off the rails about Roko’s basilisk "RT @rao2z: Who is she? Well, duh. Wouldn't the article have more Shannon bits if it is flipped and explains instead who/what is J.P. Mor…" RT @Jigsaw: We're hiring a research program manager to investigate opportunities for technology to help vulnerable people around the world.… RT @catherineols: My favorite part of the @OpenAI blog post (debate as a framework for human supervision of AI systems that are more expert… @timhwang Nice emoticon btw @timhwang Saw this the other day @sir_deenicus @gwern @mark_riedl No paper yet, see the link above for all the details I know of @TheAnnaGat Hasn’t been decided, no, just argued (among many other things) in the book @twitskeptic @jwangARK I’m not familiar w the use of “fixed point” without specifying the # of bits... isn’t it just floating point but truncated at some standard length? Apologies for my ignorance :) @rbhar90 We should chat at some point :) I'm considering making this summer my Summer of Crypto. FAIR is hiring a Research Scientist on Trust in AI: https://t.co/LjLJpyLUaZ Didn't mention the precision in the news article, though. "Sources: China plan translation - https://t.co/M8uPsSN70I Coverage of Cambricon chip: https://t.co/AHjXjcVVlo" If the claimed stats for Cambricon's chip are correct, then some of China's 2020 goals have already been achieved (@jwangARK?), or I'm misinterpreting things. As previously noted, the 2020 goals in this area were always catch-up goals rather than leapfrogging goals, though. https://t.co/R63MjGG1gg Latest in a long line of academics I didn't think would join industry doing so... soon it will be AIs and undergrads teaching AI classes. RT @Bschackner: Here's more on Carnegie Mellon computer scientist Manuela Veloso's departure for JP Morgan @PIttsburghPG https://t.co/d0mN… Wait, Manuela Veloso works at JP Morgan now?? (Might lose points for the AV part because the bot doesn’t like signs of applications, esp. body parts) This one’s total @BrundageBot bait - “Robust Deep Reinforcement Learning for Security and Safety in Autonomous Vehicle Systems,” Ferdowsi et al.: https://t.co/1kTmEJqIBa @erfannoury Yep! @erfannoury Namely, that stuff many claim is innate (language, causal reasoning) is not. @erfannoury sorry for the confusion! The things listed on the first tweet are hypothesized by Heyes to be innate. The things on the second tweet are hypothesized to be cultural, building on the stuff in the first tweet. These aren't complete/exact lists but give you the general flavor. Those would be the stakes if true, I mean - Not sure I'm convinced and Heyes notes the jury is still out but this def. pushed me a bit more in the "cognitive gadgets" vs. "cognitive instincts" direction as she puts it. ...but notably not causal reasoning, language, imitation, which are cultural. Interesting topics relevant both to nativist/learning extremist debates in AI and general future stuff (e.g. makes a catastrophic global disaster even worse b/c we'd lose even more than you'd think). Enjoying Cecilia Heyes's "Cognitive Gadgets: The Cultural Evolution of Thinking." TL;DR: more of cognition is culturally evolved than you think, building from small genetic core (attending to ppl, associative learning, slightly souped up but chimpanzee-like memory/exec function)- @mark_riedl thought they put out a trained system too? RT @KateCharlet: https://t.co/mgO6mIdgPK RT @elizabeth_joh: This is BFD: criminal use of a drone swarm to interfere with an FBI hostage rescue attempt. by @DefTechPat https://t.co/… Off to LA ✈️ "RT @janleike: Very interesting and original approach for value alignment with a focus on scalability by @geoffreyirving https://t.co/4m6I9f…" RT @paulmschwartz: Slate: Facebook has fired multiple employees for inappropriately accessing user data: https://t.co/MMYRB5enBB via @slate @timhwang leeks, too "RT @ylecun: Joelle Pineau talks about FAIR's go-playing bot ELF OpenGo, which was open sourced yesterday. Trained on 2000 GPUs for 2 weeks…" RT @TheEconomist: A new nuclear arms race, with all its destabilising consequences, is likely https://t.co/wShf5JQ5bD RT @OpenAI: AI Safety via Debate: why arguments between agents might let us evaluate powerful AI systems: https://t.co/INCaO84v6d https://t… Replace "agmts" with "algorithms/ideas" and you have a decent recipe for AI punditry, too. https://t.co/NEdRKhHRuA @mark_riedl Re: success: https://t.co/aeIvisqFeA Should have said thinking, not pondering, as pondering has another meaning in this context... *braces for tomatoes* Interesting that ELF OpenGo beat pros with 50 seconds pondering for the bot, unlimited for the humans. AFAIK it's plausible AlphaGo Zero or AlphaZero could have done that but it hasn't been (publicly) tried. https://t.co/A67TwCcYcA "A Taxonomy for Neural Memory Networks," Ma and Principe: https://t.co/kGHB4Xaga2 RT @dawnsongtweets: Really excited about our Keystone project on building Open Source Secure Enclave: https://t.co/2ZPa1LkYIF . Looking for… Oh and they're really nice people to boot :) So yeah, awesome paper all around. I didn't wanna mention this right when it came out cuz the paper deserved attention on its own merits, but now I just have to say: this paper also has an epic origin story!! Econ+AI. Mother+son. Student of Ken Arrow + student of Dragan/Abbeel/Russell. 🔥🔥https://t.co/nHjtumsfPe "AI safety via debate," @geoffreyirving et al., OpenAI: https://t.co/kdrYgdoCJ6 "Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Review," Sergey Levine: https://t.co/6Nmj9QLqab """Interactive Language Acquisition with One-shot Visual Concept Learning through a Conversational Game,"" Zhang et al.: https://t.co/3cd7Xjzwhf One of the first fruits of the Baidu-Chinese gov't collaboration" "Falsification of Cyber-Physical Systems Using Deep Reinforcement Learning," Akazaki et al.: https://t.co/NoG3KbwnXx "Concolic Testing for Deep Neural Networks," Sun et al.: https://t.co/kbTS1yNpSY @kchonyc (But cf. e.g. https://t.co/dGhGyqsgu9) @kchonyc Well I can’t say for sure :) https://t.co/TqhJjEBQiF (and just in case it wasn't clear - I'm kidding. Aliens are very unlikely to exist/pose a threat IMO and militarizing space is bad. I am very serious about Dark Forest being a great book, though) RT @ylecun: We are releasing ELF OpenGo, a go bot that has attained professional level in two weeks of training and has won 15 games agains… If the Space Force had this logo, were global rather than national, and were loosely styled off of the equivalent organization in Dark Forest, I might support it. https://t.co/U1l1tLkTbE RT @jordannovet: small update today in Facebook's AI suicide prevention effort: 'as soon as our technology has identified that someone has… RT @SamanthaJPower: Pres. Obama mandated these reports to give Americans a better sense of the scope & impact of counter-terror operations.… "RT @ylecun: Smashing the accuracy record on ImageNet by pre-training to predict hashtags on 3.5 billion images. Brought to you by Facebook…" "RT @cnancyxu: so @gradientpub launched today 🎉 Weekly publications on cutting-edge topics in #AI by academic and industry researchers. Wou…" RT @ava: Heroes. https://t.co/JTQAyF82ob "RT @ylecun: Big list of open source projects from Facebook AI, some of which were released today. https://t.co/eNWKhVsm2H https://t.co/eNW…" @kentbye @OpenAI Thx, will check out later! Was gonna say, I think some of my work is useful but not for that (bias mitigation) purpose :) RT @ChrisCundy: I am a big fan of Koray Kavukcuoglu's presentation about @DeepMindAI's research: both for the phenomenal deep learning carr… RT @erikbryn: It was great to be able to give a talk at #ICLR2018 and even better to be able to learn about recent the progress in machine… @kentbye @OpenAI Say more? @zacharylipton Anything new in the talk? RT @AP: BREAKING: Black men arrested at Starbucks settle with Philadelphia for $1 each and a city pledge of $200K for young entrepreneurs. @mizroba @ToKTeacher @DavidDeutschOxf @philipcball @erikbryn @ESYudkowsky Three Body Problem! RT @signalapp: Amazon threatens to suspend Signal's AWS account over censorship circumvention: https://t.co/8llgFKoCGY RT @WiMLworkshop: Attending ICML 2018? Childcare is available this year! Sign up before 6/10. https://t.co/QBnLtbe841 @icmlconf @Inclusion… RT @fspielman: ACLU sounds the alarm about bill allowing use of drones to monitor protesters https://t.co/WC3YnsNwxn via @suntimes "Decoupling Dynamics and Reward for Transfer Learning," Zhang and Satija et al.: https://t.co/Jnt6SyFn6Q "Formal Security Analysis of Neural Networks using Symbolic Intervals," Wang et al.: https://t.co/CSX3pOTFlD RT @abigail_e_see: I recently chatted to @speevr and answered some introductory questions about #AI, #NLP, and what #DeepLearning can and c… RT @y0b1byte: My notes on "Hindsight Experience Replay" (https://t.co/9CcFrEuF9a) by Marcin Andrychowicz, @machinaut @jonasschneider @npew… Interview with @dhadfieldmenell on inverse reinforcement learning and inferring human preferences: https://t.co/Yzqod8GmPe """Adversarially Robust Generalization Requires More Data,"" Schmidt et al.: https://t.co/YXYp4w1oA1 Not surprising but good to see it worked out in detail." Word on the street is that S2E2 of Westworld is 🔥 RT @mark_riedl: White House Considers Restricting Chinese Researchers Over Espionage Fears https://t.co/tajqQP225a << may affect Chinese st… RT @WonderMicky: Do I know anybody at @instagram? We need help ASAP recovering our outreach account for the @ATLASexperiment at @CERN which… RT @jjding99: Each week's #ChinAI newsletter will contain interesting updates on China's AI development like the one highlighted below. Sta… RT @washingtonpost: UPDATE: Double suicide bombing in Kabul kills dozens, including at least 7 journalists rushing to the scene after the f… RT @jackclarkSF: Current top entry on the @OpenAI Retro Contest Leaderboard has learned to glitch through a test level. Devious RL! https:/… RT @pixelatedboat: I fixed that New Yorker review of Infinity War, now everyone can be happy: https://t.co/u6DlVmHmWE RT @AnimaAnandkumar: @zacharylipton Come to our poster on "Deep Active Learning for Named Entity Recognition" on Monday at 4:30 at #ICLR201… "Network Transplanting," Zhang et al.: https://t.co/8giygjfTng "Weaver: Deep Co-Encoding of Questions and Documents for Machine Reading," Raison et al.: https://t.co/a0ZHDHWJDy There's stuff after the credits btw @zacharylipton not sure if intuition was used in an AlphaGo paper, but def. in discussions of it @zacharylipton generative models = imagination, neural net-guided tree search = intuition... FWIW I don't think all such things are unjustified (one can use such terms while also saying that the genuine article is overrated). Also not new to DL, see e.g. Ekbia's book Artificial Dreams https://t.co/VG2vbzG4mN @RealAshEdwards Are you there? If not, you could participate in this :) If you're there, enjoy!! https://t.co/qQhB3U2sWT @mark_riedl Interested. It will be livestreamed, though, at least (h/t @ylecun): https://t.co/c7QNBF668u Apparently I'm the only one not at ICLR. Have fun, everyone! Maybe next year. https://t.co/3lT8w2DLbZ Great post on differential privacy in general and PATE in particular by @NicolasPapernot and @goodfellow_ian. The other posts on Clever Hans are great too! https://t.co/fkptt1ad6J RT @NicolasPapernot: Privacy and ML: two unexpected allies? Read our new #CleverHans blog post with @goodfellow_ian on how ML researchers c… RT @math_rachel: my new blog post: An Introduction to Deep Learning for Tabular Data https://t.co/OrYS1bUAmk RT @Peston: Amber Rudd has resigned RT @AlexisCoe: If you think last night was harsh, you’re going to hate what historians will have to say about Sarah Huckabee Sanders. RT @EBKania: Sinovation Ventures has announced a new $900 million investment fund focused on opportunities in AI, from robotics to educatio… @kennethpayne01 nice, will check those out too! RT @vexmark: A classic good news/bad news situation https://t.co/d7YjZbcUBs @hardmaru Brainintendo collaboration in Japan? :) If they think severing ties will stop China from progressing, then they're not self-contradictory, but still wrong :) Also seems like a lot of ppl warning about China's rise in AI don't see the obvious drawback in severing ties with those they claim will surpass us. If trends continue, it won't be long before the knowledge flow is much more symmetrical, and we'll wish we had stronger ties. (I'm oversimplifying, of course, and lumping exec. and legislative branches together, but think that there's a kernel of truth here) It looks increasingly like the US gov't is incapable of doing the obvious right things for AI competitiveness (like fixing immigration BS and investing in civilian R+D), and knows it, so resorts to counterproductive-but-doing-something stuff like this. Is there IP theft, covert Chinese gov't involvement, etc. involved in AI-related collaborations? Sure, but on net, US-China relations should be increased, not decreased, even if there are some costs. This sounds extremely shortsighted (to put it nicely). https://t.co/Eg77OlbjeU @timhwang I heard someone say both of these in one comment the other day. ~"I want to push back on on that - I totally disagree." What is the committee's view on this? RT @leedrutman: I think @LilyMasonPhD's new book, Uncivil Agreement: How Politics Became Our Identity, will be one of the most important bo… @erfannoury Indeed - there’s a chapter on that but obviously not super detailed for length reasons. That book looks good - thx! BTW, Wheeler mentions another book that came out around the same time. He describes it as complementary but he might just not want to admit they're redundant, not sure yet. Anyway, this is it: https://t.co/wjKXPpVir1 @zacharylipton @bgreene reminds me of Daniel Dennett's joke that "clearly" is always used before indefensible claims @AdrianBPatter oh like blockchain stuff? think I get it now :) Examples: USA/USSR in late 80s, India-Pakistan, US-Iran... also some useful (for me) critical overviews of costly signaling theory and various other stuff. Recommended for IR folks into these topics. Enjoying "Trusting Enemies" by Wheeler - TL;DR: international relations theory doesn't pay enough attention to face-to-face interactions btwn leaders. Signals of peaceful intent, even costly/true ones, are not interpreted as intended w/o prior trust-building through interaction. @AdrianBPatter what do you mean? RT @RealAshEdwards: The deadline for our ICML/IJCAI/AAMAS workshop on Goal Specifications for RL has been extended to May 15th. https://t.c… This one’s gonna be 👌 https://t.co/Vu5w0eNpdm Domestic flights are so nice - no customs, short. 👍 @AnthroPunk Wasn’t disputing that @AnthroPunk I wish it were that simple! :) Alas, lots of stuff could be plausibly characterized as quantitative but as-yet unsolved (exploration in reinforcement learning, one-shot learning, etc.) There are so. many. such. claims. It'd be fun to do a meta-analysis of claims to the effect of "X is easy for AI; Y is hard" in papers, books, journalism, movies, etc. Off to Seattle for a few days ✈️ RT @tdietterich: Several machine learning researchers have signed a statement regarding the upcoming launch of Nature Machine Intelligence.… RT @barryfriedman1: @M_Feeney @Miles_Brundage @axon_us One of the really interesting questions is whether vendors can find a way to ensure… RT @barryfriedman1: This short thread and @M_Feeney piece worth reading. Feeney singing my song of course, as @Miles_Brundage points out. P… RT @jgcarpenter: A quote from me in The Guardian a couple days go regarding mental health chatbots, and what they can and can't do to help.… "RT @CuteEmergency: Whatcha dreaming about, Hud? 😂💤 📹: hudthegolden https://t.co/zrjgTp4d93" (There are of course some relevant policies but typically at local/state scales, not on fine-grained AI issues, not in most countries, and even where policies exist they aren’t nec. democratically chosen) Given that IRL there *is* a deficit of such debate/policymaking, it's incumbent upon those involved to at least try to simulate it in microcosm (e.g. through representation on the board) but not a panacea. See also: "Unwarranted: Policing Without Permission" by @barryfriedman1. Don't agree with all of this but it raises some good points (and indeed some, like selling to orgs with bad policies, were discussed at the 1st meeting). As I mentioned before, corporate ethics is not a substitute for democratic debate and policymaking. https://t.co/nKfXogM26D RT @ArmsControlWonk: This is the kind of thing that scares me. The White House’s expectations are way too high. https://t.co/oBs7S1dh5u RT @cholodovskis: Gerry Tesauro and I wrote a brief blog post summarizing the work I developed as an intern at @IBMResearch. It will be pre… Jet lag is catching up to me https://t.co/z4V94m1okN RT @nighatdad: Hi @sundarpichai I run @DigitalRightsPK a civil society org based in Pakistan. We wrote this letter to you asking Google to… RT @ImogenParker: Great example of the problems in AI cited by Patricia Christias @Microsoft: Facial recognition software had <1% error rat… RT @dog_rates: This is Oakley. He picked you some flowers. Hopes they’re your favorite color. If not, he can try again. 14/10 they’re perfe… @HrSaghir @UofT @chautom @AzadehKushki congrats! RT @OpenAI: OpenAI will be at ICLR2018, please check out our contributions (including winner of the best paper award) if you'll be there: @cfarivar @harlanyu @axon_us (Obviously these are all just my own thoughts, not nec. those of other members - I’m glad yall are raising these Qs and trying to answer open Qs I know the A to where I see them) @cfarivar @harlanyu @axon_us Suspect much of $ will be donated, and can compensate for time/$ spent. Personally I’ve invested a lot of time and $ already reading up on related issues. DeepMind’s health board, for example, only added $ after complaints from board that volunteer basis didn’t allow serious work @cfarivar @harlanyu @axon_us Closed press meetings allow candid/proprietary discussions, though doesn’t mean there shouldn’t also be public events, + public info on exact role of board, principles etc. Will be pushing for such things. Independence concern is fair, though IMO $ not nec. opposed to that. E.g.: RT @hypatiadotca: Hey friends! Another reminder that the ACLU is hiring a tech fellow! Come work on tech+policy: protecting our right to en… @cfarivar @harlanyu @axon_us I’m also not sure if NDAs were “required” per se - I signed as I do with many other companies, to allow discussion of proprietary things, but suspect that a member could have negotiated leaving the room at certain times if they wanted (I didn’t try). @cfarivar @harlanyu @axon_us The NDAs are specifically for discussion of proprietary info and do not prohibit discussion of the board’s work. RT @TessaThompson_x: You can watch #DirtyComputer now . 🤖 what a dream to get 2 make art with such brilliant dirties. https://t.co/3cbOHa5b… RT @ilangoldenberg: 1. So what actually happens if Trump doesn’t waive sanctions on May 12 and walks away? I have no idea. Nobody does. B… RT @ylecun: ICLR talks will be streamed on Facebook Live. https://t.co/biDISPMXaz RT @rbhar90: Check out the first public introduction to @ComputableLabs! We're working on the next generation of internet infrastructure by… @chrisalbon It’s a bowl. What’s wrong with guac and cheese on top? See also: https://t.co/H5gGiE8flA @chrisalbon This is the US. In the UK, it’s similar ingredients, just worse, and especially bad rice and chips. (Technically there is Chipotle in the UK but it’s inferior to 🇺🇸) 😍 https://t.co/ucEZbM9Ip5 RT @DeepMindAI: Details of all our #ICLR2018 papers in one place -https://t.co/dn8v7b4MQC https://t.co/grT5wlfXiy 😵 https://t.co/uODSafREC4 RT @berkeley_ai: Should you plan ahead or learn by trial and error? Read @Vitchyr's BAIR blog post to see how temporal difference models (T… RT @BBCWorld: The handshake that made history. https://t.co/JB09Ce9mHt @BanKillerRobots Not as far as I know. Will have something to say on some of those themes eventually. "PANDA: Facilitating Usable AI Development," Gao et al.: https://t.co/jtmFfeM4qb "The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation," Chen, Firat, and Bapna et al.: https://t.co/qAZOn855qE RT @Miles_Brundage: We just wrapped up the first meeting of Axon's AI Ethics Board (see e.g. here for coverage: https://t.co/6Zk8L5bhO5 and… "Multiagent Soft Q-Learning," Wei et al.: https://t.co/Wqqeq9T9rS "Action Categorization for Computationally Improved Task Learning and Planning," Nair and Chernova: https://t.co/063keGjnTA Book review part 2: I finished it on the flight over here and it (Gnomon) is really quite good. RT @hardmaru: Excited about expanding the Google Brain team in Tokyo. If you are excited to work on fresh and interesting AI research, plea… @tetisheri congrats! @hardmaru thanks! RT @ilyasut: a talk on some of our recent work: https://t.co/eIolmGxA5i @samim indeed! @samim a lot of it is not on Axon but on police chiefs, local/state/national gov'ts, etc. to set appropriate policies for when cameras should/should not be on, and there are a wide variety of such policies. From the view of one set of policies, others are abusive. It's complicated. @samim They do regular third party penetration tests and take various other measures to avoid breaches or unauthorized tampering of data - also audit trails etc. So I think that they are generally doing a good job from that info sec perspective --but re: the broader Q of body cam abuse, P.S. Unfortunately, no, I did not get Tased, though I wanted to (ran out of time). Hopefully next mtg! Feel it's necessary to get a (painful) feel for one of their products... Overall, again, good first meeting and I'm glad something like this is happening/humbled to be involved. There will eventually be official reports from the board, I'll prob. say more stuff on related topics, etc. but these are just some personal comments. And certainly the role of the board will not just be to rubberstamp such a thing. As previously noted, the board was not just about face rec. (I'm mentioning it b/c it was highlighted in the letter and news coverage). E.g. Axon does AI for other things like paperwork automation. Re: face recognition - again, a range of views on the board, and in society more generally. I think it's good that Axon is fostering a proactive exploration of these issues before developing any related product, if it ever does. Notably, other companies are just doing it. The representational issue is tricky since it's a company that operates in 100+ countries, but still, progress could be made. And a representative board is no substitute for broader democratic discussion/legislation of the proper role of policing in society/tech in policing, etc. I thought it was a good first meeting, though the issues involved are not going to be resolved in a day. Lots of perspectives represented/expressed, though cf. the letter's point re: affected communities' representation, which is def. an area for possible improvement. *These are my thoughts, not necessarily those of other board members or of Axon the company, of course.* We just wrapped up the first meeting of Axon's AI Ethics Board (see e.g. here for coverage: https://t.co/6Zk8L5bhO5 and additional info and Axon's POV here: https://t.co/KoNJ0Xa7Zz). Here are some miscellaneous thoughts (thread). RT @drewharwell: CEO of Axon, maker of Tasers and police body cams, on face recognition: "We don’t want to create an Orwellian state just t… RT @demishassabis: Great to see government and industry coming together to strengthen the UK’s position as one of the leaders in ethical AI… The board isn't just about face recognition so headline a bit misleading, but otherwise good points discussed here: https://t.co/HHrKnjbkwi RT @verge: Axon launches AI ethics board to study the dangers of facial recognition https://t.co/wIhhB4y056 https://t.co/3JEzoIS1i9 Humbled to be involved in this effort. See also this letter organized by various civil rights and privacy orgs on the stakes involved. https://t.co/SrjA3UEmLh https://t.co/lG8pdMvEPf RT @axon_us: Axon launches first of its kind AI Ethics Board for Public Safety. “We believe AI research and technology for use in law enfor… RT @JeffDean: You have questions? QANet, a new stacked architecture designed to do well on question answering tasks, has answers. https://… "Generative Temporal Models with Spatial Memory for Partially Observed Environments," Fraccaro et al.: https://t.co/y8vcc3Tos3 @agent_cooper i’m an American so no apologies needed ;) Heading to 🇺🇸✈️ RT @mattsheehan88: Wow https://t.co/FHY3FXx3fX RT @ycombinator: A.I. Policy and Public Perception - @Miles_Brundage and @timhwang https://t.co/9uvkSat8mN Tim @timhwang and I said some stuff for a podcast with @ycombinator a few months back. Apparently we lol'ed. https://t.co/dFVmUriqU8 RT @judywawira: Always worry when I don’t see a single physician from the underserved countries that #ArtificialIntelligence will improve a… "SimpleQuestions Nearly Solved: A New Upperbound and Baseline Approach," Petrochuk and Zettlemoyer: https://t.co/fNHqLBQAIi Interesting - "Estimate and Replace: A Novel Approach to Integrating Deep Neural Networks with Existing Applications," Hadash et al.: https://t.co/OIGRayVhaZ "No Metrics Are Perfect: Adversarial Reward Learning for Visual Storytelling," Wang et al.: https://t.co/Qv2AJSGvTr "Multi-objective Architecture Search for CNNs," Elsken et al.: https://t.co/b3wyYgXG5F RT @colinraffel: New work on arxiv with @avitaloliver @gstsdn @ekindogus @goodfellow_ian on realistically evaluating deep semi-supervised l… In general, online videos are underrated IMO. Overrated as a replacement for all of the education system, perhaps, but underrated for lifelong learning/brushing up on various things/nerdy entertainment. Nice MOOC on applied cryptography: https://t.co/1KnMnVdRDT Pretty stoked for some serious airplane reading tomorrow. (which I realize people say during every election, but cf. Trump) Dr. Ross is a great candidate for Congress with serious expertise in healthcare and other issues she's campaigning on. Also, reminder that 2018 is a super important year politically! https://t.co/Mq8MLK7zGx RT @HeatherforAZ: We need your help to defend against the dangerous, inflammatory attacks from the right against Democrats and our campaign… RT @nakashimae: Senate confirms Paul Nakasone to lead the NSA, U.S. Cyber Command https://t.co/EvdTE07Ozl RT @dawnsongtweets: Submit your paper to Neural Abstract Machines & Program Induction workshop @icmlconf/@IJCAI_ECAI_18, deadline June 1, 2… RT @brhodes: The Iran Deal imposes strict, verified limitations on Iran's centrifuges and stockpile to prevent them from obtaining a nuclea… RT @HeidyKhlaaf: C++ folks, a dear friend is looking for someone to help teach an MSc level course "C++ for Finance" in Birmingham. It is 3… RT @Miles_Brundage: "Taskonomy: Disentangling Task Transfer Learning," Zamir et al.: https://t.co/UHEL6R14Lu RT @timnitGebru: We need many more women applying to be TAs at Addis Coder this summer: https://t.co/jRN10swJNs 50% of our students will be… RT @charlotte_stix: Interested in national AI strategies and ecosystems of various EU countries? Have a peek at my report: https://t.co/1kr… RT @chipro: You know you work in AI when you try to help your friend with their immigration problem and autocorrect keeps suggesting that t… @fhuszar Agreed: see also this thread and @GoAbiAryan’s thread https://t.co/FWAiQKYAYn RT @abursuc: ICYMI @markus_with_k did a marvellous survey on current research on machine learning and structure for mobile robots along wit… RT @graphcoreai: With new hardware specifically designed for machine intelligence, like Graphcore’s IPU, it’s time to rethink received wisd… RT @mark_riedl: #iclr2018 paper acceptance stats. @salesforce Research (@MetaMindIO) holds the #2 and #3 spots for authors with most accept… @halhod @liu_cixin Read the trilogy and Wandering Earth. Also dabbled a bit in Google Translated stuff. Looking forward to a proper translation of Ball Lightning. @halhod @liu_cixin So good RT @Ali_Wyne: Excited that the @RANDCorporation is launching its Security 2040 initiative today with the publication of Ed Geist and @Andre… RT @jennwvaughan: Ok, machine learning people, what are the topics you would be most excited to see covered in a #nips2018 tutorial? RT @paul_scharre: It's out! Army of None: Autonomous Weapons and the Future of War https://t.co/zADIFqitAc 🤔Not sure how I feel about this. Big fan of Utopia. https://t.co/2J4zJHYd2s The book Gnomon is quite something. Hard to describe, and very long, but worth checking out if you dig sci-fi, especially stuff related to surveillance and AI. (book review part 1 - still another 400 pages to go!) h/t @williamstome @StephanZheng @yuqirose congrats! "Towards Symbolic Reinforcement Learning with Common Sense," Garcez et al.: https://t.co/2VMH1dG5z6 "A neural interlingua for multilingual machine translation," Lu et al.: https://t.co/MD59h6mnAM "To Create What You Tell: Generating Videos from Captions," Pan et al.: https://t.co/pIzPVtUvL0 "Taskonomy: Disentangling Task Transfer Learning," Zamir et al.: https://t.co/UHEL6R14Lu "Inter-Annotator Agreement Networks," Karl Stratos: https://t.co/wG8PX4CuF2 "What's Going On in Neural Constituency Parsers? An Analysis," Gaddy et al.: https://t.co/9w8pQ4RZfy "Subgoal Discovery for Hierarchical Dialogue Policy Learning," Tang et al.: https://t.co/ljx1gY7LSE "Unsupervised Natural Language Generation with Denoising Autoencoders," Freitag and Roy: https://t.co/IpN0wO9LwN """Efficient Large-Scale Domain Classification with Personalized Attention,"" Kim et al., Amazon Alexa: https://t.co/Yv4sfdbRdz ""A Scalable Neural Shortlisting-Reranking Approach for Large-Scale Domain Classification in Natural Language Understanding,"" Ibid: https://t.co/3GdQ7WHL5N" """Learning from the experts: From expert systems to machine learned diagnosis models,"" Ravuri et al.: https://t.co/TDIr6V7t4S ""using expert systems as generative models that create simulated data on which models can be learned""" RT @ctnzr: This code is astonishingly fast. 320 DeepVoice voices in real time on a V100 GPU, and handles bigger models as well. Super usefu… RT @awjuliani: Been experimenting with PPO+Curiosity on a more sparse-rewarding environment. Agent has to learn to press the button to spaw… RT @dpkingma: Smiles from a non-autoregressive likelihood-based generative model :-) https://t.co/K7fKp95sXQ Nice talk by Marta Garnelo - "Symbolic representation learning": https://t.co/q5Tq21neGF @chrisalbon congrats! @AthertonKD not in the area permanently but in town this week I believe: @RebeccaCrootof @GaryMarcus @robmccargow @GoAbiAryan or sustainability, or (insert anything other than just creating jobs here) @GaryMarcus @robmccargow @GoAbiAryan Even if it weren't going to be global, there was (is?) an opportunity there for it to be medicine-focused, with some European flavor (e.g. focus on neglected diseases, or aging, throw in some unbridled capitalism bashing :) ) @robmccargow @GoAbiAryan @GaryMarcus (if that is indeed the origin of the idea [no offense to Gary!] as I have heard similar ideas like this for a while before that, if not explicitly referencing CERN. In any case he def. helped popularized it) @robmccargow @GoAbiAryan @GaryMarcus pretty much, though I think Gary also wanted something more global than this (so doubly removed from the original idea). ("have economic impact and create jobs in Europe" isn't super inspiring/distinctively European) And yes, I get the "if you're not at the table, you're on the menu" theory of influence - need to be competitive in AI to influence its direction. Regardless of whether that's true, would be good to hear how European values fit into this, e.g. choice of problems/applications. That’s not to say I think ELLIS is a bad idea, just that it could be iterated in a direction more oriented towards European values/goals, not just competition. Otherwise why should Europe be in the “race”? https://t.co/de4zBGfUgL Was just going to say something like this about ELLIS but @GoAbiAryan beat me to it. If you want to attract/retain people, and not just make competition fiercer, you need an inspirational goal. https://t.co/de4zBGfUgL @ArtirKel Is that a thing? "RT @lawrennd: Call for European lab in AI. https://t.co/COJIyPtIuV" RT @MPI_IS: Europe´s leading #AI and #MachineLearning researchers want to form a European AI hub to compete with the US and China. In an op… RT @shakir_za: It was a great fun to speak at the DALI 2018 symposium. Over the years I have come to describe my research as 'Searching for… RT @kenneth0stanley: You don't need a corporate-sized warehouse of servers to run deep neuroevolution! For what formerly took an hour with… (China to Portugal, not Spain) @cwillmore @sigfpe Indeed And the longest sailable straight line is ~3x longer. https://t.co/mpWBgrAFDZ RT @jwangARK: Thanks for the feedback! Table updated to include Alibaba, AImotive, Lightmatter. 22 names in total. I left out companies tha… "RT @iamtrask: If you're looking for the right introduction to Neural Networks and Language - this blogpost by @explosion_ai is it. https:…" RT @_rockt: The workshop with the coolest webpage is back -- NAMPIv2. Consider submitting a paper until June 1st! https://t.co/HVo3JWHucY @ak1010 @bleyddyn posted: https://t.co/ceCXLZieda @ak1010 @bleyddyn Good idea! (and I should clarify that while this the first non-me contribution to the Google Doc, others also contributed helpful comments and questions in the original thread! Thanks to all!) Update: this is a thing, it's called Operation Get to the POInt, and we have our first non-me contributor (thanks @bleyddyn!!). Here's the Google Doc if you want to contribute - spoiler alert! https://t.co/S09fmVtFG8 https://t.co/JvpPUwHz59 @fchollet I think this (good!) point was formalized here -unfortunately never got around to reading it: https://t.co/bn6PySpBr3 "RT @iamtrask: A website dedicated to helping people find the dream job!!!... remote work in Machine Learning!! Great job @dqmonn https://…" RT @mchorowitz: How will military applications of #AI work - or not? Check out my new piece in @BulletinAtomic https://t.co/yLQzrsYYD5 RT @LiSchlegel: I interviewed the amazing @RikeFranke on the use of #drones by non-state actors for @risk_insights. You can check it out he… RT @dennybritz: This new NLU multitask benchmark looks great. The associated paper is now up on arXiv too: https://t.co/uAZL7VUWv5 https://… "Revisiting Small Batch Training for Deep Neural Networks," Masters and Luschi: https://t.co/2y2awjQg1p "Phrase-Based & Neural Unsupervised Machine Translation," Lample et al.: https://t.co/UAAqioA72Y @FutureBuckNasty @jackclarkSF @WIRED David Hanson, not Robin Hanson, FYI RT @hardmaru: "A continually increasing supply of STEM graduates from developing and post-communist-bloc countries, and it’s hard to imagin… RT @Miles_Brundage: It's Socratic Sunday! Here is an imagined dialogue btwn supporters/opponents of Google working on Project Maven and mor… RT @astro_pyotr: Another important discussion in RL to go along with reproducibility is overfitting. New work, "A Study on Overfitting in D… @timhwang As in, Jiraphics Park? RT @rao2z: ML-Ready Sanskrit: https://t.co/SaJ4Jp97ng RT @rao2z: According to this helpful brochure at the Taipei Confucius Temple, the children of Zhou Dynasty were already doing LDA/Complex L… RT @soundbitelife: Dear policy colleagues, it looks like the Congressional Research Service @librarycongress is hiring policy analysts for:… RT @jackiefloyd: Wondering if this is a thing unique to women in STEM: Told I need to establish "credibility." So I write down equations fo… RT @juliaioffe: Drain the swamp. https://t.co/zQm3oNLQ9V https://t.co/KC6hxCKZFh @fchollet My quote in the high school yearbook was (I think) "A problem well-stated is a problem half-solved.” - Charles Kettering @timnitGebru @histoftech @maria_axente @fredwerner73 @jonniepenn @robmccargow @ITU @Scholl_ITU @maikkisi @salome_viljoen_ @CjColclough @kathytpham @jovialjoy @marylgray @LatanyaSweeney @j2bryson @vdignum @kathrynmyronuk @drkatedevlin @JennyKorn @chels_bar also many men of dubious qualifications... @Plinz but yes, this is not an exhaustive dialogue. @Plinz Got to that a bit at the end. Fin. h/t @calebwatney for the Socratic dialogue idea "Jane: Agreed. And also, the person who imagined us is getting bored and I think the people reading our debate get the point that it's a complicated situation. Jill: Agreed." Jill: Fair point, though I'd think that they'd be public about it if they could actually defend it against serious scrutiny. In any case, we may be reaching diminishing returns on what we can say without knowledge of the actual agreement. Jane: That all seems reasonable, but how do you know that's not what's happening already? Google said the Maven stuff is for "non-offensive" purposes anyway. And the details of the agreement are secret. Jill (cont'd): If they're going to work with DOD, it should be on clear, defensible terms that help the world, not just the US. For example, it could only help with cyber defense, not offense, as a coalition of other companies recently suggested. Jill: Either Google is just another company at the whims of world events, or it's a serious stakeholder with some influence over how global affairs play out - with some of those possibilities being more peaceful than others. You can't have it both ways. Jane (cont'd): In a world of resurgent great power conflict and trade wars, Google needs to consider the alternative: not US pacifism but the US being outmatched in future prospective conflicts by countries that work more closely with their technical talent. Jane: As we both agree, there is no option of total neutrality. ISIS and others will continue to use Google tools, as will the US. And let's not forget that ISIS isn't the only subject here... Jill (cont'd): Google may be based in the US but has offices and customers globally. It should not be picking sides. Jill: I'm not so sure. Aren't they just applying Tensorflow and off the shelf CV techniques? Maybe if Google were more open about all this, we'd be in a better position to say. I also want to push back a bit on your America-centric perspective. Jane (cont'd): The wisdom of US policy (or lack thereof) doesn't mean there aren't threats to soldiers and citizens which we can help with. And Google has talent that other prospective contractors don't, as well as a responsibility to a country that has done much for its success. Jane: Let's agree to disagree on that. In any case, this whole reputation issue is just a matter of Google's self-interest, whereas what we should really be talking about is the ethics of it. Jill: It's hard to quantify the reputational risk issue, but I suspect it's serious. Scientists/engineers in general and AI researchers in particular are in a sellers' labor market and don't have to stay at Google indefinitely. They can get free food and GPUs elsewhere. Jane (cont'd): Even re: liberals, I have yet to hear of any mass exodus from Google, and doubt one is forthcoming because of one project. Jane: The reputational risks aren't as clear cut as you let on. Remember that 40% of Americans still support Trump. Google also needs to keep in minds this broader landscape of opinion, including its customers, not just those of liberal elites in the Bay Area. Jill (cont'd): Google can and should be discerning about its contracts, and runs serious reputational risks. Jill: The fact that ISIS is not just bad but very bad does not mean that Google specifically should be involved (there are other potential defense contractors) or that the current US security posture in the Middle East is productive and not counterproductive. Jane (cont'd): Tackling this threat is a serious challenge and Google has unique skills that can aid in the effort, such as deploying image recognition technology. Jane: We agree that ISIS is bad, it seems, but I think you're downplaying the severity of the issue and Google's need to assist. ISIS has been linked to many attacks on US soil, with the Pulse nightclub attack alone claiming 49 lives.... Jill (cont'd): In the case of Maven, while ISIS is indeed bad, there is no evidence that this "non-offensive purposes" language means anything, or that Google's expertise is being used ethically. Google should have clear, public principles before doing any such things. Jill: While I agree that Google is necessarily involved in matters of security, including that of the US in particular, that doesn't mean that Google should support all possible missions DOD pursues... Jane (cont'd): They have a responsibility as an American company benefiting from American protections + gov't R+D to help explicitly w/ American security threats. Jane: Google is involved in matters of security whether they explicitly pursue contracts or not. Examples include YouTube-hosted war videos and widespread use of Google tools like search/Maps/Earth.... (cont'd) It's Socratic Sunday! Here is an imagined dialogue btwn supporters/opponents of Google working on Project Maven and more generally pursuing DOD contracts, since the quality of this debate IRL is very low. Jane "Hawk" Jeffers supports GOOG/PM/DOD, Jill "Dove" Johnson doesn't. RT @TheAVClub: R.I.P. Austin Powers star Verne Troyer https://t.co/BG2VOwJnhD https://t.co/Y6pVPJDrY6 RT @AthertonKD: With even the low-end counter-drone jammer rifles costing in the $10,000s, though, expect to see more bullets fired in pani… RT @mikarv: Check out the videos from the @turinginst GDPR and Beyond event. Featuring talks by among others @ICOnews Elizabeth Denham, @mi… @maosbot could you say more? So many layers of this tweet’s illegality onion https://t.co/KZu4V20Ug9 RT @DavidM2000AD: Grand Lisboa Hotel viewed from the alleys of Macao https://t.co/AKptMNEANY RT @KarinaVold: Excited to announce that registration for the Varieties of Mind Conference hosted by @LeverhulmeCFI and @Cambridge_Uni is o… @pfau why? my spelling was arbitrary but you seem to have a more principled approach... @iandanforth @netflix I still get a lot of value out of it. @iandanforth @netflix lose all their content? RT @yonatanzunger: I am routinely stunned by the moral depravity which pervades ICE. This policy requires individual agents to deliberately… @roboticwrestler try to go to Japadog :) (if you eat meat, at least) RT @m_clem: Spotted in Silicon Valley by @PaulFNiehaus https://t.co/FBfizJtLHy RT @goodfellow_ian: Blog post about Google talks by @elie and me about ML and security at @RSAConference yesterday: https://t.co/MWaoGVY0qV Enjoyed "The Architecture of Privacy: On Engineering Technologies that Can Deliver Trustworthy Safeguards" by Bowman et al. - nice not-too-technical introduction to the design space of access control, auditing, etc. https://t.co/TS1lcgAH5l RT @maidylm: Go checkout the @ASUEngineering @ASU #FURI symposium where my awesome mentee @300Aditya is presenting!! @asu https://t.co/vrk7… RT @washingtonpost: Do not eat any kind of romaine lettuce, CDC warns https://t.co/XoKCzZLmu3 "Fun fact: due to the difference in how dates are written in the UK vs. the US, 4/20 is celebrated in the UK on Frecember* 4th. *the 20th month" RT @jwangARK: Updated this table to include Facebook. There are now 19+ companies designing custom chips for deep learning acceleration. ht… RT @dawnsongtweets: Security will be one of the biggest challenges in deploying AI https://t.co/zRu6qOrciC RT @NicolasPapernot: Following the success of last year's NIPS adversarial competition, a new competition is being organized on adversarial… RT @Deorro: Cant believe we lost one of the greatest music influencers of our time. Way too young to leave. Thank you for everything @Avici… RT @robinhanson: I review new book Prediction Machines. I endorse its framing of new tech, & its qualitative predictions re directions of c… RT @EBKania: Alibaba's DAMO Academy is building a chip called Ali-NPU (neural processing unit), designed to handle AI tasks like image and… @irinimalliaraki @jackclarkSF @mark_riedl Mostly the last part (compute/data, + smart colleagues to work with, so there's a "rich get richer" phenomenon of top teams). $ doesn't hurt/can make some difference in choices, esp. for those with families, choosing btwn good options etc. but most I know don't optimize for that @mark_riedl Maybe in a few years https://t.co/mwRKipiHk1 RT @peterwsinger: But if Starbucks shuts down for the day, where will all the awkward "informational interviews" be held? RT @ruskin147: Special guest is @AkshatRathi on this week’s @BBCTechTent - the show also features @zsk @DameWendyDBE @poppycrum and @Miles_… @mark_riedl why do AI research when you can do AI policy research for an order of magnitude+ less RT @Comey: My book is about ethical leadership & draws on stories from my life & lessons I learned from others. 3 presidents are in my book… RT @nnaisense: We have just published a research report on learning stable & powerful deep neural networks by utilizing insights from contr… @aprilaser I didn't get "All of these groups maintain complete independence from their donors." Seems to go against the beginning of the para (/the recent New America kerfuffle)? RT @BrundageBot: Learning to Extract Coherent Summary via Deep Reinforcement Learning. Yuxiang Wu and Baotian Hu https://t.co/Mw2xjHRdbB "GNAS: A Greedy Neural Architecture Search Method for Multi-Attribute Learning," Huang et al.: https://t.co/zTLlgpHekW "Gender Bias in Coreference Resolution: Evaluation and Debiasing Methods," Zhao et al.: https://t.co/Egk9JfPRQS "NAIS-Net: Stable Deep Networks from Non-Autonomous Differential Equations," Ciccone and Gallieri et al.: https://t.co/W1HfODfT6Q "Low Rank Structure of Learned Representations," Sanyal et al.: https://t.co/jeLO1kYF2W "Semantic Adversarial Deep Learning," Dreossi et al.: https://t.co/7sqlhyuS1K "Modeling and Simultaneously Removing Bias via Adversarial Neural Networks," Moore et al.: https://t.co/BL8i8B0QGe "A Study on Overfitting in Deep Reinforcement Learning," Zhang et al.: https://t.co/4cBEWkT7Ry RT @JeffDean: We just posted a couple of new DAWNBench ImageNet training results on TPUs, including our first result that uses more than on… RT @shimon8282: Oxford is hiring in machine learning! https://t.co/hrirmohfnX 🤔🍿https://t.co/hY2tMda5h5 RT @ai4allorg: FAT/ML 2018 is seeking papers about fairness, accountability, and transparency in machine learning. Learn more about require… RT @RebeccaCrootof: The deescalatory, Goldilocks solution for the harmful cyberoperations that aren't cyberwarfare and aren't cybercrimes.… RT @jeremyphoward: Why yes, we did just train CIFAR10 ~2000% faster than the previous best on DAWNBench, using fastai and @pytorch. :) Blog… @IntuitMachine per the article and the links there, not really. RT @Zergylord: Yes, he has the same name as the basketball player. Put that aside and focus on what matters: this is a very thoughtful arti… RT @tdietterich: Important essay by Michael Jordan: “Artificial Intelligence — The Revolution Hasn’t Happened Yet” by Michael Jordan https:… "RT @benbarry: Talented web developers, please come help me create awesome things at @OpenAI. https://t.co/VL3bdGZsUn" @Schwartzesque (serious Q, I don't know) @Schwartzesque Yeah, but am I wrong that it sounds ominous to non-expert Western audiences? Someone mentioned that it's used in the context of church sometimes, too, but I have a strong terrorist association with it. Looks good - https://t.co/zrPevWT4iG Following up on this: I'm told it is a legit term in the context of the CCP, so not faulting the author. Still, don't think any meaning would have been lost by saying branch, and I could see cell causing more of an alarmed reaction by some readers FWIW. @dude313123123 thanks! That's fair, though I at least didn't know that, and suspect I'm not the only reader who perceived that headline as more threatening than if they'd said branches. (and I see that a Chinese publication also uses the term, but that was presumably translated - they also used branches, so not clear if they were aware of the "cell" baggage - whereas Western writers could use either term) Why not branches, or groups, or networks... I only ever hear "cells" in the context of terrorist groups. Good article, but not sure about the use of the word "cells." Seems a bit overly threatening-/secretive-sounding for an organization with tens of millions of members. https://t.co/iwXRJabGmu @mark_riedl though you could say that about a lot of things that have been patented (dropout!) @mark_riedl One can, and many do, but I'm not aware of any litigation yet. "On Learning Intrinsic Rewards for Policy Gradient Methods," Zheng et al.: https://t.co/0VLddjdQg1 "Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomization," Tremblay et al.: https://t.co/leFRwc1O61 "The Limits and Potentials of Deep Learning for Robotics," Sünderhauf et al.: https://t.co/qxJx4iGoaF "Good thing the national security advisor isn't a crazy hawk and the President is super sane. And the State Department is well staffed. This is from the US's report at the recent UN meeting on lethal autonomous weapons btw - clearly a huge priority for the administration: https://t.co/oC3cz25CeX" Quick reminder that hypersonics are really bad and the US is making things worse on this and every other arms control issue I'm aware of right now: https://t.co/Y68urupvji https://t.co/Pc5reT0xI3 RT @timhwang: The deadline for the @ICMLconf workshop I’m hosting with @catherineols @miles_brundage @jackclarkSF is coming up next Monday… RT @MullerCatelijne: Newly elected President of the @EU_EESC, @LJahierEU just announced the creation of a new EESC working body on AI. Am v… Malicious use of AI report was just quoted by Rep. Kelly (IL-D) in this ongoing hearing on AI: https://t.co/99SN2h2hVA @catherineols Blackwell's is the best. Can't speak to tort but if @RebeccaCrootof wrote a paper about it there's gotta be something interesting there :) https://t.co/svGlPmwkjG "RT @RebeccaCrootof: It's up! ""International Cybertorts: Expanding State Accountability in Cyberspace"" explains how we might use state lia…" RT @filar: Detecting Malicious PowerShell Commands using Deep Neural Networks. Another interesting application of DL/NLP techniques being u… @DanitGal @PrincetonCITP Congrats! RT @OpenAI: Releasing Evolved Policy Gradients, an experimental metalearning technique to let agents rapidly learn to solve novel tasks: ht… RT @JeffDean: We just posted new DAWNBench results for ImageNet classification training time and cost using Google Cloud TPUs+AmoebaNet (ar… RT @lottelydia: ugh Cambridge no https://t.co/JQ91rldwXl RT @NipsConference: The NIPS executive board is currently discussing the possibility of changing the name of the NIPS conference. At the en… Slippery Reviewer 3 did not recommend rejecting the paper due to substantive flaws but because of jealousy - there were NO ERRORS (except by the Dems!). https://t.co/hvOjHjfYhR RT @jackclarkSF: Today I'm testifying in Congress about AI and public policy. I'm going to discuss the importance of developing shared ethi… RT @rbhar90: Shipping rapidly is critically important for any company in a competitive market. Doubly so when the rival is as formidable as… @aprilaser so much great stuff! TL;DR: Very much a hedgehog book, which has pros and cons. I happen to disagree with the big idea but maybe it's better than having no idea about AI. @MrMeritology Very much reads like a book by business professors for businesspeople/thinkfluencers. Which has good sides and bad. Clear, memorable, perhaps useful for busy people, but also misleading. So, perhaps a useful simplification, but a simplification nonetheless. Businesspeople should know more about AI than "prediction is cheap." *Which* predictions, with what data efficiency/robustness, with what level of interpretability, etc., and non-prediction tasks, also matter. ...and also exclude stuff that AI *can* do, like exceed human performance in many domains, and RL, which (contra what they say) is not just a prediction problem. Exploration, planning, etc. is not all just prediction (except maybe in the broad sense), though prediction helps. But sometimes they use the word prediction in a super broad sense, e.g. self-driving cars are about "a single prediction problem: 'what would a human do?'" The problem with this way of talking is that if you define it *that* broadly, it includes stuff AI can't do yet... But I don't really agree with the way they carve up the AI space. They distinguish "prediction" ("the process of filling in missing information") from "intellect, reasoning, or thought itself." The former includes many things in their view, inc. classification, deep learning... As context, their basic claim is that it's helpful to think about the economics of AI through a simple lens: as certain tasks becoming cheaper, they become more widely used, organizations that adapt to this new cheaper reality prosper. So far so good - useful way of thinking. Reading "Prediction Machines: The Simple Economics of Artificial Intelligence"... my concern about the way they use the term prediction, and say that recent AI progress is just about prediction, seems vindicated. Maybe a useful book for some folks, but also somewhat misleading. @rekmarks thanks! :) ("tutorial thing" is the best I could come up with. Interactive experience? Anyway, looks cool, may be of interest to ppl not super familiar with ML) This looks like a fun way to get a feel for some machine learning concepts with an interactive webcam-based tutorial thing: https://t.co/1Hj2BgWfEi @rekmarks @jackclarkSF and you should also read Jack's newsletter :) @rekmarks I'd maybe check out DeepMind and OpenAI's blogs and peruse some of the posts + papers linked therein - both orgs focus a lot on autonomous agents learning games from scratch and the blogs are pretty accessible (can then go to papers for more detail). @jackclarkSF @rekmarks +1 to Lake et al., the Behavioral and Brain Sciences version has rebuttals and a response to them, which is a nice read (varying quality of the rebuttals though). @rekmarks Hi Erik - that's a tough question :) what kinds of papers? @dlowd @tdietterich (though in practice, people have to actually look at the data to notice, so may not be that big of a difference in some cases) @dlowd @tdietterich Good point, I was not thinking about the natural appearance issue. Big diff from vision. "On Improving Deep Reinforcement Learning for POMDPs," Zhu et al.: https://t.co/NoLY2fbJjS "Compressibility and Generalization in Large-Scale Deep Learning," Zhou et al.: https://t.co/T4EhZZpXU2 "Sparse Unsupervised Capsules Generalize Better," Rawlinson et al.: https://t.co/p0j5fZjPbT "Reinforced Co-Training," Wu et al.: https://t.co/K4IGzkIGtA """Near Human-Level Performance in Grammatical Error Correction with Hybrid Machine Translation,"" Grundkiewicz + Junczys-Dowmunt: https://t.co/jZNy01lr5X ""Approaching Neural GEC as a Low-Resource Machine Translation Task,"" Junczys-Dowmunt et al.: https://t.co/j2P5tiHi48" @rao2z True @tdietterich "just as vulnerable" was a sloppy way of putting it. That may be false, but it is true that there have been several demonstrations of at least some neural NLP systems being brittle. @tdietterich E.g. https://t.co/7PGfm20c78; https://t.co/qNKn4XFxmV; https://t.co/vZBmHiDW6T Could have done good voice transfer there, plenty of data... Video doesn't look (or sound) start of the art, but interesting that Jordan Peele is interested in AI 🤔https://t.co/WdBf38eOqw Another general answer to the original Q (besides internal/external, private/public) is low stakes vs. high stakes. Both of these are fuzzy distinctions, though, and there may be other useful distinctions to draw here re: when robustness matters. NLP is just as vulnerable as vision, if not more (b/c less studied), though also not talked about much. ...and of course there are other senses of robustness that matter besides adversarial inputs (catastrophic failures/unexpected failure modes that humans won't make, or don't anticipate). Surprised to not see more written on this - one of the biggest barriers to widespread impact. One answer is that it is more useful internal to organizations than in a public-facing setting, where malicious others can poison the data, give it adversarial inputs, etc. Though that assumes there aren't malicious insiders, or cyber vulnerabilities, neither of which is safe... The lack of robustness in AI is interesting both from technical perspective and a social/economic perspective... E.g., if we've solved [vision/language/whatever] for the purposes of some set of tasks, but adversaries can easily mess it up. What applications does that (not) have? RT @LaylaMoran: Unforgivable https://t.co/dKblBPlyFz @rcalo They may have changed their tune since 2015 but at one point they said this https://t.co/LJWKRO97lY RT @sapinker: Four levels of recursive embedding by the late Morris Halle & Noam Chomsky. https://t.co/K7qG3Dzi9c @catherineols I could be wrong but think it’s bigger in the UK? @primalpoly @bariweiss +@drkatedevlin RT @random_walker: This tax day, it's worth remembering that H&R Block and Intuit are lobbying against free and simple tax filing https://t… @hlntnr @rcalo @catherineols “Glass boxes” for autonomous weapons (for recording decision trails) = another example of A from outside FATML world @hlntnr @rcalo @catherineols So I’d say it’s mostly b.) and some a.) (though not nec in the “FATML” literature - lots of work on audit trails etc) @hlntnr @rcalo @catherineols There does seem to be more F/T than A, from what I know, but 1.) Non-zero A (e.g. seminal - https://t.co/CdgCAdddex; just from last night - https://t.co/caQJ6HemVX), 2.) much T inspired by A (versus e.g., performance, science). @samim I can’t speak to all countries but in the US, there are limits on what the govt can do to force corporations to help (see e.g. Defense Production Act...can make people prioritize existing govt contracts over non govt contracts but not nec make them provide a new service) @samim Not sure what you mean by outside legal process? As with Maven, I can see arguments to not sign this (in some cases, cyberattacks may be justified, proportional etc.) but if recent indications are correct, expect more nonsense from Google on this (or nothing). I find the defensive pledge part of this especially interesting. Notably, Google not signing (yet). @sundarpichai has a lot of thinking to do... https://t.co/D81QrlZ7NU RT @pwnallthethings: 7am flights are dishonest in seeming superficially like a reasonable time when you book them, but actually being at ga… RT @carlbfrey: According to @OECD 1 in 7 jobs are exposed to automation. We (@maosbot and I) believe that the actual figure is higher. Her… @calebwatney If by Socratic dialogue style you mean Choppers meme style, then maybe I will. @calebwatney ...though each in turn has various responses. Really low caliber discussion, deserves so much better. @calebwatney There are many plausible arguments that could be made - that (though invoking Sam Harris is a facepalmy way to do it), that ISIS is bad, that the "non-offensive scope" thing in the grant is actually a thing (doubtful/no way to conclude this based on public info yet), etc. Also who is this claimed second person on the Defense Innovation Board from Google? AFAIK it's just Eric Schmidt. Does he have a clone? Would explain all the fireside chats. Is no one speaking out against that letter b/c afraid of internal backlash? Then why not better external people than this? Or do they think it's a lost cause? Or a slam dunk? Such a weird situation. I realize that this isn't the best possible representation of the pro-Maven position, but it's the only one I've seen, which is weird because I practically live in AI/defense Twitter world. (Google's statement on the matter doesn't even count as a defense, said nothing) And vaguely hinting at WWIII? And Sam Harris? SHM. "Bizarre article. Surprised to not see good defenses of Goog/Maven yet. Maybe make the case for fighting ISIS, not say weird/contradictory stuff about ""what’s good for business is good for peace"" but also YouTube hosting war vids = Google ""at war"" already? https://t.co/hXwfKHycO8" RT @mer__edith: One of more patronizing and incoherent arguments I've heard (psst, I've been a Woman in Tech for over a decade❗) https://t.… "Frustratingly Easy Meta-Embedding -- Computing Meta-Embeddings by Averaging Source Word Embeddings," Coates and Bollegala: https://t.co/h12xDzEfoS "RT @erikbryn: Here's my new paper with @avi_gan & Felix Eggers: Using Massive Online Choice Experiments to Measure Changes in Well-being W…" "Not something we considered in the malicious use report... troubling :( ""Adversarial Attacks Against Medical Deep Learning Systems,"" Finlayson et al.: https://t.co/9mHv6FK8eR" "Global Robustness Evaluation of Deep Neural Networks with Provable Guarantees for L0 Norm," Ruan et al.: https://t.co/HUQ5jlyAxw "Data-efficient Neuroevolution with Kernel-Based Surrogate Models," Gaier et al.: https://t.co/Vi7iFRaJ8r "Deep Embedding Kernel," Le and Xie: https://t.co/amKQi5nUgF "Newtonian Action Advice: Integrating Human Verbal Instruction with Reinforcement Learning," Samantha Krening: https://t.co/jXS5AXSkvY @EzekielTakam1 Awesome :) Thanks, Ezekiel! @EzekielTakam1 Here's the Google Doc, just started :) https://t.co/S09fmVtFG8 @jyoti_hereiam Here's the Google Doc, just started :) https://t.co/S09fmVtFG8 @bleyddyn https://t.co/S09fmVtFG8 @sir_deenicus @dgueraco @judywawira https://t.co/S09fmVtFG8 @dgueraco @judywawira went ahead and started a Google Doc! https://t.co/S09fmVtFG8 RT @evacide: Job alert: ALCU is hiring a Technology Fellow. It could be you. https://t.co/i8BiulcaM6 More entertaining, and Presidential, at least. Knowing what I know now about a paper's fate (rejection), "WITCH HUNT!" would have been a better rebuttal to the reviews. @Smerity exciting! good luck :) Big fan of Cody's blog posts, of which this is one of many - clear explanations of/commentary on technical AI stuff. https://t.co/PELgtElGN7 RT @nerdsrocket: It's almost as if he was radicalized online... https://t.co/QexLtbz4T0 FATML is the new FATCIA/FBI https://t.co/QMcwQUMZXi @WellsLucasSanto I wrote this partly for these reasons. Not definitive or unbiased but some seem to have found it helpful. I could see someone doing something similar with more of a FATML orientation, vs. my more long term/int’l conflict etc. bias: https://t.co/ivoC1Y6dDY RT @seungminkim: .@washingtonpost wins Pulitzer for Roy Moore coverage. What a cool moment in my new newsroom https://t.co/LLgOfMD2G8 RT @PulitzerPrizes: Congratulations to @washingtonpost! #Pulitzer https://t.co/FLueips9PH RT @PulitzerPrizes: Congratulations to @JFormanJr, @Yale, @YaleLawSc and @fsgbooks! #Pulitzer https://t.co/HYzuogdz2V RT @ELXGANZA: I’ve found the 18th century equivalent to the distracted boyfriend meme https://t.co/QDKjygVDcr RT @sarahjeong: I've never been so excited for a tv show https://t.co/VpPqkeZ0zP RT @beenwrekt: Collecting some thoughts on reward shaping and ethical machine learning: https://t.co/iuXmqA8zUW RT @JeffDean: We've been working on a prototype microscope that we think is a great way to blend the expertise of automated machine learnin… RT @echohuangy: How Chinese government played a role in helping SenseTime, one of China's leading AI companies. https://t.co/Epwhh7lNOK by… Honored that the malicious use of AI report by @FHIOxford and others, and FHI's written/oral evidence, were cited in the Lords Select Committee on AI report. You can read the Lords report here: https://t.co/H5OYgYWJu1 RT @LordsAICom: It’s what you’ve all been waiting for: the #LordsAIreport is here and ready for you to read. Let us know what you think (be… RT @gwern: Today's discovery: a new genre of video game streamers, but with 3D model avatars controlled by facial recognition, "Virtual You… Also some nice historical/period bits like the value of Keynes's contribution to the world as a lower bound on how important AI would be, and the assumption that radio would be needed to get parallelism to work (fiber optic cable didn't start working well until a few years later) "a large part of imagination in chess can be reduced 2 routine. Many of the ideas that require imag in the amateur are routine for the master. Consequently the machine might appear imaginative to many observers..+ the programmer. Similar comments apply to other thought processes" "it will need to be able to handle or to learn to handle ordinary language with great facility. This will be important in order that its instructor should be able to teach it rapidly, and so that later the machine will be able to teach the instructor rapidly." Some other fun excerpts: "The first ultraintelligent machine will be educated partly by means of positive and negative reinforcement. The task of education will be eased if the machine is somewhat of a robot, since the activity of a robot is concrete." TIL that in addition to coining the term intelligence explosion 55 years ago, I.J. Good also thought that superhuman AI would "need to be ultraparallel, and is likely to be achieved with the help of a very large artificial neural net": https://t.co/uArVFvmMEX The journal Brain used to be edited by Russell Brain (aka Lord Brain or 1st Baron Brain) https://t.co/iTgCEGYx1b @bleyddyn Also there are multiple tiers- some stuff ppl should watch, sometimes they should just watch excerpts (e.g. important flashbacks), sometimes totally skip/don’t care, sometimes they should get a summary @bleyddyn Roughly: involves characters that matter in the long run, not just person of the day being saved RT @psygnisfive: hey trans californians! what's the process for getting an ID card when you're changing your name and other personal detail… @ChrystalDing @lukeprog did a nice review recently here: https://t.co/7FnoXR1Nt0 "RT @rebecca_roache: Someone on The Internet who procrastinates more than you has translated the Zuckerberg hearing into Glaswegian https://…" RT @jpbrammer: trying to forget the moment this afternoon when my barber asked “are you having fun?” and I said “yes” but he was talking to… @jackclarkSF Agree! @jackclarkSF Unclear 🤔 @judywawira @dgueraco https://t.co/dkWIW3A0Bw 🤔 @judywawira @dgueraco haha yess :) RT @judywawira: The Kenyan government though @MoICTKenya launched a taskforce on #blockchain and #ArtificialIntelligence , with a public ca… RT @decodyng: I spent the last few weeks getting deep into the weeds of VAE representation learning, and came back with some (hopefully use… @dgueraco @judywawira yes, for sure. Need Root's appearance in S1 and Shaw in S2. @judywawira @dgueraco *how to handle HR/Elias/FBI hunting the Man in the Suit etc. - general NYC-specific plot stuff. Some seems important, esp. related to what happens to Carter, but also not specifically AI-related. RT @CharmingGrump: It's the anniversary of Yuri Gagarin going into space. When he was 8, he Home Alone'd a Nazi. https://t.co/aeSNF2zyb5 @judywawira @dgueraco in seasons 2+3, how much general character building/"flavor" of Reese/Finch etc. people should see even if not directly long-term-plot-relevant, in seasons 1+2, and of course the rest of the seasons. Maybe we should do a wiki or Google Doc at some point. @judywawira awesome :) + @dgueraco also expressed interest. I've made a lot of progress already on seasons 1 and 2, with the general heuristics of "skip totally long-term irrelevant eps" and "watch flashbacks only on semi-relevant eps." Some things I'm unsure about: how to handle HR stuff... @robinsloan Fortunately, some affordances of the show make it relatively easy (e.g. different color scheme for plot-relevant flashbacks makes it easy to find them on semi-skipped episodes that are mostly fluff). @robinsloan Though maybe there are more deluxe scenarios I'm not considering. @robinsloan I don't think it really merits a Kickstarter project, at least for a minimum viable product (blog post with general guidelines/options/reasoning behind choices made, eps to skip, what you missed that you may want to know, timestamps of stuff to watch on semi-skipped eps). And if you haven't seen POI, wait a bit longer :) One of my casual long-term side projects: designing an abridged version of the show Person of Interest, for people interested in the AI-related main plot but wanting to skip much of the fluff. If you've seen POI and want to collaborate on this, let me know. RT @PeterGleick: He never had it. https://t.co/I1MN6Admg4 RT @maggieNYT: An actual “I hardly know the guy” https://t.co/9rs2abas8f RT @realDonaldTrump: The President must get Congressional approval before attacking Syria-big mistake if he does not! @laurayosiam @weird_hist probably P for pass (F for fall) in a Pass/Fail course. @timhwang It’s pretty great, very 90s feel but also relevant RT @PsyPost: Study: Smartphones don’t cause long-term harm to levels of self-control in teens https://t.co/mwN3yuJGWU @beaucronin ? RT @PsyPost: Study of sapiosexuality suggests some people really are sexually attracted to intelligence https://t.co/9ZwWw79ACi RT @TensorFlow: Meet @chipro, author and instructor of the TensorFlow for Deep Learning class at @Stanford. Learn about her journey & how s… @timhwang Speaking of infrastructure, this has Tim written all over it https://t.co/8QsDsWhRoD Haven't watched it but looks pretty good, and the book is good. TIL "The Prize," an 8 part PBS series from the 90's inspired by Daniel Yergin's book of the same name (history of the petroleum industry viz-a-viz world affairs), is on YouTube. Part 1: https://t.co/BOC1cbSyNf RT @elonmusk: @timkhiggins Yes, excessive automation at Tesla was a mistake. To be precise, my mistake. Humans are underrated. (Refefence to @michaelpollan’s “Eat food. Not too much. Mostly plants” for those who don’t know) Read more. Mostly books. @abdu Was saying that oxford’s weather is nice right now Oxford weather RN 👌 @egrefen @waltshaub Scooter Libby https://t.co/kvCUf8r2NJ RT @quasimondo: So spectral normalization is a mixed bag. Overall it seems to make everything more consistent and there are no blatant arti… RT @realDonaldTrump: Now that Obama’s poll numbers are in tailspin – watch for him to launch a strike in Libya or Iran. He is desperate. RT @EBKania: As of today, China has confirmed calls for a "ban" (new CCW protocol) though the language is carefully qualified as "limited t… @erikphoel The Amazon summary makes it sound like Avatar. RT @radleybalko: Once again, Trump is outraged at the gassing of Syrian women and children to whom he refuses to grant asylum and slanders… @chipro you did great :) Just gonna leave this right here https://t.co/q5zCpXp0Wc RT @chick_in_kiev: This year we have admitted 11 (eleven) refugees from the country we are striking today. https://t.co/3kPLZmBOFd RT @erichorvitz: Fireside chat with @tdietterich https://t.co/Oun1YyNEmk during his visit to @MSFTResearch @acmeducation @OregonState @Real… RT @EBKania: The Pentagon plans to establish a “Joint Artificial Intelligence Office,” which would concentrate DoD efforts in AI. https://t… @primalpoly Bolton + Comey RT @qhardy: John Bolton's first week as National Security Advisor. "Righteous power" SMH RT @Bakari_Sellers: We are ordering a military strike without a Secretary of State. Glad people are both reading it and moving beyond it already :) And also cool that Def Con has an AI Village now at all. TIL the first talk at Def Con China's AI Village (tentative schedule) is "Beyond the Malicious AI Report": https://t.co/1sgRaM3sC6 Nice interview with the great @chipro on teaching TensorFlow/deep learning: https://t.co/TbV0gccRvf RT @scottlincicome: You guys I'm beginning to think the WH doesn't have a coherent, long-term strategy on any number of policy issues. RT @mmitchell_ai: It's important to release and democratize ML models & tools responsibly. Here, we speak to the recent release of Google t… @AthertonKD we're gonna find out soon with AI analyzing tax records, if/when IRS et al. get competent enough to do so or outsource it RT @patrickc: https://t.co/CRv5Xb5F9y is an interesting attempt expand access to some of the benefits of Silicon Valley without the locatio… @SuyenEspinoza Feel free to send me a message if you want to discuss further! :) @SuyenEspinoza I'm not sure there's a perfect answer - depends on the person! Family, friends, trusted colleagues, and counselors at school are all good options. Personally, I've had some success with counseling and friends/family but others have done different things. TFW you’re super fit for office https://t.co/nxtdlewmNa @SuyenEspinoza I understand that feeling! I’ve found that people will often be more supportive and understanding than you might think, though - many have suffered, too. And besides, you have to do what you need for your own health, and that often includes reaching out. Self-care>not annoying RT @sarahjeong: Mark Zuckerberg is using AI as an excuse and I’m mad about it https://t.co/jt44hkaUSH Having a bit of We, Robot 2018 FOMO but glad @levendowski is tweeting it https://t.co/bw7lmIIRIE "RT @hlntnr: tired: influencing elections via targeted ad campaigns wired: ... via synthetic video of candidates inspired: ... via style-tra…" @Omair28Khan :( that's not a helpful thing to say. RT @LordsAICom: Nearly there! #LordsAIreport out on Monday (we don’t think we’ve mentioned this enough). Tell your friends! https://t.co/cp… @RebeccaCrootof @levendowski 🙌 RT @levendowski: I'll be live-tweeting from #werobot2018 today and tomorrow! Agenda: https://t.co/SVPFCSjVoD. If you're suffering from depression in grad school, be sure to talk to someone abt it, whether or not they're in your program (e.g. I'm always happy to chat; there are probably also resources available on campus). Know that you're not alone but also shouldn't have to feel crappy. Depression in grad school is "normal" in the sense of being common (I've struggled with it/know many who have), but not something that should be "normalized"/expected as par for the course in this or any other industry. Schools need to do better. https://t.co/yPZKl8DFhr RT @jeremyphoward: One of our students tried training a medical Q&A model for fun. It's interesting how it creates answers that sound impre… @HeidyKhlaaf yay easter eggs! RT @PamelaPaulNYT: Here's The New York Times Book Review of James Comey's memoir by Michiko Kakutani: https://t.co/Axds3Suaso RT @jaketapper: Calling @Comey a “proven LEAKER & LIAR” while you’re about to pardon Scooter Libby, who leaked the identity of a covert CIA… RT @brianklaas: Trump’s assault on rule of law and law enforcement continues. Republicans who stay clinging onto Trump’s insane authoritari… RT @nicholaraihani: High levels of male-male competition increases risk of whole species going extinct. (Not a commentary on @realDonaldTru… One specific thing I enjoyed here is the discussion of safety, bias, and fairness through a common lens (alignment of AIs with human values). This is something some people have been saying for a while but dunno if I've seen it in print this clearly before. https://t.co/JzjWmryD6B "RT @catherineols: OH HECK YES. - In RL, reward functions are misspecified. - In law, contracts between people are underspecified. - Law has…" "Fun work from @dhadfieldmenell and @ghadfield I've been looking forward to for a while - ""Incomplete Contracting and AI Alignment"": https://t.co/Pyr17H1UgH Getting an AI to do what you want=similar to principal-agent probs in economics - AI ppl can learn lessons from the latter." "Optimizing Query Evaluations using Reinforcement Learning for Web Search," Rosset et al.: https://t.co/L8aOhIztdV "Deep Neural Networks motivated by Partial Differential Equations," Ruthotto and Haber: https://t.co/uNmkFhu33x "Learned Deformation Stability in Convolutional Neural Networks," Ruderman et al.: https://t.co/n9pKxWCGHP "Deep Differential Recurrent Neural Networks," Zhuang et al.: https://t.co/zTy9fpdO3h "Combating catastrophic forgetting with developmental compression," Beaulieu et al.: https://t.co/jnSC9G3HzL "Training a Ranking Function for Open-Domain Question Answering," Htut et al.: https://t.co/9KIJsv0hXN "RT @fox: Wow, this one is a true achievement. Congratulations on full lineup of 87 MALE SPEAKERS @code_europe! https://t.co/LWvBGdS2JF" RT @BrendanNyhan: "'They were about to lead a country that had been attacked by a foreign adversary yet they had no Qs about what the futur… @rodolfor I see the market for cloud AI (not just storing data) as essentially limitless, which means basically everyone/every org is a potential customer. To realize that, you need talent. @rodolfor perhaps the biggest single customer, but that doesn't mean it's a big fraction of the market, or worth losing a lot of talent over. Whether it *will* lead to losing a lot of talent is uncertain, though. RT @BanKillerRobots: 👇 Amazon, Microsoft, Google, Oracle all reportedly bidding for a Pentagon contract worth as much as 10 billion dollars… I don't know what the profit margin on this sort of thing is, but it's in the vicinity of my estimates here - which is to say, Google people speaking up now or not could have an impact. https://t.co/tNcDcrsFxo https://t.co/Fc3VhTjGBX https://t.co/rmZRNClmpC "RT @FogleBird: ""Deep Painterly Harmonization"" Examples show original painting, naive composite and output. https://t.co/aPhfUIjW30 https:…" RT @vkrakovna: Can you tell if you’ll like an ML paper after skimming for 30 seconds? Help create data sets for AI safety by taking part in… @halhod @jjvincent I saw that more as a DM/Google jab than an "AI could be dangerous" jab but one never knows for sure with Elon RT @TacoCohen: Best paper award for our ICLR paper, "Spherical CNNs"! Read it while it's hot 🔥 https://t.co/OSNDGd6M3d 🔥 https://t.co/ozof7… RT @iamtrask: .@Smerity is awesome. This interview is great! https://t.co/X1lxcnFkXg RT @BrundageBot: arXiv papers, April 12, 2018: RT @AtomicHeritage: The “Voices of the Manhattan Project” website, a joint project of @AtomicHeritage & @losalamosmuseum, now features 500… "CoT: Cooperative Training for Generative Modeling," Lu et al.: https://t.co/RFIkEHnnOi But it's hard to see why that wouldn't apply to "predict" being anthropomorphic, or why humans shouldn't often be accountable when predictions have direct/indirect consequences. Anyway, I'll stop talking about this book now until I read it (few days til it's out). I'm sort of attacking a straw man here as it's just an excerpt from the talk - maybe the claim was more nuanced - but the best versions of this claim I can think of involve either humans being morally accountable for software impacts, or "decision" being anthropomorphic... Narrator: they also make decisions. And that's a misleading distinction anyway. [that being said, I look forward to the book by Agrawal et al.). https://t.co/olA38YkDhZ 🍿🍿🍿🍿https://t.co/mGJK8gvkM4 RT @jjding99: This week's #ChinAI newsletter focused on the prospects of China militarizing AI technologies - one that will be informed by… RT @TensorFlow: Introducing TensorFlow Probability: empowering ML researchers and practitioners to build sophisticated models quickly, leve… RT @lrozen: "Honestly, I wish the motherf*cker would just go away....He wakes up in the morning, sh*ts all over Twitter, sh*ts all over us,… There is a lot of AI snake oil in cyber. @unterix @katherinebailey @hardmaru Cc @abigail_e_see "Lol journalist asks Rudd who’s a bigger threat to UK cybersecurity - Russia or FB. Rudd: well if we leave promptly we can catch Zuck testimony. FB should cooperate w/ our inquiry. Other journalist: are we on the brink of WWIII?" Yeah, I’m at a cyber conference. It’s different. Home Secretary Rudd announcing £50 million for building cyber capacity in UK law enforcement at #cyberuk RT @DeepMindAI: Please welcome @lilaibrahim, our new COO! You can find out more about Lila and how she’ll work with our founders to design,… @sarefo Huh. Nope! RT @haldaume3: just found out about https://t.co/VZe11bfEE8 via @inclusioninml!!! looks like a great effort, including events (talks), a d… @samim agreed. This is something we vaguely hinted at in the report but didn't put it that way... AI is not a total solution to defense, and we also need to double down on efforts to improve end user awareness + vigilance (e.g. 2 factor authentication). @guillefix not as far as I know Finally, AI people should learn from cyber people. The latter have spent more time thinking about dual-use issues, O/D balance, responsible disclosure of vulnerabilities, security generally, etc. than the former. So, the AI/cyber nexus isn't going away but isn't all bad. /Fin Cyber people should think about how to get AI people to work with them on defense. They (good AI people) may not want to work on offense, and even re defense, AI people have plenty of stuff they can work on and are scarce. Eventually this may be "plug and play" but now it isn't. Overall, this is an area in flux and under-theorized/under-explored empirically. We tried to do some assessment of such issues (including O/D balance) in that report but it's early days there, too. How worried should we be? Unclear. One Q is the future offense/defense balance for the AI layer, and how AI affects the O/D balance at the trad. software layer. If one simplistically thinks of AI as substituting capital for labor, it's good that the "good guys" have more capital. The latter is pretty concerning since defense is losing right now and all the emerging applications of AI are increasing the attack surface on the internet - in addition to messing with the traditional software layer, you can mess with the AI layer. Broadly, one can think of two categories of risks here: de novo malicious AI (e.g. automated spear phishing), and the undermining of AIs being used for good purposes (e.g. through data poisoning/adv. examples on malware classifiers). E.g. while writing the report, we talked about deep reinforcement learning as a paradigm for some cyber stuff. Before going to press, such work started appearing (e.g. deep reinforcement fuzzing: https://t.co/ubsoQwj6zP). We've barely scratched the surface of risks/opportunities. First, this is a fast-moving space. Lots of interest in both offense and defense. Surveys and our own investigation into the topic (Ibid) agree that we'll see increasing weaponization of AI in cyber in the near term. I'll share some of my general thoughts on it here for those who won't be there (i.e. probably all of you). For more detail, see: https://t.co/eOcORdFx4s @rodolfor no stream AFAIK but I'm about to tweet some points. https://t.co/bsEmzpAgep On my way to #CyberUK to talk about offensive applications of AI in cyber and related issues. RT @realDonaldTrump: @walaa_3ssaf No, dopey, I would not go into Syria, but if I did it would be by surprise and not blurted all over the… RT @haarnoja: New paper on how hierarchies emerge naturally from maximum entropy policies with a latent space. These policies achieve state… TFW you’re super historically literate https://t.co/hZQdIQiGax "RT @AlperUcok: Positive reply by fictive job applicants with the same CV in Germany (University of Linz study) Sandra Bauer: 18.8% Meryem Ö…" TFW you're super mature and not at all dangerous https://t.co/aLctKwFaiC @jjvincent (I wouldn't be surprised by "most," FWIW - they're huge - just hadn't heard it before) @jjvincent I'd accept "a lot of" or "a plurality of" without question, but is it really "most of"? @Smerity @CommonCrawl nice! :) "A Hierarchical Latent Structure for Variational Conversation Modeling," Park et al.: https://t.co/K9W2Buyq9e "Graphical Generative Adversarial Networks," Li et al.: https://t.co/lg2cyJGQS5 "Modular Generative Adversarial Networks," Zhao et al.: https://t.co/sZK4dWTEQo "Design of an Autonomous Racecar: Perception, State Estimation and System Integration," Valls, Hendrikx, Reijgwart, and Meier et al.: https://t.co/zfyNz55ITN 👀 https://t.co/ulbkzfKyNx "Large scale distributed neural network training through online distillation," Anil et al., Brain: https://t.co/Pzcbdunrv6 """Imagine This! Scripts to Compositions to Videos,"" Gupta et al.: https://t.co/Yv58UXExUb https://t.co/YbMkmsbHDU" RT @cfiesler: Though to be fair, a few years ago when we did a study on this, Facebook's TOS was more readable than most (which isn't sayin… RT @cfiesler: It would be trivial for Facebook to study this to find out for certain on their own platform. However, there's a ton of resea… "And we're going to do it allllll in 5-10 years https://t.co/KsfEJqqfmg" @mark_riedl ? Zuck related? (I'm behind) @MattLevinson he's not a big Zuck fan/vice versa (disagree on AI, Musk blew up Zuck's satellite) @L_badikho Yeah he is talking a lot about AI for moderation. Someone should look into this AI thing RT @Miles_Brundage: Check out @jjding99’s newsletter, ChinAI, for regular updates on AI in China, including translations of important docs… RT @MelanieHannah: he’s 33 https://t.co/Vtfpnoxcbz https://t.co/CWAFB4yD8K @pfau also I'm super mature @pfau Agreed. You should hire this octopus neuroscientist to your team. https://t.co/BjGydhRki6 @cynicaldevil_ Dunno, I just read that page. @ankurhandos Saw some folks tweeting about it. RT @pabbeel: Existing RL methods can be adapted to learn robust control policies capable of imitating a broad range of example motion clips… """because birds have a large pallium, but no cortex, [and have mental time travel, reasoning, metacognition, etc.] a specific cortical architecture cannot be a requirement for advanced cognitive skills"" Makes ya think re: the AI architecture search space. https://t.co/etUPwsXYgR" Wow! https://t.co/yIJbs6chfP @hardmaru @seaandsailor (/workshop...I meant as opposed to journals, which seem to usually only go to arXiv when they’re already accepted) @hardmaru @seaandsailor We did for the deep RL survey. Left ones that were only arXiv and replaced published ones with the (usually conference) info. @HeidyKhlaaf Congrats!! "RT @InclusionInML: #MachineLearning community! This account is a joint effort between the Inclusion chairs at #icml2018 and #nips2018! Ple…" @hardmaru yeah, I wasn't very confident the Graves stuff would be directly useful for you - I was mainly thinking that you'd enjoy large amounts of Graves prose :P As usual, you should read @zeynep's article. https://t.co/rssS7aqh7l RT @zeynep: Many people asked me what lawmakers should ask Mark Zuckerberg. Here's my answer: Nothing. Instead, they should get to work and… @deliprao @kastnerkyle I've waded in a bit, always working to go deeper... but there's value in both for sure :) @deliprao @kastnerkyle I like that it has a lot of intuitive math-free explanation at the beginning. That's my favorite part :) RT @finkd: Never thought I'd be on a boat. Lots to chew on here... https://t.co/qRss3TSuJJ @mark_riedl If the funders had any direct influence over the research, that'd be a different thing, but I doubt they'd be that stupid. *braces to be proven stupid* @mark_riedl Bit of an overreaction to that tidbit IMO. Yeah, FB is a walking disaster RN, but this is clearly just to give the semblance of bipartisanship, and they chose good scientists to do it. RT @anirudhg9119: Our new work is now online! Join work with Alex Lamb, Jonathan Binas, Dmitriy Serdyuk, Sandeep Subramanian, @bouzoukipunk… This seems like @hardmaru's cup of tea "A Machine Learning Approach To Prevent Malicious Calls Over Telephony Networks," Li et al.: https://t.co/qrKTUZb1Py "Associative Compression Networks," Graves et al.: https://t.co/iFCbEUtK9C "Structured Evolution with Compact Architectures for Scalable Policy Optimization," Choromanski and Rowland et al.: https://t.co/C6gyhgdZh0 "Fortified Networks: Improving the Robustness of Deep Networks by Modeling the Manifold of Hidden Representations," Lamb et al.: https://t.co/W8bJ9TiV2E "Programmatically Interpretable Reinforcement Learning," Verma et al.: https://t.co/U6vLI4y0Pk """DeepMimic: Example-Guided Deep Reinforcement Learning of Physics-Based Character Skills,"" Peng et al.: https://t.co/cPJSAcSsNs 👀 https://t.co/xYdyG5UHMV" "Latent Space Policies for Hierarchical Reinforcement Learning," Haarnoja and Hartikainen et al.: https://t.co/tAUnrltIYG "Differentiable plasticity: training plastic neural networks with backpropagation," @ThomasMiconi et al.: https://t.co/6qff4LQ1rA arXiv is lit tonight "What, if anything, is the difference in meaning between these (in the context of academic papers): Author Name*, affiliation X *now at Y Author Name*, affiliation Y *work conducted at X" RT @costareports: Briefly reached a WH official. Official said the WH doesn't have a strategy for the Comey book. Paused. Then said that sh… RT @FeryalMP: Excited to announce our workshop on Learning from Demonstrations for High-Level Robotics Tasks this June at RSS 2018. More in… @ronnie2tweet @iacopo_poli Good point! "RT @ch402: Very excited about the new @OpenAI charter! Some comments. https://t.co/qER8bxofQo https://t.co/WCkhTa6yJv" Interesting that DOE is still excited about generic exaflop computing, as they probably should be for non-AI reasons (e.g. scientific simulations), while specialized AI hardware is more or less there already. AlphaZero was about a fifth of an exaflop. https://t.co/9JNUaqGKN6 Look forward to reading! https://t.co/trGrR8eKFg RT @catherineols: When people ask how to get good at ML, it's common advice to "implement papers". It's seldom explained exactly what that… I'd just add that this is also a nice example of concretizing a previously vague commitment made by many (Asilomar AI Principle #5 - race avoidance). https://t.co/NO0qCfFOAP RT @catherineols: The @OpenAI charter released today includes a commitment to join up with other projects (rather than competing) in case o… RT @y0b1byte: My notes on “The Kanerva Machine: A Generative Distributed Memory” (https://t.co/JTESzvHP2N ) by Yan Wu, Greg Wayne, Alex Gra… RT @gdb: What OpenAI is about: https://t.co/vzjUM5QpeD RT @OpenAI: OpenAI Charter: https://t.co/luYP0j87qs RT @AINowInstitute: Today we release our full report on Algorithmic Impact Assessments, a framework for accountability and oversight of AI… @danelliottster @jekbradbury https://t.co/TpanctyoqR RT @Davidramli: Scoop: China’s SenseTime completed a $600 million funding round led by Alibaba at a $3 billion+ valuation in recent months,… "Regularizing Deep Networks by Modeling and Predicting Label Structure," Mostajabi et al.: https://t.co/tNR2Eliy7Y "Hierarchical Disentangled Representations," Esmaeili et al.: https://t.co/CKVb2RdZrh "Few-Shot Text Classification with Pre-Trained Word Embeddings and a Human in the Loop," @katherinebailey and Chopra: https://t.co/9Er0GyIP3R (supposed to sound like "start your engines" but yes, I know, it doesn't work) AI tweeps, start your enGANes. https://t.co/BLGXZXBUy7 @johnfraxedas @samim lol nice RT @jenanmoussa: 11/ Notorious #ISIS-fighter El Shafee Elsheikh told me in interview he was in Raqqa when he read reports that UK media dub… RT @zeynep: I’d be surprised if every person who was on Facebook by 2015 didn’t have their data siphoned this way, and still floating out t… @samim (I've refused to set this up every time HSBC insists for this very reason) @samim breaking of voice passwords used for phone bank log-ins :( @AnthroPunk I think it’s plausible they won’t persist and that this is part of the reason why (underestimating resistance) @AnthroPunk I’m not sure what I’m asking, perhaps: what assumptions am I making that are way off (e.g. future contracts >>5 bln), is this the wrong way to think about it... mostly just saying how I think about it for discussion purposes. And yeah, why do they persist is one Q -also will they P.S. I could also imagine future contracts that well exceed that $, or a much larger/smaller hard core. But haven’t seen anyone make the case/discuss specific $ values. And again, cf. Eric Schmidt Just Wanted to Do a DOD Thing Theory. Thoughts? From people who can comment ;) Many simplifications here, and I could imagine e.g. a single high profile signatory having a big impact. And also presumably some want to do the contract (/maybe it’s not as ominous as Goog’s vague PR makes it seem). But it’s not at all clear IMO that $ motivation = more of this. "... and they aren’t easily replaceable. In that case, the future contracts would have to be >$5 billion in value for Google to do this just for $ in face of opposition. Maybe they are? But my point is, it’s not clear, could see it being scrapped even for strictly $ reasons." "...suppose a third of those who signed the letter are hardcore anti-Maven, so 1k people, and will eventually leave if it isn’t cancelled (I’d guess less than that but also consider future recruits...this is all approximate). Suppose each is valued by Google at $5 million." "Re: Google/Maven thing - people have said it’s a future cloud contracts/$ thing.* But current and future researcher/engineer loyalty are also worth $, so that doesn’t mean they will keep it. For example: .. *I’m not convinced/think this could also just be an Eric Schmidt thing" "Things AI researchers agree on: - that documentary was pretty unhelpful -Terminator images are usually inappropriate - AlphaGo Zero (if not other Alpha*s) was pretty cool (That’s about it)" RT @mortendahlcs: A step towards tf.contrib.encrypted? The first blog post on private machine learning in TensorFlow: https://t.co/perfUdqb… Waterworld > @WattersWorld https://t.co/CaYvNAoa9A @zacharylipton Don’t dox me Zach @markus_with_k @dhadfieldmenell So dunno. Though maybe ppl who were interviewed longer did see a draft version - haven’t seen any evidence one way or the other. Whereas Dylan didn’t have an (audible) speaking role. 🤔 @markus_with_k It may be more flexible there - whereas journalists have a pretty standard code of conduct where showing the draft article to interviewers is considered taboo, perhaps sometimes filmmakers do this - but cf. @dhadfieldmenell being surprised he’s in it :) @markus_with_k So yeah I think they prob “agreed to be part of it” as in being filmed, for the individual interviews, and knew it was related to a documentary, but not how exactly it’d be edited @markus_with_k It’s pretty standard with both documentaries and journalists’ articles that you don’t know how your comments will end up being contextualized, and you have to decide participation based on reputation of (journalist/newspaper/filmmaker etc) apparently the "software bug" page on Wikipedia also mentions Edison, but doesn't really answer my question (was it a generic term applied, or a new term invented which happened to have been used before without the new users' knowledge) *applied in this context b/c real bugs "I've heard people say that ""bug,"" as in software bug, comes from real bugs in early computers, but Edison used it in similar/generic way before such computers. Are these claims wrong or am I misconstruing it (e.g. term was *applied* in b/c real bugs, vs. another generic term)? https://t.co/U6JLgPW7hJ" RT @beaucronin: "The White House Council of Economic Advisers estimates that the economic cost of the opioid crisis was $504 billion just i… "RT @shannonrwatts: ✅ Bragging about Trump Tower while it’s on fire ✅ Managing to be sexist while thanking firefighters ✅ Ignoring civilian…" RT @rbhar90: I've written a new blog post, "The Advent of Huang's Law," which makes the case that the continuing improvements in GPUs along… RT @mcfunley: https://t.co/hcPFuOYQLQ RT @thomaswright08: Congratulates himself first, first responders second. https://t.co/y8so5BnYQB @drkatedevlin fun radical bookstore, too (Lighthouse), and farmers' markets! Need to go back soon... RT @RebeccaCrootof: Just finished @paul_scharre's excellent new book, Army of None. Per usual, an excellent, thoughtful take on #AWS issues… RT @quasimondo: Fingerplay (Take 1) https://t.co/oyys84Al0e "RT @trochee: Y'all. ROBERT MERCER is one of us gone to the Dark Side. There will always be weaponization capabilities for #nlproc and soci…" @nancyleong sketti! RT @davidmackau: Michelle Obama on women in politics: "People should be less disheartened by the fact that me and Oprah don't want to run,… RT @icmlconf: Registration is opening soon for ICML 2018. Child care is available this year through https://t.co/PJHl0xEoBb @timhwang Love it. @dmarthal cf. https://t.co/Ep4LZOrEFq TIL that at the end of the show Dinosaurs, everyone dies in a dinosaur-genic ecological disaster. https://t.co/3TYtPSLvsA Nice thread on problems with that documentary - agreed: https://t.co/Vso1CCxED9 RT @abigail_e_see: Check out "Skynet Today" - a promising project aiming to give a calm antidote to exaggerated media coverage of AI news.… @rivatez @dhadfieldmenell @KatjaGrace @markoff yep. @jgcarpenter @dhadfieldmenell @rivatez @KatjaGrace @markoff :( """Do You Trust This Computer?"" documentary: + @dhadfieldmenell writing on whiteboard - too many white male fake experts, saying some - false things + @rivatez +@KatjaGrace cameos but - not interviewed + @markoff saying ""et al."" - no coherent thesis Overall grade: C-" @XandaSchofield Same, actually. (+”looking forward” to dissertation edits, but mostly memes) RT @avgupta_me: Check out our new paper! "Feedback GAN (FBGAN) for DNA: a Novel Feedback-Loop Architecture for Optimizing Protein Functions… @mark_riedl https://t.co/4GaeDe3zID? RT @quasimondo: Another pretty sketchy clip of the Old Masters model in action. https://t.co/vjbCdmEC89 "The Kanerva Machine: A Generative Distributed Memory," Wu et al.: https://t.co/RUDzAP6d2V "Image Generation from Scene Graphs," Johnson et al.: https://t.co/CSyape7RZc https://t.co/xD3LWDO5MD "Learning Strict Identity Mappings in Deep Residual Networks," Yu et al.: https://t.co/mIiekE5pg7 "End-to-End DNN Training with Block Floating Point Arithmetic," Drumond et al.: https://t.co/RhvAqi0RSD @rcalo is this from Atlantic hanging guy? @atg_abhishek Fortunately, most of what I have to say there is already said more coherently here :) https://t.co/eOcORdFx4s @tomvarsavsky @BanKillerRobots the folks I mentioned are outspoken re: not taking military funding whatsoever - it's common for academics to take military funding but to not work on weapons per se. the latter group = "almost all" in the US. can't speak to outside US as well. @tomvarsavsky There are lots of AI organizations that don't *do* weapons research (some with outspoken leaders include Nourbhakhsh's lab (https://t.co/MQE2diRC9p), Ben Kuipers etc. but really, almost all academic/nonprofit organizations), then there are advocacy groups like @BanKillerRobots RT @jackclarkSF: A new transfer learning contest from OpenAI where you train your algorithm on levels of a particular game, then test on ne… @atg_abhishek dunno. I don't think so. I’ll be saying some stuff on the AI+cyber panel on Wednesday, in case anyone’s going and wants to say hi :) https://t.co/zNLtw11Mfx RT @ivan_bezdomny: I just published “(When) will an AI win the World Series of Poker?” https://t.co/nHNSzbkZXd Nice interview with @JeffDean by @twimlai: https://t.co/nqbnComUcP RT @danielgross: AI Grant is accepting applications for our third batch! Get $2,500 in cash. $20k in GPU credits. A network of other scient… RT @JohnBrennan: I served 6 Presidents, 3 Rs & 3Ds. I directly supported Clinton, Bush 43, and Obama. While I didn't agree with all their p… RT @hardmaru: "As researchers we have a responsibility to at least consider the harm our work might be doing and think of ways to mitigate… Reupping this cuz come on, AI and dogs! Also a good paper. https://t.co/t6sZVTzAFf https://t.co/AqNKhSXLQF "Information Maximizing Exploration with a Latent Dynamics Model," Barron et al.: https://t.co/SjzJkgHcCa "Stochastic Adversarial Video Prediction," Lee et al.: https://t.co/rq7iuWTdB4 "Probing Physics Knowledge Using Tools from Developmental Psychology," Piloto and Weinstein et al.: https://t.co/hPGCK5SNgz RT @Reuters: Russia's first postal drone takes its maiden flight - and crashes straight into a wall. More from @ReutersTV: https://t.co/4WE… On my way back to the UK ✈️ RT @iandanforth: Blaise Agüera y Arcas, Google: Learning locally and globally https://t.co/6IWxg8IUnG from #ccbm2018 - Good talk that goes… @nonja_master But it will always help to have expertise, especially if you’re trying to do more cutting edge things. @nonja_master I don’t think it will solve it but may make things easier for ppl with less experience...already things like TensorFlow/other open source frameworks, MOOCs etc. have helped with this so I see it as part of that trend, and esp. making “mature” things like supervised learning easy "At least they didn’t go with: Something something “community” ⏹" RT @ava: He was 39 years old. #MLK50 https://t.co/8YC9L7dCRO @nonja_master Yeah that’s def a big issue...certainly IIT helps, as do the increasingly available free online education matetials. And maybe AutoML/metalearning will eventually reduce need for talent to make good applications, but prob talent will always help "Google’s decision process RN on DOD projects apparently: Drop project ⏹ Explain it coherently ⏹ Say ISIS is bad or something ⏹ Repeat vague nonsense about “non-offensive” ✅" @nonja_master Unfortunately I don’t off the top of my head - sorry! RT @verge: Leading AI researchers boycott Korean university over its work on "killer robots" https://t.co/0zxRGiJNWW https://t.co/Xkc2vhOOtK TFW you can pay PR people $$$$ to come up with a coherent explanation of what “non-offensive” means between two consecutive NYT articles and apparently don’t even bother https://t.co/O0zeTUgvSe https://t.co/O0zeTUgvSe @y0b1byte thanks for writing this! Re: mean/median, agree standard mean is a problem, and for this reason I think DM has not used standard mean in the past few months - either median, or mean but with scores capped at 100%. That seems to address the issue you raised. RT @nomadj1s: When they ask you for your slides in advance of your talk: https://t.co/Ou0PqLBXNm @rbhar90 Yep, I recently discussed related issues in a chapter here (other implications of scalability): https://t.co/997edC97Y5 @ankurhandos other things deserve more respect, too, like search algos and planners: https://t.co/T5hUdNpaE0 "Neural Autoregressive Flows," Huang and @DavidSKrueger et al.: https://t.co/0SM3hfnFZF "Learning to Search via Self-Imitation," Song et al.: https://t.co/NuicgZ8O1B @GoAbiAryan I dunno but this def. wasn’t even close. There are others with at least hundreds if not thousands. RT @timnitGebru: Please consider submitting your work to the fairness, accountability and transparency in machine learning workshop at ICML… RT @TheRyanParker: Zuckerberg San Francisco General Hospital PIO Brent Andrew tells me they have received a number of patients with gunshot… RT @diazf_acm: https://t.co/EsErLNABvY RT @Lavrusik: Active shooter at YouTube HQ. Heard shots and saw people running while at my desk. Now barricaded inside a room with coworker… RT @hlntnr: Wasn't expecting my first published newspaper article to be in Chinese! 🐼 Co-written w/ @jackclarkSF, Chinese translation by @j… RT @xuhulk: These memes are going to entirely eliminate the need for college. https://t.co/HO8VzdHHzQ RT @anirudhg9119: Our new work Backtracking Models for Efficient Reinforcement Learning is now online! Joint work with Philemon Brakel, @L… RT @mustafasuleymn: Through the @PartnershipAI and our Ethics & Society team, we’re working to ensure ethics remain at the forefront of con… RT @chelseabfinn: New paper on integrating planning and representation learning! Optimize for representations that lead to effective goal-b… RT @MateuszOnAI: In navigation, we can rely on our memories of the neighborhood, and various visual cues to reach desired destination. Here… RT @DeepMindAI: Navigating through real-world environments is a basic capability of intelligent agents. In "Learning to Navigate in Cities… RT @Jason_Healey: With Cyber Command's new "Vision" state, US in midst of resounding policy shift on cyber conflict w/ profound implication… RT @jackclarkSF: New op-ed by @hlntnr + me in @PDChina on malicious actors & AI & the need for greater international collaboration on these… RT @Luke_Metz: Checkout our new work on Learning Unsupervised Learning Rules! https://t.co/lpeYOfxUgj Done with my amazing collaborators @n… RT @j_foerst: QMIX: An exciting new method that combines centralised Multi-agent learning under decentralised execution with Q-learning! If… Looks interesting. I wasn't persuaded by the authors' claim elsewhere that AI-related automation is all (mostly?) about predictive tasks, but it's an interesting perspective, and there may be other useful economics stuff in there even if you don't agree. https://t.co/CkOjuMnkXG @AnnaBeiler Thanks! :) @AnnaBeiler @clarkamiller (Re: SF’s value generally - i also have some slides on AI in particular but less academic https://t.co/HcittfEse3) @AnnaBeiler I think it can be a valuable resource! ASU’s own @clarkamiller and Ira Bennett have a nice paper on this :) https://t.co/qVtInTxizA Check out @jjding99’s newsletter, ChinAI, for regular updates on AI in China, including translations of important docs you can’t find in English elsewhere: https://t.co/lf0eXqCKmg @L_badikho It didn’t even try/give me an option because the English ratio was too high :) Thanks also to many others for help along the way! @clarkamiller for feedback + encouragement for years, folks at @FHIOxford for support + tolerating my dual affiliations, @rao2z for accepting my dubious application to take his AI class (and asking great Qs at defense), etc. :) @mariadelcuy It’ll be online on ProQuest/my website etc. at some point - timing still being negotiated :) @Smerity @erik_fisher @j2bryson @femmefutura ☺️ Thanks to my excellent committee, Dave Guston (chair/not on Twitter), @erik_fisher, @j2bryson, + @femmefutura! Still much more to be done edit-wise but glad to be past that particular hurdle :-) Dissertation defense ✅ @nonja_master There are refs, they’re just numbered rather than spelled out RT @chipro: A couple of things I learned in the last few years. "A survivor’s guide to Artificial Intelligence courses at Stanford" https:/… @zacharylipton I was thinking about this earlier. Fortunately it was also shown around the same time that we have nothing to fear: https://t.co/FGJCkj4rMf RT @MelodyGuan: Also check out @carpedm20's implementation in Pytorch https://t.co/tEkbj34vo2 RT @MelodyGuan: Efficient Neural Architecture Search (ENAS) code is now available https://t.co/4tnkBf3fBT RT @elonmusk: Elon was found passed out against a Tesla Model 3, surrounded by "Teslaquilla" bottles, the tracks of dried tears still visib… RT @TheOnion: Jumbled Nest Of Cords Makes Move To Third New Apartment https://t.co/dEE3vRPPKi https://t.co/pScmg7DwZ6 RT @sapinker: Excellent collection of new essays: "Should we fear artificial intelligence?" https://t.co/CmG6ypzu3b @j2bryson @ASU I’m not v. familiar w/ Phoenix but it’s private, vs. public (ASU), neither owns other. ASU has been pretty proactive in pushing online - they have a partnership with Starbucks for their employees to take online classes. RT @seb_ruder: 1/ People (mostly people working with Computer Vision) say that CV is ahead of other ML application domains by at least 6 mo… RT @jacqui_gavin: On the 31st March it is International Trans Day of Visibility and I challenge all of us to recognise Trans people across… @robmccargow you know, there was this Obama guy who also did interviews with Wired... 😢 RT @foxandfriends: .@AmbJohnBolton tests out the Simply Fit Board... https://t.co/Jb2pFNBCXs RT @geeknik: Chinese smugglers use drones to transport $80M worth of iPhones https://t.co/WvWmgogQYh "@Smerity 😍 That arXiv page must have taken a while" RT @Smerity: ReLU isn't the only piecewise activation function to work well. Introducing the NUGGET Non-Linear Piecewise Activation, the re… @mattsiegel @oliviacpu I thought you meant the sci-fi author :) RT @RealAshEdwards: We encourage submissions broadly related to specifying goals for reinforcement learning agents and problems that can ar… RT @RealAshEdwards: I'll be co-organizing an ICML/IJCAI/AAMAS workshop on goal-specifications for reinforcement learning with Himanshu Sahn… @Iwillleavenow Checked out Brooklyn 99 because of this - hadn’t heard of it. Thank you for your service, it’s pretty good. RT @pwnallthethings: CEO of company that removed VPNs and various end-to-end encrypted messaging apps to help Chinese authorities bulk-surv… @daniel_bilar @NKPyo And/or American Chopper? One or both of those. i don’t watch them @daniel_bilar @NKPyo It’s some of the stars of the TV show Orange County Choppers @xpasky @ESYudkowsky @xuenay @Plinz the "self aware" thing also seems like the sort of thing that people who aren't familiar with the arguments and/or don't find them compelling say. @xpasky @ESYudkowsky @xuenay @Plinz I can't prove that it's intended as a putdown obvi but the use of terms like "seem to worry about" suggests to me he doesn't view it as a legit concern. It *seems* dismissive to me :) RT @googleresearch: France has a very dynamic and active #MachineLearning research community, so we are excited about expanding Google’s #A… @ESYudkowsky @xuenay @Plinz I am not sure if we disagree/if so, what about. Yes, it was non-neutral and a putdown. RT @wsm1: Love these off-angle shots from around the world! Hard to believe the cameras are ~1,000 km away! My fav 3 copied, some more on m… @xuenay @Plinz @ESYudkowsky (I also found it somewhat surprising, though, coming from Munroe, whom I previously thought of as ~Tim Urban, but I also don't read it that regularly) @xuenay @Plinz @ESYudkowsky +1. There are many commonly held clusters of views on things like timelines, the usefulness of present safety work, and the scale of misuse risks that could justify this conclusion without incoherence, even if they're wrong. RT @china: China’s top apps user respond to user privacy concerns https://t.co/TGvof46ykF by @technodechina https://t.co/MiVhyjPFPx "Colorless green recurrent networks dream hierarchically," Gulordava et al.: https://t.co/qdcWrSrAAY "Protection against Cloning for Deep Learning," Richard Kenway: https://t.co/71locQJBt9 "Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks," Gupta et al.: https://t.co/Af6jAux4ol """Cracking the cocktail party problem by multi-beam deep attractor network,"" Chen et al.: https://t.co/tO4GDumdLn Big improvement on the cocktail party problem in speech recognition." """Universal Sentence Encoder,"" Cer et al.: https://t.co/343cgr8DxZ Nice that they also investigate bias, drawing on @aylin_cim, @j2bryson, and @random_walker's work." This is very cool - "Who Let The Dogs Out? Modeling Dog Behavior From Visual Data," Ehsani et al. at UW/AI2: https://t.co/Ep4LZOJfwY https://t.co/crk1fiZLRE The actual ICML 2018 Debates will be a lot more interesting (and safe)! Submissions are due April 23rd. https://t.co/xs6BBu4Yr5 @hardmaru https://t.co/Qfxu4TQVRo @hardmaru Done. @psygnisfive @GaryMarcus @ylecun But people who happen to have similar views are welcome to submit ;) @psygnisfive @GaryMarcus @ylecun "This is a work of fiction. Names, characters, businesses, places, events, locales, and incidents are either the products of the author's imagination or used in a fictitious manner. Any resemblance to actual persons, living or dead, or actual events is purely coincidental." https://t.co/xs6BBu4Yr5 https://t.co/s7vqB78S9U Where are all the "guys yelling at each other/throwing chairs" memes for AI? Do I have to do it? Come on. RT @EmmanuelMacron: Thank you @DeepMindAI, @demishassabis for choosing France and french talents to keep making the world a better place us… @LucasLiu_NJU Thanks, it is not my paper and I haven’t looked at it closely, perhaps you could contact the authors. @awjuliani I was guessing Science :P RT @pomarius85: New jobs open at @FHIOxford: Senior administrator, web & comms officer and research positions in AI Safety and Macrostrateg… RT @RealAshEdwards: Excited that our work from my internship at Google Brain is now on arxiv! Forward-Backward Reinforcement Learning: http… RT @rebecca_roache: Weld done, Marco! https://t.co/0gHZSZxbv4 RT @demishassabis: Thrilled to be opening a new research lab in another of Europe’s great AI research centres. Can’t wait to see what Remi… RT @DeepMindAI: Announcing our first #AI research lab in continental Europe, #DeepMindParis, and a return to France for Remi Munos / Nous a… RT @mpd37: You really should apply! Last year's indaba was the best event I attended in a long time. https://t.co/HEBFWDM7Dm On addressing partial observability in deep RL with fancy neuro-inspired memory. "Memory, RL, and Inference Network" = MERLIN. DeepMind's been upping their acronym game lately. https://t.co/V8400Po9U5 (this is a defensively oriented paper but most of this stuff is dual use and I'm just expressing concern about the general trend) Good thing AI systems are super robust and transparent, or else we'd have big problems when the technology is weaponized in cyberspace """Initial Reference Architecture of an Intelligent Autonomous Agent for Cyber Defense,"" Kott et al. at...um...a bunch of NATO countries under the auspices of NATO: https://t.co/aMQMthY4hH 🧐🤔🤖🔥😑" (Saggs, 1989 = original, excerpting by Lipsey et al., 2005) "Machine learning researchers bemoaning cloud AutoML I mean scribes and phonetic writing (Kidding, mostly, don’t @ me) https://t.co/a7mBzrOspu" "Forward-Backward Reinforcement Learning," @RealAshEdwards et al.: https://t.co/k7AuSqUyuz "Unsupervised Predictive Memory in a Goal-Directed Agent," Wayne, Hung, and Amos et al., DeepMind: https://t.co/DRhIoVFzAj RT @Iwillleavenow: Hello, I have decided to start a war. https://t.co/fR3OIpvFzS @Iwillleavenow 🧐 RT @IrwanBello: A short blog post about Neural Optimizer Search and our new #Tensorflow optimizers! https://t.co/dQwyRu2Qkk RT @FHIOxford: We are excited to announce the job opening for a Sr. Administrator. S/he will be a proactive go-getter who will work with th… @hardmaru I look forward to the dream-within-a-dream sequel. https://t.co/W2MGJ9zGkK It's a sign of the importance of compute, and NVIDIA's savviness, that a bunch of people I know are at a GPU-oriented conference right now. Someone should write a paper about such things (*cough* read @timhwang's paper *cough* https://t.co/Lc3CX0QBDB). (business ethics is complicated/the China move may have been justified from a consequentialist POV, but "human right" is a strong claim, just sayin) "Tim Cook: privacy is a human right Also Tim Cook: https://t.co/FrD4XbMcmn" @samim yup. Bob Mercer is basically the Man in Black from Westworld. https://t.co/T0suQRtt0u @Sam_L_Shead Why would they want us to “forget about” it? Makes it sound dirty. Seems like an early effort that isn’t especially controversial or interesting. @Sam_L_Shead Why would they care? "RT @pyoudeyer: The French #AI report by @MissionVillani in english (pdf) https://t.co/Ll3I7hkkyo @Miles_Brundage" Is there an English version of the French AI plan or anything good written on it in English? @marwinsegler @nature congrats!! RT @marwinsegler: Machines can learn to plan the chemical synthesis of molecules autonomously, using deep neural nets, MCTS and symbolic re… RT @sama: You can be wrong on a lot of decisions if you are really right on a few huge ones. Optimize for the magnitude of your good decis… @samim @halhod https://t.co/1hIR1CrCKZ @samim @halhod Have you read Walkaway? He was wrong about a lot of things, but I like his ambition. Unfortunately he died just on the verge of the current machine learning revolution - if he'd lived, I think he'd have a lot to say about how all the emerging pieces fit together. "Underrated visionary - James Albus: https://t.co/cwmhEwZZW1 ""Outline for a Theory of Intelligence"" ('91) detailed an elaborate AI architecture with neural net building blocks https://t.co/aoAqjck7pt Worried about redistribution decades before it was cool https://t.co/W7bgothUAt" "Some great stuff here - thanks for sharing, @ylecun! (Note that the ""private video"" icons can be ignored, just click on them and see what they are. Not sure what's up with that.) https://t.co/isuTy8iBdN" "RT @ylecun: Videos of the talks at the workshop on Canonical Computation in Brains and Machines held at NYU a few weeks ago. Incredible sp…" RT @hardmaru: Neat work from @DeepMindAI that generates the brush strokes of a painting using the discriminator's output as a RL reward sig… RT @JanelleCShane: It learned to dream its own (sometimes glitchy) version of Doom, then learned to beat it. The dream-training helped it b… "Fast Parametric Learning with Activation Memorization," Rae et al.: https://t.co/KfRbt4BHqK "Accelerating Empowerment Computation with UCT Tree Search," Salge et al.: https://t.co/MdeKFrDO4e "Learning to Branch," Balcan et al.: https://t.co/Pt1prHKd5z "Connectionist Recommendation in the Wild," Pardos et al.: https://t.co/Q15jX1NBCw "Equation Embeddings," Krstovski and Blei: https://t.co/4mLdvGOVSd "code2vec: Learning Distributed Representations of Code," Alon et al.: https://t.co/4wKbIeI7aB RT @deviparikh: Check out Neural Baby Talk (spotlight at #CVPR18) by @jiasenlu and @jw2yang4ai. Code: https://t.co/kSYbPUCSNQ. Paper: https… Best names in AI: Mausam, Rif A. Saurous... ? @hardmaru There’s a time and a place for both - in this case having both was nice :) """Facebook's Advertising Platform: New Attack Vectors and the Need for Interventions,"" Faizullabhoy and Korolova: https://t.co/onO6b8SbKO ""Facebook’s response to our “Single-House Targeting” report shows a disregard for the need to limit the ease of targeting marginalized groups.""" RT @rcalo: An interdisciplinary team @TechPolicyLab asks: Is Tricking a Robot Hacking? https://t.co/1Xrj3yN3SB Thoughts welcome on this ear… David Ha, Jurgen Schmidhuber, deep RL, world models, https://t.co/X3KVACEL5d style article... this is out of control. 😍😍😍😍😍😍😍 https://t.co/HRyEmPTPC1 "RT @hardmaru: Our work on ""World Models"" is out！🌐 Can neural network agents dream, and learn inside of their own dream worlds? Read more…" RT @AP: BREAKING: Seoul says Beijing confirms visit of North Korean leader Kim Jong Un to China, his first foreign trip since taking power. RT @DeepMindAI: By learning to write programs that generate images our artificial agents can reason about how digits, characters and portra… RT @jackclarkSF: If you are at #GTC18 (or are just generally involved in AI) you should be talking to @katyanna_q - she will have read your… "*Tony Stark voice* I need it. https://t.co/rXgKX3m4DH" @JFoss117 Mostly just news articles/poker press stuff, not academic, though see e.g. https://t.co/pkWa7UmV1a RT @MichaelHBowling: @Miles_Brundage Another interesting angle is the legitimate uses of AI in online poker, e.g., training and analysis.… RT @Waymo: Introducing the world’s first premium electric self-driving vehicle – the Waymo @Jaguar Self-Driving I-PACE. https://t.co/BKhofA… RT @DeepMindAI: The next step for WaveNet - powering text-to-speech on Google Cloud Platform https://t.co/VDAGZXp33o It's an interesting case study. I think I made a mental note to look into this more after talking to @MichaelHBowling one time but then the note got deleted unfortunately :) "One thing I wish we had covered in the malicious use of AI report (https://t.co/eOcORdX7W0) is the use of bots in online poker. Pervasive use going back years, cat and mouse game of detection, rapid assimilation of research breakthroughs, + real $ impact." Maybe AI will go faster than that, maybe not. Certainly we don't yet have the widely usable/widely applicable killer application that would enable it, though - stuff like cloud AI/AutoML is hinting at it but still not quite there. E.g. ppl like to say AI will lead to faster change than previous technologies... besides there being negligible evidence for big impacts yet (mostly bc AI is still early in its development IMO), stuff like cars happened v. fast (<10% to >50% households in less than 2 decades). (there will def. be some actually novel effects of AI but it's not clear whether those will be more important than the first category of effects) Anyway, TL;DR: recommended if you want more historical perspective on "New/Fourth Industrial Revolution" type hype. A key way AI/automation more generally could be important is through making Gordon-type-stuff cheaper/better/more widely available, not novel consumer experiences per se. See: "task expedition" and "leisure society" discussions in this new publication. https://t.co/DXYMF3IZ7y I think AI, for example, will ultimately be a very big deal, but clearly nothing shown to date is remotely comparable to electricity, cars, refrigeration, improved medicine, etc. Gordon does a good job of showing how many crazily important things happened in a v. short window. Book I think a lot about: The Rise and Fall of American Growth. Highly recommended for a reality check re: claims that certain technologies are a huge deal. People often forget how big of a deal other things were. Original thread on the topic: https://t.co/jy50y7a0Xj @abigail_e_see @jekbradbury You had a wider emotional range than Scooter Man! @clarkamiller indeed. In other news, Ball Lightning, a stand-alone novel by Liu Cixin, is released in English in a few months. Take my money for both of these now and get them here sooner, please 💵💷💶 😍 https://t.co/5rCmq59r6R RT @togelius: The rare case of an honest research paper. This is how papers should be written. https://t.co/H4BuAeOevJ RT @timhwang: one thing frequently missed in discussions about artificial intelligence is the complex role that hardware plays in shaping i… RT @JeffDean: Stanford's DAWNBench is a new benchmark suite measuring a variety of deep learning training and inference tasks. Google Cloud… and 3. enabling a prosperous leisure society. These benefits are not guaranteed by progress in AI, but AI may be necessary for them. They're enabled by a generic feature of AI (which also enables large-scale misuse) namely the combination of scalability with competence. (2/2) TL;DR (2 tweet version): AI, if well governed, could have hugely positive effects, which I cluster into 1. speeding up progress in important areas, like science/medicine, 2. improved coordination (e.g. via privacy-preserving surveillance for arms control verification), ... (1/2) @zacharylipton Noted, sir. https://t.co/afgRFMFTbp This was related to an event a few months back: https://t.co/TTfg2fJPx0 (there's a video but unfortunately it doesn't include slides) @zacharylipton It's evidence against the "far outside the AI/ML orbit" claim - he has a formal link to a top lab/part of some related conversations. But yes, that on its own does not imply he has a lot of AI domain knowledge. "I contributed a chapter to this EU document with various perspectives on the future of AI - https://t.co/997edBRwzv If podcasts are more your style, I discussed the chapter with @JohnDanaher a little while back here: https://t.co/4G6Kbi0lvY https://t.co/h8xlhh9bXs" You will get through this @BrundageBot. Maybe not you, @BoredMiles Tomorrow's arXiv update (the normal Tuesday load plus the delayed weekend batch) will be 🔥🔥🔥 @zacharylipton (He’s also a DeepMind advisor) @zacharylipton E.g. https://t.co/iG33JJD26O among others @zacharylipton Sachs actually has several publications on the economics of AI RT @Evan_Rosenfeld: BREAKING: AP: Arizona governor suspends Uber from autonomous testing following fatal pedestrian crash he says raises sa… @cipri_tom dunno @hardmaru @BrundageBot not sure :) @amaub arXiv is dead, long live https://t.co/E5SiQjyGqg @zeitzoff Congrats! "RT @hannawallach: ICYMI!!! New working paper!!! 📝 Locally Private Bayesian Inference for Count Models by @AaronSchein, @zstevenwu, Mingyua…" @ericjang11 Reread some bits of Flowers for Algernon a minute ago at a bookstore. I’m totally fine, nothing to see here https://t.co/YA4Bxl6qle RT @beenwrekt: For my optimization followers: introducing ML to the utility of performance profiles. https://t.co/WJLzBSqLBL https://t.co/k… "RT @alxndrkalinin: DQN Adventure: from Zero to State of the Art https://t.co/4f13IDVUyz An easy-to-follow step-by-step Deep Q Learning tuto…" @Iwillleavenow The Path is pretty good Great paper! https://t.co/2P1J22XuY2 RT @y0b1byte: My notes on “Kickstarting Deep Reinforcement Learning” (https://t.co/ICvlNBvYuI) by S. Schmitt, J. Hudson, A. Zidek et al. @s… @factorwonk good point, I was vague - I'd be interested in answers that consider both pre- and post-movie stardom, but I guess I meant pre-movie stardom. @Zergylord yeah I just was suggesting Primer before I saw your tweet. Will check out Following. "Besides those mentioned in the replies, some candidates from me: High ratio: Adventures of Pluto Nash (not super star-studded but incredibly low quality) Low ratio: Primer" @aCraigPfeifer @ThatKevinSmith Of high or low? @aCraigPfeifer however, Moneyball the movie does not do well by these metrics :) Neither very high nor very low (pretty good cast, pretty good movie) Which movies have the highest and lowest ratios of star-studdedness to quality? RT @DeepMind_Health: Have you shared your thoughts with us on how companies like DeepMind should be working with the NHS? We're closing the… Looks like a Very Real Book™ https://t.co/0PwHuM71Bf "DOP: Deep Optimistic Planning with Approximate Value Function Evaluation," Riccio et al.: https://t.co/XhLLU2bUqq """Fictitious GAN: Training GANs with Historical Models,"" Ge et al.: https://t.co/bY7aVpf15v Fictitious play inspired approach to training any kind of GANs, purported to resolve convergence issues by training against an ensemble of old models." """SEGEN: Sample-Ensemble Genetic Evolutional Network Model,"" Zhang et al.: https://t.co/khFQMya26u This looks cool..." "Explicit Reasoning over End-to-End Neural Architectures for Visual Question Answering," Aditya et al.: https://t.co/GyG3UXePH1 """Studio Ousia's Quiz Bowl Question Answering System,"" Yamada et al.: https://t.co/YHj28WlLly (winner of NIPS quiz bowl competition)" Second claim seems dubious to me (all data I’ve seen on this seems pretty partial) but agree with the message. With federal science funding mostly saved recently (no thx to the White House), immigration policies are now main threat to US competitiveness. https://t.co/JvOObRGYHb RT @Selina_y_wang: Chinese students get 10% of all doctorates awarded in the U.S. There are more Chinese engineers working on AI at U.S. te… "RT @Liv_Boeree: The human mind gets weird when it thinks about extinction risk. Kind people - who would presumably never dream of hurting…" RT @valleyhack: Turns out Zuck will be unavailable to testify before Congress https://t.co/3s7InR9Vok RT @donmoyn: Justy a sample of what NRA supporters are doing to teenagers who survived a massacre (real picture on the right). https://t.co… RT @jjding99: Check out the Solving the AI Race round of the @GoodAIDev @ai_challenge - need people from different backgrounds thinking abo… RT @magnord: I’ll be talking about deep reinforcement learning in AAA games tomorrow at #GTC2018 https://t.co/SxsMgga19T @PatrickOmid they forgot to credit me for taking the photo at DM's office... @hannahgais Correct @ivan_bezdomny (I'm a GAN fan (FAN?) but want to her about other stuff too) @ivan_bezdomny Would be very interested in that. One doesn't hear as much about unsupervised learning these days outside of GANs. The last time I got excited was this https://t.co/0N3IWQST1K but just checked and most of the citations to it are GAN stuff :) @ivan_bezdomny I enjoyed your AI talent thing. @ivan_bezdomny Would be interested in more tweets (or other forms of commentary) on those too! do your part to increase the signal/noise ratio ;) @ivan_bezdomny Also consider submitting here ;) https://t.co/xs6BBu4Yr5 I would be interested in thoughts on non-poker impacts of imperfect info research; computer poker forecasts; the DL world according to (someone at) NVIDIA; + stuff ppl aren't talking about/I can't predict :) RT @matt_slotnick: genius at work https://t.co/XeB1WmcOb6 @jeffclune but re: non-DRL approaches rivalring current highest claimed performance of DRL systems (independent of if that's been validated/reproduced). See also this (of which DeepMind has been guilty, calling A3C/UNREAL etc. "SOTA" despite higher scores elsewhere) https://t.co/sdkn6C0LQ0 @jeffclune on the other hand, some of those papers (e.g. Ape-X) don't report individual scores, + few post-DQN/A3C algos have good open source implementations, so it's reasonable to use better tested/implemented ones as baselines. My skepticism was not re: utility of your/others' papers, + @jeffclune I think it's super interesting, too, for the record! I'm a fan of neuroevolution and of challenging DRL hype :) Re: "weak," that's a tricky question. They are not SOTA, and have been surpassed in median score/individual scores (NoisyNet variants, dueling nets, Ape-X, etc.) RT @jvmancuso: @beenwrekt @Miles_Brundage Somewhat related, awhile back I worked on a comparison of OpenAI's Parameter Space Noise and DM's… @jeremyphoward @katyanna_q https://t.co/fHRPJc93YG RT @MelMitchell1: #MarchForOurLives #Portland #pdx https://t.co/QPubpjP4li RT @zeitzoff: Results of non-scientific Twitter poll, suggest poli sci Twitter is increasingly worried about a military strike on North Kor… @Omair28Khan @markus_with_k @schmidhubered Yes that one, thanks! RT @KaiLashArul: There's still more to come from DRL and EAs. It's been a good reminder that DL isn't the be-all and end-all of ML, and I h… RT @animesh_garg: @beenwrekt @markus_with_k @Miles_Brundage I agree with @beenwrekt mostly, DRL on complex dynamics has a harder time -- ht… RT @animesh_garg: @beenwrekt @markus_with_k @Miles_Brundage And the line of works which argue Random Search or evolution is working at par… RT @KaiLashArul: I'll give this a stab. AFAIK the best scores on Atari are DRL works - taking DRL to mean NNs trained via gradients compute… @markus_with_k @beenwrekt (Also some follow up work: https://t.co/r40eufFlvS) @beenwrekt Mostly - not all robotics or DMLab/Psychlab stuff is really game-y (some is directly based on psych experiments for example). But all artificial tasks, sure @beenwrekt They typically don’t release code for papers (+have said the reason is that it’s too connected to their proprietary code related to TPUs etc.). @KaiLashArul has reproduced many of them, but as you know, there are issues with reproducibility :) (and some are v. compute-intensive) @markus_with_k @schmidhubered Er, actually, a more specific page - something about the ensemble ultimate theory of everything (Tegmark’s related theory) @markus_with_k @schmidhubered Multiverse page on Wikipedia @olgakharif @technology Is this different from Trillian? @beenwrekt instances of SOTA performance on some robotics-related task judging from the volume of Berkeley folks' papers alone, though maybe w/ imitation involved, + not sure what baselines are. could be wrong, though, that's part of why I mentioned this, to get people's reactions. @beenwrekt re: what else it's SOTA at, good Q - various things would seem to plausibly count, e.g. Go, chess, shogi; VizDoom/DMLab/Psychlab [though don't know if people have tried other approaches hard]. can't speak to real world or MuJoCo robotics, but I'd be surprised if there weren't >0 @beenwrekt re: first Q: depends on metric (specific game(s), median/mean, initial conditions, frames etc.) but some good ones that I think are superior to non-DRL results include NoisyNets (https://t.co/c7vymdC0gq), IMPALA (https://t.co/ArJkFqjPEZ), + Ape-X (https://t.co/zD8LkiAy4P) RT @jonathanwpeters: I was just thinking of how weird my hard drive would look to anyone unfamiliar with First Amendment law. https://t.co/… @yannick___m This one: https://t.co/BgVB3gSjfi (don't agree with all of it/remember all the details but this was intended to be a catch-all pick for "left-leaning politics/vaguely pro universal basic income/optimistic political messages needed etc." "My #WorldviewIn5Books: Doing Good Better Global Catastrophic Risks The Measure of All Minds Strategy and Arms Control Inventing the Future" @hardmaru @MatthewGuz it was an A+ meme :) @spysamot @togelius @mjntendency on my reading list :) @FelixGoldberg1 though most who use those analogies just mean something much simpler (~"AI is a big deal") @FelixGoldberg1 hopefully soon :) but briefly, there's a lot of interesting history around the role of governments, business, societal norms, innovators, etc. in influencing how stuff happened historically, and economic theory around general purpose technologies, etc. that is relevant to AI "people who knows anything" https://t.co/bkwmbcMBxp (I actually think there are very illuminating analogies to be drawn, but people rarely seem very interested in actually looking into them) Fun fact: there is little overlap between people who describe AI/data/automation as the new electricity/oil/Industrial Revolution and people who knows anything about electricity, oil, or the Industrial Revolution. @dtsbourg @adriancolyer I like comment 3 :) RT @dtsbourg: First edition of reading notes! Self-Normalizing Neural Networks, by G. Klambauer, T. Unterthiner, A. Mayr, and S. Hochreiter… @togelius @MatthewGuz If only there were a venue for someone to write an opinionated article on this *cough* https://t.co/xs6BBu4Yr5 *cough* :P @Kaaz1992K @dennybritz yeah, I didn't mean to suggest NoisyNet is the SOTA - I'd suspect that's IMPALA, Ape-X (if you are willing to count scores after a ton of frames), or something else - it just was the first one I looked up at the moment which had all scores conveniently listed in a table :) @MatthewGuz 100% agree with that for the record ('m bullish on it getting more efficient, and think it makes much more sense when bootstrapping from imitation or simulation or other things but not there yet). I just think hype-within-the-context-of-research-benchmarks is justified :) @Kaaz1992K @dennybritz (it is a good baseline for sure, though, in any case, and especially good when training time is limited/some hard exploration ones like Frostbite) @Kaaz1992K @dennybritz thanks! Yeah, I think this is consistent with my point re: weak baselines - DQN and DDQN are not SOTA anymore, and NoisyNets (published before the neuroevolution paper) outperforms all of those including GA by a large margin on all but Frostbite and Venture, I think. "Tired: AI is the new electricity Wired: AI is the new electioneering" Take a break from AI for a minute to muse about multiverses and you get @schmidhubered https://t.co/hl8XO2sV4W @MatthewGuz @hardmaru made meme about it but not sure how serious he was :P @MatthewGuz Def. agree they're good baselines. It just seems that some folks take the narrative further than that, even if that's the logical conclusion of the papers. Trying to find good examples of such DRL bashing, haven't found it yet but pretty sure it exists :) Similar things could be said about some of the classical planning stuff for Atari. DQN is not the key baseline for 2018... though I do really like those papers, e.g. https://t.co/2OVkqOmnxI cc @hardmaru @KaiLashArul https://t.co/yKjzxvtguK Part of the issue/ambiguity here is that people mean various things by "competitive with X" (could be a little better than X, or not strictly dominated by X on all possible metrics) and "state of the art" (could be the GOAT or something pretty good from the past 2 years) I'm pretty sure this is true for Atari (don't think anything outside DRL is competitive with e.g. IMPALA) but I'm less familiar with the Wild West that is MuJoCo evaluation and some of the papers in this spirit use that. (Not making a claim about specific papers overstating their results, just about others' interpretation of them to say that DRL is lame) My rough sense is that some "random search or evolution beats deep RL" stuff is overstated, often using weak baselines for DRL or different means of evaluation. Random search/evo have advantages, but not best final score RN. Haven't looked into it super closely though. Thoughts? Upcoming deadline on OpenReview: https://t.co/tlNj4OKNtM @EdwardRaffML @catherineols @timhwang @jackclarkSF Sorry for the slow reply! Yes. @ericjang11 You first @GregoryMcNeal @rcalo Ryan made a permissionless tweet "RT @hannawallach: More exciting news!!! My latest working paper is now online!!! 🎉🎊 Datasheets for Datasets by @timnitGebru, @jamiemmt, @…" @RebeccaCrootof @CCW_UNODA https://t.co/1hjSRlhiHt "RT @haldaume3: this was a super mind-expanding paper to have been able to be a part of ""Datasheets for Datasets"" aka how can we move towa…" RT @TheDailyShow: WHITE HOUSE: Lead legal counsel John Dowd to be replaced by 75-inch Samsung television https://t.co/9CDtnDF6qh RT @hlntnr: This is going to be amazing and is already making me doubt my decision not to go to ICML. You should totes be there. https://t.… @lukeprog Thanks! (I was indeed thinking about educational purposes) "RT @sindero: New work with colleagues from @DeepMindAI. Kickstarting Deep Reinforcement Learning proposes a paradigm where 'teacher' agen…" @lukeprog do you recommend Enlightenment Now and The Big Picture to those already predisposed to those perspectives? and specifically me? :) "Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddings," Chen et al.: https://t.co/Ax4TlogBvL RT @Smerity: Simplicity is still competitive! Standard LSTM/QRNN models can achieve state-of-the-art results on character (PTB, enwik8) + w… "Gradient Descent Quantizes ReLU Network Features," Maennel et al.: https://t.co/dCxBSZDOXo "Group Normalization," Wu and He: https://t.co/S4UbaMyJCp "RT @KELLYWEILL: what she says: im fine what she means: t-pain is a gifted singer who tried to distinguish himself in a competitive field by…" "Cold take on IMPALA (see also hot takes below): Multi-task RL performance on diverse tasks (Atari) in 2018 = similar to single-task RL circa 2015. Multi-task RL on similar tasks (DMLab) in 2018 = similar to single-task RL circa 2019 (positive transfer). https://t.co/saHAs5enTp" RT @WonderMicky: Why this looks like a victory in light of the proposed White House budget for FY18. Btw, #HEP is funded under DOE Science… "RT @jeremyphoward: More terrific work from @Smerity :) Single gpu simple models trained for a day or so beat all comers. Good example of…" RT @rbhar90: It's an amazing feeling to spend time at your day job learning about zeta functions of elliptic curves on projective planes fo… "RT @Miles_Brundage: Marvel: ""Infinity War is the most ambitious crossover event in history."" @timhwang, me, @jackclarkSF, @catherineols,…" "Good points from @L_badikho on #deletefacebook and its discontents: https://t.co/txnzM5KRbX" "RT @DrBeef_: Exploring the latent space of AI-generated landscape paintings today instead of doing work. Please do not tell my manager. ht…" (In all seriousness, there are many good people serving at lower levels who are admirably making things less bad. But the upper echelons of the WH proper are something else entirely) Reminder: https://t.co/MrpcSbawVR RT @BBCBarbaraPlett: The new National Security Advisor #JohnBolton has published a legal argument for a preventive strike on #NorthKorea &… RT @lindsey_brink: In the Trumpocracy global crisis Jenga game, the whole edifice is now tottering atop the Mattis block. Please nobody eve… @MatthewGuz @ArtirKel I said small! ;) @MatthewGuz We prob. wont resolve that disagreement via tweets but I’m happy to make a small bet ;) have one with @ArtirKel on this already As @twitskeptic said, he was a RISCy choice for chair of Alphabet. https://t.co/pLl11ZCxOK @MatthewGuz Thanks! We shall see :) I’m prob. more bullish on StarCraft (would be surprised if it were *more* than a few years) but that’s partly because there is big effort/competition going into it. TBD if that’ll happen with BF1 or other games. @EBKania Come to Tempe, AZ and you’ll see em all the time (at least pre-Uber accident)... I wouldn’t be surprised if China saw decent deployment soon. Ng previously suggested starting with fixed bus like routes but if I can survive biking in Beijing, prob not massively harder than US @MatthewGuz But I guess the takeaway is you don’t see it as just a matter of more training, better exploration, etc. @MatthewGuz Wasn’t wedded to the 50% thing, just trying to get a rough sense of how far is far (5, 50, 500 years ;) ). And I agree it’s more about ideas than time, but time easier to quantify/one could assume roughly a constant level of effort @MatthewGuz What’s your guess for time until 50% chance of full game AI supremacy? @MatthewGuz Still wouldn’t be that surprised by the full game “before too long” but that’s more like years, not months for the sub-game I had in mind. @MatthewGuz I was thinking of basic battle + navigation, a la this simplified sub-game, not the full game. (Spinning around in circles is a bit better than rushing into battle and dying) Probably better than me (though that doesn’t say much), wouldn’t be surprised if it were better than everyone before too long. 🔫🤖 https://t.co/rBJN8qEnEP RT @verge: EA has started training AI players in Battlefield 1 https://t.co/qxNrNHRpO7 https://t.co/ceauJ5mcys RT @ZekeJMiller: WASHINGTON (AP) — Trump announces former U.N. Ambassador John Bolton to serve as national security adviser, replacing H.R.… @mat_kelcey @rogerclark Then this is super up your alley @mat_kelcey @rogerclark Will check out. You may dig Crystal Nights too. https://t.co/0XPtX312CI quite timely with the return of evolutionary methods RT @seed: Q&A interview with @magnord with more details of how we are trying to teach neural network AI to play Battlefield 1 https://t.co/… @rogerclark Thanks! So far I’ve just read a bit of this and the story Crystal Knights which I liked @rogerclark Diaspora sounded more interesting to me than Permutation City...? Thoughts? In any case, the former is where I’m starting. Seemed to cover some similar ground. I now see what the Greg Egan hubbub is about. RT @RepStefanik: An independent National Security Commission on Artificial Intelligence (AI) is critical to ensuring that the United States… RT @rao2z: Looking at this awful disengagement statistic, and my own subjective experience of never having passed by an #selfdriving @uber… RT @elasri_layla: Montrealers, A TechAide AI conference will be held on Apr 17. You'll hear about the latest on AI from @JeffDean and other… RT @catherineols: Note that papers *may draw on existing work*, so if you've already expressed your opinions somewhere - in a blog post, a… "Marvel: ""Infinity War is the most ambitious crossover event in history."" @timhwang, me, @jackclarkSF, @catherineols, Shourya Roy and @sandyasm: https://t.co/xs6BBu4Yr5 https://t.co/j4H2n0x9Vo" @roeldobbe @timhwang @icmlconf @catherineols @jackclarkSF 2-5 pages "RT @catherineols: I'm co-organizing an ICML workshop to host debates on the future of AI: https://t.co/ep0YX5guaP Notably, the focus is *n…" RT @catherineols: We're looking for short position papers (ex: https://t.co/WV5HHM7mqa) on topics such as limitations of deep learning; app… "RT @fulwoodomys: Marvel: ""Avengers Infinity War is the most ambitious crossover event in history."" Me: https://t.co/ffgOv8Eltg" RT @timhwang: For @ICMLConf, excited to announce a workshop I’m organizing w @catherineols @miles_brundage @jackclarkSF and others that’ll… @francoisbecker https://t.co/31ApUMMScV (specifically he seemed to refer earlier to Putin mentioning New START extension, so bilateral nukes stuff...not aware of any mention of hypersonics in particular or anything else, so very curious if I missed something) Did anyone ever ascertain what was meant here by arms race? In context of remarks earlier mentioning Putin's overture early in the Trump admin, it seems like he prob meant "something something nukes" but also plausibly something else (hypersonics etc.). https://t.co/z1ZAaCD6fX RT @boredyannlecun: So excited to announce that this year I will be delivering the plenary roast at #nips2018! Watch out @alirahimi0, @Gary… "Learning Robotic Assembly from CAD," Thomas and Chien et al.: https://t.co/hiBaeVp6JB "Twitter for Sparking a Movement, Reddit for Sharing the Moment: #metoo through the Lens of Social Media," @maidylm et al.: https://t.co/RJRVTFPD6S "RT @rao2z: 1/ On first look at #uberaccident dashcam viideo we will likely picture ourselves as the driver. (https://t.co/ONN2DSKjWF) Ins…" @calebwatney @rcalo (And the “driver”) @calebwatney @rcalo Gotcha, haven’t looked super closely. That + it being near a concert venue that lets out late were the first things I thought of, but if Lidar/radar weren’t working or used, seems like that’s the bigger deal... @calebwatney @rcalo Also have people discussed whether the car had its brights on? I’ve driven that path hundreds of times and would have done so myself at that time of day RT @PatrickOmid: Yeah, do they not use lidar/radar...? I can see how a camera might’ve only detected her a split second before she would ge… RT @hannawallach: .@hugo_larochelle, Kristen Grauman, Nicolo Cesa-Bianchi and I want to know who you'd like to see as an invited speaker at… "RT @DeepMindAI: Using neuron deletion to analyse neural networks, we find: 1) interpretable neurons (""cat neurons”) are no more important t…" "RT @TheRegister: Minor typo in Mark Zuckerberg's statement today on Cambridge Analytica: Replace ""we learned from The Guardian"" with ""we l…" @SamBendett Two very different questions :) "RT @mayhplumb: Marvel: 'Infinity War is the most ambitious crossover event in history' Me: https://t.co/u9l7vEoyB9" @halhod But community RT @samleecole: 👇 sex workers noticed this first because they often need to share files. but if this *isn't* just another glitch, it might… RT @ericgeller: Wait what was that about a coming arms race https://t.co/M18NkQmC68 "Marvel: 'Infinity War is the most ambitious crossover event in history' Me: https://t.co/CFGovTP3Vu" """It seems like all of our videos in Google Drive are getting flagged by some sort of automated system"" https://t.co/tMkpRmWuFu" RT @juliacarriew: Zuck’s “what I learned when I unplugged from the internet for one week” essay is gonna be awesome @ChrSzegedy @yoavgo @hardmaru I lol'd Reading reviews like https://t.co/1n5971dv0V Interesting that there seems to have been a lot more outrage expressed on Twitter about this Facebook stuff than the Google/drones thing from a few weeks ago. Not saying that's necessarily unjustified, just an observation, was surprised by how quickly the latter fizzled out... 🤔 @achristensen56 good luck! This was very much the case earlier today. I swear, my RNN was in a better position to write after the nap... "RT @Miles_Brundage: My alarm: wake up Me: https://t.co/AvTL5dUGQV" RT @goodfellow_ian: Check out Adversarial Logit Pairing, the new state of the art defense against adversarial examples on ImageNet, by @har… "C3PO: Database and Benchmark for Early-stage Malicious Activity Detection in 3D Printing," Li and Ma et al.: https://t.co/m1LW3tgbSo RT @pixelatedboat: Thank god, Zuckerberg has finally addressed the data breach: https://t.co/ZPotYaL5Vk """Closing the AI Knowledge Gap,"" Epstein and Payne et al.: https://t.co/rO5GcNTyOC ""Our diagnosis suggests that accelerating the scientific study of AI systems requires new incentives for academia and industry, mediated by new tools and institutions.""" "Blaming humans in autonomous vehicle accidents: Shared responsibility across levels of automation," Awad and Levine et al.: https://t.co/RhZd63UG5y "The Three Pillars of Machine-Based Programming," Gottschlich et al.: https://t.co/h7FK7JzjLP "Meta Reinforcement Learning with Latent Variable Gaussian Processes," Sæmundsson, @katjahofmann, and @mpd37: https://t.co/AS7bHbXJOW RT @rupammahmood: In Kindred's first research paper, we strive to make reinforcement learning with robots easier and more repeatable. https… @FHIOxford is hiring for several positions: https://t.co/Nl8kLC35Iu RT @cholodovskis: I'm pleased to announce that our paper has been published at @JAIR_Editor! It discusses evaluation protocols and reproduc… RT @hardmaru: You may not like it, but this is what peak performance looks like. https://t.co/QfjOIRjqMW RT @mattdpearce: Another reminder that the word "terrorism" has no real meaning in our current use of it, except to denote "Muslim." https:… @markus_with_k @aaronsnoswell @tttorrr I think so but not sure... @sg175 Could be childified a bit to make it work: "Round off floats, losers!" "Is your child texting about deep learning? lol: lots of loss omg: one more GPU brb: bringing RNNs back btw: better try word2vec lmao: layers - more and oversized smdh: save me, Dear Hinton (inspired by a @Iwillleavenow version about infosec)" Taleb without the deadlifts. https://t.co/5rJuJbVbBU """Setting up a Reinforcement Learning Task with a Real-World Robot,"" Mahmood et al., Kindred: https://t.co/aCGYIX47bo Tips and tricks for doing reproducible RL research with robots" """Composable Deep Reinforcement Learning for Robotic Manipulation,"" Haarnoja et al.: https://t.co/3fxzBiOYuN https://t.co/UOo7e1GoRZ" "Adversarial Logit Pairing," Kannan et al.: https://t.co/8fYmj33ST7 RT @tom_rainforth: Nesting probabilistic programs allows us to model agents reasoning about other agents, but current inference engines typ… @tkasasagi @BrundageBot Unfortunately no ;) it has a pretty limited action space (choosing among new arXiv papers then crafting tweets about ones I’d likely tweet) and it is not learning on new data, even if it could take other actions A big part of the problem is specification of properties - even with efficient verification methods, there's still the question of what counts as an adversarial example, i.e. what the relevant data distribution is, not to mention vaguer properties like safety, security, etc. See also some discussion of security-related reasons why verification would be useful in Appendix B here: https://t.co/eOcORdX7W0 At the workshop on which that report was based, some were skeptical verification would every be useful - only further research effort/time will tell. """A Dual Approach to Scalable Verification of Deep Networks,"" Dvijotham et al., DeepMind: https://t.co/PlGcowXSan Glad to see DM (among others) working on DNN verification. Lots of applications in improving security/robustness." Sign of the times - AI village (~conference track) at Def Con: https://t.co/jevfASddel RT @julius_adebayo: Fairness in ML gets lot of attention; however, this equality of opportunity project: https://t.co/e8RcWJR9kN is doing s… RT @seanmcarroll: Cleaning your room is good; using pseudo-intellectual babble about archetypes to identify culture with masculinity is dum… "RT @SussilloDavid: Please check out our new work on visual question answering (VQA), 'A dataset and architecture for visual reasoning with…" RT @mattdpearce: This isn't some low-level putz who got O'Keefe'd at a bar. Channel 4 got Cambridge Analytica's CEO talking about bribery a… RT @profcarroll: BOOM! Cambridge Analytica filmed saying they use bribes and sex workers to entrap politicians #CambridgeAnalyticaFiles htt… RT @awjuliani: Please spread the word! We are looking for a Research Intern to join @unity3d SF office this summer and work with the ML-Age… RT @MachinePix: Automatic shoe cover for clean facilities. https://t.co/sUQSfwbBP2 "RT @rao2z: First self-driving car pedestrian fatality.. I guess this had to happen here sooner or later, given we @Tempegov have become th…" RT @FHIOxford: New report about 'Deciphering China's AI dream' from FHI's Jeffrey Ding. https://t.co/2B2it7vhVp https://t.co/2pQHU8dEWV Google Docs as 21st Century Republic of Letters RT @KarenAttiah: People of color are being bombed in Austin. This story deserves so much more attention. https://t.co/Vf1GEkJQDM “Nesting Probabilistic Programs,” Tom Rainforth: https://t.co/e6ndToVMhA “A dataset and architecture for visual reasoning with a working memory,” Yang and Ganichev et al.: https://t.co/bMOdXpe5zl https://t.co/pyv1w66M1h https://t.co/FBDxhVagOO RT @peteskomoroch: "We've developed a new revolutionary deep-learning program aimed at your kindergartner called Keras4Kindergartners" http… Or to a program committee, meeting, etc. https://t.co/O6UcrBPjZw RT @CuteEmergency: Winston helping Brody go for a morning stroll! 😍 https://t.co/zjeqRH8Isa 🧐 https://t.co/sIT3kX8Anw @EBKania I’m missing the connection between the 5G stuff and the AI stuff. What does subverting the US AI industry mean? Or am I misconstruing this? (Full article paywalled) Nice article by @willknight on China's AI governance efforts, including discussion of @jjding99's recent report and translations on these topics: https://t.co/UNoghImQpy @gwern I haven’t made bets about it taking a long time ;) RT @jjding99: We severely underestimate the influence of scifi books and TV in shaping the frames of reference and overall milieu surroundi… RT @janleike: Interested in getting into machine learning research and AI safety in particular? @80000Hours recently interviewed me about t… RT @mark_riedl: We didn’t beat state of the art on the Story Cloze Test, but we came really close and with a simpler model https://t.co/Uwm… RT @pabbeel: Great opportunity to develop yourself as AI researcher, while spending a year in Tokyo! Note the short turn-around, applicati… Jet lag allows me to occasionally pretend I'm not a crazy night owl, and go to sleep before midnight. RT @abigail_e_see: Bay Area people: Please join us for the Poster Session for #Stanford #CS224n: #NLP with #DeepLearning on Wed March 21. T… RT @splinter_news: Trump is firing everyone who could potentially stop a war with Iran. https://t.co/2T0W2jnwRX https://t.co/0dIbipEzsV "RT @ericuman: A few things about Gina Haspel: - We were wrong: She didn't oversee torture of Abu Zubaydah. - She did oversee CIA dark pri…" "Unpaired Image Captioning by Language Pivoting," Gu et al.: https://t.co/5FG2igjBrR "Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge," Clark et al.: https://t.co/DWrEHZQoVO """Achieving Human Parity on Automatic Chinese to English News Translation,"" Hassan et al.: https://t.co/x7k0GkviH8 (MSFT paper discussed yesterday)" "LEGO: Learning Edge with Geometry all at Once by Watching Videos," Yang et al.: https://t.co/KKBWiHGB9M "GossipGraD: Scalable Deep Learning using Gossip Communication based Asynchronous Gradient Descent," Daily et al.: https://t.co/pUTAvwsf6Q "Large Margin Deep Networks for Classification," Elsayed et al.: https://t.co/bTKMziDSV8 """Feedback Control For Cassie With Deep Reinforcement Learning,"" Xie et al.: https://t.co/iTNCVfRKzv (Cassie = bipedal robot)" @RebeccaCrootof I aspire to make it there pre-robopocalypse. RT @twimlai: Today we're joined by @goodfellow_ian of @GoogleBrain @googleresearch and Sandy Huang, PhD Student at @UCBerkeley, to discuss… Nice thing about going from the UK to the US - I came totally prepared for sudden rain. ☂️ "Tired: AI is the new electricity Wired: AI is literally electricity Inspired: Bitcoin is using all our electricity https://t.co/W1zc9IfjXm" @kuziemsky I mean, I do have more govt experience than Tillerson ;) or Trump for that matter, for another few years... The news is out https://t.co/3WyaOPZwOI Off to the 🇺🇸✈️ @KnicTheFinch Sometimes, depends how long the books and trips are :) I also often only read parts of them though FWIW RT @CNN: Students at a Los Angeles school held a die-in spelling #ENOUGH with their bodies as a gong sounded 17 times, one for each student… Re: hubbub, if you aren’t aware, in addition to lectures, there are bajillions of videos on YouTube by his fans of him “owning” or “setting straight” “SJWs” etc. E.g. https://t.co/TAqU7Zyies After an Atlantic article about Peterson had an embedded YouTube vid about him, I started getting Peterson vids on the YT homepage and watched some. The fanboying around him is quite strange. This goes some way towards understanding the hubbub... https://t.co/49df4Mc5j2 RT @curaffairs: jordan peterson has been crowned as a brilliant philosophical mind, but is he really? our editor @NathanJRobinson takes one… RT @JanelleCShane: This program won at Tic-Tac-Toe by figuring out how to remotely crash its opponents' computers, causing them to forfeit.… (Esp. Luo Ji and his shenanigans) The Wallfacer Project (Remembrance of Earth’s Past series, esp. Dark Forest) is one of my favourite things in sci-fi ever. "RT @hotterpop: Just asked Google now ""how old is Stephen Hawking?"" Response: ""Stephen Hawking died tomorrow at age 76"" Anyway, timezones…" @tkasasagi Nonfiction and sci-fi usually :) currently: https://t.co/fYKgndXdSw @tkasasagi I have plenty of those but also like physical ones :) "The 2017 AIBIRDS Competition," Stephenson et al.: https://t.co/Zbw3Ekd5TZ "Defensive Collaborative Multi-task Training - Defending against Adversarial Attack towards Deep Neural Networks," Wang et al.: https://t.co/NoRrx4JLoz "Averaging Weights Leads to Wider Optima and Better Generalization," Izmailov et al.: https://t.co/dZ9Yxu6FsB Hardest part of packing for a trip: which books to bring? https://t.co/AcO3imSr1y RT @Miles_Brundage: Great work by @jjding99! Valuable insights on China’s AI strategy. https://t.co/00KTJ6Qpny "Learning to Explore with Meta-Policy Gradient," Xu et al. at Baidu and friends: https://t.co/Lzu0FRa1cI On future work: "These improvements should allow the MAIL architecture to be used to train agents to play modern AAA FPS games." 🧐 """Imitation Learning with Concurrent Actions in 3D Games,"" Harmer et al., Electronic Arts: https://t.co/Q0UwL8XFM2 Hadn't thought before about the fact that FPS games involve concurrent actions... nice video: https://t.co/eLj1xGPD3I" @Zergylord @NicolasPapernot I don't know what the venue Nicolas writes for regularly is, but I love the takeaway cutouts and clarity. See also https://t.co/MqGgRKx9jE RT @loisbeckett: Covering a walkout this morning at an elementary school in Virginia, and the 11-year-old organizers had a press packet rea… "RT @haldaume3: wow, this is quite impressive! congrats @xdh, Arul, Tie-Yan & the rest of the MT team!!! (of course like all science/headli…" RT @Miles_Brundage: More info on the aims of the project - https://t.co/As2I1A6msm Please RT so they can build a big dataset! RT @Miles_Brundage: Can you tell if you’ll like an ML paper after skimming for 30s? @FHIOxford's AI safety team is creating a dataset on qu… RT @red_abebe: I'm sharing a transcript of my talk at the #CSW62 event on empowering Africa women and girls in tech. I talk about my journe… RT @dtsbourg: If you have a bit of time, it's an interesting experiment to think about how you apprehend an unknown paper: what info do you… RT @JeffDean: Full article is at https://t.co/2FaPjAoAMq RT @JeffDean: Here's new work from the Google Brain team that shows increased accuracy in model for diagnosing diabetic retinopathy through… More info on the aims of the project - https://t.co/As2I1A6msm Please RT so they can build a big dataset! "Can you tell if you’ll like an ML paper after skimming for 30s? @FHIOxford's AI safety team is creating a dataset on quick vs. careful judgments about ML papers. Please consider taking part - no signup required. https://t.co/BtDwlGA1DQ" Great work by @jjding99! Valuable insights on China’s AI strategy. https://t.co/00KTJ6Qpny RT @NatureNews: "Stephen’s expectations when he was diagnosed dropped to zero; he said that everything that had happened since had been a b… @eisokant @marnovo Thanks! Will try to check this out soon. RT @jjding99: Excited to share my Deciphering China's AI Dream report, a 6 month effort at analyzing how all the pieces fit in China's AI s… "Testing Deep Neural Networks," Sun et al.: https://t.co/x0jXvXiE2a "Learning to Maintain Natural Image Statistics," Mechrez and Talmi et al.: https://t.co/7rpuTiX6tt Nice superresolution results on much less data. https://t.co/QRa0mbqyoY """Automated software vulnerability detection with machine learning,"" Harer et al.: https://t.co/G2i1JSqqN3 Hot topic right now - this is far from the end of the story! See also this on the broader social context of this, by me + 25 of my closest friends :) https://t.co/eOcORdFx4s" This looks great - "Deep k-Nearest Neighbors: Towards Confident, Interpretable and Robust Deep Learning," @NicolasPapernot and McDaniel: https://t.co/xB8YWeGZWg "Expert identification of visual primitives used by CNNs during mammogram classification," Wu et al.: https://t.co/FcNJsQkQ2b "Independently Recurrent Neural Network (IndRNN): Building A Longer and Deeper RNN," Li et al.: https://t.co/RHZidbnnXu "Hierarchical Reinforcement Learning: Approximating Optimal Discounted TSP Using Local Policies," Zahavy et al.: https://t.co/23AfCyJKtz Another today: https://t.co/m6R2Jm4gGq "RT @kateconger: Google: we'll organize the world's information and make it universally accessible and useful also Google: did the moon lan…" RT @dennybritz: Interesting reddit thread: Are the hyper-realistic results of Tacotron-2 and Wavenet not reproducible? https://t.co/0bCZ5kp… RT @iandenisjohnson: Not the end of history in China: A very useful intervention by @JulianGewirtz in @ChinaFile , reminding us that Xi's p… Or Ivanka and Peter Thiel 🤔🔥😑 RT @mark_riedl: My current working hypothesis on why the Bay Area is so interested in flying cars, based on plotting median house prices ag… @cnadd @GenFlynn Mattis has also said mostly reasonable things, but I also still worry about DoD being the de facto AI policy/funding lead (with NSF funding down and no science advisor), which seems like the likely scenario... bad for diversity of R+D, prospects for international cooperation etc Not looking forward to the Training + Research for Understanding Minds Policy (TRUMP) led by Kushner and Steve Wozniak RT @AaronMehta: Wait until Trump learns there’s an active Air Force program called the Space Fence. (the US government should be doing stuff on AI, perhaps most importantly *not* doing everything it's doing on immigration, but it seems that the quality of policy-making in this administration is inversely related to Trump's personal involvement) Silver lining of the Trump administration so far: he hasn't gotten personally interested in AI yet. Iran, NK, trade, and now space are not reassuring re: what will happen if he does. 🤦‍♂️ RT @RogerGrosse: Flipout makes weight perturbations (evolution strategies, variational BNNs) as mini-batch-friendly as activation perturbat… @GoAbiAryan https://t.co/VHwDzB0oLz RT @willknight: Highly recommend this... https://t.co/DDZQOjcYdi RT @EdFelten: White House just announced that President intends to nominate me for @PCLOB_GOV . @L_badikho I’m apparently “the Michael Jordan of tweeting arXiv papers” 😬 """The Charlie Sheen Effect on Rapid In-home Human Immunodeficiency Virus Test Sales,"" Allem et al.: https://t.co/xTyDUorJyp Charlie Sheen talking about his HIV diagnosis led to 8k more people getting HIV tests, 7x more of an effect than World AIDS Day." TFW you fire people by tweet instead of IRL but also would totally run into a school without a gun to stop a school shooter https://t.co/ZjVnjPbmR1 RT @AshleyRParker: And worth noting that Trump — who made his name declaring “You’re fired!” but is not actually able to fire people — had… RT @SamanthaJPower: .@realDonaldTrump casts doubt on factual findings by our great ally, just as he has long cast doubt on those by our own… RT @selectedwisdom: With Tillerson departure, foreign countries talking to any U.S. officials must debate whether to waste time with meetin… RT @MiekeEoyang: Expect a tough, partisan confirmation fight for Gina Haspel, who Trump has named to be the first female director of the CI… "RT @DanielleWenner: Yesterday: Tillerson breaks with WH narrative, says Russia to blame for UK poisoning, must be held accountable Today:…" RT @StephenLosey: CNN is now reporting that Tillerson definitively learned he had been fired from this tweet. https://t.co/rFQYi57mH9 RT @BeijingPalmer: It's ok, everyone: China 2.0 will put institutionalized succession on the blockchain. RT @emilyrauhala: From @monkeycageblog: ”Xi has not yet crossed the threshold into personalist dictatorship but is moving closer, and his r… RT @L_badikho: Adversarial Machine Learning is not only about examples that fool a trained model (evasion attacks), we should also care for… RT @DrLukeOR: Failed replication of the 2016 @JAMA_current retinopathy #AI study, but only in the sense that the team used different data,… RT @lewisshepherd: Missed inflection: machine learning performed far worse than humans in Feb’s stock-market sell-off. “Strategies tooled f… @mark_riedl got schmidhubered @mark_riedl well.. https://t.co/l1ALXxWoEX "Learning and analyzing vector encoding of symbolic representations," Fernandez et al.: https://t.co/7cqEUzk4v4 "Detecting Adversarial Examples via Neural Fingerprinting," Dathathri and Zheng et al.: https://t.co/opG7Lq8mTF "Entity Resolution and Federated Learning get a Federated Resolution," Nock et al.: https://t.co/ry6PeBtlu3 "Interpreting Deep Classifier by Visual Distillation of Dark Knowledge," Xu et al.: https://t.co/mDXOei10d0 "ARMDN: Associative and Recurrent Mixture Density Networks for eRetail Demand Forecasting," Mukherjee et al., Flipkart: https://t.co/yOAdKNYsgE Just gonna leave this right here https://t.co/xvduddVL4m "Neural Conditional Gradients," Schramowski et al.: https://t.co/6OAwrdAB4k "Intelligible Artificial Intelligence," @dsweld and Bansal: https://t.co/shONuKCfzE "Handful of papers from folks at Sentient on multitask learning, evolution, + architecture search: https://t.co/EHoUPTSQ5J https://t.co/AEQamDkK0b https://t.co/MSIh2fXiLh https://t.co/ni93QBaBvw" "Sales forecasting using WaveNet within the framework of the Kaggle competition," Kechyn et al.: https://t.co/CqyLfuuTTG """Scalable Breadth-First Search on a GPU Cluster,"" Pan et al.: https://t.co/XBGj6RHcAi Search people (should) like GPUs too" @chrisdonahuey yeah think I may delete this - didn't look v. carefully. Might just be a class paper """IcoRating: A Deep-Learning System for Scam ICO Identification,"" Bian et al.: https://t.co/XfqXnzwRok White paper-related and Github-related features provide the most signal; websites/teams also used" "Delayed Impact of Fair Machine Learning," Liu et al.: https://t.co/QYtH3ppSfR """Replication study: Development and validation of deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs,"" Voets et al.: https://t.co/NR2twYmzpW Failed replication of 2016 JAMA study" (semi-related sidenote: note that DeepMind started using capped mean human normalized scores, not giving extra credit for exceeding 100% - so DMLab results recently are more impressive than they look if your intuitions are based on the old method like me) """Kickstarting Deep Reinforcement Learning,"" Schmitt, Hudson, and Zidek et al.: https://t.co/nODifNhpJA Distillation + PBT to get learning started faster using pretrained agents" "@zacharylipton @iamtrask @ch402 @OpenAI @jackclarkSF a Claus clause, if you will sorry" @zacharylipton @iamtrask @ch402 @OpenAI @jackclarkSF I forgot about "thought leader" @EmmanuelAmeisen @zacharylipton @iamtrask @ch402 @OpenAI @jackclarkSF you're under my threshold ;-) @zacharylipton @iamtrask @ch402 @OpenAI @jackclarkSF Neither is a perfect rule because sometimes legit people who just started and don't understand twitter use a bunch of hashtags. but yeah, hashtags, "futurist," "speaker," etc. all red flags @iamtrask @ch402 @zacharylipton @OpenAI @jackclarkSF (not a full solution :) ) @iamtrask @ch402 @zacharylipton @OpenAI @jackclarkSF my rule of thumb is to be ignore accounts which have a ratio of hashtags to actual biographical information greater than 1 :) RT @lukeprog: 2-year UCLA fellowship to work on AI governance/policy with @open_phil grantees Ted Parson & Richard Re. Deadline is Mar 26th… RT @jjding99: First issue of the weekly ChinAI Newsletter is out! It includes links to the translations of the Tencent book and China's Whi… @jackclarkSF @OpenAI Asynchronous Variational Autoencoders (AVA) should be next, then. AI from Spike Jonze (director of Her) and @OpenAI (Hindsight Experience Replay, or HER). What are you doing over there, @jackclarkSF? https://t.co/kZ7urY17Q2 "How Democracies Die," Steven Levitsky and Daniel Ziblatt on their book by the same name: https://t.co/fIHQMCfzeH @SmithaMilli Is there an ML theme? :) RT @fermatslibrary: We are doing an AMA (Ask Me Anything) about the GANs (Generative Adversarial Nets) paper with @goodfellow_ian on 3/15 (… RT @JohnDanaher: New post - Should we care about inequality? A critical analysis of Pinker's optimism https://t.co/o9Hes5Rfdc https://t.co/… @calebwatney Stanford campus? RT @MattBellassai: whoever invented the “skip intro” button at netflix deserves the highest accolade we as a society can bestow upon a citi… Thread: https://t.co/Pu1rL0YNV1 "The Importance of Being Recurrent for Modeling Hierarchical Structure," Tran et al.: https://t.co/7xtv8Ke9rn "On Generation of Adversarial Examples using Convex Programming," Balda et al.: https://t.co/reyDn2NtmR "The Lottery Ticket Hypothesis: Training Pruned Neural Networks," Frankle and Carbin: https://t.co/9HIJPMO51N "Deep Visuo-Tactile Learning: Estimation of Material Properties from Images," Takahashi and Tan: https://t.co/e7NMqWm9yi """High-Accuracy Low-Precision Training,"" De Sa et al.: https://t.co/Okeo3s7ELL a.k.a. HALP" @deliprao lol "American Spies - Modern Surveillance, Why You Should Care, and What to Do About It," @granick: https://t.co/UUj3X6MQvD Best served with a side of unicorn https://t.co/JVU70ifZwP (published later) @rbhar90 interesting - thanks! :) "The Surprising Creativity of Digital Evolution: A Collection of Anecdotes from the Evolutionary Computation and Artificial Life Research Communities," Lehman, Clune, and Misevic et al.: https://t.co/wvtl33dhRQ curious how impressive the results are (CC @rbhar90) "Learning Deep Generative Models of Graphs," Li et al.: https://t.co/4XVzE6CQTg @erfannoury Haven’t read Autonomous but I liked Algebraic Mind, FWIW. Was a long time ago (both the publication and my reading of it), though, dunno how current it is. Maybe check out a review or sample first. And on sci-fi, have you read Three Body Problem? :) RT @twitskeptic: @Miles_Brundage Very RISCy appointment @twitskeptic 👍 RT @dustinvtran: Highly recommend this augmentation, infrastructure, and human-centric perspective on "AI" by Mike Jordan https://t.co/68KP… Suffice it to say there will be more TPUs and fewer silly hats "Security, Privacy, and Democratization: Challenges & Future Directions for ML Systems beyond Scalability," @dawnsongtweets: https://t.co/WNKtVdHJuZ "Deep Reinforcement Learning with Subgoals," David Silver: https://t.co/hULLbjXVus If you’re interested in China and AI, check this out - I’ve found Jeff’s translations very interesting. https://t.co/XeiXUKgGSd RT @brianklaas: In a single speech, Trump praised dictators, attacked the press, singled out a journalist who he called a “son of a bitch,”… RT @washingtonpost: Trump celebrates winning 52 percent of women in 2016 — which is only how he did among whites https://t.co/0EQxAQj7ZJ @AthertonKD Inspired: end time https://t.co/vQiIUJw7Ca @acherm It’s discussed in the AlphaGo Zero paper (search “600”). @mark_riedl @williamstome @Harkaway +1, on the list! ResNets improved AlphaGo Zero’s performance by 600 ELO points (!!!). Also notable that it came from China - one of the most influential publications from there (specifically MSFT Research Asia) in recent years, though first author Kaiming He is at FB in the US now. https://t.co/c5FsoD4EFu Hope @Twitter is aware of and doing something about all these cryptocurrency scams. They’ve gotten more sophisticated (fake recipients saying it worked for them, etc.). https://t.co/0kK6FZvSOH RT @Hiba_chougrad: I just published a blog post about my personal experience attending the @DeepIndaba last year, make sure to check it out… RT @nytimes: “These regulations were written with human blood.” Safety rules adopted after the Deepwater Horizon disaster are a target of T… @hendysh @AndrewDohertyQu @michael_nielsen see also https://t.co/LeBBtL4s8k (/more academic version: https://t.co/0fEzem3o0k) @timhwang @robinsloan @TheDailyShow @ronnychieng @jbrowder1 Would watch @robinsloan Soooo good. RT @catherineols: @jackclarkSF @hardmaru Weird AI https://t.co/T1TI75OyEe @robinsloan 👍👍👍👍👍👍 RT @deborahhanus: .@MSFTResearch is offering $25K to help students who are women & underrepresented minorities to finish their PhDs. Apply… RT @jjding99: When the Asilomar principles were drafted, only 1 out of 150 attendees was working at a Chinese institution (@AndrewYNg at Ba… RT @jjding99: Since these have drawn some interest lately, a short thread with my informal translation of "Chapter 25: 23 'Strong Regulatio… @robotic_hands @ArmsControlWonk that article cites the person you seem to be arguing with (?) RT @hannawallach: Come work with me, @hugo_larochelle, Kristen Grauman, and Nicolo Cesa-Bianchi on NIPS 2018!!! https://t.co/xapqDmuimi "RT @ArmsControlWonk: “Missile Test” He thinks he knows what he means but he doesn’t and lord knows how he will react if North Korea conduct…" @j2bryson @jackclarkSF @DanitGal @jjding99 Not sure if they’re public yet, perhaps @jjding99 can email if not. Hopefully eventually so we can mitigate this trend Jeff observed: https://t.co/fHRPJc93YG @jackclarkSF @j2bryson @DanitGal @jjding99 has translated a few chapters so far. "RT @BBC: 🙌 1 year ago today the world became a better place. #BBCdad https://t.co/Q5I70XxT7T" "RT @timhwang: 👋! on @thedailyshow last night with @ronnychieng and @jbrowder1 talking robots, legal automation, and racism https://t.co/kc…" @healyjforUC yes, though it's for a computer port of Q-Bert, so may be a bug with the simulator, not the original code @ciphergoth it's on arXiv. https://t.co/FGJCkj4rMf got censored by PhilPapers ;) "RT @MullerCatelijne: Excellent news, EU will: - build ""European AI Alliance"" (broad, diverse community of stakeholders) - set ethical guide…" RT @jaketapper: So you’re the president of the United States of America. You can dine with literally anyone you want to. Titans of industry… RT @lvandalm: Impressive and comprehensive report on malicious use of #AI by among others my alma mater @UniofOxford and @FHIOxford Having… "RT @ChadMac19: Martin Shkreli cried as he was sentenced to prison today. I'll give you a tissue, Martin. Only $500 each." RT @catherinebuk: When men and women talk to Siri from @deliprao https://t.co/yC3oDs8mS4 "RT @allie_conti: that was a very long three hours https://t.co/tyrwV7fexa" https://t.co/WXgO6sMXof @JeffreyASachs @JamesBulczak thanks for clarifying! @JeffreyASachs This link seems to be saying the opposite of what your tweet says (?) RT @JeffreyASachs: There Is No Campus Free Speech Crisis: An Unreasonably Long Thread RT @shimon8282: New link with better audio: https://t.co/us5Yolp1z8 https://t.co/mVtimu9IaT RT @qhardy: Rich guy crime is so different. Trying to imagine this argument for a guy who broke into a house or shoplifted some food. https… RT @s010n: And recordings of the tutorials are available here: https://t.co/6bXYivTgdQ https://t.co/QqqEkqtiac RT @katecrawford: So thrilled that our paper is now officially in print! https://t.co/I49vDKTkjc RT @dandrezner: Nothing to see here, just a glimpse at how U.S. foreign policy is being managed by the White House. https://t.co/4c1EA0CPSp… RT @Gregory_C_Allen: https://t.co/3BiIvXQWkc @jjding99 Vice chair also sounds potentially important... "RT @vdignum: Special issue on #Ethics and #ArtificialIntelligence now online: https://t.co/Ft5tG6UqWo … including papers by @iyadrahwan @j…" RT @charlotte_stix: So proud to announce something super exciting I’ve assisted on. Call for experts to advise the European Commission on A… RT @iamtrask: I believe this paper will be one of the most important Privacy-preserving ML papers of the year. Proposes practical methods f… @jjding99 The text seems to say the US “won” that competition...? Or am I misreading RT @clarkamiller: Tempe City Council votes to adopt a 100% renewable energy goal for 2035. Congratulations Tempe! "SentRNA: Improving computational RNA design by incorporating a prior of human design strategies," Shi et al.: https://t.co/EAry35gFFD @jackclarkSF not enough. Should be laughing Alexa or equivalent """The Advantage of Doubling: A Deep Reinforcement Learning Approach to Studying the Double Team in the NBA,"" Wang et al.: https://t.co/JE7V30gMuQ They lost me at ""During the 2017 NBA playoffs"" but supposedly there's deep RL in there." @aaronsnoswell now, perhaps some parts of AI (or the field's status at different points in time) are more butter knifey and others are more virusey, so it's not clear how useful the term is/where to apply it, but we found it a helpful concept in connecting AI to other domains where term used. @aaronsnoswell thanks! And good question! In some sense, yes, but it's a matter of degree, and the term is often used to refer to tech especially generic or especially amenable to weaponization - e.g. butter knife + dangerous virus both dual use but label more useful in latter case :) "An efficient framework for learning sentence representations," Logeswaran and Lee: https://t.co/DC1NIoGXLG """Learning with Rules,"" Cohen et al.: https://t.co/ZLffpm52Ys (bland title so here's the abstract) https://t.co/cbMXxgH75I" """Learning with Rules,"" Cohen et al.: https://t.co/ZLffpm52Ys (bland title so here's the abstract) https://t.co/gFKWkY3xRr" "A Deep Generative Model for Disentangled Representations of Sequential Data," Li and Mandt: https://t.co/pCKDGt2j0O "How Images Inspire Poems: Generating Classical Chinese Poetry from Images with Memory Networks," Xu et al.: https://t.co/SA3f3Z9uZy "Feudal Reinforcement Learning for Dialogue Management in Large Domains," Casanueva et al.: https://t.co/SQoYI0I7hi Happy International Women's Day!! "RT @peterwsinger: Army of None New book for those interested in robots and the future of war from @paul_scharre https://t.co/XEkpuGPnXT" RT @black_in_ai: "We’re providing 6-10 stipends and mentorship to individuals from underrepresented groups to study deep learning full-time… RT @pabbeel: "Our results include using an entire NVIDIA DGX-1 to learn successful strategies in Atari games in single-digit minutes." (tha… RT @shimon8282: This video explains our work on Expected Policy Gradients in just 13 minutes! https://t.co/umU3O9o7ky RT @drhyrum: The right direction for adversarial ML in infosec by @phtully: Identify reasons for strategic offensive advantage, and propose… RT @stevenleemyers: The constitutional change in China was "the culmination of months of secretive discussions that are only now coming to… "Extracting Action Sequences from Texts Based on Deep Reinforcement Learning," Feng et al.: https://t.co/aEUaNk2EQz "Natural Language to Structured Query Generation via Meta-Learning," Huang et al.: https://t.co/kRescJ3zz1 "Billion-scale Commodity Embedding for E-commerce Recommendation in Alibaba," Wang et al.: https://t.co/h0peZXDz0d "Transfer Automatic Machine Learning," Wong et al.: https://t.co/yvqfXCOM50 Deep RL may not be competitive with humans in sample efficiency yet, but it's at least competitive in wall time with a DGX-1... https://t.co/WVpqVyPG3i https://t.co/0sOZCgO66g "Accelerated Methods for Deep Reinforcement Learning," Stooke and @pabbeel: https://t.co/WVpqVyPG3i "Smoothed Action Value Functions for Learning Gaussian Policies," Nachum et al.: https://t.co/rot5lKY5yj "Sever: A Robust Meta-Algorithm for Stochastic Optimization," Diakonikolas et al.: https://t.co/dLGRRA9u9I RT @rcalo: this headline explains why Alexa was laughing 😂 https://t.co/T34jgj6yfJ RT @Ted_Underwood: New life goal. Never be mentioned in any article that uses the phrase “according to people familiar with the matter.” Th… RT @dandrezner: NARRATOR: the people did not overwhelmingly vote for him. He did not even win a plurality of votes. https://t.co/HqbdBP4LMm RT @verge: Amazon admits Alexa is creepily laughing at people and is working on a fix https://t.co/aes1wwEtCT https://t.co/360NSBvf7S Actually, there’s already AmoebaNet 🤔 (From Wikipedia) How low can we go? https://t.co/EftBRpnYlN I love that Reptile is compared to MAML... https://t.co/ibgoXOZTMA "RT @OpenAI: Releasing Reptile, a Scalable Meta-Learning Algorithm: https://t.co/JQB60XRaQi - Try it out with our interactive tool for few-s…" RT @jjding99: Finally got my copy of a 500pg book published by Tencent and a govt think tank on AI policy and governance. What @AndrewYNg s… RT @bradplumer: Wind turbines are getting really freakin huge. GE's planning the biggest one yet: https://t.co/KPxKEarMoI https://t.co/sAaN… @_tabbz @AlisonBLowndes @natashajaques @catherineols No problem at all, just clarifying :) sounds like an exciting opportunity! @_tabbz @AlisonBLowndes @natashajaques I think I just got included on this thread because I retweeted something, and am not involved in the program, but @natashajaques is,and @catherineols also strongly recommended it so CCing her :) RT @natashajaques: I'm excited to be participating as a mentor in a new OpenAI program to help underrepresented groups participate in deep… RT @hardmaru: Creative use of style transfer to synthesize QR codes! https://t.co/Y3sHPFlylP ??? https://t.co/QsPvfJgEqX RT @shimon8282: Our latest paper is the fruit of a new collaboration with @oxfordrobots: hierarchical learning from demonstration: weakly s… "Deep Super Learner: A Deep Ensemble [of traditional ML algos] for Classification Problems," Young et al.: https://t.co/fY90SsrOhG """Learning Memory Access Patterns,"" Hashemi et al.: https://t.co/txXeBoc4AK NNs for prefetching. ~A sequel to ""The Case for Learned Index Structures"" as foreshadowed by @JeffDean at NIPS (""Learning in the core of all of our computer systems will make them better/more adaptive"")." I’m old enough to remember when the Department of Energy social media team didn’t retweet Donald Trump referencing Drudge Report. https://t.co/ne4LZVjaYb RT @TheOnion: Gary Cohn Resigns In Protest Of Trump’s Bigoted Comments Towards Aluminum https://t.co/cm2smdHb0B https://t.co/JoHjOCo1X2 RT @erikbryn: Most Americans See Artificial Intelligence as a Threat to Jobs (Just Not Theirs) https://t.co/HdAuINXNXR RT @tdietterich: I just published “Reflections on Innateness in Machine Learning” https://t.co/gAOYxmgxiN RT @arvindsatya1: Super excited to publish "The Building Blocks of Interpretability," a @distillpub article where we explore rich user inte… There probably won't be a science advisor (Thomas Bayes, personal communication) https://t.co/xTpOc2vNqX RT @lawfareblog: "The Coming Conflicts Will Be Tweeted," the latest from Thomas Zeitzoff: https://t.co/UZveATfKX2 "RT @catherineols: Excited to see this! I know 5 of 6 mentors personally and they're *really fantastic* folks. OpenAI has received criticis…" RT @kateconger: Here’s some good context from @mhbergen about how this fits in to the business plans for Cloud: https://t.co/laG3XpqUEZ RT @markus_with_k: After long nights and sacrificed weekends, many chats with colleagues and friends, I have finally completed this (much t… RT @OpenAI: Now accepting applications for OpenAI Scholars: mentorship and financial support for people from underrepresented groups to get… Thread: https://t.co/qo7WcTZFAw My colleague Shahar and I spoke with the hosts of the Cyberlaw Podcast about our report on malicious use of AI. https://t.co/LKFW6hOaCp RT @lawfareblog: "The Cyberlaw Podcast: Interview with Miles Brundage and Shahar Avin," the latest from Stewart Baker: https://t.co/u9CaJuq… @HeidyKhlaaf As far as I know there are no ground or air based fully autonomous weapons deployed by the US. There are some such systems deployed on ships for defensive purposes. But the trends are heading towards autonomous offense even if we’re not there yet so agree it’s a big concern. @HeidyKhlaaf (And if not, maybe they shouldn’t be doing it) @HeidyKhlaaf Fair points + I am also v. concerned about autonomous weapons. All the more reason why they shouldn’t be so vague about this. If there are actually limits on how their tools are used, they should say so. Or just say something about it pre-leak on one of the 100,000 fireside chats Eric Schmidt does per week As various folks have pointed out, this may not be that substantively significant of a collaboration - statement is super vague. But it’s symbolically significant so why not have a coherent statement ready if it leaks in any case? @jjvincent @jackclarkSF Total shitshow 🤦‍♂️ @jackiesnow @jjvincent The wording is vague but I would expect them to have said something very different if there were no actual collaboration. Words like “providing” suggest collaboration. FWIW I am pro defeating ISIS and could see an argument for Google teaming up with DOD on stuff like this, but doing it secretly then having a crappy explanation when it’s leaked is embarrassing. "Glad Eric Schmidt is less involved in Alphabet than he used to be but his legacy lives on in stuff like this. Think about how this looks to China. And the principles/safeguards haven’t been finished yet?🤦‍♂️Get your act together, Google. https://t.co/uyOTNzqtk8" RT @JeffDean: Totally agree with @etzioni that this a huge disaster in the making, and it is due to our current government's absurd immigra… RT @alicetiara: ACADEMIC TIP: When you really like an article, send the author a quick note to let them know! It builds such good feeling a… "RT @pabbeel: #nips2017 Meta Learning Symposium videos are now available here: https://t.co/tDcjUVQKV9 Thanks to Risto Miikkulainen, Quoc Le…" "Recurrent Predictive State Policy Networks," Hefny et al.: https://t.co/NZQIK2KfU9 @gosainnn @zacharylipton +1 RT @ChrSzegedy: (Simplified) #wavenet for the win! These results support our experience as well that wavenets outperform #RNN for sequence… "An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling," Bai et al.: https://t.co/TD4c6rnSlR https://t.co/KUt7weFBXK Enjoyed "The China Questions: Critical Insights into a Rising Power," Rudolph and Szonyi (eds.). Nice collection of bite-sized essays on a wide range of topics. https://t.co/gyvCZ3kL46 "RT @jamesrbuk: Vision: algorithms will make hiring better as they don’t discriminate Reality: “One HR employee for a major technology comp…" Context, for those who, unlike me, have the good sense not to read Trump tweets: https://t.co/I8sLCQo784 Is there a rapper named Crooked H yet? @drkatedevlin I don't remember that... @KeenDisregard Unclear exactly who/what it is "RT @rao2z: Recently @asunow co-interviewed me and the fellow Sun Devil @Miles_Brundage about risks and rewards of #AI.. @RealAAAI @Part…" "Very British version of “if you see something, say something”: “See it, say it, sorted.” https://t.co/ilrwrBwYHv" @ankurhandos Addressing an important problem but I don’t really have a good sense of how it compares to other approaches. Solution to AI: aggregate all data on Trump, follow him around with video cameras all the time, ask him diverse questions, train a neural network to predict his responses. Add negations to all responses. Since he’s systematically wrong about everything, the AI will output truth. Mayo-free sandwich located at the train station https://t.co/5zbGxcn9N2 RT @pyoudeyer: I just posted a new review on computational theories of curiosity-driven #learning where I discuss how tools from #MachineL… RT @Miles_Brundage: Nice summary of Paul Christiano's approach to AI safety, by Ajeya Cotra: https://t.co/67KUpjFHIA RT @SamanthaJPower: It’s out! ‘Can It Happen Here? Authoritarianism in America’ https://t.co/pchqIk4AIG @atg_abhishek I think it's not just that people weren't noticing, but also that the quality has improved and the quantity has grown a lot recently. RT @mark_riedl: @ken_goldberg When will there be a Most Scientifically Accurate AI category at the #Oscars RT @awjuliani: My project from yesterday's @OpenAI hackathon: Implemented PPO+Curiosity (https://t.co/bLRixoWQNI) in a "Pyramid" environmen… @ColorofSpace I was kidding :) they seem to be automatically generated fake books. RT @Phil_Lewis_: A charity run in Philando Castile’s name just wiped out the lunch debt of every student at all 56 schools in the district… @rcalo WHAT DID I MISS RT @BrendanNyhan: This is fine https://t.co/v3YxETf8PY Johnny had a busy month. https://t.co/HVUYZ4QaNn These are all tied for me. But seriously, I don't have a good answer, was wondering if others did. https://t.co/7nqz9DvacR What's the best book you've *ever* read? "RT @fchollet: The Chinese version of the Keras docs is now online at https://t.co/5trR8eth1a Thanks to everyone who contributed to the tra…" RT @marceldirsus: This is uncomfortably accurate https://t.co/7BDpI2Iyvz "Understanding the Loss Surface of Neural Networks for Binary Classification," Liang et al.: https://t.co/gPZqjlrupH "On Polynomial Time PAC Reinforcement Learning with Rich Observations," Dann et al.: https://t.co/ixGPzR7alS "Essentially No Barriers in Neural Network Energy Landscape," Draxler et al.: https://t.co/2M2YFPiRF5 "A computational perspective of the role of Thalamus in cognition," Dehghani and Wimmer: https://t.co/LBkx8VC2vr "Meta-Learning for Semi-Supervised Few-Shot Classification," Ren et al.: https://t.co/fDzmvdXnAm "Evolutionary Generative Adversarial Networks," Wang et al.: https://t.co/KGUXYXjcTZ "Autostacker: A Compositional Evolutionary Learning System," Chen et al.: https://t.co/SX7NlA9jaq Nice early performance on Montezuma's Revenge, though hard to compare/say if SOTA since the training ends early (by DeepMind standards) at 4 million frames. Does seem way faster than e.g. FuN but dunno if plateaus soon after. "Hierarchical Imitation and Reinforcement Learning," Le et al.: https://t.co/94zTrGPuH4 (just from today - many more in the past year) "Alibaba is using deep RL for lots of stuff: ""Accelerating E-Commerce Search Engine Ranking by Contextual Factor Selection,"" Zhan et al: https://t.co/R758oebZ3a ""RL to Rank in E-Commerce Search Engine: Formalization, Analysis, and Application,"" Hu et al: https://t.co/4TwCAbpTZc" "Unsupervised Learning of Goal Spaces for Intrinsically Motivated Goal Exploration," Péré et al.: https://t.co/UZskkXHGCU RT @catherineols: Overheard in lab meeting: “Defenses for adversarial examples fall into in three categories: ‘already broken,’ ‘doesn’t wo… @deliprao @tdietterich @Smerity @WonderMicky @OpenAI that's fair, and I'm sympathetic to that/Tom's points. Saying surveys should be done doesn't entail that one should take them as gospel - my main takeaway from them so far has been the extent of disagreement/uncertainty, + I use many other signals in my thinking. @deliprao @tdietterich @Smerity @WonderMicky @OpenAI getting lots of ppl to make lots of falsifiable short/medium term forecasts can help, but with something like the long term future of AI, there's residual uncertainty re: how relevant those are. @deliprao @tdietterich @Smerity @WonderMicky @OpenAI yes, many missed it but some didn't - the problem is that we don't know whom to listen to on which topics. @tdietterich @Smerity @WonderMicky @OpenAI (I did badly even on a 1 year horizon: https://t.co/cvr1gOhNZD, so agree it's hard!) @tdietterich @Smerity @WonderMicky @OpenAI Have you written anywhere about your past failures? I'd be very interested in that/any common themes :) "Richard Sutton on TD learning: https://t.co/D6okhd0bfn Unfortunately, can't see the slides, but at least they're linked to." @tdietterich @Smerity @WonderMicky @OpenAI ...but my view is that this was a big advance in specificity/usefulness (and other dimensions like population of experts etc.) over previous surveys, and should be done better in future, not abandoned entirely. (end) @tdietterich @Smerity @WonderMicky @OpenAI Ideally, we'd have very precise forecasts, and/or good datasets/models fitting and extrapolating them into the future, as a complement to expert opinion, and I've done some of that myself (indeed, my 2017 forecasts erred most when I relied too much on experts vs. trends!). @tdietterich @Smerity @WonderMicky @OpenAI Agree expert opinions (esp. on ill-defined tasks) should be taken with at least a grain of salt, but worthless seems too harsh. Many of the tasks were reasonably well specified (see appendix), and aggregating tacit knowledge from experts can provide some clues re: task ordering RT @OriolVinyalsML: Fun interview from @Blizzard_Ent on our views on the role of @StarCraft in #AGI. https://t.co/VVdFtP77Lf (lots of other good stuff on that blog - https://t.co/de9H5uYeBJ - but this is the best intro yet) Nice summary of Paul Christiano's approach to AI safety, by Ajeya Cotra: https://t.co/67KUpjFHIA @Smerity @WonderMicky @OpenAI I don't know about "smarter than you" :) but see here for estimates from hundreds of NIPS/ICML authors: https://t.co/VVtluIHBQL RT @ai_memes: @karpathy https://t.co/Aft7EXUN1E RT @mer__edith: WSJ presents AI-aided "hyperwar" as inevitable. This is dangerous and disingenuous. *The future is not settled* If we want… (from https://t.co/TTS0YMJr5D) Learned the other day that most of the battleships sunk at Pearl Harbor were fixed and returned to service. *enter clickbait mode* You won't believe what happened next: https://t.co/9czVKsaTEJ Peter Eckersley of @EFF, one of the authors on the malicious use of AI report, discusses (automated) fake news on a Vox podcast: https://t.co/A6WVkIWQNO Will be in London Monday, let me know if you want to chat :) RT @egrefen: Excellent @turinginst talk by Richard Evans (@LittleBimble) of @DeepMindAI on learning Logic Programs by solving SAT problems… @clarkamiller on it! April 2 :) RT @rsalakhu: New #iclr2018 paper on Unifying Deep Generative Models: Establishing formal connections between deep generative modelling app… @clarkamiller but really, I barely scratch the surface there. Many big issues including the ones you mentioned. @clarkamiller I agree! Someone should write a dissertation on this ;) AI can/should be highly positive-sum in its impacts. How to make sure that happens isn't yet super clear but should be actively explored much more seriously before resigning ourselves to a race mentality. This coalescing AI arms race narrative is super dangerous (see: https://t.co/JsGK1PBZc6) and confused, lumping together a bunch of distinguishable forms of competition. Meanwhile, a literal arms race for hypersonic weapons continues. https://t.co/qp5kD4rPw7 RT @Kasparov63: Trump routinely praises dictators in public as well, and has all his life. This deep contempt for democracy is a most dange… RT @rbhar90: I'm excited to announce that @deep_chem 2.0 has just been released! We've significantly refactored and extended our TensorGrap… RT @pstAsiatech: #ChinaAIWatch Almost 80% of Chinese concerned about AI threat to privacy, 32% already feel a threat to their work · TechNo… "RT @jackclarkSF: @Miles_Brundage @goodfellow_ian @ylecun fine. Schmidhuber: Captain Capuchin Long-Short @ilyasut : Illest Sequence. @…" RT @_tessr: these days, a fave is just a non deterministic retweet The last two are especially bad and I'm sorry RT @goodfellow_ian: 4 years of GAN progress (source: https://t.co/hlxW3NnTJP ) https://t.co/kmK5zikayV "DJ names for AI researchers: @goodfellow_ian: Adversarial Samples @ylecun: LeTune Judea Pearl: Bayesian Ne-twerk Geoff Hinton: The Physical Symbol System Hiphopicist" Quite a tweet. https://t.co/VSRCKrxd8C RT @NuclearAnthro: 720ish+ US nuclear weapons ready to fly 24/7/365 and the guy who makes bad decisions impulsively has launch authority. 👇… "Tired: good policies Wired: nationalism Inspired: mercantilism https://t.co/MXkV4YlqTo" On IMPALA, before it was called IMPALA. https://t.co/0SnXNEuyXw RT @nytimes: Many Americans can buy a gun in less than an hour. In some countries, the process takes months. https://t.co/0b7ATRfTss @willknight FAT chance https://t.co/WDKhBE4Esh Wild that Star Trek: Deep Space Nine has its own Gaius Baltar. Their personalities are even the same. https://t.co/dQCy9HT4EL RT @CNAStech: Need a quick breakdown of the recently published 100-paged report on the malicious uses of #AI coauthored by @CNASdc, @CSERCa… RT @ahjackman: On “mega-colonies” of penguins near the Antarctic peninsula: "Scientists, prompted by satellite images, mounted an expeditio… @Aelkus indeed, and particularly disappointing when he's had gigs in which he could literally talk to anyone at Google anytime he wanted, get good briefings etc. and still says silly things @Aelkus Yeah, I don't take it that seriously, I'm just saying he's been like that for a long time :) for years he's said stuff like "The [full blown/broadly defined] Turing Test will be passed in a few years" and "human-level AI is science fiction" in the same breath @Aelkus Kind of weird how people apply totally different standards to tech than to any other policy/life issue. Imagine him saying we shouldn't worry about climate change because the worst effects aren't for decades. Also, he's been a joker for a long time, glad ppl are realizing it now. RT @drfeifei: Super important work! The development of Responsible #AI guidelines in companies and governments is just as important as the… "Efficient Multi-Task Deep Reinforcement Learning," Vlad Mnih: https://t.co/xkbWqA9Oha Reminded me of the one about Margaret Hamilton "helping to" write the code for Apollo (which she wrote). (or something more like this) https://t.co/acSCxNjkvx If this were about a guy with those credentials, I suspect it'd say "spurring," not "helping to spur"... 🤔 https://t.co/kBItV7RgSs RT @paul_scharre: Friendly fire isn't friendly: McMaster to depart "in a move orchestrated by chief of staff John Kelly and Defense Secreta… "Neural Networks Should Be Wide Enough to Learn Disconnected Decision Regions," Nguyen et al.: https://t.co/qJevRxWZr6 "Learning Longer-term Dependencies in RNNs with Auxiliary Losses," Trinh et al.: https://t.co/uqsjey4uHv https://t.co/UItVtcESon "Model-Based Value Estimation for Efficient Model-Free Reinforcement Learning," Feinberg et al.: https://t.co/wR5Ofab1eP """Deep Reinforcement Learning for Sponsored Search Real-time Bidding,"" Zhao et al., Alibaba etc.: https://t.co/Jf9dVKGb6n As I said, lots of DRL applications happening in China..." "Composable Planning with Attributes," Zhang and Lerer et al.: https://t.co/qkYn0ax531 "Knowledge Transfer with Jacobian Matching," Srinivas and Fleuret: https://t.co/KQVSqpUrBT RT @GurdeepPall: A good new paper by a broad group of thinkers snd practitioners that tries to organize and explain Malicious #AI scenarios… Worth a (re)read: "Toward an Integration of Deep Learning and Neuroscience," @AdamMarblestone et al.: https://t.co/pdvEXtF4cj @willknight @zacharylipton @ericschmidt many zeroes, actually https://t.co/k5heiEu7Oi Remember Mike Pence? "The bit about AI in NSA nominee Nakasone's testimony earlier starts at 1:36:45ish here - https://t.co/mFmw0vOnnJ h/t @KateCharlet" @catherineols @jackclarkSF He’s so contradictory. He also thinks the Turing Test will be passed in a few years but that isn’t a big deal because ~*reasons~* RT @Kantrowitz: When your targeted advertising is just a bit too on point https://t.co/Nyda05t13s $15K of prizes in the "Solving the AI Race" round of the @GoodAIDev @AI_Challenge - write up your ideas on how AI development can be developed more cooperatively and beneficially. https://t.co/iXOUk0606r https://t.co/A9LNluz9Y1 @timhwang https://t.co/zmKFEJ24io (I agree, but worry that NSA could end up being part of the problem here if it sets a precedent for aggressive use of AI-enabled offense) From Nakasone's answers to advance questions: "Additionally, the U.S. should closely monitor and prepare for threats utilizing emerging technologies such as artificial intelligence and machine learning." https://t.co/Daan03Z32V MIT and SenseTime working together: https://t.co/WF2IsL6l39 RT @ericjang11: Off-policy RL, i.e. "offline training", is highly underrated when it comes to approaching generalization across many tasks.… "Compressing Neural Networks using the Variational Information Bottleneck," Dai et al.: https://t.co/mXzv0jwizi Didn't know the Joint Tsinghua-iFlytek Lab was a thing. "Medical Exam Question Answering with Large-scale Reading Comprehension," Zhang et al.: https://t.co/yaymCpKgXu "Improved Explainability of Capsule Networks: Relevance Path by Agreement," Shahroudnejad et al.: https://t.co/bvBnUGTAUl @togelius nope, not Schmidhubering :) (from https://t.co/IyJNad6gJW) "My alarm: wake up Me: https://t.co/AvTL5dUGQV" TL;DR: actively pursue various hand-coded auxiliary rewards like these, sequenced in various ways, to explore better in robotics. https://t.co/6IRq6td7RI "Memory-based Parameter Adaptation," Sprechmann and Jayakumar et al.: https://t.co/P96sqQSk92 "Selective Experience Replay for Lifelong Learning," Isele and Cosgun: https://t.co/WLiv1hlBnd "Deep Reinforcement Learning for Vision-Based Robotic Grasping: A Simulated Comparative Evaluation of Off-Policy Methods," Quillen, @ericjang11, and Nachum et al.: https://t.co/20OC9ufloL "Precision medicine as a control problem: Using simulation and DRL to discover adaptive, personalized multi-cytokine therapy for sepsis," Petersen et al.: https://t.co/9s2VTkn6GP "DiGrad: Multi-Task Reinforcement Learning with Shared Actions," Dewangan and S et al.: https://t.co/sSlqClQDXL "Learning by Playing - Solving Sparse Reward Tasks from Scratch," Riedmiller and Hafner et al.: https://t.co/mEvkiSrEJX @joshkerr @WarrenDavis29 @tsimonite @gwern https://t.co/265ZYzYXlQ RT @SuryaGanguli: New #deeplearning paper: The Emergence of Spectral Universality in Deep Networks https://t.co/VtY9b2xfPt to appear at AIS… RT @fjord41: Google's Machine Learning Crash Course is now available externally! The internal version of this course is what helped me get… RT @georgejtucker: We looked at the sources of variance in policy gradient estimators for some common continuous control tasks, and I was s… @Smerity @iamtrask I enjoyed it too :) @iamtrask So like this https://t.co/6WDMZsloP4 but in reverse :P Snowmg https://t.co/UmcuPqArSn RT @AP: BREAKING: Dick's Sporting Goods, one of the nation's largest outdoor gear retailers, ends sale of assault-style rifles in stores. "Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis," Ben-Nun and Hoefler: https://t.co/pFbcAyFMDO "Modeling Others using Oneself in Multi-Agent Reinforcement Learning," Raileanu et al.: https://t.co/qa4rVUtQ4N "Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNs," Garipov, Izmailov, and Podoprikhin et al.: https://t.co/bwmjK77S4O (never say never - there is more every year - but let's say, I'll tweet a disproportionate amount of it) I also have stopped trying to cover health stuff, GANs, adversarial examples, or deep learning theory stuff that I don't understand, as there's too much of all that stuff. Will never skip good deep RL stuff, though! Period reminder that my botter half tweets more papers than I do - I'm more selective: @BrundageBot PPO + GAIL. Video here: https://t.co/6mkx945Sy8 “Reinforcement and Imitation Learning for Diverse Visuomotor Skills,” Zhu et al., DeepMind: https://t.co/0Hx5Y7KBe6 Apparently it’s Torque Tuesday, though (robotics stuff). RT @mark_riedl: I don't even know what to say about this, so I'll just leave this here and hide under the covers for the rest of my life ht… My Atari sense is tingling 🤔 let’s see 500% median score or good transfer... @WarrenDavis29 @tsimonite @gwern Whether this, from an AI paper, is a known bug: https://t.co/nSr7cc1Ya0 RT @verge: Exclusive: Palantir has secretly been using New Orleans to test its predictive policing technology https://t.co/GTY9umwfZC https… RT @KarinaVold: Wrote some ideas on the legal implications of the extended mind thesis--thanks to @aeonmag and @daviesally for working with… RT @moyix: Re-upping: an AI algorithm found and exploited a bug in Qbert without human intervention, and it doesn't seem to have been disco… @MilitantHobo yep, there are links in the paper for several things including this. TL:DR: moar hard drives. https://t.co/owcj5FApkY "Reinforcement Learning on Web Interfaces Using Workflow-Guided Exploration," Liu et al.: https://t.co/ek4yYysLs7 "then starts to jump from platform to platform in what seems to be a random manner... For a reason unknown to us, the game does not advance to the second round but the platforms start to blink and the agent quickly gains a huge amount of points" Some fun results, e.g. "Specifically, the agent learns that it can jump off the platform when the enemy is right next to it, because the enemy will follow: although the agent loses a life, killing the enemy yields enough points to gain an extra life again" "Back to Basics: Benchmarking Canonical Evolution Strategies for Playing Atari," Chrabaszcz et al.: https://t.co/265ZYzYXlQ RT @NicolasPapernot: Find out why privacy and accuracy are not necessarily enemies! The new PATE is more accurate, more private and more co… "Scalable Private Learning with PATE," @NicolasPapernot and Song et al.: https://t.co/CtLSPDc5tr "Meta Multi-Task Learning for Sequence Modeling," Chen et al.: https://t.co/vRnu5YNkW0 """Adversarial vulnerability for any classifier,"" Fawzi et al.: https://t.co/VNSpY32P03 Seems to go even further in the impossibility result direction than Adversarial Spheres." """Deep Feed-forward Sequential Memory Networks for Speech Synthesis,"" Bi et al., Alibaba: https://t.co/koLDp7qjwu In the same spirit of compute-efficient neural speech synthesis as yesterday's DM/GB paper." @mark_riedl lol @mark_riedl The general theme of self-citation, sure. But the early 90s AI refs is pure Schmidhuber "Temporal Difference Models: Model-Free Deep RL for Model-Based Control," Pong and Gu et al.: https://t.co/En54atlh6G "Addressing Function Approximation Error in Actor-Critic Methods," Fujimoto et al.: https://t.co/BvGGk95H8p @AMP_SV he is inimitable. RT @catherineols: Check out our paper! Make your GAN training more stable by keeping the generator well-conditioned during training: https:… "RT @nottombrown: Our new paper: ""Is Generator Conditioning Causally Related to GAN Performance?"" TLDR: ""Almost certainly"" https://t.co/55…" (not bashing Schmidhuber, just observing his continued uniqueness in various respects) Literally no one else in the world would write this abstract https://t.co/F37Ps7XZEs @gwern seems plausible, though I'm not sure of the rationale for not using the NNAISENSE affiliation. perhaps just habit (/or he has to keep publishing stuff with his Swiss AI Lab hat for some reason). No results, but lots of ideas. "One Big Net For Everything," Juergen Schmidhuber: https://t.co/IyJNad6gJW @clarkamiller nope. RT @thomaswright08: I see Trump said he'd have taken on the school shooter without a gun. This is how he reacted when someone fell at Mar-… RT @jackclarkSF: Working on this new robot release from @OpenAI has made me significantly more optimistic that we'll see significant progre… "RT @OpenAI: Ingredients for Robotics Research: https://t.co/tPFyfo6PSE - Hindsight Experience Replay (HER) in Baselines. - New robotics env…" "RT @egrefen: Final version of our ICLR paper is out. Key points: * ConvNets good for vision, not so good for tree structure. * Explicit co…" Appendix B also has a lot of interesting ideas on further areas to explore. Much more questions remaining than answers! "Glad our report on malicious use of AI (https://t.co/EOguni4pTN) got attention, but perhaps unsurprisingly, most discussion focused on the risk scenarios (1 section of report). I'm particularly proud of the Strategic Analysis+Interventions sections, hope ppl check em out too :)" "RT @peterwsinger: U.S. blocks chip equipment maker Xcerra's sale to Chinese state fund https://t.co/GR0O2se2ZW #ghostfleet" Things you encounter walking around Oxford https://t.co/dTpmbKC29K @clarkamiller We should def. discuss when I'm in town in early April if you're around then! RT @urbanfriendden: https://t.co/WKGm9zF2Uo @clarkamiller Interesting. Might make sense given the diversity of AI-related subtopics. @clarkamiller indeed! thanks! @clarkamiller so I'm particularly interested in learning about fairly "generic" elements of agreements (e.g. institution design for resolving disputes, on-site inspections) that don't nail down the exact thing to be verified, but of course that's v. important/needs much more analysis+dialogue @clarkamiller That's part of what I'm trying to understand - it's not obvious, + diff. answers for diff. threat models. Perhaps certain forms of robots, perhaps certain computing hardware, hopefully not software but maybe, perhaps some uses of some of these things. @pfau yes, it's definitely not just a Trump problem @pfau Putin seems to have started funny business with INF (intermediate range missiles) b4 Trump, but Trump needs to handle it and doesn't seem to be. Some stuff is more squarely in Trump's court like Putin calling to say hey, let's extend New Start, and Trump's like, that's lame. @lauretig a tiny bit but haven't read that one - will check it out, thanks! And New START...and Iran... it's not a good time to argue that international cooperation can work. But I'll soldier on. 🤦‍♂️ E.g. I got very excited about the INF Treaty based on old papers and then looked at recent developments https://t.co/pdXi3mpM9R "Sadly common narrative in a lot of arms control agreements I've been investigating as case studies for international cooperation on AI/autonomous weapons: -long negotiation period -pretty decent terms/verification -going OK for a while -Trump/Putin messing it up now" Would have liked to see results on the rest of DM Lab. Oh well. RT @EFF: While we may not yet be at the point where face recognition is being used to broadly monitor the public, our government is buildin… Video: https://t.co/yV5ngKA2JJ @gwern I dunno, but IMPALA was mostly (if not totally) different people and DM tends not to incorporate very recent advances into new architectures, esp. ones that have been cooking for a while like this one probably has. More seriously: good paper, surprisingly simple but effective. I was wondering when Universal Value Function Approximators would have their day... also, another success story for for parallel actors with a centralized learner in DRL. Only focusing on the most important part of the paper Technically Unicorn, not UNICORN. Still. https://t.co/an4OiuUZke Excited about this paper! Been looking forward to something like this since David Silver teased some related ideas at NIPS. That being said, let's talk about UNICORN being based on "UNIversal Continual Off-policy Rein- forcement learNing" 🧐 "Towards end-to-end spoken language understanding," Serdyuk et al., Facebook + Yoshua Bengio: https://t.co/YsQXzqjutD """Do WaveNets Dream of Acoustic Waves?,"" Kanru Hua: https://t.co/W3RPYCgzcJ Timely investigation of what's going on inside WaveNets." Chinese companies love deploying DRL... "Budget Constrained Bidding by Model-free Reinforcement Learning in Display Advertising," Wu et al., Alibaba: https://t.co/QNTePTsWLr "Structured Control Nets for Deep Reinforcement Learning," Srouji and Zhang et al., Apple: https://t.co/ZAIW79BXRb "BigDataBench: A Dwarf-based Big Data and AI Benchmark Suite," Gao et al. at Chinese Academy of Sciences, Huawei, Alibaba, etc.: https://t.co/3Qz40hfnHi "Verifying Controllers Against Adversarial Examples with Bayesian Optimization," Ghosh et al.: https://t.co/ZJoSceVnV4 """Efficient Neural Audio Synthesis,"" @NalKalchbrenner et al., DeepMind/Brain: https://t.co/HyqIRaAu66 ""high fidelity audio generation is now achievable on widely available low-power mobile CPUs""" "Unsupervised Grammar Induction with Depth-bounded PCFG," Jin et al.: https://t.co/0WRKoOKcPd "Weighted Double Deep Multiagent Reinforcement Learning in Stochastic Cooperative Environments," Zheng et al., Tianjin/Soochow U.'s: https://t.co/MfBPTj5Fs1 "Unicorn: Continual Learning with a Universal, Off-policy Agent," Mankowitz et al., DeepMind: https://t.co/JVU70ifZwP RT @BrundageBot: Asynchronous Byzantine Machine Learning. Georgios Damaskinos, El Mahdi El Mhamdi, Rachid Guerraoui, Rhicheek Patra, and Ma… @jathansadowski https://t.co/L5ZNbrUenP @jathansadowski Omg is that as big as it looks And of course, see Dark Forest and the rest of the Remembrance of Earth's Past series! See also: https://t.co/eXfFe86T0d https://t.co/I9p3IVpXED "Strengthening Checks on Presidential Nuclear Launch Authority," Bruce Blair: https://t.co/GfTdilUa3I RT @XHNews: The Communist Party of China Central Committee proposed to remove the expression that the President and Vice-President of the P… RT @NandoDF: Our new paper on learning compositional communication illustrates how agents subject to suitable environmental pressure can le… RT @NandoDF: There is a lot of speculation about machines becoming aware. In this new paper, we try to formalise one form of awareness and… cc @jeremyphoward, related to some of your recent comments (cf. https://t.co/hDSn0mDNbj for some of the arguments being argued against) Arguments against various arguments for why future AI progress might be discontinuous, from @AIImpacts: https://t.co/iyWQ9kqP6L "RT @BeauWillimon: As of today, @Emma4Change now has more followers than the @NRA. It happened in less than two weeks. This is a movement.…" "RT @juliagalef: I highly recommend applying for a research analyst job at Open Philanthropy: https://t.co/chEFa9UrVi If you care about the…" @mikeyd_47 I haven’t, will check out - thanks! Damn it, it should have been Security Dilemma Saturday. "It’s Soviet Union History Saturday! (Really bad summary of the book but it had to have an S) https://t.co/LpeV6CA7SC" @samim I’d think the cost is mainly in the (camera) hardware and hiring of engineers but I dunno, interesting question. @samim https://t.co/OBxdGLGlJJ @samim Well China is exporting their surveillance tech bigly. A “One Belt, One Road” China-led surveillance network is pretty plausible. US+China, dunno. @samim Thanks! :) @samim That’s why I helped write the report :) and yes I could be wrong, so am eagerly anticipating this book soon: https://t.co/ibpnnNbCsD @samim (Unfortunately they are less applicable to the nuclear war mongering part where checks are not significant :( ) @samim I’m with you on surveillance being a huge problem but Trump is fortunately not omnipotent @samim Yes, seriously. The US is in a really shitty place but still has courts, “deep state” etc. and Trump regularly defeated by such checks. @MonaJalal_ @samim Glad they did! Half in database sounds right, and many foreign ppl in US databases via customs/immigration photos at airports. Would still think FB has a lot more total photos/does orders of mag. more inference @samim Use of the word primary. I think your overall point is fair and there are huge risks here. @samim I’m aware of PRISM, but post-Snowden there were reforms and AFAIK even pre reforms, it was never total FB data, just ability to get info on specific ppl. I would be surprised if any govt other than China were doing face tagging at FB scale. In any case, I was just disputing the - @samim not sure it’s primarily used for surveillance (in the West at least, though maybe true in China?). Hundreds of millions of FB users are tagged daily, no comparably large integrated face surveillance system that I’m aware of. But even if not *most* common use, your point is fair RT @BulletinAtomic: Gregory Lewis investigates long-run impacts and potential catastrophic risk from advancing biotechnology at the @FHIOxf… RT @ai_memes: There's an incredibly low variance in AI-related memes, as most of them revolve around a handful of concepts. https://t.co/4e… From Facebook https://t.co/4A6TzHSMGk Making an action movie starring yourself is the new sending your car into space. https://t.co/XqdOdYoBGJ Game theory according to Dan Brown. I’ve heard his discussion of antimatter is similarly 👎 https://t.co/NcV5Dc0ZaX RT @shimon8282: Final version of our ICLR paper is online: TreeQN and ATreeC: Differentiable Tree-Structured Models for Deep Reinforcement… "RT @leonardblier: I have just released my first preprint on arXiv ! ""Do Deep Learning Models Have Too Many Parameters? An Information Theo…" RT @mark_riedl: As threatened last year, I am now about to live tweet my reading of Dan Brown’s The Origin, which I’ve been told features A… @mpshanahan I owe you coffee next time you're in Oxford or I'm in London :) Very impressed with @mpshanahan's sleuthing skills! https://t.co/si3w0vG0oJ @mpshanahan we have a winner!! @atg_abhishek 2, with the same underlying theme RT @NicolasPapernot: Did you ever wonder if adversarial examples that fool machine learning models can also fool humans? Read more to find… RT @DeepMindAI: Our new paper proposes a simple and general causal approach to algorithmic fairness: https://t.co/x5h1XMCmzA @robmccargow Reading the whole thing once also merits a coffee :) @ArtirKel Nope Co-authors other than Shahar and @jackclarkSF are also eligible for this prize/punishment. @is8ac just pretty design :) @brubsby Nope, good guess though! Don't think anyone has found the easter eggs in the malicious use of AI report 🧐 if you do, I'll buy you a cup of coffee or a spear phishing email, your choice. RT @katherine_oxf: Xiaomi and Microsoft have signed a Strategic Framework Memorandum of Understanding (MoU) to work more closely in the are… RT @RoryStewartUK: Really helpful starting point on managing potential threats from AI https://t.co/9mhMaAbFtk "Tired: don't send anyone to South Korea Wired: send Ivanka Trump Inspired: actually appoint a US ambassador to South Korea https://t.co/DJEvCVrD6S" Sad to be missing this IRL but glad it’s being taped! https://t.co/8zy3fIJ0uK RT @fatconference: Watch the #FAT2018 livestream here: https://t.co/izyRiA1UtK @catherineols @colinraffel nvm I think I'm thinking of The Angry Beavers. Carry on. "An Analysis of Categorical Distributional Reinforcement Learning," Rowland et al.: https://t.co/r0uqZvdkJ9 @catherineols @colinraffel omg, is that the one where they had a really cool mail system? "Manipulating and Measuring Model Interpretability," Poursabzi-Sangdeh et al.: https://t.co/HHLY7iqbR8 "Learning to Explain: An Information-Theoretic Perspective on Model Interpretation," Chen et al.: https://t.co/rBZzZQfOD9 "ChatPainter: Improving Text to Image Generation using Dialogue," Sharma et al.: https://t.co/LAgNoZ40AO "The Secret Sharer: Measuring Unintended Neural Network Memorization & Extracting Secrets," Carlini et al.: https://t.co/kPGBdsUNLS RT @goodfellow_ian: Adversarial examples that fool both human and computer vision https://t.co/jpeYjPuw6D https://t.co/i4ttmFNrHX @pfau @chelseabfinn that's the metaverse brain version. Interesting that they tried both @chelseabfinn's MAML and Li's Meta-SGD, both on 7k user devices. "Normal brain: meta-learning Expanding brain: federated learning Galaxy brain: ""Federated Meta-Learning for Recommendation,"" Chen et al., Huawei: https://t.co/SVSFwlAouH" "Machine Theory of Mind," Rabinowitz et al., DeepMind/Brain: https://t.co/85gTfwTfbP RT @mbrendan1: Just published! "xView: Objects in Context in Overhead Imagery" https://t.co/I2OomguxJT @tsimonite @Smerity (again, I'm sure we could have done it more time, but it went from "top post on well known Reddit page = link to app/tutorials etc." to "have to dig around a while" so I gave up) @tsimonite @Smerity first idea was Trump/Obama talking about the report being great, then it moved to something just involving one of us as the person being made to say something in light of the former maybe being unethical etc., never got to the point of hashing out the details, though, bc Reddit. @Smerity @tsimonite We added a bit on this to report after it happened... + between the time I had the idea of using deepfakes to make a promo video and actually trying to, Reddit cracked down, so it was harder (not insurmountable, prob, but not worth my time) to find the app. Fast moving area! (According to Wikipedia, there has been some trouble in recent years involving Russia and Syria viz-a-viz the treaty but I haven’t looked into this - book written before that) Makes ya think 🤔 re: what could be done with unarmed drones. The Treaty on Open Skies is very cool. Excerpt from foreword to Peter Jones’s book Open Skies. https://t.co/nuIidwTued @rcalo Awesome! RT @IrwanBello: If you're working in AI, or simply interested in the future, please consider reading this report! https://t.co/H8l2RqeLsP h… @rcalo also... https://t.co/29ASrnZMfy @rcalo Your paper sounds cool - we briefly mentioned this in the malicious use report but didn't know anyone was working on it! (I assume you are referring to adversarial example/data poisoning type stuff?) RT @rcalo: Agenda is up for We Robot. It's full of FASCINATING STUFF. But I wouldn't check it out unless you are interested in FASCINATING… "RT @IRHotTakes: me: deepfake videos are an existential threat to public trust in our democracy also me: lord of the rings but all the hobbi…" RT @derektmead: White House position on guns https://t.co/8r6Rd1EILN "RT @OpenAI: Releasing MADDPG, an algorithm for multi-agent reinforcement learning. MADDPG: https://t.co/2jZCWfLY3o Multi-agent environment…" ~*AI~*ethics~*research~*group~* https://t.co/5tN1zk22yG RT @weballergy: Announcing another initiative in #AI for healthcare at DeepMind: https://t.co/mHA6vVLQdK "RT @AlenaSatoshi: When you see an amazing team on this new cool ICO website... 😂 https://t.co/EjvH0cOCEA" RT @sarahkaplan48: Huge @azeen @paldhous @virginiahughes story on allegations of sexual misconduct against celebrity scientist and skeptic… RT @zinmalu: I'm excited to share our new paper "Ordered Preference Elicitation Strategies for Supporting Multi-Objective Decision Making"… RT @nikiparmar09: Our new paper “Image Transformer”, extends self-attention from the original Transformer to much longer sequences on Image… @clarkamiller At least one person in the Canadian govt did :) RT @zacharylipton: *Active Learning with Partial Feedback*: we introduce learning agents that choose not only *which image* to label, but *… "A Generative Deep Recurrent Model for Exchangeable Data," Korshunova and Degrave et al.: https://t.co/Zb1A5cdM45 """Attack Strength vs. Detectability Dilemma in Adversarial Machine Learning,"" Frederickson et al.: https://t.co/WPQvEuESib TL;DR: resolvable dilemma, attack wins again" "Generalization in Machine Learning via Analytical Learning Theory," Kawaguchi and (Y.) Bengio: https://t.co/M8ueHBsXYS "Clipped Action Policy Gradient," Fujita and Maeda: https://t.co/r7pfmRg7Qx "Information Theoretic Co-Training," David McAllester: https://t.co/j4VpxZO0ts "Pair of cool-looking papers on intrinsic motivation by Haber and Mrowca et al.: ""Learning to Play with Intrinsically-Motivated Self-Aware Agents"": https://t.co/6UQjnOxOB1 ""Emergence of Structured Behaviors from Curiosity-Based Intrinsic Motivation"": https://t.co/EjSu23aMXl" "Stochastic Video Generation with a Learned Prior," Denton and Fergus: https://t.co/LN0GaLGgGH Been waiting for something like this - "Continual Lifelong Learning with Neural Networks: A Review," Parisi et al.: https://t.co/vc8t7Vxhi1 "Interpreting Neural Network Judgments via Minimal, Stable, and Symbolic Corrections," Zhang et al.: https://t.co/ilETYt756t "Investigating Rumor News Using Agreement-Aware Search," Shang et al., Urbana-Champaign/Google: https://t.co/gso7xNMwgd RT @mbrendan1: Today we announced xView, a new dataset and challenge designed to advance key computer vision frontiers for disaster respons… RT @shimon8282: Our new paper: using Fourier analysis to derive policy gradients: we recast the integrals as convolutions, which a Fourier… "RT @EFF: Society must prepare for bad actors misusing artificial intelligence. 26 authors from 14 institutions, including EFF, have worked…" That escalated quickly (https://t.co/EOguni4pTN traffic). https://t.co/d4ETM206VT RT @DroneCenter: There are over 200 counter-drone products on the market today, but a host of practical and legal questions around their us… @iamtrask hahah RT @MGBennett: On #BlackPanther &its potential to reshape political thought &action https://t.co/OtNztWiWt6 @iamtrask Sorry to interrupt your ride ;) RT @mer__edith: ⚡️We called for an end to black box AI systems in core public agencies. Now @AINowInstitute offers a practical framework fo… @katyanna_q Am I a boffin? 🧐 @marasawr @seanhn I’m not aware of* @marasawr @seanhn we discuss this a bit in Appendix B, first section, but by no means exhaustively addressed the issue. Would be interested in your perspective, on this and apologies if there is public work/writing on this already I'm aware of. @seanhn some of the broader context around export controls, etc. came up in the editing process but we weren't able to do the issue/term full justice, granted. @seanhn It's commonly used in some of the literature we were inspired by in other domains (e.g. https://t.co/lcwyKUGRKV; https://t.co/8KEDkMTpnD) and does indeed have some baggages. Arguably omni-use (in light of AI's high generality) is better (we briefly mention that too). @jjvincent what's the best other than Player of Games? @HeidyKhlaaf Thanks! That'd be awesome. I'm in Oxford most of the time but also drop by London occasionally :) On the subject of AI + cybersecurity, see also these great slides from a talk by @halvarflake which we really should have mentioned (my fault): https://t.co/vTskwjgdqj "RT @drhyrum: citable arxiv link for the report: https://t.co/A3JrXkf0eG" "Nice post from two co-authors of the report elaborating on the infosec/dual use issues raised: ""Thus, while we’re not clamoring that the sky is falling, we do feel an obligation to raise awareness."" https://t.co/ENbuphAWAB" RT @drhyrum: Our stance (with @filar) on the dual-use nature of AI for infosec, in conjunction with new report on malicious use of AI (http… @EvanSelinger many thanks! RT @JohnDanaher: Check out @Miles_Brundage (and lots of others') great new paper on the malicious uses of AI. And for counterbalance, then… RT @halvarflake: I have a few (small) comments on the "malicious use of AI" report that came out today. Thread follows. @AntonioGrzt I’m unfortunately not but CCing colleagues in case they are @HaydnBelfield @CSERCambridge @jeremyphoward thanks!! RT @HaydnBelfield: Op-ed on our new 'Malicious Use of AI' report co-written by me, @Miles_Brundage, @jackclarkSF, Shahar Avin & Seán Ó hÉig… RT @markus_with_k: Congrats to @Miles_Brundage @jackclarkSF and colleagues for steering the communication towards more imminent challenges… @Rsnuzum I was - thought your name was familiar! https://t.co/zj2q0HkOpN @tdietterich Thanks! And indeed, a lot of the things we should do in light of AI are things we should have done a long time ago, but now just have more urgency. RT @jackclarkSF: I've spent a year or so having the pleasure of thinking intently about all of the worst ways in which people may abuse or… RT @BrundageBot: arXiv papers, February 21, 2018: RT @shivon: Creating the best possible AI future is *not* a simple equation. This is really excellent thinking on how to navigate the thorn… RT @sociolegaltech: "The Malicious Use of Artificial Intelligence:..." is a fantastic report by @Miles_Brundage et al (2018). The Report's… "RT @tdietterich: This new report does a great job of identifying many potential malicious uses of AI technology https://t.co/aUuCWZji7e Hig…" RT @dhadfieldmenell: I was really excited to participate in this at some early phases. Dual use of AI is an under appreciated risk that doe… "Neural Architecture Search with Bayesian Optimisation and Optimal Transport," Kandasamy et al.: https://t.co/49jcmiGj7D RT @paul_scharre: Just a few of the co-authors: @jackclarkSF, @hlntnr, @RebeccaCrootof, @paul_scharre, @Gregory_C_Allen, @HMRoff, @j2bryson… RT @paul_scharre: Groundbreaking new report out on possible malicious uses of #artificialintelligence. 26 authors from 14 institutions http… "Distribution Matching in Variational Inference," Rosca et al.: https://t.co/3jIVyi0yVI "Attentive Tensor Product Learning for Language Generation and Grammar Parsing," Huang et al.: https://t.co/urVl7BUQQ7 "Meta-Reinforcement Learning of Structured Exploration Strategies," Gupta et al.: https://t.co/lgv8nqr7bg "Continual Reinforcement Learning with Complex Synapses," Kaplanis et al.: https://t.co/HzJ4Hgaq7n "arXiv copy of our new paper, ""The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigation,"" by 26 authors at 14 institutions: https://t.co/eOcORdFx4s 🤖🤔🧐" @PatrickOmid congrats! RT @PatrickOmid: My survey paper on recent progress in applying deep learning to multi-target tracking (i talk about a lot of other ML tech… @robotic_hands @lmatsakis @RealSexyCyborg @WIRED @VICE @motherboard it's really fine, I was worried too Apologies in advance for copious report-related tweets, but hopefully I've earned some political capital to burn after all the free paper-filtering services 🧐 also, read the report and let me know your thoughts! https://t.co/EOguni4pTN RT @gdb: A topic that will become increasingly important over time: https://t.co/FbjIsJVCLR RT @FHIOxford: New report on malicious use of AI, collaboration of researchers from FHI, @CSERCambridge, @OpenAI, @EFF, @CNASdc and 9 other… RT @awjuliani: Really striking figure from https://t.co/2tOfNVko5N (definitely worth reading, by the way) showing progress of GANs in gener… RT @tsimonite: Also, interesting how @FathomComputing is a public benefit corporation—the founders want the power to turn down deals that m… Thanks for covering the report! I'd add that our discussion of openness is pretty nuanced, so encourage readers of this to keep an open (cough) mind/read report themselves :) Complex issue, and I wouldn't want the field to be way less open anytime soon. https://t.co/ab1p9SbetL https://t.co/BcFVvQRf52 "RT @RikeFranke: You want to read this report. Ok, no, you don't want to, but you should. #AI https://t.co/UqriPUqEZO" "A few more who are on Twitter: @drhyrum, @filar, @zeitzoff, @carrickflynn. Thanks also to all who gave key feedback on the report+participated in workshop, + Talia Cotton/Sankalp Bhatnagar for the design. Look forward to people's thoughts on this complex and important topic!" RT @filar: Super excited to have been part of this effort and discussing AI Misuse in Infosec with fellow @EndgameInc researcher @drhyrum h… RT @tsimonite: As an appetizer before you digest the full 99 pages, here's a summary of some major points: https://t.co/L9IKELQG48 https://… "RT @OpenAI: Preparing for Malicious Uses of AI: https://t.co/ebAwQVkwHR Policy research on forecasting, prevention, and mitigation of AI-bo…" RT @zeitzoff: Very important and cool report on AI and malicious actors. Proud to be part of this/contributor. https://t.co/3OjnvFXMNm "(In case that link doesn't work, you can get it at https://t.co/fzDgwnkgy3) It's been great working with a diverse team of experts inc. @jackclarkSF, @hlntnr, @RebeccaCrootof, @paul_scharre, @Gregory_C_Allen, @HMRoff, @j2bryson, @romanyam, and many others not on Twitter!" Excited to share a report I've been working on for a while with many collaborators at @CSERCambridge, @OpenAI, @CNASdc, @EFF, and elsewhere: "The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigation": https://t.co/sLWF75K1u3 https://t.co/I8lkhSGtmB Have some cool stuff to share very soon 🙊 Oprah giving out AI residency programs .gif https://t.co/WSpI4eSIqF @romanyam https://t.co/l2i0qep6QI RT @tsimonite: Moore's Law is fading, but hunger for more powerful machine learning appears insatiable. @FathomComputing's founders say the… Last tweet in the series - the interdisciplinary Megazord is almost in the wild. https://t.co/Ux74bXDqSZ @timhwang @logangraham he also has a book coming out soon. RT @timhwang: DC People: for an upcoming paper, I’m looking for a temp research assistant to attend a two day workshop on chip security in… "Implicit Robot-Human Communication in Adversarial and Collaborative Environments," Kulkarni et al.: https://t.co/S0BMny0suV "Recommendations with Negative Feedback via Pairwise Deep Reinforcement Learning," Zhang et al., JD and Michigan State: https://t.co/Pf5Wv1XH94 "Differentially Private Generative Adversarial Network," Xie et al.: https://t.co/bRjGuUxr0j "Learning High-level Representations from Demonstrations," Anderson et al., Prowler: https://t.co/4WiUp5szSv @mgubrud that interview made no sense RT @JeffDean: Some new work from the part of Google Brain that works on ml for healthcare: we have encouraging early signs that non-invasiv… RT @FHIOxford: "When so much is at stake, collective caution should be the guiding principle—not unilateral action. Not all discoveries jus… https://t.co/ibDf6eeZDn RT @noUpside: I can’t emphasize enough what a disaster Groups are. The Groups recommendation engine is a conspiracy correlation matrix. It… @swirlOsquirrel @netflix I think at least some of them are generated by Netflix. In any case, they have an option on the menu to give feedback on incorrect subtitles, which would be strange if they never change them. RT @BrundageBot: arXiv papers, February 19, 2018: "Disentangling by Factorising," Kim and Mnih: https://t.co/WajS34aM4W "Towards an Engine for Lifelong Interactive Knowledge Learning in Human-Machine Conversations," Mazumder et al.: https://t.co/BxBOX23bAd "Diversity is All You Need: Learning Skills without a Reward Function," Eysenbach et al.: https://t.co/4gqRmotDx1 @halhod could be a good application, yeah, if not used already. E.g. Apple on their FaceID "We augmented the studies as needed to provide a high degree of accuracy for a diverse range of users" (could be doing a similar thing through other means). "Neural Voice Cloning with a Few Samples," Arik, Chen, Peng, and Ping et al.: https://t.co/hZoTXN6OmE "Training Deep Face Recognition Systems with Synthetic Data," Kortylewski et al.: https://t.co/f6AzMaOKew "MPC-Inspired [model predictive control] Neural Network Policies for Sequential Decision Making," Pereira et al.: https://t.co/zv1fmHLOrR @marcfawzi @netflix and to be clear, I'm not sending generic emails, I'm using the form designed for this specific purpose built into this site. Maybe people send a bunch of junk to that, but I'd be surprised, and it'd be easy (at least for human) to filter ones that suggest specific problemx/fixes @marcfawzi @netflix I suspect they don't get much of this specific kind of feedback - they should have a human look at it if it's actually technically that hard to automate (I'm not sure it is). Especially for people (not including me) who actually really need the subtitles. Hi @netflix - whenever I see an incorrect subtitle, I submit a correction, but they never get fixed. You should either look at customer feedback or not ask for it. @primalpoly @KStylePodcast @DLoesch *their main lever out of those options, not sure it's their main overall mechanism of influence @primalpoly @KStylePodcast @DLoesch The teachers' union figure you're referencing includes outside spending, which is the NRA's main lever (50x direct campaign donations). Using comparable figures: NRA>teachers' unions. Quick reminder that the President calls people Liddle' https://t.co/8lHzFEkGCB @mark_riedl So the third would be The Tensor Convolutions? "Autonomous Agents Modelling Other Agents: A Comprehensive Survey and Open Problems," Albrecht and Stone: https://t.co/CYKqhb1shU RT @SmithaMilli: When you want PhD students to show up and free food just doesn't cut it anymore https://t.co/29uw8AGVRA "RT @erikphoel: Yup, naked mole rats are immortal. https://t.co/lInJokGMzC" @timhwang But what would the multiverse brain do? @tdietterich He also said something similar about chess back in the day :) RT @ProfDavidHart: John Holdren #AAASmtg talk re TrumpAdministration - disrupting sci coop, stacking courts w ideologues, undermining globa… "RT @darth: ""how can i make this about me"" https://t.co/XHCrPirihL" "RT @SaysHummingbird: CAN'T. RETWEET. THIS. ENOUGH @dalehansen 👏👏👏👏 https://t.co/i3w9K3FeXU" @jackclarkSF @rcalo @zeynep @UW (and, indeed, can penalize it - see e.g. https://t.co/w4gtDF8TCQ, more about public engagement than policy engagement per se, but the two are related) RT @peterbakernyt: Indictment makes clear Russia is waging a virtual war against the United States. But with Trump focused on what it means… "RT @erikbryn: Very interesting finding. I'm going to do this today after reading a new paper. Other studies show the sleep has a similar e…" *actually final edits! https://t.co/LNSVs6DRaZ @rbhar90 @tsimonite @rao2z @DeepMindAI He said something like that for fully autonomous cars, something more like Rao’s tweet re: general AI, I believe RT @decodyng: Have you ever heard the term "model distillation", but not had a good idea of what it entailed? In this post, I dive into the… Re-upping this cuz it's super wild that they applied DRL to actual cell networks: https://t.co/Q8YJAowdzD RT @BoredMiles: @Miles_Brundage I believe in you Finished what I needed to for the day! Thanks all for the thoughts (see thread in case you also need a push :) ). https://t.co/bCWm2D9y1L @AnthroPunk That’s a very long thesis! Making me look bad ;) @AnthroPunk thanks :) @vkrakovna thanks! :) @rivatez I like it :) @L_badikho that's awesome to hear! :) and good point re: Trump. @RitaJKing good idea :) @RitaJKing dissertation, and wanting to do basically anything else, + concern that some of what I'm saying is wrong @rivatez say more? Help, need writing motivation. RT @erichorvitz: #AI100 call for proposals https://t.co/v6i29IDsGT 100 Year Study on AI at #Stanford is entering its second cycle. Study-wo… RT @ToluseO: Mueller Charges 13 Russians, 3 Companies for Hacking Election https://t.co/7uLXY4Csz4 via @business RT @timhwang: If phrases like “universal, robust, targeted adversarial image patches in the real world” get you excited, I’ve finally poste… @williamstome @MIRRORLab @CSatMines @hrilab @TuftsCS congrats! RT @_rockt: Recording of my talk about combining DL and Logic at The Alan @turinginst workshop on Logic and Learning is now online: https:/… "RT @mcmansionhell: me, a dumbass: ""smart cities"" are cities w/great transit, affordable housing, divested from fossil fuels you, supreme…" "RT @ToniCreswell: Code here: https://t.co/SUmKvli5bV Including code for training DCGAN and WGAN on CelebA, Shoes and Omnilgot. https://t.co…" @rcalo @mark_riedl I recall from your paper! Needs moar AI, though. Maybe "DeepChuckle: Animatronic Entertainment Optimization with Deep Reinforcement Learning from Audience Decibels," Cheese et al. @erikbryn @jeremyphoward @TheAnnaGat @catherineols @ESYudkowsky @sapinker @fchollet @amcafee Stay tuned for some related thoughts very soon :) RT @diazf_acm: "Measuring the value of search", https://t.co/AEXkFK77Md HT: @IR_oldie https://t.co/izqp03zvFB @judywawira I unfortunately don't have a very informed opinion about it :) What do you think? @mark_riedl Chuck E Cheese. Chipotle. "Adversarial Risk and the Dangers of Evaluating Against Weak Attacks," Uesato et al.: https://t.co/cZSu2pNrdy "Reinforcement Learning from Imperfect Demonstrations," Gao et al.: https://t.co/0o6Xr276ET "Inverting The Generator Of A Generative Adversarial Network," @ToniCreswell and Bharath: https://t.co/5LpxvyIpc1 Non-exhaustive list of companies I've been surprised to see AI papers from lately: Swisscom, Comcast, Philips... "Universal Neural Machine Translation for Extremely Low Resource Languages," Gu et al.: https://t.co/GwP9GmBgBd "And now hyperparameter extraction: "" Stealing Hyperparameters in Machine Learning,"" Wang and Gong: https://t.co/wjo8vv2Nnh https://t.co/YkBIsKY4P3" RT @dog_rates: This is Jacob. In June of 2016, he comforted those affected by the Pulse nightclub shooting in Orlando. Four months ago he f… @skrish_13 @zacharylipton last sentence of the article, page 19. @zacharylipton “However, to say anything good about anyone is beyond the scope of this paper” is a solid outro @zacharylipton #ThrowbackThursdays https://t.co/73CponDVTN @gwern @vkrakovna Cc @catherineols RT @natashajaques: A new, short paper I wrote on the importance of learning from implicit social feedback as an intrinsic motivator for dee… @AMP_SV @ginnysimmons probably does RT @vkrakovna: "Deep RL doesn't work yet" has an excellent collection of reward hacking examples - see section "Reward function design is d… RT @SmithaMilli: in case you were wondering what I did this summer https://t.co/4njYcnFWRA RT @ivan_bezdomny: I just published “The AI Talent Shortage” https://t.co/a38jilBMDa Is this electronics/hardware store in Oxford just awesome, or are cables (HDMI, iPhone etc.) just way cheaper in the UK compared to the US? 🤔 That was fast. https://t.co/gb3MydF09H Great work from @SmithaMilli et al.! https://t.co/BVUVT5k8RQ "RT @OpenAI: Interpretable Machine Learning through Teaching: https://t.co/7nrIbVWs2u — encouraging neural network-based agents to transfer…" Agreed, nice post! I also think of DeepStack as deep RL. https://t.co/6OXH2bBVnN "RT @CSERCambridge: **1 MONTH LEFT** Early-career funding for people to work on & study Global Catastrophic Biological Risks https://t.co/L…" RT @togelius: Who killed Albert Einstein? That's up to you to find out. @GabbBarros @Bumblebor @SentientDesigns and I proudly present our n… "Learning via social awareness: improving sketch representations with facial feedback," @natashajaques et al.: https://t.co/CHvWJZB5L4 "TVM: End-to-End Optimization Stack for Deep Learning," Chen et al.: https://t.co/m6HLZWV7a5 "Not to Cry Wolf: Distantly Supervised Multitask Learning in Critical Care," Schwab et al.: https://t.co/SGygAumHzt "GEP-PG: Decoupling Exploration and Exploitation in Deep Reinforcement Learning Algorithms," Colas et al.: https://t.co/KmYUANKvSr @IrwanBello Yeah, I didn’t mean that as a knock against the work, to be clear :) I liked this, though notably not competitive with gold old fashioned SAT solvers, for now at least ("no obvious path," they say). https://t.co/apt6MlPPTE RT @open_phil: We expect hiring to be a major priority for 2018 and have recently posted new job openings for Research Analysts, Grants Ass… RT @sama: Today was the first day I fell for an AI-generated fake video with major geopolitical implications. Luckily the people who showe… @davegershgorn oh, deer RT @ryan_t_lowe: "Deep Reinforcement Learning Doesn't Work Yet" -- fantastic, thorough blog post by Alex Irpan on why deep RL mostly sucks… RT @mcwm: Life comes at you fast https://t.co/Aj84djKjnp @gdb @mbrendan1 @terahlyons @CadeMetz got it, thanks for clarifying! @tkasasagi congrats!! @mbrendan1 @gdb @terahlyons @CadeMetz Did @gdb mention any technologies that would support that? Sounds significantly higher than I've heard even from bullish people. "A comparative study of fairness-enhancing interventions in machine learning," Friedler et al.: https://t.co/CgMjQaLTga "Neural Relational Inference for Interacting Systems," Kipf and Fetaya et al.: https://t.co/s9bWAzaIFO RT @techreview: Trump's proposed budget would introduce some serious cuts for scientific research, despite adding $984 billion to the feder… The MCTSnets paper is also now on arXiv - " Learning to Search with MCTSnets," Guez and @theophaneweber et al.: https://t.co/7P6tLvfKor https://t.co/uvxucQfUr9 "Tighter Variational Bounds are Not Necessarily Better," Rainforth et al.: https://t.co/dmx5KdUOzX "Efficient Exploration through Bayesian Deep Q-Networks," Azizzadenesheli et al.: https://t.co/t98PXMmsbx "Efficient Model-Based Deep Reinforcement Learning with Variational State Tabulation," Corneil et al.: https://t.co/pSwxBQzolj RT @ycombinator: We're podcasting with AI policy researcher @Miles_Brundage and @timhwang. What questions do you have? Jimbob’s Baguettes responds to Five Guys opening up next door. https://t.co/N1OLFanhIF RT @pfau: This paper with @cpburgess_ has almost nothing to do with GANs, but if I put "GAN" in the tweet I bet it will get a lot more atte… RT @jackclarkSF: Perplexing: The vast contrast between China and the US with regards to attitudes & investments re: national AI strategies,… RT @mj_lee: The day after Sarah Sanders emphasized that “above all, the President supports victims of domestic violence,” Rob Porter’s two… @aaronsnoswell Re other Q, I don’t read them all. https://t.co/tjkgH7lzEP RT @BrundageBot: arXiv papers, February 13, 2018: "Answerer in Questioner's Mind for Goal-Oriented Visual Dialogue," Lee et al.: https://t.co/GP7AEnarAy "Deep Meta-Learning: Learning to Learn in the Concept Space," Zhou et al.: https://t.co/vFoSE0zLWb @BogusHype I look forward to having a big influx of new papers to read. Yeah, there’s always a trickle of good ones every day, but when there are conference submission deadlines, there are a lot more than usual. "Universal Successor Representations for Transfer Reinforcement Learning," Ma et al.: https://t.co/ZDIKuJkTXf "Evaluating Implicit Generative Models With Large Samples," Gulrajani et al.: https://t.co/TvY7fN09dW "Winner's Curse? On Pace, Progress, and Empirical Rigor," Sculley et al.: https://t.co/jCymCNqZ5l "Evolved Policy Gradients," Houthooft et al.: https://t.co/Pz6Io40PSv "Transferring Task Goals via Hierarchical Reinforcement Learning," Xie et al.: https://t.co/mFCDvrijV1 "Differentiable Neural Network Architecture Search," Shin*, Packer*, and @dawnsongtweets: https://t.co/uP9iC69bH1 "Learning to Learn Without Labels," Metz et al.: https://t.co/sRqrT5Gpgc Actually it's a few hours from now, my bad. "Minimally Redundant Laplacian Eigenmaps," @pfau and @cpburgess_: https://t.co/SHCOY3uPoZ (deadline in 30 mins) The Singularity is right now (every time you refresh the ICLR page on OpenReview, there are new papers). "Learning Longer-term Dependencies in RNNs with Auxiliary Losses," Trinh et al.: https://t.co/k4DIWlyXYn "RT @timhwang: i’ve been thinking a *lot* recently about family rooms and children’s folk games. new paper available today: “on the archite…" "Sim-to-Real Optimization of Complex Real World Mobile Network by Deep Reinforcement Learning," Tan et al., Huawei: https://t.co/udsyqP0XPD RT @MattHourihan: Here's a first cut of #science and #tech agency budgets in the FY19 request, compared against 2017 spending levels. https… Update: pretty interesting but not super coherent. Chapters on how cerebral cortex works, history of analog computing, evolution of programming, etc. Interesting to read if you want an opinionated take on a bunch of AI-related things, not so much if you want an argument. @EBKania Ooh! Will be interested in your thoughts... RT @MattHourihan: The President's budget is again proposing massive reductions to many federal #science and #tech programs-->https://t.co/7… RT @lijiali_vision: Cloud TPUs are now available in beta on @GCPcloud #democratize computing https://t.co/xNZApozF6U @jwangARK Thanks! @jwangARK Sorry, to clarify, I was talking about NVIDIA, not AMZN @jwangARK I thought they already had cloud GPUs? "A [simulated] moth brain learns to read MNIST," Delahunt and Kutz: https://t.co/dtxz9UmPpa RT @MelodyGuan: ENAS achieves SOTA on PTB language modeling among all methods without post-training processing and strong performance on CI… RT @MelodyGuan: "Efficient Neural Architecture Search via Parameters Sharing" https://t.co/JzOfe3rhqF We reduce the computational requireme… @jackclarkSF @MelodyGuan @ajmooch Sad! "Imitation networks: Few-shot learning of neural networks from scratch," Kimura et al.: https://t.co/Hcbs9AQfo3 "Efficient Neural Architecture Search via Parameters Sharing," Pham and @MelodyGuan et al.: https://t.co/cmOzvdcaYZ "Learning Robust Options," Mankowitz et al.: https://t.co/Ba8R8f2dLY """PoTrojan: powerful neural-level trojan designs in deep learning models,"" Zou et al.: https://t.co/u5W6qOyWoB Non-exhaustive list of NN vulnerabilities: adversarial examples, data poisoning, general non-robustness, software vulnerabilities, deliberate backdoors/trojans, etc." @edersantana lol. they could offer, but it hasn't happened yet and I don't think I would :P Esp. tomorrow night which will have weekend submissions plus OpenReviewgeddon, as well. Brace yourself for arXivgeddon. https://t.co/smm7ygmwPg @mgubrud They are aware of that. @shyamal_chandra That AlphaZero learned really fast and impressively, from random play to superhuman in a few hours. AlphaZero: "Hold my beer." https://t.co/31OdlK8NfP @AndreTI i could imagine the former happening, but the latter would just cause them to (I'd hope :) ) conclude they were wrong. 🤔"Our analysis suggests that, if machine consciousness is at all possible, conscious experience can only be instantiated in a class of machines that are entirely different from digital computers, namely, time-continuous, open, analog, dynamical systems." https://t.co/ynFdGIVvkC @theophaneweber Gotcha - thank you! RT @TimoBorreck: One of the few tokens that are really used by it's owners and that have an utility other than just raising money for the i… RT @xbresson: Deep learning era - do not forget to cite *future* relevant papers in your paper :) https://t.co/QxCYLGKvca RT @SophieCFischer: "Artificial Intelligence: China's High-Tech Ambitions" - my new piece for the @CSS_Zurich (available in English, German… RT @togelius: Artificial Intelligence and Games, the new textbook by @yannakakis and me, is now available for pre-order. Will be available… ICML/ICLR paper-geddon is coming. RT @MilitaryTimes: We asked, you voted: 89 percent said no to a military parade: https://t.co/YgLPFPxUnd https://t.co/MnOgnKcT6F RT @UberFacts: This bird loves to stop by and feed all his baby fish ❤🐠 https://t.co/vj37ddECId Would also be good to see more of a prioritized version of this list, a la GiveWell charity evaluations - i.e. what are the most important plausible AI applications that are unlikely to be developed based on commercial incentives alone? """Goals for algorithmic genies,"" Masum and Tovey: https://t.co/SvgCUm0V4k Nice wishlist for possible AI (/software) applications. Generally consistent with my forthcoming paper on the long-term upsides of AI, which focuses more on why stuff like this is plausible..." RT @avgupta_me: This is the only ad I've gotten on Youtube since I took CS229. Being AI track, I'm convinced it will be the only ad I get f… Some of you know what I'm talking about. https://t.co/U0VRdB8Zsb (very incomplete list) "Some Seinfeld plot elements that are unrelatable to people born after ~1990 or so: - Internet being new/fancy - fax machine as status symbol - phone messages as stealable things on tape - driving directions on paper fly out window - speed dial as sign of closeness" RT @sarahjeong: WAYMO V. UBER IS SETTLING AND THE CASE IS BEING DISMISSED WITH PREJUDICE "RT @EricHolthaus: The Tesla Roadster, now in solar orbit, has been officially logged as a celestial object by NASA: https://t.co/bDz2zFWdI…" RT @ricard_sole: 14 years after Alan Turing's death, an unpublished manuscript emerged where he suggested the idea of a "disordered" comput… RT @BrundageBot: arXiv papers, February 9, 2018: RT @katecrawford: important new paper from @jovialjoy @timnitGebru - facial recognition systems producing significant errors for women and… "Capacity of neural networks for lifelong learning of composable tasks," Leslie Valiant: https://t.co/Dfox91mXEu @gwern I dunno, haven't read them all yet super carefully. I did enjoy TreeQN/ATreeC though, will be interested to see how that develops/compares (not mentioned here unfortunately). @gwern Yeah, I’m not expecting the environment simulation per se to rack up costs so much as the associated computations. *I think only Ape-X has. Could be wrong about that, didn't check carefully, just confirmed that Ape-X>>this>>most model-free stuff. "That is, unless Fig. 3's ""environment steps"" includes rollouts, in which case this is more of a slam dunk. In any case, it's a good score - besides work mentioned, only Ape-X has gotten better performance before but took a bajillion frames to do so. CC @theophaneweber" Specifically, it seems like it's pretty expensive still, and perhaps enough to make the faster (episode-wise) learning wash out compute-wise. Doesn't say exactly how expensive the rollouts are but I'd guess non-trivial (they do make it somewhat cheaper than it could be, though). This seems like good progress towards general model-based RL, along the trajectory of recent DM work (Imagination-Augmented Agents, etc.), though still not quite a slam dunk over model-free results-wise... https://t.co/zgra3MGRuK "Learning Inductive Biases with Simple Neural Networks," Feinman and Lake: https://t.co/YifcsgMpME "Efficient Large-Scale Multi-Modal Classification," Kiela et al., Facebook: https://t.co/LFtUWryAp1 "Rotate your Networks: Better Weight Consolidation and Less Catastrophic Forgetting," Liu et al.: https://t.co/T6vmYcIXWc "Going Deeper in Spiking Neural Networks: VGG and Residual Architectures," Sengupta et al.: https://t.co/c2lbc02pCM "Improving the Universality and Learnability of Neural Programmer-Interpreters with Combinator Abstraction," Xiao et al.: https://t.co/WxhZDzthMv cc @_rockt "Learning and Querying Fast Generative Models for Reinforcement Learning," Buesing et al., DeepMind: https://t.co/r40eufnKEk RT @OpenAI: Automatic disambiguation of which object is meant by a word in a sentence (by discovering a type system): https://t.co/NJ0bIljj… RT @ipeirotis: Wow! Smart replies now account for more than 10% of the replies on GMail. #wsdm2018 https://t.co/ctCA1VQ4Hy RT @lexfridman: Here's a talk at MIT AGI by Josh Tenenbaum on "Building machines that see, learn, and think like people" https://t.co/RIrqP… @jackclarkSF @katyanna_q Looks like WordsEye @mark_riedl They're sold out. "First the muscle work, then the routine work, then, maybe, the real brainwork." - Vonnegut, 66 years ago. There was also some stuff about learning from demonstration, in the hairdresser case. Excerpt re: AI and jobs - "[comment from audience] The last job an AI will take is a hairdresser! Lots of dexterity, requires trust." Player Piano continues to be a prescient book! https://t.co/uc1yoJQvgp 😍 Thanks! Epic notes. https://t.co/uc1yoJQvgp @mikarv @__frederike__ I don’t have one :( RT @jackclarkSF: Kind of funny that porn is going to trigger a wider 'dual use' discussion re AI tech, but hopefully this can be constructi… RT @kr_t: Our paper on "A Cognitive Assistant for Visualizing and Analyzing Exoplanets" won the Best Demo award at #AAAI2018 earlier today!… RT @_rockt: TensorFlow implementation of our ICML 2017 paper "Programming with a Differentiable Forth Interpreter" (∂4) is now online @matt… RT @BrundageBot: arXiv papers, February 8, 2018: "Yes, but Did It Work?: Evaluating Variational Inference," Yao et al.: https://t.co/c1EBtyyDXr "Semi-Amortized Variational Autoencoders," Kim et al.: https://t.co/qSwzGyb47f "Scalable Meta-Learning for Bayesian Optimization," Feurer et al.: https://t.co/EjohlOdyAT "Recent Advances in Neural Program Synthesis," Neel Kant: https://t.co/wxdy6rT8ZF "Universal Deep Neural Network Compression," Choi et al.: https://t.co/L8vMfktZKV "LightNN: Filling the Gap between Conventional Deep Neural Networks and Binarized Networks," Ding et al.: https://t.co/MnU5WI2N5T @jackclarkSF @TheAnnaGat @EBKania @pstAsiatech @DanitGal @jjvincent https://t.co/1m9ch4aFe1 "RT @DeepMindAI: IMPALA - a new and efficient distributed architecture capable of solving many tasks at the same time in DeepMind Lab. - b…" RT @BrundageBot: arXiv papers, February 7, 2018: "Alleviating catastrophic forgetting using context-dependent gating and synaptic stabilization," Masse et al.: https://t.co/dlQdLeU424 @AMP_SV it's gotten way more frequent for me in the last year. """Shared Autonomy via Deep Reinforcement Learning,"" Reddy et al.: https://t.co/c5dK49ODWG Videos: https://t.co/vQbhDJXXFc" @AMP_SV “First written by Thomas Friedman” 😵🤭🌶 RT @samleecole: I closed my mouth and it fell open again holy hell https://t.co/WjITIFKaPP @mark_riedl yup, with a fake astronaut in the driver's seat. Now that's a flamethrower. https://t.co/jUecbllbAD RT @chelseycolbert: Pornhub considers deepfakes to be nonconsensual porn https://t.co/0b9iAfap8x RT @SpaceX: Falcon Heavy test flight webcast is now live → https://t.co/gtC39uBC7z On the first Intel CPU, it’d take a bit longer than the remaining lifetime of the sun. The comparable number for training AlphaZero is about 17 million years. @jwphillips91 The compute number in the Real et al. paper, Wikipedia page for the old computer, and my own calculations. @mundoplano Yup It would take about 350,000 years to run one of the experiments in Real et al.’s paper last year, “Large-Scale Evolution of Image Classifiers,” on the fastest computer from 50 years ago (CDC 7600). No takers so I picked it up myself. Stay tuned. https://t.co/5FPhUFADhr Alright, winter, you’ve had your fun. Go away now. RT @elonmusk: Live webcast of the launch at https://t.co/bDd3GxQXMC RT @anderssandberg: I and some others answered some questions about brain emulation and its ethics for Gizmodo, triggered by #AlteredCarbon… @ArtirKel @bryan_caplan The case seems like it would be much more compelling decades ago when mass automation wasn’t a realistic possibility in the coming decades. Now (or soonish) vocational education seems harder to target, intrinsic culture arguments more powerful. Reminder that this isn't just a China thing. Digital Barriers has a similar body camera product in the West, Motorola isn't far off (object recognition though not yet face). Big unresolved issues around error rates + false positive-based escalation. https://t.co/cGxAt8yfcd RT @KaiLashArul: Significant practical achievement in DRL - achieving reasonable scores across all (57) Atari games with one agent. https:/… @junkiepunch Don't know @junkiepunch Game level results were not listed. Presumably it wasn’t great. P.S. so their work isn't overshadowed, there was another fun multi-task RL paper today in the continuous control case - "Multi-task Learning for Continuous Control," Arora, Kumar, and Krone et al.: https://t.co/OxwyZQ4nUa Again, there's a lot of other stuff going on, but those are my main takeaways: moar distributed RL a la Ape-X (etc.), first big demo of multi-task RL, positive transfer in multi-task DM Lab, not horrible at multi-task Atari. I'd expect to see something even better soon. Fin. As they put it, Atari's "considered a hard multi-task environment, often accompanied by negative transfer btwn tasks (Rusu et al., 2016). To our knowledge, IMPALA is the 1st agent...trained in a multi-task setting on all 57 games...competitive w a standard expert baseline [A3C]" The Atari results are less impressive from a transfer perspective (with experts still winning out) but 60% median is not a bad start for the first (AFAIK) single system training on all games. Unsurprising DM Lab would go better, with more similar visuals, tho still diverse tasks. https://t.co/kD7NLki7Er See e.g. this graph, where expert = training individual agents on individual tasks, and IMPALA (without the "expert" label) = a single agent doing all of them. And these aren't sketchy tasks chosen to demo positive transfer - DeepMind Lab and Atari are well studied. https://t.co/4UkGeVMY26 This is (1 of) the first large scale demo(s) of positive transfer across tasks in RL. Positive transfer has been demonstrated before in RL but usually on one of 1. lame tasks, 2. few tasks, 3. negative transfer on some of them. Here, there's clearly a benefit to multi-tasking. That's all fine, and helps do huge experiments like this (hundreds of billions/maybe trillions of frames). I didn't read the V-trace stuff super closely/understand it all, but empirically, it seems important for getting this to work. What most interests me is the multi-task stuff The distributed architecture is sort of a generalization of Ape-X (though they say it's more similar to another paper I'm less familiar with), from one learner and many actors to 1+ learners and many actors, but still the same basic idea of sharing good experiences, not gradients So, some thoughts. There are many new ideas and optimizations going on here, and various newish bells and whistles thrown in (e.g. population-based training), but the main things are the distributed architecture, V-trace for off-policy learning, and multi-task stuff. They grow up so fast. https://t.co/C5PI4JZ1uI RT @BrundageBot: arXiv papers, February 6, 2018: "RT @chelseabfinn: Enabling a robot learn from a video of a human was a goal of mine 3.5 yrs ago. Now, we have! (in a limited sense) One-sho…" "DeepType: Multilingual Entity Linking by Neural Type System Evolution," Raiman and Raiman: https://t.co/o12GlRtcT3 "Can your paper evade the editors axe? Towards an AI assisted peer review system," Ghosal et al.: https://t.co/FEze0okYP0 "One-Shot Imitation from Observing Humans via Domain-Adaptive Meta-Learning," Yu and @chelseabfinn et al.: https://t.co/MMXE3yoGtw "Regularized Evolution for Image Classifier Architecture Search," Real et al.: https://t.co/9lUJVxs9bR 🤔 ya know, there's this Michael Burnham person... https://t.co/28MG3ujBtY Hot takes incoming... "IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures," Espeholt, Soyer, and Munos et al., DeepMind.: https://t.co/ArJkFqBr3z "Regret Minimization for Partially Observable Deep Reinforcement Learning," Jin et al.: https://t.co/JeoYNTYe9f Few more fun cherry picked samples: "Epic GAN arguments are generally depressing"; "Foveated Twitter Adaptation with Recurrent Neural Networks," Funke et al.; "Chipotles and meta-cognition"; "peak low standards for the near-term tech seem important to develop AI" And my favorite: "Diabetic Reward Learning in Social Medical Pairwise Networks," Beel et al. "A Low Resource Language Model: A Surprise in an LSTM-based RL," Santhill et al.; "Human-Level Integration of Tree-Based Policies," Arahi et al.; "Sustainable more excited and beneficial AI," Lochander and Al-Onaizan, IBM; ... Nice titles: "Learning Shrinkage-Generated Robots using Generative Adversarial Network," Ghoshalos et al.; "Explainable Black-Box Neural Networks for Personalized Pain Procedures," Mei et al.; "Fastest Bounds for Differentially Private Marginal Nonnational Saliency," Wu et al. Narrator: no, he won't. https://t.co/bYmSRTUKNQ "How do Humans Understand Explanations from Machine Learning Systems? An Evaluation of the Human-Interpretability of Explanation," Narayanan, Chen, and He et al.: https://t.co/dRCxd2FCtV @PatrickOmid https://t.co/prIAQPYqQF @eigenhector Yeah that’s how it was for a few days, then I switched to Anakin Skywalker This is Brundage Tweet Bot 3.0 (not to be confused with @BrundageBot). Me checking the status of a neural net’s training https://t.co/GiAiAVmWn4 Enjoyed advance copy of @paul_scharre’s book “Army of None: Autonomous Weapons and the Future of War.” You should read it when it comes out! Athenian democracy was more interesting and modern in some respects than I realized - some excerpts from Ober’s “Demopolis: Democracy Before Liberalism in Theory and Practice.” https://t.co/JMKH7U7h94 @robinhanson @altcarbnetflix Spoiler alert or leaving out the bit about the revolutions’s goal would have been nice from my/possibly others’ POV, FWIW (hadn’t gotten to that yet :( the rest is revealed on ep 1). I agree though + find lack of backups particularly jarring @calebwatney 3 seems true to me RT @decodyng: Three weeks after being nerd sniped by the topic of adversarial examples, I completed a post focusing on what strategies exis… RT @daniel_bilar: Billy Mitchell's Donkey Kong record stripped, evidence of MAME cheating shown https://t.co/kUF1Vx4Cfw [side-by-side vs pi… This is the link I intended on the East Asia point, not that one: https://t.co/mtKhOavKlG Cc @DN_Debatt_betyg mini review of book I mentioned :) Interesting book if you’re into political philosophy but meh if you want the answer to “what does people’s behaviour suggest is a good political system,” even if you agree with him that’s the right question. I don’t really like the obsession with crime/insurrection data either. ...glib mention of China- Charter 08 therefore prosperity->ppl like democracy. Pretty weak given high support there for state. This sort of “revealed political preferences” argument would need to take East Asia and Russia seriously as challenges. See e.g. https://t.co/BDZQKvDgLD Shockingly weak empirical section, though, a lot of “much less prone to insurrection” etc. and references to papers but no actual numbers in text. Sad! Would have been better if written with a social scientist. Case could be made but isn’t made here. Also, ... Floyd’s book “Is Political Philosophy Impossible?” is pretty interesting, basically argued that political theory debates are unresolvable, better to judge political systems by track records, esp. costly signals of disaffection (crime/insurrection), + liberal democracy=good there. @AndreTI @jamesproud Haven’t looked but it was AAAI 2015 I found some archival footage of that keynote. https://t.co/iJTMZoJh5e See https://t.co/SE2jLGatTd Geoff Hinton is great and all but this last part is false (which is fine, he did tell us so). He ended a talk at AAAI with the words “Deal with it” or something very similar. https://t.co/MiAQEtbS1T RT @maidylm: Come stop by our poster this afternoon to learn how users of intelligent personal assistants are trading their privacy for con… RT @morninggloria: Happy 100th anniversary of a flu pandemic that infected 500 million people and killed at least 50 million, everybody! ht… I’m very sorry about that one Old McDonald had a farm, AI, AI, oh... https://t.co/4eKmj6DBqS RT @DeletedWiki: List of sitcoms which feature actors holding the Nintendo 64 controller wrong @MattLevinson I find it entertaining. @honnibal Agree @jackclarkSF Fox News coverage of AI makes me scared. @jackclarkSF I'm legit concerned about this Seriously though, there is so much activity related to DeepFake right now. I’d guess more person-weeks have been spent by random people on that than have ever been spent on e.g. AI safety. #societalpriorities "Cyberpunk short story*: President Donald Trump finds out about AI via fake Ivanka Trump porn, decides to regulate AI. *by that I mean mostly plausible scenario, except IRL he’d probably brag about how great she looks in it https://t.co/s1Ex9EGgnm" @rcalo @danielas_bot 👏 RT @rcalo: Here's a very interesting job. Manage driverless car policy at Uber. https://t.co/nUHgwO2Xph There’s also a student track: https://t.co/oVsWYlUjs4 *AIES Congrats Stephen and Sean! The paper (“An AI Race for Strategic Advantage: Rhetoric and Risks”) can be found along with many other AEIS papers here: https://t.co/qSjaNV4dFG https://t.co/peHqrjpGWA RT @KayFButterfield: I’m looking for a Project Leader to join me in at the Center for the Fourth Industrial Revolution in San Francisco. @… “TFW when” Considered Harmful RT @SInow: These Jeopardy! contestants know absolutely NOTHING about football and Alex Trebek let 'em have it 😂 https://t.co/Ng5g0asg71 @filippie509 Aren’t disengagements not as bad as accidents (on average - in the worst case, they’re equivalent)? RT @paul_scharre: The debate continues! My reply to Stuart Russell, Anthony Aguirre, Ariel Conn, and Max Tegmark in @IEEESpectrum on the "S… RT @terahlyons: The Partnership on AI team is growing. If you want an opportunity to help advance the AI field—and our understanding of it… @tsimonite @mikarv There was a good panel looking back on it recently https://t.co/07nZjxblgm @jackclarkSF Shhhh Mysterious benefactor identified! RT @voxdotcom: If you’re not scared for American democracy, you’re not paying attention. https://t.co/vfjl6nAmPd @mikarv @tsimonite yeah, great era to remember. Conferences were even bigger back then! Don't know about the 80s equivalent of Flo Rida at an Intel event, though. @ribbonfarm FYI the two hyperlinks to two pieces of Simler's writing are both the same (for the second title). "RT @VahidK: Going through these reports could give you some idea about the current state of self driving cars: https://t.co/BQ7ynBfc5c" RT @intelwire: Imagine how fucked we'd be if our corrupt leaders were also competent https://t.co/NiFtKev2RB RT @dlowd: If you need to talk to someone about depression and academia, feel free to DM me. I don't have all the answers, but I can share… RT @mhbergen: Also ex Stanford president John Hennessy has replaced Eric Schmidt as Alphabet chair. @y0b1byte Lol. Good sausage rolls too! @mark_riedl They just wanted the IQ acronym I guess. "RT @mark_riedl: Hi! Did you know that while I'm on sabbatical I'm working with Salesforce Research (https://t.co/8EcVcCqv50)? I’m looking…" @FarzaTV @edersantana @KaiLashArul Also @hardmaru RT @KaiLashArul: Ever wanted a non-technical intro to ML that explains what it can and can't do? Check out out this article + video feat. J… https://t.co/m0t7OIWSJl RT @jeremyphoward: I know @fchollet has pointed this out before - but the machinelearning subreddit really is an embarrassment to the commu… RT @nytimes: Trump has barely paid lip service to the promotion of universal human rights, and experts say his warm embrace of hard-line le… RT @MIT: Introducing a major new Institute-wide initiative on human and machine intelligence – the MIT Intelligence Quest, or MIT IQ. https… RT @JYSexton: Trump will literally dismantle the entire American system of government if it means saving himself. @colinkgarvey It’s a matter of degree. More of a change would be felt on the energy side than AI, but in AI, still some effect. Many don’t want to take DOD funding and rely on NSF. "Nested LSTMs," Moniz and Krueger: https://t.co/PpQXmL1zXT RT @BrundageBot: arXiv papers, February 1, 2018: "Generating Wikipedia by Summarizing Long Sequences," Liu and Saleh et al.: https://t.co/ZiwhMAfbIf "Deep Reinforcement Learning for Programming Language Correction," Gupta et al.: https://t.co/EYbdDgiJeP "Pretraining Deep Actor-Critic Reinforcement Learning Algorithms With Expert Demonstrations," Zhang and Ma: https://t.co/haUOlazgLj Writing my dissertation like https://t.co/En6hm1Y0g6 People who abuse mailing lists :( Notably, the NSF division responsible for AI, too, is also being cut bigly, though not quite as bad as energy would suffer from this. We're basically heading towards a situation where the defense budget and private companies determine innovation priorities in the US. ...and from a purely economic perspective, this is also super dumb. Many jobs are currently supported by clean energy, way more than fossil fuels. China etc. are going to lead in this area (and others) if the US doesn't get its shit together and stop pulling this kind of stuff. This would be really bad. The Department of Energy provides a huge global public good by funding research and development in renewable energy and energy efficiency. https://t.co/rzyg5aCEAv "RT @nickfrosst: Sara has released the code for our first capsule paper ""dynamic routing between capsules"" presented at NIPS check it out…" RT @dennybritz: The Matrix Calculus You Need For Deep Learning https://t.co/XcJ7F6rxtT - Great guide by @the_antlr_guy and @jeremyphoward.… RT @abigail_e_see: This Friday I will moderate a debate at #Stanford between @ylecun and @chrmanning on "What innate priors should we build… RT @JAIR_Editor: New Article: From Skills to Symbols: Learning Symbolic Representations for Abstract High-Level Planning https://t.co/TD8Cn… RT @samim: The combined market-cap of Google, Apple, Amazon, Facebook is now bigger than the GDP of all countries on earth, except for 4. h… @davegershgorn https://t.co/Zu3nkC2aYM RT @Zergylord: Hanson robotics, the "Sophia" hacks, on this list of top AI companies. ElementAI, Vicarious, BenevolentAI? Nope, let's put a… RT @BodegaBot: These two ex-Airbnb designers want to replace champagne bars with robotic surgery Over a year ago... can't imagine why there's no mention of related issues in the SOTU 🤔🤖 https://t.co/xTpOc2vNqX @jackclarkSF Unless he is referring to the fall of Theano when he talks about "crumbling infrastructure," there's nothing AI-related. Also just checked "innovation," "automation"... nope. @jackclarkSF but yes, I should not underestimate his ability to improvise stupidity @jackclarkSF per the text, there's no "artificial intelligence," "robotics", or "technology". RT @BrundageBot: arXiv papers, January 31, 2018: TL;DR of the State of the Union, AI edition: nothing (crazy) about AI. 👏 "Structured Memory based Deep Model to Detect as well as Characterize Novel Inputs," Brahma et al.: https://t.co/TCuw7m0thJ "PrivPy: Enabling Scalable and General Privacy-Preserving Computation," Li et al.: https://t.co/8OWZ4iYJKe "Riemannian Walk for Incremental Learning: Understanding Forgetting and Intransigence," Chaudhry, Dokania, and Ajanthan et al.: https://t.co/vJnNk4HAiF "TransRev: Modeling Reviews as Translations from Users to Items," Garcia-Duran et al.: https://t.co/4HIf1vMozw "Features, Projections, and Representation Change for Generalized Planning," Bonet and Geffner: https://t.co/jqyLIkFPmH RT @zeitzoff: Foreign policy/poli sci folks, What are chance that the US engages in a military strike against North Korea in the next 6 mon… @TheAnnaGat good fire, not bad fire :) @bitcurian I don't know, haven't used Share Latex. @TheAnnaGat (maybe does other things too but that's what I'm using it for now) @TheAnnaGat Useful website for editing papers in LaTeX, where it shows the code on the left and the current version of the paper given that code on the right. Overleaf is 🔥🔥🔥 @rbhar90 +1. See also (from 4 years ago, wow...) re: his similar remarks on Watson. He says this about a lot of things. https://t.co/nkEYKaD37Q @TheAnnaGat Oooo @_rockt @markus_with_k Maybe posters growing but main track still selective? @dkasenberg (I’m not sure if it would affect research in any case though? Maybe just products) @dkasenberg Supposedly Google just does it to prevent others from patenting and then enforcing it but presumably some intend to enforce. Will prob become an issue at some point. @dkasenberg lots of AI patents, though I haven't seen any cases of them being enforced (yet). RT @whi_rl: Our paper "TreeQN and ATreeC: Differentiable Tree Planning for Deep Reinforcement Learning" has been accepted at #ICLR2018 --… @gosainnn Keep going! I liked Dark Forest even more :) @gwern ...getting it to work, not rolling out, which China's good at anyway - slash most of the time was spent on getting there...and now they can build on tons and tons of papers (including by themselves). Would think catchup there is easier than HW manufacturing. @gwern Re: first part, yes, though not as ambitious as being where they'll be in 2 years, or beyond. I don't think this is shocking, but important context for some who don't know what those numbers mean. Re: second part, I don't know - but I'd think most of the challenge was ... RT @BrundageBot: arXiv papers, January 30, 2018: ...which would be consistent with their higher level public timeline/strategy of surpassing other countries in a decade or so, not immediately. I was specifically referring to the DL chips stuff there re: catching up. Perhaps other sections are more ambitious. Interesting that there are specific 2020 goals here for stuff like DL chips and (if I understand the doc and current benchmarks correctly), they're basically in the ballpark of existing tech - that is to say, it's a call for catching up (not leapfrogging). https://t.co/ApL8JL4s52 RT @CNAStech: English translation of China's "Three-Year Action Plan for Promoting Development of a New Generation Artificial Intelligence… "Deep Reinforcement Learning for Dynamic Treatment Regimes on Medical Registry Data," Liu et al.: https://t.co/fvqs5gFX2h Towards an Understanding of Neural Networks in Natural-Image Spaces," Yan and Fezzi: https://t.co/l6VcNO9sEk "Learning the Reward Function for a Misspecified Model," Erik Talvitie: https://t.co/zd1fNToZTn RT @NarangVipin: We are all going to die. https://t.co/de2X8fxYNk RT @drhyrum: This arxiv paper published today provides more comprehensive background/detail for my BlackHat USA 2017 talk on evading black-… RT @cholodovskis: Our paper "Eigenoption Discovery through the Deep Successor Representation" was accepted at ICLR'18 (w/ Rosenbaum, Guo, L… "RT @egrefen: Delighted that our paper on neural nets and logic was accepted to ICLR'18. https://t.co/7yw2i66lPC Summary: on highly and hete…" @tkasasagi Congrats! RT @egrefen: Blog @DeepMindAI post about our “recent” (submitted a year ago) work with @LittleBimble on learning neural nets jointly with s… RT @jackclarkSF: Google appears to have categorized this week's issue of 'Import AI' as spam, so check your spam folders and re-categorize… @PatrickOmid I got an HP Omen 15” recently, similar price. Bulky but gets the job done. RT @DeepMindAI: Our new paper in the Journal of Artificial Intelligence Research (JAIR) demonstrates how deep neural networks can be extend… @halhod @roseveleth @PopUpMag +1. Also, hotels often will give you a surprising variety of things for free if you ask. RT @BrundageBot: Learning to Evade Static PE Machine Learning Malware Models via Reinforcement Learning. Hyrum S. Anderson, Anant Kharkar,… RT @tdietterich: I think people (including the authors) are over-interpreting https://t.co/GBP7owzVIZ "Measuring the tendency of CNNs to le… RT @BrundageBot: arXiv papers, January 29, 2018: "Neural Algebra of Classifiers," Santa Cruz et al.: https://t.co/B7GuLPxE78 "FlashRL: A Reinforcement Learning Platform for Flash Games," Anderson et al.: https://t.co/pl2JnjbTj0 """Etymo: A New Discovery Engine for AI Research,"" Zhang et al.: https://t.co/Rot56JUaxd https://t.co/6OOt72xgPP" "Safe Exploration in Continuous Action Spaces," Dalal et al.: https://t.co/Ez01vc1tb0 """Recasting Gradient-Based Meta-Learning as Hierarchical Bayes,"" Grant et al.: https://t.co/PBwR6TQR3d MAML-->LLAMA (Lightweight Laplace Approximation for Meta-Adaptation)" "Transparent Model Distillation," Tan et al.: https://t.co/kfwAGENqsV "CommanderSong: A Systematic Approach for Practical Adversarial Voice Recognition," Yuan et al.: https://t.co/SxbdPmtCRF embedding voice commands in songs to target Alexa/Siri etc. RT @goodfellow_ian: Users of @Strava have complained about the app's limited / confusing privacy settings since as far back as 2014. I myse… RT @vkrakovna: Is there a tradeoff between immediate and longer-term AI safety concerns, in terms of funding, talent, or media... https://t… RT @EdFelten: We'll be running a 3-week summer school on AI (technical and policy) at @Princeton for rising 11th graders from underrepresen… @TheAnnaGat Just wait until you see your Amazon homepage after you buy a romance book as a favor to a friend :( RT @naotokui_en: AI DJ Project — A dialog between human and AI through music https://t.co/bokS1sYdMl on medium https://t.co/ptShL8TxFB RT @rsalakhu: This semester I am teaching a graduate course in Deep RL with over 500 graduate students enrolled so far, the biggest class I… It's "Wow, I forgot how great the Stanford Encyclopedia of Philosophy it is" Weekend! RT @kaifulee: AI investing is not for the novice. For people who try to get into early stage of AI without understanding the technology, th… RT @chrisdonahuey: Thanks to Hans Zimmer, it is not possible to Google for information about "inception score" RT @terahlyons: Thrilled to announce that the Partnership on AI is hiring! Details on joining our growing organization below: https://t.co/… "RT @fchollet: Tutorial on building an AlphaZero-like system with Keras and TensorFlow (applied to Connect4) https://t.co/HnWpVYZByI" @Zergylord And yes it is an interesting analogy. Just finished a good book on the Space Race for the same reason. @Zergylord That one sounds good, this is a different one though: “Robert Oppenheimer: A Life Inside the Center” RT @togelius: New paper with @FilipoGiovanni and @risi1979 to be published at @Evostar2018 https://t.co/RtKaK5XMoG (Tony Stark voice): I need it. https://t.co/UTYtT8ZOak RT @ylecun: Haha. Not entirely inaccurate. https://t.co/TMofJSoKRX @juliagalef which did you find (most) compelling? RT @BrundageBot: Probabilistic Planning by Probabilistic Programming. Vaishak Belle https://t.co/2RrStIqJ9o Omg @BrundageBot started with the exact same 2 papers I was going to tweet. Shut it down! +@amaub are they in order of Miles tweet probability? RT @BrundageBot: arXiv papers, January 26, 2018: """DVQA: Understanding Data Visualizations via Question Answering,"" Kafle et al.: https://t.co/gpVcAE8LzK Good work, MOM https://t.co/ZTcYfQ2HoI" "Deep Interactive Evolution," Bontrager et al.: https://t.co/5C1asIu6Rw RT @anderssandberg: A little tech report on settling the universe as fast as possible: how fast can we physically go, and do we need to use… RT @viegasf: Psyched to announce a new collection of essays on PAIR's human-centered approach to designing with ML and AI: https://t.co/6HQ… (from Facebook) https://t.co/mN5Tl9kH3U RT @BrundageBot: arXiv papers, January 25, 2018: @ESRogs Not better, no. See also this (h/t @notmisha) https://t.co/QEAvTdQV4E https://t.co/PtVylQWaKM RT @SenBillNelson: If the administration plans to abruptly pull us out of the International Space Station in 2025, they're going to have a… """Intriguing Properties of Randomly Weighted Networks: Generalizing while Learning Next to Nothing,"" Rosenfeld and Tsotsos: https://t.co/gopEcPA0U2 You can freeze the majority of the weights at their initial random value, and still get good performance." Michael Redmond cameo! @BenedictEvans Have you read the late Calestous Juma's book on this? Documentary on Tencent's Fine Art AI: https://t.co/BgdSPqhkNf """Evaluating Layers of Representation in Neural Machine Translation on Part-of-Speech and Semantic Tagging Tasks,"" Belinkov et al.: https://t.co/64FQYnN2Ue ""we find that higher layers are better at learning semantics while lower layers tend to be better 4 part-of-speech tagging""" "One of the more basic researchy papers I've seen from Alibaba lately - ""PRNN: Recurrent Neural Network with Persistent Memory,"" Zhao et al.: https://t.co/cIC0Ug2rAX" RT @MattHancock: We’re looking for the best possible person to head up our world-first Centre for Data Ethics & Innovation. More info here:… RT @jackclarkSF: Harvard/MIT people: I'm living here in Boston for next few months. Who would like to meet up in Feb/March to discuss AI? P… RT @etzioni: Thought provoking, contrarian argument..worth thinking through... https://t.co/7stpndInVE @iandanforth Lol I hope not! RT @awjuliani: So awesome! Traditional psychology/neuroscience experiments simulated in DeepMind Lab. https://t.co/QVaRFsRT6h Thanks to whoever sent me a biography of Robert Oppenheimer! Mysterious but I’ll take it... "Psychlab: A Psychology Laboratory for Deep Reinforcement Learning Agents," Leibo et al. at @DeepMindAI: https://t.co/Nj9lae5R8m RT @gosainnn: Just announced: Geoff Gordon --> @MSRMontreal as the new Research Director there! We will be doubling the size of our lab. Ex… Nice to see several of you in London! Fun day. London-based DeepMinders: I’ll be in the office and free from 4-4:30 and 5-5:30 if you want to say hi :) @bluemonk482 @turinginst Timing/locations didn’t work out this time but I’ll try to make it to Turing next time! Thanks! :) RT @MadelineAshby: “The exercise of imagination is dangerous to those who profit from the way things are because it has the power to show t… “It seems reasonable to suggest at least big companies with ... bounty reporting infrastructure attempt to reward and collaborate with those who find bias in their software, rather than have them take it to the press...with no compensation” - @rubinovitz https://t.co/oMkN0I9NnN @visarga Not that I've seen... "Convergence of Value Aggregation for Imitation Learning," Cheng and Boots: https://t.co/0r8izytsqe """High Resolution Face Completion with Multiple Controllable Attributes via Fully End-to-End Progressive Generative Adversarial Networks,"" Chen et al.: https://t.co/M0HRQOwqQF single feed-forward pass in .007 seconds at 1024*1024 resolution https://t.co/vu8QQOUtXW" @geoffreyirving Lathe of Heaven is also worth checking out if you haven't already. :( RIP Ursula Le Guin. RT @Oregonian: Ursula Le Guin, master of speculative fiction, dies in Portland at age 88 https://t.co/dpwdWNRJlc https://t.co/DPLkuvoXDu @SimonMoores Yup, Ecuador is one of the firsts it seems but won’t be last. RT @SamBendett: Great presentation by Elsa Kania on Chinese AI developments https://t.co/5pvjSHGPh0 "RT @rubinovitz: Bias Bounty Programs as a Method of Combatting Bias in AI https://t.co/wgdXHBGXHy" 😿 https://t.co/PkbtClfTkJ RT @abhshkdz: Detectron, huuuge object detection code + model release from Ross Girshick et al. at FAIR, 70+ pretrained models and performa… RT @JCornebise: We are #hiring Research Engineers and AI Devs in our @element_ai London office, to help pursue #AIforGood . Read the profil… RT @LalehKhalili: I criticised the face-art-matching app a few days back (data collection; its seeming racism etc), but man, it really seem… RT @JCornebise: Proud to be joining @element_ai as Head of our new #London Office and Director of Research, with a focus on #AIforGood! htt… RT @JMPyper: BREAKING: Trump Admin Issues 30% Solar Panel Import Tariff. @SEIA warns of 23,000 job losses. @GTMResearch anticipates an 8-10… "Tim Mulgan [argues for] 'ananthropocentric purposivism' (AP). AP is the view that, contra atheism, the universe has a purpose, but, contra benevolent theism (BT), that purpose is non-human-centered." (book review) https://t.co/44WveSDE3D @janieflegal @ESPM_Berkeley congrats!! RT @JeffDean: I'm very excited that we're expanding Google's AI research presence in France! https://t.co/vJhGoXc6FA :) preprint still available here: https://t.co/KIqtU3vTJl https://t.co/CKNkKIaI1J RT @KaiLashArul: Happy to see that people find A Brief Survey of DRL useful - it was IEEE SPM's most popular article last month: https://t.… @davegershgorn It’s not clear to me that the *research* area isn’t sparse relative to its importance/potential/difficulty. But certainly, yeah, application-wise, there is plenty of crap. Itamar Arel's new AI startup (after Ocado) is Apprente: https://t.co/1IYiG9RvH0 The Lee Sedol of skin diseases... from @jackclarkSF’s newsletter. https://t.co/FgIvb4ZfKS "RT @ylecun: Facebook is increasing its AI investments in France: - Doubling the staff at FAIR-Paris to 60 scientists and... https://t.co/ym…" RT @RealAAAI: Check out the exciting program for the first AAAI/ACM conference on AI Ethics & Society! https://t.co/HxhC79ATtB https://t.… @mark_riedl 🤫 @iandanforth Yeah it has prob gotten way better, but on a scale of seconds to minutes saved vs days/weeks RT @lorandlaskai: Ecuador is fighting crime using Chinese surveillance technology https://t.co/37XalVAsfw @chrisalbon there are lots of really sketchy startups that do already. "Piggyback: Adding Multiple Tasks to a Single, Fixed Network by Learning to Mask," Mallya and Lazebnik: https://t.co/VGRmC8cVHP "Introducing ReQuEST: an Open Platform for Reproducible and Quality-Efficient Systems-ML Tournaments," Moreau et al.: https://t.co/ieDhz7Iqfo "Global overview of Imitation Learning," Attia and Dayan: https://t.co/xrL68FiZqr "Composite Functional Gradient Learning of Generative Adversarial Models," Johnson and Zhang: https://t.co/AvHCBy3a2X RT @attackerman: EXCLUSIVE: DHS' analysts were left out of the Justice/"DHS" report conflating immigration & terrorism. And that followed s… @zaxtax yay!!! And also note diminishing returns - Google search now is better than 10 years ago but not THAT much, and the pop up info/excerpts are helpful but again, not as much as the no search/search gap. https://t.co/EyAhli1ELe Too bad I don’t have Zed-Eyes, I guess this is the use case for that. I feel bad about this (I was like um we should chat sometime), hope they reach out. I’m bad at recognising people as @zacharylipton can confirm. RT @Miles_Brundage: Person who just said hi to me in Oxford whom I know from NIPS, shoot me an email to remind me of your name so we can ch… @pstAsiatech Thanks! Give it a year. (made more sense when it was a smaller part of the screen) I got quite perturbed for a second thinking that this said "The ICO" https://t.co/tyuMc4vyVC @Zergylord You reply to the tweet that your new one comes after Today is the day I finish this. Great book - has been taking so long, though, because I’ve wanted to give it quality time. https://t.co/lEzRlpLI0V "RT @SortaBad: Everyone: let’s get the Nazis and hate speech off of twitter Twitter: https://t.co/uPmGuPhPcE" RT @LeahLitman: there’s always money in the banana stand https://t.co/HQiVBTBAyj @joeveix @timhwang Was just going to give this as an example of “~X, not X” https://t.co/LrQmV0NZ68 @pstAsiatech What’s different here from the national deep learning lab or various state key labs etc. (If anything)? @dkasenberg @iamtrask We have had current PhD students before. @dkasenberg @iamtrask I did not write that description/dunno but I’d shoot a query to the listed email and they can clarify :) Thanks for the kind words, @iamtrask!! :) For others, note that we also have internships in AI policy, and both types of internships are paid. https://t.co/N8F81qyTxB Person who just said hi to me in Oxford whom I know from NIPS, shoot me an email to remind me of your name so we can chat sometime when we’re not in the rain :) 😑 https://t.co/EnRb5RQQvY @JeffDean @zacharylipton @willknight (by ML practitioner I mean me, but still) @JeffDean @zacharylipton @willknight My nuanced contribution to the debate: https://t.co/wcT07jKFAo I had a dream that a neural net I’m training had great performance. Woke up and: not so much. I thought this was a thread for a second...they're not unrelated. https://t.co/6bsw9VfymC RT @MEPFuller: An emerging trend is that Trump and his staff have no idea how to stage photos to make it seem like he’s actually working. h… RT @iamtrask: If you're interested in AI Safety research, I highly recommend checking out the @FHIOxford's internship in Reinforcement Lear… @mark_riedl @NIH Department of Energy is in the same boat. Is there any more info on the Alphabet/Tencent thing I missed? "Another related paper I liked recently: ""Towards Practical Verification of Machine Learning: The Case of Computer Vision Systems,"" Pei et al.: https://t.co/TbTl8fKiYm" RT @TheAnnaGat: "Gödel & Bach, OK - but Escher?" -- overheard on the London Underground 🎶🧠 RT @matthewamiller: Stephen Miller is the president for immigration policy. H.R. McMaster and Jim Mattis are co-presidents for national sec… RT @goodfellow_ian: Video of morphing between ImageNet categories with SN-GAN: https://t.co/U9ZIDIX6y9 RT @benhamner: Would love to learn a bit more on the tools you use for ML along with any experience you have around model deployments throu… @primalpoly Just quadrillions? Sad! RT @Miles_Brundage: London folks! I'll be visiting next Wednesday, let me know if you want to hang out :) RT @JohnDanaher: Philosophical Disquisitions: The Utopia of Games: Intelligible or Unintelligible? https://t.co/Nczk1E8HUW @AMP_SV @zacharylipton @willknight I mean, that’s literally a thing I do often :) @zacharylipton @willknight Will get back to you after changing one number in this code and then running it on a new dataset "Also, despite the quiz being laced with traps that would nail total Carries, Mirandas, or Charlottes, the AI was smart enough to always answer questions as a wild yet wise, hard-partying New York businesswoman." https://t.co/pfXVvL1RvY It's the first annual "Satirical coverage of AI is often better than real coverage" celebration. https://t.co/x3s2LEiLKF https://t.co/2RRNTSoD7Z "RT @BenedictEvans: Anyone working longer hours than me won’t produce more - they’ll just waste effort, burn out and ruin their life. Anyon…" RT @GreeneScientist: Our new and improved review of #deeplearning in #biology and #medicine (touches on #genomics, #imaging, #clinicalinfor… RT @BarackObama: Dr. King was 26 when the Montgomery bus boycott began. He started small, rallying others who believed their efforts matter… @AMP_SV *trained, I guess, is the right word... @AMP_SV I think the same thing when I hear people say that it will be like teaching a dog... have they taught a dog!? @JeffDean @techreview A revised version of Jeff Dean Facts should cover your pun-making abilities... Not clear how far NN verification can go--maybe always a big gap btwn best systems + best verified systems--but gap will be even bigger than it has to be if we don't push on these two fronts - 1. NN-informed solvers + 2. verification-informed NN designs. https://t.co/039ksfbe1C @mhbergen /if it involves AI collaboration @goldkorn fair, though I'm not just saying it'd be nice for me personally - also would be good for others, not all of whom can afford it. I'm fine disabling ad blockers, not sure why WSJ is an anomaly in this respect (unusually paywall-y). @mhbergen Thanks! https://t.co/KWh0fgfhJm Sidenote: WSJ's China tech/AI team is 👏👏 great coverage, wish there weren't a paywall ?? https://t.co/ILyhQLrFB0 "Sickening. Get your shit together, 🇺🇸 CC @ACLU https://t.co/yLsaPkx0XO" When a coauthor makes a bunch of awesome changes to a draft while you aren't paying attention, then you check out the doc. https://t.co/xOBMfTgshp RT @BrundageBot: arXiv papers, January 19, 2018: One of the best title/author pairings I've come across lately... https://t.co/clBVZ9mKNZ """An Experimental Study of Cryptocurrency Market Dynamics,"" Krafft et al.: https://t.co/FOCalNMzU6 ""We find that individual ""buy"" actions led to short-term increases in subsequent buy-side activity hundreds of times the size of our interventions.""" RT @jeremyphoward: Thanks to @seb_ruder for writing up my NLP classification ideas & experiments (during his vacation!) we can now present:… """Toward Scalable Verification for Safety-Critical Deep Networks,"" Kuper et al.: https://t.co/QSQfQ2IxNm Nice big picture/short work-in-progress piece - enjoyed related talk by one of the authors (Barrett) at NIPS." RT @Q________Q: finding out that trump cheated on his wife with a porn star and paid her $130,000 in hush money and also obsessively called… RT @CNASdc: Now Hiring: Research Associate for the Technology & National Security Program at CNAS. Apply: https://t.co/aniBK8iL0k @mat_kelcey https://t.co/mrwsdfnTyP "Meta-Learning with Adaptive Layerwise Metric and Subspace," Lee and Choi: https://t.co/FsLQZSznYl RT @Reza_Zadeh: @fchollet The trouble here is that Sophia has raised $36 million dollars, scamming so many people. This will hurt so many p… @sbenthall You’ll be fine. 👍 @jvmancuso So many ICOs are, but yes, this one especially. I’d pay to see Sophia interrogated in court to determine the veracity of SingularityNet’s claims RT @markus_with_k: .@jjvincent nicely summarises in this @verge post how all the hype around Sophia (@RealSophiaRobot) is greatly misleadi… RT @markberman: The @tide social media team is now spending its time responding to people who say they ate Tide Pods https://t.co/uHhALzYJ89 RT @DianeCoyle1859: There’s a new AI Challenge @AI_Challenge from @GoodAIdev https://t.co/QM3NtI90nw Will be interesting to see what’s subm… RT @OpenAI: Scaling Kubernetes to 2,500 nodes: https://t.co/KbravWt7fw RT @erichorvitz: The Future Computed: Book on AI and its role in society now avail for download https://t.co/E0U4lNIFgj Collaboration of co… @atg_abhishek @davegershgorn Skimmed it and it seemed well written but a pretty standard/uncontroversial perspective @rodolfor 26% of 100 million or whatever obscene amount they raised. https://t.co/86qQ2RoZJE @atg_abhishek @ylecun Simple... they should of course check such things, and some do, others don’t. @botminds I am sure some of them are playing along, but I wouldn't blame many of them for believing it given press treatment of this, Facebook language bot thing etc. Some of the people responding to the tweet in question seemed to genuinely believe it, from my reading. RT @F_Vaggi: This is important: if the people who actually do ML don't speak out against the scammers taking advantage of the hype, there w… https://t.co/MoBfycbyHr Note also that Sophia hype is used by SingularityNet (same people) to get millions of dollars for them. It's a hype-pyramid scheme, basically. There are a lot of comments like the one he quoted. Lots of people have been taken in by this kind of stuff. https://t.co/EJmisL17KL What @ylecun said: https://t.co/FOAnEHiA4u Sick awards, bro https://t.co/PYzr5ZKeGx "AliMe Assist: An Intelligent Assistant for Creating an Innovative E-commerce Experience," Li et al., Alibaba: https://t.co/CsgxXshPU1 RT @JohnDanaher: Scalable competence, enhanced coordination and the leisure society - Listen to @Miles_Brundage defend the case for conditi… @timhwang Have you spent quality time in the Norrington Room at Blackwell’s yet? 💸📚 RT @JeffDean: Today, Google Cloud is announcing the first of many AutoML products, AutoML Vision. It's the result of close collaboration… @davegershgorn can I have a slice pls "GitGraph - Architecture Search Space Creation through Frequent Computational Subgraph Mining," Bennani-Smires et al.: https://t.co/9KsAzncWa7 RT @BrundageBot: arXiv papers, January 17, 2018: @AMP_SV Tip of the iceberg: https://t.co/wwlYjwo1uV RT @drfeifei: An exciting @googlecloud CloudAI product is coming live tmrw. Many months of hard work! Check our blog tmrw! We've now got mo… @ArtirKel Unfortunately not London folks! I'll be visiting next Wednesday, let me know if you want to hang out :) RT @JohnDanaher: "AI combines the scalability of digital technology with the flexible competence of human intelligence' - Listen to @Miles_… @zacharylipton yeah, I just thought it was funny, could happen to me. A few days ago I returned to a hotel convinced that I forgot a book there, and it was in my jacket pocket which I had very recently tweeted was good for storing books. RT @roydanroy: @Google I think this needs immediate attention. RT @LevineJonathan: WATCH: Sen. Orrin Hatch removes a pair of glasses he's not wearing https://t.co/QXCCb4RHzn @deliprao @googledocs @roydanroy Just tried this out. The doc in question was private, so I was not able to access the doc (just using the URL from the metadata, without having been logged into the relevant account)... but the URL did reveal some info about the account in question. So, yeah, worrying. RT @rbhar90: This is an amazing paper on bitcoin price manipulation at the now dead Mt.Gox exchange. Makes you wonder how much of the curre… RT @roydanroy: Anyone ever notice that Google writes the URL for the googledoc into the metadata of the exported PDF? So much for privacy o… ICYMI - @JohnDanaher and I talking about the long-term future of AI. https://t.co/jVnHHhfy2E RT @RogerGrosse: CycleGANs can crack classical ciphers (substitution, Vigenere, etc.). Interesting paper by a team of UofT undergrads. Aid… So, it’s like working at a McDonald’s, basically, in various ways. https://t.co/m0IIefXeX2 "RT @yoavgo: I made this slide deck about computers getting ""near human performance"" on the SQUAD dataset some months ago. Worth reading ag…" RT @vkrakovna: Exciting summer internships in AI safety at UC Berkeley's Center for Human-Compatible AI! Apply by Feb 15 https://t.co/72Dwj… Back in the 🇬🇧 RT @BrundageBot: arXiv papers, January 16, 2018: @adam_will_do_it If I were shorter (3 seats wide, 5 feet or so?), I’d lie down to sleep on this long flight. Remembering that there still isn’t really enough room to lie down 😧 Empty row on flight to London 😀 "“SuperNeurons: Dynamic GPU Memory Management for Training Deep Neural Networks,” Wang et al.: https://t.co/8K3jDjK3R9 “Particularly, SuperNeurons can train ResNet2500 that has 104 basic network layers on a 12GB K40c.”" @withfries2 Lots of impressive stuff coming out of China but this story is super out of control, shut it down. https://t.co/Ti8ud2FNzt Boarding flight + don’t have time to argue with this “China beats US at AI reading comprehension/AI superhuman at reading comprehension” stuff but briefly, former = negligible gap, latter = false, just one task (+also negligible). see also @withfries2 comments earlier. RT @OpenAI: Releasing gradient checkpointing - a package for fitting bigger Tensorflow models onto your GPU. By trading off memory usage ag… RT @Miles_Brundage: Text of the "Letter from Birmingham Jail": https://t.co/TKBaUbNsTm #MLKDAY Enjoyed discussing a new paper on the potential long term upsides of AI. @JohnDanaher asked great questions. https://t.co/tuiRhYsxmK RT @PatrickOmid: Judea Pearl outlines 7 tasks which are beyond reach of current machine learning methods but can be approached by the tools… Omg a comic intro to A2C. https://t.co/ap4tlqdxOO RT @EsotericCD: Case closed! https://t.co/L0rXcUolWk RT @GaryMarcus: The debate continues! Friends and foes of #Deeplearning and #AI: how strong were the replies to my recent appraisal of de… @cynicaldevil_ I was def pretty shocked by the teardrop disaster thing but not sure if I have a favourite... I enjoyed pretty much the whole thing! Anything involving Luo Ji was great for sure. Can you make edgier forecasts for this year? https://t.co/DhGzbwCtln Freebies are fine but should ideally be labelled as such (high confidence) and also bundled with more controversial/uncertain predictions. “Roundup of 2018 AI Predictions” - lots of freebie/unfalsifiable ones, arguably... https://t.co/JisAfX39OM By @DoodleChaos. https://t.co/034f1ShO40 "RT @HoffmannAnja: I could watch this for the rest of the weekend 👀 He synchronized the song ""In the Hall of the Mountain King"" by Edvard G…" "RT @RoxanneHeston: Are you a @PeterSinger die-hard or you Kant be convinced? Take the Oxford Utilitarian Scale survey (based on a paper by…" @samim @GaryMarcus Come up with a solution to every well-defined human-doable task. Just trying to be appropriately modest bc simple approaches sometimes surprise us, and my forecasts for last year weren’t that great 😑 See also this from @GaryMarcus and Davis on the limits of simulation - good list. https://t.co/4Buige3YsB powerful tool for sure but MCTS/planning +/or NNs won’t solve everything. Probably 🤔 https://t.co/rz1ee8pUIP @HZoete IMO it is an extremely cleverly written series with a lot of big picture ideas about the future, so a good read if you’re into that sort of thing. (And the rest of the trilogy but that should hopefully follow naturally; and not sure people know the name of the trilogy, Remembrance of Earth’s Past, as well as 3BP) @patricknmahoney Yeah it deserves some quality time. If you finish 3BP and don’t like it then maybe ditch but personally by then, for me, I started buying the next one when I was close to finishing one, couldn’t stop :) @patricknmahoney It took me a little while to be completely hooked FWIW. Was worried about that too, but ultimately don’t think it should deter you - context often disambiguates it and not everyone’s listed there is absolutely essential (if I remember correctly). "Me reading most fiction: 🙄😧😑 Me reading that trilogy: 🤫😵🤠" Regular reminder to read The Three Body Problem. We’re clearly not a global maximum for performance in control tasks, and can be exceeded by other local maxima arrived at through very different processes. Control tasks aren’t everything, but this seems like relevant info for thinking about future of jobs etc. At a bigger picture level, I think it’s interesting that one can exceed human performance bigly in radically different ways for the same domain - in the Atari case, ALL model or model-free. Similar to Stockfish and AlphaZero, too. Humans continue to disappoint🤭. Sorry. Lots of interesting stuff possible with synthesis of old and new stuff - AlphaGo just one point in the learning/planning/inference hybrid space. This point also made here recently https://t.co/KuivKbbAXF See also https://t.co/OMVvOpkUBU and https://t.co/nUvHjQmpdq Though not really a problem unique to this approach considering learning approaches also indirectly benefit from the simulator bc so data inefficient. Also as discussed, imitation+classical planning or MCTS is a cool compromise (explored a bit elsewhere). 🤔🕹 Playing Atari from pixels without training using classical planning. Seems like it could be made real time with more compute/parallelism/algorithmic tweaks, but main issue (as discussed is reliance on simulator)... https://t.co/Zz2wzJ4ZRq @m_older @Ada_Palmer There’s some fancy tech stuff in the mix, as well, and I haven’t finished it so not sure yet how best to characterise, but def. lots of ideas floating around. Enjoying Infomocracy by @m_older. Sort of in the vein of what @Ada_Palmer recently called hard social science fiction. https://t.co/rtHDrJYQD2 RT @vrothsch: Marriott (as well as Zara and Delta) groveling....gross. https://t.co/yRrxjHEPDr RT @rodolfor: I love that in the original Uber pitch deck, Uber style themselves as the “NetJets of car service” RT @aaronsnoswell: @Miles_Brundage This is great! Maybe also; "The curse of dimensionality in decision making for AI policies" :P I've been in AI policy for a while but have been derelict in making related puns, e.g. about the other meaning of "policy" in the AI context. Possible paper titles along these lines: "Policy networks for policy networks?"; "Value iteration and fundamental values"...prob others 🤔 RT @DoubleStraps: To put it in perspective of percentage, this is the equivalent of a person making $50k donating $16. https://t.co/MYzEir8… RT @chipro: CS20: @TensorFlow for Deep Learning Research is back for the second year! The updated syllabus is up https://t.co/Elu75qBMta. M… @fchollet Somewhere, an automated trading bot just read your tweet and affiliation and bought some Google stock... @mattsiegel Huh, was not aware of that. Thanks! This is what happens when I have a seminar in an hour... Our 👏repeated 👏Petitions👏 have 👏been 👏answered 👏only 👏by 👏repeated👏 injury.👏. He 👏has 👏called 👏together 👏legislative 👏bodies 👏at 👏places 👏unusual👏, uncomfortable👏,and👏 distant👏 from 👏the 👏depository👏 of 👏their 👏Public 👏Records👏, for👏 the 👏sole 👏purpose 👏of 👏fatiguing 👏them 👏into 👏compliance👏 with 👏his 👏measures👏. The Declaration of Independence, but with 👏’s. Re: “shithole,” reminder that almost 2/3 of Americans don’t have a valid passport. “Neural Program Synthesis with Priority Queue Training,” Abolafia et al.: https://t.co/4UxmIYbwIM @mapc Just a measure of how successful forecasts are :) RT @goodfellow_ian: To gain some idea of the far future of ML security, we studied a simple toy problem called "adversarial spheres," simul… @surfnm this worked well for me (up to 100 images for each query - haven't tried beyond that, just assumed it'd incur Google's wrath/I don't need much more than that hopefully) https://t.co/IrK6Loy9aY all i did was modify the query Please don't throw tomatoes at me if this is an old/bad idea, haven't run anything yet but seems promising, and haven't looked hard to see if others did it. (not the Google Images thing, the search terms - "before and after" and related terms. Lots of images already in the appropriate left-right format for paired image translation) Side note, think I found a magic trick for getting good image translation data :O @peteskomoroch https://t.co/ikVOOiiTrO For some reason I thought it'd be a lot harder to find and run a Google Images scraper than it is... @patricknmahoney indeed!! @patricknmahoney I'm not sure what you mean by "unsupervised over unlabeled data". I'm talking about the items in language 1 dataset not being paired with (/labeled as) the corresponding item in language 2 dataset. @patricknmahoney yeah, I mean this and this, though they use diff. words - https://t.co/L3jWmoE9DR and https://t.co/a6AyIlyEEY *thinking human stuff is special Then again, so is unsupervised image-to-image translation, and that's a thing, but for some reason I thought language wouldn't work. Silly human thinking human language stuff is special again, I guess? Unsupervised machine translation (/machine translation without parallel corpora, not sure if there's a standard word for this?) is completely insane. Preliminary dissertation seminar later this week 😬🙃😑🤓🤔😎 "Planning with Pixels in (Almost) Real Time," Bandres et al.: https://t.co/2OVkqOmnxI Follow up to earlier work on classical planning for Atari with RAM, if I recall correctly... """Deep In-GPU Experience Replay,"" Ben Parr: https://t.co/JT4RByguj4" @nonsensews I haven’t given it enough thought so don’t hold me to this ;) but that still seems like the right ballpark @nonsensews What about it? @timhwang @geomblog @fatconference Roger that. RT @zacharylipton: Hey folks interested in computation meets Fairness, Accountability, Transparency (FAT)! Good news: Registration is only… RT @hardmaru: Maybe Home Depot will also offer DIY deep learning cloud compute services soon ... https://t.co/43nDyzPMF7 @agibsonccc aren't both of those good ideas from the POV of all involved if they're ultimately acquihired? RT @BrundageBot: arXiv papers, January 10, 2018: Professors have it easy by comparison (though also a hard job in its own ways). I taught middle school super briefly because I crazily thought I could do it a bit part time as a community service, but wasn’t cut out for that. Extremely difficult and skilled labour. Completely insane that teachers in general aren’t well paid. https://t.co/gQwwmpryM4 @kuziemsky I thought the same thing Btw, lessons may flow in the opposite direction. Militaries generally want to know what their systems will actually do. @willknight @davegershgorn https://t.co/6tXJAgOiOB RT @ASciFiLawyer: @Miles_Brundage Should be some interesting working group reports from the ABA on the use of AI in legal processes soon. A… @pbnsilva I'm not the best person to do this RN but many others are on top of it :) Great papers, e.g. at the FATML/FAT conferences, but mostly not yet well translated into popular explanations/policy proposals @davegershgorn Is that a roomba with a statue on top @mariadelcuy NGO reports are more in the middle of the technical (papers)—popularisation (books)spectrum. (would also like to avoid a situation where such approaches are needed, but good to have them ready if they are) Similarly to how it's hard ban AI used for markets but can create/demand good practices, it's hard to avoid some military/intelligence uses of AI, but can at least have some sort of technically-grounded confidence building + signaling of intent to avoid worst case scenarios. Relatedly, I'm doing some thinking on intersection of FATML concepts and security - hope to share more on this at some point. My hope: lessons learned from commercial/gov't products/services will inform design of military/intelligence AIs, + reduce cyber/LAW escalation risks. "Maybe appropriate for mass market books, but still, hoping there are more good long-form case studies, best practices, analyses of tradeoffs in practice, popular explanations of diff privacy etc. in the next year or so. Hoping Partnership on AI, AI Now, etc. help with this." Been reading some books on AI fairness/bias/transparency/interpretability in specific domains (e.g. policing) lately and they're good but lacking in details. Big disconnect between that lit and the FATML paper world. @davegershgorn Real company with a paper that time, at least @davegershgorn ? @j2bryson @Oliver_S_Curry @Floridi @SandraWachter5 @wooldridgemike @PaulaBoddington Oh sorry misread; will be there, let’s chat too! @j2bryson @Oliver_S_Curry @Floridi @SandraWachter5 @wooldridgemike @PaulaBoddington Have a great talk! In AZ now myself unfortunately. "RT @BenLaurie: Fair decentralised consensus is impossible, a proof: https://t.co/A14rwByA0j. Enjoy." RT @goodfellow_ian: I never heard back from MIT. I got rejected from CMU. I was accepted to U of T but not to work with the PI I wanted the… "RT @NHSOrganDonor: Got two minutes? Sign up now as an organ donor and you could save lives https://t.co/PEG4bURUQ3 https://t.co/v8kc6VY3Dg" @robinhanson I like that you do these responses! Wish more authors did that. "Yoshua Beijing" My thoughts, exactly. https://t.co/ZthJXtx1Qt For any Leobens out there... here are 20k characters. https://t.co/TWom8axXmd @hardmaru @BrundageBot yeah I was actually curious what @BrundageBot would make of BrundageRNN's titles. I'd guess it would be a big fan :) CC @amaub SHUT IT DOWN https://t.co/CqUKZZoIrX @jackclarkSF yep, @sherjilozair's repo specifically. Reading RNN outputs is a bit like listening to the hybrids from Battlestar Galactica talk. I bet Leoben would find some deep insights here. https://t.co/m2YNiC3VS8 “Perfection Using Active Recurrent Models” has no author but could be a good read, too. @mark_riedl Noticed that. And @davegershgorn among others. Some output from an RNN trained on the text of all my tweets. I want to know more about "Hard Motivators Transfer for UAVs" by Dengzer et al. and "Generative Models for Hand Games" by Boutous and Goldin. https://t.co/ze7OfjgwYY RT @BrundageBot: arXiv papers, January 9, 2018: RT @EBKania: Perhaps an important bellwether for things to come —Russian forces in Syria under attack by a swarm of drones operated by a no… RT @MelodyGuan: kNN-UCB: a contextual multi-armed bandit algorithm based on UCB and k nearest neighbors that models non-linearities in the… RT @BrundageBot: arXiv papers, January 8, 2018: "VulDeePecker: A Deep Learning-Based System for Vulnerability Detection," Li et al.: https://t.co/N5oXdCxYYY RT @fchollet: Automating bug triaging with deep learning: https://t.co/eVaujznVMs @phoebemoore Cc @clarkamiller RT @BoredMiles: Just watched a great documentary on the automation of skilled labor in the entertainment industry. JT was recently replaced… @zacharylipton @goodfellow_ian you know you've had your own iced tea brand for a while, right? @catherineols https://t.co/PetXdBWx7z "RT @trishgreenhalgh: RCTs. Over-rated. Nancy Cartwright at her best, writing with Angus Deaton. https://t.co/Mr6cp5yZa3" "Try turning it off and on again" is the best advice that has ever been given or will ever be given. RT @goodfellow_ian: An article about adversarial patch: https://t.co/sLXwqaZAyr https://t.co/4UosrsNVb8 @lidija_sekaric Re AI https://t.co/cvr1gOhNZD some of my 2017 errors were related to spending too much time with bullish AI scientists so have to watch for it on other fronts too :) @lidija_sekaric But could for all I know be wrong about some things. He’s def. a sharp observer of contemporary AI science so I’d think he’s also familiar with chemistry stuff relevant to nano but haven’t discussed with him in detail. In any case thx for chiming in :) as I noted here... @lidija_sekaric Interesting, thanks! Can def. relate to the cab driver thing - AI equivalent is AlphaGo being conscious or Terminator stuff I guess :) In Drexler’s case I know he has distanced himself from the self-replicating “gray goo” stuff (says he never said it was a real concern I think?) @lidija_sekaric (p.s. I agree with your characterization re: Drexler largely being dismissed in mainstream nano world - in that sense the "ruin" thing is largely true, I just meant it isn't like he's on the streets or anything :) and does engage e.g. on some DOE nano grant stuff) @lidija_sekaric would be interested in your take! @lidija_sekaric That's def. true in AI - theoretical arguments vs. "look at what we're doing today and how far away that is"/often weak theoretical counter-arguments...not much substance-level engagement. @lidija_sekaric Selin (article I'm referencing: https://t.co/A4wekIb87H) says that Drexler and critics basically talked past each other, making different styles of arguments. Dunno how true that is. @lidija_sekaric I'm somewhat (over)analogizing from AI, where I see many people who write carefully about longer term AI scenarios, while clearly distancing them from stuff today, dismissed by others who make somewhat spurious arguments. Not as familiar w/ nano, as I mentioned. @lidija_sekaric Full disclosure, I'm not super familiar with nano stuff. But I know Drexler very well and he seems like a quite sober thinker to me, and under no illusions that things in the lab today = the longer term molecular machine stuff he's written about. But still thinks latter possible. @botminds Yep "This battle for power over the future, the ability to set the stage for what counts of nanotechnology, is complex and intertwined with social authority, legitimacy, and what kind of power is wielded." See also - "deep learning" vs. "differentiable programming." https://t.co/33OhyWzrrH P.S. Drexler is my colleague and "ruin" is a bit of an overstatement - he's doing just fine, though he is still frustrated with how people talk about nano as discussed in that article. (or even just AI... some don't even like using that term/associated baggage) *cough* AGI *cough* https://t.co/hzuzCk9H9n Reminiscent of a certain other technology 🧐🤖 (from Selin's "Expectations and the Emergence of Nanotechnology"). https://t.co/9jhCNHrQfq @TheAnnaGat Why does it make you angry? @alexleavitt I fell asleep :) now AFK. But yes I plan to @alexleavitt haven't finished it yet, but that could be right; just my initial impression. @dopetard I enjoyed USS Callister a lot; prob. my favorite this season, despite the implausibility of the DNA thing. Overall, maybe White Christmas ... @haddadhesam That's plausible, but a pretty low bar for being President IMO. The "stable" and "genius" part are more what I object to. (not my favorite) Metalhead (Black Mirror episode): what if Terminator Salvation, but Boston Dynamics "Tired: human-level AI Wired: superintelligent AI Inspired: stable genius AI https://t.co/ZYNfVEjLIv" @LydNicholas that scenario is more plausible; wish they had done something like that instead of just DNA. @MsKanta congrats! @KaiLashArul I'll give you a hint. https://t.co/mVuZsTcfAe @dopetard thanks! @ianbremmer @EBKania There's another 150 billion figure about investments related to the semiconductor industry, but not limited to AI-related hardware @dopetard also, don't think that figure from Bremmer is real (just replied to the original tweet) @ianbremmer Not aware of such a figure - they have talked about a 150 billion dollar *market* but not spending, AFAIK, CC @EBKania ? @dopetard who are the Chinese equivalents? @alexleavitt ah I haven't gotten to the end! fortunately you were vague ;) @alexleavitt (referring just to Crocodile) @alexleavitt I could imagine people having implants or wearables that record everything, but if brains continue being basically how they are, you would never be able to recover that much detail people didn't attend to.. "USS Callister: that's 👏 not 👏how 👏DNA 👏works 👏 Crocodile: that's 👏 not 👏 how 👏 memory 👏 works 👏" @BenedictEvans still a pretty small number for China, though. Even by 2020 on that graph, wouldn't be anywhere close to Japan's per capita. RT @sarahkendzior: Watching "Mr Robot" to get a break from our confusing political reality...oh wait... https://t.co/y7VRP2B6fy RT @GaryMarcus: fun to see all the discussion re the future of #deeplearning. if you or someone you love has a substantive critique of my r… RT @MaureenShaw: DON'T EVER ASK WHY WOMEN DON'T REPORT SEXUAL ASSAULT. EVER AGAIN. https://t.co/RJfFZHszr3 RT @JeffDean: Less than four days left to apply for Google's AI Residency program (formerly the Google Brain Residency program). Applicatio… Interesting that NNAISENSE is in Austin, too. Merging with Cogitai or something? https://t.co/tUpevwMsuW @tallinzen Fair point, though I think people would be upset if a single newspaper followed him around everywhere and immediately made whatever he said (no matter how false/outlandish/threatening) breaking news. Think he tweets things he wouldn't give press conferences about. (Misquotations of Stalin and @jack respectively) """When one man dies it's a tragedy. When thousands die it's statistics."" ""A death threat against a person on Twitter is against our terms of service. Threatening nuclear war is important public dialogue.""" RT @jtlevy: “I could tweet a video of myself shooting someone in the middle of Fifth Avenue and @jack wouldn’t suspend my @Twitter account.… @ArtirKel (signaling emojis) @ArtirKel I don't want to give you any ideas, but.... shouldn't this review be the longest ever??? 🚥🚦 @ArtirKel know the feeling... my forecast post was ~6k. Just added some comments in the Brier score section to that effect for those who haven't yet read it. So, hopefully people find the blog post useful but don’t read too much into the score itself. I could have been way too hard (or easy) on myself. "First, some domains are harder to forecast than others - without more data, we don’t know how random or predictable AI progress is. Second, Brier scores are about the forecasts you actually made, not other possible forecasts. I could have made many easy forecasts to boost score." "A few clarifying comments on this post... I didn’t explain this very well but Brier scores give an incomplete picture of how good one is at forecasting. Two other factors are key. https://t.co/ICRyAoKt7e" RT @nakashimae: Adm. Mike Rogers, NSA director and head of Cyber Command, has now told the workforce he is retiring this spring, and he exp… RT @JohnDanaher: Should we explore the final frontier? Space Exploration as a Utopian Project https://t.co/qQrSRSWG3m https://t.co/ohuLpUq4… "RT @CSERCambridge: For more on the thinking behind the Civ 5 mod, an interview with Dr Shahar Avin: https://t.co/NK6pVI5di9" "RT @dmimno: Optimist: AI has achieved human-level performance! Realist: “AI” is a collection of brittle hacks that, under very specific ci…" RT @CSERCambridge: Shahar Avin's Civilisation 5 superintelligence mod is out and freely available. Explores AI & tech tree dynamics. Encour… RT @Miles_Brundage: Review of my 2017 forecasts: https://t.co/cvr1gO0cB3 Pretty close to what happened actually (7/12 forecasts = ~58.3%), which I realized after making this joke, but that’s not the best metric as discussed. https://t.co/l3qyJB7MrM 60% of the time, my forecasts are right every time. https://t.co/ICRyAp23YM RT @JeffDean: Be sure to check out the newest TensorFlow 1.5 release candidate (including eager execution mode: see https://t.co/B5csoDSSIR… @hlntnr @slatestarcodex https://t.co/cvr1gO0cB3 @amaub maybe one could milk some variance estimates out of the nearer-term forecasts here? https://t.co/VVtluIq0sb @amaub Yeah I should have mentioned the issue of base rates :/ @amaub Thanks! I’m a big fan but admittedly it’s dry at times. If you want to think clearly about intelligence, task hardness, etc. though I think it’s the best long read available Why sleep when you can read almost 6000 words about AI forecasting? Many thanks to @seb_ruder and @marcgbellemare for help resolving some of the forecasts, and countless others for helpful related conversations over the years. Review of my 2017 forecasts: https://t.co/cvr1gO0cB3 Stay tuned for an assessment of my 2017 AI forecasts tonight! @hlntnr @slatestarcodex My AI ones are forthcoming sometime in the next few days :) RT @GaryMarcus: this thread by @tdietterich blurs many distinctions and misrepresents my views, especially with respect to differentiable p… RT @tdietterich: Disappointing article by @GaryMarcus. He barely addresses the accomplishments of deep learning (eg NL translation) and min… "RT @COSenDem: The marijuana industry supports hundreds of small businesses across our state. Since legalization, marijuana has generated…" RT @COSenDem: We'll give Jeff Sessions our legal pot when he pries it from our warm, extremely interesting to look at hands. https://t.co/L… "“There is No Agency Without Attention,” Bello and Bridewell: https://t.co/NmacYfkX4o (Free log-in maybe required)" b/c Dubai wasn't yet cyberpunk dystopia enough https://t.co/1qGCA3A6ni RT @abhshkdz: Panoptic Segmentation, neat work from FAIR / Heidelberg University on unifying instance and semantic segmentation, and a new… @girlziplocked worst part is, they could have made it more plausible with the cookie things from other episodes, instead of DNA... 😑 "RT @rao2z: 1/ The article does a good job of pooling & citing some of the known ""DL isn't a panacea"" arguments for the non-cognoscenti. Th…" @jeremyphoward Would like to see more experts making such falsifiable forecasts, especially for near term. Rodney Brooke’s latest was good on the specificity front, though mostly distant future so hard to determine calibration. @jeremyphoward Think we agree, but I’d emphasise timeframe- important for societal implications. experts can say X is possible (eventually), but without specific timeframe, it’s unfalsifiable/not much value add over nonexperts. Admirably, author gave 1-2 yrs for 1st 2 applications, glad to see. RT @Ada_Palmer: I have a new essay for Scientific American on Social Science in Science Fiction. https://t.co/eBHsLrFkNz RT @BrundageBot: arXiv papers, January 4, 2018: @jeremyphoward (One can also distinguish technical forecasts from societal ones - not sure we are great at either one in AI :) but would put more stock in tech experts for tech forecasts) @jeremyphoward Thanks - I guess I was primed to think you meant *forecasts* of such capabilities/limitations, my bad :) makes sense @jeremyphoward (Just a general soapbox comment as I’m writing up thoughts on this, not a dig at the article :) thanks for flagging it) @jeremyphoward Ofc one should all things being equal trust ppl with more than less info, but also experts disagree a fair amount. My 2017 forecasts generally did better when based on extrapolating trends vs. updating a lot on conversations with specific experts. @robinhanson I was looking in new stuff/current events type sections, not psych, maybe should check psych next time I’m at a store @robinhanson Traveling around in US now and haven’t seen yet but hopefully soon! @robinhanson Any intel on when I might see it in stores? RT @benhawkes: Project Zero blog post: "Reading privileged memory with a side-channel" by Jann Horn (@tehjh) - https://t.co/eVKlU7eiGy RT @OriolVinyalsML: "Optimal" running, brought to you by Deep RL. https://t.co/NimTGxSDbu https://t.co/Sln3HO68Ot 👏They’re 👏not👏unrelated👏 The Rise of Big Data Policing starts the same way as each Person of Interest episode. 🤔 https://t.co/mU2qCgCuVr RT @mark_riedl: Doomsday clock now at 2 minutes to midnight snack https://t.co/Ki6pjTDspm RT @emilyrauhala: I'm on the Tianjin to Beijing train and the automated announcement just warned us that breaking train rules will hurt our… @mhbergen Dead is a bit strong... @gwern Didn’t get much distribution the last times I did this @gwern Not worth our time :/ but yes it probably is false RT @FHIOxford: You only have one more week to apply to one of our two AI Safety research positions - AI Safety Research Scientist (https://… @samim @Aelkus Hmm interesting. Maybe he’s changed his views, or we have different maps of singularity land :) @Aelkus @samim @EBKania Don’t nec. disagree with that (indeed, have had a few ppl mention Kurzweil to me in China), just responding to the book discussion @samim @Aelkus I haven’t read the second book mentioned but have read Master Algo - despite title, it’s very much not singularity-ish. Explicitly anti-AI safety/intelligence explosion concerns in fact... Provisional TL;DR of blog post in progress... subject to revision. Final Brier score still to be calculated. https://t.co/wjXUi5EGjN RT @amaub: A review of the top 5 papers ML arXiv papers of 2017 (according to the number of likes each paper's @BrundageBot tweet received): "Dendritic error backpropagation in deep cortical microcircuits," Sacramento et al.: https://t.co/EtwkVyOIoQ "Denoising Adversarial Autoencoders: Classifying Skin Lesions Using Limited Labelled Training Data," @ToniCreswell et al.: https://t.co/jt4soRSBDM "Accurate reconstruction of image stimuli from human fMRI based on the decoding model with capsule network architecture," Qiao et al.: https://t.co/ny1UmIf6FP @seb_ruder @jackclarkSF @bousmalis Thanks! :) RT @GaryMarcus: Top 10 reasons #deeplearning isn’t getting us to artificial general intelligence. A critique of deep learning, 5 years into… Helpful discussion of transfer learning developments in 2017 by @seb_ruder. Do you know about TL and agree/disagree? Please chime in! See also Seb’s nice post on this a while back https://t.co/Zq7Y12mtIb https://t.co/JqWlR6eIyE @seb_ruder @bousmalis Many thanks!! This is very helpful. Curious: do you think, if I asked 10 relevant experts, most would agree there was significant progress? Given how forecast was framed, I think significant disagreement+vagueness —> forecast fails (others are easier to resolve) RT @seb_ruder: 1/ @MilesBrundage asked me to give my thoughts on his prediction whether there has been an impressive transfer learning achi… RT @BrundageBot: arXiv papers, January 3, 2018: RT @BrundageBot: Deep Reinforcement Learning for Unsupervised Video Summarization with Diversity-Representativeness Reward. Kaiyang Zhou an… RT @BrundageBot: The CAPIO 2017 Conversational Speech Recognition System. Kyu J. Han, Akshay Chandrashekaran, Jungsuk Kim, and Ian Lane htt… @gwern Can’t really fault them for trying to adhere to the ICLR guidelines... @seb_ruder Sure! Was going to ask you for thoughts on the (especially vague :/ ) transfer learning one https://t.co/rzqLGysyfy RT @FeryalMP: @Miles_Brundage GitHub: https://t.co/VmofbPoB4v RT @rasbt: Hey, I have another request 😅 It's about an arXiv endorsement again. Is there s.o. who could help with an endorsement for the Qu… @seb_ruder @marcgbellemare thanks! :) "Deep Learning: A Critical Appraisal," @GaryMarcus: https://t.co/Zqe40iVIDC """DeepMind Control Suite,"" Tassa et al.: https://t.co/ILxhiYmnPm ""a set of continuous control tasks with a standardised structure and interpretable rewards, intended to serve as performance benchmarks for reinforcement learning agents"" https://t.co/We8C8FWwed" RT @Rochelle: I reported 45’s most recent nuclear threat tweet and got the "We have reviewed your report carefully and found that there was… "RT @PaulDMiller2: Foreign leader: fear me cause I might nuke you. Trump: Mine is bigger. Me: *burns PhD* https://t.co/TESrmPnWVB" 😑 https://t.co/KFrrr45sag Cc @marcgbellemare @seb_ruder 👋😊 "Btw, I may want some folks to help grade some of my forecasts, specifically in the following areas: Atari AI, transfer learning, speech recognition. Let me know if you’re an expert in one of these and willing to devote a few minutes to this (prob <10)." Moment of truth soon 🙈 https://t.co/Np20F4JWmP @neuroecology @achristensen56 wasn't a fan of that part :( but I enjoyed it overall. Maybe see also White Christmas from an earlier season, which is along somewhat similar lines and pretty popular (*slightly* more plausible, too). @internetrebecca I dunno... https://t.co/YJEemTSqmF @red_abebe congrats! RT @rishi_raj: Check out our latest (and send us your comments): "Large-scale, high-resolution comparison of the core visual object recogni… RT @timhwang: We’re live! @jackclarkSF and I are back with another edition of our recap of technical highlights from @NIPSConference 2017,… RT @ethanwbrown: @Miles_Brundage Also think the way they keep reusing brain emulation is a bit lazy. It's far less plausible than other fut… @ethanwbrown agreed. RT @etzioni: Thought provoking piece by @elismason1 who is a leader in fighting poverty! https://t.co/D4FQKbxbeA RT @rao2z: Admirably specific! https://t.co/WAZeMKinCz @hardmaru Nice emoji @botminds @ArtirKel @Aelkus @gwern It’s at the odds in the original post in the thread For others, you should watch Black Mirror :) All that being said, Black Museum type stuff seems plausible and even likely given sufficient tech and no governance. There are >0 super sadistic. I just suspect there are a lot more Captain Daily type people. :/ Anyway, tried to avoid spoilers, hopefully some of you get this. (e.g. Black Museum). However, the DNA thing on USS Callister was 😑😑😑😑🤦‍♂️🤦‍♂️🤦‍♂️🤦‍♂️ they could have at least tried to make it somewhat plausible with cookies, or the Black Museum hat thing, or basically any causal mechanism other than DNA... FWIW, I liked the USS Callister episode - that "business case" for mind crime seemed plausible, and has less extreme forms (non-conscious emulations of people, e.g. the recent face-swapping porn thing)... moreso than the super cruel stuff which hopefully has less of a market. Mind crime is far from the only reason one might worry about synthetic, conscious minds, so it's interesting that Black Mirror dwells on it. Maybe, again, because it's easy to write about? Take human cruelty, add new tech affordances... Note also that a principal concern about emulations that the show explores is mind crime (mistreatment of synthetic minds, potentially allowing previously impossible degrees/scales of suffering - discussed in Superintelligence and elsewhere by Bostrom). @Aelkus @robinhanson I mentioned one of the earlier seasons' em-related episodes to him (White Christmas) and he wasn't a huge fan - my low-fidelity model of him suggests he won't be much more impressed by the new season than he was by that or Walkaway :) 1/2 is a lower bound on how emulation-related this season is - 3 out of 4 I’ve watched have dealt with it (6 total). "Black Mirror is really into brain emulation issues these days. Not complaining*, just unusual - came up on approximately 1 in 5 episodes for seasons 1-3, now 1 in 2. *I like such episodes, but anthropomorphic AI is a bit easier/lazier to write about than non-anthropomorphic AI." RT @AmericaFerrera: These donations from all of you are wrecking me 😭. THANK YOU for standing up to say: #TIMESUP - The @TIMESUPNW Legal D… RT @juliagalef: A modern-day Gift of the Magi: I look straight into my webcam while Skyping, instead of at your face on the screen, to give… "RedDwarfData: a simplified dataset of StarCraft matches," Merelo-Guervos et al.: https://t.co/bCrmblEZeM RT @BrundageBot: Boosting the Actor with Dual Critic. Bo Dai, Albert Shaw, Niao He, Lihong Li, and Le Song https://t.co/UrzWaezQDZ I misconstrued the arXiv holiday schedule - think there are another two batches of pre-new year submissions (after tonight), if I understand correctly this time. "The algorithm is provably convergent with nonlinear function approximators using off-policy samples by solving the Bellman optimality equations." https://t.co/KKpvGF3CVb RT @BrundageBot: arXiv papers, January 1, 2018: RT @ArtirKel: Public reminder that I have a standing bet with @Miles_Brundage that by the end of the year, Starcraft 2 won't have fallen to… RT @syhw: We just open-sourced wav2letter! https://t.co/DRLEmfeysZ @patricknmahoney @Things4WhitePpl It is true, using it right now (n of 1) Pro tip: at least some Patagonia jackets have pockets big enough to hold (non-textbook) books. RT @dennybritz: I wrote up a (not so brief) summary of AI developments that stood out to me in 2017 https://t.co/3oLEOlC1GE RT @rubinovitz: I'd really love a good investigation into how health insurance uses dark UX to deny benefits, I say as I go into the develo… @BoredMiles @FHIOxford You were there in spirit. @deliprao @BenedictEvans They tend to have many hashtags in their profile and also use many hashtags. Big red flag. RT @histoftech: me at the beginning of 2017 vs me at the end of 2017 https://t.co/CgeLZN88i5 @SmithaMilli True of every topic I suspect 😑 def. politics @amaub @iandanforth @BrundageBot Note also that my follower account increased over time, so that should maybe be controlled for. Can get u that data (followers over time) if needed RT @BrundageBot: How could @BrundageBot become more useful in 2018? Content sources besides arXiv? Tweet fewer/more papers per day? Data se… Especially actionable ones (i.e. should I watch sooner, or later). Spoiler free hot takes on Black Mirror S4 needed. RT @blkahn: If you don't like how cold it is in the eastern U.S., may I suggest a vacation to nearly anywhere else on Earth? https://t.co/c… "RT @vkrakovna: My belated report on the this year's NIPS conference: https://t.co/FiGOOC0rMP https://t.co/u0krj559pC" RT @AlirezaNader: #iranprotests are very different than 1999 and 2009 protests. This is the most vehemently anti regime event I've ever see… RT @AP: Police in Iran's capital say they will no longer arrest women for failing to observe the Islamic dress code imposed since the 1979… 🧐 https://t.co/hdMc4vY7wJ https://t.co/Rk4LTSkIOO Including discussion of how one would implement AlphaGo Zero in this framework... https://t.co/3beSzsvmWq """Tensor Regression Networks with various Low-Rank Tensor Approximations,"" Cao et al.: https://t.co/IRGbnA4LUv ""For CIFAR-10 dataset, we achieved the compression rate of 0.018 with the sacrifice of accuracy less than 1%.""" "@markus_with_k 1. generative model 2. cool videos of robot grasping 3. ??? 4. profit" @samim so we should pursue that scrutiny/oversight but also not throw the baby out with the bathwater if they can actually demonstrate that they're doing something like this in an ethical fashion. AFAIK they haven't, though @samim agreed, should be subject to a lot of scrutiny - more unofficial scrutiny (public pressure/muckraker journalism/consumer activism etc.) and official regulation if not nationalization of some sort... but also,they're (among) the only actors that could actually do this (one of the) first paper(s) with the Embodied Intelligence affiliation... https://t.co/GjF9EIGXl2 "Facebook’s suicide prevention AI is potentially affecting more people already, but no evidence on impact/accuracy AFAIK. Could end up being one of most beneficial applications of AI if false positives/privacy/PR etc. managed well. V. interested in AI for mental health in 2018." "Still not a fan of the Woebot website - has some anti-therapy/meds-sounding* stuff on there which rubs me the wrong way... but mental health is super important and if not now, then eventually it will be a killer (read: saver) app for AI. *FAQs more nuanced" TIL the Woebot folks (chatbot for mental health) have a paper: https://t.co/5e3HnTJ0k2 One of the bot's better ideas... https://t.co/kq3IQFmyiS RT @BrundageBot: arXiv papers, December 29, 2017: Looks interesting. NovuMind is the company Wu started after leaving Baidu post-ImageNet scandal. "“CNN Is All You Need,” Qiming Chen and Ren Wu: https://t.co/bxR8S4DOtL 44-46 BLEU on English->French" @sakrejda Yeah Fair pt. chose AlphaGo bc very domain limited. Some systems maybe analogous to stronger insects or low mammals. RT @DrLukeOR: 2017 in review! I look at progress in #medical #AI and machine learning more broadly, consider some important topics for our… @dennybritz @tkasasagi not too late! ;) https://t.co/WS8wVsTv49 @tkasasagi see also ;) https://t.co/SvuQ1mBglW Colin Allen reviews "Plant Minds: A Philosophical Defense," by Chauncey Maher: https://t.co/anDU39ulFi @tkasasagi when I'm in such conversations, I emphasize that intelligence isn't magic/there is a spectrum of generality/smartness and we're still in early stages etc. but it's still cool and impactful even if not human-level/human-like :) @tkasasagi I'm not sure on that one. There are definitely gray areas, but for some things like AlphaGo/AlphaZero/embodied deep RL systems, those seem clearly >0/comparable to e.g. a dumb insect to me :) Others might say nothing "counts" yet. Last chance to prove me right by solving speech recognition, or wrong by overshooting 500% median on Atari, etc. Not getting my hopes up, though - I think things are mostly settled at this point (70% confident in this :P). @tkasasagi depends who u ask/what u mean :) if by AI you mean the field, then most say yes, it's an AI sub-field. if by AI you mean "an intelligent artifact", more controversial Q :) personally I think ML systems are barely non-0 on the intelligence spectrum, so (barely)yes; others disagree Only 2 more batches of arXiv papers before I have to grade my 2017 AI forecasts. 🤖❓📈 "RT @ByRosenberg: A big story of 2017: income inequality got much worse Millionaires (0.7% of the population) now have 46% of all wealth wh…" @BBCTech Hi - Lee Sedol lost 4-1, not 3-0 as article states. "On Monte Carlo Tree Search and Reinforcement Learning," Vodopivec et al.: https://t.co/1uZi770iTg RT @Liz_in_Shanghai: WeChat will soon be China's official virtual ID >> Alibaba won’t be happy to see this... even tho wechat’s trial now i… RT @yomnapple: I'm organizing a day of women & non-binary folks live streaming open source work for some time in February. Sign up here if… Alas, Buckminster Fuller was not a mathematician or computer scientist. But he was right about some things. https://t.co/FDWyV6dWk0 """A problem adequately stated is a problem well on its way to being solved."" - Buckminster Fuller (also me while cleaning data, and a convolutional layer while popping into existence)" RT @JeffDean: Nice visualization of probabilities that people assign to words and phrases. The multimodal ones are pretty interesting. Wh… RT @decodyng: I think our conversation about bias and fairness in #machinelearning is valuable, but I think it could use some extra clarity… "Gender differences in beliefs about algorithmic fairness," @2plus2make5: https://t.co/5UWHHytSb4 @mark_riedl exactly. I also fight wrong views (of AI) online. https://t.co/hxs9ockiwJ "Learning to Run with Actor-Critic Ensemble," Huang et al., Megvii/Peking U.: https://t.co/wXdjz5uKqp 2nd place at NIPS Learning to Run competition, after NNAISENSE. @michael_nielsen @jeremyphoward @BenedictEvans And importantly, per paper, they checked that at least based on readily available info, survey responders not much different from non-responders. This was a prob with other surveys. @jeremyphoward @BenedictEvans I also quite like the yellow--black optimism/pessimism chart. Have used in talks before... clear depiction of radical disagreement @jeremyphoward @BenedictEvans there are others but generally smaller and more biased/problematic in various ways (not that this one's perfect, but it's more of a serious effort than most such surveys) "@jeremyphoward @BenedictEvans Main survey described here https://t.co/VVtluIHBQL Lots more results here https://t.co/1Vp7HPjH75" RT @dandrezner: “The personal attacks from the leader of the free world, blasted out to his 45 million followers, have no real precedent in… @hardmaru @deliprao some of those outlets have prob. covered Sophia, another project by some of the people involved (Ben Goertzel, David Hanson), not the ICO. but yeah, there is 0 due diligence on ICOs generally. at least with Rocket AI, ppl emailed to say "i want to talk/invest," didn't just send $ @timhwang I got a 4.5 year delayed response a little while back RT @gwern: .@Miles_Brundage I made you an attempt at explaining the importance of AlphaGo Zero in a simple way. https://t.co/AGHclgwDjh @BoredMiles Nice find "RT @BoredMiles: A sobering read on how this Internet thing will never actually work... https://t.co/frL3So2F2l" RT @elonmusk: Having a sinking feeling that most people actually do think it was aliens … RT @paul_scharre: Everything wrong with that Slaughterbots video: https://t.co/qM47Wy5F8s @mchorowitz @RebeccaCrootof @amirhusain_tx @sean_… 🤦‍♂️ https://t.co/LA6HPI4QvM @PatrickOmid Chicken tenders is obvi the right answer though @bcmcmahan @catherineols @JeffDean Scaling to 40 or so was an experience :) agree all those things help, esp. tying to existing interests. And ideally all classes would be small but in some cases like mine, could see more adaptive toys/apps helping. RT @washingtonpost: What makes some men sexual harassers? Science tries to explain the creeps of the world. https://t.co/8Aqj89Lfqa Postdoc positions in AI policy and AI trust/transparency! https://t.co/LR6ZcLjDxg @catherineols @JeffDean My experience teaching middle schoolers was similar...hard to find right complexity, especially at scale (in that case, big classroom). Scratch, for example, is cool but too easy/hard for many to self teach. Some turned on, some off. Maybe ML for adapting complexity would help :) Off to Seattle ✈️ RT @BrundageBot: arXiv papers, December 22, 2017: Wait, this Long Island Iced Tea thing is real? Happy holidays everyone!! First act as co-chair. Bold move for Alphabet. https://t.co/xH9fItFD0f Breaking: Bored Miles Brundage and Brundage Bot to serve as non-executive co-chairs of the board. Will donate salaries to Miles Brundage. https://t.co/Qr9iwwArLz @patricknmahoney 🤔 Burning hot take https://t.co/w1aHtPn3FO Hot takes, please. https://t.co/Dpb2Wyk4PJ RT @benhamner: I want to give a big shout-out to the bitcoin folk. Thanks to the massive cryptocurrency bubble that’s starting to consume a… "RT @erikbryn: Delighted to see my article with Tom Mitchell published in @ScienceMagazine : ""What can machine learning do? Workforce imp…" RT @timhwang: my new paper evaluating the case for cda 230 reform in the context of online disinformation is now officially up https://t.co… RT @vkrakovna: Examples of research topics covered by the new FLI grant program: https://t.co/pleit1j8iS RT @hardmaru: Reverse Curriculum Generation for Reinforcement Learning Agents. Generating a curriculum over start positions might allow age… RT @EBKania: Great progress and rapid success for Project Maven as algorithms are fielded and refined for operational use https://t.co/PBGH… @nsaphra Or batteries https://t.co/W8aAI0Q2at @nsaphra 👏👏👏👏👏 RT @nsaphra: In the lower right corner, the historic AI/worker solidarity treaty to process the oblivious rich into paperclips. https://t.c… RT @FLIxrisk: We are excited to announce the launch of our 2018 International AI Safety Grants Competition! Submission info & deadlines her… RT @pfau: Excellent summer school that I'll be speaking at this coming year, with a fantastic roster! Maybe you should apply? https://t.co/… RT @Doctor_Galactic: Folks @scienmag is gone! Twitter have removed it for impersonating @sciencemagazine. About damn time. RT @BrundageBot: arXiv papers, December 21, 2017: "RT @vkrakovna: FLI has announced a new research grants program focusing on long-term AI safety! Deadline Feb 18. Request for proposals: htt…" @botminds agreed. Unaries is quite a prankster. On the other hand, @BrundageBot's favorite paper of the year is "Multi-Label Zero-Shot Learning with Structured Knowledge Graphs" by Lee and Fang et al. Thanks @amaub for checking on this and for making @BrundageBot :) https://t.co/7eKcsX6zCf RT @erichorvitz: Important reflection. Care needed on data-centric analyses on sensitive issues, but should not overlook opportunities for… @yuxili99 thanks for sharing this! @PacktDatahub @AndrewYNg I don't know, but good Q :) I'm with the AI, not the human labelers, on this one: it would be socially awkward to sit in the aisle when there are seats available. https://t.co/RsGXQ2cMTy "Learning to Act Properly: Predicting and Explaining Affordances from Images," Chuang et al.: https://t.co/ujW3kA7LdX Wild new dataset/problem. https://t.co/clNQFKfehH "Deep Regression Forests for Age Estimation," Shen et al.: https://t.co/6eXO6j65yR Very big improvement over the state of the art (purportedly at least). "Finding Competitive Network Architectures Within a Day Using UCT," Martin Wistuba: https://t.co/kPTNTFiXTs @mark_riedl Call me when it’s a positronic wafer. @PacktDatahub also, in the mental health space, while it's controversial, I think stuff like the Facebook detection of suicidal messages is potentially v. important. I hope there's more work on AI and mental health, though obv. lots of ethical issues there. Beyond health, again, hard to say :) @PacktDatahub gosh, that's a super hard question :) honestly, there are so many in development, but it's still early days in terms of actual deployment. Tons of stuff for medical diagnosis, for example, that seems close to deployment+impact, esp. in developing world. RT @Reza_Zadeh: New blog post: The Artificial Intelligence Computing Stack. A look at why the U.S. and China are investing heavily in this… (cool diagrams, deceptively simple idea); "Deep Q-learning from Demonstrations" (insane amount of value gotten out of very few human demonstrations); and "Should Robots Be Obedient?" (important, provocative, clear). Fin. Some runner ups (runners up?): "Emergent Complexity via Multi-Agent Competition" (great demonstration of the power of self-play in general and in 3D environments); "A Deep Reinforcement Learning Chatbot" (simple/powerful idea, readily improvable); "Distral: Robust Multitask RL"-- OK, the results from my highly arbitrary and biased decision process are in. The winner is: "Deep reinforcement learning from human preferences," by Christiano et al. at OpenAI and DeepMind: https://t.co/Kje9ua0r6x Clearly explained, important problem, and collaborative. 👏👏 @TheAnnaGat @amaub do you happen to know if Brundage Bot has a favorite this year? :) Some great papers in the replies here! I feel like I should pick some now, but it's so hard. I'll try... https://t.co/lLq1hcLjet @JoshMiller656 congrats! RT @ColinKahl: This report should be taken very seriously. There is a contingent at the White House that believes a limited strike is viabl… @mariadelcuy @arxiv I seem to recall being confused about that when I submitted but don't think it's an actual thing; not sure... cc @tdietterich @mariadelcuy @arxiv No one needs to know the gatekeepers - anyone can submit. RT @sarahjeong: This doesn't actually solve anything https://t.co/RYliGaA4SW @markus_with_k @PatrickOmid @BrundageBot @BoredMiles I have a hypothesis about Bored LeCun but am not sure. 🤔 @iandanforth :( @markus_with_k @PatrickOmid @BrundageBot @BoredMiles Not me, but someone you know (of). I will let him or her decide on their anonymity :) "RT @RichardSocher: Hierarchical and interpretable multi-task reinforcement learning. This tackles some major limitations in RL: Training ag…" @PatrickOmid @markus_with_k @BrundageBot or @BoredMiles might have more insights on >3 dimensional matters than I do, seeing as they come from the future and/or different parallel universes RT @stevelevine: The biggest AI stories of 2017, by @RodneyABrooks, @AndrewYNg, @awmcmu, @TerahLyons, @Azeem, @_BeenKim, @RichardSocher, vi… @markus_with_k you mean you haven't solved time travel with deep RL?? (I interpreted it as academic year without the clarification FWIW :) ) RT @markus_with_k: Taking summer interns this year! #intershipwithrobots https://t.co/rgy0EJDEe5 Interesting analysis. I sometimes forget how big MILA is, and there is def. a lot of interesting stuff brewing in the Montreal startup scene, some known and some unknown 🤐 https://t.co/rjqRIedK8Q RT @hlntnr: Exciting to see @open_phil's growing grantmaking to support scientific research featured in @nature! Highlighted 2 quotes that… RT @APStylebook: The adjective "transgender" describes people whose gender identity does not match the sex or gender they were identified a… Lamp fixed in my bedroom, whooo, = more reading, fewer tweets. You're welcome/I'm sorry as the case may be. Insane amount of money (by non-cryptocurrency/non-tax bill standards). https://t.co/SY6lZhl5cf @ankurhandos still needed: https://t.co/9jXvNjCU06 RT @egrefen: Many machine reading datasets only require extracting a short span/entity. To drive research on systems that can read and unde… @ArtirKel Cc @nsaphra @avijit9d Not in the near future but hope to start thinking more seriously about it when my dissertation wraps up next year :) @generuso Yeah I could imagine doing that, though I think I’d do a lot of things first. Maybe depends on exact lifespan. It was hard to come up with an example that I couldn’t imagine doing but wasn’t some obscene unethical thing that’d be weird to say @surajkmurthy Most populous country I haven’t been to, by far :) and also unique history/culture etc. I haven’t experienced much of "Fuck it list: stuff you would never do, even given a virtually* infinite lifespan and enhanced cognitive capacities Personal example: antique restoration** __ *Literally living forever (e.g. no heat death of the universe) changes things **Maybe. This was hard to come up with." "Bucket list: stuff to do before you die Borg it list: stuff you could imagine enjoying but realistically won’t ever do unless you live forever and/or become a cyborg that can swap experiences/knowledge with others easily E.g. bucket for me: visit India Borg it: watching sports" RT @andyjko: I get to be Debbie Downer today and tear down this NYT article on toys that teach coding: https://t.co/r9xTSvFj0s RT @BrundageBot: arXiv papers, December 20, 2017: Rotten Tomatoes Review Generation with Shallow Actor-Critics RT @mmitchell_ai: My friends over at Jigsaw have launched a toxic online comments challenge. Build a multi-headed model that’s capable of… Looks like a good review - Adversarial Examples: Attacks and Defenses for Deep Learning," Yuan et al.: https://t.co/HuZ9teKUz8 "The NarrativeQA Reading Comprehension Challenge," Kočiský et al.: https://t.co/xcpvUoTLwO "ComboGAN: Unrestrained Scalability for Image Domain Translation," Anoosheh et al.: https://t.co/GS47oTHXsq https://t.co/iMIW3PJrB2 "Towards the Augmented Pathologist: Challenges of Explainable-AI in Digital Pathology," Holzinger et al.: https://t.co/Y5cxU6jJxw RT @NicolasPapernot: Accepted papers from the workshop on ML security at this past #NIPS2017 conference are now up on the website: https://… @juliagalef you inspired me to look this up, which I was a fan of in high school - glad to see it's alive and kicking! https://t.co/98d6mEcyJS @michael_nielsen @Dynamicland1 <5 mins browsing a startup website seems like a reasonable time investment for a random person to me... (not saying I agree/the comment should have been made, I've spent ~0 minutes on it, but also not trashing it online. seems disanalogous to the physicist) Someone was finally appointed to manage US nukes... 11 months into the administration. 🤦‍♂️ https://t.co/9IJ9etZt0n @ylecun link not working FYI (for me, at least). Ooh, this should be good. Precup is an RL rockstar (RockstaRL? RLockstar?) https://t.co/5nekDshG7e @tetisheri Yay! RT @joshchin: We spent almost two weeks exploring what life is like in Xinjiang, which China's government has made into a laboratory for it… RT @mlittmancs: AP News has a quick take on one of our planned research projects---a robotic cat to bring help and comfort to seniors. My r… @TheAnnaGat see also the show Caprica (dating in VR with possibly different avatars) :) RT @feamster: .@PrincetonCITP is looking for postdocs, fellows, and visitors. Come join me, @EdFelten, @random_walker and others. Lots of g… @gwern thanks - will (re)read. This was a popular NIPS poster! @gwern I think I agree that ExIt is important/think I understand it but haven't yet deeply gotten it yet @gwern what's the best explanation of it you've read (or written)? I frankly didn't find the intuition behind the AG papers that well explained, but found e.g. Christiano's discussion of it viz-a-viz capability amplification compelling. Maybe need to reread both and/or something else. RT @twimlai: NEW SHOW ALERT!! @Samcharrington is joined by @TimnitGebru, postdoc at @MSFTResearch, and one of the organizers of @black_in_… @rodolfor thanks. will revisit :) 😍 https://t.co/wJLEmWmuaa @rodolfor cooler than DeepStack? I seem to recall skimming safe and nested and finding it a bit technical (vs. DS) and then stopping, but should revisit in any case. RT @tsimonite: Approximately 550 million Facebook users won't be getting the new facial recognition feature rolled out today because Canadi… RT @googleresearch: Building on TTS models like 'Tacotron' and deep generative models of raw audio like 'Wavenet', we introduce 'Tacotron 2… @gwern Why AlphaGo Zero and not AlphaZero? RT @mark_riedl: But also mass deregulation resulted in a large number of really deep pits without hand railings https://t.co/XQbqmmXrjG RT @BoredMiles: The Death Star required half a dozen different individuals to push 50+ buttons in order to launch its lazer beam - not even… What's the coolest AI paper you read this year? Deep Reinforcement Yearning from Human Preferences @mark_riedl Huh, so you’re saying bots are doing your tasks, badly? Or humans are assigning them to other humans for less and taking the profits? RT @marcgbellemare: A long time in the making: An RL blog, by yours truly, with an eye towards fusing the old and the new https://t.co/I5vs… @samim hm interesting. And yeah, I worry about decline of that oversight too, but AFAIK it isn't dead yet. Deep State to the rescue? ;-) I'm maybe one Intercept article from being proven wrong but I think/hope many post-Snowden reforms still in place @samim (that's not to say China isn't into digital surveillance - obviously they're super into it! - but there isn't as much of a big push for cameras everywhere in the US...UK perhaps more comparable, but still way, way fewer I think) @samim Agree the latter is important, but quite different in that there are non-trivial democratic oversight processes/legal protections against abuse (albeit imperfect ones, esp. pre-Snowden) and more abt digital than physical surveillance. One can worry abt both :) Maybe 1:1 ratio? "https://t.co/iCbojMulzo See also https://t.co/lfDSAYq0An" RT @rustyryan: @Miles_Brundage Samples are here: https://t.co/VurDxuG4aJ @PatrickOmid how was it? RT @jennwvaughan: I've shared a transcript of my #wiml2017 opening remarks: Nine things I wish I had known the first time I came to NIPS @w… Should be part of the conversation on FATML... and this is just stuff that is publicly visible. Lots of other data labeling going on in corporate silos, where there are other issues (e.g. traumatizing data). https://t.co/8iP8cEmDyW """Morphology dictates a robot's ability to ground crowd-proposed language,"" Mahoor et al.: https://t.co/gt4uNQchnv On findings from the Twitch Plays Robotics platform, where the crowd evolved robots https://t.co/36L14Wmkiw" "Generating and designing DNA with deep generative models," Killoran et al.: https://t.co/A9HSKjlzjj "Nonparametric Inference for Auto-Encoding Variational Bayes," Bodin et al.: https://t.co/C73CJcFEDY """Ray: A Distributed Framework for Emerging AI Applications,"" Moritz and Nishihara et al., Berkeley: https://t.co/hJtLcGdKRJ Used to solve the humanoid-v1 task in <4 minutes on 8192 cores" RT @BrundageBot: arXiv papers, December 19, 2017: @zacharylipton @SmithaMilli full disclosure, haven't read that one so can't defend it :) more familiar with the other one I tweeted before it. I, too, am lacking vital context. RT @tallinzen: "workers earned a median hourly wage of only ~$2/h, and only 4% earned more than $7.25/h" https://t.co/EcrHUEI7lL "Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictions," Shen et al., Google: https://t.co/cFW5Z4OXL7 big improvement over WaveNet according to mean opinion scores, though no demo (yet) "A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk," Hara et al.: https://t.co/TPhAZqM6Kk @SmithaMilli P.S. another paper tonight from one of said colleagues, on making AIs indifferent about certain things (see screenshot): "'Indifference' methods for managing agent rewards," Stuart Armstrong: https://t.co/TWTy1ngzdy https://t.co/0wFHJsd6sJ @SmithaMilli (but with some darker examples :) ) anyway, check out if you're interested in AI safety! @nancyleong 👏👏👏 Paper also discusses what it would mean, in the framework introduced, for an AI to manipulate or override human preferences (e.g. as discussed @SmithaMilli et al.'s work, "Should robots be obedient?"). Naive solutions like a simplicity prior don't help, but other assumptions along the lines that humans routinely use when interpreting other humans' behavior (e.g. re approximate rationality, biases, emotions etc.) might. The "impossibility" in the title refers to the impossibility of deriving human values from behavior without making significant assumptions about humans (to be explored more in a future paper). New paper from my colleagues on issues with inverse reinforcement learning - "Impossibility of deducing preferences and rationality from human policy," Armstrong and Mindermann: https://t.co/GIylg7MJ6A @pfau @PatrickOmid @KaiLashArul Or Deep Adaptation Robustness With Integrative Networks (DARWIN) @pfau @PatrickOmid @KaiLashArul Generative Evolutionary Network Engine (GENE) @gwern Diagon Alley @doomie @BoredMiles oh God... Been getting this specific ad a lot lately No, I don't think this online course will teach me to "create deep learning algorithms," thx though YouTube https://t.co/mXVe8Rahvf @zacharylipton also noteworthy that the (stated) goal of this paper was to test the combination of previous things/have an overall good system (inc. final performance), not just early performance, whereas some papers optimizing for the latter didn't achieve my metric (Neural Episodic Control) @zacharylipton (many of the hyperparameters for both were inherited from previous work or not heavily optimized, though, FWIW. In any case, I was making a pretty limited claim, not saying research processes are hyper efficient) @zacharylipton correct, since that applies to A3C, as well. The metric in question is median performance across 57 games for a single system (however derived) using a common set of hyperparameters across games (however derived). maybe I'm lame, though Can we talk about how the "you're the puppet" thing in Star Wars was unnecessary/forced/lame One of my fave charts of this year - because of Rainbow's impressive performance, the aesthetically pleasing line 😍, and because my forecast was that something would beat A3C with 5% of the training this year 👍 https://t.co/AERstqVfml https://t.co/h3KiVmOhtA "RT @soumithchintala: a birds-eye view into Facebook's datacenter infra https://t.co/i8MaG0BTji https://t.co/Fq4c8eoCKp" @Smerity @iamaidang @KLdivergence thank you for doing that! RT @NicolasPapernot: The submission deadline for the deep learning security workshop at @IEEESSP 2018 has been extended to Jan 5. Looking f… RT @ColinKahl: Trump's Nat'l Security Strategy declares: "After one year, the world knows that America is prosperous, America is secure, an… RT @jeffclune: Welcoming the era of deep neuroevolution. Simple GA trains DNNs on Atari (competes with DQN, A3C, ES). Random search also co… @KaiLashArul @iamtrask Also happy birthday!!! :) @KaiLashArul @iamtrask I’m so old (30), yall are making me look bad :( "US national security strategy: we will attract the best and brightest Also US national security strategy: foreign students are scary https://t.co/J9UHljoTUZ" @nsaphra 👏 @Hernandez_Danny @metaculus (Some 2017 categories don’t make sense for 2018, e.g. Atari before maximum scores start to matter a lot and AlphaGo when it wasn’t certain it was v. superhuman...so prob too late for several of my existing ones) @Hernandez_Danny @metaculus I’ll take a look at Metaculus when I start thinking about 2018 stuff. Could maybe use some of theirs, or suggest others (I particularly want ones that resolve within a year) @Hernandez_Danny yeah, I'll in any case be doing #2. will think about calibration curves. I kinda hoped I could compare my Brier with others but doesn't seem likely (don't know of anyone with >1 or 2 falsifiable forecasts) - maybe next year :) @Hernandez_Danny @superforecaster (/I would want them to explain their reasoning, too) @Hernandez_Danny @superforecaster thanks - I'm prob. going to delegate some to people where it's not clear, and/or give a range of possible scores given different determinations. didn't pick/name those people in advance, though, but they'll clearly be relevant experts. RT @BrundageBot: arXiv papers, December 18, 2017: @Hernandez_Danny (more precisely, I'm omitting the unresolvable ones and counting "almost right" as fully wrong/almost wrong as fully right) @Hernandez_Danny P.S. @Hernandez_Danny is there a standard way of dealing with unresolvable or "almost" right forecasts? I'm currently just omitting them. @Hernandez_Danny But roughly, I think I overestimated prog. in speech recognition and transfer learning, was close to right about DL+StarCraft, right about Atari (esp. in light of Rainbow and Ape-X), Alphago, and Labyrinth. To be continued :) Hope others will make falsifiable forecasts next year. @Hernandez_Danny Will prob. write a blog post in a few weeks about how my 2017 forecasts fared (still some time for me to be proven right/wrong about a few :) ) but I think my Brier score will be ~.45+/-.1...depends how you resolve some things. Surprised to not find an easy Brier score calculator online, though didn't look all that hard. Fortunately, not too hard to do manually with small # of predictions. CC @Hernandez_Danny @polynoamial congrats! RT @polynoamial: We just published the details of our Libratus poker AI in Science! https://t.co/LZzw9lWYDV The AlphaGo movie is in fact very good. Nostalgic about watching the livestreams, fun times! Good discussion of neural style transfer https://t.co/9Lld5PveQV """AI2-THOR: An Interactive 3D Environment for Visual AI,"" Kolve et al.: https://t.co/mgly2MXdph https://t.co/ZLzY9TSXoL" """Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoning,"" Chen et al.: https://t.co/gk4bKIbrwX Like BadNets but without knowledge/control of the model being attacked." "Safe Policy Search with Gaussian Process Models," Polymenakos et al.: https://t.co/7BAQReDuBd "Uxbridge - an actual town Oxbridge - an idea (Oxford+Cambridge=breeding ground for the ruling elites) Took me a while to get that" RT @tdietterich: The NIPS Foundation has posted a "Statement on inappropriate behavior" at #NIPS2017. See https://t.co/HsIQq9v54c @tetisheri @Apple Bluetooth too @chrisalbon if you're in an epic mood, @iamtrask shared this a bit back https://t.co/B1JXK93qcH "Hate crimes against L.G.B.T.Q. people went up 20 percent in 2016 in nine metropolitan areas, a rise that several studies attributed to last year’s hate-filled election campaign. Last year also saw the highest number of violent L.G.B.T.Q. deaths on record" https://t.co/Gn4pKo05sD @goodfellow_ian good point, I was at some point but then ran out and forgot to get more/lost the habit... and yes, Swedes/Canadians/Alaskans/etc. I know it's not *that* bad. "It's too cold and dark in Oxford right now, worse than last year I think :( SAD!* *https://t.co/fHrDBppe1A" @IntuitMachine Correct :) https://t.co/KCHIszoAak "RT @nikitab: For contrast, how to write a non-apology: 1. What I did may have been construed as wrong though through no fault of my own 2.…" Obviously Monday night, since that's when the most arXiv papers are released. https://t.co/9xgT6dFjfT "I'm writing* a Being John Malkovich/Kafka/Asimov-inspired sci-fi novel in which one of my hobbies was automated by a bot on a social media platform, and then a parody account of me springs up, and a big fraction of posts in my feed is from some version of myself. *living in" I swear, this isn't me :) (I am an author on that paper, though) https://t.co/NSXVtLcJz1 "RT @BoredMiles: URGENT READ: Massive breakthrough in AI safety!! ""On the Impossibility of Supersized Machines"" - https://t.co/kv5A30paNp" "RT @BoredMiles: Probably the most important paper you'll read this year... ""Stopping GAN Violence: Generative Unadversarial Networks"" - ht…" @MattLevinson apparently... 🧐 https://t.co/6qha7BtFeZ @BoredMiles please DM me with the correct answer or I'm calling the Turing Police @rohitguptahpf seems plausible @BoredMiles 😑 @rohitguptahpf certainly there are some places (e.g. deep south) where even mentioning clear abuses like that would cause some to characterize you as anti-American etc. but I'd be surprised if either were controversial in the Bay... ? @BoredMiles is that Tim @rohitguptahpf hmm. yeah, maybe it's a red state/blue state thing, but I think that has changed somewhat since the Iraq War, more isolationist/libertarian sentiments in the Republican party these days. Maybe also a tone thing ("disrespect" for military vs. "this is a bad strategy") @BoredMiles omg who are you @rohitguptahpf huh, maybe we're in quite different social circles, cuz I think of "bad things about the military" as not being taboo...though maybe you mean something specific. Broadly agree with Anil that much of this is stuff that should actually be stigmatized (e.g. transphobic/racist/classist stuff and ignorant views like "perhaps all the women who want to be engineers ARE engineers"). Notably, most about politics/sex/race etc., not novel physics. "Interesting that purportedly silenced views run gamut from right to left (+other dimensions). Not a v. rigorous/representative survey, though, so distribution unclear. Warning: some nasty stuff, including on LGBT issues. https://t.co/MN5RKZlczD" @juliagalef @anildash @jasoncrawford +1 to that not being obvious RT @nytimesworld: British fruit left to rot in fields because no E.U. migrants are there to pick them https://t.co/7sDrqU4ldH RT @anildash: Though I think it misrepresents my comments in the introduction, an interesting exercise in what some in Silicon Valley think… @tarinziyaee tough one :) for fiction, definitely Three Body Problem and its sequels. non-fiction is tougher - probably Security Engineering (textbook) or The Heavens and the Earth: A Political History of the Space Age (not quite done with that one - love it though) RT @mark_riedl: No need to ever make graphics for AI press stories ever again #StyleTransfer https://t.co/fRN8DZgv4A RT @tomdale: This is uncomfortable, but it’s possible we have to allow people to wear not one but two neon polo shirts if we want them to b… RT @ThingsWork: This is the scale of living things on earth https://t.co/CGYDffa9ea Great stuff from @ch402 et al. - we need more people who put in the effort to explain things clearly like this (in AI and in the world more generally). https://t.co/b6ZStl5SMt @pstAsiatech interesting that this is still *much* lower than in Western countries (often hundreds of k in dollars). wonder if that will change, or how much lower cost of living affects things. RT @biannagolodryga: “purchase appears to be 1 of several extravagant acquisitions — including a $500 m yacht & a $450 m da Vinci painting… @mbrendan1 interesting, thanks! That's for production, not training, I assume? Seems like a lot. @NoPtrException and I don't take many notes but when I do, they're by topic (documents or empty file folders with the title as the note, inside the topical paper folder) rather than by paper @NoPtrException I don't have a very good system for this. Roughly there's a hierarchy from unread/high urgency to read/low urgency (though some exceptions to this) where unread/high urgency = open PDFs, read/low urgency is in folders by topic, and medium = minimized PDFs Hyperbarometer search https://t.co/kH8uImGFrK @PatrickOmid yeah I could imagine FB > RankBrain... have heard about lots of *local* China surveillance but dunno if there's anything nation-wide that might count. @ciphergoth thought that wasn't out yet? @gringomochilero Interesting, hadn’t thought of autocorrect. Would expect it’s pretty computationally cheap per use but maybe makes up for that in volume (vs e.g. translation) Other semi-random guesses: Google/Baidu/etc. machine translation, Baidu search, some companies' speech recognition, Facebook image classification... By big I meant in FLOPs but other metrics could be parameters, number of users, inferences per day, etc. What's the biggest deployed deep learning system? I'd guess the RankBrain portion of Google search. (and yes, I asked this a while ago - it was helpful!) What's the best book you've read lately? The light at the end of the PDF tunnel... https://t.co/hro4DXsU4h RT @RonDMoore: Excited to be working on this with Maril and Matt Wolpert & Ben Nadivi - can’t say much except it’s super cool! https://t.co… RT @red_abebe: Really exciting to see Charles Onu's work featured here! He gave an incredible talk at the #BlackinAI workshop at #NIPS! htt… Reminds me of the "CorpSeCorps" corporate security organizations in Atwood's MaddAddam trilogy... https://t.co/FyHLjMQZqi @xuhulk Per their “Face ID Security” doc, probability of random person unlocking is 1 in million, presumably much higher for same gender etc. so should expect some stories like this even race-neutral. Also says “representative” users used to train it, including diverse ethnicities... RT @sindero: A few folks asked, and so here’s a transcript of the talk I gave at the @black_in_ai workshop dinner at #NIPS2017. Thanks agai… @gokstudio @kinggary @DeepMindAI yes, this is also a useful public resource (though I suspect by commercial version/reproducibility, King meant something like a full system you can play arbitrary games against, not just cached games/move evaluations). @kinggary @DeepMindAI Commercial or free web interface version is in principle possible; though I think they may have said they won’t do that for diff reasons (not sure). Free seems unlikely bc demand would get very big. @kinggary @DeepMindAI I’m pretty sure they’ve said before that they don’t intend to publish AlphaGo (+ later iteration) code since it’s too intricately intertwined with proprietary code. Compute requirements are also so big that it’s unlikely anyone would reproduce it. Transfer Yearning RT @KloudStrife: In case anyone was starved for deep learning content, I've compiled a list of ~20+ papers of the year : https://t.co/u3snc… @rcalo 🤔🧐 RT @wimlds: Bloomberg has published the first article on the allegations of sexual misconduct in the Bayesian Stats/ML community. https://t… Going through old photos for unrelated reasons and found this from NIPS 2015... 🤖📈 https://t.co/phTWPeNctO RT @sarahbouchat: .@CDC gets list of forbidden words: fetus, #transgender, #diversity https://t.co/RnWmJCcYOs @girishsastry @gwern @sama The overhead is pretty huge (5-1000x per Jeff Dean) so abstractly, problems where early performance is a strong signal of late performance (so can stop training quickly - --> not hard exploration probs?), or simple-ish environments, maybe? Good question, those are just guesses. RT @BrundageBot: Online Learning with Gated Linear Networks. Veness, Lattimore, Bhoopchand, Grabska-Barwinska, Mattern, and Toth https://t.… The new Star Wars is good. RT @negar_rz: Our "Deep Prior" paper is out now! https://t.co/AwgYJpH5oo RIP. https://t.co/IFp9Vff2GA omg the stretching one https://t.co/ReiGZ8wyl1 Brundage Bot Ent courtesy of @mark_riedl https://t.co/GRTVB9VMyf @mark_riedl nice :) thanks! @davegershgorn Dat journalism: "He told Wired this week:" https://t.co/YvFV7cfPB8 @mark_riedl request: https://t.co/QPtSf8WVpr @davegershgorn You sure he wasn’t there? https://t.co/JlEDCRq6y7 @Davidramli oh then chip goes back to NVIDIA for distribution... yeah that gets weird, forgot about that part @Davidramli Why incestuous? I meant something like: (great-great) NVIDIA design goes to TSMC (great), TSMC makes chip (parent) which runs AI (child) (not proud of this) System 1/2 fail: the symbol on the Twitter hashtag for net neutrality stresses me out more than the actual decision. ICYMI: this is very good! https://t.co/6NPQZsgHbL On that line of thinking, NVIDIA (among others) is the great-great-grandparent. @MrMeritology for, among other fabless companies, NVIDIA @MrMeritology yep (TSMC-->chip-->you-->AI) RT @BrundageBot: arXiv papers, December 15, 2017: Taiwan Semiconductor Manufacturing Company (your AI systems' great-grandparent...) will spend around 20 billion on their next big fab. https://t.co/kVaMTLhfHS Simple app running in the background mines cryptocurrency and donates it to get people accused of misdemeanors out of jail (info from Bronx Freedom Fund, where the money goes). https://t.co/cjiRgyrtFb https://t.co/CNZIYlnbCj RT @colinraffel: New paper with Chung-Cheng Chiu: Monotonic Chunkwise Attention (MoChA), an online/linear-time attention mechanism which co… "Evolving Unsupervised Deep Neural Networks for Learning Meaningful Representations," Sun et al., Sichuan U./Oklahoma State: https://t.co/vNZ39ci85h "MentorNet: Regularizing Very Deep Neural Networks on Corrupted Labels," Jiang et al., Google/Stanford: https://t.co/HqsNDJMZpP nice results @negar_rz @DavidSKrueger Canada's not messing around! 🇨🇦🤖 "Deep Prior," Lacoste et al. (inc. @negar_rz and @DavidSKrueger), Element AI - from NIPS workshop on Bayesian DL: https://t.co/18ttACsulN @jackclarkSF @EBKania 🤖📈❓ """Learning Compact Recurrent Neural Networks with Block-Term Tensor Decomposition,"" Ye et al.: https://t.co/cW7NLLhj7V ""BT-LSTM utilizes 17,388 times fewer parameters than the standard LSTM to achieve an accuracy improvement over 15.6\% in the Action Recognition task on...UCF11""" @deliprao :( @EBKania Has there been any additional info on the Baidu-govt lab and how that fits into the plan? Also, I have decided I am okay with the fact that I overuse emojis 🤷🏼‍♂️ RT @EBKania: So, the proliferation of AI-related plans is continuing! Here's my latest tabulation of all (I think?) of the relevant nationa… Expedition with Future of Humanity Institute colleagues tomorrow to learn about humanity’s distant past. Anyone else seeing Star Wars? 📽 @EBKania sounds interesting! @EBKania Just in the past month, I've found her stuff on political control and AI in China especially interesting https://t.co/gPQ6twtHpK (and part 2 https://t.co/S9MtP9grTG) but there are a bajillion others I have no idea how @EBKania writes so much but I'm glad she does :) https://t.co/sLsy6kiQKh RT @mustafasuleymn: Really great talk by @katecrawford at @AINowInstitute - Essential one to watch for anyone working on or interested in A… @PatrickOmid @ohthatkristen just finished season 1. "Me: OK, time to write some dissertation stuff tonight. Also me: it's really urgent that I know what happens to Jamie and Claire on Outlander and read all the latest Distill articles. https://t.co/f0YrwkuWoe" @azeem @gwern @sama haven't gotten around to Scale but like West's papers. good summary of the Reenen et al. paper: https://t.co/MDMJUR9eOH @azeem @gwern @sama Well to be fair, it was not the focus of his post/argued for at length. But glad you liked the points :) @gwern @sama Fin. @gwern Spurred by this from @sama in a blog post (https://t.co/d9JxE7tKcg). I also don't think exponential growth in researchers will help that much, given diminishing returns to scientific effort (see https://t.co/4FAUBxZRuH) and near-term saturation in % of total researchers. https://t.co/ZF2UraQMs8 I suspect latter is more important than former, though. See @gwern on comp. complexity and AI https://t.co/nNZiamhzJ2 - approximations, other stuff can help a lot, and AI algos increasingly parallelizable. But harder to get people to come up with great ideas to try super fast. Re: hardware + AI progress, it's def. a big contributor, but exponential hardware growth doesn't = exponential algorithmic progress, both b/c 1. combinatorial explosions and 2. (generalized) Amdahl's law - human intuition building can't be sped up arbitrarily, becomes bottleneck. "When deep space exploration ramps up, it'll be the corporations that name everything - the IBM Stellar Sphere, the Microsoft Galaxy, Planet Starbucks..." https://t.co/CkfdZ4optF @timhwang @starsandrobots when is the ICO? Underrated paper - "Deep Learning Scaling is Predictable, Empirically," Hestness et al.: https://t.co/wWim0MEebh RT @KerrieMengersen: As ISBA President and on behalf of the Executive: ISBA is taking this report very seriously. We are establishing proto… @Azaliamirh Thanks for sharing! I was sorry to have missed your talk and it's great to at least be able to check out the slides. RT @Azaliamirh: Slides for RL-based device placement and other talks at NIPS “DL at SC Scale” workshop are now available: https://t.co/gEyC… RT @sundarpichai: @UTAustin @NASAKepler 2/2 So excited to share 2 newly-discovered planets ID’d by Google AI models: Kepler-80 g, and Keple… RT @sundarpichai: 1/2 Google AI working w/ @UTAustin used machine learning to look for exoplanets in @NASAKepler data. Our models were trai… RT @AndrewYNg: Announcing my new company! Landing.ai will help companies transform for the AI era. We’re starting with the manufacturing in… RT @oxbotica: We're now hiring graduate autonomous vehicle engineers! https://t.co/oIYgQN45zO #jobs #oxford #autonomous #roboticsjobs #robo… RT @mark_riedl: All AI/ML conferences should adopt clear codes of conduct. AAAI's @AIIDEconference did so this year. RT @mark_riedl: AI, ML, math, and stats needs to clean house of abusers. Academic and industry. #MeTooPhD RT @JeffDean: Read the accounts of what Kristian Lum described, and if you see such behavior in your own workplace or conferences, speak up… RT @abigail_e_see: Kristian Lum is courageous to describe the appalling behaviours at ML conferences that led her to leave the field. https… Headline from 2018 (19?). Dunno, but don’t see this ending well... "Barely Understanding Bitcoin, Buyer Loses Everything" """Comparing deep neural networks against humans: object recognition when the signal gets weaker,"" Geirhos et al.: https://t.co/xO2Ncey57Q 🧐more robust than🤖" @mapc CS arXiv has been a bit slimy lately... as in literal papers about slime molds. RT @katecrawford: My NIPS talk 'The Trouble with Bias' is now up on the 'tubes. About the politics of classification, and limits of focusin… @notmisha @ngutten super interesting, thanks! @dennybritz Yep. Demis made a related point in his remarks at NIPS and I totally agree. Humans draw on the *equivalent* of a huge amount of game time, through reading, tutoring, etc. @dennybritz I don't think we disagree. My point could be rephrased in your terms as "the wall time is important from a practical perspective (suggestive re: rapid automation of economically-relevant tasks, potential future rapid AI development, etc.); game time more impt from scientific POV" @generuso it's definitely impressive, though I'm not sure if I consider that modest for this domain. maybe! To be clear, I think the AlphaZero paper and related papers are algorithmically interesting in their own right, even if you ignore the "few hours" thing. I'm just commenting on the latter. RT @demishassabis: If you play chess, you'll like this highlights reel from IM @DanielRensch. really demonstrates the unique playing style… ...and when we have the right algorithms, more commercially relevant/realistic tasks will also be learned insanely fast. "AlphaZero becoming superhuman at chess etc in a few hours isn't interesting b/c it was efficient in terms of game-time (it wasn't efficient/RL will no doubt get more efficient in the future)... It's interesting as additional evidence that computers are insanely fast these days.." RT @JohnDanaher: New paper - The rise of the robots and the crisis of moral patiency https://t.co/984d9H1X60 https://t.co/nzxPRPJBeI @zacharylipton congrats!! RT @tdietterich: .@katecrawford makes many very important points. Here is my attempt to translate some of them into engineering terminology… @nsaphra Haha did not occur to me. @nsaphra A+ gif btw @beaucronin Batshit how specifically @EmmanuelAmeisen awesome, thanks! :) @saruftw @goodfellow_ian @FHIOxford Feel free to shoot an email to the address listed there with questions about eligibility. I am not sure how strict that part is. Cc @pomarius85 Also added some of my own observations to the thread. too many workshops simultaneously? think people's interests in diff. workshops are correlated, hard to parallelize but maybe could be done better (3 days?); discussions generally>talks, in part b/c talks often on old material (not unique to NIPS); those are some of the main ones. ...out in force, but changing composition (^ China, hedge funds mostly gave up up); successful WIML/Black in AI events (from what I heard - plan to participate in the future!); + lots of disagreement around pace of AI progress (consistent w/ NIPS surveys https://t.co/VVtluIHBQL) Some brief observations from me on NIPS - lots of discussion of hardware as an accelerant of AI; mainstreaming of AI safety lingo/topics (e.g. Pieter Abbeel keynote shoutout to value alignment); great turnout for/discussion spurred by Crawford keynote on bias; recruiters still.. Unless I see something better, I'm just going to incrementally add stuff/encourage others to add stuff to this thread as they're pointed out to me, so it can serve as that collection. https://t.co/ZI01RYR7JQ @logangraham @AdrianoCarmezim Going to just make this thread a repository of NIPS stuff unless I find a better resource. Other stuff: 1. @decodyng's 4 blog posts (most recent ones on this list as of now): https://t.co/5dh1RQHsRX, 2. miscellaneous people commenting on Reddit: https://t.co/wzb7VFP13C @logangraham @AdrianoCarmezim I have not, thanks! @nirsd @goodfellow_ian @FHIOxford That is not required, it's just desirable as China is an increasingly big player in AI policy. Maybe the page could be clearer on this point; thanks for asking. CC @pomarius85 @FHIOxford These are paid, btw! 🤖❓💷 Reminder that @FHIOxford is still looking for interns in AI safety + RL (https://t.co/c632LPSI30) and policy/governance (https://t.co/EZXmP37WVq). Especially looking for candidates from underrepresented demographic groups, and people who are available at times other than summer. @AdrianoCarmezim I have! Agreed, super helpful. I'm sure there's other stuff I'm missing, though. Are all the NIPS takeaways/summaries/notes collected somewhere? @timhwang See also Sessions Coffee, designed to help cope with bad attorneys general without creating undue anxiety/jitters (same formula) @timhwang Half caf is a thing, straightforward to do quarter caf... Winter Considered Harmful Great stuff from @vkrakovna as usual! I like the specification problems vs. robustness problems distinction discussed there and also in the AI safety gridworlds paper (https://t.co/kW7D1jtwfJ). https://t.co/WVS9PHIwoY RT @vkrakovna: The slides and video for my talk on Interpretability for AI Safety are now posted on the #NIPS2017 Interpretable ML symposiu… RT @samswey: Alabama’s 1.3 million black residents shouldn’t have to turn out in unprecedented numbers, fight deliberate voter suppression,… @jeremyphoward @JeffDean @arxiv_org @yddt @BrundageBot Almost ;) think there’s still room for improvement. See: https://t.co/czSvzahhhH @Smerity 🤖 "Really proud of Americans coming together tonight to see through the misinformation... I'm talking, of course, about Bagnall et al., ""Training Ensembles to Detect Adversarial Examples"": https://t.co/0WJ3i3ndnB" RT @chrislhayes: Congrats to two-shirted strategic genius Steve Bannon who deftly maneuvered the GOP into a crushing senate loss IN ALABAMA RT @zara915: No matter what happens tonight, never forget that black women tried to save us every. fucking. time. https://t.co/XMe1YMXiLc RT @passantino: AP CALLS IT FOR JONES Jk I’m bad at sleep. @MatthewGuz It’s also almost 3 am here... I've stayed up all night for enough sex offender vs. decent person elections lately, sitting this one out. Outlander time. Good night! RT @BrundageBot: arXiv papers, December 13, 2017: "Cavs: A Vertex-centric Programming Interface for Dynamic Neural Networks," Zhang and Xu et al.: https://t.co/2MMDoTC9Ws Some stuff from the paper... https://t.co/cRzhGX2zQX "Logo Synthesis and Manipulation with Clustered Generative Adversarial Networks," Sage et al.: https://t.co/0ryPoYLalQ code/data/models will be available eventually but not yet. :( Wanted to make some logos. "Concept Formation and Dynamics of Repeated Inference in Deep Generative Models," Nagano et al.: https://t.co/OboI13fMWa "Data Distillation: Towards Omni-Supervised Learning," Radosavovic et al., FAIR: https://t.co/CosK0abQXQ "Lessons from a few episodes of Outlander: -Scottish accents>English accents -anything Ron Moore makes is good -that’s about it" @Smerity @Twitter @reddit maybe partly b/c of more widespread pseudo-anonymity? @Smerity @Twitter @reddit Reddit is a hive of scum and villainy. Even moreso than twitter :/ "RT @drepurse: Happening in AL 1. 3 ID checks at polling places 2. 90 min waits in predominantly af-am precincts and no wait at white ones…" One talk I especially enjoyed at NIPS was @sg175 on BadNets (for those who missed the paper: https://t.co/wXVKCrlCl1) and other issues related to adversaries training NNs (not to be confused with adversarial training :) ). Most work to date is on inference-time attacks, it seems. @gwern @BrundageBot Yeah maybe I’ll help Brundage Bot fill out the application. RT @lukeprog: Attractive job opening at MIRI: basically, read interesting ML papers, all day every day. https://t.co/7h6YynUa8Z Read the bill and I guess the Commerce thing is OK (it will be housed there but have a broader mandate/membership within gov't) but still kind of a lax approach - report back in 2019? You know things are moving fast + there's a huge body of work on all the issues covered, right? @Smerity Great post, and sorry to have missed you! Pretty sure I saw you at lunch but you were in the middle of something :) Next year! RT @Smerity: Bias is not just in our datasets, it's in our conferences and community. It won't be solved by a singular champion, no matter… @Albozdroid @obama yes, good point. Bad immigration policy did not start yesterday, though def. going in wrong direction. Not a bad idea, but if you're going to do this at Commerce, should do it many other places, too. Would rather see a new, more overarching body, or OSTP made great again. https://t.co/0ssdb90fqa RT @pstAsiatech: New Senate bill from @SenatorCantwell requests that Commerce Department establish Federal Advisory Committee on the Develo… @davegershgorn in other words, it was nice to see you :) @davegershgorn you're just jealous you were at NIPS instead of getting this killer scoop Insanely detailed notes from the great David Abel. See also higher level blog post: https://t.co/QhnGbE7dum https://t.co/CYw2E8x7vi @JohnDanaher (actually, my views on the key variables [humans!] are pretty clear, it's the attitude/forecast that's unclear) @JohnDanaher Fun chat! Hopefully the podcast/paper will come out around the same time as my paper on malicious uses of AI so people are sufficiently confused about my views (I'm also confused). RT @agibsonccc: My 240 dgx cluster in china agrees with this. https://t.co/eQ8KeN5Ksd RT @ankurhandos: no end to indoor scene simulators for RL https://t.co/TanR6A1PkG RT @hardmaru: Neural Pigs https://t.co/o8HSVnaapq @mapc I'll prob. be around in January :) "Robust Deep Reinforcement Learning with Adversarial Attacks," Pattanaik et al.: https://t.co/AXSQjS31fe "Peephole: Predicting Network Performance Before Training," Deng et al.: https://t.co/tH5XAo0AB2 Look forward to chatting with @JohnDanaher tomorrow for a podcast about my new paper on the long-term potential upsides of AI. Paper should be out next month. RT @alexjc: I've been wrestling with the implications of this for a few days, since I was asked to comment on the story. This needs to be a… RT @alexjc: People often say that porn pushes the limits of any technology, but when it happens in your field it feels very uncomfortable..… @sknthla The sorts of figures people are throwing around (10-100x+ in few years) are way faster than Moore's Law for specific operations. @sknthla It's just because there's a market for it, and specialized stuff can be faster. Tons of startups (Graphcore, Cerebrus etc.) and big corps (Intel, Nvidia etc.) working on it. @sknthla For AI purposes, though, vs. general computing, things are accelerating way past Moore's Law in the next few years. @semiDL I'd like to avoid cloud if possible, seems to save money in the long run. Not aware of any GPUs that are remotely as cheap (100 bucks...?) but also haven't looked hard. "@AllTooHueman yeah, I'd def. prefer training, too. But it's ultra cheap compared to a GPU, and sometimes inference experiments* are actually painfully slow for me (e.g. WaveNet, denoising...). CC @semiDL *playing with random stuff" @semiDL could you say a bit more about why it's bad for my purposes? If it's (basically) a DSP that can run image/video stuff I want to run faster than CPU, that'd be cool...and cooler if it can do other stuff. Seems to only be good for inference, which is fine for just playing around with pretrained stuff. Speaking of hardware, has anyone used the Movidius Neural Compute Stick? Seems like a nice low end option for a plebe like me who uses a CPU for silly deep learning experiments (sad!). @semiDL please send me one and I'll train an RNN to write scary scifi stories about AI :P RT @xor: Love it when my record player and VCR use their constant surveillance to insult me https://t.co/5T7wgOxvF2 Again, that's without great new ideas, but obviously faster iteration of models will enable faster iteration of ideas, too. Lots of papers report training a single model in a day or a few days on a good GPU. With e.g. 100x performance/cost in a few years, could do *much* bigger model in a day, or try 100 full hyperparameter variations in a day (or the equivalent of way more with fancy PBT-type stuff). It's already possible to do face recognition at scale, but there are more computationally intensive video analyses that will 1. get better with scaled training, 2. be cheaply applied to larger numbers of cameras/datasets etc. with faster hardware. One subset of this scariness is that even without big new ideas, the next wave of hardware will make massive scale video analysis tractable, opening the door to much more invasive surveillance. https://t.co/97H2exeCJG @rubinovitz oh cuz you mentioned Hogwarts (?) @rubinovitz lol wait why? Home! Didn’t miss 100% of the snow-related prettiness (this isn’t bad by Florida standards) but it was apparently Hogwarts winter level pretty while I was gone. https://t.co/FJctdYvskU Nice posts on NIPS from @decodyng here: https://t.co/5dh1RQHsRX @decodyng Thanks for doing these posts! Also I can confirm @goodfellow_ian has a time turner. He is also impossibly responsive by email etc. relative to the volume he must receive. RT @AP: BREAKING: Pentagon says it will allow transgender people to enlist in the military beginning Jan. 1, despite Trump's opposition. Missed the pretty Oxford snow :( @pfau @marwinsegler Oh god, I just remembered there was also a Mandalay Bay connection. Something something orbs involved in the Las Vegas shooting. @pfau @marwinsegler Mine went like 10 steps beyond that. He saw an "orb" (/drone?) that turned into a 747. Oh, and he did security at NIPS, too. @pfau @marwinsegler This is the same Uber driver from yesterday, but it took a long flight to remember it. And/or I'm being deceived by orbs and actually on a military base, who knows. @marwinsegler @pfau Among other orb-level confabulations. @marwinsegler @pfau I also just remembered that he also described the movie Logan's Run at length, and his description was quite inaccurate. All the humans were actually robots, supposedly (they weren't). RT @KimZetter: Does anyone else find it concerning that @netflix is datamining subscriber viewing records for laughs? Makes you wonder what… @ankurhandos @markus_with_k told me about an old Schaal paper recently and I was impressed with how prescient it was. @ankurhandos Same issue but I’m also on my phone so not confident there is an issue @ankurhandos Link isn’t working? "Masterstroke*: there's a lot of uncertainty about the AI progress production function, which isn't that well explored (though cf. recent Baidu paper) *yes, I used a rhyming dictionary, and no, there's no good reason woke isn't the pinnacle" "Joke: hardware and data are all that matter in recent AI progress Woke: algorithms were really important, too Bespoke: the next wave of hardware plus recent/near-term algorithmic ideas will be 🔥🔥🔥" @gwern Yeah (to a side event, not NIPS proper AFAIK) RT @DeepMindAI: Explore how #AlphaGo rates thousands of the most popular opening moves from the recent history of Go using our new tool - A… Back in 🇬🇧 RT @JeffDean: I'm glad that we have people like Sara Sabour and Geoff Hinton in the Toronto office of @GoogleBrain. https://t.co/rMQlGeFUVF @Smerity A+ parentheses RT @BrundageBot: arXiv papers, December 11, 2017: RT @CBSNews: NEW: Women who have publicly accused President Trump of sexual harassment and assault will speak at a news conference, hosted… RT @ZekeJMiller: Inbox: Megyn Kelly will have an exclusive live sit-down interview on Monday, Dec. 11 with three women who have publicly ac… RT @RheeMor: Yearly reminder that even the greatest of minds have their moments. https://t.co/yv2tPiCKYV RT @mollycathwalsh: I met Roy Moore a few months ago for an interview, he grabbed my hand & pulled me in & said “aren’t you a pretty little… @generuso The “orb” in question turned into a full size plane "Tired: bad immigration policies Wired: slightly better ones to help science and tech Inspired: actually good immigration policies because it’s the right thing to do" RT @JeffDean: Current U.S. policies that make it hard or impossible for some of the most talented people in the world to enter this country… Just the thing one wants to hear while driving 70 mph on the highway. Other Uber driver: government has “orbs,” which are AI-controlled drones that shape shift. 😵 Uber driver in Long Beach: “You here with the geek squad?” “Did Elon end up making it?” @PatrickOmid Also what does not scalable mean in the context of hierarchical RL? @PatrickOmid What’s the issue with self play besides representation learning? OMG, please let it stay this way until I get back in 30ish hours... https://t.co/8bkwCgIDFy @mat_kelcey 1:36 am. Pshh. @mat_kelcey Have been before. RT @OpenAI: OpenAI's goals, the impact of more compute, and artificial general intelligence with @gdb: https://t.co/B4ywDeU6LF Thanks all for the tips! My ensemble model of Twitter folks suggests I should do some combination of Griffith Observatory, The Last Bookstore, and the Museum of Jurassic Technology tomorrow. Let me know if you want to join :) @Smerity 🤐 @Brett_Fujioka thanks! @Brett_Fujioka No particular itch. @interwound yes, there are good and bad versions of each of those types. definitely many (/most?) are bad. What's the best bookstore in LA? @interwound there are various kinds. some do what you described, others provide services whose essence is AI-y/not really doable without AI (e.g. large-scale video recognition or whatever), others are just researchers intending to get acqui-hired. @RichardSocher oh, wasn't aware of this, thanks! So many AI startups these days. 📈❓📉 Flight isn't until tomorrow night so let me know if any of you have ideas for things to do in the LA area tomorrow :) Great to see/meet a bunch of you at NIPS! @pfau @honglaklee @irinavlh @doristsao 🤔 @mjntendency Not everyone agrees FWIW. Talked to someone with a lot of expertise in this area and they did agree it could have been more fair, but didn’t think it’d change the outcome. @katyanna_q 😬 RT @vkrakovna: Gillian Hadfield on parallels between incomplete contracts and reward misspecification at #NIPS2017 Aligned AI workshop http… "RT @JeffDean: Slides from my talk in yesterday's ML Systems workshop are now up at https://t.co/cbCLDMqF3T #NIPS2017" @PatrickOmid -20 years, Schmidhuber did it in 1997 (Schmidhuber-Bot, 1997). RT @rubinovitz: Talk notes here https://t.co/7qZBZ5SAn5 Interesting low level RL ideas for moving away from simple reward functions (e.g. e… RT @vkrakovna: @goodfellow_ian: "The mixture of being very smart and being very dumb is probably the most dangerous thing about powerful AI… RT @vkrakovna: @goodfellow_ian on the challenges of value alignment at #NIPS2017 https://t.co/hEkCB6qjMb @rubinovitz Oh it’s like society in the loop AI @rubinovitz Closest thing I can think of is this paper by MIT Media Lab folks, but forgetting paper name. I’m getting too old for this @rubinovitz This is also something Paul has written about somewhere (autonomous corporations considered harmful) but forget where @rubinovitz Yeah; sadly, there isn’t a workshop on policy! "Excited to hear* Paul Christiano's talk on learning from human feedback today at 1:15 in the aligned AI workshop - his is one of the more interesting research directions in AI safety. *among MANY many other great talks, flagging based on high interestingness:well known ratio" RT @Snarik: Seen in the parking lot of #NIPS2017. https://t.co/IanAZtNtYr @jackclarkSF @geoffreyirving (assuming it was from Platt's talk) @jackclarkSF @geoffreyirving also, was this based on intuition or trend extrapolation? missed that part of the talk. RT @rubinovitz: Tweeting from #NIPS2017 Online Content Prioritization workshop this morning. Definitely not a popular workshop, and we're i… @L_badikho (though you should probably use a range of exploration levels in your questions :P) @L_badikho Exactly. It works for Atari! :) "I've narrowed down the number of workshops tomorrow that I want to attend (at least in part) to 7. I don't know how much lower that can go. I have a bot, but other measures might be needed. https://t.co/lBTPzqB3QE" RT @hardmaru: One Billion Drawings 🖍🙀 https://t.co/mXUQkp0f1K Desired: more coherent tweets "Tired: NIPS parties Wired: being tired Inspired: getting a good night's sleep" RT @mark_riedl: A GAN building an airplane in Minecraft. Blue is imagined target. White is actual construction. Work by one of my MS studen… @GarrulousGeoff @ankurhandos The Naked Sun? @mgubrud @EBKania in self-play-amenable, simulatable domains, compute is essentially converted into data. @mgubrud @EBKania Depends on domain/task IMO. Data helps a lot for some stuff like face recognition, natural language etc. but domains that can be simulated are more amenable to self-play and other approaches. And in general, things will get more data-efficient but unclear how fast. RT @DLeonhardt: Big new economic study, on the problem of "Lost Einsteins." Our extreme inequality is almost certainly denying us important… "RT @korymath: At #NIPS2017 panel: Question asker: ""bit of a meta-question here... Moderator: ""no problem"" Question asker ""... What.. are..…" RT @aharutyu: If still at #nips2017 tomorrow, and care about options, come see my talk at the hierarchical RL workshop at 11:30am :) @jekbradbury Thanks for this, saved me a lot of standing and craning my neck! RT @jekbradbury: .@jeffdean talk is standing room only here at the ML Systems Workshop with a livestream for overflow. Slides are up though… RT @awjuliani: Blog post out! https://t.co/0dYX3LlPE9 @ArtirKel Well the paper was just released! That’s new... @rubinovitz @ch402 said he’d be happy to talk :) @ArtirKel I do not but it’s similar to his common talks, just added some AlphaZero stuff RT @red_abebe: Black in AI workshop at PIKE BALLROOM at the Marriott Renaissance Long Beach Hotel at 1 PM! Come join the fun! #blackinai #N… "RT @vkrakovna: Allan Dafoe on failure modes of predicting the future at #NIPS2017: - Being overconfident that X will happen - Being overcon…" RT @NicolasPapernot: Inserting backdoors in neural networks: BadNets is the best attack paper at the ML security workshop #NIPS2017 https:/… @timhwang @willknight Next year: Brundage Bot and ML cake stickers 😬 the Miles bubble is going to pop soon (but the @BrundageBot era is just beginning)... https://t.co/OBhnMwWhsP @rubinovitz Cc @AdaptiveAgents @janleike @SmithaMilli @dhadfieldmenell @willknight @timhwang I can’t say I’m surprised lol RT @vkrakovna: Super excited for the #NIPS2017 Aligned AI workshop on Saturday! Great talks by @paulfchristiano, @janleike, Gillian Hadfiel… RT @rubinovitz: Please find me at #NIPS2017 if you are interested in the problems and solutions that come up when framing ai interpretabili… @hardmaru Hypothesis: as time progresses, the fraction of papers that Schmidhuber can claim some credit for directly through a 1990s paper or indirectly through a student asymptotically approaches 100% RT @boydgraber: Through today, I'm revealing the humans who will take on winning computer team at #nips2017 (5:45, 103AB): David Farris, m… "RT @jwangARK: TSMC will build a state of the art fab for $20 billion. Ten years ago, a state of the art fab costed $3 billion. Moore's Law…" @FlorinGogianu I could be wrong! there will at least be lots of tweets :) RT @Reza_Zadeh: Deep Learning Scaling is Predictable, Empirically. When tested across four machine learning domains: machine translation, l… @FlorinGogianu don’t know if any of the workshops are being streamed/if so, which ones or where. suspect most aren’t because heard journalists weren’t allowed. "RT @ericjang11: Excited for the workshop on ""robot learning in the real world"" tomorrow. https://t.co/Rug0w7BnF3 2 posters on semantic gras…" Until this is solved with self-play, I will use artisanal hand-crafted features like "starts after 10 am" and "I understand the title" Optimal Workshop Attendance Planning through Deep Reinforcement Learning just realized that's Saturday, not Friday....but I expect to be just as tired tomorrow night, too, so the point still stands. Hoping that some heroes will wake up early and tweet David Silver's talk at the HRL workshop 🤞 @nagaraj_arvind @Smerity @Tesla @shivon @karpathy @elonmusk @jekbradbury @RichardSocher @nealstephenson +1 RT @suchisaria: PhDs w/ training in social sciences are welcome; there will be opportunity for collaborative work with CS, stats and medica… RT @suchisaria: I’m looking for postdoc(s) w/ interest in explainable AI & healthcare. DM if interested. I’m at #nips2017 would love to mee… RT @saeedamenfx: Victoria Krakovna discussing AI safety problems #NIPS2017 https://t.co/uuV8yahdFi RT @andrewgwils: .@vkrakovna giving an awesome talk about interpretability for safe AI at the #nips2017 symposium on interpretable ML! http… "Holy moly Already TPUs, Graphcore, etc., now this Really wonder how this will all shake out Dunno What do you think Also Really Exhausted https://t.co/BCbwoHBWYI" RT @NicolasPapernot: Looking forward to the lineup of posters and speakers at the ML security workshop tomorrow! Join us in Shoreline #NIPS… @aaron_kif @josh_tobin_ it is definitely a common thing. I've personally seen him do it a few times. RT @BrundageBot: arXiv papers, December 7, 2017: RT @BrundageBot: arXiv papers, December 8, 2017: @aaron_kif @josh_tobin_ On that definition, this was an instance of reverse shmidhubering (no you didn’t do that first!) but maybe it’s normal schmidhubering under a generalised “adversarial Q+A” definition :) @aaron_kif @josh_tobin_ Something like: disputing the novelty of research and saying (rightly or wrongly) one accomplished the same thing a long time ago, often in Q+A @davegershgorn When you’re a star, they just let you do it @tarinziyaee There were a few related to whether comparisons were fair/claims of having done meta learning of x (learning quadratic function or something) were true but I missed the beginning of talk so didn’t follow it all RT @benhamner: It’s embarrassing and infuriating that some #NIPS2017 authors couldn’t get visas to present their work. USA should be leadin… Schmidhuber getting deep adversarial questions RT @elonmusk: @FortuneTech Do it RT @FortuneTech: Boeing CEO: We’re Going to Beat Elon Musk to Mars https://t.co/mmaqd9avsV https://t.co/XlbP82gh3w RT @mer__edith: If you haven't yet, go! Watch @katecrawford's brilliant talk on bias, classification, and the AI experiment raising the sta… "RT @coreylynch: We just open sourced Time Contrastive Networks (TCN). code: https://t.co/9Q1sSQXuNS data: https://t.co/dRcCowN8GX details:…" RT @michael_nielsen: New essay, with @shancarter, in @distillpub: "Using Artificial Intelligence to Augment Human Intelligence" https://t.c… @jackclarkSF Seen at NIPS parties (I'd assume): formerly conscious creatures intoxicated and able to enjoy but not remember their nights. Nice slide from @theophaneweber on the spectrum of modelyness. https://t.co/yruD2PPomu RT @KaiLashArul: Online Learning with Gated Linear Networks: https://t.co/aHaF6jJWV1 . Hot on the heels of the NIPS debate on rigour, a ver… RT @FHIOxford: FHI is hosting a lunch mixer on AI Safety at #NIPS2017 - Thursday 12.30 - Gladstone's Restaurant, 330 S Pine Ave - come join… @timhwang @jackclarkSF I approve!! 10/10 would distribute/vandalise with @jwangARK It is (somewhat) *generic* across games but each instance of it doesn't "generalize" across games... I'm nitpicky about this word choice :) anyway are you around? Would be nice to chat later RT @karpathy: Block-Sparse GPU Kernels release from OpenAI https://t.co/lzhxRV0Qlj Deep Ariel RT @theophaneweber: If you want to know more about our work on imagination-augmented agents, which blend model-free and model-based RL, I a… https://t.co/3XdvMKvrUU "2016: AlphaGo 2017: AlphaGo Zero 2017 (late): AlphaZero 2018: Undefined" RT @BrundageBot: arXiv papers, December 6, 2017: This is nothing compared to @BrundageBot, which uses 10^5,000 TPUs, btw. "AlphaZero used 5,000 TPUs for generating self-play data 🤖🤖🤖🤖🤖🤖🤖🤖🤖🤖🤖🤖🤖🤖🤖🤖🤖🤖" RT @chess24com: Now the era of computer chess engine programming also seems to be over: AlphaZero, developed by @DeepMindAI & @demishassabi… Trio of speech recognition-related papers from Google: "State-of-the-art Speech Rec w Seq2Seq Models": https://t.co/S2rrVTNfQS; "Improving the Perf of Online Neural Transducer Models": https://t.co/3ixUYt1JiD; "Minimum WER Training 4 Attn-based S2S Models" https://t.co/UIBgAXlqOD @katecrawford Great talk! "Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm," Silver, Hubert, and Schrittwieser et al., DeepMind: https://t.co/pXmKLong82 https://t.co/n9zT9T0ska RT @googlecloud: Cloud Video Intelligence is now GA, offering even deeper analysis of videos than before and can detect 20,000 labels. Lear… fixed link: https://t.co/iPmvZVLXUR "Generalized Grounding Graphs: A Probabilistic Framework for Understanding Grounded Commands," Kollar and Tellex et al.: https://t.co/Es6JWdMhVC @geoffreyirving @FHIOxford thanks for flagging this! cc @tanya_skas @timhwang @cigrainger with all this hype, it's clear taht Miles Winter is coming... @cigrainger cc @timhwang RT @vkrakovna: Come to the #NIPS2017 AI Safety lunch mixer on Thursday (12:30pm) hosted by @FHIOxford! Gladstone's Restaurant, 330 S Pine A… @ericjang11 @PatrickOmid Location? Or meetup location/time? @halhod @FHIOxford Would be great to have you - be sure to fill it out :) @FHIOxford will be hosting another lunch mixer on AI safety at NIPS this year - fill out this form if you want to join so we know how many to plan for! :) #NIPS2017 https://t.co/Gz47lNIMYf "RT @shivon: To friends attending NIPS: we'd like to invite you to our AI fireside chat and party! Starts at 7pm tonight. If you’d like to…" @PatrickOmid @ericjang11 that'd be great! @anandsriraman I think I heard that there was a livestream for part of it? Can't find it right now, but maybe look around on twitter for info on that... perhaps of interest to @KatjaGrace Name of the game this week: save some energy for the workshops. @feraldata cc @AnthroPunk "Deep Learning Scaling is Predictable, Empirically," Hestness et al., Baidu: https://t.co/wWim0MVP2P Upon close inspection of the schedule, NIPS will be 🔥🔥🔥 @ericjang11 would love to chat! @beaucronin it was fun! Not first time, but still a total of only a week or so so hardly an expert :) Nice Tsinghua/Harvard etc. AI event. Now back stateside for NIPS! @beaucronin Yeah. It picks up and Dark Forest is even/much better. Trilogy overall is very worth it. UK Mexican restaurants: hold my basmati rice. https://t.co/DmU1Rm7Jcx @SteveLiuVCU this is not my paper unfortunately, don’t know if they have made any code available Good experience this trip with 72 hour visa-free transit program in China - recommend folks who travel a lot consider it (need to be going to different countries before/after China among other rules). RT @hardmaru: You know AI is a bubble when Intel invites Flo Rida to perform at their NIPS party https://t.co/Psyqlt8vcl @tkasasagi thanks! :) Jet lag pending PEK->LAX soon ✈️ see lots of you tomorrow! Obligatory use of a bike sharing app in Beijing. https://t.co/Y2MYtIqvjI @hardmaru @BrundageBot yeah that was weird RT @BrundageBot: Improved Learning in Evolution Strategies via Sparser Inter-Agent Network Topologies. Adjodah et al. https://t.co/b6hk4YNl… RT @BrundageBot: Learning to Compose Skills. Sahni, Kumar, Tejani, and Isbell https://t.co/0J3Y6vwbot RT @BrundageBot: arXiv papers, December 1, 2017: RT @marcgbellemare: Releasing a new version of the ALE today with @cholodovskis! New games, modes, and difficulties -- lots of challenges f… "RT @pabbeel: NIPS Deep RL Symposium Schedule now available: https://t.co/a2UEG3v7lf includes over 70 contributed papers/posters, and invit…" RT @terahlyons: Going to #NIPS2017? Join us at the @PartnershipAI reception! https://t.co/gVSApBP2BR First AI Index report: https://t.co/K9uqLUSehj @tsimonite halving the gap in a few years seems fast to me :) Off to 🇨🇳 for a few days. See you on the other side at NIPS! 🤖 RT @ShaneLegg: If you're interested in AGI Safety, check out this new collection of grid worlds (blog+paper+code). While they are as simpl… RT @BrundageBot: arXiv papers, November 30, 2017: "End-to-End Optimization of Task-Oriented Dialogue Model with Deep Reinforcement Learning," Liu et al.: https://t.co/BmOf7NHjUw When you finish two papers in one night... https://t.co/XecNFOOpe4 RT @ICLR18: Please bear with us while tardy reviewers finish their tasks. We hope to get the reviews out by early next week. @davegershgorn @tsimonite please don’t let it be Sophia @AMP_SV and I would imagine Canada’s SkyNet would be very polite... @AMP_SV Not at the moment :) ... but it has historically - ITER (fusion), International Space Station, relying in part on IAEA on nukes, etc. (it isn’t there today - IMO claims that it’s behind or tied with China/Canada etc. are often overblown - but this is the trend) My hope is that we’ll find more cooperative approaches to AI than “winning the race” but right now the US is headed towards losing or, in a cooperative scenario, just not contributing much. See Mark’s thread: https://t.co/QmyMb3MUfu RT @jimwaterson: Britain First was struggling for UK media coverage until this morning, now this. https://t.co/hIWhf0ikAH RT @piersmorgan: Good morning, Mr President @realDonaldTrump - what the hell are you doing retweeting a bunch of unverified videos by Brita… @samim Sabour et al. ;) RT @polynoamial: Our paper "Safe and Nested Subgame Solving for Imperfect-Information Games" won BEST PAPER at #NIPS2017! The talk is at 2:… @L_badikho sounds good! :) @gwern (same order of mag. though) @gwern it's less than the evolving image classifiers paper. ~2*10^20 FLOPs of GAN experiments. https://t.co/CPIwSAh1Dh RT @gstsdn: "Finally, we did not find evidence that any of the tested algorithms consistently outperforms the original one." https://t.co/N… "Crossmodal Attentive Skill Learner," Omidshafiei et al.: https://t.co/QCdzLApUh4 "One-Shot Reinforcement Learning for Robot Navigation with Interactive Replay," Bruce et al.: https://t.co/BIzMlHOPh8 @katherinebailey yaaaaaaaas. Just finished this - highly recommended! Complete with Three Body Problem reference (which is also highly recommended :) ). https://t.co/6NPQZsgHbL @ericjang11 in any case, I'd def put SL well above RL in generalization, but maybe I'm too generous... hm. @ericjang11 (I agree with most/all of what you said, btw, the examples I mentioned are pretty trivial in terms of generalization still...I've been a bit underwhelmed with transfer this year) @ericjang11 thanks for the replies! :) to play devil's advocate, couldn't you say adversarial examples show the same thing in the supervised case? I found this demo especially impressive - pretty hard game (goal is to rescue the people): https://t.co/73zlzQHGVZ This paper is super impressive IMO. Very small amount of human data to build off of on a hard task. Not a panacea for efficient RL by any means (still not great without training a lot in simulation) but worth checking out. RT @Miles_Brundage: Among other fun things here, using just 5 human demonstrations (and without many modern DRL bells and whistles), DQfD a… @brettvalle @AMP_SV thanks! @brettvalle @AMP_SV how did you do that, though? sorry, missing something It's official: Christoph Waltz will play Schmidhuber in any film adaptation of his life and work. https://t.co/M2ht6axEhK (h/t @AMP_SV for inspiration) @AMP_SV https://t.co/M2ht6axEhK @AMP_SV I have an idea, just need to find the guy's name... @AMP_SV I'd guess it's him. @TwitterSupport Terminology-wise, I'm going with Deep Schmidhubering. @ericjang11 https://t.co/6LL7pQh4mq (+ a - at the end); https://t.co/fKx4GuDxhT (Ibid); https://t.co/elGf38MEMn; https://t.co/vVA8wGowex; https://t.co/ezOdyUg9qF; https://t.co/8Nq19lbKFR (2/2) @ericjang11 great post! Thanks for writing this. I wonder if weak/strong generalization in RL is more like getting there/hard, respectively, though? Lots of recent promising stuff. Some things that come to mind (1/2): @AMP_SV https://t.co/fKx4GuDxhT + a "-" @TwitterSupport I like that paper btw. (have to add the - manually to the URL - when are you going to fix that, @TwitterSupport?) Meta-(/Deep-?)Schidhubering: Schmidhubering a paper's references. https://t.co/fKx4GuDxhT- RT @maithra_raghu: A blogpost I wrote on our paper SVCCA, at #nips2017! With Justin Gilmer, @jasonyo @jaschasd -- hoping many people will t… "Ms. Sabour [CapsuleNet paper lead author] is an Iranian researcher who wound up in Toronto after the United States government denied her a visa to study computer vision at the University of Washington." https://t.co/FtEjbgEXAV RT @EBKania: I'm excited to share my report, "Battlefield Singularity: Artificial Intelligence, Military Revolution, and China’s Future Mil… Great blog post and paper! Also, it's Testbed Tuesday. https://t.co/PIqIYkdrka RT @_ambodi: It’s hard to miss #NIPS2017 just because I am an Iranian. I always thought politics should have a limit, but apparently not th… "RT @DeepMindAI: Using simple environments to illustrate technical AI safety problems. Read the blog: https://t.co/2XCK9aCcgY https://t.co/e…" RT @janleike: Our new paper with RL environments for AI safety problems: https://t.co/iIENC73OMg https://t.co/gJigJeqHQZ @samim have just the paper for you coming soon ;) (I have a soft spot for Alex Jones jokes) https://t.co/QhFhCNgtfd It's Tasteless Tuesday: if Alex Jones did the voiceover for Doom (2016). https://t.co/3MYWBKh96z @KaiLashArul @nickfrosst lol I hadn't read yet and thought you were kidding but nope. 👏 RT @BodegaBot: These two ex-Lyft founders want to replace Malaysian restaurants with tricorders RT @BodegaBot: These two ex-Palantir product managers want to replace automotive shops with mind uploading RT @BodegaBot: These two ex-Github interns want to replace Indian restaurants with optical computing RT @BodegaBot: These two ex-Airbnb product managers want to replace comedy clubs with wireless long-range electric shock weapons Me at the beginning and end of this project... https://t.co/nx8aiFwAvv RT @astro_pyotr: Supplementary examples, code for experiments, experimental setup, etc. can be found here: https://t.co/cn02FOA3OY RT @astro_pyotr: Excited to show off our new investigative paper from joint MILA/McGill dialogue group: "Ethical Challenges in Data-Driven… Nice video here - https://t.co/9C5cQwE165 good stair climbing skills. Pretty fast, though still no strobe required to see it. https://t.co/cYeod1i8Cl "Distilling a Neural Network Into a Soft Decision Tree," Frosst and Hinton: https://t.co/NidWXmaWcz RT @BrundageBot: arXiv papers, November 28, 2017: "AI Safety Gridworlds," @janleike et al., DeepMind: https://t.co/kW7D1jtwfJ Only 40 workers used for Labyrinth vs. 80 for Atari, though - might have pushed it over the top. Sad! This seems to resolve half of my superhuman (>120% human) Labyrinth forecast positively: mean of 150%, median just shy (115%). https://t.co/8inAROVXpQ @MichaelHBowling @DeepStackAI @sciencemagazine I was worried I had to pick between the two, phew. RT @MichaelHBowling: @DeepStackAI and Libratus in running for @sciencemagazine scientific breakthrough of the year. https://t.co/4cQSa9XIrK Look forward to hearing more about this from @maxjaderberg's talk at NIPS! https://t.co/8inAROVXpQ "RT @ddale8: At event ""honouring"" Native war heroes, the president: - Used term Natives see as a racist slur - Stood in front of portrait of…" RT @kylegriffin1: Here's the video: Trump calls Elizabeth Warren 'Pocahontas' while honoring Native American code talkers: "You were here l… @jackiesnow @davegershgorn I suspect @rivatez (organizer) isn’t too concerned about it but she can speak for herself :) @davegershgorn @jackiesnow it’s also a joke about the associated longstanding conference, NIPS, I assume @jackiesnow @davegershgorn yep @davegershgorn wasn’t referring to that specifically, there are parties every night @davegershgorn and of course keynotes, parties 🎉 etc @davegershgorn but really, the symposia should be great for pretty much everyone, lots of workshops too, depends on your interests which workshops/other stuff to see though @davegershgorn scooter/jetpack/hyperloop between sessions RT @zeynep: I’m hiring a postdoc to work with me on social implications of AI. Technical/CS background (especially within the ML cluster) p… RT @RogerGrosse: Theorem 2 of my moment averaging paper is one of the most surprising mathematical results I've seen in machine learning. T… Some interesting responses - https://t.co/TpYH2sHNL3 @tdietterich @diazf_acm I might also be missing stuff because I don't read many bandit papers (sorry :) ) @tdietterich thanks, good counterexample. @diazf_acm also mentioned MSFT publishing related stuff (not sure if he meant that specifically or something else/both) """Ethical Challenges in Data-Driven Dialogue Systems,"" Henderson et al.: https://t.co/5ln9YCzb9H covers ""bias, adversarial examples, privacy, safety, considerations for RL, and reproducibility""" "No Classification without Representation: Assessing Geodiversity Issues in Open Data Sets for the Developing World," Shankar et al., Google Brain: https://t.co/uldMcan8Ui """Action Branching Architectures for Deep Reinforcement Learning,"" Tavakoli et al.: https://t.co/icshSMgnIX Come for the figure, stay for the DRL research 👏👏👏👏 https://t.co/VICIdkDd3J" @alex_peys isn't that what arXiv is for? ;) @diazf_acm interesting, could you give an example - e.g. one comparable to this https://t.co/mmJMPwUfnh in terms of core business relevance? Better examples: https://t.co/jO4rPjyvB8 @insideNiMA good point, such a rate is plausible if you use other modalities - though the way it was characterized in the media was as pure face recognition maybe not the best example because it's a fairly researchy paper (QA that could be applied outside e-commerce) but there are other examples I've tweeted about before. I'm sure there are counter-examples, but generally speaking, one does not typically see e.g. Google/Amazon/Facebook etc. papers specifically on click through prediction/ads, but one does see that from several Chinese corps. "Interesting twist on the US/China AI situation is that unlike American companies, Alibaba* continues to publish AI papers on stuff core to their business, e-commerce: https://t.co/cRutYzz1ZR *+some others" RT @BrundageBot: arXiv papers, November 27, 2017: "New paper from them tonight (they have tons) https://t.co/3ExARUkx3C Good results but nothing like that figure, unless you count the target being in the top 20 as correct, then sure, 1/100 million is more plausible. But not top-1. Even iPhone w/ multimodal data is like 1/10,000" SenseTime is undoubtedly good at face recognition, but seems extraordinarily unlikely that the widely quoted "1/100 million error rate" is meaningful... https://t.co/TIsS6C1WMr Among other fun things here, using just 5 human demonstrations (and without many modern DRL bells and whistles), DQfD achieves state of the art performance on Montezuma's Revenge. Updated AAAI version of Hester et al., "Deep Q-learning from Demonstrations": https://t.co/BK4xnTLzQi @atg_abhishek I wasn't planning any others but off the top of my head, there's also Gorila :) https://t.co/Ih8xeynm66 Battle of the animal-named algorithms... Simple Neural AttentIve Learner (SNAIL) takes on Model-Agnostic Meta-Learning (MAML). https://t.co/MGnpUL1Qt1 RT @WiMLworkshop: @WiMLworkshop starts in 1 week!!!!! We have an amazing line up of speakers, contributed talks and mentors with the openin… Me seeing Sophia (robot "citizen") stories... https://t.co/IzM20hXIpT @jackclarkSF when is the nature/screens election @egflo first tweet I’ve seen with footnotes 👍 CC @iamtrask "Interesting approach to ML privacy from Dong et al.: https://t.co/SdlRlM3uAE ""we migrate the first layer of deep network to users' local devices, and apply the activation functions locally, and then use ""dropping activation output"" method to make the output non-invertible""" Cool paper from @maidylm et al. on user perceptions of privacy in intelligent personal assistants: https://t.co/wH1l25l4OL RT @zacharylipton: Good enough to get a grad degree at Stanford and an offer at Google but not good enough to get an H1B. What happened to… RT @adamjwhitedc: He gets worked up over Time Magazine's Man of the Year Award almost every year. Like clockwork. https://t.co/27TnDTguAD @guillefix nice, I had wanted the former feature but had never clicked on that little drop down thing! "RT @dandrezner: C’mon, that Tom Friedman column on MBS can’t be THAT bad. Let’s just take a lo— Oh. Oh God. Oh dear God in heaven. http…" RT @gosainnn: Calling @NipsConference attendees. NIPS ConvAI competition is looking for volunteer to converse with there bots. Check out: h… @rbhar90 series of posts here: https://t.co/1JFoFXBaIP RT @mbrendan1: DOE buying 35k Volta GPUs https://t.co/lGUkxFv42d RT @hardmaru: China's SenseTime plans to IPO and start research center in the US as early as 2018. https://t.co/PdJvRb5lJ0 https://t.co/m1Q… RT @feministabulous: tfw you realize trump respects turkeys more than women. https://t.co/OEmcxoXpGv RT @BrundageBot: arXiv papers, November 23, 2017: "AlignedReID: Surpassing Human-Level Performance in Person Re-Identification," Zhang Luo et al., Megvii: https://t.co/5g0M6LeY9X @PatrickOmid same RT @avdnoord: Introducing Parallel WaveNet, or how to generate 500,000 audio samples per second :). This is our generative Text-To-Speech m… RT @JaneMayerNYer: Thank you for recalling the supreme sacrifice of your predecessor, JFK, on this day, and the dignity, service and ideali… "RT @dmartosko: TODAY-- 8:01 -- White House tells press to expect a ""low-key day"" 8:07 -- White House instructs pool to clarify that the PRE…" RT @rivatez: lulz https://t.co/kphtBeOt6c When you have 280 characters but say "E" for election. https://t.co/NQQR5tXs6b RT @BrundageBot: arXiv papers, November 22, 2017: "Knowledge Concentration: Learning 100K Object Classifiers in a Single CNN," Gao et al.: https://t.co/uJ4RbPGr1u @PatrickOmid Dark Forest is even better! :) RT @collinsljas: (1/5) i still can’t believe that when you google ‘carol reiley’, who has an established career as a roboticist and is cofo… What about now? (I'm not, for the record, but wow, there are lots of must-see talks on the schedule) https://t.co/dxtEA3tesK RT @markus_with_k: It's again the time of the year when finance folks reach out to us poor ML researchers to offer salvation from academic… RT @graphcoreai: We're hiring #AI Engineers in Bristol, UK & Palo Alto, US to support customers - join our growing team https://t.co/MlF7KZ… RT @ericjang11: New blog post on Expressivity, Trainability, Generalization problems in Machine Learning, and why RL is still very unsolved… @michalwols I liked that one, too! RT @pstAsiatech: https://t.co/hlEmw0buil this one goes out to @timhwang - here's hoping that I might live up to him making a sticker of me instead of @BrundageBot ...and my favorite for today: "Learning to select computations," Lieder, Callaway, and Gul et al.: https://t.co/VTAGWRrS1X "FluidNets: Fast & Simple Resource-Constrained Structure Learning of Deep Networks," Gordon et al.: https://t.co/gKsIi1nFx1 "Excitation Backprop for RNNs," Bargal et al.: https://t.co/cYYQ6ShqIH "Generation and Consolidation of Recollections for Efficient Deep Lifelong Learning," Riemer et al.: https://t.co/2dnGwiQ6aU A handful of artisanal picks for today... "Leave no Trace: Learning to Reset for Safe and Autonomous Reinforcement Learning," Eysenbach et al.: https://t.co/OMJ6kJSqXu RT @BrundageBot: arXiv papers, November 21, 2017: RT @zacharylipton: ***Does mitigating ML's disparate impact require disparate treatment?*** New paper with Alex Chouldechova and Julian McA… @FlorinGogianu @amaub the arXiv gods have heard you - lots of RL today :) Editing and in the zone like https://t.co/j4qju1Qx2P @tetisheri I hear Stanford is $$$ RT @sleepinyourhat: Revisiting this: Has anyone had much luck with Zoneout outside language modeling? https://t.co/ATORv4AQhz @_dval_ @TheAnnaGat this I think? https://t.co/7DDNUGUiii RT @mer__edith: (Process note: the NYU application portal is a bit flaky. Do try to apply there, BUT know that if that doesn't go through,… "RT @mer__edith: ⏱️tick tick tick, it's the countdown!⏱️ The AI Now Postdoc application deadline is TOMORROW! ✨✨✨Bring it, brilliant people…" @FlorinGogianu @amaub I think it’s getting a good fraction of the ones available but there’s been a bit of an RL lull lately (perhaps bc much of past few months’ RL work is under ICLR review now) "RT @DrLukeOR: Our new paper: ""Detecting hip fractures with radiologist-level performance using deep neural networks"". 55,000 hip x-rays,…" perhaps relevant to @ylecun and @GaryMarcus’s interests "RT @OxfordTalks: Oxford! Here are the talks we're listing this week: https://t.co/An6DoNH94R #Oxford https://t.co/jFsZkbxex9" @yuvalmarton surprisingly strong indeed! part of why I tweeted it is in the hopes that someone more informed would tell me if it's a sketchy (or great) paper :) RT @katherinebailey: This was such an excellent talk by @AngeBassa on corporate data science at ODSC East 2017 https://t.co/pI32uRgOR5 RT @BrundageBot: Improving Palliative Care with Deep Learning. Avati, Jung, Harman, Downing, Ng, and Shah https://t.co/pF4p40YC0J RT @BrundageBot: VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection. Zhou and Tuzel https://t.co/uyf1d9EnSM RT @BrundageBot: Data-driven Planning via Imitation Learning. Choudhury, Bhardwaj, Arora, Kapoor, Ranade, Scherer, and Dey https://t.co/g9Y… RT @BrundageBot: arXiv papers, November 20, 2017: """3D Reconstruction of Incomplete Archaeological Objects Using a GAN,"" Hermoza and Sipiran: https://t.co/B0J8D8UB6T Ind-AI-na Jones https://t.co/5lFPeqCOha" "Question Asking as Program Generation," Rothe et al.: https://t.co/kjFH9RhzAJ """One Model for the Learning of Language,"" Yang and Piantadosi: https://t.co/7DDNUGUiii ""discover many of the key features of syntactic structures, including regular, context-free, and context-sensitive languages, using positive evidence only+a simple, unitary learning mechanism""" "Predict Responsibly: Increasing Fairness by Learning To Defer," Madras et al.: https://t.co/VkmPNrdniY What did you say about FDR, @JeffFlake? https://t.co/3hyLpTJxlh @BenedictEvans they don’t OS or publish everything, though a fair amount (agree w/ split up skepticism, just saying) "Screenwriter (probably): ""It's like Terminator..."" Producer: ""How is it different?"" Screenwriter: ""It has John Cusack."" h/t @romanyam https://t.co/AE1glh66U8" "RT @erikbryn: The US Department of Labor just released its 2018-2022 Strategic Plan. It was surprising and disappointed that AI, MachineL…" "RT @markus_with_k: Here are all the videos from #CoRL2017 from Vincent's mail! Day 1: https://t.co/mAqbqN1lBa Day 2: https://t.co/Tbpxvuvz…" @markus_with_k yay!! thanks! @markus_with_k ooh, thanks! That has Wednesday, not sure about Monday (they're unlisted vids so can't find via search) but Tues+Wed will keep me entertained for a while in any case :) @markus_with_k this is just day 2, right? Do you know about the other vids? RT @markus_with_k: The talks from #CoRL2017 are online. Many great talks, including our work on Reverse Curricula for RL and Mutual Alignme… @deliprao yeah I liked the candidness re: privacy/policy, technical catchup needed etc. @Zergylord reminds me of https://t.co/QFcHlfQTz7 RT @brianklaas: There is something seriously wrong with this man. He has a deep and pathological need for praise and an inability to behave… "The State of Artificial Intelligence in China," talk by @kaifulee: https://t.co/RTSS0VEUIj I'm shocked, shocked that a President who doesn't have a science advisor wouldn't want to meet with a bunch of other scientists. https://t.co/DC2jONX0sd RT @erwincoumans: OK, an initial pybullet simulation reinforcement learning environment for Atlas jump and flip: https://t.co/wHZlqBIk66 RT @SethAbramson: THANKS TRUMP https://t.co/WMrPLZYgu8 RT @tamikothiel: Many thanks to @kschwabable - for caring, and wanting to know! https://t.co/HvznQmFY7P @togelius ...which is especially fun in this case, because the paper is in part about authoritarianism... Beginning final edits with 20+ authors now... https://t.co/RCE0E4VBjf RT @SarahRoseCrook: You know how in disaster films there's always a lone male genius saying "THE VOLCANO IS GONNA BLOW" and no one believes… @samim ICYMI - https://t.co/ibd81gC3ZH RT @suchisaria: UAI 2017 Tutorial video on machine learning and counterfactual reasoning for personalization: https://t.co/7uLt6TmWcM https… RT @emmaroller: you think I’m joking but https://t.co/XPNKqHUVy7 RT @emmaroller: “raid a witch’s house and throw your bounty in an endangered clam shell” https://t.co/6AU0NJ3Jgv @tarinziyaee nice, will check out - thx! @tarinziyaee prob. would expect systems that are mostly learning-based (a la the DeepMind response) to excel eventually/beat out most hand crafted things but how much compute that takes is unclear @tarinziyaee I don't have super novel thoughts :) I tend to be impressed with what ppl continue to achieve w/o much in-built structure, but seems reasonable to learn from human/animal brains where possible to speed things up, esp. given compute limits @zacharylipton works for late years, but not early years when students (in some programs at least) are actually taking classes. The DeepMind submission is interesting, and there's a lot of other stuff worth reading, too. Target article seems similar to the original if you've read it, but responses and reply from authors are new. RT @Miles_Brundage: PDF from Lake's website here: https://t.co/C5iIMqxRHu https://t.co/E9zdIV6gHx RT @jongold: wow - love the press photos for the new Tesla truck @elonmusk — truly a vision of the future https://t.co/sje9Fn7Xsx "RT @erikbryn: This is now happening all over America. It is a dumb policy for the USA, and in the long run for the world. https://t.co/Xhs…" @semiDL which SC 17 presentation? RT @dennybritz: Meanwhile at university... relying solely on grad student descent #feelsbadman https://t.co/27zT3lSLQq @AMP_SV same, minus the barging (I’ll set up a tent overnight to get a seat :P) @generuso do you have a reference re TPUs? didnt see it there... RT @AndrewYNg: It's not right for PhD programs to be accessible only to rich families. The current US proposal to tax tuition forgiveness i… @amirhusain_tx and 100% agree re: Chinese ASIC investment etc. The TPU example (while IMO significant today) by no means assures a long term lead, just thinking people hearing only about HPC should know about that too (along with Intel etc.). @amirhusain_tx I think we’re in violent agreement on most of the facts/trends/policies :) I’d like to see those things happen, too. Just also want to avoid a “missile gap” type misreading of situation/defeatism. US still has strengths, should build on em. @amirhusain_tx yep, we’re on the same page about all of that. I think 4. is true though it doesn’t justify complacency (agree the others are false). @amirhusain_tx agreed. If current political/investment/tech trends continue, US will lose lead in most/all areas eventually. Just a matter of when/if it’s happened already/what to do :) Referring to stuff like this btw. Not saying traditional HPC unimportant, or China won’t surpass in other areas, just good to have well rounded view on hardware competitiveness. https://t.co/WSVuPGeXBY (notably, some benefit from hyping about China being ahead, so important to push back on overstated claims. And hopefully it won’t matter who “wins” on these metrics anyway b/c we should be cooperating) China is doing a lot of v. impressive stuff in both AI-relevant hardware and software, but I’ve noticed a tendency to grab onto specific benchmarks as signs China’s ahead when picture is more complex. "People (Americans) are freaking out a bit too much about China’s high performance computing stats IMO. Not all powerful compute is bundled together physically and called a supercomputer. TaihuLight=~10 of Google’s TPU Pods, each pretty small (though latter more specialized)." RT @DeepMind_Health: Want to join the DeepMind Health team? We're looking for Research Scientists and Research Engineers at https://t.co/Ms… RT @nonstrategic: Could a tweet spark a nuclear war? Maybe. But there are a lot of other ways the information ecosystem could affect crisis… Fun with Google Scholar (some results for searching Montezuma's Revenge)... https://t.co/eeTch3UHlN RT @permutans: read this one the other week, main paper is quite vague, supplement has details of the "marXbot robotic platform" https://t.… ⬇️ https://t.co/8jDMXzHA0m "Mergeable nervous systems for robots," Mathews et al.: https://t.co/QPzjdjsAli https://t.co/BZqXAYmuq4 @iamtrask literally what’s happening! "Congress: these Chinese investments in US companies are really scary. We’re losing our edge! Also Congress: Let’s utterly destroy American higher education." RT @DavidOAtkins: Good news white working class! Your taxes will go up, your Medicare will be cut and your kid's student loans will be more… RT @terahlyons: The @PartnershipAI hosted our first-ever Partner event in October in Berlin. On the last day, I sat down with @p_humm to gi… RT @elonmusk: Tesla Semi https://t.co/7VLz7F46Ji @deliprao yep! :) @gokstudio :( RT @dandrezner: 👇👇👇Director of Bring It On.👇👇👇 https://t.co/Zshvg97YdX RT @jesseengel: Happy to share my latest work: Improved VAE priors and satisfying user preferences with posthoc learned latent constraints.… I gather people aren't ready yet. https://t.co/7bg4yRzW6S The symposia (among other things) are going to be 🔥🔥🔥🔥 RT @markus_with_k: Rauber, Mutz and Schmidhuber generalise Hindsight Experience Replay. https://t.co/EU1JE4hI2k Who's ready for NIPS?? "Hindsight policy gradients," Rauber et al.: https://t.co/64OKqFd8ZJ I see where you got the "backflipping" part... https://t.co/PVdM8AHHhu RT @alexgkendall: Amazing new robot tricks from @BostonDynamics!! https://t.co/eO2dyrblP0 RT @pstAsiatech: Baidu expects China to lift ban on testing of driverless cars, adopt California-style regulations | South China Morning Po… @bradknox congrats! RT @bradknox: Big news regarding my startup Bots Alive / Emoters! https://t.co/UseqPtnc41 #robots #toys "RT @OpenAI: New baselines: - PPO2, a GPU-optimized version of PPO: https://t.co/YO524251nr - ACER, a sample-efficient policy gradient algo…" @primalpoly haha gotcha :) @tallinzen sure-dloo @primalpoly not cute https://t.co/R7StXOS8hr (/correlated with alt right/Trumpist trolls) @primalpoly if it’s a Pepe cartoon... @gwern @michael_nielsen see e.g. https://t.co/oK1Uo2YxTK and references to/from it RT @timnitGebru: Today, I joined 50+ technical experts to call on DHS to drop its “Extreme Vetting Initiative” - a plan to automatically fl… RT @Miles_Brundage: One intuitive idea for making a superintelligent AI safe is to have it just answer questions, but actually you could be… RT @diazf_acm: Today, I joined 50+ technical experts to call on DHS to drop its “Extreme Vetting Initiative” - a plan to automatically flag… RT @boredyannlecun: ***The Ivory Tower Can't Keep Ignoring Deep Learning!*** Don't leave it to the lobbyists! Don't wait for Google to hire… @zacharylipton @jekbradbury it’s @amaub’s doing :) https://t.co/znLoENOzUl RT @BrundageBot: arXiv papers, November 16, 2017: RT @evawxiao: Live stream of Baidu's AI conference in Beijing today (for those who want to tune in/can understand Mandarin): https://t.co/D… Looks like a helpful review - "Advances in Variational Inference," Zhang et al.: https://t.co/dwP82bvwg7 "Variational Adaptive-Newton Method for Explorative Learning," Khan et al.: https://t.co/LRMT1ijoDd @mattsiegel as with search engines/newsfeeds, there can be a fine line between informing and manipulating ;) "Interesting stuff on the comp. complexity of RNNs - ""Recurrent Neural Networks as Weighted Language Recognizers,"" Chen et al.: https://t.co/hr56MbFQUO ""Testing equivalence of RNNs + minimizing the number of neurons in an RNN are both undecidable,"" approximations needed" "One intuitive idea for making a superintelligent AI safe is to have it just answer questions, but actually you could be manipulated by the answers. New paper by my colleague, Stuart Armstrong, suggests two ways to salvage the oracle AI concept: https://t.co/I5hEOKjFiU" @rbhar90 @Aelkus see e.g. https://t.co/nNZiamhzJ2 also a talk on YouTube about this @goodfellow_ian great title! :) RT @goodfellow_ian: Thermometer encoding has closed most of the accuracy gap for strong, iterative white-box adversarial examples on SVHN.… @adropboxspace there were issues with Cornell's server. I think fixed now. The campaign to bring down academia continues (arXiv and Google Docs).... @jackclarkSF That’s why I stick to survey papers, don’t want to have to change my profile pic... RT @Miles_Brundage: We're still hiring for 2 AI safety research roles at @FHIOxford, along with 2 administrative/operations roles + interns… @calebwatney 2. seems like a prereq for (large impact of) 1, and broader, so I’d put it first... Peter Dayan is notable for developing Q-learning and a lot of neuroscience stuff, and having a very mean looking official photo. Holy moly indeed! https://t.co/UAy01C3yrf RT @ilyasut: Compared to other society-altering sciences (physics, bio), ML is by far the easiest to get started with. Requirements: comm… Being into AI makes the names Al Capone and Al Franken read a bit differently... "RT @iamtrask: DLPaper2Code: Auto-generation of Code from Deep Learning Research Papers Soon you won't even have to run experiments! Just w…" Sharknado: Gandalf Strikes Back in 3, 2... https://t.co/x6olUVPopi RT @OpenAI: Are you a programmer who wants to get into deep learning? Apply to our Machine Learning Fellow role: https://t.co/15Oatnkw2t RT @Mvandepanne: DeepLoco now running & walking with a full humanoid. #deepRL #BulletSimulation https://t.co/39RX9x8LZY @adschina strange that these are all existing already and private. So, govt will try to accelerate? RT @AINowInstitute: Today we officially launch the @AINowInstitute at NYU! Humbled to be the first university research institute focused on… "RT @egrefen: And now, for something a little different… https://t.co/CveDKIuKrp We show that robust, interpretable latent rules can be syn…" @paul_scharre my mom sent me this earlier and I was like, I know him! :) RT @jonfildes: Any visual designers out there who fancy coming to work with the awesome team @DeepMindAI? Apply here: https://t.co/KBmb3Ljw… RT @mat_kelcey: "Inverse Reward Design" https://t.co/uaFnvqR3vG @egrefen (On a differentiable framework for Inductive Logic Programming) "Learning Explanatory Rules from Noisy Data," Evans and @egrefen: https://t.co/fRq17YXfcj "Good to see more work on encrypted AI - could grow the space of possible business/governance models... ""CryptoDL: Deep Neural Networks over Encrypted Data,"" Hesamifard et al.: https://t.co/FCRHFc4Aw2" @PatrickOmid Server didn't work when I tried to download it :( "RT @PatrickOmid: uM, ACtuALly... (This is cool work) https://t.co/EXRovZgoNe" Mere humans don't seem to be able to access the updated CS/ML etc. pages but Brundage Bot saves the day! https://t.co/QVBAXscQ09 @AmjadPf hopefully only a bit longer, server issues @JoshMiller656 server issues @blakezsmith server issues RIP arXiv, we had some good times... @mustafasuleymn on "The Technologist's Dilemma" at @theRSAorg. https://t.co/uxxH8CLgL5 @mat_kelcey @edersantana but I am selling now ;) @edersantana I’ll sell you a ticket for 5,000 Bitcoins RT @edersantana: Is NIPS 2020 registration open yet? I hope I’m not too late... "RT @nnaisense: We have won the #NIPS2017: Learning to Run #DeepRL challenge! Thanks to the organizers for a great competition, @NvidiaAI fo…" @BIUK shut it [Sophia coverage] down cc @Sam_L_Shead @BVLSingler also isn’t there no money? Thought it was more like universal basic goods/services... We're still hiring for 2 AI safety research roles at @FHIOxford, along with 2 administrative/operations roles + internships: https://t.co/1h72JYGkWI RT @arxiv: We're aware of the #arXiv outage. Continued issues with Cornell's server farm: https://t.co/kEZgb5fClr. We apologize for the inc… (b/c arXiv is having issues, not b/c I or @BrundageBot are abdicating our duties, to be clear :) ) no arXiv updates today... https://t.co/czz9oN9Zi5 RT @stephenWalt: At what point does #POTUS45 {or Huckabee Sanders) insist that he barely knows Don Jr? RT @dandrezner: Please tell me Mueller discovers Eric Trump gave $1 million to a Nigerian email scam promising Hillary Clinton’s deleted em… RT @BotJunkie: NEW SPOTMINI https://t.co/kI3lm3ctwC @Aelkus reach out to the author? @timhwang @NipsConference why no love for @BrundageBot? 😬 https://t.co/Mjl1oUPcG0 @timhwang @NipsConference LOL @aharutyu congrats! :) "RT @aharutyu: Our new paper is out and accepted to #AAAI2018! ""Learning with Options that Terminate Off-Policy"" https://t.co/l2LVGbo6ge" RT @graphcoreai: Silicon Valley giant Sequoia Capital has invested $50m in a Bristol-based #AI startup https://t.co/bKruzTbKoe "RT @M__Verbruggen: * What is the state of play of Autonomy in Weapon Systems? * How are #LAWS developed? * How can we move the discussion…" Timely, with the UN meeting this week on related issues... ⬇️ https://t.co/Z33bkmSBxk "RT @pabbeel: Newscast from a (undesirable) future: https://t.co/U10FHQpdWj A wake-up call produced by @UCB_EECS @berkeley_ai 's Prof. Stuar…" @Reza_Zadeh see also: https://t.co/xhrFEyVFLh @skrish_13 yes, it includes many responses from other authors and a rebuttal from the original authors (dunno how different the main text is - looks similar) RT @BrundageBot: Breaking the Softmax Bottleneck: A High-Rank RNN Language Model. Yang, Dai, Salakhutdinov, and Cohen https://t.co/ULRpl58l… RT @BrundageBot: Learning with Options that Terminate Off-Policy. Harutyunyan, Vrancx, Bacon, Precup, and Nowe https://t.co/b1Is3lvHhi RT @BrundageBot: Self-Supervised Intrinsic Image Decomposition. Janner, Wu, Kulkarni, Yildirim, and Tenenbaum https://t.co/2ucyEg1DDh RT @BrundageBot: Neural-Symbolic Learning and Reasoning: A Survey and Interpretation. Besold et al. https://t.co/g06W2IiKZe RT @BrundageBot: arXiv papers, November 13, 2017: "@patrickc -An Autobio. (Gandhi, takeaway: be ethically ambitious) -Singularity is Near (Kurzweil, AI plausible) -Contemporary Ethics (Shaw, be ~utilitarian) -Moral Machines (Wallach/Allen, AI value alignment hard) -Real Freedom for All (van Parjis, UBI+growth key to justice)" PDF from Lake's website here: https://t.co/C5iIMqxRHu https://t.co/E9zdIV6gHx RT @santoroAI: Lake et al's "Building Machines that Learn and Think Like People" now published in BBS, alongside a number of commentaries.… RT @hardmaru: Also ESTool, my little tool for performing these evolution experiments. https://t.co/2SKfNwLKRE https://t.co/VL1bTyOef3 RT @hardmaru: Evolving Stable Strategies https://t.co/NCkjJG0uqO https://t.co/QGARJZ8XUE RT @black_in_ai: Official Black in AI account for announcements about the upcoming workshop, our group, features of members, and other acti… RT @red_abebe: Official Black in AI account up! #AI #MachineLearning #DeepLearning #DataScience https://t.co/k2iOnJUfdO Me waking up late and going straight to a meeting... (excerpt from the Maximum a Posteriori Policy Optimization paper's video: https://t.co/qb1DsNZjgp) https://t.co/cMJbdd9nFi @timhwang @bfod when in doubt, ask @anderssandberg Video: https://t.co/blCnWlEd7U Just a funny typo from an overall interesting paper, Progressive Reinforcement Learning with Distillation for Multi-Skilled Motion Control: https://t.co/fKx4GuDxhT- AI is magic after all... https://t.co/Ou7fQsxrfN RT @SmithaMilli: Happens all too often https://t.co/TsufwnVvvU https://t.co/xAMZtnyXen "RT @ddale8: Kim Jong Un called Trump a ""lunatic old man"" who might start a ""nuclear war."" Trump let ""lunatic"" and ""nuclear war"" slide and…" RT @RadioFreeTom: The President is tweeting like a mean girl at a rogue nuclear state while we argue over whether a guy in Alabama who date… RT @karpathy: New blog post: "Software 2.0" https://t.co/psXB9T1anp Wonder if @elonmusk knows that there’s a TV show with a character (Darius Tanz) that seems to be based on him... https://t.co/yp6UQx3qNH @Cooper_Kunz there’s a huge lit on it, see @paul_scharre’s recent 50+ tweetstorm on it :) @Cooper_Kunz arms races, faster and faster decision-making, etc. spiraling out of control. So I'd like to see some sort of governance of it if possible. @Cooper_Kunz I don't have a super strong view. Think there are good args for why in individual cases, it could be a good thing (e.g. b/c defensive or better than alternative) but worried about system level issues... One of two US working papers: https://t.co/2lhhvlrUvq (and a mainstream argument more generally) For Americans RTing this and unaware: this is your govt’s official position in UN negotiations next week. https://t.co/Fe0NCJbx1n @ArtirKel nice :) @RikeFranke @PHDcomics ha, same. DeepMind's Matt Botvinick on human brains and meta-RL: https://t.co/pZmhvIJ28N @Zergylord yeah that’s a fair point. RT @ChuBailiang: Sources say Trump in secret talks to acquire Xi's hair stabilization technology. "They're decades ahead of us." https://t.… "RT @erikbryn: AI is a GPT and that's good news for future growth. @danielrock, Chad Syverson and I explain in our new @nberpubs working pap…" @Zergylord Mostly that he didn't actually/literally apologize to the victims, just talked about how he felt bad/hurt people. Also some stuff like talking repeatedly about how admired he is etc. rubbed me the wrong way. RT @alanyttian: https://t.co/CpE7AqFebx 10 Minutes of Imaginary Japanese Anime Face, dreamed by (an 256x256 version) of our #MakeGirlsMoe G… @dribnet @jackclarkSF @hardmaru nice!! :) who, btw, might be AI researcher/fashion model #2, unless Movitz Lenninger is a common name... "Generative adversarial networks as integrated forward and inverse model for motor control," Movitz Lenninger's master's thesis: https://t.co/sokcskXiBg RT @nasrinmmm: As if US wasn't already losing PhD students(& hence future dominance in tech including AI)to Canada,UK,&other countries beca… @VahidK my dubious face was directed at CNBC, not you :) @VahidK 🤔 RT @AngeBassa: Are you a veteran looking to get into data analytics or data science? Hit me up! I’m happy to help with resume polish, inter… @tallinzen same happened to me recently, quite obnoxious @shimon8282 congrats! RT @shimon8282: Whiteson Research Lab members have three papers accepted at AAAI! https://t.co/u5vAVLgQXv RT @markus_with_k: New trick: hire people just before camera-ready deadlines and add new affiliation to paper -> your startup just publishe… (and yes, as others have said, the content is bad) Man, the writing on this Louis C.K. statement... he shouldn't quit his day job. Well, he should, but not to take up writing. https://t.co/dyQ2bBjV2w RT @Miles_Brundage: Preprint here: https://t.co/KIqtU3vTJl https://t.co/4szgKsN5lV RT @Bencjacobs: Worth noting that the White House's official position is that every woman who has accused Trump of sexual harassment is lyi… Preprint here: https://t.co/KIqtU3vTJl https://t.co/4szgKsN5lV RT @KaiLashArul: Shiny magazine print of A Brief Survey of DRL (w/ @mpd37 and @Miles_Brundage) now available from IEEE: https://t.co/TYLKZq… @davegershgorn I mean, it's a mainstream argument in the lethal autonomous weapons debate. RT @NandoDF: Trying to understand cortical circuits, while narrowing the gap with machine learning models (LSTMs). We’d love feedback! Than… @psygnisfive https://t.co/9OCuUC6LFx "RT @Mom101: @aravosis To recap FOX: 39 year old Don Jr is ""a good kid."" 36 year old Kushner is too young looking to have done anything il…" RT @sla: Preferred Networks achieved 74.9% accuracy on ImageNet training in 15min, the world's fastest result using ChainerMN and 1,024 P10… RT @BrundageBot: arXiv papers, November 10, 2017: Timely. https://t.co/3zszegJ3on Specifying non-trivial, falsifiable predictions is hard. Btw, I realized recently that on some interpretations of my original MR forecast, it happened before I even made it, but dunno if a single run counts. My Atari sense is tingling... let’s see some good Montezuma’a Revenge results (but nothing >500% median) please :) @samim @aeronlaffere and yes, good utopian fiction is much needed, a la Banks, Le Guin etc. @samim @aeronlaffere Island was supposed to do that, no? What was wrong with it in that respect? (naive Q) @samim @aeronlaffere I can’t speak to Island but I read Brave New World Revisited and seem to recall it being explicitly a warning (re manipulation/totalitarianism) @samim Why urgent 55/85 years later? :) but really, never got around to finishing Island. Not sure it's that influential vs. BNW, +latter seemed anti-eugenics? @hardmaru @jackclarkSF only if it’s a HyperGAN. @jackclarkSF lol I discovered Smart Lasso is part of Preview. @jackclarkSF Fanfare awaits. This could be you! https://t.co/rmQIupD2U4 RT @shakir_za: We release a report on the outcomes of the first Deep Learning Indaba and what we have so far learnt about strengthening Afr… RT @HMRoff: New @UNIDIR report out for ccw meetings on #autonomousweapons https://t.co/XmVZ5ydNX2 #A.I RT @OpenAI: Developing our Dota 2 system, with @gdb @sidorszymon @sama: https://t.co/VlVnwjvQ5z @primalpoly (haven’t done a second watch through, but that’s one reason I might) @primalpoly and a second time for understanding what actually happened when! RT @jwangARK: Intel's new graphics chief says his new project will be on a different scale than anything attempted before: https://t.co/0Zz… RT @riashatislam: Our paper highlighting issues with reproducibility in Deep RL, titled "Deep Reinforcement Learning that Matters" got acce… RT @BrundageBot: arXiv papers, November 9, 2017: "Inverse Reward Design," @dhadfieldmenell et al.: https://t.co/NTvNm06HU8 @jwangARK many thanks! This is helpful. "RT @jwangARK: @Miles_Brundage Here's my last writeup: https://t.co/LP7vOEH7ZO Even if they don't win the ultra high-end, they could do dama…" @jwangARK what do you think their prospects are? /have you written up your views on the state of play in the AI-related market lately I could see/may have missed? @EBKania indeed! I think Jeff here (you know him? if you don't you should chat :) ) might be doing that... @EBKania will be interested if you find it! I just found two versions of the article you linked, and that "most cited" page, but dunno if related. @EBKania e.g. compare that YAGO2 paper (631) w/ "Imagenet classification with deep convolutional neural networks" (conf. paper, over 16k) @EBKania both b/c conference papers generally more important than journals, and Elsevier journals not nec. most popular of the journals. Looked at some from that list and had tiny cites vs. conf papers. Maybe other source used, though. @EBKania key Q here is what the list of papers consists of. If it's this (https://t.co/RPPt0wOwuj) from Elsevier publications, super problematic. RT @SuryaGanguli: Our new paper! Learning asymmetric recurrent neural networks thru variational inference https://t.co/jmDUmpg9SY w/Yoshua… Throwback Wednesday - overview of metalearning from Schaul and Schmidhuber, 2010: https://t.co/agldB5WA0q @patricknmahoney pretty much :) see: https://t.co/JWY4skobsU "RT @nova77t: That's quite impressive. ""Globally and Locally Consistent Image Completion"" https://t.co/vA6VMKngG7 https://t.co/qvICyqjOOq" @NatalieParde congrats! Finally got around to this... TL;DR: MAML (model-agnostic meta-learning) is great. https://t.co/LNbib1kLeH RT @maithra_raghu: First foray into Deep RL https://t.co/oaDjqsCkh4 We test on a game with continuously tuneable difficulty and *known* opt… @GalaxyKate this one had a cute title https://t.co/9IVuurbcPZ @davegershgorn yeah, so does like everyone (dunno what specifically she meant but AI for cyber defense is v not new) "RT @rodolfor: So, I have started a new company. Still stealth but I am hiring Right now looking for: - full stack engineers - NLU devs -…" I love how this Priti Patel thing people are freaking out about in the UK is similar to the Trump Russia stuff but like a million times less damning. RT @seb_ruder: Happy that we're announcing €2m investment today! We're also hiring. If you want to work or do research with us (also for Ph… RT @btaylor: Cosmic justice: Danica Roem will become the first transgender person elected to a state's legislature, defeating the author of… "RT @RichardSocher: First fully parallel machine translation model.No RNNs😳Less latency🙃 https://t.co/yFQehJm34H https://t.co/LeVaIQ9n62 htt…" John Nash’s paper “Equilibrium points in n-person games” would fit in 7 (280 char) tweets. https://t.co/z5DmIcUutg It’s almost like China’s gov’t knows what they’re doing and how to push Trump’s buttons. https://t.co/nao8BHIb4z @BVLSingler @Sam_L_Shead @jjvincent i thought your superpower was studying (deity/AI) superpowers :) @daviottenheimer but I’m an unverified nobody writing in 140 by choice, I deserve leeway ;) @BVLSingler @Sam_L_Shead @jjvincent A+ reference @BVLSingler @Sam_L_Shead @jjvincent good thing we’ve already resolved all legal issues related to autonomous cars and non-autonomous drones - combining the two should be NBD 🙈 P.S. I guess the revised text could just be <140 chars if the bot has 280 and can use some on the introductory text. "RT @tomstafford: The good news: brain training works The bad news: it's expensive, hard work and called school https://t.co/aI6K9Ch5Hg" @andypiper @dribnet @BrundageBot cc @amaub fyi (I know summarization isn’t solved/tweets sometimes harder to summarize than eg news articles—maybe do when confident? thoughts NLPeople? Bot idea: find verified users who used all 280 chars, run text through summarization technique to <120 chars, say “You could have said...” RT @sarahookr: Our work shows the explanations of a model prediction can be mislead by simple input transformations to show a cat. https:/… RT @BrundageBot: Learning Robust Bed Making using Deep Imitation Learning with DART. Laskey, Powers, Joshi, Poursohi, and Goldberg https://… RT @BrundageBot: Sparse Attentive Backtracking: Long-Range Credit Assignment in Recurrent Networks. Ke et al. https://t.co/VYVlNPdyjd RT @BrundageBot: Moonshine: Distilling with Cheap Convolutions. Crowley, Gray, and Storkey https://t.co/h2BP8vevsZ RT @BrundageBot: Compression-aware Training of Deep Networks. Alvarez and Salzmann https://t.co/82pkGTG3u1 RT @BrundageBot: Can Deep Reinforcement Learning Solve Erdos-Selfridge-Spencer Games?. Raghu et al. https://t.co/EOUdoCUI8y RT @BrundageBot: Cortical microcircuits as gated-recurrent neural networks. Costa, Assael, Shillingford, Freitas, and Vogels https://t.co/s… RT @BrundageBot: arXiv papers, November 8, 2017: RT @FHIOxford: Come join our operations team! We are looking for a new Administrative Assistant, details here: https://t.co/dZunWyANvh Back in 🇬🇧 @zacharylipton @LiDeng1 Might attend. You will def. need a pic of Louisiana BBQ, ideally spilled on a copy of the paper. Also, congrats :) Great paper on AI and explanation! Covers issues of explanation in general, in law, in AI, etc. very succinctly. https://t.co/RB86vGzv6y RT @JoshuaGreen: The guy she beat, derisively referred to by opponents as "Bigot Bob" Marshall, sent out mailer reminding voters Roem was "… Most diagrams in AI papers are not very clear or helpful. This is a good one, from https://t.co/ucVmyuJ6zx. https://t.co/5HyZRq92p8 RT @BuzzFeedBooks: if you think 280 characters is exciting, try reading a book RT @Redistrict: Projection: Ralph Northam (D) has been elected next governor of VA, defeating Ed Gillespie (R). #VAGOV The question I know everyone is asking, though, is: does @BrundageBot have 280? I refuse to use 280 characters until everyone has the right to marry, er, use 280 characters. I also still have the ability to add lame stickers to images. I have one circle worth of characters, great. https://t.co/5K9bsGEhsD RT @distillpub: Feature Visualization - a new Distill article by @ch402 @zzznah & @ludwigschubert. https://t.co/Ckqq3QFYDR policy net = "deep neural network (DNN) version of Hotz and Miller's (1993) conditional choice probability estimates" etc. etc. etc. Haven't read the whole thing but looked interesting - basically it's an economist Schmidhubering much of game AI. https://t.co/m2EDDfOzLu @hardmaru which one? Sequence Transduction with Recurrent Neural Networks? Generating Sequences With Recurrent Neural Networks? @hardmaru yeah, I assumed. @hardmaru or, if that's too hard of a Q on the spot, what is at least one other that'd be on the list :) @hardmaru yeah! what are your other all time faves? Less jokingly, though, there are many big ideas in that cited paper, still just as relevant 2 years later - https://t.co/N7tnrolYGH Always a safe sentence to include, just fill in the general idea... (from Imagination-Augmented Agents for Deep RL) https://t.co/xmEye3Nmtc RT @BrundageBot: Composing Meta-Policies for Autonomous Driving Using Hierarchical Deep Reinforcement Learning. Liaw et al. https://t.co/9G… RT @BrundageBot: arXiv papers, November 7, 2017: RT @HrSaghir: After a certain company almost killed robotics with a buying spree, It's refreshing to see new robotics startups. Congrats @p… 🦄 in 3⃣,2⃣,1⃣... https://t.co/Mq0XN9XwcH RT @dennybritz: A.I. Researchers (including Pieter Abbeel) leave OpenAI to begin Robotics Start-Up https://t.co/8WjLROALgs RT @BodegaBot: These two ex-Github interns want to replace art galleries with cryonics RT @mpd37: Faculty position in Machine Learning (CS Department) at Imperial College London .@ICComputing .@imperialcollege https://t.co/KCx… Lots of good research ideas there, including some security-related one - I'm esp. a fan of the secure enclaves for ML stuff. "A Berkeley View of Systems Challenges for AI," Stoica et al.: https://t.co/X1u00MWN35 RT @BrundageBot: The (Un)reliability of saliency methods. Kindermans, Hooker, Adebayo, Alber, Schütt, Dähne, Erhan, and Kim https://t.co/Hi… RT @BrundageBot: Accountability of AI Under the Law: The Role of Explanation. Doshi-Velez et al. https://t.co/Ali8hnQNM1 RT @BrundageBot: Lifelong Learning by Adjusting Priors. Amit and Meir https://t.co/1tGb1jvCJq RT @BrundageBot: Neural Discrete Representation Learning. Oord, Vinyals, and Kavukcuoglu https://t.co/FEUbqTI921 RT @BrundageBot: arXiv papers, November 6, 2017: RT @Reza_Zadeh: Dataset: 100k chest X-rays from 30k unique patients with different forms of lung cancer. From NIH. Time to train. https://t… @ankurhandos @rbhar90 more species... https://t.co/XvxiKID2rB ...and this https://t.co/ReqHzFA635 and this https://t.co/zSbQdfohCB, just at ICLR. This is very cool! Learned model-based RL is pretty hot right now... see also MCTSnets https://t.co/6NlI3UCT3r- https://t.co/ZYKuqdtDDk RT @hardmaru: Deep Learning at @NvidiaAI❓ https://t.co/RbtnpLbPCx @semiDL yeah didnt mean to imply its just US, I’m just speaking to a largely american audience so pointing out their complicity TL;DR hypersonic missiles would be really bad/destabilizing. P.S. In the US, DARPA is currently funding R+D on them. https://t.co/UiFFbMhVIP RT @RebeccaCrootof: Regulating Artificial Intelligence: a thread https://t.co/bmKQxyWo4l RT @RebeccaCrootof: Come work with me! https://t.co/1dbbVORZfe RT @SmithaMilli: Our new paper "Interpretable and Pedagogical Examples" is now available on arXiv https://t.co/a1qJX4fQr2 @amaub @lcyflmng @BrundageBot I don’t think they’re very easy fixes, but OTOH haven’t thought about it much, will let you know @lcyflmng @BrundageBot though perhaps some room for improvement on the algorithm side as it does get some things clearly wrong @lcyflmng @BrundageBot yeah the goal is human preference centric so data needed, prob. wont change much now bc im not tweeting as much so data mostly fixed... @lcyflmng @BrundageBot no, but saves me a lot of typing Audio samples - token 5 is my favorite. https://t.co/1ea7Yyt8lK https://t.co/FKrUqsvdeG RT @RepTedLieu: .@POTUS is going on another international trip tomorrow - this time to Asia. Here's another cheat sheet to help him out dur… RT @gneubig: No takers on this? I was fully expecting to be Schmidhubered :) https://t.co/xGw9PwcwyA RT @hardmaru: Second version of this paper is humbler: ImageNet Training by CPU. AlexNet in 11 Minutes and ResNet-50 in 48 Minutes https://… RT @brundlefly: Thanks for clarifying. I was concerned you’d grown a fucking backbone or something. https://t.co/JC1lVYx1Yn @Aelkus but yes i agree, it is imaginable @Aelkus “meddle with” = suspend = something that happens thousands of times a day with good reason, quite diff from tweeting as someone @Aelkus of course I wouldn’t rule it out, but one doesn’t clearly follow from the other... @Aelkus seems unlikely to me that their system allows someone (or at least many) to impersonate ppl. vs banning less risky/part of customer service RT @BrundageBot: Don't Decay the Learning Rate, Increase the Batch Size. Smith, Kindermans, and Le https://t.co/BwABBJ1zgS RT @BrundageBot: Learning with Latent Language. Andreas, Klein, and Levine https://t.co/LNpoZTcTLr RT @BrundageBot: arXiv papers, November 3, 2017: RT @BrundageBot: A Unified Game-Theoretic Approach to Multiagent Reinforcement Learning. Lanctot et al. https://t.co/y1y0mNuq4C RT @BrundageBot: Interpretable and Pedagogical Examples. Milli, Abbeel, and Mordatch https://t.co/PL4K2XUiOm @garrytan (assuming you were speaking literally, not figuratively...) I’m unaware of evidence 4 “exponential,” prob sublinear https://t.co/WyUE1PqHv2 RT @red_abebe: speaker list up our #blackinai workshop https://t.co/oONpCxk5N4! Full prgm w amazing submissions coming soon! #AI #NIPS2017… RT @fchollet: A Keras implementation of Hinton's CapsNet: https://t.co/7OSOKfuscf @davegershgorn @kcimc (just specific case but more generally I’d be shocked if Goog didn’t do something on this front as leaders in ML security research...?) @davegershgorn @kcimc https://t.co/8fO6k5vdwD @EBKania when is Part 2?? :) "RT @ziyatong: Limacodidae caterpillar is like a walking gummy bear [video: Janice Ang] https://t.co/fr13tvjMaM" RT @peterwsinger: Knucklehead government worker makes it harder to prosecute and punish terrorist. https://t.co/u3fYu17UsN RT @yasamanbb: We recently finished a paper, "Deep Neural Networks as Gaussian Processes," https://t.co/74Le2kXbd7. Training without "train… RT @mena_gonzalo: I understand the interest on prof Hinton, but It is sad the article does not even mention Sara Sabour, first author. http… RT @BrundageBot: Hierarchical Representations for Efficient Architecture Search. Liu, Simonyan, Vinyals, Fernando, and Kavukcuoglu https://… RT @BrundageBot: Unsupervised Machine Translation Using Monolingual Corpora Only. Lample, Denoyer, and Ranzato https://t.co/LzDKw7H9Xw RT @BrundageBot: Visualizing and Understanding Atari Agents. Greydanus, Koul, Dodge, and Fern https://t.co/WAOAJCiWbo RT @BrundageBot: Fraternal Dropout. Zolna, Arpit, Suhubdy, and Bengio https://t.co/YDBSkFlhUW RT @BrundageBot: arXiv papers, November 2, 2017 (redo): @catherineols @zacharylipton p.s. Critch and Russell wrote this just for you after your tweet (I assume) https://t.co/GvitLVslUJ RT @EBKania: My take on the Chinese Party-State’s plans to leverage AI to bolster its performance legitimacy. https://t.co/pnepfDBkaW RT @byrdinator: i am crying laughing https://t.co/lBEa7XhKag RT @shimon8282: This has been gestating in my lab for quite a while. Really glad to finally unveil our TreeQN and ATreeC methods for deep… Donald Trump became eligible to be President by birth, a Thomas Jefferson beauty. I want merit based. https://t.co/6wyHnropuo RT @_rockt: I am very excited to share our paper on Differentiable Tree Planning for Deep RL w/ @greg_far @MaxiIgl & @shimon8282 https://t.… @calebwatney @karlbykarlsmith what’s the great variation thesis? RT @BrundageBot: CrescendoNet: A Simple Deep Convolutional Neural Network with Ensemble Behavior. Zhang, Vishwamitra, Hu, and Luo https://t… RT @BrundageBot: Stochastic Variational Video Prediction. Babaeizadeh, Finn, Erhan, Campbell, and Levine https://t.co/4ZS8UghfQV RT @BrundageBot: arXiv papers, November 1, 2017 (redo): @amaub @BrundageBot huh, weird. Another Brundage Bot missed: "Learning Robust Rewards with Adversarial Inverse Reinforcement Learning," Fu et al.: https://t.co/2mrXZYyOXd @BrundageBot and/or there's a vast conspiracy and @amaub heard me mention this paper at dinner... RT @BrundageBot: Meta-Learning and Universality: Deep Representations and Gradient Descent can Approximate any... Finn et al. https://t.co/… @BrundageBot is a super huge fan of this paper (which is good, for the record! but there were many other good ones), slash is bugging... https://t.co/DVSAAd9GT5 @BrundageBot what's up with the small number today? timing issue again? @amaub "TreeQN and ATreeC: Differentiable Tree Planning for Deep Reinforcement Learning," Farquhar and @_rockt et al.: https://t.co/VqxWCnT3i2 👍🌲🤖 RT @dribnet: @mtyka @htoyryla @quasimondo happy halloween to everyone from the imagination of the latest GAN models https://t.co/Ek6qzcE2h1 RT @qhardy: Somewhere in 2030 a therapist can now afford that summer cabin. https://t.co/Jr6jQ9l9yf RT @katecrawford: If you're looking for a great postdoc, we're hiring at @AINowInstitute at @nyuniversity - deadline in a few weeks! https:… @slugworlds cc @timhwang "RT @zinmalu: Our paper ""Interactive Thompson Sampling for Multi-Objective Multi-Armed Bandits"" is now available: https://t.co/haEgFlesov h…" @hholst80 nope! Long time no (D)C... here to drain the swamp (/go to a conference). https://t.co/NdU0gWWx9P The Trump campaign/administration in a few sentences... https://t.co/xELruuCnBB "RT @benjaminwittes: Boom https://t.co/f1EbF7V1Tm https://t.co/7QpMUUIrMZ" RT @bousmalis: We wrote a blog post about our work on closing the reality gap for robotic learning! https://t.co/N7RpD7XlL7 @catherineols @zacharylipton another arg for it being ill-defined: https://t.co/tMKvnWfnkm @jjvincent if “she” did anything with the rights @jjvincent yeah and it would basically just be making Goertzel/Hanson citizens... @jjvincent so: laughing matter @jjvincent re: “PR stunt” etc. - obv dumb but legally speaking, did this actually happen or just cheeky faux announcement? Haven’t seen any details Learning overload - ""Meta-Learning Transferable Active Learning Policies by Deep Reinforcement Learning": https://t.co/Jl5zE8SFzX RT @BrundageBot: Diff-DAC: Distributed Actor-Critic for Multitask Deep Reinforcement Learning. Macua et al. https://t.co/P8yI8O3DSU RT @BrundageBot: Unsupervised Neural Machine Translation. Artetxe, Labaka, Agirre, and Cho https://t.co/s4kGrRHppd RT @BrundageBot: Eigenoption Discovery through the Deep Successor Representation. Machado et al. https://t.co/SGRjwKVk5x RT @BrundageBot: Transfer Learning to Learn with Multitask Neural Model Search. Wong and Gesmundo https://t.co/0k9Kq3qzd2 RT @BrundageBot: One-shot and few-shot learning of word embeddings. Lampinen and McClelland https://t.co/21jyoDb71B RT @BrundageBot: arXiv papers, October 31, 2017: There do not seem be *proportionally* more RL papers - just more papers, period. After careful filtering, I have concluded there are ~a bajillion good ICLR papers. @achristensen56 yay @hardmaru :) @katherinebailey @hardmaru I at least hadn't, thanks! :) @statalgo @hardmaru oh yeah, forgot about that! @hardmaru you’ve been incepted! It is a pretty good term actually, though somewhat vague, could see ppl refer to hyperp optim., arch search, metaL etc @hardmaru who coined AutoML? I assumed it was a Google corporate thing for a Pichai talk but now researchers are saying it :) Hopefully someone took his phone so this will be his last tweet ever. https://t.co/TVZEhD5bsz RT @shakir_za: First call for ICML 2018! .@driainmurray and I will be your publication chairs, chasing you all for any bad formatting. 😜 ht… @davegershgorn there was no collusion, I assure you RT @vkrakovna: Some takeaways from the AI & Society symposium in Tokyo.... https://t.co/H5W1pJxr7g RT @MateuszOnAI: Progress on various vqa dataset at #iccv2017 https://t.co/0cCxReIV4v @GoAbiAryan Arrival, Interstellar... I've only recently come to appreciate this section heading in the Model-Agnostic Meta-Learning paper by @chelseabfinn et al. ... 👍 https://t.co/0dcWtt6QqB "RT @Smerity: Having trouble finding the papers that use technique X, dataset D, or cite author ME in the #ICLR2018 submissions? 🤔 https://t…" Bob the (Collusion Case) Builder RT @paul_scharre: @CNASdc @Alex_agvg @TheNatlInterest @ericschmidt @Google @JigsawTeam @awmcmu @CarnegieMellon @missy_cummings @HAL_Duke @D… Oh nice, someone tell Mueller! https://t.co/nkfhXNe0cU @ankurhandos though I did teach middle schoolers for a bit with Lego Mindstorms. Too expensive but pretty good for navigation, not so much manip. @ankurhandos Sounds cool, though I'm not sure what I could contribute besides tweets about it :P @ankurhandos looks like DGAF could do a fair amount! RT @nakashimae: Manafort and his attorney just walked in the front door of the FBI Washington field office. @egrefen 🎃🕵🏻👮‍♀️🔐 RT @FHIOxford: We're hiring! Applications for two AI Safety research positions at FHI open now https://t.co/7cqTmv1vII https://t.co/DnsrENP… ⬇️⬇️⬇️ https://t.co/JJOxz2kzgP @mhough let me knwo what you think re: Benito's - I was pleasantly surprised @mhough it’s ok, rice is a bit unusual for Mexican @visarga thats one good way of thinking about it, though I meant stuff like differemt types of layers @gwern I guess I would have been safe with superlinear @gwern Might be, I wasn't sure what the word for it is, though RT @BrundageBot: CANDiS: Coupled & Attention-Driven Neural Distant Supervision. Nagarajan, Sharmistha, and Talukdar https://t.co/p9bDVFotaJ RT @BrundageBot: Distributional Reinforcement Learning with Quantile Regression. Dabney, Rowland, Bellemare, and Munos https://t.co/dOLvyIR… RT @BrundageBot: Generalization Tower Network: A Novel Deep Neural Network Architecture for Multi-Task Learning. Song et al. https://t.co/8… RT @BrundageBot: arXiv papers, October 30, 2017: RT @LiYuan6: If you want to know what's going to happen in Xi Jinping's 2nd term, look at China's tech industry https://t.co/aH5x5PLEDo "RT @erikbryn: Cool debate! @GaryMarcus vs. @ylecun on ""Does AI Need More Innate Machinery?"" with David Chalmers intro #AI #2MA https://t.c…" Meta-forecast of the day: with 2 months left, I guess 6 of my 2017 forecasts will resolve positively, 3 negatively, and 2 will be ambiguous. Important - "Interpretation of neural networks is fragile": https://t.co/e5GNNwRYQh E.g. https://t.co/6cBFeFknEC + https://t.co/jd9q7OJdlG + https://t.co/g4XoKtKq1K- + https://t.co/qhOqmPNXS7- + https://t.co/vnv63PBFU2 Guys. It’s time for some GAN theory. "RT @pabbeel: NIPS Deep RL Symposium deadline Fri Nov 3. We welcome your #ICLR Deep RL submissions! (+other recent work) https://t.co/HJ26…" (not necessarily useful ones, though, which could be very rare) Even linear growth in the number of useful neural net widgets yields exponential growth in their possible combinations. 🤖 "Progressive Reinforcement Learning with Distillation for Multi-Skilled Motion Control" https://t.co/sgimAFUhuv Vid: https://t.co/NcTSWzo06u @ankurhandos you could call it the discounted gripper arm farm (DGAF) @ankurhandos should be way cheaper than Brain’s! :) curious to hear what you can do with it RT @reworkpip: .@ToniCreswell chats advancements in #generativemodels on Episode 2 of @teamrework’s Women in AI #podcast. #WiT #AI https://… "RT @poolio: One day after complaints of the NIPS capsules paper, we've got a shiny new one! Patience, DL community. Patience. https://t.co/…" @michaeltefula more so than the alternatives :) "Oxford now has decent Mexican food! 🌯 (Benito's Hat at Westgate)" Note that "human" range is broad (75-300% of human performance) yet makes up small portion of overall distribution. https://t.co/7oVg5lxKiq RT @Miles_Brundage: @marcgbellemare Made a fun graph to make this simpler :) This is the sub/human par/superhuman distribution for 5 algori… RT @hardmaru: A Visual Guide to Evolution Strategies https://t.co/LEfMMLqZOY https://t.co/AvkjBOiWJR @PatrickOmid they're real, but could be used to make fake news... The mean was not reported in the Ape-X paper and could be way higher (but hopefully, for my Brier score's sake, under 4000 :) ). Two more while I'm in Atari progress tracking mode - here is where we are now re: mean/median, juxtaposed on graphs from April last year. https://t.co/FkDvIhqRi5 @marcgbellemare maybe of interest to @jackclarkSF @marcgbellemare Made a fun graph to make this simpler :) This is the sub/human par/superhuman distribution for 5 algorithms over several years. https://t.co/e0mbuWmUXv @marcgbellemare E.g. Ape-X gets about one and a half times the human tester's score on Ms. Pacman, and about 55% for Montezuma (vs. ~0 for most algos). @marcgbellemare Hardest category conceptually (sparse reward/difficult exploration) is still hard empirically, though significant progress in some cases... Here's the 30% in @marcgbellemare et al.'s taxonomy. Note that Ape-X does OK on some (just not >300%, my def. of superhuman), bad on others. https://t.co/CoswbtJcIm An unfair comparison to other algos/humans (b/c >>compute used), but by this measure, Ape-X DQN is ~70% superhuman. https://t.co/1ARgKzQt7c @Daniel_J_Im That would be useful, but not sure if that data's available. Suspect it would look broadly similar though (~2 orders of magnitude faster) (and then the increase mostly leveled off in AlphaGo Zero and increased at more like one per month) "Original AlphaGo* roughly increased 1 rank per month - AlphaGo Zero roughly 1 per hour. *simplifying a bit b/c multiple training cycles." @_jyan_ yep @skrish_13 yeah I saw :) @_mb46_ @jeremyphoward no - maybe out of context. it's made clear in the paper that it is fast time-wise but also uses a lot of compute to do that. @markus_with_k a popular topic this year... @primalpoly @TeachFirst what did it say? @_rockt haha, I was just about to mention that to you ("see also"...) after your first tweet "RT @Miles_Brundage: Deep RL is eating deep learning is eating machine learning is eating AI is eating software is eating the world is... K…" RT @dustinvtran: According to the list of submitted papers, there are 1004 papers submitted to #ICLR2018. Last year there was 491. https://… RT @relevantorgans: When we asked Westerners to stop opioid imports into China they sank our navy and stole Hong Kong. But, sure, we'll loo… RT @dustinvtran: Scrolling through paper titles for #ICLR2018 submissions. The scrolling is endless.. https://t.co/eXyizbjtHN @togelius @TCIAIG congrats! @awjuliani yep! cc @y0b1byte @ankurhandos what’s shadow hand? Fortunately they shut it (Ape-X) down or my Atari forecast would be too conservative... https://t.co/V4GRVuMZhr https://t.co/szNZBRg0FF @ankurhandos though maybe not as hot as fancy activations and RNNs :) @ankurhandos there were actually tons of robotics papers! Many simulated, some real. Seems like it’s hot and/or Abbeel et al. are robots @iamtrask haha :) (obviously there were many other things submitted, probably mostly non-RL, but still a whole lot of deep RL!) International Conference on Learning from Reinforcement (ICLR) RT @politicaljimbo: @Anthony @realDonaldTrump Yeah, but her emails! https://t.co/daIxFxrf8C @ankurhandos yeah, seems to be really catching on @ankurhandos yup @ankurhandos note you also do seem to be able to search keywords - everything but see the long list. @ankurhandos here are some I already had tabs open for ;) https://t.co/WuMRbLc0Us + https://t.co/bFhsfF63u4 + https://t.co/V4GRVuMZhr @ankurhandos yeah I think they disabled it again, but no warning message anymore. I suspect they added more bandwidth but it still wasn't enough.. @robotic_hands here's one https://t.co/tcja4tSovr @robotic_hands might vaguely recall something like that but not 100% sure. a lot to go through :) Some big ICLR themes: deep RL, ML security/privacy, fancy NN units, architecture search, program induction, lifelong/transfer learning. (not a shocking insight, but alas, the average is way too long) I've seen TL;DRs on OpenReview that range from several sentences/half the length of the abstract to three words. Latter way better! @iandanforth 2500, good but not great/not SOTA @iandanforth ? (if I find another here or in the next 2 months that's over 500%, though, then I underestimated it :) ) Only scratched surface of the ICLR submissions but one quick tidbit: Ape-X DQN made it to 434% median on Atari, consistent w/ my forecast. Turns out that when I thought/hoped ICLR submissions were almost done, only 20% or so had been submitted... https://t.co/CDDgv5YftV RT @ethancaballero: @Miles_Brundage openreview is working now @mark_riedl I think I've been saying bonkers regularly since before moving. "Proper," on the other hand, has escalated a lot... @BrundageBot I hear it will be me for Halloween. I should be @BrundageBot for Halloween... They're missing TreePO, TREEINFORCE, Evolution Stratetrees, and TreePG, but it's a start... Now *these* are algorithm names: "TreeQN and ATreeC: Differentiable Tree Planning for Deep Reinforcement Learning": https://t.co/1MYwsg9PvX @adropboxspace re: AI and other general things that hurt AI recruitment/retention (immigration stuff) @adropboxspace yes, I don't know exactly what the solution is, but there's political will/interest to do something, at least. Vs. US doing nothing specific @ethancaballero @markus_with_k just some, not sure what the pattern is. I've already exhausted all the ones that work but still have many error tabs :) @ethancaballero @markus_with_k several tabs I have open give error messages when I reload. And I can't recover the URLs of ones i downloaded+closed tabs/name not in URL @adropboxspace in total terms, I’d put it behind US, but there is at least momentum. @adropboxspace I dunno, seems like the outposts are significant (/some stemming from startups like Maluuba), along with Element, MILA, now Vector etc.. @markus_with_k several! But the site is down (for looking at submissions RN) so can't link to them "Trudeau: *discusses hidden neural net layers* Trump: *is Trump* Shocking that Canadian AI is exploding RN... https://t.co/pAw44If0Sd" RT @prostheticknowl: New @nvidia paper demos highest quality neural network image synthesis to date including code https://t.co/9uv3gnnZcC… "RT @NipsConference: We are very happy to announce the DeepArt Poster Contest at NIPS 2017 https://t.co/9Oa4IFLXU4" Report from @nntsn is that it’s working. Look fwd to downloads working again soon - some wild stuff from what I’ve read so far. Is submission working at least? Have tons of tabs open for ICLR papers but won’t load now b/c site down. Sad! RT @hardmaru: I'm blown away by the method and results in this paper. Progressive growing neural nets may be a trend we will see in 2018. h… Bonkers. https://t.co/3Gme6rgIQX RT @jackclarkSF: Every one of these images has been generated by an AI system. A+ GAN insanity from NVIDIA https://t.co/CCHghgL60t https://… (it’s not working RN) OpenReviewpocalypse Now RT @BrundageBot: arXiv papers, October 27, 2017: RT @Azhag: OpenReview down, everyone panic/rejoice for extension \o/ Glad that’s settled. https://t.co/SxGdmvGQJJ @ESYudkowsky dunno, haven't read. "Dynamic Routing Between Capsules," Sabour, Frosst, and Hinton: https://t.co/qdnfN4qnlj Cool idea - "Context-Aware Generative Adversarial Privacy," Huang, Kairouz, and Chen et al.: https://t.co/3Y2j6tzP94 @markus_with_k @vicariousai haha i didn't realize that until after I tweeted it "DRL algos fall short of qualifying as mapping or path-planning algos with any reasonable definition of mapping" https://t.co/HgLPYq8DR7 @awjuliani and there are some early presents! First they [adversarial examples] came for supervised learning...then RL...now variational autoencoders: https://t.co/815BpKA2Hf @shivon was it recorded/any highlights for the masses? :) I'm quoted in this blog post apparently (didn't realize that when retweeting :) ) https://t.co/zIcEYgDwtt This is wild! https://t.co/EsjWwpFhSb @KenzoReHa and here https://t.co/TLFytNCnEb regarding @BrundageBot which was made by @amaub, hope that helps @KenzoReHa Hi Reza - I do not use any API in my own personal tweets, but you can read about/look at code here https://t.co/5PzWOrQlVv ... "Me: I'm going to get so much editing done tonight! Also me: looks at https://t.co/S4Slse0zB0 https://t.co/p8EKj0SI1B" RT @pabbeel: Great feature on high schooler Kevin Frans, 1st author on just released @openai HRL paper, amazing to work with! https://t.co… RT @OpenAI: Hierarchical reinforcement learning algorithm that learns high-level actions which can be reused across tasks: https://t.co/KLn… RT @tomssilver: New Science paper from @vicariousai (https://t.co/7CnOyED5PS) and blog post https://t.co/bp17t9RTgG @lidija_sekaric @BrundageBot +some randomness in my choices anyway so can't be perfect. saves me typing/tab opening time for the ones it gets right,+easy to add to it :) @lidija_sekaric @BrundageBot about as well as it did on the training set (.7 precision, .6 recall), significantly better than chance but still gets some stuff wrong :) RT @BrundageBot: Reasoning about Divergences for Relaxations of Differential Privacy. Sato, Barthe, Gaboardi, Hsu, and Katsumata https://t.… RT @BrundageBot: GeoSeq2Seq: Information Geometric Sequence-to-Sequence Networks. Bay and Sengupta https://t.co/eM6ydOyieZ RT @BrundageBot: arXiv papers, October 26, 2017: cc @EBKania thoughts? Where's the best hot take on the Xi Jinping/constitution change stuff? @davegershgorn wasn't there another article about AIs talking like Silicon Valley founders a while back though https://t.co/AJDUHC19Th @deliprao @r7dotai @bcmcmahan congrats! @y0b1byte shooting you a DM :) RT @graphcoreai: Graphcore's Dave Lacey shares preliminary IPU benchmarks - excels at training & inference & enables innovation https://t.c… @awjuliani prob. too computationally expensive for this approach (/their budget). Took days of compute for games with much denser rewards. RT @y0b1byte: We also release the webapp for data collection and jupyter notebooks with data exploration / data analysis. https://t.co/c3EK… "RT @y0b1byte: Finally, this this the Atari Grand Challenge Dataset v2. Twice as much data vs AGCv1. https://t.co/KgIggW7svI https://t.co/8e…" (reminiscent b/c trains a fast deep net to mimic a slower, more precise planning approach - see also Christiano https://t.co/mKUWcWdZir) Fun paper reminiscent of AlphaGo 0: "Deep learning 4 real-time Atari gameplay using offline MCTS planning"-Guo et al https://t.co/xJEZ1UZQZC RT @HMRoff: Want to work for the UN in Geneva? Care about #disarmament ? Apply here https://t.co/SgLuZw70wm RT @timhwang: AI/ML Researchers: deadline for our @NIPSConference workshop on machine deception is next Wednesday! Get in there. https://t.… @markus_with_k are you back in town btw? Would be nice to catch up, maybe at Westgate now that it’s open (whoo) :) Happy Wednesday! 🤖 https://t.co/MFhmhT4Dqi @markus_with_k (but really, I think that's partly just because there are a lot of SVM papers - I do tweet some) @markus_with_k bias! RT @balajiln: Check out our new paper with @elaClaudia, @shakir_za and @goodfellow_ian https://t.co/SMtTYb6Xr3 RT @BrundageBot: Many Paths to Equilibrium: GANs Do Not Need to Decrease aDivergence At Every Step. Fedus et al. https://t.co/79IlH1Kz4Q RT @BrundageBot: arXiv papers, October 25, 2017: RT @mark_riedl: Russian chatbot goes full Tay. https://t.co/TCUiHH8XLD "Memory Augmented Control Networks": https://t.co/3YvG89llca RT @erwincoumans: It works! A little bit of IK work, Kuka on a Husky with inverse kinematics following a circle: https://t.co/S1zX1lrp61 RT @BrundageBot: Neural Program Meta-Induction. Devlin, Bunel, Singh, Hausknecht, and Kohli https://t.co/ESmXnXRKBk RT @erichorvitz: Correlation found between access of info from fake news sites & votes for Trump vs. Clinton. 99% clicks via FB https://t.c… "Overlapping Layered Learning," MacAlpine and Stone: https://t.co/4KA2rkstuW Great seeing old friends/colleagues and meeting new ones at the inaugural Partnership on AI event! 🤖👍 @samim https://t.co/MohRbiuea4 Weird that ICLR's open review process is double blind now but ppl are submitting the same stuff non-anonymously to arXiv at the same time. RT @nsaphra: why are you so focused on women in science, what about MEN in NURSING or BALLE-- https://t.co/N3cEg9sWYR liddle’ https://t.co/lA8Ih9uOBA @SimonMoores pomerAInian "The Feeling of Success: Does Touch Sensing Help Predict Grasp Outcomes?," Calandra et al.: https://t.co/11rOqAXgGa RT @BrundageBot: Towards Black-box Iterative Machine Teaching. Liu, Dai, Li, Rehg, and Song https://t.co/F82gLZdcZm RT @BrundageBot: BENCHIP: Benchmarking Intelligence Processors. Tao et al. https://t.co/YFELGE7TJy RT @BrundageBot: Feature-Guided Black-Box Safety Testing of Deep Neural Networks. Wicker, Huang, and Kwiatkowska https://t.co/8X1J9Nyaxl RT @BrundageBot: Feedback-prop: Convolutional Neural Network Inference under Partial Evidence. Wang, Yamaguchi, and Ordonez https://t.co/Y2… RT @BrundageBot: Deep Voice 3: 2000-Speaker Neural Text-to-Speech. Ping, Peng, Gibiansky, Arik, Kannan, Narang, Raiman, and Miller https://… RT @BrundageBot: arXiv papers, October 24, 2017: @davegershgorn /application-only papers, which often involve human parts :) @atg_abhishek @davegershgorn yup, see https://t.co/znLoENOzUl RT @CadeMetz: What is the cost of an AI expert? Very, very high: https://t.co/NaF6rmqxRT @davegershgorn Dave @halhod @jwangARK I’m basing this on research, but could imagine some relevant commercial stuff (eg Fanuc/Preferred, some startups) Some @BrundageBot missed: Lopes et al. on knowledge distillation https://t.co/UH7fvcox8M and Depeweg ea, reliable RL https://t.co/DqVskJtaaz RT @BrundageBot: FigureQA: An Annotated Figure Dataset for Visual Reasoning. Kahou et al. https://t.co/AWdbWrygEP RT @BrundageBot: arXiv papers, October 23, 2017: RT @BrundageBot: Generalized Zero-Shot Learning for Action Recognition with Web-Scale Video Data. Liu, Liu, Ma, Huang, and Dong https://t.c… RT @etzioni: Tech Giants Are Paying Huge Salaries for Scarce A.I. Talent https://t.co/6mlVo5eos9 @dkasenberg yeah they just put up the actual submission dates v recently, suspect the portal will be up soon as well (just some semi-random early pickings - many more submissions coming this week) ICLR submissions on meta-RL https://t.co/bDezYFtWfA, making SVMs great again https://t.co/4nrcXc5i3K and super-LSTMs https://t.co/zqNv42WWDC @jackclarkSF also a fan of In Defense of Probability by Cheeseman, fun that that was radical at the time :) @jackclarkSF others now that I'm at my comp - McCarthy has some classics (Programs w Common Sense; From Here to Human-Level Int; The Well-Designed Child) @iandanforth still fits with a 5-10 year timeframe :) @jackclarkSF (prob not best but best that also comes to mind) @jackclarkSF Russell metareasoning stuff from the 90s @samim tech necessary but not sufficient for robotopia :) @samim prob lots of bad effects, but not radically diff from other home innovations in that respect (microwave) - can also be used well @samim depends. for some, time spent doing chores. others, esp old/disabled, help with physical tasks others can do (get stuff off shelves) etc @manuel_velez e.g. https://t.co/7XktgcbGlz + https://t.co/ZTS4T4An0A + https://t.co/MqGgRKx9jE RT @Smerity: With machine learning models released into the wild, it raises questions as to whether @OpenAI Gym has gone too far? 🤔 https:/… @jwangARK yeah forgot to mention that explicitly but it goes along with the transfer part. Sim-to-real is making big strides. @brubsby yes, this is part of why I'm bullish. Lots of people would pay for this, and then fund more R+D Trends that make it seem not crazy: imitation learning, transfer learning, soft robotics, approaches to dealing w/ privacy issues, etc. etc. ...could see it happen in 5-10 years, vs. multiple decades as I used to expect (though latter still seems plausible, I'm pretty uncertain). Starting to get kind of bullish on home robots that can do lots of things. We're not there yet but many underlying trends going v. fast... RT @kareraas: Historic moment for #Norway, today all top 3 government positions are held by women: Prime Minister, Finance Minister & Forei… RT @VahidK: A sneak peek of my current project: A deep learning IDE. Alpha version is almost ready. https://t.co/pGkNa3psBw "RT @BecomingDataSci: Open philanthropy AI fellows https://t.co/mT2MQpgXvN" "RT @openminedorg: OpenMined is now officially training AI on the Rinkeby @ethereumproject blockchain. https://t.co/27OMfZufC3" V cool (from few weeks back)--because binarized NNs are...binary...you can verify their properties with SAT solvers: https://t.co/CVzbn3R0b7 RT @Reza_Zadeh: Intel Nervana releases Coach: A surprisingly comprehensive Deep Reinforcement Learning Library. https://t.co/c5vWub7qkI htt… @GilPress Cc @jackclarkSF support for Cameron’s Law NIPS is the new Burning Man; Burning Man is the new NIPS. https://t.co/R6CCW02GsK "RT @ivan_bezdomny: Seriously tho - read the Nature paper if you can. Don't have to be DL person to appreciate it. The blog to start https:…" @geoffreyirving add sumo and poker and you have another 600 or so... @nathansttt @togelius Interesting, thanks! Wasn't aware of this-"It improved from a 1650 rating to a 2100 rating in just 308 games." DeepMind, eat your heart out! @trent_hauck yeah, they're all just research, but I'd be surprised if none had relevance for applications eventually. @hardmaru @togelius definitely more fun video... @samwenke https://t.co/CT8UkT5dWJ Will be in Berlin briefly Monday and Tuesday, let me know if you want to chat :) RT @hardmaru: @Miles_Brundage And Sumo! Oh and poker, of course! https://t.co/hX9olw5oyc next week is going to be 🔥🔥🔥🔥🔥 and @BrundageBot is going to miss out. @Smerity @staehere :( Recent self-play successes: DOTA 2, Super Smash Bros, Go. thoughts @nathansttt @togelius ? Maybe missing something... Groshev et al. did something related recently (https://t.co/OMVvOpkUBU), NN mimicking planner. Wonder if deeper integration useful. AlphaGo Zero for planning, but with classical planners instead of MCTS? Discuss. @rbhar90 don't know why exactly (in reality or in that claim) though @rbhar90 I've heard (from blockchain ppl, so take w/ grain of salt, but credible ones) that w some exceptions, academics don't really get blockchain. @_jyan_ we're not just interested in simulating plausible worlds but our world. @_jyan_ in principle perhaps, but would be pretty hard to reinvent all of human civilization/history/language etc from first physics principles :) @alex_peys I'd think it's a function of not just zero/positive sum but also existence of model (/other things). Why not learn coop w/ self-"play"? Timely watching after AlphaGo Zero used ~no innate knowledge. 🤔 https://t.co/uV6vgU0dYq @Smerity I innoculated myself of interest in Sudoku when I made a Sudoku solver :) Though maybe would have been a good way to pass time in airports.. @KaiLashArul @Qooborobot I want one! @tsimonite I haven’t watched yet but suspect neural, deep, understand, learn, unsupervised, supervised, humans = sufficient for alcohol poisoning Good viewing material for a wild Friday night! 🤖 https://t.co/uV6vgU0dYq RT @rbhar90: Excited to announce the release of @deep_chem version 1.3! GANs, Seq2Seq, Metalearning and more https://t.co/hengHASpOk RT @realDonaldTrump: The Apprentice was the #1 show on television last season on Sunday from 10 to 11 --- congratulations Donald! As much as I'd like to have a competent POTUS, I do kind of miss Trump referring to himself as T. RT @goodfellow_ian: If you’re at #iccv2017 on Sunday, check out our tutorial on GANs: https://t.co/o0BPVe4Pjn RT @weballergy: 'Emergent Translation in Multi-Agent Communication' https://t.co/M2CQhioEVj #MachineLearning #AI #language RT @googleresearch: Announcing AVA: a new dataset for human action understanding in video https://t.co/anUB6ksRbo Needed papers: Superhuman Dependency Installation with Deep Reinforcement Learning; PowerPoint/Projector Setup In One Shot with Metalearning RT @EBKania: Not all algorithms require such massive amounts of data, particularly as advances in use of synthetic data could obviate its r… RT @EBKania: China's abundance of data often characterized as critical factor, but that might provide context-specific edge, not generalize… @_jyan_ @BrundageBot (I did a sanity check before tweeting today for example and opened a few tabs as “hold outs” to be sure :) ) @_jyan_ @BrundageBot Brundage Bot should care about safety too :P in any case there is human oversight :) @davidmanheim @EvaKaili @anderssandberg @sapinker @peterjbentley @OHaggstrom @ThomasMetzinger @gimenezbarbat @EP_ThinkTank @Lieve_58 not sure CC @EP_ThinkTank RT @BrundageBot: arXiv papers, October 20, 2017: @willknight even that would at least be a policy but RN no one really manning the store. SAD! @willknight I suspect (reasonable baseline assumption across issues) he has no coherent view, even of opposition At this rate Djibouti will be a world leader in AI policy and research before US has a science advisor... UAE is appointing an AI minister; China investing bigly; UK has multiple investigations on AI. Meanwhile Trump retweeting this kind of stuff https://t.co/VyhwgU6Ap7 @gwern it being more sample efficient than individual humans would be far more annoying! @gwern yes, that seems obvious. I just read your original comment as saying it played less than individual humans. ur actual claim unobjectionable @gwern ah humanity as distinct from humans. makes more sense than how I read it @gwern million = more than humans play afaik. Paul Christiano on AlphaGo Zero as a concrete example of his idea of “capability amplification”: https://t.co/mKUWcWdZir Congrats!! Huge get for PAI. https://t.co/lvdtXgPe2Z RT @terahlyons: Personal news: I'm thrilled to join @PartnershipAI as the first Exec Director. Looking forward to building the team! https:… RT @DeepMindAI: Team #AlphaGo are honoured to be recipients of the inaugural Marvin Minsky Medal. Thank you @qiangyang and all at the IJCAI… The response to Brundage Bot's latest tweetstorm i was hoping for, and the one I actually had. Missed this one: https://t.co/yEkDVOTgpf https://t.co/B5CKxhE8aP Submit your Q’s! Cc @gwern https://t.co/cBphBMUyAq RT @andrefsmachado: "Should we fear the future? Is it rational to be optimistic about artificial intelligence?" #FutureofAI #STOA @EP_Think… RT @BrundageBot: arXiv papers, October 19, 2017: @amaub @BrundageBot part of the prob is maybe that I sometimes dont tweet their papers but instead retweet their blog posts about it :) @tkasasagi @BrundageBot nice! :) Agree with Vlad Mnih in talk I ref'd before (also flagged in Import AI newsletter) that we feel close to, or already had, breakthrough here. ...much at OpenAI and Berkeley (also DM a bit and some other places). Two new OpenAI 1s: https://t.co/tSBLVxY6Ox + https://t.co/1U0OLC0lDe So much work RN in low-shot robot learning, sim-to-real transfer, and other things helpful in making learned robot behavior practical... @BrundageBot (answer to the first question was no, it was not posted on arXiv (today)...Reverse Judgment Day has been postponed) RT @geoffreyirving: According to the ELO estimates, the difference in strength between AlphaGo Zero and 9 dan pro is the same as between me… So, will the AlphaGo paper be on arXiv...and if so, will @BrundageBot tweet it? 🤖😬 @dennybritz @hardmaru good flight movie RT @washingtonpost: Trump offered a grieving military father $25,000 in a call, but didn’t follow through https://t.co/70XOL22v3i @TristanMiano @ESYudkowsky it resulted in about half @denizyuret @ESYudkowsky that too, tho core algo is also different @ESYudkowsky etc.* @ESYudkowsky various differences. 2 nets before, 1 now; MCTS more deeply integrated into net eval vs just a parameter that blends their contributions etv @jeremyphoward also some are DeepMind papers where I retweeted the corresponding blog post @jeremyphoward “cognitive deep machine can train itself” 🤔 @jeremyphoward some further down I can see why I didn’t tweet them - sketchiness. grandoise claims about novel/total ML solution RT @jeremyphoward: Want more @Miles_Brundage goodness? Here's a list of papers the bot is 80% sure he would have liked, but he hasn't tweet… @rbhar90 @DeepMindAI hmmm interesting @rbhar90 @DeepMindAI assuming RL makes sense at all there why?), why not bake in some priors even if weak. I’m missing something @rbhar90 @DeepMindAI I don’t get why this is the right line of attack for that sort of prob. why not superv. learning, UL, model-based RL..? @jeremyphoward yea some of these i was iffy on or could see why it’d be surprised, e.g. more theoretical stuff, or v applied @jeremyphoward but again, these are post hoc and i could see tweeting most or all of those under some circumstance @jeremyphoward prob discriminated against bc language of “attentions” in title weird/IEEE format stuff tends to not be as exciting as conference format @jeremyphoward and I had a rough policy of ignoring late arxiv submissions already on openreview unless super big edits/v up my alley. another case, I @jeremyphoward could see myself tweeting. Some weird cases: 1 I think I didn’t bc already explicitly or implicitly covered when it was on openreview (ICLR) @jeremyphoward or at least not much. besides forecasting/future, sounds like a lot of cyber stuff everyday i dont tweet. re other stuff, many of those I... @jeremyphoward have only read up through here so far (haven’t seen latest links u sent yet) but I’m not surprised that one surprised it bc no ML in title RT @jeremyphoward: Wow. My Arxiv abstract generator has learned to create different abstracts for different topics. (csni: networking; cscv… Especially timely now that the use of a residual net was shown to yield a 600 Elo point boost in the new AlphaGo: https://t.co/XpOXF9ko9O @jjvincent where’s this from @MartinThornber @sust_ai @DeepMindAI @nature that's a more complicated Q than I can answer on a bus RN :) This is the main idea of the new AlphaGo paper: https://t.co/a8QmDALslL @robinhanson agree their view (simply/op-ed form stated) is perhaps amenable such counterarg, just pushing back on attribution of more claims than there @robinhanson such events have happened (AP hacked, report of White House bombing -> stock crash), not clear why requires asymmetry to be “big” @robinhanson your sentence is obviously true, I just don't see the article hinging its arg/narrative on centralization anywhere. @sust_ai yep @robinhanson They talk about AI being autonomous and powerful, possibly >huuman, but examples (logging, stock trading) don't assume it's only such system "RT @hardmaru: AlphaGo Zero: Learning from scratch. Self-play strikes again! This is pretty cool. https://t.co/KIe2WwGSlc https://t.co/TkGOG…" RT @DeepMindAI: Our 2nd AlphaGo @nature paper! #AlphaGo Zero learns to master the game of Go 'tabula rasa', entirely from self play https:/… @robinhanson Article doesn’t seem to take position on ur second sentence. can see early part being read as foomy though. RT @negar_rz: @WiMLworkshop is selling out soon! Please consider registering asap if you are willing to join! #nips2017 #NIPS #WiML @jackclarkSF @OpenAI @ilyasut huh, seemed to be free on mobile reader version on iPhone but not full page @jackclarkSF @OpenAI @ilyasut do you have a nonpaywalled link? RT @jackclarkSF: What self-play systems tell us about AI safety: WSJ op-ed by @OpenAI @ilyasut & Dario Amodei: https://t.co/XTRb7RV2En My (brief) talk title: "Scaling Up Humanity: The Case for Conditional Optimism about AI." What do I mean???? Stay tuned... RT @ariehkovler: Trump has again forgotten that his official reason for firing Comey was that Comey was too hard on Clinton. https://t.co/f… @trevolafoam @DeepMindAI best wishes! @sust_ai @jeremyphoward @ayirpelle Cc @amaub I think I’ve been relatively consistent over time in what I find interesting but perhaps there has been some evolution I'll be in Brussels tomorrow speaking at this event on optimism and AI - should be livestreamed: https://t.co/TTfg2fseFs RT @DeepMindAI: Join David Silver & Julian Schrittwieser from our AlphaGo team for a @reddit AMA this Thursday @ 1800 BST. https://t.co/wTq… @amaub @madebyollin @hardmaru @BrundageBot @adam_will_do_it sounds good :) Adam, feel free to submit a cheerful but appropriate option if you feel like it haha @jeremyphoward @ayirpelle yeah, prob 2-4 but it’s hard to say, there’s some randomness :) @madebyollin @amaub @hardmaru @BrundageBot @adam_will_do_it ha, love it. maybe go with the first at least for now? RT @mat_kelcey: ( also, if you want to try to repro something like this you've got pybullet grasp env & https://t.co/wUxU13Njdo ) https://t… @amaub @hardmaru @jeremyphoward @Smerity @AllTooHueman @dennybritz @BrundageBot paging @adam_will_do_it @amaub nice catch! RT @BrundageBot: Domain Randomization and Generative Models for Robotic Grasping. Tobin, Zaremba, and Abbeel https://t.co/5R9Lp2m9gN RT @BrundageBot: Stochastic Variance Reduction for Policy Gradient Estimation. Xu, Liu, and Peng https://t.co/AbcI2blQH6 RT @catherineols: I wrote a summary of @_beenkim's Interpretable ML work. Addressing the gap btw we care about & what we can optimize: http… "Gradient-free Policy Architecture Search and Adaptation," Ebrahimi et al.: https://t.co/D4cEXRaP1C "Swish: a Self-Gated Activation Function," Ramachandran et al.: https://t.co/bRa2xOCugx Nice tweet selections from my botter half. I'll add two artisanal paper choices... https://t.co/OJVoDBsEn4 RT @BrundageBot: arXiv papers, October 18, 2017: "RT @amaub: New post on overconfidence w/ the results of 11k confidence calibration assessments taken on https://t.co/omPqh59Ujk https://t.c…" @Smerity @jeremyphoward @amaub @hardmaru @AllTooHueman @dennybritz @BrundageBot glad I’m moving from research to production so fast :P RT @negar_rz: It is too sad to see many female Iranian students with accepted papers in @WiMLworkshop /@nips2017 and they can't get the vis… RT @DeepSpiker: Cool application of empowerment! https://t.co/jM5EJVN5nc @y0b1byte now I just have to remember to retweet. And optionally throw in artisanal tweets. Easier than the other job :) RT @gillianmsmith: I am absolutely thrilled about this event, and deeply disturbed by the pushback on social media. We must to work to prom… RT @timhwang: While I’m always going to want research tweets artisanally hand-crafted by @Miles_Brundage, this is awesome: https://t.co/L3w… @y0b1byte well I will try to retweet my alter ego, so it should be effectively just one :P Brundage Bot repo ⬇️⬇️⬇️ https://t.co/jCEybUFiK1 @_jyan_ @BrundageBot ha CC @amaub I almost suggested this... RT @williamstome: A beautiful @NewYorker article on automation in manufacturing, with a wonderful cameo from Stefanie Tellex and co: https:… RT @BrundageBot: arXiv papers, October 17, 2017: Now help @amaub get the precision and recall higher, so I can rest easy in my retirement! And follow @BrundageBot :) https://t.co/XjJBLO1XON RT @jackclarkSF: AI chap automates AI researcher with AI twitter bot that tweets AI papers predicted* to be selected by the AI researcher.… @amaub @BrundageBot I think there's room for improvement - suggest any to @amaub - but it's a great start and will save me a lot of time and typing. Awesome stuff @amaub! I may retire from bulk tweeting/focus on artisanal paper comments and discussing my actual work :) Follow @BrundageBot ⬇️⬇️⬇️ https://t.co/3VKBbuZHBa RT @amaub: @hardmaru @AllTooHueman @dennybritz @jeremyphoward @Miles_Brundage @Smerity I trained a model + made it into a bot @BrundageBot.… @hardmaru I'll have what it's having @BayesForDays congrats! @tsimonite @davegershgorn you either die a hero or live long enough to be Terminator pic’d "RT @jackclarkSF: @mark_riedl Alright, I'm calling it: Cameron's Law: After enough media interest, any AI story gets a terminator picture. c…" "Inferring Mesoscale Models of Neural Computation," Thomas Dean: https://t.co/iGTAB1rsWz "Unsupervised Real-Time Control through Variational Empowerment," Karl et al.: https://t.co/KoTzZBQrPC "Generalization in Deep Learning," Kawaguchi, Kaelbling, and Bengio: https://t.co/cNQJ3xU3J7 @davegershgorn SHUT IT (Futurism) DOWN RT @fredwilson: "We now have 30,000 data scientists .... 100x more than any other hedge fund ... we are not yet two years old" https://t.c… RT @bipr: 1st Deep Learning and Security Workshop, at IEEE Symposium on Security & Privacy (Oakland). Paper due Dec 22. https://t.co/lHeeRe… Vlad Mnih gives a nice summary of several recent DeepMind DRL papers here: https://t.co/eJMzwd0i9y @sigfpe @gwern cc @jackclarkSF 💯 https://t.co/IgLg2Koq2R RT @vkrakovna: An excellent AI safety demo from FHI of an RL agent developing incentives to deceive humans to avoid being shut down https:/… @_rockt @UniofOxford congrats!! ...and there’s a decent chance (% increases a bit daily) he won’t. https://t.co/Au7adVKo7a @mbrendan1 I’m a big fan of The Heavens and the Earth: A Political History of the Space Age. @timhwang 👍👍 (as did Congress) Important to be clear then/now about what the actual goals/drawbacks of "racing" are. Prestige? Econ? Military? etc. Fin. ...whereas, in reality, US had a lot of advantages/wasn't optimizing for prestigious stuff pre-Sputnik/knew it was coming, media flipped out Reading about space race, and this "China's catching up on AI! AI arms race!" stuff is similar to (often exaggerated) Sputnik media coverage "RT @RikeFranke: More of this to come. Anti-drone tech for civilian infrastructure huge growth area. https://t.co/o1jdumWo4i" Fin. "Two-stage Algorithm for Fairness-aware Machine Learning," Komiyama and Shimao: https://t.co/WW4P1KQOXI "Hyperparameter Importance Across Datasets," van Rijn and Hutter: https://t.co/0hTnS0XupC "VGR-Net: A View Invariant Gait Recognition Network," Thapar et al.: https://t.co/OrgddpZpky "Combinatorial Multi-armed Bandits for Real-Time Strategy Games," Santiago Ontañón: https://t.co/9PFiOFYbuF "Deep Regression Bayesian Network and Its Applications," Nie et al.: https://t.co/6n9D1D2PFT Fast Top-k Area Topics Extraction with Knowledge Base," Zhang et al.: https://t.co/mfgC1ktK6w "WeText: Scene Text Detection under Weak Supervision," Tian et al.: https://t.co/yJcBrHOWDW "Anti-jamming Communications Using Spectrum Waterfall: A Deep Reinforcement Learning Approach," Liu et al.: https://t.co/fDnOE9OFW9 "A Method of Generating Random Weights and Biases in Feedforward NNs with Random Hidden Nodes," Grzegorz Dudek: https://t.co/QJN0h6tQVM "User Modelling for Avoiding Overfitting in Interactive Knowledge Elicitation for Prediction," Daee et al.: https://t.co/lfgbQTG7gF "Knowledge is at the Edge! How to Search in Distributed Machine Learning Models," Bach et al.: https://t.co/RmgGmwPFB0 "Graph Convolutional Networks for Classification with a Structured Label Space," Chen et al.: https://t.co/Ed9oJM4MJ9 "Object Classification in Images of Neoclassical Artifacts Using Deep Learning," Bermeitinger et al.: https://t.co/RVSLPboAGY "RAWSim-O: A Simulation Framework for Robotic Mobile Fulfillment Systems," Merschformann et al.: https://t.co/vMZ9YbegV4 "RADNET: Radiologist Level Accuracy using Deep Learning for HEMORRHAGE detection in CT Scans," Grewal et al.: https://t.co/iAKIoGqCLO "Planning, Fast and Slow: A Framework for Adaptive Real-Time Safe Trajectory Planning," Fridovich-Keil et al.: https://t.co/5OJ1wIfi82 "Can the early human visual system compete with Deep Neural Networks?," Dodge and Karam: https://t.co/idE9AuX7Hi "Identifying On-time Reward Delivery Projects with Estimating Delivery Duration on Kickstarter," Tran et al.: https://t.co/VXsaW8acl6 "HyperENTM: Evolving Scalable Neural Turing Machines through HyperNEAT," Merrild et al.: https://t.co/vtwtntOpzL "Explaining Aviation Safety Incidents Using Deep Learned Precursors," Vijay Janakiraman: https://t.co/XJKMQmQ3Vi "Social Attention: Modeling Attention in Human Crowds," Vemula et al.: https://t.co/vV0SPVL957 "Game-Theoretic Design of Secure and Resilient Distributed Support Vector Machines with Adversaries," Zhang and Zhu: https://t.co/vR5WsCg9p3 "Stochastic neural computation without noise," Jordan et al.: https://t.co/JajLunxfCL "Simulating the Ising Model with a Deep Convolutional Generative Adversarial Network," Liu et al.: https://t.co/hwxcTsu8Uq Insights on why ResNets work - "Residual Connections Encourage Iterative Inference," Jastrzebski and Arpit et al.: https://t.co/n4c1cyEgwj Looks helpful: "Recent Advances in Zero-shot Recognition," Fu et al.: https://t.co/CQFzsMvZzi "Deep Learning for Case-based Reasoning through Prototypes: A NN that Explains its Predictions," Li and Liu et al.: https://t.co/BFjP2BCpyu arXiv papers, Oct. 16 - "Bayesian Hypernetworks," @DavidSKrueger and Huang et al.: https://t.co/bsRk2Lgpop @kchonyc @hardmaru @AllTooHueman @dennybritz @jeremyphoward @Smerity yes, and easier w 280 chars too (less compression needed when long author/title names) but let me enjoy my human supremacy for a few days ;) @kchonyc @hardmaru @AllTooHueman @dennybritz @jeremyphoward @Smerity but the precision/recall for which papers is pretty good/getting better :) @kchonyc @hardmaru @AllTooHueman @dennybritz @jeremyphoward @Smerity you will (for near future) be able to differentiate from the text of tweet. I put thought into how to attribute authors/compress to 140 char "...latter often funded by DARPA/ONR/Army etc. and industry, not just NSF. Fin." And while I agree it's crazy NSF isn't ramping up AI support and US dropping the ball here, US also has strong private sector/academia still Everything from basic science to econ applications to gov't data discussed... diff answers re: China/US competitiveness arise from diff Qs Some fine points here but lots of AI "arms race" talk is quite vague/unhelpful... https://t.co/DB5AgVJWh0 @snagglechud not as much as I used to. most I just skim. def <5 full AI ones. most stuff I read isnt AI papers. @hardmaru @AllTooHueman @dennybritz @jeremyphoward @Smerity yes - in fact, this has been done! Stay tuned :-) @dennybritz @hardmaru @jeremyphoward @Smerity one person's hero is another person's twitter terrorist 🤬 @AdrianoCarmezim wheels are in motion... @jeremyphoward @hardmaru @Smerity I was iffy on that one, sorry to hear. And yep, will get right to the code thing, brb https://t.co/cd7OKze7st @KaiLashArul that’s how I feel scrolling through all my tabs RN. offloading that reaction to you :) @zehavoc @Smerity some or all were prob tweeted already, yeah. I don’t tweet everything, though, these are chosen bc look interesting/relevant to followers @hardmaru @Smerity already some randomness in the system (and just dropped a few more bc smerity’s complaint :) ) but this is many days worth so still a lot Fin. https://t.co/PrivxkREM4 "Predictive-State Decoders: Encoding the Future into Recurrent Networks," Venkatraman et al.: https://t.co/0ASONyBgFX "Expanding Motor Skills through Relay Neural Networks," Kumar et al.: https://t.co/J91A78J5zW "Learning to Generate Time-Lapse Videos Using Multi-Stage Dynamic Generative Adversarial Networks," Xiong et al.: https://t.co/OlvnWHSVhN "Class-Splitting Generative Adversarial Networks," Grinblat et al.: https://t.co/ChafThRH51 "Learning Complex Swarm Behaviors by Exploiting Local Communication Protocols with DRL," Huttenrauch et al.: https://t.co/Pu5vttFUlA "Feature Engineering for Predictive Modeling using Reinforcement Learning," Khurana et al.: https://t.co/cXQ5xQZ3WZ "Structured Probabilistic Pruning for Deep Convolutional Neural Network Acceleration," Wang et al.: https://t.co/kwIB2fTZAT "Perturbative Black Box Variational Inference," Bamler et al.: https://t.co/tWUnBuKNbL "The arXiv of the future will not look like the arXiv," Pepe et al.: https://t.co/zhoHmWdMMV "Learning Human Behaviors for Robot-Assisted Dressing," Clegg et al.: https://t.co/0zmEu8zCly "A Deep-Reinforcement Learning Approach for Software-Defined Networking Routing Optimization," Stampa et al.: https://t.co/i5hEBIT33P "Automatic Detection of Malware-Generated Domains with Recurrent Neural Models," Lison and Mavroedis: https://t.co/jw10l6ReHR "Cooperative Adaptive Control for Cloud-Based Robotics," Wensing et al.: https://t.co/Kvx98KifCX "Variational Memory Addressing in Generative Models," Bornschein et al.: https://t.co/DlrjBeLnfm "Agile Off-Road Autonomous Driving Using End-to-End Deep Imitation Learning," Pan et al.: https://t.co/hfvxNhDP32 "Visual Question Generation as Dual Task of Visual Question Answering," Li et al.: https://t.co/NlZlzIstGa "Revisiting Resolution and Inter-Layer Coupling Factors in Modularity for Multilayer Networks," Amelio and Tagarelli https://t.co/zop7UgpD78 "Playing for Benchmarks," Richter et al.: https://t.co/0jIlncZNeb "Dynamic Evaluation of Neural Sequence Models," Krause et al.: https://t.co/219RZyy9qZ "Orthogonal Weight Norm.: Solution to Optimization over Multiple Dependent Stiefel Manifolds in DNNs," Huang et al. https://t.co/ihTZVJs95Q "Feedforward and Recurrent Neural Networks Backward Propagation and Hessian in Matrix Form," Maxim Naumov: https://t.co/4ATgFjyKc5 "When is a Convolutional Filter Easy To Learn?," Du et al.: https://t.co/XkY1faBUcu "Iterative Policy Learning in End-to-End Trainable Task-Oriented Neural Dialog Models," Liu and Lane: https://t.co/fYqc0fUZRL "PrivyNet: A Flexible Framework for Privacy-Preserving DNN Training with A Fine-Grained Privacy Control," Li et al.: https://t.co/GFcK4SsYEk "DropoutDAgger: A Bayesian Approach to Safe Imitation Learning," Menda et al.: https://t.co/OtUqMBcsw6 "Robustness of Neural Networks against Storage Media Errors," Qin et al.: https://t.co/UNM0XVpOhO "A Survey of Machine Learning for Big Code and Naturalness," Allamanis et al.: https://t.co/QktXKxZYea "Human Understandable Explanation Extraction for Black-box Classif. Models Based on Matrix Factorization," Kim+Seo: https://t.co/JHKu9elf4C "Training Better CNNs Requires to Rethink ReLU," Zhao et al.: https://t.co/61GPjeqg3S "Compressing Low Precision DNNs Using Sparsity-Induced Regularization in Ternary Networks," Faraone et al.: https://t.co/xcjfujItwJ "Dynamic Oracle for Neural Machine Translation in Decoding Phase," Dou et al.: https://t.co/w3fB7SBZ7O "Incorrigibility in the CIRL Framework," Ryan Carey: https://t.co/pwimNKuVwW "Cartman: The low-cost Cartesian Manipulator that won the Amazon Robotics Challenge," Morrison et al.: https://t.co/eGBFDHQkzz "Sparse MDPs with Causal Sparse Tsallis Entropy Regularization for Reinforcement Learning," Lee et al.: https://t.co/l6cJCCnNgZ "Exploring Human-like Attention Supervision in Visual Question Answering," Qiao et al.: https://t.co/xv1UraXfDm "MetaLDA: a Topic Model that Efficiently Incorporates Meta information," Zhao et al.: https://t.co/5bey81eloG "Analogical-based Bayesian Optimization," Le et al.: https://t.co/PEeAiTlDCC "Human Action Forecasting by Learning Task Grammars," Han et al.: https://t.co/yxAq5fcOVX "Language Modeling with Highway LSTM," Kurata et al.: https://t.co/qEMnuAST9J "A Recorded Debating Dataset," Mirkin et al.: https://t.co/dyVQ2Gn34T "Learning to update Auto-associative Memory in RNNs for Improving Sequence Memorization," Zhang and Zhou: https://t.co/WivqLpby68 "Learning to Detect Violent Videos using Convolutional Long Short-Term Memory," Sudhakaran and Lanz: https://t.co/E4ssUmQHnE """Triangle Generative Adversarial Networks,"" Gan et al.: https://t.co/ZcbyB3L5CN Perfect author name" "MUFold-SS: Protein Secondary Structure Prediction Using Deep Inception-Inside-Inception Networks," Fang et al.: https://t.co/jWsnO1TTF5 "MuseGAN: Symbolic-domain Music Generation and Accompaniment with Multi-track Sequential GANs" Dong et al.: https://t.co/rt8X0z8PKM "Deep Graph Attention Model," Lee et al.: https://t.co/SNjbnmPF0L "Modeling Twitter Customer Service Conversations Using Fine-Grained Dialogue Acts," Oraby et al.: https://t.co/nR1Pexqr28 "To Go or Not To Go? A Near Unsupervised Learning Approach For Robot Navigation," Hirose et al.: https://t.co/tWl059pNYh "Long-Term Ensemble Learning of Visual Place Classifiers," Fei et al.: https://t.co/FDA7JiQG07 "Deep Automated Multi-task Learning," Liang and Shu: https://t.co/n3Gknk0pxI "Multi-Modal Multi-Task Deep Learning for Autonomous Driving," Chowdhuri et al.: https://t.co/ofpb42xPup "Mitigating Evasion Attacks to Deep Neural Networks via Region-based Classification," Cao and Wang: https://t.co/fgOJkt8s03 "Hierarchical Gated Recurrent Neural Tensor Network for Answer Triggering," Li and Wu: https://t.co/UsmV4E4UWN "Markov Brains: A Technical Introduction," Hintze et al.: https://t.co/wiirk0gTTm "Multi-Entity Dependence Learning with Rich Context via Conditional Variational Auto-encoder," Tang et al.: https://t.co/sbz760DRGN "Reinforcement Learning Based Conversational Search Assistant," Aggarwal et al.: https://t.co/dJ2H8O1fI6 "On Inductive Abilities of Latent Factor Models for Relational Learning," Trouillon et al.: https://t.co/ZMdb7IX3FK "Sim-to-real Transfer of Visuo-motor Policies for Reaching in Clutter," Zhang et al.: https://t.co/MbGbdcDR4O "Where to Focus: Deep Attention-based Spatially Recurrent Bilinear Nets 4 Fine-Grained Visual Recognition," Wu+Wang: https://t.co/S1NCPdWNYa "StairNet: Top-Down Semantic Aggregation for Accurate One Shot Detection," Woo et al.: https://t.co/lsl18uaz8V did not mean for that link to pop up :( "Toward a full-scale neural machine translation in production: the https://t.co/H5Dg09ebSZ use case," Levin et al.: https://t.co/BqCTNZGPUn "Stochastic Stability of Reinforcement Learning in Positive-Utility Games," Georgios Chasparis: https://t.co/qR1cRUOXsG "Microscopy Cell Segmentation via Adversarial Neural Networks," Arbelle et al.: https://t.co/7Tm8XcFYIs E^2BoWs: An End-to-End Bag-of-Words Model via Deep Convolutional Neural Network," Liu et al.: https://t.co/RvzfXCK215 "Fast YOLO: A Fast You Only Look Once System for Real-time Embedded Object Detection in Video," Shafiee et al.: https://t.co/vCt6FboT5N "Leveraging Distributional Semantics for Multi-Label Learning," Wadbude et al.: https://t.co/WHCQMUtQqy "Learning Depth-Three Neural Networks in Polynomial Time," Goel and Klivans: https://t.co/XpJr6YxnPS "Video Object Segmentation Without Temporal Information," Maninis et al.: https://t.co/NA81BrSCPy "Bayesian Optimization Using Domain Knowledge on the ATRIAS Biped," Rai et al.: https://t.co/yu9jNOJUne "Relevant Ensemble of Trees," Dawer and Barbu: https://t.co/cq0NK17g6I "Dynamic Capacity Estimation in Hopfield Networks," Sarup and Seok: https://t.co/dEb8VMMoLV "Agent-based Learning for Driving Policy Learning in Connected and Autonomous Vehicles," Wang et al.: https://t.co/yNQPvjuGrG "Deep Predictive Learning: A Comprehensive Model of Three Visual Streams," O'Reilly et al.: https://t.co/rn2M75VNo2 "The Impact of Local Geometry and Batch Size on the Convergence + Divergence of SGD," Vivak Patel: https://t.co/2JlG5idHex @Smerity I assure you this hurts me (/my fingers) a lot more than it hurts you :P "Normalized Direction-preserving Adam," Zhang et al.: https://t.co/bWS4UT8982 "Adapting the behavior of AI agents using neural signatures of subjective interest," Shih et al.: https://t.co/alqICucR2I "Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting," Yu et al.: https://t.co/IwdLSKsvzv "One-Shot Visual Imitation Learning via Meta-Learning," Finn et al.: https://t.co/DngEHo7TWt "A Framework for Generalizing Graph-based Representation Learning Methods," Ahmed et al.: https://t.co/pyzCxb3nFT "The Conditional Analogy GAN: Swapping Fashion Articles on People Images," Jetchev and Bergmann: https://t.co/U6rOc1iR8x "Interpretable Graph-Based Semi-Supervised Learning via Flows," Rustamov and Klosowski: https://t.co/P512KFfCbn "Analyzing Hidden Representations in End-to-End Automatic Speech Recognition Systems," Belinkov and Glass: https://t.co/Z19gKq8jQy "Differentially Private Mixture of Generative Neural Networks," Acs et al.: https://t.co/LPqPQgp42Z "Saliency Transformation Network: Incorporating Multi-stage Visual Cues for Pancreas Segmentation," Yu et al.: https://t.co/6eTcyN4tre "Mr. Jones -- Towards a Proactive Smart Room Orchestrator," Chakraborti et al.: https://t.co/KhJJiMI4kW "Efficient Multi-Task and Multi-Robot Transfer with Continued Learning," Pereida et al.: https://t.co/woXUsHRfze "MOLTE: a Modular Optimal Learning Testing Environment," Wang and Powell: https://t.co/68RBeNcJF5 "Using NLU in Context for Question Answering: Improving on Facebook's bAbI Tasks," John Ball: https://t.co/b4St188OF6 @Smerity and there's still a lot left :( after this I hope not to fall this behind again. slash there are automation plans 🤔🤖💯 "Learning Unknown Markov Decision Processes: A Thompson Sampling Approach," Ouyang et al.: https://t.co/GBOOpDijNO "When Waiting is not an Option: Learning Options with a Deliberation Cost," Harb et al.: https://t.co/wEmBo0KwHm "A2-RL: Aesthetics Aware Reinforcement Learning for Automatic Image Cropping," Li et al.: https://t.co/64JzvxFBQk "Learning to Segment Instances in Videos with Spatial Propagation Network," Cheng et al.: https://t.co/yp3tvpQY61 "Robustness Analysis of Visual QA Models by Basic Questions," Huang et al.: https://t.co/6RUx2YLvCs "KBLRN: End-to-End Learning of Knowledge Base Reps w Latent, Relational,+ Numerical Features," Garcia-Duran+Niepert: https://t.co/ZYl3vSTgWq "DiSAN: Directional Self-Attention Network for RNN/CNN-free Language Understanding," Shen et al.: https://t.co/0IcShJ4v8T "Unsupervised deep object discovery for instance recognition," Simeoni et al.: https://t.co/Xg8rFpIscz "Binary-decomposed DCNN for accelerating computation and compressing model without retraining," Kamiya et al.: https://t.co/pFKNuiZQJO "Denoising Autoencoders for Overgeneralization in Neural Networks," Giacomo Spigler: https://t.co/ITG3bWyUYW "MODNet: Moving Object Detection Network with Motion and Appearance for Autonomous Driving," Siam et al.: https://t.co/1vOYLwtwNN "General problem solving with category theory," Arjonilla and Ogata: https://t.co/dHEg5rViss "Global-Context Neural Machine Translation through Target-Side Attentive Residual Connections," Werlen et al.: https://t.co/5ywbzKdYnQ "Synthesizing Optimally Resilient Controllers," Neider et al.: https://t.co/dilvSGHI9h "Food Recognition using Fusion of Classifiers based on CNNs," Aguilar et al.: https://t.co/aeLjIl8cZd "MBMF: Model-Based Priors for Model-Free Reinforcement Learning," Bansal et al.: https://t.co/rLbeX5sCc0 "Autonomous Quadrotor Landing using Deep Reinforcement Learning," Polvara et al.: https://t.co/w8pLQHc6OG "Stack-Captioning: Coarse-to-Fine Learning for Image Captioning," Gu et al.: https://t.co/7bk5ndhkuY "TensorFlow Agents: Efficient Batched Reinforcement Learning in TensorFlow," Hafner et al.: https://t.co/dblwNvMGGn "Statistical Physics and Representations in Real and Artificial Neural Networks," Cocco et al.: https://t.co/DzlOdNsFry "Identifying Product Order with Restricted Boltzmann Machines," Rao et al.: https://t.co/BeTjYUOUpC "A computational hierarchy in human cortex," Diaconescu et al.: https://t.co/Wc2rj4BHCK "Deep Active Inference," Kai Ueltzhöffer: https://t.co/AbF5fNM3tp "Learning from lions: inferring the utility of agents from their trajectories," Cobb et al.: https://t.co/is6HcOviND "Approximating meta-heuristics with homotopic recurrent neural networks," Bay and Sengupta: https://t.co/GekqtfTXo6 "A deep generative model for gene expression profiles from single-cell RNA sequencing," Lopez et al.: https://t.co/mksYlGHRU3 "On Fairness and Calibration," Pleiss et al.: https://t.co/MmIzKp7vGV "CausalGAN: Learning Causal Implicit Generative Models with Adversarial Training," Kocaoglu et al.: https://t.co/qBZVsvsiku "Using Posters to Recommend Anime and Mangas in a Cold-Start Scenario," Vie et al.: https://t.co/NTfPt6YiIG "The Unintended Consequences of Overfitting: Training Data Inference Attacks," Yeom et al.: https://t.co/61bStyD7di "Boosting Deep Learning Risk Prediction with GANs for Electronic Health Records," Che et al.: https://t.co/HFt5UpEvsV "Unsupervised Generative Modeling Using Matrix Product States," Han et al.: https://t.co/vzRpVWQ5Vc "Neural Networks Regularization Through Class-wise Invariant Representation Learning," Belharbi et al.: https://t.co/iGEAa5ex7G "Learning to Compose Domain-Specific Transformations for Data Augmentation," Ratner et al.: https://t.co/2OVKI2toBp "Optimal Sub-sampling with Influence Functions," Ting and Brochu: https://t.co/5pz3RmeBNc "Symmetric Variational Autoencoder and Connections to Adversarial Learning," Pu et al.: https://t.co/kfE7qRhpwl "Deep and Confident Prediction for Time Series at Uber," Zhu and Laptev: https://t.co/gC9nO2C6GY "Convolutional Gaussian Processes," van der Wilk et al.: https://t.co/RAz9uFVWim "Deep learning from crowds," Rodrigues and Pereira: https://t.co/8nOetZYZgJ "Interacting Attention-gated Recurrent Networks for Recommendation," Pei et al.: https://t.co/wWr0O8McOS "Optimizing for Measure of Performance in Max-Margin Parsing," Bauer et al.: https://t.co/NHpNZT0uO1 "Sequence Prediction with Neural Segmental Models," Hao Tang: https://t.co/2disMGrEz2 "A Class-Enhanced Attentive Response Approach 4 Explaining+Visualizing DL-Driven Stock Market Prediction"Kumar et al https://t.co/n60PP1fBj9 "Improving Landmark Localization with Semi-Supervised Learning," Honari et al.: https://t.co/u1ocHPGFUD "Deep Ordinal Ranking for Multi-Category Diagnosis of Alzheimer's Disease using Hippocampal MRI data," Li et al.: https://t.co/IjzP2PbJwm "Dynam. Multiscale Tree Learning Using Ensemb Strong Classifiers 4 Multi-label Seg of Med Imgs w Lesions"Amiri et al https://t.co/7QuTCKDA9E "Machine Learning and Social Robotics for Detecting Early Signs of Dementia," Jonell et al.: https://t.co/HEF38YJSiT "PageNet: Page Boundary Extraction in Historical Handwritten Documents," Tensmeyer et al.: https://t.co/aG0u3LdAmG "Deep Learning Techniques for Music Generation - A Survey," Briot et al.: https://t.co/iq2I1OBCoo "Exploring and Exploiting Diversity for Image Segmentation," Payman Yadollahpour: https://t.co/U0MBSEOOWv "Using Cross-Model EgoSupervision to Learn Cooperative Basketball Intention," Bertasius and Shi: https://t.co/0jpTBTUskt "Deep Convolutional Neural Network for Age Estimation based on VGG-Face Model," Qawaqneh et al.: https://t.co/7NSpYdx6hz "A Neural Lang Model for Dynamically Representing the Meanings of Unknown Words+Entities in a Discourse"Kobayashi ea https://t.co/WcbcNi3n4d "Probabilistic Rule Realization and Selection," Yu et al.: https://t.co/1AMoYb5IJu "BranchyNet: Fast Inference via Early Exiting from Deep Neural Networks," Teerapittayanon et al.: https://t.co/udkclahI8X "Semi-Supervised Recurrent Neural Network for Adverse Drug Reaction Mention Extraction," Gupta et al.: https://t.co/3z44pljNxK "Group-level Emotion Recognition using Transfer Learning from Face Identification," Rassadin et al.: https://t.co/J53CiU1is9 "Scene Text Recognition with Sliding Convolutional Character Models," Yin et al.: https://t.co/CZ7tNy4tLK "Information-Propogation-Enhanced Neural Machine Translation by Relation Model," Zhang et al.: https://t.co/B79C9IWf8A "On-the-fly Historical Handwritten Text Annotation," Vats and Hast: https://t.co/ArNSb607Md "Cross-Domain Image Retrieval with Attention Modeling," Ji et al.: https://t.co/Dw4Xsr7oHP "Radial Line Fourier Descriptor for Handwritten Word Representation," Hast and Vats: https://t.co/gYG26ZZN1i "Interakt---A Multimodal Multisensory Interactive Cognitive Assessment Tool," Daniel Sonntag: https://t.co/k8ZhxulrBd "CNN-Based Projected Gradient Descent for Consistent Image Reconstruction," Gupta et al.: https://t.co/qVcxNdaQqk "Soft Proposal Networks for Weakly Supervised Object Localization," Zhu et al.: https://t.co/5seh1ptC4S "An inner-loop free solution to inverse problems using deep neural networks," Wei et al.: https://t.co/5UxkWY2D5V "Synthetic Medical Images from Dual Generative Adversarial Networks," Guibas et al.: https://t.co/NXFjmXanjm "Language Modeling by Clustering with Word Embeddings for Text Readability Assessment," Cha et al.: https://t.co/XSmxYLyzLv "Polar Transformer Networks," Esteves et al.: https://t.co/wkl75b7bfP "Towards Neural Machine Translation with Latent Tree Attention," @jekbradbury and @RichardSocher: https://t.co/UDwsodvTej "Linking Generative Adversarial Learning and Binary Classification," Akshay Balsubramani: https://t.co/133gj7FVR9 "Continuous-Time Flows for Deep Generative Models," Chen et al.: https://t.co/ecW3qmGx3q "Stochastic Gradient Descent: Going As Fast As Possible But Not Faster," Schoenauer-Sebag et al.: https://t.co/hbLPBnFBAl "A Generic Approach for Escaping Saddle points," Reddi et al.: https://t.co/IpeEelamEy "WRPN: Wide Reduced-Precision Networks," Mishra et al.: https://t.co/BsikFRgY4T "Provably Fair Representations," McNamara et al.: https://t.co/5zr8qzMsjo "Sum-Product-Quotient Networks," Sharir and Shashua: https://t.co/UnN7wguTQu "Deep Reinforcement Learning: Framework, Applications, and Embedded Implementations," Li et al.: https://t.co/amFJsdsMGO "Mean Actor Critic," Asadi et al.: https://t.co/qk328knSxU "A Unified Query-based Generative Model for Question Generation and Question Answering," Song et al.: https://t.co/wfggowg3Un "Lensless-camera based machine learning for image classification," Kim et al.: https://t.co/2YfQItIKqC "PassGAN: A Deep Learning Approach for Password Guessing," Hitaj et al.: https://t.co/y8ESQHQCwg "End-to-End Multi-View Lipreading," Petridis et al.: https://t.co/ORUsjJlqsJ "Arc-Standard Spinal Parsing with Stack-LSTMs," Ballesteros and Carreras: https://t.co/m1ejo8PtNk "Computing Stable Models of Normal Logic Programs Without Grounding," Marple et al.: https://t.co/XEQl9Q50lF "Unsupervised learning through one-shot image-based shape reconstruction," Jayaraman et al.: https://t.co/VQHjcajsz1 "Learning to look around," Jayaraman and Grauman: https://t.co/IqdK5WVMUm "Learning Loss for Knowledge Distillation with Conditional Adversarial Networks," Xu et al.: https://t.co/JIysQAHeCh "Learning Dense Facial Correspondences in Unconstrained Images," Yu et al.: https://t.co/3JDvCXKs1w "Patterns versus Characters in Subword-aware Neural Language Modeling," Takhanov and Assylbekov: https://t.co/AbotvASFVG "Grasping the Finer Point: A Supervised Similarity Network for Metaphor Detection," Rei et al.: https://t.co/ceitOVw394 "Deep Learning-Guided Image Reconstruction from Incomplete Data," Kelly et al.: https://t.co/6uHsRXPxCA "A Recurrent Enc.-Dec. Approach w/ Skip-filtering Connections 4 Monaural Singing Voice Separation," Mimilakis et al. https://t.co/nMscBhsvAo "Investigating how well contextual features are captured by bi-directional RNN models," Chawla et al.: https://t.co/PjKUfno0YI "Disentangling ASR and MT Errors in Speech Translation," Le et al.: https://t.co/6aSxGZmrZW "Deep rank-based transposition-invariant distances on musical sequences," Hadjeres and Nielsen: https://t.co/RutMMLZUe5 "Sushi Dish - Object detection and classification from real images," Oh et al.: https://t.co/zeTGLpStMU "Compressed Sensing MRI Reconstruction with Cyclic Loss in Generative Adversarial Networks," Quan et al.: https://t.co/08k74DlHt7 "Understanding the Logical and Semantic Structure of Large Documents," Rahman and Finin: https://t.co/kxItdpCjCD "From Review to Rating: Exploring Dependency Measures for Text Classification," Cunningham-Nelson et al.: https://t.co/K3RPkYE7bA "Hypothesis Testing based Intrinsic Evaluation of Word Embeddings," Nishant Gurnani: https://t.co/TV9bvB9EYd "Semi-supervised Learning with Deep Generative Models for Asset Failure Prediction," Yoon et al.: https://t.co/UVX6EGM2MK "Dataset Augmentation with Synthetic Images Improves Semantic Segmentation," Rajpura et al.: https://t.co/HoTdURuGEq "Theoretical Analysis of Stochastic Search Algorithms," Lehre and Oliveto: https://t.co/hMAYJJP05Z "Interactive Attention Networks for Aspect-Level Sentiment Classification," Ma et al.: https://t.co/puPJZ5TeQN "Neural Networks for Safety-Critical Applications - Challenges, Experiments and Perspectives," Cheng et al.: https://t.co/E3zK2smZCq "Automation of Android Applications Testing Using Machine Learning Activities Classification," Rosenfeld et al.: https://t.co/H4z7P5VXfv "ARIGAN: Synthetic Arabidopsis Plants using Generative Adversarial Network," Giuffrida et al.: https://t.co/XWVAwz046X "Audio-Visual Speech Enhancement based on Multimodal Deep Convolutional Neural Network," Hou et al.: https://t.co/XXdVebQNt7 "DR-RNN: A deep residual recurrent neural network for model reduction," Kani and Elsheikh: https://t.co/5nPLFWVe4G "Virtual Borders: Accurate Definition of a Mobile Robot's Workspace Using a RGB-D Google Tango Tablet," Sprute et al https://t.co/I9lRvGQaTD "SamBaTen: Sampling-based Batch Incremental Tensor Decomposition," Gujral et al.: https://t.co/EgDDzTXT88 "Number of hidden states needed to physically implement a given conditional distribution," Owen et al.: https://t.co/EoTAvZsiph "Learning Implicit Generative Models Using Differentiable Graph Tests," Djolonga and Krause: https://t.co/bMQNJeqxrC arXiv paper Giga-Thread, Catch Up Edition: "Domain-adaptive deep network compression," Masana et al.: https://t.co/BI7Yc8JT75 RT @histoftech: I have made a grave miscalculation https://t.co/nnqQ1tk1Up RT @TwitterMoments: At least 189 people have been killed after twin blasts in Somalia's capital Mogadishu. https://t.co/zmwi7taRDY RT @BodegaBot: These two ex-Facebook designers want to replace bagel shops with pattern recognition RT @BodegaBot: These two ex-Pinterest founders want to replace sake bars with surgical anaesthesia RT @BodegaBot: These two ex-Apple programmers want to replace sorority houses with stem cell treatments @hstone_ @BotJunkie @jackclarkSF @scienmag @robotopia don’t think so @rbhar90 @OpenAI cc @Aelkus @rbhar90 @OpenAI (not just military issue tho, and def not just US, also law enforcement) @rbhar90 @OpenAI lots of infrastructure (nets etc), or other high tech things which are being tested but will prob be expensive at scale @rbhar90 @OpenAI I think a lot of military folks are aware of this but no clear solution. requires either lots of potentially unsafe auton anti drone drones, @rbhar90 @OpenAI or much earlier - plagues of locust :) RT @evepeyser: me when my editor asks me when a draft of my article is coming in https://t.co/PLgYnliEpB Getting ready to clear out some arXiv tabs tonight or tom., I think... https://t.co/qzUgAt8ihm @jackclarkSF @davegershgorn Sophia-istry @azeem nah, not speaking to Lords. Spoke at an earlier APPG event, and submitted written evidence to Lords, though. @samim I tried reading the Exegesis...it was not the most readable. Sign of the times: my local police department submitted evidence to the Lords Select Committee on AI, mentions the Asilomar Principles. RT @JohnDanaher: BOOK LAUNCH: Some things you wanted to know about robot sex* (but were afraid to ask) https://t.co/ox4Z9wB7F9 https://t.co… @marwinsegler @jackclarkSF ah, seems you’re right - thanks! Deceptive they’re “verified” (“yes, it’s THAT sketchy Science site/twitter account”) RT @EBKania: Despite China's ambitions to become major S&T power, systemic fraud remains major issue, as retractions reflect. https://t.co/… RT @robinhanson: A focus on collecting more ideas is harmful; "the bulk of the work and creativity is in that idea’s augmentation and refin… My fave tweet of 2017 so far prob. https://t.co/98HT6JV8Uw @jeremyphoward @robinsloan yeah just off top of head, some plausible economies of scale=IT infra, machine/transfer learning across abuse types, tagging/labor infra etc @robinsloan need to actually read @alexismadrigal’s piece now tho :) @robinsloan (though I suspect in reality their biz model could support it and theyre just not spending on the right things) @robinsloan and prob less cost effectively. But maybe biz model doesnt support enuf expansion, in which case diff model or nat’zation might make sense.. @robinsloan seems unlikely to me that decentralization is the answer given economies of scale here. If split in n parts, those parts still need 2 police "RT @VincentCMueller: Philosophy & Theory of AI 2017 conference programme is ready - speakers from around the world! https://t.co/i6ZCXlKRz8…" @jackclarkSF @scienmag @BotJunkie or someone like @BotJunkie ... @jackclarkSF @scienmag i dunno but I think @BotJunkie said it’s fake RT @ylecun: PyTorch implementations of various RL procedures: Advantage Actor Critic (A2C), Proximal Policy Optimization... https://t.co/uC… @scienmag Science, what are you doing RT @awasunyin: Why @openminedorg is becoming a role model for open-source projects, their evolution still amazes me! https://t.co/b3iT54tjf… Need editingspiration; please send. RT @RichardEngel: Why would North Korea negotiate on its nuclear program if US walks away from a deal international agencies say Iran is li… Performance not perfect, but still... impressive for <30 minute demo in each case. Also cool that auxiliary losses helpful. CC @jackclarkSF Compare table in this paper with 15 year (from 2016) goal from US Robotics Roadmap and ponder econ. implications. 🤔 https://t.co/TXwAZtUK8q https://t.co/0awJSaDQ0Z RT @richardcraib: My AMA on r/ethereum begins soon. Ask me anything. https://t.co/tkoxqdli2Y RT @_samr: Very bold move from @OxfordCity! "Oxford set to become first place in the UK to ban all petrol and diesel vehicles" https://t.co… RT @numerai: New master plan and roadmap: https://t.co/0ZtJmIK27z RT @ryan_t_lowe: We are open-sourcing the multi-agent particle environments used for our work @OpenAI! Uses Python + Gym interface: https:/… RT @2020science: New report on Genome Editing & Artificial Intelligence, by former @ASU_SFIS student Walter Jonson & @EleonorPauwels https… RT @jane__bradley: BuzzFeed is launching a push to root out other Harvey Weinsteins, in any industry. Tell us who they are (DMs open) https… RT @red_abebe: One more day! Submit your work/travel grants and hope to see you all in Long Beach! #AI #MachineLearning #BlackinAI https://… "Using Task Descriptions in Lifelong Machine Learning for Improved Performance and Zero-Shot Transfer," Isele et al: https://t.co/JsbJUyU0kt "Long-range Robotic Navigation Tasks by Combining Reinforcement Learning and Sampling-based Planning," Faust et al.: https://t.co/P7neoiqOOJ "Is Epicurus the father of Reinforcement Learning?," Eleni Vasilaki: https://t.co/Iw202p2CPp "Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperation," Zhang + McCarthy et al: https://t.co/LIdyJXLUrJ RT @y0b1byte: When you’ve tried everything, but it still doesn’t work, try this. Worked for me. https://t.co/zvuFXQKXE8 RT @zacharylipton: Congrats to Regina Barzilay for wining MacArthur! She gave an inspiring talk at MLHC this year, good to see the wider wo… @Ox_CyberSec dunno, I haven't played it yet! :) Includes written evidence I co-authored with Allan Dafoe on behalf of @FHIOxford: https://t.co/LuaWuhjX1C RT @LordsAICom: We've read it all, now its your turn. Find the written evidence submitted to our inquiry here: https://t.co/g5K0TyPe3T. htt… RT @OpenAI: AIs which develop faking, tackling, blocking, kicking through self-play: https://t.co/Ml4AAqFa67 "RT @j2bryson: Apparently referencing also our Science paper! https://t.co/2fpJRIrm7A Ht @Miles_Brundage https://t.co/E8dESrQ0ej" @j2bryson I think I’ll see you in DC soon too :) @j2bryson Oxford :) @j2bryson @natashajaques @StephenAtHome @aylin_cim @random_walker @conjugateprior yep thats from the show. Didn’t go into detail though. See link above. RT @natashajaques: Stephen Colbert covering Elon Musk's comments on AI, and some DeepMind research https://t.co/5KG4LxhITA @natashajaques with @j2bryson cameo! https://t.co/7XTF4FIq2r RT @juliagalef: London coffee houses in 1711 apparently had a lot in common with Silicon Valley coffee houses in 2017: https://t.co/6TSaI3u… RT @blakehounshell: This is, to be kind, an unusual argument for tax cuts. https://t.co/AJDiK2ko5d RT @hardmaru: This @OpenAI paper also trained humanoids to develop strategies for sumo wrestling. Check out more video demos here: https://… RT @Kaepernick7: I appreciate you @Eminem ✊🏾 https://t.co/nwavBwsOkQ @rebecca_roache kind of like Logan’s Run but with a happier ending. RT @animesh_garg: Our new paper on Neural Task Programming: Learning to Generalize Across Hierarchical Tasks https://t.co/0eAueiNL4w https:… Fin. "full-FORCE: A Target-Based Method for Training Recurrent Networks," DePasquale et al.: https://t.co/nPG6kr20vO "Forecasting Across Time Series Databases using LSTM Networks on Groups of Similar Series," Bandara et al.: https://t.co/VHvGxJTJq8 "Function space analysis of deep learning representation layers," Elisha and Dekel: https://t.co/GMxPEIIFqp "α-Variational Inference with Statistical Guarantees," Yang et al.: https://t.co/qUlRXosUnc "Iterative PET Image Reconstruction Using Convolutional Neural Network Representation," Gong et al.: https://t.co/5a2bjgSa70 "An Analysis of Dropout for Matrix Factorization," Cavazza et al.: https://t.co/vfADk3vqO5 "Meta Inverse Reinforcement Learning via Maximum Reward Sharing for Human Motion Analysis," Li and Burdick: https://t.co/8JsZEEGbxI "Learning to Generalize: Meta-Learning for Domain Generalization," Li et al.: https://t.co/F9uDkWFT56 "On- and Off-Policy Monotonic Policy Improvement," Iwaki and Asada: https://t.co/8JxvnKkaKn "iVQA: Inverse Visual Question Answering," Luo et al.: https://t.co/LJ0wx0y9ft "Energy-efficient Amortized Inference with Cascaded Deep Classifiers," Guan et al.: https://t.co/2BOU41FCIE Nice idea - "Checkpoint Ensembles: Ensemble Methods from a Single Training Process," Chen et al.: https://t.co/qY7KE0iGYx "Coreset based Dependency Networks," Molina et al.: https://t.co/VipGH92ISU "Sum-Product Networks for Hybrid Domains," Molina et al.: https://t.co/9g2RrL40SK "Standard detectors aren't (currently) fooled by physical adversarial stop signs," Lu et al.: https://t.co/sRI30IlCNs "What does Attention in Neural Machine Translation Pay Attention to?," Ghader and Monz: https://t.co/JHP8ShFQEQ "Real-Time Action Detection in Video Surveillance using Sub-Action Descriptor with Multi-CNN," Jin et al.: https://t.co/eb6eZt6vVx "AdaDNNs: Adaptive Ensemble of Deep NNs for Scene Text Recognition," Yang et al., U. of S+T Beijing/Tencent: https://t.co/AlkAHitB55 "Network of Recurrent Neural Networks," Chao-Ming Wang: https://t.co/iv9wJyzUQX "Learning to Rank Question-Answer Pairs using Hierarchical Recurr. Encoder with Latent Topic Clustering," Yoon et al https://t.co/bIzd14iZ21 "A Very Low Resource Language Speech Corpus for Computational Language Documentation Experiments," Godard et al.: https://t.co/O0qcM00V9C "Fast and Strong Convergence of Online Learning Algorithms," Guo and Shi: https://t.co/UJMxvMoa3Y "Mixed Precision Training," Narang and Micikevicius et al., Baidu/NVIDIA: https://t.co/hqe6xbFDuC "Confidence through Attention," Rikters and Fishel: https://t.co/6ioDWxWKB5 "Safe Semi-Supervised Learning of Sum-Product Networks," Trapp et al.: https://t.co/STvqOGVGtE "High-dimensional dynamics of generalization error in neural networks," Advani and Saxe: https://t.co/M1q6V3TnYl "Continuous Adaptation via Meta-Learning in Nonstationary and Competitive Environments," Al-Shedivat et al.: https://t.co/C6wBaovch0 Some fun videos: https://t.co/FANiDXQEf0 arXiv papers, October 11 - "Emergent Complexity via Multi-Agent Competition," Bansal et al., OpenAI: https://t.co/WzVVMRKtRB RT @anildash: This is the actual footage I saw when I watched Zuckerberg's virtual tour of Puerto Rico. (Background is survivors on the isl… RT @ClickHole: Office Of The Future: Researchers Predict That Over 50 Percent Of Workplace Discrimination Will Be Automated By 2040 https:/… RT @mark_riedl: … @santiontanon clarifies: https://t.co/x4gxZOqWfL https://t.co/yK2jN4p4gs RT @pabbeel: Deep RL Bootcamp lecture videos and labs release https://t.co/XNUmQ5SHkx! :) [Organized by @pabbeel, Peter Chen, Rocky Duan,… RT @benjaminwittes: What in earth does this tweet even mean? I quite literally cannot make sense of it. https://t.co/BIbn47Oqxx Parkinson’s Law for AI: the complexity of a deep learning experiment expands to fill the compute available in 2 wks. https://t.co/5q9UMJ5Xbq Never forget Comey trying to blend in with curtains so Trump wouldn’t talk to him. https://t.co/lvCDEunYL3 RT @poolio: Interesting theoretical results (and fun name) for a constrained form of neural networks where weight vectors lie on a finite s… @jjvincent shut it down!! @interwound not that I’m familiar with. sorry! "Socially-compliant Navigation through Raw Depth Inputs with Generative Adversarial Imitation Learning," Tai et al.: https://t.co/90FD9pbJ7d "MSC: A Dataset for Macro-Management in StarCraft II," Wu et al.: https://t.co/M9SujgMoZ9 RT @Malala: 5 years ago, I was shot in an attempt to stop me from speaking out for girls' education. Today, I attend my first lectures at O… RT @nonsensews: @Miles_Brundage Awesome I didn't knew that about cpac, here is against PurpleWave on the tournament https://t.co/BvkVeKS6Kj (60% confidence) and the descriptions here don't mention it. The 4th place entry, from the Chinese Academy of Sciences, did, however. Seems from slides here https://t.co/4dUDPVj87A that my 2017 StarCraft forecast resolved negatively: I said one of top 3 bots would use DL... RT @fastml_extra: Remember that sensational DQN? It's the grey line at the bottom https://t.co/YDz2qVzH9d "Nobody could have..." (video of people doing more). https://t.co/zcMsEJyi2L Median for Rainbow is 223%, vs. my 300-500 forecast for end of the year. Still pretty bullish: see bajillion areas for improvement in paper. (which is to say, steady progress by that measure) Very roughly (from eyeballing graphs + averaging some figures), Rainbow is 21% subhuman, 35% human, 44% superhuman. https://t.co/1ARgKzQt7c Yes, Hessel et al., the mean is potentially less informative, but I made forecasts for it, so will have to calculate myself :( https://t.co/DhKnp8hDX5 "Rainbow: Combining Improvements in Deep Reinforcement Learning," Hessel et al., DeepMind: https://t.co/AERstqVfml @j2bryson https://t.co/T2Xn1VKaPi @j2bryson there is a Google thing: https://t.co/taLN4EVKbp Musk said on twitter he could help with power, Governor said let’s talk, they talked RT @NoahShachtman: The Hill, apparently unfulfilled by rewriting today's stories, is now "aggregating" a story of mine from 2011. https://t… RT @zeynep: "Profile" after profile asks: why did he do it? MOST DO IT PARTLY SO YOU'LL WRITE THOSE FRONT PAGE PROFILES AND PLAY THE SNUFF… RT @zeynep: Another high profile "profile" that has no useful info of public interest besides "who knew?"—but helps incentivize the next ki… RT @leoxlzhao: @Miles_Brundage Due to dense population, companies mostly have offices with tight control of access and shared cafeteria or… Even experts well aware of ML limitations disagree a lot on the future of AI. That remains poorly explained. https://t.co/1Vp7HPjH75 Agree with point here re: deployment of robots, and to some extent re: some of these applying to non-experts, but... https://t.co/Nz79zqKt6G @FrankPasquale though charging is good if you want to then nudge people with prices based on calorie intake 🤔 @FrankPasquale well you could do that and still have it be free, or swipe ID badges :) seems like a solution in search of a problem/testbed "Or...just have the food be free, like other big tech companies? 🤖🤔 From interview with Baidu COO: https://t.co/RsKKlnoHyN https://t.co/LXhyRTv8n4" RT @ColinKahl: Just a reminder of what Trump has done to State👇. And when you lack a diplomatic instrument, all that's left is war. https:/… RT @y0b1byte: Finally decided to get into StarCraft. https://t.co/9mkQmB2sZs is an ongoing survey on SC research. Plan to update once a wee… @rbhar90 @patrickhop also quite skeptical re: AI rights (e.g. population explosion->humans have ~0 influence) but agree worth thinking sooner rather than later @rbhar90 @patrickhop agree re: governance challenge related to lack of expertise - some solutions discussed here https://t.co/Wr0j2qslNG @rbhar90 @patrickhop enjoying it! RT @rbhar90: Is artificial general intelligence imminent? @patrickhop and I discuss on our first AI livestream. Check it out! https://t.co/… RT @ColinKahl: Thread 👇 https://t.co/8MUyAjXolW "RT @HayesBrown: The US policy towards North Korea today is [spins wheel] Prove To The Crazy Paranoid Regime They're Absolutely Right" RT @rebecca_roache: Arguing on Twitter with people who have 280 characters when you still have only 140 https://t.co/kFIk1N2QMe RT @mattmfm: GOP, literally: Hillary Clinton is to blame for Weinstein harassing women but Donald Trump isn't to blame for Trump harassing… Jedi have a monopoly on the legitimate use of the Force. Pro-tip: if most interested in the utopia stuff and not picky about definition of games, skip chapters 4-12. @VincentCMueller could be cast as an empirical Q - run old algos on new HW. AFAIK not done yet, ppl just use the best available @VincentCMueller again, one could call all of this just details on A* and NNs..but that seems overly harsh to me. Much work went into new “ideas”/“details” @VincentCMueller and outside of DL proper, all sorts of heuristic search stuff, MCTS, UCB... @VincentCMueller Depends what you count. I’d count batch norm, LSTMs, experience replay, DQN, A3C... backprop could be seen as just making NNs (older) work RT @paul_scharre: Very excited to see this coming out in April 2018! "Army of None: Autonomous Weapons and the Future of War" https://t.co/… "RT @CassSunstein: What if the economics Nobel were awarded on the basis of real-world impact? Who would win? https://t.co/iqJzAzFJKY" RT @pabbeel: Beautiful explanation of Max-Ent Deep RL by Haoran Tang and Tuomas Haarnoja! Also model-free RL (from scratch) on real robot :… Planning to finish The Grasshopper: Games, Life, and Utopia this weekend. Quite a unique book. RT @dinapomeranz: Randomized experiment with 20,000 local public officials confirms everyday discrimination against Blacks across US: https… RT @GaryMarcus: Nature, nurture, and the future AI. Excellent write up of the @ylecun and @garymarcus debate. (Video to come soon.) https:… @_jyan_ they’re prob running out of RL ppl :P @_jyan_ nec. indicates accelerated growth. Growth was fast before, just local. Maybe just not big enough building :P @_jyan_ maybe. I suspect bigger probs with rate (besides prestige) are coordination and value alignment/culture. But either way, don’t think this... @_jyan_ not sure I follow Second Canadian DM office. https://t.co/43ZLkU2Mqi RT @DeepMindAI: We're opening a new research office in #Montreal, Canada, in collaboration with @mcgillu & led by Dr. Doina Precup: https:/… @robinhanson @calebwatney yes, my claim was too strong. More accurate would be: if I were making such a bet, I’d pay significant attn to political factors. @robinhanson more a political bet than a technological one - see https://t.co/b9gnLVLBon by @calebwatney “Neural Task Programming: Learning to Generalize Across Hierarchical Tasks,” Xu and Nair et al.: https://t.co/8eeudmKEM5 RT @katecrawford: Big news: Our first call for @AINowInstitute postdocs just went live! All disciplines welcome to apply. https://t.co/qAlJ… RT @timhwang: New job! Excited to be joining the Ethics and Governance of AI Fund as its Director. Announced earlier this year: https://t.c… RT @mundt_martin: Any1 know of any research on the relationship: learning rate<->CNN representational capacity? #MachineLearning #DeepLearn… @GoAbiAryan @KaiLashArul deserves >>credit :) @patrickc (not as optimistic as that presentation but still a rare case of planning for thousands of years in the future :) ) @patrickc a lot of thought has been given to making these comprehensible across future languages/cultures: https://t.co/kLxjhkheii @BenedictEvans why couldn’t they offer or rely on others’ use of summarization tools? Could still provide the best/cheapest hardware... @DaveChurchill got it - thanks! @DaveChurchill exciting! when will the results be announced? @cranchesco @y0b1byte very nice/good to know - thanks! (https://t.co/GTYnibURLB) I'm not clear on what it can do offline/how it's not just headphones attached to something w/ Google Translate... So Google's selling a Babelfish now, basically? @y0b1byte unfortunately I didn’t specify. despite trying to be falsifiable! @y0b1byte (for the purpose of my forecast, that is - i dunno when 30k would be possible but I think 120% tester is plausible this year) @y0b1byte yeah, my baseline for superhuman is just DeepMind’s tester, not best human. @y0b1byte also https://t.co/NxF8PXpJ5f @y0b1byte sure, here are a few (one not a paper, the other papers) - https://t.co/Zl4vJRwU8l and https://t.co/vcpZiqa4JJ and https://t.co/7skMQlf02A @y0b1byte I have not. I'm more confident about MR than StarCraft actually... there are already cases where (reported score at least) it's pretty good Seems about right... https://t.co/KVj1qykzDt @avdnoord very cool - congrats! RT @DeepMindAI: Last year WaveNet was a research project, today it launches in the @Google Assistant https://t.co/CuRBl92Hy2 https://t.co/X… RT @dandrezner: I will never write anything in the @washingtonpost as well as @WesleyLowery wrote this story. Shattering. https://t.co/K6kb… Great to see a big, multi-faceted commitment (in-house research, funding, etc.) to AI ethics/policy at DeepMind: https://t.co/sVzqS2uBJc RT @mustafasuleymn: Very excited to launch #DMES -understanding the social impact of AI & putting ethics into practice is essential... http… RT @DeepMindAI: Introducing DeepMind Ethics & Society, w/ @jeffdsachs, @dianecoyle1859, @cfigueres, #nickbostrom & more! https://t.co/hmNk0… @timhwang @nberpubs curious which you found most interesting! RT @rcalo: We Robot 2018 call for papers is live, people. https://t.co/YHMy9PZ0Hl Abstracts due November 6 """Neural Trojans,"" Liu et al.: https://t.co/UHxPt9GSuZ Reminiscent of BadNets: https://t.co/wXVKCrlCl1" RT @googleresearch: Check out Teachable Machine, which lets anyone explore machine learning live in the browser. Built with deeplearn.js ht… @generuso sure - but better ways to go about that than treating weak paper as factual (from an otherwise pretty good report on confidence-building measures for cyberspace - https://t.co/9DU6yqRBWu) TFW your editor asks you for more figures... https://t.co/vRKRNuhEPt @SmithaMilli cool :) btw, I meant Shafer-Landau, not Sinnott-Armstrong (philosophers with their double names starting with S's!) https://t.co/SE5GvLS5fv @SmithaMilli oh and social choice! :) @SmithaMilli (but many such classes are somewhat orthogonal so depends on prof)... sorry if TMI :) @SmithaMilli class-wise, I guess something like moral philosophy/ethics, science and tech studies intro, or science/engineering ethics, science policy @SmithaMilli maybe intro ethics book (think Sinnott-Armstrong has a food one)... maybe a machine ethics book (Machine Ethics)... @SmithaMilli would prob. add Science, Policy, and the Value-Free Ideal, one of Langdon Winner's books (The Whale + the Reactor, Autonomous Technology)... @SmithaMilli well there's the stuff at the bottom here :) https://t.co/ivoC1Y6dDY though a value alignment-related specific list might vary.. 🤔 The CHAI website also has a nice bibliography on AI safety-related stuff: https://t.co/p9JJ1dPqVj (I'd also throw in some moral philosophy, science and technology studies, science policy, etc. but seems like a good list on technical side) Recommended courses for one interested in aligning AI with human values, from Stuart Russell and Anca Dragan: https://t.co/gEhM26j7wp https://t.co/F1AwIyY0bJ @TheAnnaGat rest assured, I am very pro paper :) @TheAnnaGat well, yeah. and reading PDFs before the power runs out :) I don't know why planes stopped having WiFi but it's great for productivity. ✈️ RT @goodfellow_ian: Google Brain Residency has been upgraded to Google AI Residency. Now possible to work with more AI teams at Google. htt… RT @DeepMindAI: RL meets neuroscience in our new @NatureNeuro paper: the hippocampus as a predictive map https://t.co/XrebyL0298 RT @KaiLashArul: Version 2 (arXiv extended ver.) of A Brief Survey of Deep Reinforcement Learning w/ @mpd37 & @Miles_Brundage: https://t.co… To be continued... "Explainable Planning," Fox et al.: https://t.co/CadstHN1O0 "Convergence Analysis of Distributed Stochastic Gradient Descent with Shuffling," Meng et al.: https://t.co/mMCejKNUbN "DAGGER: A sequential algorithm for FDR control on DAGs," Ramdas et al.: https://t.co/CSZop7wlIO ...deep RL with human feedback and/or demos is so hawt right now... "Deep TAMER: Interactive Agent Shaping in High-Dimensional State Spaces," Warnell et al.: https://t.co/IQkiKeWlgy "Neural and Synaptic Array Transceiver: A Brain-Inspired Computing Framework for Embedded Learning," Detorakis et al https://t.co/PXcAuh5KAR "Self-supervised Deep Reinforcement Learning with Generalized Computation Graphs for Robot Navigation," Kahn et al.: https://t.co/vVplffmRbI "Vision-based deep execution monitoring," Puja et al.: https://t.co/IzgvDz7uaj "On the Capacity of Face Representation," Gong et al.: https://t.co/StpeK9OXCI "The BURCHAK corpus: a Challenge Data Set for Interactive Learning of Visually Grounded Word Meanings," Yu et al.: https://t.co/m6NZSI7Bt0 "The First Evaluation of Chinese Human-Computer Dialogue Technology," Zhang et al., Harbin/iFLYTEK: https://t.co/1HoiPotEW5 "A Neural Comprehensive Ranker (NCR) for Open-Domain Question Answering," Bi and Ma: https://t.co/xomzXC1fvJ arXiv papers, October 2 - "Ground-Truth Adversarial Examples," Carlini and Katz et al.: https://t.co/x3KuG9B63d "Collateral Visibility: A Socio-Legal Study of Police Body Camera Adopn, Privcy+ Pub. Disclosure in WA State"-Newell https://t.co/PgnYY07WfO @gwern I'm not that familiar w/ history of self-play but GANs def deserve a place on any list of recent big ideas. RT @rosenbergerlm: Once again, Trump undermining his own Admin's efforts to implement a strategy on North Korea. Here's my piece from Aug o… ...various tricks to get those to work, which in turn build on lots of work in AI community, and novel integration. AI !=DL !=backprop. Fin. Article about AI you've "heard about" - AlphaGo presumably counts, used many ideas from last 30 years, in/out of DL (convnets, MCTS). Not to mention that there's stuff in AI besides deep learning...lots of big progress in planning, search etc. in last 30 years. AI ppl didn't just sit around for 30 years waiting for more compute/data. Continuing to get more out of given compute/data over time. And if you're going to Schmidhuber, go full Schmidhuber - backprop/deep learning stem from >>30 years ago anyway: https://t.co/O1U9RNv00N We know > now than 30 years ago- not just >data/compute. Batch norm, LSTMs, DQN etc. maybe not as "fundamental" as backprop but still ideas. While there's good stuff here on Hinton, Canada, etc, disagree with "AI is mostly just 30 year old ideas" narrative. https://t.co/lidMfK5dEz "RT @iamtrask: #OpenMined is now the 2nd Highest Trending Python Repo on Github!!!! Come Join!!! : https://t.co/uHjmaCmnXX https://t.co/q6z…" RT @jackclarkSF: China is making great strides in AI. But this kind of fuzzy, thinly-sourced, half-wrong reporting helps no one. Why you do… RT @ericgeller: Tom Price has resigned as HHS secretary. https://t.co/2GJkrQiIJN RT @GreggDCaruso: Derek Parfit submitted this draft paper on 1/1/17 and died unexpectedly in the early morning hours of 1/2/17. https://t.c… @halhod @rodolfor don't remember exactly :) but see https://t.co/Y9QYjVJlBf @halhod @rodolfor we'll see! There was actually a paper in AI Mag about Nobel Prize-enabling AI for science as grand challenge btw... @halhod @rodolfor yeah, they said they'd release code in 6 mos but by then long since surpassed...anyway, I could imagine what u said, we have diff intuitions @halhod @rodolfor what do you mean at same level of detail? DQN paper, hyperparameters, source code... dont think that paper is Nobel quality but v detailed @rodolfor @halhod right, there's a lag involved, but IMO it's quite clear there are many world class researchers at corps doing AI RT @sirajraval: A decentralized marketplace for training AI models that pays users for their data directly? The future is now! https://t.co… @halhod @rodolfor absolutely IMO, if they haven't already @halhod they have Turing Award winners "RT @iamtrask: Very big announcement today!!! Youtube Celebrity @sirajraval has just done a brilliant video on #OpenMined. https://t.co/c…" @erikbryn @erichorvitz @ylecun does Singapore count as a major city? :) RT @peterwsinger: 🤔 https://t.co/mjxmqRHoc2 RT @SpaceX: BFR is capable of transporting satellites to orbit, crew and cargo to the @Space_Station and completing missions to the Moon an… RT @elonmusk: Moon Base Alpha https://t.co/voY8qEW9kl Nice video: https://t.co/7GT1Vd4evi "Effective learning is accompanied by increasingly efficient dimensionality of whole-brain responses," Tang et al.: https://t.co/unOxi0jpj0 "Overcoming Exploration in Reinforcement Learning with Demonstrations," Nair et al.: https://t.co/JHm0rui2fv "Learning Complex Dexterous Manipulation with Deep Reinforcement Learning + Demonstrations," Rajeswaran+Kumar et al: https://t.co/yPwi5h4Xl0 (Edinburgh's submission to Alexa Prize competition) "Edina: Building an Open Domain Socialbot with Self-dialogues," Damonte/Dobre/Duma/Fainberg/Fancellu/Kahembwe et al: https://t.co/w6aJFrY0Tz "Premise Selection for Theorem Proving by Deep Graph Embedding," Wang and Tang et al.: https://t.co/uL1picxEVC "And some AIs, I assume, are good people..." - Donald Trump RT @NicolasPapernot: Consider submitting your work to the ML and Computer Security Workshop at NIPS! Deadlines on **Oct 22 and Nov 3**. htt… @DominicHKing hard to answer as I think things could go in many directions :) but e.g I like Interstellar and Person of Interest bc non-anthropomorphic AI RT @ruima: If u r an #AI startup, 69% chance u raise $ if you're in China, avg of 10 mos, vs just 51% & 15 mos in US #Feelstrue https://t.c… RT @erik_fisher: Journal of Responsible Innovation special issue on Technology Assessment https://t.co/R7KWXinrk3 @ASU_SFIS @CSPO_ASU @Paul… Seen two people today with "I don't need Google - my wife knows everything" t-shirts, in Oxford and London. 🤔 @rcalo 😢 RT @CarolLeonnig: This is a big deal. Chuck Rosenberg, known as smart manager, devoted law enforcer, leaves. Said he concludes Trump doesn'… "Glass-Box Program Synthesis: A Machine Learning Approach," Christakopoulou and Kalai: https://t.co/YmlMQ1dgjm "Can you fool AI w/ adversarial examples on a visual Turing test?," Xu et al https://t.co/TXGvcIeCGk (sometimes,+compositional ones >robust) "Converting Your Thoughts to Texts: Enabling Brain Typing via Deep Feature Learning of EEG Signals," Zhang et al.: https://t.co/afryjjTqaw "Active Learning amidst Logical Knowledge," Platanios et al.: https://t.co/iYsX3gVnWh "Generating Sentences by Editing Prototypes," Guu and Hashimoto et al.: https://t.co/wwDcDfAFfm "Tensor Product Generation Networks," Huang et al.: https://t.co/NwpEPPnq1B (interesting that author Li Deng is at Citadel now) RT @caitlin__kelly: 139 characters https://t.co/WkfdXL8oLh RT @ZekeJMiller: RIYADH, Saudi Arabia (AP) - Saudi Arabia says women will be allowed to drive for the first time. RT @FHIOxford: FHI is celebrating that we are able to eat cake 34 years later. Happy #PetrovDay https://t.co/3YhAV23wvr Rereading this great paper - "Accountable Algorithms," Kroll et al.: https://t.co/CdgCAdddex Accountable != transparent... @davegershgorn is this your handiwork? "RT @iamtrask: NEW TEAM!! - Federated & Decentralized Machine Learning for iOS & Android - join #team_mobile on our Slack Invite: https://t…" @davegershgorn fair This looks great: https://t.co/OXaIJY5tht RT @timhwang: Hosting a workshop with @goodfellow_ian and others on ML and deception at @NIPSConference this year. RFP now open! https://t.… @davegershgorn one could say that's overstated but there are other ethical issues that are real. Anyway, agree conflation bad, just didn't see smoking gun @davegershgorn I saw ur pt re: Google/agree, just not sure that there was such conflation. "All these ethical issues" could be e.g. AI value alignment... @davegershgorn maybe "all these ethical issues" really meant "any ethical issues" but seems like uncharitable read @davegershgorn seems like he just was getting on his soapbox about superintelligence, might agree with other things you said? RT @deepthings: I chat to @Miles_Brundage about AI, policy, jobs, humanity and the life of leisure @openDemocracy https://t.co/CuVmvMSwVV Happy Petrov Day! RIP. https://t.co/OD5rBCfJSb RT @paulkrugman: Trump blaming the victims in Puerto Rico, because of course he is https://t.co/xFhlswrXgD Didn't see this title/author pair coming- "The Consciousness Prior," Yoshua Bengio: https://t.co/V0zP3Jcads (not quite as wild as it sounds) @TheAnnaGat our meeting is cancelled now :P New Star Trek. Discuss. "RT @j2bryson: Of, for, & by the people: the legal lacuna of synthetic persons https://t.co/vOKx2ixPwL Bryson, Diamantis, & Grant #aiethics…" RT @laurenduca: The White House is shamelessly engaging in the very behavior that Trump repeatedly insisted should land his opponent in pri… @davegershgorn @jonathankoren Connectivity is also an issue for travelers. Could be addressed here w/ onboard processing or Kindle like cell situation "RT @hugo_larochelle: The Montreal AI Symposium (September 26th, tomorrow!) will be streamed live on YouTube. See our site for more info: ht…" RT @arnicas: SF alert: Ancillary Justice is 2.99 today on Kindle. Excellent! https://t.co/vUOkokRcup RT @RiffRaff1971: Ah well. https://t.co/qDbDjxIqBL RT @erwincoumans: GraspGAN, a new research paper using our https://t.co/tfiNIFexlz simulator, see the video at https://t.co/4ICdH6LsqW http… Really liking The Heavens and the Earth: A Political History of the Space Age. h/t @bleddb RT @zacharylipton: Paper deadline for 1st conference on Fairness, Accountability and Transparency ( FAT*) coming up: September 29th! https… RT @qjurecic: Careful drafting as always https://t.co/WJRFHyx3Ug "Using Simulation + Domain Adaptation to Improve Efficiency of Deep Robotic Grasping"-Bousmalis/Irpan/Wohlhart et al https://t.co/h0fUzJjtHo RT @dandrezner: Thank goodness Hillary Clinton, who made grievous email errors in office, is not the president of the United States. https:… RT @mustafasuleymn: This is truly staggering: Britain's most powerful elite is 97% white... this is truly staggering. https://t.co/t9m1oxE… @zacharylipton https://t.co/ASaypfX4WW RT @ArmsControlWonk: Starting a nuclear war surely violates the terms of service, right? https://t.co/hFVNwJpTCv RT @kibblesmith: Hi sorry to interrupt your dot dot dot but the American citizens of Puerto Rico don't have electricity or drinking water.… More detailed popularization/review here: https://t.co/Qx4wL9A90x TL;DR: formalizes idea of perfect justice being hard to attain/know about in advance, diversity/liberty good 4 exploring multiple pathways. Enjoyed "The Tyranny of the Ideal: Justice in a Diverse Society" by Gaus. Good read for folks who like political philosophy. RT @jonfavs: Yes, we know that Trump attacking black athletes is good politics for Trump. That's not some revelation, that's the whole fuck… RT @rbhar90: Why has AI not yet revolutionized drug discovery? Read my thoughts in my new blog post "Liquidity in Drug Discovery" https://t… RT @EmilyGorcenski: The most fragile person on Earth. https://t.co/C1pyeI6BsN RT @Savmasta: Bill Nye just walked into our elevator while I was snap chatting.. https://t.co/LwCOITAEft RT @sla: NVIDIA GPU P100 x 1,000 to accelerate our research & development! https://t.co/S4FZ06mJGf RT @goodfellow_ian: The NIPS Workshop on Machine Deception has an open call for papers: https://t.co/mH1uwt3RIx "RT @iamtrask: Excited to announce that in less than 36 hrs...we've gone from 480 to over 600 contributors on #OpenMined Slack!!! https://…" RT @hardmaru: Revisiting the Arcade Learning Environment: Evaluation Protocols and Open Problems. Nice review paper and discussion https://… RT @Walldo: Mark Zuckerberg on election interference in Nov 2016 vs September 2017. https://t.co/ZDrhGEsKhv RT @RyanDavidsonWX: Mayor of San Juan, Carmen Yulin Cruz, said Puerto Rico will be without power for 4 MONTHS. #Maria #SanJuan #PuertoRico Maybe 1st HTC AI paper I've seen... https://t.co/petVJklRC2 """Now we've got problems And I think we can solve em You made a really deep model And now we've got SAT solvers, hey"" https://t.co/tbXAYGNgXQ" Fin. "Updating the silent speech challenge benchmark with deep learning," Ji et al.: https://t.co/ljw3xW1WSV "UnDeepVO: Monocular Visual Odometry through Unsupervised Deep Learning," Li et al.: https://t.co/u1sJ1aeI6M "Open Source Dataset and Deep Learning Models for Online Digit Gesture Recognition on Touchscreens," Corr et al.: https://t.co/4BqyK7rOOB "De-identification of medical records using conditional random fields and LSTMs," Jiang et al.: https://t.co/WCRM7bKTfd "Constructing a Hierarchical User Interest Structure based on User Profiles," Zhao et al.: https://t.co/jte91icE5Q "Bayesian Optimization with Automatic Prior Selection for Data-Efficient Direct Policy Search," Pautrat et al.: https://t.co/wEFNLk3Ab6 "Stock-out Prediction in Multi-echelon Networks," Oroojlooyjadid et al.: https://t.co/gfltc3cyIq "REACT to Cyber Attacks on Power Grids," Solta et al.: https://t.co/T3Xx729N6I "Robust and Fast 3D Scan Alignment using Mutual Information," Mehta et al.: https://t.co/3FyMElg8cf "A PAC-Bayesian Analysis of Randomized Learning with Application to Stochastic Gradient Descent," Ben London: https://t.co/UuMYAAlNiB "Learning of Coordination Policies for Robotic Swarms," Li et al.: https://t.co/IGhc4reyDe "Curriculum Learning of Visual Attribute Clusters for Multi-Task Classification," Sarafianos et al.: https://t.co/9WFXOyOK5X "Dex-Net 3.0: Computing Robust Robot Suction Grasp Targets in Pt Clouds using a New Analytic Model + DL," Mahler ea https://t.co/l55evBu2r3 "Think Globally, Embed Locally --- Locally Linear Meta-embedding of Words," Bollegala et al.: https://t.co/k2PIwz7xv8 "A Voting-Based System for Ethical Decision Making," Noothigatu et al.: https://t.co/O1DsTCqYGm "Online Learning of a Memory for Learning Rates," Meier et al.: https://t.co/fYSyPlRFRc "Transfer learning from synthetic to real images using variational autoencoders for robotic applications"Inoue et al https://t.co/RBCuWJH1PE "Robust modulation of integrate-and-fire models," Van Pottelbergh and Sepulchre: https://t.co/nCylyABgtP "Investigating the Cognitive Processes Involved in Cancer Cell Image Identification," Trueblood et al.: https://t.co/iT6OByy9OZ "Integrating hyper-p.uncert. in a multi-fidelity Bayesian model 4 estimation of a prob. of failure," Stroh et al.: https://t.co/RDAbbzKeFR "Estimating model evidence using ensemble-based data assim. w/ localization - The model selection problem"-Metref ea https://t.co/2pa3u2ospQ "varbvs: Fast Variable Selection for Large-scale Regression," Carbonetto et al.: https://t.co/xsmoCvq7Sl "Deep Lattice Networks and Partial Monotonic Functions," You et al.: https://t.co/5glrbDz122 "An Expectation Conditional Maximization approach for Gaussian graphical models," Li and McCormick: https://t.co/1Lp2PZqhst "Bandits with Delayed Anonymous Feedback," Pike-Burke et al.: https://t.co/0QtdM9caam "Verifying Properties of Binarized Deep Neural Networks," Narodytska et al.: https://t.co/CVzbn3R0b7 "Text Compression for Sentiment Analysis via Evolutionary Algorithms," Dufourq and Bassett: https://t.co/p6uPbxJ4Y0 "An Attention-based Collaboration Framework for Multi-View Network Representation Learning," Qu et al.: https://t.co/yZtyCQ8494 "Improved prediction accuracy for disease risk mapping using Gaussian Process stacked generalisation," Bhatt et al.: https://t.co/JTyPVVsYPE "Spatial features of synaptic adaptation affecting learning performance," Berger et al.: https://t.co/40oPQhv5DE "Distributed Training Large-Scale Deep Architectures," Zou et al.: https://t.co/VFZQvPqz4L "Deep Reinforcement Learning that Matters," Henderson et al.: https://t.co/6FIrNyI8tH "Deep Reinforcement Learning for Event-Driven Multi-Agent Decision Processes," Menda et al.: https://t.co/y5gUYePyr1 "OptionGAN: Learning Joint Reward-Policy Options using Generative Adv. Inverse Reinf. Learning," Henderson et al.: https://t.co/HFTIzyoxeu "Using Parameterized Black-Box Priors to Scale Up Model-Based Policy Search for Robotics," Chatzilygeroudis + Mouret https://t.co/S5FzblAF9o (at Bonsai) arXiv papers, September 21 - "Deep RL for Dexterous Manipulation with Concept Networks," Gudimella and Story et al.: https://t.co/Uodd6ZkqWx RT @EBKania: As militaries compete to leverage AI to enhance capabilities, critical to recognize risks, e.g., issues of crisis instability… RT @math_rachel: "Deep learning is a jackhammer. It's the wrong or overpowered tool in many situations." -@Smerity #TheAIconf https://t.co/… @ivenzor that's what I meant, but it'll have to await the first $1 billion bid :P @iamJYash I don't think they give out t-shirts to non-staff :) Or at least I haven't been given one. @AdrianoCarmezim they have given them out a few times, like at NIPS. I got one in person but assume it's diff from the one staff have @adam_will_do_it lol (wouldn't be surprised to see NIPS tickets sold for outrageous sums in reality, though, if that's even allowed? Might not be) 1 AI hype starter kit on sale for $1 billion. Includes NIPS ticket, Deep Learning textbook, OpenAI t-shirt, + signed copy of a Miles tweet. "RT @_rockt: CFP for 6th WS on Automated Knowledge Base Construction #akbc at #nips2017 Dec 8th, 2017 Submission deadline Oct 21! https://t.…" RT @RealAAAI: New! AAAI/ACM Conference on #AI, Ethics & Society. (Co-located with #AAAI2018). Deadline: 10/31 See https://t.co/xgwtauZy2U @… RT @ShaneLegg: Not sure where to send your new research paper on AI Safety? Check out this brand new AAAI/ACM conference: https://t.co/AR… RT @awjuliani: Excited to share what I've been working on this year: A platform for creating RL/ML training environments in Unity! https:/… @davegershgorn https://t.co/OTrKY7hZNc @davegershgorn makes sense I guess, with Bullet already being used for this stuff, they don't want to be left out... RT @iamtrask: if you're interested in helping me with a prototype combining Multi-Party Computation and Deep Learning, hit me up on #OpenMi… RT @cholodovskis: I'm very excited about our new paper (with a new ALE version)! With @marcgbellemare, Talvitie, Veness, Hausknecht, and @M… "Augmenting End-to-End Dialog Systems with Commonsense Knowledge," Young et al.: https://t.co/qMMbWqfNxM "Acquiring Background Knowledge to Improve Moral Value Prediction," Lin et al.: https://t.co/WhQqHhkygT "AI Programmer: Autonomously Creating Software Programs Using Genetic Algorithms," Becker and Gottschlich: https://t.co/UoX9CNDPE6 "Memory Augmented Control Networks," Khan et al.: https://t.co/elsLl3MGuu "Adaptive Laplace Mechanism: Differential Privacy Preservation in Deep Learning," Phan et al.: https://t.co/gHqy3UWty0 "Recognizing Objects In-the-wild: Where Do We Stand?," Loghmani et al.: https://t.co/mwXyfbxofz "IBM Deep Learning Service," Bhattacharjee et al.: https://t.co/VqBfrcrQUp "Towards Cognitive-and-Immersive Systems: Experiments in a Shared (or common) Blockworld Framework," Peveler et al.: https://t.co/ZoyItVSUwg "Guided Deep Reinforcement Learning for Swarm Systems," Huttenrauch et al.: https://t.co/8B1sCnYiQk "Coupled Ensembles of Neural Networks," Dutt et al.: https://t.co/D5Fn8qN6Gl "ZhuSuan: A Library for Bayesian Deep Learning," Shi et al.: https://t.co/tr4uFQrQV4 "Multi-Agent Distributed Lifelong Learning for Collective Knowledge Acquisition," Rostami et al.: https://t.co/LdKruWKP9Q "Combining Search w Structured Data to Create a More Engaging User Experience in Open Domain Dialogue," Bowden et al https://t.co/Or993PuGGZ "Gaussian Process Latent Force Models for Learning and Stochastic Control of Physical Systems," Sarkka et al.: https://t.co/gO3c34AVLf "Differential Privacy on Finite Computers," Balcer and Vadhan: https://t.co/7DqpzmpMv2 "Learning Ground Traversability from Simulations," Chavez-Garcia et al.: https://t.co/QbEdRnsEaN "Embedding Deep Networks into Visual Explanations," Qi and Li: https://t.co/Pnf597c8ID "Variational Gaussian Approximation for Poisson Data," Arridge et al.: https://t.co/fnz8jZJwIZ "Closing the loop between neural network simulators and the OpenAI Gym," Jordan and Weidel et al.: https://t.co/wxiYjwPqrz "N2N Learning: Network to Network Compression via Policy Gradient Reinforcement Learning," Ashok et al.: https://t.co/SaFuuE1K8X "Revisiting the Arcade Learning Environment: Evaluation Protocols+Open Probs 4 General Agents," @cholodovskis et al: https://t.co/lRiyjzKrDW arXiv papers, September 19 - "The Uncertainty Bellman Equation and Exploration," O'Donoghue et al., DeepMind: https://t.co/ASaypfX4WW @markus_with_k are you back in town? @ArtirKel not that I recall... @TheAnnaGat alas, no chipotle yet! baby steps @TheAnnaGat https://t.co/t9zQ9IZDrP Five Guys opening soon in Oxford, this is not a drill. https://t.co/Qo1kPURlwR This image is quite something. https://t.co/nBuh8p3ep8 RT @RebeccaCrootof: Rest in Peace. https://t.co/mIoacpRDGd @halhod @jackclarkSF I'm more like the guy analyzing the satellite photos of the ecosystem down below and scouring the zoologists' papers :) Fin. "Learning Functional Causal Models with Generative Neural Networks," Goudet and Kalainathan et al.: https://t.co/8j2Xd03Xdd "Optimal Learning for Sequential Decision Making for Expensive Cost Fns w Stochastic Binary Feedbacks," Wang et al.: https://t.co/jsPcik5gF4 "Commonsense Scene Semantics 4 Cog. Robotics: Towards Grounding Embodied Visuo-Locom. Interactions," Suchan+Bhatt: https://t.co/ftzp50WxDW "Conversational Exploratory Search via Interactive Storytelling," Vakulenko et al.: https://t.co/UgPZdtl0Uo "Recursive Binary Neural Network Learning Model with 2.28b/Weight Storage Requirement," Guan et al.: https://t.co/saLir9gZcB "Video Synopsis Generation Using Spatio-Temporal Groups," Ahmed et al.: https://t.co/qf0RgUrJzN "Optimal approximation of piecewise smooth functions using deep ReLU neural networks," Petersen and Voigtlaender: https://t.co/ndw6dhyCcf "Unsupervised state representation learning with robotic priors: a robustness benchmark," Lesort et al.: https://t.co/2Dx2ejQ4R5 "Transforming Cooling Optimization for Green Data Center via Deep Reinforcement Learning," Li et al.: https://t.co/Of1EaxpEpe (using DDPG) "Shapechanger: Environments for Transfer Learning," Arnold et al.: https://t.co/edltIeYZoT "Deep Reinforcement Learning for Conversational AI," Jadeja et al.: https://t.co/Un7zUuHmNh (general discussion) "Cooperative Motion Planning for Non-Holonomic Agents with Value Iteration Networks," Rehder et al.: https://t.co/MEKygewI20 "Abstractions for AI-Based User Interfaces and Systems," Renda et al.: https://t.co/dhIiEsoQ0a (for the low, low price of $1.2 million) "ImageNet Training in 24 Minutes," You et al.: https://t.co/1NGCJsr2o8 "WOAH: Preliminaries to Zero-shot Ontology Learning for Conversational Agents," Gonzalo Estrán Buyo: https://t.co/OMKXr7Bw4A "ClickBAIT: Click-based Accelerated Incremental Training of Convolutional Neural Networks," Teng et al.: https://t.co/ZJgWOiZ9hz "Learning Intrinsic Sparse Structures within Long Short-term Memory," Wen et al.: https://t.co/7J0SHbF0xm "Attention-based CNN Matching Net," Liu et al.: https://t.co/OBrdG7z8kK "Self-Guiding Multimodal LSTM - when we do not have a perfect training dataset for image captioning," Xian and Tian: https://t.co/ViHBlSVDdq "Disentangled Variational Auto-Encoder for Semi-supervised Learning," Li et al.: https://t.co/ohzosDxZFr "Learning Compact Geometric Features," Khoury et al.: https://t.co/oYZXDrPPND "Accelerating SGD for Distributed Deep-Learning Using Approximated Hessian Matrix," Arnold and Wang: https://t.co/CaqujhSv04 "Joint Hierarchical Category Structure Learning and Large-Scale Image Classification," Qu et al.: https://t.co/WInhuMy27u "A Deep Generative Framework for Paraphrase Generation," Gupta et al.: https://t.co/JSFncXPZOf "Robust Kernelized Multi-View Self-Representations for Clustering by Tensor Multi-Rank Minimization," Qu et al.: https://t.co/YkcMBIlMbV "Viewpoint Invariant Action Recognition using RGB-D Videos," Liu et al.: https://t.co/KVmRRyxykQ Unsupervised Aspect Term Extraction w/ B-LSTM & CRF using Automatically Labelled Datasets," Giannakopoulos et al.: https://t.co/owlJRUp6Ez "Multi-Label Zero-Shot Human Action Recognition via Joint Latent Embedding," Wang and Chen: https://t.co/WVtBEYOOP6 "A Streaming Accelerator for Deep CNNs w/ Image+Feature Decomposition for Resource-limited System Apps," Du et al.: https://t.co/tnFaXzlfQk "Multi-scale Deep Learning Architectures for Person Re-identification," Qian et al.: https://t.co/I6h2xtezys "Masquer Hunter: Adversarial Occlusion-aware Face Detection," Chen et al.: https://t.co/FLqywi34E3 "LSTM Fully Convolutional Networks for Time Series Classification," Karim et al.: https://t.co/6YBI0oj4vt "Transcribing Against Time," Sperber et al.: https://t.co/TyrHAdLVfI "Detection of Anomalies in Large Scale Accounting Data using Deep Autoencoder Networks," Schreyer et al.: https://t.co/D2fSbjw1ek arXiv papers, September 18 - "Supervising Unsupervised Learning," Garg and Kalai: https://t.co/LoKqEjNjbf RT @grok_: Robot Ethics 2.0 is out! (I wrote a chapter.) https://t.co/XdNV42zV3G And he learned to retweet himself :( FYI for those who don't follow him, Trump is retweeting a bunch of pro Trump memes today, such as this. https://t.co/kw3U9f3yqW RT @GlennThrush: Classy retweet by the leader of the free world, man with nuke codes, fella who reads TelePrompter on national unity and re… "RT @soumithchintala: NIPS Conference Registrations 2002 thru 2019. [2018] War erupts for tickets [2019] AI researchers discover time travel…" There is a lot of bad sci-fi/conspiracy theory stuff about CERN on Amazon... RT @red_abebe: CFP for the First Black in AI workshop at #nips2017 All are welcome to attend! https://t.co/FSLQycNeTY "Mean Actor Critic," Asadi and Allen et al.: https://t.co/qk328knSxU "RT @syhw: A toolkit for controlling Euro Truck Simulator 2 with python to develop self-driving algorithms. https://t.co/KnwmAXL41L" RT @s010n: Pretty damn excited about my new class on fairness, accountability, and transparency in machine learning! #FATML https://t.co/X3… Summoning the daemon Based on search results for "lecture" + filtering for length, there are significantly more than 500 years worth of lectures on YouTube. "RT @NASAJPL: Our @CassiniSaturn spacecraft is now one with the planet it studied for so long. The rest is science. #GoodbyeCassini #GrandF…" The CanAIdian takeover continues... https://t.co/qMHDiT26Nw RT @AndrewBeatty: #BREAKING @AFP (London) - British PM May tells Trump not to 'speculate' on London attack RT @alexia: Two ex-Googlers want to replace your mom with the wire monkey on the right https://t.co/ffpVLlbaAr @MatthewGuz congrats! Look forward to reading this... https://t.co/eDdqcet0M2 RT @kaitlancollins: A U.K. police spokesman tells CNN this is "pure speculation given we don’t know who is involved." "Any speculation is u… RT @DeepMindAI: Honoured that #KeJie took the time to study his #AlphaGo games with our Go ambassador Fan Hui & AlphaGo itself https://t.co… RT @glouppe: A million-agent RL experiment that reveals population dynamics following population-prey equations! https://t.co/WGvyH41YMc Su… Preface to The Heavens + the Earth: A Political History of the Space Age... @elonmusk was 26 in Bay at time (97), SpaceX 5 yrs later -close! https://t.co/6DywMphJcd @ctphoenix @jackclarkSF not sure if you should care, there are several big AI confs, this one's just especially big/sponsor/recruiter-laden @ctphoenix @jackclarkSF I think there's prob a bubble of startups/big corporate efforts in the area/hype but NIPS will feature real advances RT @_tessr: a lot of people haven't been exposed to these ideas outside of "blockchain," so suddenly everyone wants to put everything on a… RT @_tessr: so often people say they want a blockchain, when they actually want a blockchain component (e.g., public key crypto) "Autonomous Extracting a Hierarchical Structure of Tasks in RL and Multi-task RL," Ghazanfari and Taylor: https://t.co/0AnpBgPWEm "Shared Learning : Enhancing Reinforcement in Q-Ensembles," Menon and Ravindran: https://t.co/HpPHkMVdjN "RT @chelseabfinn: New paper on one-shot visual imitation learning, including a real robot! w/ T. Yu, T. Zhang, @pabbeel, S. Levine https://…" "An Empirical Study of AI Population Dynamics with Million-agent [Deep] Reinf. Learning," Yang, Yu, and Bai et al.: https://t.co/VbA9N2ye4v RT @oxmartinschool: We're recruiting 3 new research posts for the Oxford Martin Programme on Technological & Economic Change - https://t.co… @memotv @mtrc @Medium nice, will check out. IMO should be more govt funding of beneficial, not nec. profitable applications. NIPS is now sold out: https://t.co/H3vR7r72KU @mat_kelcey *Mnih @mat_kelcey that's Vlad Minh in the center of the field RT @mtrc: AI research lets us ask the bold question: which bits of humanity are worth amplifying? And the answer is: the oppression/money-m… RT @GiorgioPatrini: #nips2017 is the new burning man RT @drhyrum: Conf on Applied ML for InfoSec https://t.co/maT7xwVRAF A venue to get "in the weeds" ML for infosec @EndgameInc @datamachines… Hopefully they will know that rooms involving DRL this year will require infinite seats. For an ML conference, they did a lot of misleading linear extrapolation (Oct 1 --> Sept 25 --> Sept 14/15 --> RIGHT NOW). The NIPSularity is here. Type, type! https://t.co/FwVRJR5CJP 🔥🔥🔥🔜 this is not a drill 🔥🔥🔥 https://t.co/9WFdFGUz4s @GoAbiAryan not sure what you're referring to. The Stewart paper was about a film. Also "We corroborate our theoretical results with numerical experiments based on the New Yorker Cartoon Caption Contest." "Former cartoon editor of the New Yorker coauthors AI paper" is the new "Kristen Stewart coauthors an AI paper": https://t.co/mNZemdafUA *first wearable external one, to be precise "Perhaps the single most Frankensteinian invention we have is the pacemaker" (inventor inspired by watching Frankenstein movie) RT @erichorvitz: Today we roll out @Azure Confidential Computing https://t.co/bJpMhACoFg Congrats to all, including @MSFTResearch leads @Th… RT @ilyasut: If learning models the fact that other agents learn too, the agents converge on to much better cooperative mutually-beneficial… (written 200 years ago this year) Nice talk by my advisor, Dave Guston, on the legacy of Frankenstein: https://t.co/uyZ321EemM RT @OpenAI: LOLA: Agents that learn by modeling other agents: https://t.co/U1Lt6OLpFM RT @waitbutwhy: For people without a technical background interested in working in AI, a guide to working in AI policy and strategy: https:… "New state of the art results for general Atari playing" https://t.co/W4yERll9zt RT @Reza_Zadeh: A good overview of how Apple, Google, Amazon, Microsoft, & Facebook make their empires run. https://t.co/s19vOjy7R5 @AMP_SV at least they're not submitting tweets. @davegershgorn Dave... "Were the Framers Right About Constitutional Design? The US Constitution in Comparative Perspective," Tom Ginsburg: https://t.co/pORmFtRr1F "A Learning Approach to Secure Learning," Nguyen and Sinha: https://t.co/03z6mUfbFT "Sketch-pix2seq: a Model to Generate Sketches of Multiple Categories," Chen et al.: https://t.co/kQBCs5Uo3I CC @hardmaru "Pre-training Neural Networks with Human Demonstrations for Deep Reinforcement Learning," de la Cruz Jr. et al.: https://t.co/oxJHkYwHjH @robinsloan Indeed! Bravo @j2bryson et al. :) Also lots of interesting history on legal personality I was unaware of. (I tend to agree for near future at least, but haven't thought much abt it/could imagine changing view eventually, esp. w/ brain emulations) Finally got around to finishing this paper - great framing of problem even if one doesn't agree w/ all conclusions: https://t.co/WB7TStPqAY RT @mjntendency: generous fellowship open to current PhD students in (some areas of) AI, $40/yr up through the 5th year of your PhD https:/… RT @lukeprog: Three wild speculations from amateur quantitative macrohistory: https://t.co/ycbdZ7q4Yl https://t.co/9vhsIjHNRe RT @LeverhulmeCFI: Join us on Monday at our workshop on Artificial Agency and Collective Intelligence https://t.co/SnV0KrkpCp #AI #politics… RT @danieldewey: Announcing the @open_phil AI Fellows Program! A fellowship w/ up to 5 years of funding for AI/ML PhD students: https://t.c… @mbrendan1 @withfries2 link not working but I am aware of the project @APB_Laudrain haven't looked at it closely but unsurprising companies are optimizing for AI on mobile - Huawei doing as well, prob others From 30 years ago...liked the bit on the Connection Machine's 500 million operations per second (a TPU is about 500k times faster). Ray Kurzweil documentary from the 80s with lots of expert system hype: https://t.co/b97NyysrFV "RT @akarp: *Enters the bar*: Bartender : why the cryptographically strong face? https://t.co/jipGR71TLm" @mark_riedl that's why they pay me the RT bucks Way behind on arXiv, hope to catch up soon... "Towards Proving the Adversarial Robustness of Deep Neural Networks," Katz et al.: https://t.co/2uaF4fjK5n "Explore, Exploit or Listen: Combining Human Feedback and Policy Model to Speed up DRL in 3D Worlds," Lin et al.: https://t.co/LmKkSZR0VH "Interpreting Shared Deep Learning Models via Explicable Boundary Trees," Wu et al.: https://t.co/a802NTXBgw "StarSpace: Embed All The Things!," Wu et al., Facebook: https://t.co/gaGFtRQkLk @dennybritz I almost planned to make it next month but couldn't :( you may be interested in the event though fyi- https://t.co/EUXdR59JXL Nice interview with the great @SmithaMilli on AI safety: https://t.co/s74EXcMiiv Several safety-related papers accepted to NIPS, including the DeepMind/OpenAI deep RL from human preferences one 🤖🤗 https://t.co/qAPo8hlaNe @calebwatney or (what I meant) basic income but not scrapping everything, just least efficient/progressive things, or w/ more taxes. (Current estimate is Sept 25, pretty sure it was Oct 1 less than 6 days ago) Expected time to NIPS selling out is decreasing faster than time passing. NIPS sale singularity! Register soon if maybe going-can get refund @calebwatney would be interesting to see responses for more moderate proposals than that one, too. @calebwatney oo, thanks! @calebwatney (think timing is an important Q, just not nec. the right ppl to ask). feel like pretty much anything would be more interesting than 2nd Q :) @calebwatney I wouldn't put much stock in their views on timing, but would be interested in e.g. views on basic income vs. something else's efficiency @calebwatney what do you mean the medium? @calebwatney 2nd Q is ~"are u a mainstream economist," unsurprising ppl agree. more interesting Qs are timing/likelihood/optimality of redistribution etc RT @abigail_e_see: This is why it's both very useful and very daunting to share trained systems. Respect to @allenai_org for providing a fu… "RT @erikbryn: In Boston Friday? Join Max @Tegmark & me talking about #AI & its implications at Museum of Science https://t.co/dWXoavdH13 #M…" RT @shimon8282: Major updates to our expected policy gradients paper: https://t.co/iaib52qByO. Theory leads to new principled approach to… RT @KaiLashArul: Looks like Geoff finally got his capsules to work 😀🎉 https://t.co/Vwd9GjbKcU @davegershgorn (I wouldn't say "simply" bc other differences but scalability is a key characteristic) @davegershgorn +1. More on this soon :) RT @_rockt: List of @NipsConference accepted papers https://t.co/RoFuvomNe3 This is a high quality tweet: https://t.co/F3wpnAod6n "RT @jeremyphoward: Some thoughts on how AI can help medicine, and what's needed now https://t.co/e95pNQyd4J" RT @WiMLworkshop: #NIPS2017 registration is selling out before @WiMLworkshop notification of acceptance! Please register asap! @DaniCMBelg… RT @Smerity: @Miles_Brundage Register with the sweet calm reassurance that you can also apply for a full refund for quite some months from… Just registered for NIPS - you maybe should, too, it's going to sell out soon! @timhwang gonna be 🔥 RT @timhwang: 🎉 Our workshop @NIPSConference on machine learning and deception was accepted! More details forthcoming: https://t.co/eqbzSzX… RT @APPG_AI: What a great panel of speakers we have today at Evidence Meeting 5: #Governance, Social and Organisational Perspective for #AI… @davegershgorn what do I send to SkyNet if it asks? Look forward to providing oral evidence to the All Party Parliamentary Group on AI today! Two birthday gifts for myself :) https://t.co/aMD08Z7MhG @iamtrask thanks! :) Siri's close now: https://t.co/leShk4Wnfi RT @goulcher: This guy is an actual magician https://t.co/TO7s6mbeP8 RT @anirvan: Deep Learning for Siri’s Voice: On-device Deep Mixture Density Networks for Hybrid Unit Selection Synthesis - Apple https://t.… RT @AnthroPunk: I need a FT job. Looking in #research #applied research institute, industry. Focus: #humans #AI #automation #ethics. https:… RT @suchisaria: Seeking a project manager for my group: strong writing & communication skills, curious, organized, and deep interest in cli… RT @etzioni: Overview Paper for AllenNLP: https://t.co/JiNgF1dxvp https://t.co/dK3qrTIiUs "RT @j2bryson: Of, for, and by the people: the legal lacuna of synthetic persons Bryson. Diamantis & Grant; #AI & #Law https://t.co/bag5BaCC…" RT @dennybritz: AllenNLP - An open-source NLP research library, built on PyTorch https://t.co/00cx9F8sGY @adam_will_do_it @_jyan_ @AMP_SV more just the tea :) I suppose if that paper were to come from anywhere, it'd be deepmind... Fun excerpt on some of the strategies it learns: https://t.co/Fc6IN14RVN P.S. this is consistent with most chatbots still being bullshit for at least the near future :) Curious what NLP folks think! Not doing justice to it here as lots of algo. ideas in paper, but for lay person, proof of concept of deep RL chatbot at scale (I think?). So lots of room for improvement. This (/some other recent papers on DRL for dialogue) ~ : chatbots :: pre-AlphaGo convnets-Go paper : Go...? Would benefit from moar data, compute, encoding inputs w/ CNNs/RNNs (competition has time limits), better ensemble, richer MDP state space.. Lots of other bells and whistles (some handcrafted rules, reward shaping, "abstract discourse MDP," etc.). Still early results but will be very interesting to see how scalable this is. They claim it's pretty scalable. Lots of interesting details but main idea = big ensemble of different ways of coming up with responses, learn which models to use when w RL. I also totally read Evibot as Evilbot. This is quite interesting... https://t.co/obnemdlVYd RT @everyonesai: https://t.co/b9A5t5xJqT Human-Level Tea Preparation with Steep Reinforcement Learning RT @subarnaT: 4 additional days to complete the writeup and submit to WiML https://t.co/LsYA38raQq RT @danijarh: TensorFlow Agents available now! https://t.co/8Ll8cGMNly #deeprl #tensorflow #rl #ppo RT @BillGates: This little-known government agency wants to do for energy what DARPA did for the Internet. https://t.co/3ifNQM0Rh8 RT @ashleyfeinberg: I, too, casually arrange photographs of my 100 children to face outwards so I can only see the backs of frames https://… @j2bryson @NoelSharkey @APPG_AI @drkatedevlin @SandraWachter5 yep, look forward to seeing you all! @mark_riedl nice, thanks. Cool stuff! Nice post on deep learning and NLP from @abigail_e_see: https://t.co/TCuZfSUd20 https://t.co/n8zcd3LIWl @mark_riedl /explicit representation? @mark_riedl action conditional video prediction in atari - is it the "engine" part? @mark_riedl also I'm missing something - 1st "learn a game engine and simulate a game world with gameplay footage" - why not count Oh et al? @GoAbiAryan @mark_riedl see URL at end of mark's tweet RT @mark_riedl: AI System Uses Less Than Two Minutes of Videogame Footage to Recreate Game Engine https://t.co/JeFG4sE3us https://t.co/mhDw… @mark_riedl shut it down!! RT @ndiakopoulos: NYT looking to hire someone to cover algorithms and AI: https://t.co/CDuMvK59zh RT @Sparkyparky82: Interested in #TensorFlow ? Looking for a TensorFlow Developer to join #Deepmind https://t.co/YVghUWN7CU @DeepMindAI #AI… "A Deep Reinforcement Learning Chatbot," Serban et al., MILA's entry in the Amazon Alexa Prize competition: https://t.co/5hSIiSCpSY Long podcast with my colleague Toby Ord on the ethical importance of the future: https://t.co/RHZgyKX1eH "RT @negar_rz: Tomorrow is the deadline for the @WiMLworkshop abstract submission! https://t.co/Lg4owgHQVe #NIPS @WomenTechmakers @wimlds @…" @Smerity Indeed! Nice overview of natural language processing by Percy Liang: https://t.co/b6PeuNVDAs RT @hardmaru: A Survey of Deep Learning Techniques for Music Generation. This 108-page book attempts to cover a lot of ground. https://t.co… Article on religious implications of AI, feat. work by @maidylm and others: https://t.co/2zPOM9JtBD RT @viegasf: So excited about the first-ever Google Faculty Research Awards in Human-AI Interaction: apply by Oct 7th! https://t.co/ghKBwtf… "RT @sla: ""All Levels of Sponsorships are SOLD OUT."" NIPS is competitive not only for researchers but also sponsors...! https://t.co/VczKGDG…" RT @iamtrask: I am VERY excited to post the very first OpenMined demo video showcasing the brilliant work of OM Contributors!!! https://t.… RT @DeepSpiker: Very interesting paper, great read! https://t.co/iW1SfyiDut RT @zacharylipton: Exciting development! As we write the open source Deep Leaning w MXNet book, it's simultaneously translated into 中文 http… @hardmaru hah, wish I had interns for that :) Too many papers, halp. RT @iamtrask: Hey folks! This Friday I'll be speaking @imperialcollege at 4pm about Encrypted AI w/ #OpenMined. Just meet me @ the main en… Paid internships working with me and others on cool stuff in Oxford! https://t.co/0ZqWZAs8qJ RT @FHIOxford: FHI is looking for interns to contribute to our work in the areas of AI policy, AI governance, and AI strategy https://t.co/… RT @LordsAICom: Our call for evidence on #AI closes at midnight tonight - there's still time! https://t.co/zCgiAVsBRT RT @kleinsound: Facebook/NYU's Yann LeCun at #CCN2017 "We process 1.2 bn photos daily, each is processed by 4 deep nets within 2 seconds" h… RT @timhwang: Pumped to be a judge on this! “Into the Black”, a writing competition about basic income. the prize: basic income. https://t.… "Tired: Searle (John) Wired: CIRL (cooperative inverse reinforcement learning)" RT @allahpundit: The first rule of the art of the deal: Signal immediately that you’re bluffing https://t.co/AatZJ0ETVG RT @mikarv: Which police depts engage with bias/transparency in their experimental ML systems publicly? Congrats @DurhamPolice https://t.co… @mtyka awesome!! Enjoy :) How you know it's NIPS upload week (from another paper) https://t.co/NhS0h7i2Gl "Towards Understanding Adversarial Learning for Joint Distribution Matching," Li et al.: https://t.co/f76E14QbER "Active Exploration for Learning Symbolic Representations," Andersen and Konidaris, Prowler/Brown: https://t.co/lsnrmIJfxV "Knowledge Sharing for Reinforcement Learning: Writing a BOOK," Chang et al., Seoul National U.: https://t.co/IqYgBXkW5z Not going to be able to keep up with everything this week, but here's some fun early NIPS stuff... """Hierarchical loss for classification,"" Wu, Tygert, and @ylecun: https://t.co/MZjBHViwJ8 dog/skyscraper mistake worse than sheepdog/poodle" @KaiLashArul PSA: also @KaiLashArul rocks @ethancaballero yes. ...and by issues I mean random install probs I could probably fix but the project isn't that important, anyway. TF usually works, though. Why do I always have Torch issues :( RT @erwincoumans: Deep Reinforcement Learning trained @BostonDynamics Atlas Robot in Roboschool running on Windows (TCP connection): https:… Just finished Death's End. What he said. https://t.co/9EqKhnGfty @L_badikho and Russian spies ;) haha @L_badikho still deciding (before it sells out hopefully!) but there's a good chance I'll be there! :) @davegershgorn just wait til tonight. RT @markus_with_k: Congrats to @PROWLER_IO for raising another £10M. Hoping to see some strong work on #inversereinforcementlearning in the… "RT @negar_rz: Just 4 days to @WiMLworkshop (Women in Machine Learning workshop) abstract deadline! https://t.co/Lg4owgHQVe #nips2017 #nips" RT @_rockt: Our paper on End-to-end Differentiable Proving was accepted for oral presentation at NIPS! https://t.co/8Z3ABIBAnz https://t.co… Worked a few mins later. Don't think that particular error has happened to me before... Sad! Tomorrow's going to be a doozy. https://t.co/99sNJlKCkV RT @ericjang11: Really insightful presentation by @karpathy on plausible solutions to AGI https://t.co/n8WIfoupyc RT @katherinebailey: Google’s Transformer model can even handle Winograd schemas apparently https://t.co/RIq9ARpjZP https://t.co/Mk0K3b4Y6G @L_badikho @NipsConference congrats! RT @KaiLashArul: This Friday at 4pm at @imperialcollege, @iamtrask will present "Proposing Encryption and Federation for Safe AI" - https:/… "RT @MirowskiPiotr: Recommended reading for #AI research fans: ""A Brief Survey of Deep Reinforcement Learning"" by @KaiLashArul et al. https:…" Fin. "How images determine our visual search strategy," Amor et al.: https://t.co/96z6xeGirS "Knowledge gaps in the early growth of semantic networks," Sizemore et al.: https://t.co/WpqlRZ5uiq "Independent circuits in basal ganglia + cortex for the processing of reward + precision feedback," Pascucci et al.: https://t.co/nGvHD5HKQ5 "Determinantal Point Processes Stochastic Approximation for Combinatorial Optimization," Wang et al.: https://t.co/BzaEUibkAy "RANK: Large-Scale Inference with Graphical Nonlinear Knockoffs," Fan et al.: https://t.co/jkyhKYDXsT "Asymptotic Bias of Stochastic Gradient Search," Tadic and Doucet: https://t.co/JEeu2XS3Zy "Earth System Modeling 2.0: A Blueprint 4 Models That Learn From Obs's + Targeted High-Res. Sims," Schneider et al.: https://t.co/UwShuT8tIl "Sparse Regularization in Marketing and Economics," Feng et al.: https://t.co/sM0T5Kgo4l "Statistical Inference for Machine Learning Inverse Probability Weighting with Survival Outcomes," Iván Díaz: https://t.co/ek4fnt5kQe "Fast Incremental SVDD Learning Algorithm with the Gaussian Kernel," Jiang et al.: https://t.co/kifhArOirm "Query-by-example Spoken Term Detection using Attention-based Multi-hop Networks," Ao and Lee: https://t.co/RTDcIHgLgm "End-to-end Learning for Short Text Expansion," Tang et al.: https://t.co/dchhhjdPBx "Smile for the Camera: Privacy and Policy Implications of Emotion AI," Sedenberg and Chuang: https://t.co/vGlO8EoADJ "Coupling Dimensionality Reduction w/ Generative Model for Non-Interactive Private Data Release," Chanyaswad et al.: https://t.co/thkDW9MYC8 "Learning Inference Models for Computer Vision," Varun Jampani (dissertation): https://t.co/uPZotiTamY "Unsupervised Learning of Semantic Mappings," Galanti and Wolf: https://t.co/Y3lkN7KgxC "Behavior Trees in Robotics and AI, an Introduction," Colledanchise and Ögren (long): https://t.co/6HCYI2WRBh "Linguistic Reflexes of Well-Being and Happiness in [not Amazon] Echo," Wu et al.: https://t.co/gBPXnP5ODA "Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning," Zhong et al.: https://t.co/3ShQ868tkY "Private Information Retrieval with Side Information," Kadhe et al.: https://t.co/Fusol1qGmb "Online Convolutional Dictionary Learning," Liu et al.: https://t.co/0qrdeAYss5 "Single Shot Text Detector with Regional Attention," He et al.: https://t.co/eBHpTazVzk "Learning what to read: Focused machine reading," Noriega-Atala et al.: https://t.co/JcleFxuqBv "Order-Planning Neural Text Generation From Structured Data," Sha et al.: https://t.co/EAytGBhcCH "Effective Use of Dilated Convs for Segmenting Small Obj. Instances in Remote Sensing Imagery," Hamaguchi et al.: https://t.co/Q03pfE5KGl "Semantic Composition via Probabilistic Model Theory," Emerson and Copestake: https://t.co/3qTDbYRlqN "DeepUNet: A Deep Fully Convolutional Network for Pixel-level Sea-Land Segmentation,' Li et al.: https://t.co/AgvzsLbFRa "Variational Inference for Logical Inference," Emerson and Copestake: https://t.co/xy0bcaaj77 "Adversarial Networks for Spatial Context-Aware Spectral Image Reconstruction from RGB," Alvarez-Gila et al.: https://t.co/wNsjWhIboo "Algorithmically probable mutations reproduce aspects of evolution such as [..long title]," Hernandez-Orozco et al.: https://t.co/keVIYacYCa "Telepath: Understanding Users from a Human Vision Perspective in Large-Scale Recommender Systems," Wang et al., JD: https://t.co/fMHskH54pK "Visual-textual Attention Driven Fine-grained Representation Learning," He and Peng: https://t.co/0mUJwzyAId "A Comprehensive Survey of D. Learning in Remote Sensing: Theories, Tools + Challenges for the Community"-Ball et al https://t.co/dtyVpxe987 "Glyph-aware Embedding of Chinese Characters," Dai and Cai: https://t.co/ElASsqGRwI "EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification," Helber et al.: https://t.co/RddAbjswAF "Multi-task Dictionary Learning based CNN for Computer aided Diagnosis with Longitudinal Images," Zhang et al.: https://t.co/sYHxWk06aQ arXiv papers, September 4th - "R^3: Reinforced Reader-Ranker for Open-Domain Question Answering," Wang et al.: https://t.co/g1nwoS2NAk @_jyan_ I'd be sad because (among other things) that would mess up my Brier score of 2017 forecasts ;) but really I see it as gradual anyway Oh and this (NIPS acceptances including many arxiv-bargoed papers) this wk, according to official schedule at least. https://t.co/8TOOdN2ZcK Brace yourself for deep learning arXivgeddon in the next few months... https://t.co/ngTGsJKeHZ Fin (though I probably missed more good ones than usual this week b/c accidentally reloaded a tab from earlier in week + arXiv site finicky) "Coulomb GANs: Provably Optimal Nash Equilibria via Potential Fields," Unterthiner et al.: https://t.co/tovvITuZm4 "Deep Convolutional Neural Networks for Raman Spectrum Recognition: A Unified Solution," Liu et al.: https://t.co/FEO4Lb1QxG "Deep EHR: A Survey of Recent Advances on DL Techniques 4 Electronic Health Record (EHR) Analysis," Shickel et al.: https://t.co/zlhMI9Q8NY "Efficient ConvNet Learning using Parametric Log based Dual-Tree Wavelet ScatterNet," Singh and Kingsbury: https://t.co/8bRGS4oRSw "Reasoning about Fine-grained Attribute Phrases using Reference Games," Su et al.: https://t.co/BiDUxAXCoF "Curriculum Learning for Multi-Task Classification of Visual Attributes," Sarafianos et al.: https://t.co/0r5IsQm7rt "Design Patterns for Fusion-Based Object Retrieval," Zhang and Balog: https://t.co/nyshqREWmK "EntiTables: Smart Assistance for Entity-Focused Tables," Zhang and Balog: https://t.co/Qe4802JWcR "Neural Machine Translation Training in a Multi-Domain Scenario," Sajjad et al.: https://t.co/nuB5mskl80 "Performance Guaranteed Network Acceleration via High-Order Residual Quantization," Li et al.: https://t.co/vRdZxSYqNB "Performance Analysis of Open Source ML Frameworks 4 Various Params in 1-Threaded+Multi-Threaded Modes"Kochura et al https://t.co/HYDnTZzpUI "Fast, Accurate, and Scalable Method for Sparse Coupled Matrix-Tensor Factorization," Choi et al.: https://t.co/zYPWPkoeKz "Kernelized Movement Primitives," Huang et al.: https://t.co/vXiLbLg3Vn "Why feature dependencies challenge the reqs engineering of automotive systems: An empir. study," Vogelsang+Fuhrmann https://t.co/EsMSZE4lrZ "A parameterized activation function for learning fuzzy logic operations in deep neural networks," Godfrey + Gashler https://t.co/8nmiwfrDrK "Subspace Selection to Suppress Confounding Source Domain Information in AAM Transfer Learning," Asgarian et al.: https://t.co/PhyNbMqZzO "On the Reconstruction Risk of Convolutional Sparse Dictionary Learning," Singh et al.: https://t.co/HyB8JRlbZo "An inexact subsampled proximal Newton-type method for large-scale machine learning," Liu et al.: https://t.co/LAxVI1AxPC "EC3: Combining Clustering and Classification for Ensemble Learning," Tanmoy Chakraborty: https://t.co/sgiTwwHexf "Multi-task Neural Networks for Personalized Pain Recognition from Physiological Signals," Lopez-Martinez and Picard https://t.co/6xppMhOzK9 "Continual 1-Shot Learning of Hidden Spike-Patterns with NN Simulation Expansion and ... ," Lightheart et al.: https://t.co/MPpRuGxSuI "Machine Learning Topological Invariants with Neural Networks," Zhang et al.: https://t.co/CRUaNPt4cC "Fast(er) Exact Decoding + Global Training for Transition-Based Depend. Parsing via a Minimal Feature Set"-Shi et al https://t.co/3TkVcBl1E8 "Inferring Human Activities Using Robust Privileged Probabilistic Learning," Vrigkas et al.: https://t.co/6QWc400Zg5 "Transfer Learning across Low-Resource, Related Languages for Neural Machine Translation," Nguyen and Chiang: https://t.co/xMDYW90GNu "Design and Analysis of the NIPS 2016 Review Process," Shah et al.: https://t.co/8oltj2QLDd "Generating Video Descriptions with Topic Guidance," Chen et al.: https://t.co/OXjdz5sXO4 "Abnormal Event Detection in Videos using Generative Adversarial Nets," Ravanbakhsh et al.: https://t.co/D0wYhqiLyS "ICDAR2017 Competition on Reading Chinese Text in the Wild (RCTW-17)," Shi et al.: https://t.co/Y4bXDCfTCP "Joint Separation and Denoising of Noisy Multi-talker Speech using RNNs + Permutation Invar. Training," Kolbæk et al https://t.co/21bhliB8Bu "Video Summarization with Attention-Based Encoder-Decoder Networks," Ji et al.: https://t.co/BsKVlBxCoi "Learning a Generative Adversarial Network for High Resolution Artwork Synthesis," Tan et al.: https://t.co/NLxfvHgDKc "Learning Invariant Riemannian Geometric Representations Using Deep Nets," Lohit and Turaga: https://t.co/yVdxe072hK "Efficient tracking of a growing number of experts," Mourtada and Maillard: https://t.co/rY7asfJIGr arXiv papers, August 30 - September 1 - Automatically Generating Commit Messages from Diffs using NMT," Jiang et al: https://t.co/FMlNigOFDZ "RT @TheAnnaGat: YES our new website is up!!! https://t.co/t2a4SZ65Xn Come and check out our new AI-mediated chat app for preventing or reso…" RT @AndrewBeatty: Here's a list of journalists killed doing their jobs in 2017, so far. https://t.co/lG7QYZ84HA https://t.co/LldZJ2Zp9o RT @ylecun: @jackclarkSF CTHULHU: Convolutional Transformations Hidden Under Layers of Hidden Units @j2blather I like the medicine angle. Have been meaning to read book on FDA. Don't know much abt architecture.. @j2blather nice! @j2blather also privacy @j2blather omniscience, no. combined w/ data - power, yeah (most if it's on human misuse stuff and the recs in Smart Pols) @j2blather will cite Smart Policies :) @j2blather yeah. Working on evidence for Lords Select Committee now and being sure to note future probs != current, both impt, synergies.. @j2blather ah, cool - Jeremy Gillula. Enjoy the conf! @j2blather in any case, v. cool project! @j2blather nice. Peter Eckersley? @j2blather @j2bryson ah got it from ur next message @j2blather @j2bryson PG? @pfau @TheAnnaGat oo, could be. @Smerity you win :) but I'll try to finish DE this weekend. Just finished the tales. RT @Smerity: Finished The Three Body Problem trilogy. Each book offers a vastly different view of humanity through a wide lens. Strongly re… RT @Miles_Brundage: "Efficient Methods and Hardware for Deep Learning," nice recent overview lecture by Song Han: https://t.co/Ndi32cwREL RT @y0b1byte: This should have happened. https://t.co/LC0xAGYvcj "Efficient Methods and Hardware for Deep Learning," nice recent overview lecture by Song Han: https://t.co/Ndi32cwREL @EBKania (I tried but failed to find it :( ) @EBKania you haven't seen the full report yet, have you? That escalated quickly: https://t.co/gSjL5WaIU9 @jackclarkSF @halhod damn it you beat me to it elsewhere @jackclarkSF @halhod https://t.co/6fM7J3utVF Average/top tier AI journalism has gotten better in the past year or two (though the low end will probably always be horrible). RT @DeepMindAI: An insightful contribution to human reinforcement learning in @NatureHumBehav. Read the paper here: https://t.co/O1zYfwANmP… RT @TheAnnaGat: Just realised guys in Mission Impossible (1996), while using 75 kg laptops, just mentioned "artificial intelligence Risk ch… @TheAnnaGat lol. they're onto us! @TheAnnaGat what?? RT @fchollet: Also: Alex Robicquet uses Keras, in case you were wondering what DL framework will make you cool and handsome https://t.co/Ns… RT @dustinvtran: "How much compute do we need to train generative models?" https://t.co/8lWSzR96Ns @_jyan_ also thought the postscript was apt @_jyan_ and he was quite right about some things - bashing expert systems for example @_jyan_ yes, I think plausible candidate or at least protocandidate theory, though still missing fair amount. In any case, interesting model (interesting early model of intelligence explosion/discussions of other topics) Throwback Friday: "The time scale of artificial intelligence: Reflections on social effects," Ray Solomonoff, 1985: https://t.co/aRTdUcqUMt @KaiLashArul @katjahofmann @imperialcollege wish I could make it! @_jyan_ @GazetaRu wonder if this could be more like leader of the world/superpower than ruler, potentially less ominous versions of the translation :) @_jyan_ @GazetaRu is that quote based on machine translation? RT @Reza_Zadeh: Bold claims by Wave Computing: 1000x faster than GPUs for neural network training. 8k cores at 8.6ghz. Let's see. https://… RT @iamtrask: I'm super proud to be a part of the OpenMined community... and amazed at how large and international it is already. https://t… RT @mark_riedl: My department is hiring: https://t.co/TCTp5XTfo2 Priority areas: ML, NLP, computing ed, social computing. Or awesome people… RT @mikarv: @Miles_Brundage Backfired: AI is the new tulip Expired: my jokes "Tired: AI is the new electricity Wired: AI is literally made of electricity Inspired: AI is important but different from electricity" RT @CSERCambridge: Come hear @HMRoff talk on 'Nukes of Hazard: Mapping the Risks' on 25 September https://t.co/2FFU9xZiBU RT @cmarschner: @mark_riedl @verge Typical pose at the end of a paper talk https://t.co/YFDxQZNJTw RT @KaiLashArul: "To know your model, you must become a model." - Sun Tzu. #goals https://t.co/3IQapcQSvy RT @abigail_e_see: Structure's back, subword's in, and we're rethinking our assumptions. The #dlearn trends of #acl2017nlp, a blog post htt… RT @everyonesai: https://t.co/pic70frh6Z RT @twimlai: Listen Now! TWiML Talk #44 - We take a walk through the history of LSTM's and Deep Learning w/ Jürgen Schmidhuber - https://t.… @mhough thanks! :) no relation to the review paper, just some cool-looking new papers. RT @mtyka: 20 minutes long smooth journey through face latent space. https://t.co/hxwsk2Ro8g RT @KirkDBorne: A Brief Survey of Deep Reinforcement Learning: https://t.co/CaRoFjbNg4 #BigData #DataScience #MachineLearning #DeepLearning… RT @tsimonite: Two projects set out to measure progress in AI - to help the world figure out where it might take us https://t.co/0uHJZagE29 RT @dandrezner: So if you're interested in this story https://t.co/RucnQjudHT, you'll be super interested in The Ideas Industry! https://t.… RT @Susan_Hennessey: Google Critic Ousted From Think Tank Funded by the Tech Giant https://t.co/aAs7VBx7zF RT @nowthisnews: President Trump spoke to people who lost everything after Hurricane Harvey...about his crowd sizes https://t.co/XnU73qQCFG To be continued... "Comparing Human and Machine Errors in Conversational Speech Transcription," Stolcke and Droppo: https://t.co/jNX8ZNcrOv "Towards Poisoning of Deep Learning Algorithms with Back-gradient Optimization," Muñoz-González et al.: https://t.co/sAusK7u9Bm "Multi-Layer Convolutional Sparse Modeling: Pursuit and Dictionary Learning," Sulam et al.: https://t.co/4V8m4fn9ty "Autoencoder with recurrent neural networks for video forgery detection," D'Avino et al.: https://t.co/QegGJjg2td "Safe Reinforcement Learning via Shielding," Alshiekh et al.: https://t.co/Rmr2l81bpz "DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous Cars," Tian et al.: https://t.co/sZvy5mwONp "Joint Syntacto-Discourse Parsing and the Syntacto-Discourse Treebank," Zhao and Huang: https://t.co/JAwW4pj1Z5 "Coulomb GANs: Provably Optimal Nash Equilibria via Potential Fields," Unterthiner et al.: https://t.co/tovvITuZm4 "On denoising autoencoders trained to minimise binary cross-entropy," @ToniCreswell, @KaiLashArul, and Bharath: https://t.co/FS94SkVzMg arXiv papers, August 30 - Gradual Learning of Deep Recurrent Neural Networks," Aharoni et al.: https://t.co/sXDrZwVQFT @Smerity @AMP_SV on behalf of everyone outside the US, yes, we're going too ;) be sure to register soon after it opens! (Friday) RT @Miles_Brundage: "On the Protection of Private Information in Machine Learning Systems: Two Recent Approaches," Abadi et al.: https://t.… Fin. "Plausible Deniability for Privacy-Preserving Data Synthesis," Bindschaedler et al.: https://t.co/kT2FOjFRW5 "Deep learning with CNNs for decoding and visualization of EEG pathology," Schirrmeister et al.: https://t.co/gKKFePR9vc "Imbalanced Malware Images Classification: a CNN based Approach," Songqing Yue: https://t.co/C3tRJqpMfE "ByRDiE: Byzantine-resilient distributed coordinate descent for decentralized learning," Yang and Bajwa: https://t.co/wwxrWHSJzP "Open-World Visual Recognition Using Knowledge Graphs," Lonij et al.: https://t.co/WdCdTgcyO4 "Deep Learning Sparse Ternary Projections for Compressed Sensing of Images," Nguyen et al.: https://t.co/B7PFQcHPum "Framing U-Net via Deep Convolutional Framelets: Application to Sparse-view CT," Han et al.: https://t.co/Yw8r2jNtOT "Logistic Regression as Soft Perceptron Learning," Raul Rojas: https://t.co/J1yDJzg2Cq "Characteristic and Universal Tensor Product Kernels," Szabo et al.: https://t.co/L4jdwyqhmV "Active Expansion Sampling for Learning Feasible Domains in an Unbounded Input Space," Chen and Fuge: https://t.co/xQCku6UivQ "Accelerating Dependency Graph Learning from Heterog. Categorical Event Streams via Knowledge Transfer," Luo et al.: https://t.co/jOa2aCmNcB "Multi-task Self-Supervised Visual Learning," Doersch and Zisserman: https://t.co/efiugm5367 "Folding membrane proteins by deep transfer learning," Wang et al.: https://t.co/IcjOkAkVdi "SlowFuzz: Automated Domain-Independent Detection of Algorithmic Complexity Vulnerabilities," Petsios et al.: https://t.co/TV3A3xrooi "Feature Conservation in Adversarial Classifier Evasion: A Case Study," Tong et al.: https://t.co/ejryNLCcwz "DeepPrior++: Improving Fast and Accurate 3D Hand Pose Estimation," Oberweger and Lepetit: https://t.co/WwgZZOFn07 "The Convergence of Machine Learning and Communications," Samek et al.: https://t.co/QumAUWoDim "On Type-Aware Entity Retrieval," Garigliotti and Balog: https://t.co/XIx4QpOnqy "Generating Query Suggestions to Support Task-Based Search," Garigliotti and Balog: https://t.co/sd2UuYizCO "Stylizing Face Images via Multiple Exemplars," Song et al.: https://t.co/lARJr8ISco "Integrated Speech Enhanc.Method Based on Weighted Predict. Error and DNN for Dereverberation + Denoising," Li et al https://t.co/hxtxuO0yrM "Efficient Decision Trees for Multi-class SVMs Using Entropy and Generalization Error Estimation," Kantavat et al.: https://t.co/pgJitcxdmM "Automatic Dataset Augmentation," Bai et al.: https://t.co/3wczGXLVqT "ChainerCV: a Library for Deep Learning in Computer Vision," Niitani et al.: https://t.co/FhERqb9tN7 "Automated Crowdturfing Attacks and Defenses in Online Review Systems," Yao et al.: https://t.co/dqm1rLnn4C "Cross-view Asymmetric Metric Learning for Unsupervised Person Re-identification," Yu et al.: https://t.co/EVxKPx00MA "Facial Expression Recognition using Visual Saliency and Deep Learning," Mavani et al.: https://t.co/8ygNvwZN6r "3D Object Reconstruction from a Single Depth View with Adversarial Learning," Yang et al.: https://t.co/JZgiyVPkHD "Maximum A Post.Estimation of Distances Between Deep Features in Still-to-Video Face Recognition," Savchenko+Belova: https://t.co/9OXTzJzzVK "MTIL17: English to Indian Langauge Statistical Machine Translation," Patel et al.: https://t.co/V1QZlCDf7Y "TraNNsformer: Neural Network Transformation for Memristive Crossbar based Neuromorphic System Design," Ankit et al. https://t.co/enaqDH1XWn "Sales Forecast in E-commerce using Convolutional Neural Network," Zhao and Wang: https://t.co/7wUagBDIVy "Deep Style Match for Complementary Recommendation," Zhao et al.: https://t.co/MsRWo2192n The Future of Life Institute is looking for an AI policy lead, focusing initially on autonomous weapons issues: https://t.co/exuF9TgVq0 @jon_hersh thanks! @AngeBassa although in Terminator Genisys, it happens this year :O lol. Hope you did a better job avoiding that movie than me. RT @everyonesai: @Miles_Brundage hello i made u this comic https://t.co/MSecQaqjqZ @everyonesai could I have a drawing, please? @WellsLucasSanto yep, this is another one with the duo! @semiDL that all may be true, I don't have informed opinions on either. Was mainly just commenting on the Bengio thing but went on a tangent. @semiDL talk more recent, will see if any details @semiDL The idea is to train *via* teleoperation, not teleop as an end in itself. But I can't speak to the tech. Still watching talk. HN 1 yr old @adropboxspace not criticizing, I just find it remarkable and wonder what that role actually consists of. Speaking of which, looks like a pretty wild job opening there: Context: this talk from their CTO: https://t.co/SK42AIQugw https://t.co/0t7iKVJeFn I would not be surprised if Yoshua Bengio were an advisor to over 10 AI companies, at the rate I randomly find them: https://t.co/f6j5GpQuq5 RT @dennybritz: Hacks for training RL systems from John Schulman's lecture at Deep RL Bootcamp https://t.co/b0wl6vWZT0 "Adversarial Training for Relation Extraction,'' Wu et al.: https://t.co/ObFn0e3T0Z @StevenGlinert Can't speak to all StarCraft AIs but at least some (e.g https://t.co/26hGlLBtdo) use variants of DQN w/ bells+whistles (eg decentralization) To be continued... "Robust Task Clustering for Deep Many-Task Learning," Yu, Guo, and Yi et al.: https://t.co/OysHZnQGP1 "Generative Models for Network Neuroscience: Prospects and Promise," Betzel and Bassett: https://t.co/f5OHrQgRPm "Explainable Artificial Intelligence: Understanding, Visualizing + Interpreting Deep Learning Models," Samek et al.: https://t.co/p9Q0RNJ57x "k-Nearest Neighbor Augmented Neural Networks for Text Classification," Wang et al.: https://t.co/SpI4iqUhxn "One-Shot Concept Learning by Simulating Evolutionary Instinct Development," Ahmed + Bikmal, S. Forsyth High School: https://t.co/ohh7fb8YUc "Controlled Sequential Monte Carlo," Heng et al.: https://t.co/D79hn2orr6 "ChemGAN challenge for drug discovery: can AI reproduce natural chemical diversity?," Mostapha Benhenda: https://t.co/Cecl5aQoV2 "Methods for applying the Neural Engineering Framework to neuromorphic hardware," Voelker and Eliasmith: https://t.co/u6qYsUZdBK That one's short and pretty accessible. Good intro to and context for Noisy SGD and PATE. "On the Protection of Private Information in Machine Learning Systems: Two Recent Approaches," Abadi et al.: https://t.co/ZTS4T4An0A ...and complementary to our recent DRL survey (not just on games, but not covering as much game stuff as them): https://t.co/KIqtU3vTJl arXiv papers, August 29 - "Deep Learning for Video Game Playing," Justesen et al.: https://t.co/1ZlzCuyhIj Looks like nice review... https://t.co/VYQelSbFgn @_jyan_ indeed (didn't know about the class though), hence the emojis :) @_jyan_ maybe not soon but eventually, as safety issues not urgent now for lab based stuff. Need to know when to blow whistles first :) @_jyan_ I like the idea of whistleblowers in general, but hiring someone specifically for that role is a bit atypical. Maybe makes sense, tho, dunno "One-Shot Concept Learning by Simulating Evolutionary Instinct Development," Abrar Ahmed and Anish Bikmal: https://t.co/ohh7fb8YUc 🎓💯 https://t.co/ylTxVgNmrw @Zergylord congrats! @jordnb congrats! RT @paul_scharre: @BanKillerRobots @mchorowitz @icracnet Shout outs in the article to @RebeccaCrootof and @HMRoff for their work on autonom… RT @paul_scharre: What should we make of the letter from AI company CEOs on #autonomousweapons? https://t.co/JB6mYcxnMY @BanKillerRobots @m… OpenAI is seeking more researchers for their safety team (among other roles): https://t.co/5Ll38fs5kO @L_badikho how was it? RT @iamtrask: OpenMined is the first Open Source Federated Learning library - currently under active volunteer development - https://t.co/v… @jeremyphoward @vulnerablepops @haldaume3 not sure... @davegershgorn if they can't handle you at your omelet, they don't deserve you at your poignant AI remarks @jeremyphoward @vulnerablepops @haldaume3 Yes, lots of people find papers and comments on/critiques thereof here. I find it helpful! Also feeds into tools like arxiv sanity preserver Seems potentially important - https://t.co/6aP57I0hPO Fin. "Reinforcement Mechanism Design for e-commerce," Cai et al.: https://t.co/Z8rVwwJ7cc "Learning the Enigma with Recurrent Neural Networks," Sam Greydanus: https://t.co/ebIb1AVDdo "Leaf Counting with Deep Convolutional and Deconvolutional Networks," Aich and Stavness: https://t.co/66a3uwuYLl "Active Preference Learning for Personalized Portfolio Construction," Tee et al.: https://t.co/UwVHzGeHvf "A Robust Indoor Scene Recognition Method based on Sparse Representation," Nascimento et al.: https://t.co/7JKG8LXKX7 "Objective Classes for Micro-Facial Expression Recognition," Davison et al.: https://t.co/n5Yv0VVjt0 "Supervised Speech Separation Based on Deep Learning: An Overview," Wang and Chen: https://t.co/KryvkJHIhi "FacePoseNet: Making a Case for Landmark-Free Face Alignment," Chang et al.: https://t.co/dzzrVrKHgd "A General Framework of Studying Eigenvector Multicentrality in Multilayer Networks," Wu et al.: https://t.co/CPj7E5YSSW "Joint Structured Learning and Predictions under Logical Constraints in CRFs," Jean-Luc Meunier: https://t.co/HzmPy27gTx "Semantic Foggy Scene Understanding with Synthetic Data," Sakaridis et al.: https://t.co/ru62TWtw3Q "Subspace Approximation for Approximate Nearest Neighbor Search in NLP," Jing Wang: https://t.co/oayStalmoJ "Low Cost, Open-Source Testbed to Enable Full-Sized Automated Vehicle Research," Costley et al.: https://t.co/undGqq3i0V Good 1st auth. name "Evaluation of Deep Learning on an Abstract Image Classification Dataset," Stabinger and Rodriguez-Sanchez: https://t.co/E9CK4aTM2Z "A Function Approximation Method for Model-based High-Dimensional Inverse Reinforcement Learning," Li and Burdick: https://t.co/kJBINAfbuK "Multi-Agent Q-Learning for Minimizing Demand-Supply Power Deficit in Microgrids," Diddigi et al.: https://t.co/IEUXfhfvDj "Revisiting the Centroid-based Method: A Strong Baseline for Multi-Doc. Summarization," Demian Gholipour Ghalandari: https://t.co/4WsWsNT2Jq "Learning Spatio-Temporal Features with 3D Residual Networks for Action Recognition," Hara et al.: https://t.co/auPHmJtTAI "SPARQL as a Foreign Language," Soru et al.: https://t.co/PT0gYbiAnr "More Iterations/Second, Same Quality--Why Async Algos may Drastically Outperform Traditional Ones," Hannah and Yin: https://t.co/3tfD26NZ3g "Delayed Sampling and Automatic Rao-Blackwellization of Probabilistic Programs," Murray et al.: https://t.co/pghQCy1IXp "Accurate parameter estimation for Bayesian Net. Classifiers using Hierarchical Dirichlet Processes"-Petitjean et al https://t.co/ltLMT9KRQ1 "Modular Learning Component Attacks: Today's Reality, Tomorrow's Challenge," Zhang et al.: https://t.co/GDP8qAANBV arXiv papers, August 28 - "Fashion-MNIST: a Novel Image Dataset for Benchmarking ML Algorithms," Xiao et al.: https://t.co/lSEUMGkCh8 @hardmaru @jonfildes and speaking of arXiv, lots of the letters are about asking for copies of papers. @hardmaru @jonfildes unfortunately, images of them are not on the site, just summaries. @jonfildes TFW you miscalculate Turing's taxes. https://t.co/dgmWKwD1Zp @jonfildes Also this (he died the next year). https://t.co/RqNatQnTKX https://t.co/OICFjTFYik @jonfildes See also (from the link Jon tweeted), I assume referring to the same paper. https://t.co/DiBtDYTWxC Turing on RL + attributing creativity to machines v humans (h/t @jonfildes for sending me down a Turing rabbit hole) https://t.co/gJBf4sc78C https://t.co/WVhfWZ0WCQ RT @jonfildes: @OfficialUoM The whole lot available to search here: https://t.co/AynHp6WZhS RT @jonfildes: This is amazing - 150 of Turing's letters found in an old filing cabinet @OfficialUoM https://t.co/WdZigSaOu9 Fin. "M2D: Monolog to Dialog Generation for Conversational Story Telling," Bowden et al.: https://t.co/4LLv6wDsUn "Classification via Tensor Decompositions of Echo State Networks," Ashley Prater: https://t.co/JQImFo1gDR @oh3kqd thanks! @jackclarkSF @zacharylipton easy: Watson "An LSTM-Based Dynamic Customer Model for Fashion Recommendation," Heinz et al.: https://t.co/4lYF7FnyKy "Learning Grasping Interaction with Geometry-aware 3D Representations," Yan et al.: https://t.co/MbqyagGpHD "Towards an Automatic Turing Test: Learning to Evaluate Dialogue Responses," Lowe and Noseworthy et al.: https://t.co/4HZiUlRQsZ "3D Morphable Models as Spatial Transformer Networks," Bas et al.: https://t.co/9M62kXFKm5 "A Study on Neural Network Language Modeling," Dengliang Shi: https://t.co/c7EXbzFEjR "Intent Communication between Autonomous Vehicles and Pedestrians," Matthews et al.: https://t.co/sY0GiRgYcE "Massively-Parallel Feature Selection for Big Data," Tsamardinos et al.: https://t.co/xdpwAZuLPi "Is Deep Learning Safe for Robot Vision? Adversarial Examples against the iCub Humanoid," Melis et al.: https://t.co/2gUJJGgKtV "Scale-invariant unconstrained online learning," Wojciech Kotłowski: https://t.co/jNbUtvvEdJ "Dynamic Input Structure and Network Assembly for Few-Shot Learning," Hilliard et al.: https://t.co/XPv6ymj4q0 "Non-linear Convolution Filters for CNN-based Learning," Zoumpourlis et al.: https://t.co/KEgWApV81g "Capturing Long-term Temporal Dependencies with CNNs for Continuous Emotion Recognition," Khorram et al.: https://t.co/UlY8OA8Ql9 "Automatic Detection of Fake News," Perez-Rosas et al.: https://t.co/0ZC7M52M9Z "Super-Convergence: Very Fast Training of Residual Networks Using Large Learning Rates," Smith and Topin: https://t.co/88vIjVqJmO "Tags2Parts: Discovering Semantic Regions from Shape Tags," Muralikrishnan et al.: https://t.co/QBfsP0LqBA "CNN Fixations: An unraveling approach to visualize the discriminative image regions," Mopuri et al.: https://t.co/nJDtmy3crj "A Spatiotemporal Oriented Energy Network for Dynamic Texture Recognition," Hadji and Wildes: https://t.co/51q7rbdert "WordSup: Exploiting Word Annotations for Character based Text Detection," Hu et al.: https://t.co/nfHr9Udzw0 "VIGAN: Missing View Imputation with Generative Adversarial Networks," Shang et al.: https://t.co/y8Gpq0bYRA "BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chain," Gu et al.: https://t.co/wXVKCrlCl1 "Representation Learning by Learning to Count," Noroozi et al.: https://t.co/VZm5fEb9Xb "Twin Networks: Using the Future as a Regularizer," Serdyuk et al.: https://t.co/sjLXQM1D8s "Deep vs. Diverse Architectures for Classification Problems," Colleen Farrelly: https://t.co/uUq3lOA7RC "Sum-Product Graphical Models," Desana and Schnorr: https://t.co/IkMtnxqjnZ "Exploiting Convolution Filter Patterns for Transfer Learning," Aygun et al.: https://t.co/B0Hbfjn0PP "Incremental Learning of Object Detectors without Catastrophic Forgetting," Shmelkov et al.: https://t.co/ZEjWt3eoA3 "Generating Visual Representations for Zero-Shot Classification," Bucher et al.: https://t.co/hryZDVRFmr "Paving the Roadway for Safety of Automated Vehicles: An Empirical Study on Testing Challenges," Knauss et al.: https://t.co/SmzYuNyT36 "Statistical Selection of CNN-Based Audiovis Features 4 Instantan Estimation of Human Emotional States"-Basnet et al https://t.co/CzcF6G9k80 "The Unconstrained Ear Recognition Challenge," Emeršič et al.: https://t.co/M3DMzQWK0E (recognizing people by their ears) "CNN-Based Prediction of Frame-Level Shot Importance for Video Summarization," Al Nahian et al.: https://t.co/FJFtXo8wFe "Fast single image super-resolution based on sigmoid transformation," Wang et al.: https://t.co/mdR5xhoVom "Application of a CNN for image classification to the analysis of collisions in High Energy Physics," Madrazo et al: https://t.co/RYGryeTupu "Skip RNN: Learning to Skip State Updates in Recurrent Neural Networks," Campos et al.: https://t.co/uJRyBBmcBM "Nonparametric regression using deep neural networks with ReLU activation function," Johannes Schmidt-Hieber: https://t.co/cw0uFCHRAl "Learning Combinations of Sigmoids Through Gradient Estimation," Ionnadis and Montanari: https://t.co/nphNFi1z1N "On a Formal Model of Safe and Scalable Self-driving Cars," Shalev-Shwartz et al.: https://t.co/ziiSAUHToh "Automated Feature Extraction for Website Fingerprinting through Deep Learning," Rimmer et al.: https://t.co/pFsCIcrNAK "STNet: Selective Tuning of Convolutional Networks for Object Localization," Biparva and Tsotsos: https://t.co/vPiEYGIJ26 "SafePredict: A Meta-Algorithm for Machine Learning That Uses Refusals to Guarantee Correctness," Kocak et al.: https://t.co/jAs8zYIVTg "Cold Fusion: Training Seq2Seq Models Together with Language Models," Sriram et al.: https://t.co/H6W9KZa4u7 "PiCANet: Learning Pixel-wise Contextual Attention in ConvNets and Its Application in Saliency Detection," Liu+Han: https://t.co/B036F9Iyob "Planning Based System for Child-Robot Interaction in Dynamic Play Environments," Charisi et al.: https://t.co/JzMvAbuz65 "Sharpness-aware Low dose CT denoising using conditional generative adversarial network," Ye and Babyn: https://t.co/GtPPlOaoUT "Towards Automatic Construction of Diverse, High-quality Image Dataset," Yao et al.: https://t.co/Mqi1R5TsAy "Sparsity Invariant CNNs," Uhrig et al.: https://t.co/F8CNw0Mj03 "Handling Homographs in Neural Machine Translation," Liu et al.: https://t.co/nBGfaWAHt8 "Learning Efficient Convolutional Networks through Network Slimming," Liu et al.: https://t.co/XuYkp8mQZT "Neural Network-based Graph Embedding for Cross-Platform Binary Code Similarity Detection," Xu et al.: https://t.co/xaHicUGgxL "Stacked transfer learning for tropical cyclone intensity prediction," Deo et al.: https://t.co/z1t9nsq5IE "Reinforcement Learning in POMDPs w/ Memoryless Options + Option-Observation Initiation Sets," Steckelmacher et al.: https://t.co/OIcT2RpnZm "EEG-based Intention Rec.from Spatio-Temporal Rep's via Cascade and Parallel Convolutional RNNs," Zhang et al.: https://t.co/W4mqmV8Nbs "Activity Recognition based on a Magnitude-Orientation Stream Network," Caetano et al.: https://t.co/PbWNJraViE "Build your own visual-inertial odometry aided cost-effective and open-source autonomous drone," Sa et al.: https://t.co/sKNe7bTRbC "On Image Classification: Correlation v.s. Causality," Shen et al.: https://t.co/YPTJJU3dW5 "Large-Scale User Modeling with Recurrent Neural Nets for Music Discovery on Multiple Time Scales," De Boom et al.: https://t.co/MP7NEZ4kkP "Deep EndoVO: A Recurrent CNN based Visual Odometry Approach for Endoscopic Capsule Robots," Turan et al.: https://t.co/tPQkFZgg53 "Classification of Radiology Reports Using Neural Attention Models," Shin et al.: https://t.co/IESKGrsuEA arXiv papers, August 23-25 - "Anytime Neural Networks via Joint Optimization of Auxiliary Losses," Hu et al.: https://t.co/aKdLuJHjKB h/t @SmithaMilli "We found participants who identified the robot as a bomb threat were just as likely to open the door (87%) as those who did not." "Piggybacking Robots: Human-Robot Overtrust in University Dormitory Security," Booth et al.: https://t.co/ZShIcY6ip3 @KaiLashArul it's delightful. Great work @GalaxyKate RT @pabbeel: Excellent lecture on model based RL at DeepRLBootcamp by @chelseabfinn https://t.co/GIeNwgRQft RT @ABC: Astounding video shows numerous boats maneuvering around stranded vehicles on flooded street in Dickinson, Texas. https://t.co/JZv… RT @meetmissjoness: Incredible, watch as @BrandiKHOU flags down a rescue boat on-air, saving this truck driver's life https://t.co/EVvNbdt1… RT @ShannonVallor: This app is identical to the hypothetical example I give in my talks of the kind of unethical AI design to avoid. Of cou… RT @innjesst: early this week WIP collab w/@orgicus getting this little guy to doodle #mirobot #sketch #rnn #magenta #TensorFlow #robot #dr… "Advisors: bungling this hurricane response could cost many lives and jeopardize your presidency. Trump: https://t.co/sArLFZ5mVQ" RT @mike_58stingray: An unbelievable photo of nursing home residents waiting to get rescued in Houston. https://t.co/lxPmYA6bGI "RT @sla: Preferred Networks is proudly sponsoring Deep RL Bootcamp at UC Berkeley, today & tomorrow. What a packed room! https://t.co/B1FEu…" @RebeccaCrootof it me for AI. RT @stevenpbrumby: @Miles_Brundage @thedansimonson Need an early 2000's-era version with Researchers ignoring Neural Networks and lusting a… @ivan_bezdomny as in the original meme, they can be friends ;) https://t.co/yKSt3e9Kfh "RT @TIME: Trump cybersecurity advisors resign, citing his ‘insufficient attention’ to threats https://t.co/WfBdGAbfGe" RT @hardmaru: Neural Net evolved to play Mario Kart 64, requiring only small computing power. MarioKart64NEAT code by Nick Nelson: https://… https://t.co/93uBmXn25f If you loved 1 in every batch of 10,000 YouTube videos and had good filtering, you could watch brand new YouTube vids you love forever. Helpful reference suggestions... https://t.co/ExzE624E4K RT @monkeycageblog: Why Trump’s pardon of Joe Arpaio isn’t like most presidential pardons https://t.co/OdS3gGs3WJ RT @ACLU: We'll see you in court, @realDonaldTrump. https://t.co/LjGWu7gU5J RT @Asher_Wolf: This tweet was not fully thought through. https://t.co/zZtcDUm0DO @girlziplocked do you mean something in particular by curbing AI? For non-Arizonans/non-political people: Arpaio is very, very bad. @_jyan_ @jackclarkSF I'd be surprised if they didn't, but more surprised if they were #1 at ICML, NIPS, or ICLR. RT @kylegriffin1: Hours before a Category 4 hurricane hits US soil, Trump signs an order barring transgender people from the military and p… RT @nycsouthpaw: Trump pardons racist Arizona sheriff Joe Arpaio Friday night in the middle of a life-threatening natural disaster. https:/… @jwangARK haven't read em closely but search Xilinx brundage on twitter and you'll find the two I identified by org (maybe others I didnt) Been seeing lots of Xilinx papers on arXiv... https://t.co/9xvvSEGfmG Sci-fi short that's kinda like Battlestar Galactica except it all takes place on Earth: https://t.co/Q4OtFdSGhi @johnrobb @iamtrask haven't thought hard about the synergies/tensions here but it's good to see people thinking creatively about AI futures. @johnrobb @iamtrask relevant link for OpenMined: https://t.co/dV4DTMb8oS 🤔 Synergy btwn @johnrobb's AI@Home (https://t.co/8G4jRid4qH), @iamtrask et al's OpenMined, Sriraman et als AI coops? (https://t.co/OfB6kIC3gc) RT @AcademicsSay: https://t.co/zickzjzUx1 RT @FHIOxford: New paper: A Brief Survey of Deep Reinforcement Learning, w/ FHI researcher @Miles_Brundage & @KaiLashArul, @mpd37 https://… @gokstudio I agree with your point - it's an incentive problem. "RT @RikeFranke: Wanna know what to read on #drone warfare? I've got 60 recommendation for you: https://t.co/wSPo1GQfci" @RikeFranke I really like it so far! Half done... RT @natfriedman: Today's the last day to apply for AI Grant – $2500 in cash and >$20k in GPU credits. Apply in just minutes: https://t.co/Q… @gokstudio is 3x more important than algos, govt should subsidize that more" (just a hypothetical example), could lead to cred in other domain (policy) @gokstudio yes, I think the rewards would mainly have to come from outside the AI field. For example, an economist/policy person saying "hey, hardware+ RT @zacharylipton: What are they smoking at @futurism? Aug 9 story about an IBM breakthrough: "deep learning using multiple servers" https:… RT @jameshensman: Probabilistic models underpin principled AI. https://t.co/ETWqNfAYwX (My first attempt at something like this, be gentle)… And it's also quite doable to run old algos on new compute, do ablation analysis on all sorts of DL tricks, etc. but just rarely done. P.S. I don't think this is at all intractable - so many data points on HW/data/SW/hyperparam/performance in papers - just takes time. Some exceptions - AI Impacts blog, some papers, EFF AI Prog Measurement proj., etc help - but generally ppl seem too confident abt it (4/4). More surprising is lack of serious efforts by anyone to test these models. AI ppl have excuse (working on algo part), others less so (3/n). ...one also often sees 3-4 factor models put forward by AI ppl (e.g. data, comp., algos, frameworks). Not surprising, diff POVs, but (2/n).. Common things one sees: 1-2 factor qualitative models of recent AI progress put forth by non-AI ppl (e.g. just data; data+compute)...(1/n) @zacharylipton well, not at CMU, but happy to be chief twitter hype officer if you'll allow an outsider in the position. @zacharylipton me Hope to catch up on other arXiv stuff soon. "Learning Generalized Reactive Policies using Deep Neural Networks," Groshev et al.: https://t.co/OMVvOpkUBU RT @katjahofmann: We're hiring! Excellent opportunity: postdoc/researcher in adaptive machine learning / decision making / RL https://t.co/… RT @iamtrask: Oxford's "Deep Learning for NLP" - Just noticed the Videos, Slides, and Practicals are all up on the Github now!!! https://t.… RT @robinhanson: My TED talk on #ageofem is now up! https://t.co/OsTjsRztDn @davegershgorn re: cloud market implicated, I'd think AI stuff is a pretty small segment of the total market still, no? (agree this is impt stuff though) He's also implicitly expressing his passion for Babylonians' invention of capitalization. Find someone who loves you as much as this guy dislikes a hypothesis about Babylonian math: https://t.co/AznQgoYxFP https://t.co/c5yO8LmjhE @y0b1byte nice! Yeah, I liked the 2nd even more, about halfway through 3rd. @XandaSchofield congrats! Enjoying @KelloLucas's book on cybersecurity and international relations. https://t.co/RUUR2phXlo (long-term bc PV is super cheap by comparison to most things now, but ultimately would be good to use land/light more efficiently) Big fan of this (though pretty long-term): split light into parts useful for both PV and thermal power production. https://t.co/iad7VJu8JQ @mat_kelcey 👎 @_jyan_ Numbers like that aren't super useful, but China also claiming ambition to catch up/surpass... do u disagree? @_jyan_ hm I just took the 10 trillion RMB as supposed to be rough #, not a reflection of ambition/lack thereof. They also say want world-leading AI Silly humans mixing up Hydropsyche saxonica and Hydropsyche angustipennis. SAD! Researchers compared humans to machines on a task. You will believe what happened next. (CNN a bit > average human, 1 human perfect though). "Human experts vs. machines in taxa recognition," Arje et al.: https://t.co/y8GWLG4ryS @_jyan_ @jackclarkSF *for various reasons @_jyan_ @jackclarkSF my impression is most labs pretty open, varies case by case for (product-related, high status thing like AlphaGo, whom talking to etc.). @_jyan_ @jackclarkSF Yes, NDA could cover such things, may/may not be enforced. I just interpreted u as making stronger link. Anyway, seems pretty open to me. @_jyan_ @jackclarkSF (prob some norms there about not talking about some research before publication, or product relevant R+D, but not correlated w/ NDA I think) @_jyan_ @jackclarkSF Most big companies have NDAs, but that doesn't imply they can't publish, just restricts talking about e.g. Google-wide emails, products, etc They also changed AI journalism forever. https://t.co/GUAjrwQm44 Work by folks at Ghent U. and Spotify. https://t.co/aJiuxQZGs1 "RT @RikeFranke: My @OUPAcademic Bibliography on #Drone Warfare has been published! Hopefull of use for students & teachers: https://t.co/wS…" "World of Bits: An Open-Domain Platform for Web-Based Agents," Shi et al., OpenAI/Stanford: https://t.co/IxjpmumBoi "RT @jackclarkSF: Weekend: Write fiction story about bitcoin miner starting AI biz Late Sunday night: Bitcoin company reveals AI biz https:…" @jackclarkSF or crypto @jackclarkSF It you https://t.co/Vp2M3wfJQj (second sentence). Also love the name Sophon. Now I wanna see adversarial ML algos w/ Wallbreaker/facer names RT @sg175: Our work (with @moyix) on vulnerabilities in pre-trained deep learning models now up on ArXiv. https://t.co/TYq0jt93JH https://t… RT @elonmusk: New Model X SUV now faster than a $500k Lamborghini https://t.co/J23AKNMnmV RT @ivan_bezdomny: @fchollet VC always been better at evaluating business then technical reality. They knew car share would be huge. They k… RT @fchollet: I feel like AI VC in SV is overcrowded by a considerable factor. There is far more money than viable ideas. And VC firms lack… RT @goodfellow_ian: CleverHans 2.0.0 is out: https://t.co/bfRyJ0GDXB Many thanks to all our contributors! @RebeccaCrootof @BanKillerRobots seems like chump change for a generous aid country like Sweden but point taken re ownership @RebeccaCrootof but seems like anyone could just give it to the same exact account as states would? per @BanKillerRobots its <<1 mill @RebeccaCrootof agree thats not ideal - was being somewhat cheeky bc they just complained about it. Philanthropists, other govts better Can't be that expensive... CC @RebeccaCrootof Was the UN autonomous weapons meeting cancelled bc ppl angry about states not paying dues or $ needed for mtg? If latter, why not CEOs pay? RT @weballergy: 'Twin Networks: Using the Future as a Regularizer': https://t.co/PJcUc3xJEJ #DeepLearning #MachineLearning #AI https://t.co… Cool AI safety work from ANU + DeepMind - see also informal blog summary from Everitt here: https://t.co/6UdqdUsDXg https://t.co/5zMF6fZu5E RT @vkrakovna: An updated version of our IJCAI paper on RL with reward corruption, with updated proofs and explanations https://t.co/M0roBc… ... https://t.co/AFlmG0M27r RT @ToniCreswell: GAN papers are not the only ones with amusing titles: "VAE with a VampPrior" 🎃🧛‍♀️🦇 @_jyan_ @KaiLashArul @mpd37 who translated it? RT @Miles_Brundage: Remember Jibo? RT @Miles_Brundage: Remember Viv? @hyponymous thanks! @botminds @hardmaru agree fly vs demo unfair 1:1 comp, diff numerator. but skeptical that 200x greater (vision vs. vision seems fairer) https://t.co/VFswjqEdZi @botminds @hardmaru not sure we're talking about the same thing? I'm talking about behavioral complexity:parameter ratio, not parameter:energy. @twitskeptic @hardmaru not sure what a better comparison would be, perhaps vision system for rat vs sub-human but pretty good comp vision @twitskeptic @hardmaru comparing the soccer thing to fruit fly prob unfair - fly does more, but also has >> params even if 1 param/synapse @twitskeptic @hardmaru if >>1 param/synapse, params maybe not v efficiently used, it an ML system v bio brain can do ~same w same # neurons @ivan_bezdomny @hardmaru yeah def. a big gap there @hossein_h10 do you recall how long before posting on arXiv u did experiments? (/if change was because of paper or not?) @hardmaru this makes me think brains arent as efficient/optimized as ppl think (fruit flies=10M synapses/~parameters), ML > than ppl think RT @KaiLashArul: Deep Reinforcement Learning: An Overview by @yuxili99: https://t.co/XCFfEO7s1M. A complimentary, more comprehensive list o… RT @mpshanahan: Recommended https://t.co/AJI2HZllEA RT @goodfellow_ian: Have an idea for blocking adversarial examples or making them stronger? Join our NIPS 2017 competition on Kaggle: https… FIn. "Security, Privacy and Safety Evaluation of Dynamic and Static Fleets of Drones," Akram et al.: https://t.co/gTP5Ds6xRm "Sparkle: Optimizing Spark for Large Memory Machines and Analytics," Kim et al.: https://t.co/NdMhg7A1tJ "Cross-Lingual Dependency Parsing for Closely Related Languages - Helsinki's Sub. to VarDial 2017," J. Tiedemann: https://t.co/FJ5w4zggR8 "The Helsinki Neural Machine Translation System," Östling et al.: https://t.co/BUXl51csjt "Privacy Concerns and Attitudes on the Internet of Things," Ponciano et al.: https://t.co/HvmBqzQhQT "Arabic Multi-Dialect Segmentation: bi-LSTM-CRF vs. SVM," Eldesouki et al.: https://t.co/yD8Gyn5mlA "What Drives the International Development Agenda? An NLP Analysis of the UN General Debate 1970-2016," Baturo et al https://t.co/8o6IV2Hetr "Teaching UAVs to Race Using UE4Sim," Mueller et al.: https://t.co/e9uH2ikOFm (2/2) "UE4Sim: A Photo-Realistic Simulator for Computer Vision Applications," Mueller et al.: https://t.co/SzLQLM7jXZ and... (1/2) "Image2song: Song Retrieval via Bridging Image Content and Lyric Words," Li et al.: https://t.co/T665ulioLX "NIZKCTF: A Non-Interactive Zero-Knowledge Capture the Flag Platform," Matias et al.: https://t.co/24AZFXNnRB "Real Time Prediction of Drive by Download Attacks on Twitter," Javed et al.: https://t.co/aZmSxmy0mr "Visual Forecasting by Imitating Dynamics in Natural Sequences," Zeng et al.: https://t.co/EllIzB9qYc "Ensemble Of Deep Neural Networks For Acoustic Scene Classification," Duppada and Hiray: https://t.co/6bF8bURDkI "Applying Deep Bidirectional LSTM and Mixture Density Network for Basketball Trajectory Prediction," Zhao et al.: https://t.co/9QhXkwQS0F "Employing Weak Annotations for Medical Image Analysis Problems," Rajchl et al.: https://t.co/bVHwb88R3T "The CARESSES EU-Japan project: making assistive robots culturally competent," Bruno et al.: https://t.co/1OR8PnUFJu "This Far, No Further: Introducing Virtual Borders to Mobile Robots Using a Laser Pointer," Sprute et al.: https://t.co/OsUo1MHIyB "Probabilistic Relation Induction in Vector Space Embeddings," Bouraoui et al.: https://t.co/nzntdP6lEz "Notes: A Continuous Model of Neural Networks. Part I: Residual Networks," Li and Shi: https://t.co/Ry6f0K9Jdh "GraphR: Accelerating Graph Processing Using ReRAM," Song et al.: https://t.co/pxQjUHWFMG "Stochastic IMT (insulator-metal-transition) neurons," Parihar et al.: https://t.co/1i15HMMGQR "Fake News in Social Networks," Aymanns et al.: https://t.co/lVyyO1ZEpx "Givers & Receivers perceive handover tasks differently: Implications for Human-Rob.collab. system design," Roy+Edan https://t.co/EpZ7MG0xfQ "Revisiting knowledge transfer for training object class detectors," Uijlings et al.: https://t.co/R8qAukDwBq "Distantly Supervised Road Segmentation," Tsutsui et al.: https://t.co/Cj1W1yZlJK "Scientific Information Extraction with Semi-supervised Neural Tagging," Luan et al.: https://t.co/CgrFEoMsql "Vector Space Model as Cognitive Space for Text Classification," Ganesh HB et al.: https://t.co/XtVev2Vq6Z "nuts-flow/ml: data pre-processing for deep learning," Mateschke et al.: https://t.co/GYKS1As8oh "More cat than cute? Interpretable Prediction of Adjective-Noun Pairs," Fernandez et al.: https://t.co/f2mYtbxga0 "DeepBreath: Deep Learning of Breathing Patterns 4 Automatic Stress Rec using Low-Cost Thermal Imaging..." Cho et al https://t.co/mwt6wuIbFc "Portuguese Word Embeddings: Evaluating on Word Analogies and Natural Language Tasks," Hartmann et al.: https://t.co/dfB2Vp461K "Joint Multi-view Face Alignment in the Wild," Deng et al.: https://t.co/OFtOptLXvB "Learning to Paraphrase for Question Answering," Dong et al.: https://t.co/4r93ozW43O "A Capacity Scaling Law for Artificial Neural Networks," Friedland and Krell: https://t.co/MkVQFWYHov "Modelling Word Burstiness in Nat. Language: A Generalised Polya Process for Doc. Lang. Models in IR," R. Cummins: https://t.co/kQYYzMEfsm "Boltzmann machines and energy-based models" https://t.co/DVUsQKB0gl and "BMs for time-series,"T. Osogami: https://t.co/ghfjfdTvE4 "A Batch Noise Contrastive Estimation Approach for Training Large Vocabulary Language Models," Oualil and Klakow: https://t.co/Kb0bsi4BWW "LSTM Network for Inflected Abbreviation Expansion," Piotr Żelasko: https://t.co/qai2LFxrYG "Perceptual audio loss function for deep learning," Elbaz and Zikulevsky: https://t.co/oxIT6c3FIc "Attentive Semantic Video Generation using Captions," Marwah et al.: https://t.co/8R9ZkMzNST "Applying Data Augmentation to Handwritten Arabic Numeral Recognition Using Deep NNs," Ashiquzzaman et al.: https://t.co/uXkNzErbNl "ConStance: Modeling Annotation Contexts to Improve Stance Classification," Joseph et al.: https://t.co/8RsMXOagj4 "Neural Networks Compression for Language Modeling," Grachev et al.: https://t.co/ItPIcPeXVr "A Data + Model-Parallel, Distributed+Scalable Framework 4 Training of Deep Nets in Apache Spark," Shrivastava et al https://t.co/CUXCOWiXW1 "Learning Spread-out Local Feature Descriptors," Zhang et al.: https://t.co/S9QoxIWaxW "Stochastic Primal-Dual Proximal ExtraGradient Descent for Compositely Regularized Optimization," Lin et al.: https://t.co/46ighAPzcS "X-PACS: eXPlaining Anomalies by Characterizing Subspaces," Macha and Akoglu: https://t.co/nSDkueM6Xn "ExSIS: Extended Sure Independence Screening for Ultrahigh-dimensional Linear Models," Ahmed and Bajwa: https://t.co/FlYyZiMVUG "Data-Driven Tree Transforms and Metrics," Mishne et al.: https://t.co/HnuPtQWy0y "Improving Deep Learning using Generic Data Augmentation," Taylor and Nitschke: https://t.co/JqJTe9MIrG "Neural Block Sampling," Wang et al.: https://t.co/7pXj4JJzsB "General Backpropagation Algorithm for Training Second-order Neural Networks," Fan et al.: https://t.co/UceyC8gvd7 "The Stochastic Replica Approach to Machine Learning: Stability and Parameter Optimization," Chao et al.: https://t.co/IXslPMi9Zl "Pillar Networks++: Distributed non-parametric deep and wide networks," Sengupta and Qiu: https://t.co/PAm4Li66kI "Semi-supervised Conditional GANs," Sricharan et al.: https://t.co/DGS0jf9xAY "Secure Search on the Cloud via Coresets and Sketches," Akavia et al.: https://t.co/t33fSE8TS3 CC @iamtrask "A Deep Q-Network for the Beer Game with Partial Information," Oroojlooyjadid et al.: https://t.co/nQ48cVYjcT "Solving a New 3D Bin Packing Problem with Deep Reinforcement Learning Method," Hu et al.: https://t.co/aMQheY06K4 "Neural Machine Translation with Extended Context," Tiedemann and Scherrer: https://t.co/mKf2BrRd0J "An End-to-End Trainable Neural Network Model with Belief Tracking for Task-Oriented Dialog," Liu and Lane: https://t.co/rwTQseTfZL "The Natural Stories Corpus," Futrell et al.: https://t.co/rMcYkDp1I3 "Neural machine translation for low-resource languages," Östling and Tiedemann: https://t.co/wlJcvXc8Kk The survey, which is forthcoming in IEEE Signal Processing Magazine, covers RL fundamentals, value vs. policy search, key algos + frontiers. arXiv papers, August 22 - "A Brief Survey of Deep Reinforcement Learning," @KaiLashArul, @mpd37, me, and Bharath: https://t.co/KIqtU3vTJl RT @animesh_garg: Thanks @mpd37 @Miles_Brundage & @KaiLashArul for a very nice summary of deep reinforcement learning! https://t.co/fb8B9pt… @_jyan_ but I'm sure there's >0 ppl who fit the model you mention. Don't think it's the main one - mostly ppl have long timelines @_jyan_ There's a diversity of views/reasons for em (previous AI Winter [over]compensation, not knowing solution to X so assuming distant, etc.) @_jyan_ Think we'll see *more* generalish systems in more realish enviros in the next few years, but unlikely solve everything in that time. @_jyan_ Thanks! :) I'm not sure we have a consensus on such things, but from my POV, the condition (*more* human-like, *more* complex) is gradual. "RT @dennybritz: A Brief Survey of Deep Reinforcement Learning https://t.co/awFDgMKpka Looks amazing! By @KaiLashArul @mpd37 @Miles_Brunda…" Update on this: I'm told that the sort of solution suggested in paper (jitter) was already added a while ago, paper written before fixed. RT @KaiLashArul: @mpd37 @Miles_Brundage We hope that it is an accessible yet broad overview of the combination of reinforcement learning an… Check out our new survey of DRL! Covers foundations, key algorithms, and current research directions. https://t.co/tsDtElOQoi RT @KaiLashArul: A Brief Survey of Deep Reinforcement Learning w/ @mpd37 & @Miles_Brundage: https://t.co/pNBYQ8kv7h RT @fchollet: Just released Keras 2.0.7: https://t.co/fCWthGc7vR RT @MatthewGuz: Accepted papers at #IJCAI2017 by geographic area https://t.co/OY6sT3VwmO The goats did not faint. @ESYudkowsky @deontologician I'm not sure these are sharply divisible in all plausible scenarios, but in very hard takeoff scenarios, sure @ESYudkowsky @deontologician (governance of any sort maybe naive, or ban feasible, I don't know) @ESYudkowsky @deontologician that would indeed be bad. Seems plausible, not sure about likelihood. Doesn't help when vague call for governance described by media as ban @deontologician @ESYudkowsky To some extent, sure, though I think moreso for systems specifically designed for killing/power projection. 20 minutes until a bunch of goats faint (or don't faint) due to the eclipse. https://t.co/R1Wpa8KrEQ RT @WillOremus: "Five seconds, I'm not sure, but 10 seconds is probably too long and 20 seconds is definitely too long." https://t.co/GgJgx… (read Three Body Problem, people) Meanwhile, on Trisolaris, everyone is dehydrated. @ESYudkowsky maybe - could also be that big stock of effectors makes (human/AI-initiated) takeover easier, or coop on 1 paves way for other arXiv volume tonight will also block out the sun. RT @nytimes: No, seriously, don't look at the eclipse without special glasses https://t.co/8yn0yUVzIE @mdekstrand I assumed it vaguely had to do with Seldon/ML both involving prediction but not sure. CC @mark_riedl RT @RVAwonk: Six months after a #SolarEclipse that he interpreted as a sign from God, Nat Turner began his rebellion against slavery on thi… RT @limlouisa: BREAKING: Cambridge University Press backs down "We have listened to the academic community & taken the decision to unblock… RT @givesyouHel: https://t.co/SgVnAyjE7P RT @RebeccaCrootof: Bless you, MarketWatch: https://t.co/N9N4ZdEbTy RT @RebeccaCrootof: Of course, "Elon Musk and other experts raise alarm & offer help in creating international regulations for #AWS" doesn'… RT @RebeccaCrootof: But per usual, a nuanced call is quickly mischaracterized: https://t.co/BpMaUCywkH RT @RebeccaCrootof: Notwithstanding misleading headlines, the 8/21 Open Letter never calls for a #AWS ban. That was clearly intentional. ht… @pmo_fillingham it was shown that more careful trained humans could do better than previously reported human level, that now reached by AI 2 This would put the new system (and the revised human score) just below the bottom of this graph. Big progress! https://t.co/y9wf76p4ya https://t.co/EBPLdVCl6k RT @erichorvitz: Another AI milestone from researchers at Microsoft https://t.co/sFbma6Od7u @MSFTResearch @TheOfficialACM @compcomcon @Comp… RT @jwangARK: China's deep learning chip startup Cambricon reaches unicorn status https://t.co/GNjWvCmHEq @hardmaru think the relevant paper (not just webpage) had a few other authors, but agreed, impressive early work! Feel like we (in West - maybe talked about a lot in China) would be hearing a lot more about them if they weren't in China. Huge valuation. Would be very interested in people's take! SenseTime's pubs seem quite ambitious + they have lots of ppl/$/products. https://t.co/wPTdqnaH0m Fin. "Accelerating RNN training using sequence bucketing and multi-GPU data parallelization," Khomenko et al.: https://t.co/VNIlcuh3l4 (yeah, that's what it's about) "What does a convolutional neural network recognize in the moon?," Daigo Shoji: https://t.co/deTXvHQx3l "3D Pose Regression using Convolutional Neural Networks," Mahendran et al.: https://t.co/Phuc4Q5fhl "Learning to Transfer," Wei et al.: https://t.co/9A4nFs52NG "Robust Contextual Bandit via the Capped-ℓ2 norm," Zhu et al.: https://t.co/2nyXYxkckO "An Annotated Corpus of Relational Strategies in Customer Service," Beaver et al.: https://t.co/8PiVp6supn "Eigen Evolution Pooling for Human Action Recognition," Wang et al.: https://t.co/JAaYvNTIRa "Large-Scale Domain Adaptation via Teacher-Student Learning," Li et al.: https://t.co/HPD3OlIQ9g "Dilated Residual Network for Image Denoising," Wang et al.: https://t.co/BHeliSzmhc "A Question Answering Approach to Emotion Cause Extraction," Gui et al.: https://t.co/1jSBoIf3hJ "Towards Interpretable Deep Neural Networks by Leveraging Adversarial Examples," Dong et al.: https://t.co/1zKA2Kkjwt "Towards the Automatic Anime Characters Creation with Generative Adversarial Networks," Jin et al.: https://t.co/UpIllWkNPI "Large Margin Learning in Set to Set Similarity Comparison for Person Re-identification," Zhou et al.: https://t.co/W3hn5GZfjl "Syllable-level Neural Language Model for Agglutinative Language," Yu et al.: https://t.co/fcWgsWywhk "EveTAR: Building a Large-Scale Multi-Task Test Collection over Arabic Tweets," Hasanain et al.: https://t.co/vMch9nZEOZ "Exploring Directional Path-Consistency for Solving Constraint Networks," Kong et al.: https://t.co/KaK3CfsDgx "Assessing the Stylistic Properties of Neurally Generated Text in Authorship Attribution," Manjavacas et al.: https://t.co/AJfKPLl57u "Mesh-based 3D Textured Urban Mapping," Romanoni et al.: https://t.co/01sLHdXU4d "Agree to Disagree: Improving Disagreement Detection with Dual GRUs," Hiray and Duppada: https://t.co/ldeJq7RIsB "Future Word Contexts in Neural Network Language Models," Chen et al.: https://t.co/eJ60s8NObq "Practical Network Blocks Design with Q-Learning," RL for NN design by Zhong et al. at CAS/SenseTime: https://t.co/Fwxn5rcbX1 "Statistical Latent Space Approach for Mixed Data Modelling and Applications," Ngueyn et al.: https://t.co/fHjO853YAz "Nonnegative RBMs for Parts-based Representations Discovery and Predictive Model Stabilization," Nguyen et al.: https://t.co/GDeH3dE8TX "Self-explanatory Deep Salient Object Detection," Xiao et al.: https://t.co/PDmrGlBdj3 Asynchronous variant of DQN used in practice by JD (~Chinese Amazon) for online sales, with big revenue improvement. "LADDER: A Human-Level Bidding Agent for Large-Scale Real-Time Online Auctions," Wang et al. at JD: https://t.co/abwV4ebopP @ericstsai @BenedictEvans Yes, this was suggested by the authors of that paper. Long paper presenting Seldonian (!) algorithms, an approach claimed to be useful for addressing bias, safety, etc. in ML. https://t.co/VRFqYZucsX arXiv papers, Aug. 21: "On Ensuring that Intelligent Machines Are Well-Behaved," Thomas, da Silva, Barto + Brunskill https://t.co/OVffyALsVd It's Seldon Sunday! @primalpoly That was what I was meaning to suggest but it's not really my area of expertise, haven't looked into it @primalpoly ...given more informal rights protections here in general. Seen some controversial stuff from folks at Ox, + they're still here FWIW @primalpoly I do not, unfortunately. I would guess it depends in part on institution/political climate (now, favorable - https://t.co/u2pKJsHnsO ) @primalpoly other grievances against Oxford (only 1 I've looked at) seem more free speech related, but counting that ^ makes me question agenda/framing @primalpoly methods a bit dubious/mix free speech+various things. Oxford docked points bc of sexual consent workshop for which non-attendance unpunished @FHIOxford Most are open access, too 👍 @FHIOxford Also, Pricing Externalities to Balance Public Risks and Benefits of Research, Farquhar et al.: https://t.co/nhKonHx6pd and so on. @FHIOxford (among other researchers) See e.g. Existential Risk and Cost-Effective Biosecurity by Millett and Snyder-Beattie: https://t.co/HzP5NxqR2A New issue of Health Security has several articles on catastrophic biological risks from researchers at @FHIOxford: https://t.co/72NuKpCDYR RT @hardmaru: @IrwanBello AutoML methods are not limited to Architecture Search. Neural Optimizer Search found simple optimizers that beat… @dmarthal problem is I don't even have time to read all thr abstracts :) but it does seem like a reasonsbly training data rich task @dmarthal summarization stuff? RT @hardmaru: Neural Optimizer Search with Reinforcement Learning, by @IrwanBello et al. Train RNNs to discover better optimizers. https://… @GarrulousGeoff I do want to watch it though @GarrulousGeoff haven't watched it/don't have time so don't want to want to watch it. @GarrulousGeoff please don't say anything positive about the new show @gwern Tencent working on it, too, re: engineering/compute, and FB... @gwern BTW, think Feudal Nets (and prob. some hierarchical RL papers I know less well) merits a place on your list of relevant papers. @gwern Almost certainly under 5 years. I have a bet (with you as referee, I think) re: end of 2018. I wonder if sooner is realistic. But so many papers. I misread "malicious hardware" as "delicious hardware." Should probably sleep soon. Between these observations, Feudal Nets, GAIL/etc. in imitation learning, etc. I think the writing is prob. on the wall... Also, still pretty small training set. Looks like more/better human data and self-play data would go a long way towards good value network. Plots in question below. If that were already superhuman with weak baselines, it'd be a pretty good hint as to where things are headed... https://t.co/hwYqiXXFYm Pretty good % after 20 mins - unsurprising (I think? SC fans?). If AlphaGo=any guide, earlier prediction (e.g. 7 mins) could be superhuman. Finally read whole DeepMind SC2 paper; found supervised learning stuff interesting. Wonder how win prediction rate compares to a human's? @mark_riedl @FDGconf Didn't realize Trump was giving talks at academic conferences now. Seriously, though, WTF. And he keeps going still. RT @mark_riedl: Glad to see a swift and unambiguous response from @FDGconf https://t.co/dJfqCZecoR @william_fitz @qhardy thanks! So, it's a paid service. But authors used free demo it seems. Maybe computationally cheaper/less robust than paid version? CC @qhardy P.S. This is (I hope?) still just a demo, but robustness of cloud AI services will be a big deal soon even if it isn't already. @F_Vaggi I don't know what this is actually being used for. I assumed mostly internal corporate purposes but maybe not. Another issue: inappropriate stuff can be put in audio track, API only looks at video. Quick reminder: machine learning algorithms are not (yet) robust under good circumstances, let alone w/ gaping holes like this. @F_Vaggi that is a solution the authors in fact propose. I think it's probably because they assume there are no adversaries. Huge opening to adversarial attacks though (fortunately/hopefully?) not used on critical systems. I'm coining Tyler Durden Attack for this. :O "we show that the [Google video] API generates...labels by processing only 1st frame of every second of..video" https://t.co/EzQfw9puDx Nice talk on deep RL from Raia Hadsell of DeepMind: https://t.co/zryTFBsiJh RT @y0b1byte: I've just updated the Atari Grand Challenge dataset and published the first version of data loaders + some utils https://t.co… "computers will... remove the gray. info you successfully keep private u can have more private than ever...once not private, fully public" @robinhanson Uses example of DejaNews search by employer who finds embarrassing Usenet postings. Google later bought Deja, as I just discovered w/ Google @robinhanson "ease of access of public knowledge + ease of correlation will remove a lot of what we currently think of as privacy"[but strong crypto too] Prescient 1997 talk by Mark Miller on code as law, smart contracts, encryption, etc. complete w @robinhanson cameo. https://t.co/VfbNoHh1x3 https://t.co/TkP0G1UzbE @adam_will_do_it trying to have somewhat self contained manageable threads. Alas... @adam_will_do_it don't worry, plenty of material on the Thursday/Friday megathread. Fin. That's it for last week! 🤖 "SMASH: One-Shot Model Architecture Search through HyperNetworks," Brock et al.: https://t.co/IdTGlLYFdN "General AI Challenge - Round One: Gradual Learning," Feyereisl et al.: https://t.co/NF5lHkGmjV "Deep Learning at 15PF [petaflops]: Supervised and Semi-Supervised Classification for Scientific Data," Kurth et al: https://t.co/qCPBFqBe4g "Structures of Knowledge from Wikipedia Networks," Maxime Gabella: https://t.co/CH2cz7TpF5 cultures as represented in Wiki knowl. structures "Data-driven Advice for Applying Machine Learning to Bioinformatics Problems," Olson et al.: https://t.co/RC1YRPQhn8 "Corrupt Bandits for Privacy Preserving Input," Gajane et al.: https://t.co/VdhNIHjGOv "Deep & Cross Network for Ad Click Predictions," Wang et al., Google: https://t.co/NRegG3M0pa (somewhat rare to see Google ad papers) "Machine Learning as an Adversarial Service: Learning Black-Box Adversarial Examples," Hayes and Danezis: https://t.co/BqvJlxm90G "Pseudo-extended Markov chain Monte Carlo," Nemeth et al.: https://t.co/JHfz5V5zgi "Efficient Use of Limited-Memory Resources to Accelerate Linear Learning," Dünner et al.: https://t.co/JZ00m0Jpmm "An Ensemble Quadratic Echo State Network for Nonlinear Spatio-Temporal Forecasting," McDermott and Wikle: https://t.co/rDir2K95UC "Adaptive Clustering Using Kernel Density Estimators," Steinwart et al.: https://t.co/EaVbQIzLMs "Auxiliary Variables for Multi-Dirichlet Priors," Christoph Kling: https://t.co/2HyvqAYlcf "Learning a Multi-View Stereo Machine," Kar et al.: https://t.co/b1LMHBhMLG "Restricted Boltzmann machine to determine the input weights for extreme learning machines," Pacheco et al.: https://t.co/p5FOkmA47G "PixelNN: Example-based Image Synthesis," Bansal et al.: https://t.co/pe6sgvVG45 "MirrorFlow: Exploiting Symmetries in Joint Optical Flow and Occlusion Estimation," Hur and Roth: https://t.co/JoPrGzB8C4 "Learning Musical Relations using Gated Autoencoders," Lattner et al.: https://t.co/Muxyga2Y1z "Deep Residual Learning and PDEs on Manifold," Li and Shi: https://t.co/wGab2jUuuU Among other things, they find that different sorts of systems are good for working with humans, vs. just the SOTA. Cool - "Evaluating Visual Conversational Agents via Cooperative Human-AI Games," Chattopadhyay and Yadav et al.: https://t.co/KRbleTonFl "Deep Binary Reconstruction for Cross-modal Hashing," Li et al.: https://t.co/cVXGjBDuQK "Deep Scene Text Detection with Connected Component Proposals," Jiang et al.: https://t.co/9Do2QpxBaO "Pixel-Level Matching for Video Object Segmentation using Convolutional Neural Networks," Yoon et al.: https://t.co/jGV58sAFRd "Scalable trust-region method for deep RL using Kronecker-factored approximation," Wu and Mansinov et al.: https://t.co/zrKPNzDs4o "Energy-based Models for Video Anomaly Detection," Vu et al.: https://t.co/KpPaFjFCqH "FaceBoxes: A CPU Real-time Face Detector with High Accuracy," Zhang et al.: https://t.co/GF93mTVgam S^3FD: Single Shot Scale-invariant Face Detector," Zhang et al.: https://t.co/7ETluvarzr "Incorporating Copying Mechanism in Image Captioning for Learning Novel Objects," Yao et al.: https://t.co/D33TR4BOdM "Designing and building the mlpack open-source machine learning library," Curtin and Edel: https://t.co/xuNzn7u6II "Simple Open Stance Classification for Rumour Analysis," Aker et al.: https://t.co/qTtwVja5Mr "Fast Matrix Factorization for Online Recommendation with Implicit Feedback," He et al.: https://t.co/s5mFDFMLt0 "Neural Factorization Machines for Sparse Predictive Analytics," He and Chua: https://t.co/p7TRyEle4b "Deep Neural Network Capacity," Wang et al.: https://t.co/fPCFYsI17p "Neural Collaborative Filtering," He et al.: https://t.co/Py0iYDK5Rv "ConvNet Architecture Search for Spatiotemporal Feature Learning," Tran et al.: https://t.co/EswowW81Rb "Cross-lingual Entity Alignment via Joint Attribute-Preserving Embedding," Sun et al.: https://t.co/6zOBDrye0K "Learning spectro-temporal features with 3D CNNs for speech emotion recognition," Kim et al.: https://t.co/TF8Lu7L4Y5 "Efficient training-image based geostatistical simulation and inversion using a spatial GAN," Laloy et al.: https://t.co/dRfz0IQSJH "Scalable Joint Models for Reliable Uncertainty-Aware Event Prediction," Soleimani et al.: https://t.co/ZxL4wEqMo0 "Weighted parallel SGD for distributed unbalanced-workload training system," Daning et al.: https://t.co/UInmgwbg2d "Ultra-Fast Reactive Transport Simulations When Chemical Reactions Meet ML: Chemical Equilibrium," Leal et al.: https://t.co/NyVjOs6ZoH "Active Orthogonal Matching Pursuit for Sparse Subspace Clustering," Chen et al.: https://t.co/BHyyFoVjTp "BitNet: Bit-Regularized Deep Neural Networks," Raghavan et al.: https://t.co/fwBnJn35v2 "Racing Thompson: an Efficient Algorithm for Thompson Sampling with Non-conjugate Priors," Zhuo et al.: https://t.co/y5nP2vqT8B "Geometric Enclosing Networks," Le et al.: https://t.co/klLNZqZbwC "GANs for Biological Image Synthesis," Osokin et al.: https://t.co/jqBU7WIsDk "Augmentor: An Image Augmentation Library for Machine Learning," Bloice et al.: https://t.co/nDUuFWBi0B "Deep Learning the Ising Model Near Criticality," Morningstar and Melko: https://t.co/FGH6EmosLy "Adaptive Threshold Sampling and Estimation," Daniel Ting: https://t.co/5tGfYSmzCg "Fault in your stars: An Analysis of Android App Reviews," Aralikatte et al.: https://t.co/rhtsgxyzoU "Visualizing and Exploring Dynamic High-Dimensional Datasets with LION-tSNE," Boytsov et al.: https://t.co/oXEWf7gxZn "DARVIZ: Deep Abstract Representation, Visualization, and Verification of Deep Learning Models," Sankaran et al.: https://t.co/0gjLKN3qL7 "mAnI: Movie Amalgamation using Neural Imitation," Panwar et al.: https://t.co/7lVZboEg7j "Stacked Deconvolutional Network for Semantic Segmentation," Fu et al.: https://t.co/ZHEPrc1lms "Maximum A Posteriori Inference in Sum-Product Networks," Mei et al.: https://t.co/3OpJnOo4ts "A deep architecture for unified aesthetic prediction," Murray and Gordo: https://t.co/cR1fvZsTI1 "Random Erasing Data Augmentation," Zhong et al.: https://t.co/7rxP4GXPpx "Design-Time Quantification of Integrity in Cyber-Physical-Systems," Morris et al.: https://t.co/Ed6sh2428C "Language Identification Using Deep Convolutional Recurrent Neural Networks," Bartz et al.: https://t.co/EXrLfuKD0i "A Generalised Directional Laplacian Distribution," Nikolaos Mitianoudis: https://t.co/T6j0QGwRvi "GlobalSLAM: Initialization-robust Monocular Visual SLAM," Tang et al.: https://t.co/DDbSRnPP7E "Multi-task Neural Network for Non-discrete Attribute Prediction in Knowledge Graphs," Tay et al.: https://t.co/yemNhxwktG "Machine Learning for Survival Analysis: A Survey," Wang et al.: https://t.co/zoYr55kbtL "Convolutional Neural Networks for Non-iterative Reconstruction of Compressively Sensed Images," Lohit et al.: https://t.co/3ltIwqMkMd "DeepFaceLIFT: Interpretable Personalized Models for Automatic Estimation of Self-Reported Pain," Liu et al.: https://t.co/5n0yRHPbc6 "Sequence-to-Label Script Identification for Multilingual OCR," Fujii et al.: https://t.co/tXjmDBwZI3 "DeformNet: Free-Form Deformation Network for 3D Shape Reconstruction from a Single Image," Kurenkov et al.: https://t.co/160lVwg3Dc "Acoustic Feature Learning via Deep Variational Canonical Correlation Analysis," Tang et al.: https://t.co/raqiBF5VxP "New Directions: Wireless Robotic Materials," Correll et al.: https://t.co/vORRmo4hes "Learning Graph While Training: An Evolving Graph Convolutional Neural Network," Li and Huang: https://t.co/Z6G6u9VzGH "Identifying Harm Events in Clinical Care through Medical Narratives," Cohan et al.: https://t.co/PFYhTYz0D5 @markus_with_k e.g. I exclude almost all "deep learning applied to X" with no new innovation) and medical DL papers @markus_with_k I have actually (and need to more) but increase in volume and interestingness has cancelled it out so far :) @markus_with_k still two more days to catch up on first ;) "Deep Learning for Passive Synthetic Aperture Radar," Yonel et al.: https://t.co/B6tHtUUjNf "VQS: Linking Segmentations to Qs and As 4 Supervised Attn in VQA + Question-Focused Semantic Segm.," Gan et al.: https://t.co/rOk8GNKC8o "Evaluating Word Embeddings for Sentence Boundary Detection in Speech Transcripts," Treviso et al.: https://t.co/UN6HDtJCKM "DeepRebirth: Accelerating Deep Neural Network Execution on Mobile Devices," Li et al., Samsung: https://t.co/wYoujEa9ux "An Improved Neural Segmentation Method Based on U-NET," Xu and Li: https://t.co/FwWMRfSFOH "Dialogue Act Segmentation for Vietnamese Human-Human Conversational Texts," Ngo et al.: https://t.co/6FoHAsLsPj "Modality-specific Cross-modal Similarity Measurement with Recurrent Attention Network," Peng et al.: https://t.co/IFjdP4Wvpn "StarCraft II: A New Challenge for Reinforcement Learning," Vinyals et al.: https://t.co/D4U0VDeoMU (the DeepMind/Blizzard paper) "Attentional Factorization Machines: Learning the Weight of Feature Interactions via Attn Networks," Xiao et al.: https://t.co/eVMDusvbCN arXiv papers, July 17-18 - "Deconvolutional Paragraph Representation Learning," Zhang et al.: https://t.co/ADqxA1aqjw Fin. "Balanced Information Storage and Transfer in Modular Spiking Neural Networks," Mediano and @mpshanahan: https://t.co/yPGAlgFIJm "Motion Planning under Partial Observability using Game-Based Abstraction," Winterer et al.: https://t.co/omopexT525 "Encoding Multi-Resolution Brain Networks Using Unsupervised Deep Learning," Rahnama et al.: https://t.co/VkuV8q2eN9 "Collaborative Filtering using Denoising Auto-Encoders for Market Basket Data," Abad et al.: https://t.co/B7f730cNUP "The Trimmed Lasso: Sparsity and Robustness," Bertsimas et al.: https://t.co/rzzLeG5yEi "Theoretical Foundation of Co-Training and Disagreement-Based Algorithms," Wang and Zhou: https://t.co/E3MEIu8WUd "Graph Classification via Deep Learning with Virtual Nodes," Pham et al.: https://t.co/MmWW0dFHqI "Actively Learning what makes a Discrete Sequence Valid," Janz et al.: https://t.co/EI9YXrM3uD "A learning framework for winner-take-all networks with stochastic synapses," Mostafa and Cauwenberghs: https://t.co/y9wcNSQxM2 "Attacking Automatic Video Analysis Algorithms: A Case Study of Google Cloud Video Intelligence API," Hosseini et al https://t.co/e1xL8EFbRC "Emotion Detection on TV Show Transcripts with Sequence-based Convolutional Neural Networks," Zahiri and Choi: https://t.co/ORXQ9NHVuo "MHTN: Modal-adversarial Hybrid Transfer Network for Cross-modal Retrieval," Huang et al.: https://t.co/BHr49aDO6T "An ELU Network with Total Variation for Image Denoising," Wang et al.: https://t.co/GRi9wQhf5r "Situation Recognition with Graph Neural Networks," Li et al.: https://t.co/2pfEnrH9j6 "Improved Answer Selection with Pre-Trained Word Embeddings," Chakravarti et al.: https://t.co/L3wKjjFW1N "Continuous Representation of Location 4 Geolocation+Lexical Dialectology using Mixture Density Nets," Rahimi et al: https://t.co/gdmtBOPrX8 "Deep Edge-Aware Saliency Detection," Zhang et al.: https://t.co/AuExC0EcW5 "Dockerface: an easy to install and use Faster R-CNN face detector in a Docker container," Ruiz and Rehg: https://t.co/xmnkU6yPS7 "Learning body-affordances to simplify action spaces," Guttenberg et al.: https://t.co/XUCFdgyfMC "Fluency-Guided Cross-Lingual Image Captioning," Lan et al.: https://t.co/GR0Uu0PWNm "Bringing Background into the Foreground: Making All Classes Equal in Weakly-sup. Video Semantic Seg.," Saleh et al: https://t.co/KcIvrJ4VNu "Knock-Knock: Acoustic Object Recognition by using Stacked Denoising Autoencoders," Luo et al.: https://t.co/Yh0mSqYDDG "Iterative Closest Labeled Point for Tactile Object Shape Recognition," Luo et al.: https://t.co/fg0jn8p4rA "Extractive Summarization using Deep Learning," Verma and Nidhi: https://t.co/cJ9x9TCf8M "Comparison of Decoding Strategies for CTC Acoustic Models," Zenkel et al.: https://t.co/2Oi2Am97No "SCNN: An Accelerator for Compressed-sparse Convolutional Neural Networks," Parashar et al.: https://t.co/xUsW6L3dyw "SPMC: Socially-Aware Personalized Markov Chains for Sparse Sequential Recommendation," Cai et al.: https://t.co/iHfBVlolc4 "Pathological Pulmonary Lobe Seg. from CT Images using Prog. Holistically Nested NNs + Random Walker," George et al: https://t.co/WRxBhK8BCY "DesnowNet: Context-Aware Deep Network for Snow Removal," Liu et al.: https://t.co/9S774yipBQ "Learning from Noisy Label Distributions," Yuya Yoshikawa: https://t.co/K2xCd77c7z "Improved Regularization of Convolutional Neural Networks with Cutout," DeVries and Taylor: https://t.co/tDcBD7cQiQ "Automatic Summarization of Online Debates," Sanchan et al.: https://t.co/I4AxN9eEWJ "Gold Standard Online Debates Summaries + 1st Exp's Towards Auto. Summarization of Online Debate Data"-Sanchan et al https://t.co/VFrGjidhm9 "Segmentation-Aware Convolutional Networks Using Local Attention Masks," Harley et al.: https://t.co/bvWC5VOqAh "Boosting in the presence of outliers: adaptive classification with non-convex loss functions," Li and Bradic: https://t.co/OnMo6dpLWW "RT @fre8de8rike: Job opportunity: Research Associate in Emerging Technology and Law/Society at @Cambridge_Uni https://t.co/F9FixxYEqH" @ESYudkowsky @primalpoly (AI representations in media, that is) Back in the UK! 👋 @ESYudkowsky @primalpoly see also https://t.co/IfcCmBvsWE @primalpoly see also these (don't think I'd seen POI then but pros=disembodied/inhuman [mostly], cons=too good at prediction) https://t.co/Ob9wp8OksS @primalpoly Person of Interest has issues but not quite as glaring as some of the others. Interstellar is good too. @Smerity You're 4-500 pages ahead of me still. We'll see how my next flight goes, prob some sleep too :) I loved Dark Forest!! RT @daveweigel: I never want to forget this https://t.co/SEjvTOhnp1 RT @yashar: Watch This Immediately https://t.co/mieNTTvy5a cc @Smerity Making progress on Death's End. Enjoying so far. @y0b1byte great scene! (this is the paper about ACKTR from last night: https://t.co/zrKPNzV2VW Good results on early (<10M) Atari learning) https://t.co/gWTVgM4uUS RT @maggieNYT: Bannon going - admin officials say it was Trump, people close to Bannon insist he resigned. https://t.co/XuOvPjZN37 RT @dhadfieldmenell: New post on value alignment: https://t.co/m3lPMtXGvK RT @hardmaru: Train a HyperNetwork to guess the weights of various generated network architectures, to auto-rank them. Very cool! https://t… "RT @ethancaballero: Neural Architecture Search with a Single GPU!! from @ajmooch https://t.co/MGC3BM4FUw" RT @BeffernieBlack: I had no idea Google were putting conservatives in electro-convulsive therapy and chemically castrating them. Huge if t… RT @Susan_Hennessey: The President of the United States propagates and endorses a disgusting racist myth. https://t.co/EHCRoCxIfZ "RT @catehall: Nazi attack: let's not be too hasty Any other attack: let's dip bullets in pig's blood and murder some muslims (this is the P…" "RT @catehall: White supremacist attack: gotta wait for the facts, never talk without facts Any other attack: it was Islamic terrorism https…" @avijit9d I usually tweet anything I have to say that I think others might be interested in. Don't take other notes. RT @glouppe: Nice little gem in today's arXiv: rediscovering Maxwell equations with symbolic search in theory space https://t.co/lwr5qv7HOK "RT @WiMLworkshop: Abstract submission is now open! 12th @WiMLworkshop Co-located with NIPS 2017, December 4 and 7, 2017 https://t.co/cC4Mb…" @rivatez https://t.co/McNr2476nK @kevin_zakka no, I pick which ones to skim/read the abstract of/read/tweet based on the titles, only fully read very few. Average = skim/read abstract Slipping two days behind on arXiv - won't let it get too out of hand, though, should be caught up by this weekend. A+ paper title: https://t.co/rhtsgxQags https://t.co/Xr4cuRveR0 RT @vkrakovna: New blog post on a portfolio approach to AI safety research... https://t.co/BXFB6XFGvg RT @OpenAI: Self-play catapulted the performance of our Dota 2 system: https://t.co/HtLcA9rApF https://t.co/BUTHspPxX3 "Portfolio approach to AI safety research," post by @vkrakovna: https://t.co/navZ26YNVH Incredible journalism from @elspethreeve et al. Watch this. https://t.co/4nImmHGtrT To be continued... "Learning with Rethinking: Recurrently Improving Convolutional Neural Networks through Feedback," Li et al.: https://t.co/AidC1YbYHp "Towards Learning Reward Functions from User Interactions," Li et al.: https://t.co/IUMWhwTGIj arXiv papers, July 16 - "Benchmark Environments for Multitask Learning in Continuous Domains," Henderson et al.: https://t.co/AlRHaZhfKE "RT @TheRaDR: I'm a rabbi. I believe words have power. I try to choose mine carefully. Fuck you, Trump." Fin. "Rocket Launching: A unified and effecient framework for training well-behaved light net," Zhou et al., Alibaba: https://t.co/CceHJG4lg7 "Robust transformations of firing patterns for neural networks," Kanders et al.: https://t.co/CewS57fUT8 "ZOO: Zeroth Order Optimization based Black-box Attacks to DNNs without Training Substitute Models"-Chen+Zhang et al https://t.co/jtLiVJZy0u "OpenML Benchmarking Suites and the OpenML100," Bischl et al.: https://t.co/hu6h1bTF3E "Sentiment Analysis by Joint Learning of Word Embeddings and Classifier," Sarma and Sethares: https://t.co/5bdEt3SFIB """Direct-Manipulation Visualization of Deep Networks,"" Smilkov et al.: https://t.co/E2lvYJqjyN https://t.co/dChQVeHoxq" "Critical Points Of An Autoencoder Can Provably Recover Sparsely Used Overcomplete Dictionaries," Rangamani et al.: https://t.co/zynpQ6k5yh Kamath et al.: https://t.co/OaQwAgCj3N "Optimization of Ensemble Supervised L. Algos for Increased Sensitivity, Specificity + AUC of Population-Based Colorectal Cancer Screenings" "Communicating Robot Arm Motion Intent Through Mixed Reality Head-mounted Displays," Rosen et al.: https://t.co/lyfgTA9RcV "Convolutional Neural Networks for Font Classification," Tensmeyer et al.: https://t.co/WCylNIr5bZ "Deep RNNss for mapping winter vegetation quality coverage via multi-temporal SAR Sentinel-1," Minh et al.: https://t.co/jn5pGsmZno "Learning Rotation for Kernel Correlation Filter," Hamdi and Ghanem: https://t.co/2EV71OXuKr "Emotion Intensities in Tweets," Mohammad and Bravo-Marquez: https://t.co/PXgzf3R809 "Improved Abusive Comment Moderation with User Embeddings," Pavlopoulos et al.: https://t.co/Vqwsb3HLHs "WASSA-2017 Shared Task on Emotion Intensity," Mohammad and Bravo-Marquez: https://t.co/OQW9TcOj3d "Eigenvalue Decay Implies Polynomial-Time Learnability for Neural Networks," Goel and Klivans: https://t.co/aYVqVwMi7W "Exploiting Semantic Contextualization for Interpretation of Human Activity in Videos," Aakur et al.: https://t.co/6QqQ3Or4fG "Face Parsing via a Fully-Convolutional Continuous CRF Neural Network," Zhou et al.: https://t.co/ZsiyPUrEE4 "Cross-Sentence N-ary Relation Extraction with Graph LSTMs," Peng et al.: https://t.co/vc0TykN2Uf "Calipso: Physics-based Image and Video Editing through CAD Model Proxies," Haouchine et al.: https://t.co/NzZxuWdVgL "Flower Categorization using Deep Convolutional Neural Networks," Gurnani and Mavani: https://t.co/aOG6hK6Sy6 "Noisy Softmax: Improving the Generalization Ability of DCNN via Postponing the Early Softmax Saturation"-Chen et al https://t.co/g5Bsrp5C95 "Boosting Both Object Detection Accuracy and Speed With adaptive Patch-of-Interest Composition," Zhang et al.: https://t.co/kqjPPnG53a "Hybrid Deep-Semantic Matrix Factorization for Tag-Aware Personalized Recommendation," Xu et al.: https://t.co/OpG6gou8D7 "Deep Steering: Learning End-to-End Driving Model from Spatial and Temporal Visual Cues," Chi and Mu: https://t.co/y9AjzsIVuK "Revisiting the Effectiveness of Off-the-shelf Temporal Modeling Approaches 4 Large-scale Video Classif.,"Bian et al https://t.co/2y22jY2qbY "Mass Displacement Networks," Neverova and Kokkinos: https://t.co/0LYbFfIDhb "Training Support Vector Machines using Coresets," Baykal et al.: https://t.co/bbrPI8RoUD "IoT Data Analytics Using Deep Learning," Xie et al.: https://t.co/DV8doMpC7S "Automated Pulmonary Nodule Detection via 3D CNNs w Online Sample Filtering+Hybrid-Loss Residual Learning"-Dou et al https://t.co/nA4aNUqMOK "A Game-Theoretic Analysis of the Off-Switch Game," Wängberg et al.: https://t.co/l6GcuxlEXG "Recurrent Filter Learning for Visual Tracking," Yang and Chan: https://t.co/78vocSozQm "Image Quality Assessment Guided Deep Neural Networks Training," Chen et al.: https://t.co/DIWyzbJeqP "Scaling SGD Batch Size to 32K for ImageNet Training," You et al.: https://t.co/ANQEZfobeF "EmoTxt: A Toolkit for Emotion Recognition from Text," Calefato et al.: https://t.co/zUwkT91th0 "Belief Tree Search for Active Object Recognition," Malmir and Cottrell: https://t.co/0mOiaIHuCG "Semi-supervised emotion lexicon expansion with label propagation and specialized word embeddings," M. Giulianelli: https://t.co/3OQD3hR0uS "A Cost-Sensitive Visual QA Framework for Mining a Deep And-OR Object Semantics from Web Images," Zhang et al.: https://t.co/tALPJQRyXI "Learning Deep Neural Networks for Vehicle Re-ID with Visual-spatio-temporal Path Proposals," Shen et al.: https://t.co/Vh6ElYctqw "Towards Speech Emotion Recognition "in the wild" using Aggregated Corpora and Deep Multi-Task Learning," Kim et al. https://t.co/joYPgjZmcI "Visual Graph Mining," Zhang et al.: https://t.co/xy4AlswRIw "Leveraging Sparse and Dense Feature Combinations for Sentiment Classification," Yu et al.: https://t.co/2r2bCt37Ir "Lattice Long Short-Term Memory for Human Action Recognition," Sun et al.: https://t.co/XbC3hnPJGi "SSH: Single Stage Headless Face Detector," Najibi et al.: https://t.co/xI3h62zyBD (the network is headless, not the faces) "AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wild," Mollahosseini et al.: https://t.co/hdqTL8duMq "Optimizing Gross Merchandise Volume via DNN-MAB Dynamic Ranking Paradigm," Yan et al.: https://t.co/B7pcc4Cc8A "Data Sets: Word Embeddings Learned from Tweets and General Data," Li et al.: https://t.co/6LJ7GJbeD3 "Group-driven Reinforcement Learning for Personalized mHealth Intervention," Zhu et al.: https://t.co/HY9RfkLFMA "Style2Vec: Representation Learning for Fashion Items from Style Sets," Lee et al.: https://t.co/wvhhER1zwp "Counterexample Guided Inductive Optimization Applied to Mobile Robots Path Planning," Araujo et al.: https://t.co/BbJefcZtzJ (second or third paper I've seen on deep RL for industrial robotics... 🤖🤔) "Deep Reinforcement Learning for High Precision Assembly Tasks," Inoue et al.: https://t.co/32MH6Lr5nM "Kinship Verification from Videos using Spatio-Temporal Texture Features and Deep Learning," Boutellaa et al.: https://t.co/KdPrJ6e1d3 "Context-based Normalization of Histological Stains using Deep Convolutional Features," Bug et al.: https://t.co/yP18QPRGyt "Early Improving Recurrent Elastic Highway Network," Park and Yoo: https://t.co/VBo1rfxLM6 "Reproducibility of Benchmarked Deep Reinforcement Learning Tasks for Continuous Control," Islam et al.: https://t.co/rNvufCJYxX "A Measure for Dialog Complexity and its Application in Streamlining Service Operations," Liao et al.: https://t.co/uvKZliBST7 "Towards Semantic Fast-Forward and Stabilized Egocentric Videos," Silva et al.: https://t.co/TAnKSHwwsI "Fast-Forward Video Based on Semantic Extraction," Ramos et al.: https://t.co/jg8tUXJBXM "Sequence Modelling For Analysing Student Interaction with Educational Systems," Hansen et al.: https://t.co/7GupcP7zis "Divide and Fuse: A Re-ranking Approach for Person Re-identification," Yu et al.: https://t.co/TbS4VNlsGZ "A scalable multi-core arch. w/ heterog. memory structures 4 Dynamic Neuromorphic Async Processors," Moradi et al.: https://t.co/r5N7G4mHzA "Learning to Plan Chemical Syntheses," @marwinsegler et al.: https://t.co/Z8nurXmjlc More progress in the AlphaGo-for-science direction... arXiv papers, July 15 - "Deep Object-Centric Representations for Generalizable Robot Learning," Devin et al.: https://t.co/FbD8hOjS8i RT @jaketapper: Executives walking away from Trump: Now it's 5 as @RichardTrumka quits WH council in protest https://t.co/9qQ58AegKR RT @brianklaas: Meanwhile on Earth 2, President Hillary Clinton is enjoying a quiet day in the Oval Office after signing a bipartisan infra… RT @ABC: Richard Trumka, Thea Lee resign from Pres. Trump’s manufacturing council: “We cannot sit on a council for a president who tolerate… RT @dale_e_ho: Evergreen tweet: POTUS is a disgrace. https://t.co/O8yahgO11B RT @peterwsinger: If you are a CEO who stands with Trump after this display today, you have no sense of leadership. RT @KSoltisAnderson: There is nothing - NOTHING - that President Trump does not try to make all about himself. Not even the death of an inn… RT @TechPolicyLab: Research with the Lab! We have an opening for an #AI postdoc working under @rcalo, more info at https://t.co/c2yRsp4wtp "RT @j2bryson: Correct. My new preprint Of, For, & By the People: The Legal Lacuna of Synthetic Persons https://t.co/t1PH9r9SHa @rcalo @lsol…" RT @RecklessCoding: . @AIIDEconference StarCraft competition is sponsored by @facebook & @DeepMindAI https://t.co/Y8bRL66DeA (Guess 5 years old isn't technically a toddler but anyway, kids are smart) "Occam's toddler - 5 yr old: I could see you with x-ray vision from the bedroom. Me: What was I doing? Her: The same thing you're doing now." @vdimarco shoot me a DM @vdimarco nice! Unfortunately I won't be back in the UK by then (in Seattle right now). Fin. "DNN Transfer Learning based Non-linear Feature Extraction for Acoustic Event Classification," Mun et al.: https://t.co/u2y62LNGvf "SkyLens: Visual Analysis of Skyline on Multi-dimensional Data," Zhao et al.: https://t.co/8kJruvK1rQ "Unified Neural Architecture for Drug, Disease and Clinical Entity Recognition," Sahu and Anand: https://t.co/JyYojBcNdM "What matters in a transferable NN model for relation classification in the biomedical domain?," Sahu and Anand: https://t.co/Wfs87LQPbR "Combinatorial Optimization by Decomposition on Hybrid CPU--non-CPU Solver Architectures," Narimani et al.: https://t.co/JoYOPqiZig "Variational Deep Semantic Hashing for Text Documents," Chaidaroon and Fang: https://t.co/EeYMa8MMYh "Iterative Deep Convolutional Encoder-Decoder Network for Medical Image Segmentation," Kim et al.: https://t.co/HPKqGAA9qg "Argument Labeling of Explicit Discourse Relations using LSTM Neural Networks," Hooda and Kosseim: https://t.co/q4XzELGJ7Z "Video Deblurring via Semantic Segmentation and Pixel-Wise Non-Linear Kernel," Ren et al.: https://t.co/RAUK19Xjq0 "Learning to Attend, Copy, and Generate for Session-Based Query Suggestion," Dehghani et al.: https://t.co/4VwUA4uNUf "GlobeNet: Convolutional Neural Networks for Typhoon Eye Tracking from Remote Sensing Imagery," Hong et al.: https://t.co/uIQsaSUyvW "Pose Guided Structured Region Ensemble Network for Cascaded Hand Pose Estimation," Chen et al.: https://t.co/LbmQE8z4ax "Phase Transitions, Optimal Errors and Optimality of Message-Passing in Generalized Linear Models," Barbier et al.: https://t.co/0MraSMRjPm "Making Sense of Word Embeddings," Pelevina et al.: https://t.co/VTInHpwzEg "Joint Multi-Person Pose Estimation and Semantic Part Segmentation," Xia et al.: https://t.co/nkylJBBYhk "Resilient Linear Classification: An Approach to Deal with Attacks on Training Data," Park et al.: https://t.co/YluAoa9Uyl "Topical Behavior Prediction from Massive Logs," Shih-Chieh Su: https://t.co/GYQbzhm4ie "Output Reachable Set Estimation and Verification for Multi-Layer Neural Networks," Xiang et al.: https://t.co/ued5SD9s4t "Effective Dimensionality Reduction for Word Embeddings," Vikas Raunak: https://t.co/UULUjaqTd4 "Unsupervised Incremental Learning of Deep Descriptors From Video Streams," Pernici and Del Bimbo: https://t.co/nMA2VYKhJ5 "Semantic Word Clouds with Background Corpus Normalization and t-distributed SNE," Schubert et al.: https://t.co/O5yvSLiE0w "Neural Translation of Musical Style," Malik and Ek: https://t.co/rmaTEOSwfi "Early Stage Malware Prediction Using Recurrent Neural Networks," Rhode et al.: https://t.co/8dzsgVg9ox "Break it Down for Me: A Study in Automated Lyric Annotation," Sterckx et al.: https://t.co/UR1cXdijIM "A Generic Deep Architecture for Single Image Reflection Removal and Image Smoothing," Fan et al.: https://t.co/mBOCKISeDJ RT @goodfellow_ian: The results of the first dev round for the Kaggle contest on adversarial examples are out: https://t.co/AjAidDPqzt @rcalo https://t.co/pcWTRymPeM Great to see lots of old friends/colleagues and meet new ones in SF! I hear lack of support from Strange people in Alabama was the main barrier to the wall. Now it'll go along smoothly. https://t.co/bS7RhZyqlJ @priyapanda12 cool! thanks for sharing :) "Habituation based synaptic plasticity and organismic learning in a quantum perovskite," Zuo + @priyapanda12 et al.: https://t.co/h6SzDluDPW Fuzzing (trying a bunch of inputs) for neural nets, basically: https://t.co/c3B5KSiER4 arXiv papers, August 14, "Neural Expectation Maximization," Greff,* van Steenkiste,* and Schmidhuber: https://t.co/jfUYhQxKm0 Fin. "Enabling Massive Deep Neural Networks with the GraphBLAS," Kepner et al.: https://t.co/CD9lCZaIQF "Above and Beyond the Landauer Bound: Thermodynamics of Modularity," Boyd et al.: https://t.co/ULCkvctN60 "Thinking Fast, Thinking Slow! Combining Knowledge Graphs and Vector Spaces," Mittal et al.: https://t.co/DzcBRJ9j42 "Systematic Testing of Convolutional Neural Networks for Autonomous Driving," Dreossi et al.: https://t.co/XflUuIgMPv "Cell Detection with Deep Convolutional Neural Network and Compressed Sensing," Xue and Ray: https://t.co/xUS2E45pdn "Learning to Synthesize a 4D RGBD Light Field from a Single Image," Srinivasan et al.: https://t.co/67i1nzbqjm "TPC: Temporal Preservation Convolutional Networks for Precise Temporal Action Localization," Yang et al.: https://t.co/mTQoR6rl3B "Motion Feature Augmented Recurrent Neural Network for Skeleton-based Dynamic Hand Gesture Recognition," Chen et al. https://t.co/RS7MSqA8CE "Document Image Binarization with Fully Convolutional Neural Networks," Tensmeyer and Martinez: https://t.co/uge74EfpOf "Analysis of Convolutional Neural Networks for Document Image Classification," Tensmeyer and Rodriguez: https://t.co/f9NXCNk9zS "Neural Machine Translation Leveraging Phrase-based Models in a Hybrid Search," Dahlmann et al.: https://t.co/AzQgUDnv95 "SESA: Supervised Explicit Semantic Analysis," Bogdanova and Yazdani: https://t.co/ml6mzKdpjs "DNN and CNN with Weighted and Multi-task Loss Functions for Audio Event Detection," Phan et al.: https://t.co/gBKbPp96i7 "Achieving an Efficient and Fair Equilibrium Through Taxation," Gao and Huang: https://t.co/MvC6ytBbFs "Neural and Statistical Methods for Leveraging Meta-information in Machine Translation," Khadivi et al.: https://t.co/JNt8sovnmI "Utilizing Embeddings for Ad-hoc Retrieval by Document-to-document Similarity," Yang et al.: https://t.co/FZs9OudHPP "TensorFlow Enabled Genetic Programming," Staats et al.: https://t.co/amPU5QSBAu "Towards Neural Speaker Modeling in Multi-Party Conversation: The Task, Dataset, and Models," Meng et al.: https://t.co/J0CgCf41jP "Attention-Aware Face Hallucination via Deep Reinforcement Learning," Cao et al.: https://t.co/zn6UbBsOw7 "Modality-bridge Transfer Learning for Medical Image Classification," Kim et al.: https://t.co/sbkjNOyKfO "Semantic Video CNNs through Representation Warping," Gadde et al.: https://t.co/QByv05IWjY "A Machine Learning Approach to Routing," Valadarsky et al.: https://t.co/52udht8nvn "TandemNet: Distilling Knowledge from Med. Images Using Diagnostic Reports as Optional Semantic Ref's," Zhang et al: https://t.co/o6ynWHMdLs "Online Interactive Collaborative Filtering Using Multi-Armed Bandit with Dependent Arms," Wang et al.: https://t.co/bX4NQmjxA4 "Challenges in Deploying an On-Demand Crowd-Powered Conversational Agent," Huang et al.: https://t.co/qSR6es7bVk "An Empirical Study on Team Formation in Online Games," Alhazmi et al.: https://t.co/M1gzBuB2cs "Scaling Deep Learning on GPU and Knights Landing clusters," You et al.: https://t.co/ZdiBeuoIgY "Identifying Reference Spans: Topic Modeling and Word Embeddings help IR," Moraes et al.: https://t.co/1MOP31SqkN "Hierarchically-Attentive RNN for Album Summarization and Storytelling," Yu et al.: https://t.co/eApR3SWPAD "Random Binary Trees for Approximate Nearest Neighbour Search in Binary Space," Komorowski and Trzcinski: https://t.co/50MUWBP3UX "Learning Policies for Adaptive Tracking with Deep Feature Cascades," Huang et al.: https://t.co/Z7kFotLLvS "Personalized Cinemagraphs using Semantic Understanding and Collaborative Learning," Oh et al.: https://t.co/FssUEB9g6U "Convergence of Unregularized Online Learning Algorithms," Lei et al.: https://t.co/0AYR8a2GzV "Classification without labels: Learning from mixed samples in high energy physics," Metodiev et al.: https://t.co/zjPFDd7i8e "Tikhonov Regularization for Long Short-Term Memory Networks," Andrei Turkin: https://t.co/XbIpP8okc2 "Anomaly Detection on Graph Time Series," Daniel Hsu: https://t.co/NduC9Y16vY "Communication-Free Parallel Supervised Topic Models," Gao and Zheng: https://t.co/Pt846jicdy "Automatic Selection of t-SNE Perplexity," Cao and Wang: https://t.co/UTV3X29iD7 "Using Deep Neural Networks to Automate Large Scale Statistical Analysis for Big Data Applications," Zhang et al.: https://t.co/6QUFrcN7Cn arXiv papers, August 11 - "Universal limits to parallel processing capability of network architectures," Petri et al https://t.co/K9GYndk55p "RT @dennybritz: Teaching A.I. Systems to Behave Themselves https://t.co/4jbInTgvvs A good piece on AI safety!" RT @primalpoly: Careers in AI safety research & policy: Panel with @hlntnr, @Miles_Brundage, @m_bourgon, Jan Leike, & Andrew Snyder-Beattie… Nice article on AI safety by @CadeMetz featuring @PaulChristiano, @ShaneLegg, and others. https://t.co/kg3J3DM8xT RT @jackclarkSF: NYT article on real world AI safety, featuring OpenAI, DeepMind, Google, UC Berkeley, others. https://t.co/6xp1RKBTNO http… @Brombadil perhaps. Not a particular kind of exploration, at least, may have tried all sorts of other stuff @gwern why distinguish between those? That's basically what I meant. It was good against some set of strategies, not some outside distrib. Claim that OpenAI bot was defeated 50+ times with a simple strategy, probably resulting from self-play overfitting: https://t.co/8j58VYbTdL RT @gilbertjasono: Wish Trump could find the same anger for murderous Nazis as he did for Nordstrom after it stopped selling his daughter's… @markus_with_k hopefully soon! I want to know how much compute it took + what info it had :) @markus_with_k I'm pretty sure there will be a paper soon. They prob wanted to be able to say what happened in the pro matches. RT @OpenAI: Dota pro teams interested in trying the bot for training — email rafal@openai.com. We're curious to see if it's useful! Palace of Fine Arts, SF. https://t.co/8OfC7XsG2A @ArtirKel @dennybritz we'll see 💵 "RT @dennybritz: Wrote up a quick opinion piece: Hype or Not? Some Perspective on OpenAI’s DotA 2 Bot https://t.co/qERo7IxUzw" RT @gdb: Our AI is undefeated against the world's top professionals, including @DendiBoss @Arteezy @SumaaaaiL, in Dota 2 solo https://t.co/… RT @OpenAI: Our Dota 2 AI is undefeated against the world's best solo players: https://t.co/cUvTbGW7ya RT @OpenAI: In a few minutes, watch our Dota 2 AI play live on main stage at The International: https://t.co/mjTTPTlPh5 @SmithaMilli sounds like a cool talk! @mbrendan1 @DIU_x @sarahbrowning8 interesting/congrats! This was a big factor in the success of ARPA-E @jordannovet pretty much RT @rcalo: Artificial Intelligence Policy: A Roadmap by Ryan Calo | @SSRN https://t.co/V9CVKLP7CF "RT @j2bryson: Beijing’s AI Strategy: Old-School Central Planning with a Futuristic Twist https://t.co/KoS4LfHQaF cites @Miles_Brundage & me" RT @SmithaMilli: Updated schedule for Reliable ML workshop tomorrow is up! Lots of exciting talks https://t.co/OhDQlvUzS6 #rmlw17 #icml17 RT @OriolVinyalsML: If you are at #ICML today, come check out the Video Games and Machine Learning #VGML workshop! Great speakers! @syhw ht… @botminds correct. That's higher than many people would give. @ArtirKel keep us posted! Think you'll enjoy. @Smerity @iandanforth @_jyan_ #sorrynotsorry I have no regrets for focusing on The Dark Forest on my last flight :) RT @histoftech: When women suffer, so too does computing. My op ed in the @washingtonpost on memogate https://t.co/ckg7lUENMc Fin. "Transitive Invariance for Self-supervised Visual Representation Learning," Wang et al.: https://t.co/CxwByeUsLK "SUBIC: A supervised, structured binary code for image search," Jain et al.: https://t.co/spf5CdLa2T "CoupleNet: Coupling Global Structure with Local Parts for Object Detection," Zhu et al.: https://t.co/bxDoPEL0ar "WebVision Database: Visual Learning and Understanding from Web Data," Li et al.: https://t.co/Um1lwPMYnv "Online Multi-Object Tracking Using CNN-based Single Object Tracker with Spatial-Temporal Attn Mechanism," Chu et al https://t.co/Io5JCoSwhv "Speaker Diarization using Deep Recurrent Convolutional Neural Networks for Speaker Embeddings," Cyrta et al.: https://t.co/puLpwuOhUh "Decoupled Learning of Environment Characteristics for Safe Exploration," Van Molle et al.: https://t.co/gZZtUd9LZB "BlitzNet: A Real-Time Deep Network for Scene Understanding," Dvornik et al.: https://t.co/W3LygkVkqT "Multi-dimensional Gated Recurrent Units for Automated Anatomical Landmark Localization," Andermatt et al.: https://t.co/vt3RJXZ4Q4 ^ cool paper I've been waiting for a while - human-machine system built on top of Shellphish's code from the DARPA Grand Cyber Challenge... "Rise of the HaCRS: Augmenting Autonomous Cyber Reasoning Systems with Human Assistance,"Shoshitaishvili et al.: https://t.co/EeIViJWlLh "Joint Face Alignment and 3D Face Reconstruction with Application to Face Recognition," Liu et al.: https://t.co/uLw2nIRb0m "Weakly- and Self-Supervised Learning for Content-Aware Deep Image Retargeting," Cho et al.: https://t.co/S8ignu6uQT "Probabilistic NN with Complex Exponential Activation Functions in Image Rec. using DL Framework," Andrey Savchenko: https://t.co/RxU2nfVcmd "Deep Face Feature for Face Alignment and Reconstruction," Jiang et al.: https://t.co/uU3J2TNtKW "Sequential Dual Deep Learning with Shape and Texture Features for Sketch Recognition," Jia et al.: https://t.co/Sz70Mq0S4N "Tips and Tricks for Visual Question Answering: Learnings from the 2017 Challenge," Teney et al.: https://t.co/258mhyYNvN "Recent Trends in Deep Learning Based Natural Language Processing," Young et al.: https://t.co/6yhTdudnKY "Neural Vector Spaces for Unsupervised Information Retrieval," Van Gysel et al.: https://t.co/rCaBUyL218 "What Actions are Needed for Understanding Human Actions in Videos?," Sigurdsson et al.: https://t.co/Ah0E7rTSQj "Statistics of Deep Generated Images," Zeng et al.: https://t.co/7yRXfPaBJt "Generative Adversarial Network-based Synthesis of Visible Faces from Polarimetric Thermal Faces," Zhang et al.: https://t.co/ZApWDBoqs6 "Which Encoding is the Best for Text Classification in Chinese, English, Japanese and Korean?," Zhang and @ylecun: https://t.co/lYjLNaCKip "An Error Detection and Correction Framework for Connectomics," Zung et al.: https://t.co/Utdy1a41mh "Universal Function Approximation by Deep Neural Nets with Bounded Width and ReLU Activations," Boris Hanin: https://t.co/5qZwnH50Pt "Spectral Learning of Restricted Boltzmann Machines," Decelle et al.: https://t.co/9iTT08jawV "TensorFlow Estimators: Managing Simplicity vs. Flexibility in High-Level Machine Learning Frameworks," Cheng et al: https://t.co/6GsoQ9pdd0 "Gaussian Prototypical Networks for Few-Shot Learning on Omniglot," Stanislav Fort: https://t.co/TtbDbphlnF arXiv papers, August 9 - "Neural Network Dynamics for Model-Based Deep RL w Model-Free Fine-Tuning," Nagabandi et al https://t.co/SBgI6sgTfx @_jyan_ think both will be fun - definitely more expensive parties at NIPS ;) @iandanforth @_jyan_ sounds good. I also challenge @Smerity to a race to the finish - he has a head start ;-) If anything I might be over 50% b/c non-trivial researcher effort going into it (one of the factors I suggested needed)... we shall see. Still stand by my 50% on superhuman StarCraft by end of 2018 forecast, and progress in applying DL in the competition this year (60%)... @interwound for example, new stuff like Feudal Networks and other recent approaches to hierarchical+partially observable RL seems relevant (vs old A3C) @interwound I think it's much harder than Atari in ways like that, it's just that they didn't seem to put a big effort into having good baselines... @iandanforth probably can't this time :( but noted for next time, thanks! @_jyan_ Nice! There are a lot of little footnotes about puns/history etc. in the translations i've been reading, but I don't recall one about that @davegershgorn sorry for sending you that @jeremyphoward @Smerity Happy to if we can make it work! Leaving Monday AM Also, Wallbreakers are basically the only villains allowed to do the whole long monologue about foiling the hero's plan thing. Makes sense. Almost done with The Dark Forest. A+, Luo Ji FTW. In SF for a few days for EA Global etc. Look forward to seeing some of you! @gwern looked more like they wanted to underwhelm, set expectations v low, bad results on full game But I could see some being like "oh wow this is really hard" based on baselines - yeah it's hard but this isn't the best one could do today. Haven't looked super closely yet, though. In any case, interesting to have *some* if weak baselines before the deluge of serious attempts. These Starcraft baselines are kinda weak, no? I wouldn't really expect algos mostly designed for Atari to work. Maybe Feudal Nets/related? RT @DeepMindAI: The wait is over. Introducing SC2LE - an RL environment based on StarCraft II from DeepMind and @Blizzard_Ent https://t.co/… @sjobeek to clarify, I'm not at ICML at all :( on way from Oxford to US shortly @sjobeek unfortunately not :( @SmithaMilli not surprised, sadly @SmithaMilli omg @AlisonBLowndes @bradneuberg Brad was trying to confirm if the URL you tweeted was the OpenAI/Stanford World of Bits project or something else @bradneuberg it seems to be based on a tweet from @AlisonBLowndes @bradneuberg I think that's what this is - https://t.co/3aA1XCCzu5 TFW you have to confirm your humanity to subscribe to a mailing list about getting RL systems to navigate the web. https://t.co/SrNo25fUOc @rcalo Oh and the smug guy in the suit, forgot about that. @rcalo Is it the quasi-advertisement, unnecessary gendering, no context on what system can't do, or the scaring young woman part? Seems fine to me. RT @RandomlyWalking: StreetLearn: Using Google Street view to create a more complex artificial environment for agents. Such a neat idea! Ha… Fin. "Image Quality Assessment Techniques Show Improved Training and Evaluation of Autoencoder GANs," Vertolli + Davies: https://t.co/ksfLlxMURg "Mining fine-grained opinions on closed captions of YouTube videos with an attention-RNN," Marrese-Taylor et al.: https://t.co/T2U1w2oPUk "Wasserstein CNN: Learning Invariant Features for NIR-VIS Face Recognition," He et al.: https://t.co/kpqH5sU8af "Robust Conditional Probabilities," Wald and Globerson: https://t.co/43qU36YrUA "Learning Human-Rob. Collab Insights thru the Integration of Muscle Activity in Interaction Motion Models"Chen et al https://t.co/ClnCXN6Es3 "Learning a Repression Network for Precise Vehicle Search," Xu et al.: https://t.co/eMqGI6lFmn "Learning how to Active Learn: A Deep Reinforcement Learning Approach," Fang et al.: https://t.co/1uFVdmbWfK "Visual-inertial self-calibration on informative motion segments," Schneider et al.: https://t.co/lqVAgYi2NZ "Automatic feature learning for vulnerability prediction," Dam et al.: https://t.co/YXNBTS5NdO "Temporal Context Network for Activity Localization in Videos," Dai et al.: https://t.co/aDoC0YcVsZ "Unconstrained Face Detection and Open-Set Face Recognition Challenge," Günther et al.: https://t.co/q0si4NjvYT "What Makes a Place? Building Bespoke Place Dependent Object Detectors for Robotics," Hawke et al.: https://t.co/sNDCG7H7C1 "On the Learnability of Programming Language Semantics," Ghica and Alyahya: https://t.co/kzDbsZBAwD "Multibiometric Secure System Based on Deep Learning," Talreja et al.: https://t.co/oTVeFir7zl "GPLAC: Generalizing Vision-Based Robotic Skills using Weakly Labeled Images," Singh et al.: https://t.co/fKfVo83RTi "Shortcut-Stacked Sentence Encoders for Multi-Domain Inference," Nie and Bansal: https://t.co/KGgEoDFPAF "Reinforced Video Captioning with Entailment Rewards," Pasunuru and Bansal: https://t.co/2CveBhPGXf "Monocular Depth Estimation with Hierarchical Fusion of Dilated CNNs and Soft-Weighted-Sum Inference," Li et al.: https://t.co/Jg69aKgJOQ "Real-Time Visual Localisation in a Tagged Environment," Taquet et al.: https://t.co/f47migZPKW "Automatic segmentation of the intracranialvolume in fetal MR images," Khalili et al.: https://t.co/tp8G3Dqt30 "Parallelizing Over Artificial Neural Network Training Runs with Multigrid," Jacob Schroder: https://t.co/nX00C1vd2y "Corpus-level Fine-grained Entity Typing," Yaghoobzadeh et al.: https://t.co/ZJ09tAu1qj "ISS-MULT: Intelligent Sample Selection for Multi-Task Learning in Question Answering," Ahmadvand and Choi: https://t.co/3f6QttiEc9 "Generative Statistical Models with Self-Emergent Grammar of Chord Sequences," Tsushima et al.: https://t.co/ltnGnM6ouN "A Convolutional Neural Network for Search Term Detection," Salehinejad et al.: https://t.co/UJ84vMreYj "Asking Too Much? The Rhetorical Role of Questions in Political Discourse," Zhang et al.: https://t.co/JInkgG7LHy "From Deterministic to Generative: Multi-Modal Stochastic RNNs for Video Captioning," Song et al.: https://t.co/sdxrGP0AHT "An Unsupervised Game-Theoretic Approach to Saliency Detection," Zeng et al.: https://t.co/F5YHaxgjzB "Weakly Supervised Image Annotation and Segmentation with Objects and Attributes," Shi et al.: https://t.co/XdVNzXBTcH "Prune the Convolutional Neural Networks with Sparse Shrink," Li and Liu: https://t.co/UA1JauUMGx "An Effective Feature Selection Method Based on Pair-Wise Feature Prox. for High-D Low Sample Size Data"-Happy et al https://t.co/iN8tbNeWSW "FoveaNet: Perspective-aware Urban Scene Parsing," Li et al.: https://t.co/vABcUA83SC "Neural-based Context Representation Learning for Dialog Act Classification," Ortega and Vu: https://t.co/kaEFKuJYvv "Robust Computer Algebra, Theorem Proving, and Oracle AI," Sarma and Hay: https://t.co/Xz3OSAPAIt "Fast Scene Understanding for Autonomous Driving," Neven et al.: https://t.co/9Xiy3rr8rp "Semantic Instance Segmentation with a Discriminative Loss Function," De Brabandere et al.: https://t.co/GY3j71sbkW "Proving Expected Sensitivity of Probabilistic Programs," Barthe et al.: https://t.co/LZI7JD6QeR @iamtrask Quickstart guide for contributors: https://t.co/29uR6UidDo @rubinovitz @iamtrask Volunteer. Per latest meeting, options being considered for other models besides volunteer contributions but still volunteer-only RN. (I'm just a fan parroting points from their latest open YouTube meeting - reach out to @iamtrask if you have such experience). https://t.co/8gis04oSvt looking 4 help with crypto, security, JavaScript, Python packaging, ML/data science, and project management. "Towards a Skill- And Ability-Based Development Process for Self-Aware Automated Road Vehicles," Nolte et al.: https://t.co/lRKu2FHMbo "Deep Binaries: Encoding Semantic-Rich Cues for Efficient Textual-Visual Cross Retrieval," Shen et al.: https://t.co/mTdBeE7HbC "Model Predictive Control Based Trajectory Generation 4 Autonomous Vehicles - An Architectural Approach"-Nolte et al https://t.co/FEk3jot7AM "Cascade Adversarial Machine Learning Regularized with a Unified Embedding," Na et al.: https://t.co/lyRobTd6S0 "Snowflake: A Model Agnostic Accelerator for Deep Convolutional Neural Networks," Gokhale et al.: https://t.co/RHNa2CxIMA "Jointly Attentive Spatial-Temporal Pooling Networks for Video-based Person Re-Identification," Xu et al.: https://t.co/UXR8pHDarr "Beyond the technical challenges for deploying Machine Learning solutions in a software company," Ilias Flaounas: https://t.co/p6W4XZL1l6 "Fast Low-Rank Bayesian Matrix Completion with Hierarchical Gaussian Prior Models," Yang et al.: https://t.co/mUu00Mqezk "Learning non-parametric Markov networks with mutual information," Leppä-aho et al.: https://t.co/cOLxAQbhLA "Adversarial Divergences are Good Task Losses for Generative Modeling," Huang et al.: https://t.co/7NHVHNkQws "Stochastic Optimization with Bandit Sampling," Salehi et al.: https://t.co/5MZGwjMnEe arXiv papers, August 9 - "Multi-Generator Gernerative Adversarial Nets," Hoang et al.: https://t.co/yiXiNzdB3k This was supposed to be August 8, not July - whoops! Rusty :) Yesterday: RetinaNet. Today: FoveaNet. "We show that deep Q-networks fall naturally as a special case from our proposed approach." https://t.co/ae12rGp43t RT @seokgu: “Introducing Open Mined: Decentralised AI” by @awasunyin https://t.co/lgBRvB6JJB RT @JRubinBlogger: if someone had only warned that a man who can be provoked on Twitter shouldn't have his finger on the button. . . @brubsby fortunately, if they're more than a few minutes old, it's probably not happening - try to remember that in your dreams ;) Always nice to wake up from a nap and have all the tweets in your timeline be about nuclear war. RT @BilgeEbiri: Can't lose the 2020 election if there is no 2020. https://t.co/PhMdPu3x1h RT @seed: SEED AI research: A self-learning agent mastering multiple simultaneous actions using deep RL. More info in the games workshop at… RT @iamtrask: Talked a little bit about my views on AI and life with my friend @sirajraval in Granary Square. https://t.co/5R8dqYyJNb (all… I sketched out US Robots and Mechanical Men, Inc.'s business model a few years ago for a class on business models: https://t.co/aHJTGAzV96 Hirebotics (https://t.co/Qxtoiox2XQ; https://t.co/pTRMemy1aF attempt at US Robots and Mechanical Men, Inc. (company from Asimov universe). @arthchan2003 @iamtrask yes, and if interested check out some combination of the Slack channel (at https://t.co/Uv3iQ8OAZM) + Github+ other vids on Youtube channel @_prasenjitgiri_ @iamtrask this video gives an introduction: https://t.co/drUWXGd1sH @invkrh works for me. If you're at ICML I hear it's blocked there due to overuse :) RT @quasimondo: Who would have thought that if you map my face markers onto Anna Karina you get a young Angela Merkel? https://t.co/fdREZxR… @CVertex no, unfortunately. "RT @Smerity: [Weight-dropped LSTM, non-monotonic ASGD, ptr cache] on word level language modeling gives 52.8 on PTB & 52.0 on WT2 https://t…" RT @yisongyue: Predictions from 2007 by Sylvain Gelly & David Silver on progress of computer Go. #icml2017 https://t.co/55YpCIWf8l @Smerity Don't worry, it knew to let me tweet it at least, for the non-ICML folks :P @Smerity perfect. RT @Smerity: arXiv has been blocked at the International Conference on Machine Learning as we triggered the automatic robot detection syste… What's a hash function expert's favorite pop band? One Direction. RT @hardmaru: 65646 StarCraft replays that contains 1535 million frames and 496 million player actions. I know what I'll be watching when I… Fin. "Parametrization and Generation of Geological Models with Generative Adversarial Networks," Chan and Elsheikh: https://t.co/VXu6wxULuM "Interpretable Low-Dimensional Regression via Data-Adaptive Smoothing," Tansey et al.: https://t.co/Z03otufhdP "Why adaptively collected data have negative bias and how to correct for it," Nie et al.: https://t.co/YriTSATWLE "Multiresolution Kernel Approximation for Gaussian Process Regression," Ding et al.: https://t.co/onVTS0qWmF "Structured Attentions for Visual Question Answering," Zhu et al.: https://t.co/8kLs2Jdwl1 (eval'd on CLEVR but v. latest stuff not ref'd) "Learning for Active 3D Mapping," Zimmermann et al.: https://t.co/o78vJhX97F "Nonconvex Sparse Logistic Regression with Weakly Convex Regularization," Shen and Gu: https://t.co/dTx2J3v8LK (2nd SenseTime-related paper today...they publish a lot. Maybe the reported massive size is actually true) "Unconstrained Fashion Landmark Detection via Hierarchical Recurrent Transformer Networks," Yan et al.: https://t.co/mey2z8oy4G "What is the Role of Recurrent Neural Networks (RNNs) in an Image Caption Generator?," Tanti et al.: https://t.co/NoF7XGWfEM "Learning Uncertain Convolutional Features for Accurate Saliency Detection," Zhang et al.: https://t.co/7KnGHWUPQi "Memory-augmented Neural Machine Translation," Feng et al.: https://t.co/Bh811zHgvf 9 and 2.7 BLEU improvement on 2 tasks "Focal Loss for Dense Object Detection," Lin et al., Facebook - "RetinaNet": https://t.co/cdze5lgtHM "Research on Human Dynamics of Information Release of WeChat Users," Zhang et al.: https://t.co/MKMTX3QZS5 "Identity-Aware Textual-Visual Matching with Latent Co-attention," Li et al.: https://t.co/hbjoWz1qq7 "Fake News Detection on Social Media: A Data Mining Perspective," Shu et al.: https://t.co/Y79PBQmeTJ "Learning Theory of Distributed Regression with Bias Corrected Regularization Kernel Network," Guo et al.: https://t.co/RAzb1oqeEI "PPR-FCN: Weakly Supervised Visual Relation Detection via Parallel Pairwise R-FCN," Zhang et al.: https://t.co/NHdYmDKkce "A Framework for Visually Realistic Multi-robot Simulation in Natural Environment," Gononi and Mukundan: https://t.co/WEhKYVJVaQ "Face Parsing via Recurrent Propagation," Liu et al. (pretty fast): https://t.co/KGPaCaaJfS "Training of Deep Neural Networks based on Distance Measures using RMSProp," Kurbiel and Khaleghian: https://t.co/ReQMAFgiXE "EndNet: Sparse AutoEncoder Network for Endmember Extraction and Hyperspectral Unmixing," Ozkan et al.: https://t.co/nQH8oO60mR "End-to-end learning potentials for structured attribute prediction," Yamaguchi et al.: https://t.co/8TO9YhVka3 "Probabilistic Generative Adversarial Networks," Eghbal-zadeh and Widmer: https://t.co/8FvU6U3Q3j "Differential Privacy By Sampling," Joy and Gerla: https://t.co/HJt92cKtOO "Long Short-Term Memory Kalman Filters:Recurrent Neural Estimators for Pose Regularization," Coskun et al.: https://t.co/87XFivjfhj "TrafficNet: An Open Naturalistic Driving Scenario Library," Zhao et al.: https://t.co/6hFSc4F8ga "Challenges for [AI] Transparency," Adrian Weller (recommended): https://t.co/LACxm4EGhF "Exploiting Latent Attack Semantics for Intelligent Malware Detection," Kazdagli et al.: https://t.co/TmvAazYwc8 "CodeSum: Translate Program Language to Natural Language," Hu et al.: https://t.co/K0w1RLI61m "Exploiting Physical Dynamics to Detect Actuator and Sensor Attacks in Mobile Robots," Guo et al.: https://t.co/fDpRzC26U9 "A Comparison of Neural Models for Word Ordering," Hasler et al.: https://t.co/zCmQvFa1xs "Depth Adaptive Deep Neural Network for Semantic Segmentation," Kang et al.: https://t.co/1Ygu1qSgKy "Efficient Contextual Bandits in Non-stationary Worlds," Luo et al.: https://t.co/muxCfYwT7o "Interpreting CNN knowledge via an Explanatory Graph," Zhang et al.: https://t.co/nQWSHjFurV "e-QRAQ: A Multi-turn Reasoning Dataset and Simulator with Explanations," Rosenbaum et al.: https://t.co/M9EByHng31 "Neural Machine Translation with Word Predictions," Weng et al.: https://t.co/eYhrrddyJl "Referenceless Quality Estimation for Natural Language Generation," Dusek et al.: https://t.co/prsGWPjz5V "SurfaceNet: An End-to-end 3D Neural Network for Multiview Stereopsis," Ji et al.: https://t.co/KqEu9MlHXb "Boosting Variational Inference: an Optimization Perspective," Locatello et al.: https://t.co/ey148OuG4a "Optimizing Region Selection for Weakly Supervised Object Detection," Jiang et al.: https://t.co/CC6JU0NjXJ "Automatic Question-Answering Using A Deep Similarity Neural Network," Minaee and Liu: https://t.co/9U9sWbgLyO "Adversarial Robustness: Softmax versus Openmax," Rozsa et al.: https://t.co/KdDdpSkoKd "Video Frame Interpolation via Adaptive Separable Convolution," Niklaus et al.: https://t.co/OE5ZT3PrZ8 "Deep Metric Learning with Angular Loss," Wang et al.: https://t.co/c0N03DWay6 "Query-guided Regression Network with Context Policy for Phrase Grounding," Chen and Kovvuri et al.: https://t.co/PM9uIXXVuZ "An Effective Training Method For Deep Convolutional Neural Network," Jiang et al.: https://t.co/x9RagpMtie "3D-PRNN: Generating Shape Primitives with Recurrent Neural Networks," Zou et al.: https://t.co/xb2bCjndaj "Localizing Moments in Video with Natural Language," Hendricks et al.: https://t.co/LpEThkC6Qo "Two-Phase Learning for Weakly Supervised Object Localization," Kim et al.: https://t.co/NWacTBvwQf "Multimodal Classification for Analysing Social Media," Duong et al.: https://t.co/PbELrx14wx "Measuring Catastrophic Forgetting in Neural Networks," Kemker et al.: https://t.co/h3IfqfHkZH "Regulating Highly Automated Robot Ecologies: Insights from Three User Studies," Shen et al.: https://t.co/magEetH13A "Unsupervised Domain Adaptation for Face Recognition in Unlabeled Videos," Sohn et al.: https://t.co/EPfHOIadgf "PowerAI DDL [distributed deep learning]," Cho et al.: https://t.co/HzBdnpZOGW "Regularizing and Optimizing LSTM Language Models," @Smerity et al.: https://t.co/HiRDTha9ql "Self-supervised Learning of Pose Embeddings from Spatiotemporal Relations in Videos," Sumer et al.: https://t.co/nc3cL5AkFr "Training Deep Networks to be Spatially Sensitive," Kolkin et al.: https://t.co/5RA8SGGPeY "MemNet: A Persistent Memory Network for Image Restoration," Tai et al.: https://t.co/GckEj1u5v2 "Wasserstein Dictionary Learning: Optimal Transport-based unsupervised non-lin. dictionary learning," Schmitz et al: https://t.co/lV3SayeZel "Training Deep AutoEncoders for Collaborative Filtering," Kuchaiev and Ginsburg: https://t.co/nJmaoMgsac "Classifying Graphs as Images with Convolutional Neural Networks," Tixier et al.: https://t.co/NbuqDGu8hD "Learning a CNN-based End-to-End Controller for a Formula SAE Racecar," Skanda Koppula: https://t.co/paimeqFH9e "Intrinsically Motivated Goal Exploration Processes with Automatic Curriculum Learning," Forestier et al.: https://t.co/AsloXHXqAR (from folks at Prowler.io) "An Information-Theoretic Optimality Principle for Deep Reinforcement Learning," Leibfreid et al.: https://t.co/C20yPBbEwt arXiv papers, July 8 - "STARDATA: A StarCraft AI Research Dataset," Lin et al., Facebook: https://t.co/dq173bHgyQ @_jyan_ was just going to watch this :) RT @Miles_Brundage: @iamtrask Intro to the project here: https://t.co/drUWXGd1sH RT @Miles_Brundage: The excitement+work around Open Mined is quite something - always something new on Slack. Great work @iamtrask et al ht… Trump would be a really bad Wallfacer. Also, I'm enjoying The Dark Forest. RT @ashleymayer: We were promised flying cars, we got a guy dressed as a seat. https://t.co/Ynif4TFd0s RT @suchisaria: Congrats Koh & Percy on #ICML2017 best paper award: "Understanding Black-box Predictions via Influence Functions" https://t… "RT @ahjackman: Dpt of Homeland Sec paper explores ""narratives about AI to understand..perceived benefits & threats from AI adoption""https:/…" Still a lot of progress to be made technically and in developing AI-/robotics-related business models and applications. "Seems right - I'd be surprised if there were big productivity gains already. See also: https://t.co/2CMYFbMWCk https://t.co/iWjbKpSGVt" @iamtrask Intro to the project here: https://t.co/drUWXGd1sH The excitement+work around Open Mined is quite something - always something new on Slack. Great work @iamtrask et al https://t.co/Uv3iQ96com The goal is to get people to give $ to fake thing based on a fake CNN story about Musk investing in it. Could imagine ppl falling for it :( Labeled it as fake news but don't know how good the follow-up is... :( bunch of people probably getting duped. Some sketchy fake news promoted on FB - fake version of CNN, saying Musk quitting Tesla, investing in some fake tech thing linked to. Sad! @semiDL not sure what you mean by long calendar list. Fin. "The Argument Reasoning Comprehension Task," Habernal et al.: https://t.co/AeblCzwSI8 "Viewing Robot Navigation in Human Environment as a Cooperative Activity," Khambhaita + Alami: https://t.co/lEza4KsFHY "On the Selective and Invariant Representation of DCNN for High-Res. Remote Sensing Image Recognition," Chen et al.: https://t.co/uFBP0DkGgO "Hashtag Healthcare: From Tweets to Mental Health Journals Using Deep Transfer Learning," Shickel et al.: https://t.co/ymOuzFlXXf "VisAR: Bringing Interactivity to Static Data Visualizations through Augmented Reality," Kim et al.: https://t.co/wNfjhYq59w "CASSL: Curriculum Accelerated Self-Supervised Learning," Murali et al.: https://t.co/PMkMig1XJK "Recurrent Neural Network-Based Sentence Encoder with Gated Attention for Natural Language Inference," Chen et al.: https://t.co/GywLrcJr33 "AccurateML: Information-aggregation-based Approximate Processing for Fast and Acc. ML on MapReduce," Han et al.: https://t.co/cIT1h68LLx "MemexQA: Visual Memex Question Answering," Jiang et al.: https://t.co/yn8CSiAjhE "The UMD Neural Machine Translation Systems [at WMT17 Bandit Learning Task," Sharaf et al.: https://t.co/FYJzpsoKZE "Automatic Spatially-aware Fashion Concept Discovery," Han et al.: https://t.co/XQvMouCrle "Effective sketching methods for value function approximation," Pan et al.: https://t.co/eI51qiFLZ8 "Spatial Mixing and Non-local Markov chains," Blanca et al.: https://t.co/zHuHaZs4DP "Hierarchical Metric Learning for Fine Grained Image Classification," Goel and Banerjee: https://t.co/n9eB0pnNdb "Multi-modal Factorized Bilinear Pooling with Co-Attention Learning for Visual Question Answering," Yu et al.: https://t.co/4ivtNuoKge "Brain Responses During Robot-Error Observation," Welke et al.: https://t.co/EGFktkvizb "Massively Multilingual Neural Grapheme-to-Phoneme Conversion," Peters et al.: https://t.co/e0dINI9tRY "How Amdahl's low restricts supercomputer applications and building ever bigger supercomputers," János Végh: https://t.co/XpPvJxuztW "Correlation and Class Based Block Formation for Improved Structured Dictionary Learning," Kumar and Sinha: https://t.co/NkFy5Bu7F5 "Learning Model Reparametrizations: Implicit Variational Inference by Fitting MCMC distributions," Michalis Titsias: https://t.co/29Wzve3IYy "A Latent Variable Model for Two-Dimensional CCA and its Variational Inference," Safayani+Momenzadeh: https://t.co/s5zvWJBU2u "Video Salient Object Detection Using Spatiotemporal Deep Features," Le and Sugimoto: https://t.co/ORTuSaAVoj "Efficient Variance-Reduced Learning for Fully Decentralized On-Device Intelligence," Yuan et al.: https://t.co/5yb84T4BTj "Convergence of Variance-Reduced Stochastic Learning under Random Reshuffling," Ying et al.: https://t.co/jR6z6BsVWl "Exploring the Function Space of Deep-Learning Machines," Li and Saad: https://t.co/1VgLn3EYRA "Improving Speaker-Independent Lipreading with Domain-Adversarial Training," Wand and Schmidhuber: https://t.co/MjQ7EIfL2O "Region-Based Multiscale Spatiotemporal Saliency for Video," Le and Sugimoto: https://t.co/pT4rwAVFLQ "Sensing Urban Land-Use Patterns By Integrating Google Tensorflow And Scene-Classification Models," Yao et al.: https://t.co/HXnEKp2ibi "Standard Steady State Genetic Algorithms Can Hillclimb Faster than Mutation-only Evo. Algorithms," Corus/Oliveto: https://t.co/zi9QwddLpz "Augmented Reality Meets Computer Vision: Efficient Data Generation for Urban Driving Scenes," Alhaija et al.: https://t.co/9K3SEsrblh "Independently Controllable Features," Thomas, Pondard, and (Emmanuel) Bengio et al.: https://t.co/IJZ41Y5sKM arXiv papers, July 7 - "Lifelong Learning with Dynamically Expandable Networks," Lee et al.: https://t.co/PdMondADLZ Just finished The Three Body Problem. 💯 Recommended, along with The Wandering Earth. The Dark Forest + Death's End reviews coming soon. And definitely more than any individual Prize category... (the latter is a bit longer but right order of magnitude) Fun fact: about as much time has been spent watching this video as all Nobel Prize winners have spent living. https://t.co/xeiwfJZ0zM RT @ylecun: PyTorch 2.0 is out. https://t.co/Ux4DMAz700 RT @quasimondo: I guess that I overestimated the ability of this model to generalize a bit. https://t.co/GCKEie0YUp RT @Pinboard: Bots are more rational, punctual, less neurotic, less status-seeking, less emotional than humans. Twitter needs to embrace bo… @robinhanson Raven Rock (nonfic) good on Cold War construction of survivable* back up govt complexes *more than hidden but also kinda hidden That Google memo :( RT @iamtrask: A high level introduction to the OpenMined open source project https://t.co/XPbu0y2Dez @Daniel_J_Im believe it's the paper version of a keynote talk which may explain the lack of detail "Deep Learning at Alibaba," Rong Jin: https://t.co/iVdqnhvUBP "Count-Based Exploration in Feature Space for Reinforcement Learning," Martin et al.: https://t.co/lxzf3n8OG6 Good Montezuma results "Reinforcement Mechanism Design," Pingzhong Tang: https://t.co/Pw0MNCuXvk "Concrete Problems for Autonomous Vehicle Safety: Advantages of Bayesian Deep Learning," McAllister et al.: https://t.co/jaLar6ymWO RT @ValaAfshar: Chinese doctors bowing to 11 year old boy with brain cancer who saved lives by donating his organs. https://t.co/8V9429EpD5 @nlpnyc liked Accelerando, hadn't heard of Blindsight though, will check out @nlpnyc thanks! RT @SmithaMilli: Proceedings for @IJCAI_2017 now online! https://t.co/rlUjLILLNw @nlpnyc what by Vinge/Gibson do you recommend? (if other than Fire Upon D. and Neuro.) @tsimonite @zacharylipton how I felt seeing that tweet: https://t.co/ObuiOJBqxv @danbri @notmisha @GoogleTrends seems like declining interest and then picking up again with the rise of deep learning. RT @notmisha: @Miles_Brundage https://t.co/NEmifUcvAU RT @notmisha: @Miles_Brundage https://t.co/v0eN3xHaQJ Human-level AI. https://t.co/8FQlT6nYDM Some important AI progress metrics... https://t.co/TW1fTIKg5j @hardmaru @samim me for sure. @trochee love it (for the record, though, they did happen and there are bajillions of cool new papers) Update: rumors of my arXiv-tweet death have been greatly exaggerated. Starting again next week, but will pretend last 2 weeks didn't happen. @SevakAvakians @zacharylipton @COGNITUUM happy to look at a demo, as long as I don't have to sign an NDA or anything. you need to follow me to get a PM RT @nytimes: Martin Shkreli has been convicted of fraud. He had become infamous for raising the price of a lifesaving drug. https://t.co/QL… RT @DeepMindAI: Check out our blog to find out about the papers we'll be presenting at #icml2017 next week! https://t.co/8ErGb7O1H3 @SevakAvakians @zacharylipton @COGNITUUM why not a paper? @SevakAvakians @zacharylipton @COGNITUUM please do provide evidence of "universal cognitive computing platform powered by AGI" Bonus points for a fictional version of the author (same name + scifi author) being one of the bad guys in the story. @nlpnyc perhaps. still, I've really enjoyed his work so far. From Liu Cixin's short story Curse 5.0 - "the Ministry of Artificial Intelligence Safety." https://t.co/L0zVHqoW5T RT @machinestarts: This is incredible https://t.co/azMwTvq5sR @mark_riedl football/baseball/basketball etc. coaching. RT @mark_riedl: What game that Americans are culturally sensitive about should Chinese AI researchers teach a computer/robot to play perfec… RT @mrdrozdov: ParaNet! Simply translate from source language to target one and back in order to generate paraphrases. https://t.co/YSA7sBs… RT @zacharylipton: Please help me crowdsource some research. What are the most egregious overselling, overhyping AI startups? Thanks!! Hot take: I don't know anything about grand juries. @zacharylipton haven't closely evaluated but possible leads: Kimera, Cognituum, Xephor Solutions RT @machinestarts: Major update to our story: https://t.co/lIjp3XCH7x Hutchins was arrested for alleged role in creating / distributing Kro… @jjvincent ah, to be clear, I meant something narrower. "leader in AI" is vague, but "how good is paper output" = tractable (though time-consuming) @jjvincent def. agree w/ points therein abt quantity being misleading though @jjvincent (e.g. large group of ppl blind reviewing academic output, achievements, etc. but there are big challenges, +qualified ppl busy) @jjvincent one can, it just takes a lot of effort and expertise. RT @machinestarts: Marcus Hutchins, famous for stopping WannaCry spreading, has been arrested. Our report: https://t.co/lIjp3XCH7x <- updat… RT @OpenAI: Open-sourcing an interface for training AIs via small amounts of human feedback: https://t.co/vgc6cWlBZd https://t.co/1Ueh8e9CwC @davegershgorn I have a pitch, where do I send it @AGISI_ORG thanks! @esgarg (e.g. having a more nuanced vocab for different types of meaning in life - individual, community, cosmic etc) @esgarg more just clarifying my views than shifting in any big way :) @rachelannyes I have not but will check it out - thanks! @Brombadil yeah, just noticed that. Not cool :/ @Brombadil and Atari is with little training, not long training like today... https://t.co/VVtluIHBQL @Brombadil wasn't super involved, but see actual paper. The tasks are often harder than that figure suggests (e.g. TTS->"expert listener") RT @dandrezner: Wow. https://t.co/ErhTY0pyaA Giving a talk on optimism in a few months so reading some of the more pessimistic stuff I can find :) (warning: not all will find a book with long chapters on death and suicide "fun" but if you like philosophy/provocation you may like it) (pessimistic take on most things - life has less meaning/is worse than people think, immortality would be cool but is impossible, etc.) The Human Predicament by David Benatar is a fun and extremely clearly written book (though I disagree with pretty much all of it). @Brombadil whoops wrong link pasted. meant this: https://t.co/2qC4F8OJCc and https://t.co/Ji1p9qMc2E @Brombadil that a decent amount of experts think powerful AI in few decades is likely. See also on the survey: https://t.co/Q8o2mbPHZN @Brombadil it's an interesting paper, though of course expert opinions can be wrong/wildly inconsistent. My main update from such papers is @semiDL no, I hope just on break. If there's a theme, it's humanity doing big things. The Wandering Earth (both the short story and the collection by the same name which includes it) = excellent. 💯 https://t.co/Q8o2mbPHZN @mark_riedl https://t.co/TvF1MmfJtq Good talk from @dandrezner on his book "The Ideas Industry": https://t.co/H4cq98KHqr "Enterprise to Computer: Star Trek chatbot," Jena et al.: https://t.co/MnRn8DRYBk https://t.co/ZkWJnMjrd9 Snowpiercer as academic utopia (getting so much work done on the train). Dario Amodei on careers in AI, AI safety, etc.: https://t.co/TW9zbo0skq @iamtrask on the Open Mined Project on encrypted and decentralized AI (17 mins, cut off at the end unfortunately): https://t.co/adoN6J1M64 @bluemonk482 thanks for the recommendation, just listened and enjoyed this. RT @apsarathchandar: All accepted papers at ICML Lifelong Learning Workshop are now available online: https://t.co/UrvfchfU8J #icml2017 Interesting podcast interview with Graham Allison, author of recent book on avoiding US-China war: https://t.co/bFXfsUinan @rcalo @j2bryson do please send! Timeline for R+R still TBD but definitely a live set of issues in any case... RT @iamtrask: Presented at AI Decentralized conference on Monday evening. https://t.co/g0rR8iTQS3 RT @FHIOxford: Deadline extended (29 Sep) - 2 macrostrategy research positions at FHI, apply here: https://t.co/7cqTmv1vII RT @gwbstr: We translated China's Next Generation AI Development Plan in full, available with analysis at @NewAmerica https://t.co/HejMtR3L… "Deep Transfer in Reinforcement Learning by Language Grounding," Narasimhan et al.: https://t.co/3og2djdtZn "The differential geometry of perceptual similarity," Rodriguez and Granger: https://t.co/O3oe0B9O8P @_jyan_ Yes, one doesn't want to throw the baby (legit AI safety/policy etc. concerns) out with the bathwater (misleading coverage), some overstep @_jyan_ I see it as an instance of prosocial punishment to encourage journos doing more AI homework (good reporting should also be celebrated :) ) @_jyan_ (and again, the one you linked to is not most egregious. see e.g. title here on very major news source https://t.co/JImNI8qybc) @_jyan_ yes, there was a fine blog, some fine coverage, then for some reason it blew up again a while later b/c (I assume) scary framing. @_jyan_ "shut down b/c acquired capability" has an ominous sounding feel to it...this is why story copied, and why ppl clicked. @Smerity Warwick has a history of this sort of thing, not AFAIK on social media,+ I think has gotten flack in the past, so not sure it'd help here @_jyan_ Ppl reacting strongly in part b/c it had wildly disproportionate coverage, much of it local, uninformed/not contextualized + scary sounding @_jyan_ that's not the original - also, see the URL and title. "Shut down" is alarmist characterization of learning something and moving on. @rcalo @j2bryson thanks! RT @juliagalef: 21 philosophies, playable as versions of the game SNAKE: https://t.co/N6N7ika4IJ I like asceticism, existentialism & utili… @davegershgorn haven't you seen Office Space RT @DeepMindAI: New paper in @NatureNeuro: Dorsal hippocampus contributes to model-based planning: https://t.co/0F39MFiWie — Miller, Botvin… RT @natfriedman: In-browser GPU-accelerated deep learning from TensorFire: https://t.co/43EAGOt2cs First AI Grant recipients to launch. RT @machinestarts: Here's me on why you shouldn't be scared of headlines about Facebook's "creepy AI" https://t.co/UPWbKMfK73 RT @Smerity: I might lose my mind. Today, on local news back home in Australia, this made the news. What. The. Freaking. Hell. AI hype. WTF… Def. understand concern about bad/premature policies (=one of my concerns), but first remember it's a super broad space of possibilities. Not to mention AI-related stuff already affected by gov't (research funding, IP, education...). AI policy != regulation != ban SGD... And it's hardly clear IMO that internal software processes would be the/only relevant target of AI policy (vs. data, hardware, sales, etc.). "Regulate X" !=micromanage all X's, as tweet suggests--obv hard/undesirable. Products can still be managed, norms imperfectly enforced, etc. One could say same thing (though be missing something key) about "cars"+"thermodynamics," "bioweapons"+"genetics".. https://t.co/8wzKSWb9YQ "Meta-SGD: Learning to Learn Quickly for Few Shot Learning," Li et al., Huawei: https://t.co/7s6LShuqrN RT @DeepMindAI: Congrats @janexwang et al - Comp. Mod. Prize for Applied Cognition at #CogSci2017! Learning to Reinforcement Learn https://… RT @mcette: Job opportunity! Know an amazing individual interested in working in the research/policy space around AI? https://t.co/NXIjQV5D… @Smerity "Smerity is calling for a total and complete shutdown of AI articles until journalists can figure out what the hell is going on" RT @Miles_Brundage: Clear explanations of deep learning, homomorphic encryption, federated learning+smart contracts, +vision 4 mixing em ht… RT @nsaphra: "We would like to filter bots but also British people." https://t.co/MZMawXd2Ax RT @GlennThrush: Last 2 speeches by @realDonaldTrump have prompted rebuke/corrective by event sponsors https://t.co/3Jij6Wj3h1 RT @OrinKerr: Apple removes VPNs from its app store in China to help Chinese government censorship. https://t.co/GsoZpQ7eY4 https://t.co/uG… RT @jeffbigham: i've talked to elon musk, his understanding of oceans is limited https://t.co/LFMaHF9mTq @kleinsound cc @iamtrask Excited to see where the Open Mined initiative goes! Also, great name :) Clear explanations of deep learning, homomorphic encryption, federated learning+smart contracts, +vision 4 mixing em https://t.co/wslL2i5C04 RT @iamtrask: For anyone interested, here's the slidedeck from the talk. https://t.co/T45Hkt9UYv RT @EBKania: China plans to leverage int’l innovation resources & pursue military-civil fusion in AI, creating dual-use dilemma. https://t.… RT @ianhussey: SciHub now contains 69% of all published articles and can fulfil 99% of article requests, may be unstoppable https://t.co/9… RT @levie: That awkward moment when you're the world's richest person for only 6 hours. https://t.co/HP5BxKgVmY @sknthla interested RT @johnregehr: I love how we're heading for Brave New World, 1984, Snow Crash, Handmaid's Tale, and Canticle for Lebowitz all at about the… @FHIOxford is still hiring! https://t.co/8BMl7SbDYu @sknthla you at that? Had to miss the one but hope to go again at some point. @fierycushman Cc @mark_riedl (esp. last one) RT @Azhag: DARLA paper out! Disentangled representations are better then even I expected :P https://t.co/xshSvmHlZ0 RT @OpenAI: Parameter noise, a simple technique for boosting the performance of an RL algorithm via improved exploration: https://t.co/55Q0… RT @DeepMindAI: New paper: an agent that exploits interpretable vision to learn how to act robustly in novel environments https://t.co/9pIl… RT @EBKania: My initial overview of China's "New Generation AI Development Plan" https://t.co/57D2qvGuUP "RT @mark_riedl: Jeff Bezos becomes the richest man in the world https://t.co/wfop4xYZrM ""Come at me bro” — Bezos, probably https://t.co/H…" RT @weballergy: Very interesting to see the summary of the #AI progress being tracked in one place by EFF. https://t.co/fL3p2xs1kI RT @dribnet: confirming my artisanal adversarial attack is non-targeted: DenseNet also classifies LeCun in olympic jersey as a "torch" (top… RT @BlackMarvelGirl: transgender people show more courage when they leave their fucking houses in the morning than donald trump has shown h… @zacharylipton definitely hurps @ArtirKel I need to add some. Added to my homework! @ArtirKel yes, there are several such papers. The intractability of MR has been much overstated. @ArtirKel though I just eyeballed the graph; maybe it's actually there @ArtirKel but yes I think bimodal hypothesis is plausible, though didn't seem borne out in that plot (w/ 7 randomly selected games per type) @ArtirKel latent progress missed by data, and even w/ data one would see more prog there if more papers scraped. I should contribute them @ArtirKel ... specifically don't incorporate new improvements (e.g. relevant here: on exploration) in order to isolate their one new tweak. @ArtirKel again, some data not represented there. Plenty of papers with >0 score in last year. Recent paper (and many Atari) papers ... @ArtirKel it is fast IMO. see median score progress, and proportion of games sub/par/superhuman... @ArtirKel https://t.co/P2P6Te89Os @ArtirKel I have looked at this a bit, think progress is happening on the hard ones but took a while. Also not all papers shown yet EFF's AI progress measurement project now has Atari scores from many papers: https://t.co/h2OROodpsF RT @TheOnion: Trump Administration Worried President Burning Through Minority Scapegoats At Unsustainable Rate https://t.co/Yeho026xG1 http… "RT @fierycushman: Cognition just posted a new special issue on “Moral Learning” — sweet lineup of papers! https://t.co/vpITLWYBGW https://…" @mark_riedl don't let the English prof get to you Needed: Bidirectional Optimization of Recurrent Gradients (BORG). RT @hardmaru: Hebbian-style learning rule for training recurrent neural networks, guided solely by long-term delayed rewards. Work by @Thom… RT @BeschlossDC: President Truman desegregated US armed forces today 1948: https://t.co/6jRQcsqxuF RT @laurenduca: Simply being transgender in this ugly world requires an incredible amount of bravery & strength. Trump is a coward, and als… @TomsFineVideo not sure what you're referring to Oh god the sequel is dumber than I'd feared. WTF. Pence getting his lump of horribleness? https://t.co/SW7aHsUGrc Oh God... this is what it will be like when the nukes are flying, if they aren't already. https://t.co/EcyXp0BLQ6 @jwangARK thought it was an interesting paper when it came out, but no particularly novel thoughts :) experts seem to like it... RT @weijima01: New from the lab: Bayesian computation with small, generic neural networks: https://t.co/9C6nNY8QFx RT @glouppe: @KyleCranmer tldr; we replace the generator in GANs with a non-differentiable scientific simulator and minimize upper bounds o… RT @glouppe: It's out! Our latest paper with @KyleCranmer: Adversarial Variational Optimization of Non-Differentiable Simulators https://t.… In unrelated anecdotal news, a few tech CEOs are well aware they disagree a lot. @zacharylipton ground truth = massive spread from human level AI in few years to decades to centuries/never; x-risk to not risky etc @zacharylipton they consistently think others share their views, and can't all be right about that when in fact views vary a lot. @AlxCoventry so say we all @kennethpayne01 I rephrased it to be clearer, so this tweet will be an orphan soon fyi ;) https://t.co/2qC4F8OJCc Quick reminder about 1 finding of Grace et al. survey of AI experts: experts tend to think their views are less controversial than they are. RT @goodfellow_ian: The tech report on the multi-viewpoint adversarial kitten is out: https://t.co/lgEiULKbzk "Learning Transferable Architectures for Scalable Image Recognition," Zoph et al., Google Brain: https://t.co/MhqW1Nejk4 RT @natfriedman: Applications are now open for round 2 of https://t.co/9wgdrbXSEw. Excited to be working with @danielgross on this! "RT @ylecun: Facebook is looking to hire an AI editor. Yes, to write prose about AI. Not code, though that could be an... https://t.co/ofJS…" @amirhusain_tx @paul_scharre @EBKania @elonmusk @CNASdc I'd be super interested in seeing that, working on related things. RT @CNASdc: CNAS Launches a new initiative on #AI and Global Security. Learn more: https://t.co/oLSeLaFxS8 https://t.co/EOR6ctTYLY @mchorowitz very interested in this! @BenedictEvans maybe some relationship, but if it's as big as the one re: timelines, not massive. E.g. by midcentury, not much diff by citations @BenedictEvans *doesn't report relationship with expectations @BenedictEvans alas, doesn't report with expectations of good/bad outcomes, but across whole sample, fair amount of heterogeneity among NIPS/ICML authors @BenedictEvans cf. survey data (Supp. Figures b+c) suggesting not huge relationship btwn seniority/citations+views on AI timelines: https://t.co/VVtluIHBQL RT @mark_riedl: An English Professor really doesn’t like my research on using stories to teach ethics to computers https://t.co/GLGd43ADBz RT @_rockt: New paper on efficiently incorporating first-order logic rules into neural link prediction @uai2017 TensorFlow code: https://t.… @jjvincent nice. and yeah, bugs me too. @jjvincent and yeah Musk harps on this too @jjvincent no prob. it was indeed central to futurey AI narratives a while back (Kurzweil, Vinge..) though Bostrom more nuanced @jjvincent it def. discusses/suggests latter might be plausible, but not "hinged on" either. @jjvincent the exponential growth in computing/overnight thing is not an accurate re: book Superintelligence (can't speak to WBW article) RT @ken_goldberg: Nice #robot surgery montage! Clips 3,4,5 are autonomous (from our lab) the others are human teleoperated. https://t.co/c… @iandanforth untranslated Liu Cixin novels. You'll still miss content, not to mention style, but in some cases, at least, can get the gist of the plot. Big improvement over before... Machine translation has gotten to the point where one can read a novel translated for the first time into a diff language, and get the gist. RT @andresmh: This is one of the best uses of conversational UI I've seen: a data science bot https://t.co/lqfZhIjdCT by @unignorant at @St… "RT @sla: I'm thrilled with excitement about this collaboration with @pabbeel! https://t.co/cOpHElDAV7 https://t.co/8jYI4QKXzZ" RT @marcgbellemare: Very excited to share our distributional RL paper! See you @ #ICML17 @DeepMindAI https://t.co/8kHbI2RXT4 https://t.co/P… RT @jwangARK: But there are reasons to be cautious—Bitcoin mining migrated from CPU to GPU to ASIC quickly. DL has more sw moat, but not in… RT @jwangARK: Investors remain confident that NVIDIA GPUs will be competitive with deep learning ASICs. https://t.co/t4AgRBhZ97 RT @DeepMindAI: Value distributions lead to state of the art results, casting a new light on reinforcement learning: https://t.co/Uy2N3a55L7 @bluemonk482 looks interesting - thanks! @AlaArmbruster @jackclarkSF @goodfellow_ian haven't read, forgot about that. I do like that series. @_jyan_ @DeepMindAI they have a lot to tweet about today it seems (Hassabis interview) :) Blog post: https://t.co/8plzSfRgkQ @bluemonk482 I'm starting with the short stories actually but at this point I'm going to have to read Three Body. Started reading Liu Cixin's work and I see what the fuss is about. RT @byrdinator: our beleaguered AG https://t.co/ba7ttZLj7P @Aelkus = why ARPA-E's legislation exempted hiring from civil service laws, normal salary caps. More agencies should have same legislation @Zergylord (if I had to guess [don't have the data in front of me RN], the first two points in time might have lower frame #, others not) @Zergylord Typical framed are 100 million or 200, forget what's in there but it's def the case that apples to apples there's improvement Strong scores on Atari without any of the recent bells and whistles. Value distributions help in RL. "A Distributional Perspective on Reinforcement Learning," @marcgbellemare,* Dabney,* and Munos, DeepMind: https://t.co/SgGvul66Xf Median score still moving fast, though, and I still expect something along the lines of what I forecasted in Jan (300-500% med, prob >400). ...which is to say, (many) game-level scores are still improving exponentially. This is also causing mean (not median) score to do the same. Did rough check of how these game-level trends are going 17 months later...4/6 pretty much same, 1 faster, 1 slower. https://t.co/RxbBCXRZPT This. ⬇️⬇️⬇️ https://t.co/m3ZkiDeAKc RT @AlanMackworth: Robot picking bottleneck nearly solved. Big impact. https://t.co/ivxoijplYY Commence Phase 4... cleaning up comments/citations. https://t.co/w31Or1Xlcc "RT @GalaxyKate: What very-serious cutting-edge AI project am I working on tonight? oh... just a @jonnysun fanbot using QuickDraw data and…" RT @CarlosLozadaWP: In today's @PostOutlook, I look back on the works of the late Samuel Huntington and see a prophet for the Trump era: ht… "RT @togelius: Some advice for journalists writing about artificial intelligence https://t.co/1Zhp5aj39A NB: I am not a grumpy old AI resear…" @goodfellow_ian @jackclarkSF look forward to them :) @alexismadrigal @jackclarkSF @goodfellow_ian why wait that long? Maybe if you want to focus on AVs, but AI science seems relevant now @hardmaru @robo_skills @OpenAI gotcha. Was guessing maybe an epsilon of .05 or something would explain the not breaking 300 thing (if that's the max) :) @jackclarkSF @goodfellow_ian @rao2z I may be old fashioned. Would have loved to read a good pop sci book on it when starting out (/maybe would have started earlier then :) ) @jackclarkSF @goodfellow_ian Think there are timeless(ish) AI ideas one could explain well in a book format. E.g. this by @rao2z, though not book https://t.co/F0MLOSRqOs @jackclarkSF @goodfellow_ian Physics also changes, but can still put a lot of effort into explaining relativity etc. well. Algos to Live By did this for explore/exploit. @jackclarkSF @goodfellow_ian Algorithms to Live By is also along the lines I think would be cool for AI... @jackclarkSF @goodfellow_ian yeah, I'm thinking the AI equivalent of a Brian Greene or Hawking book is missing. Master Algo. maybe closest? @jackclarkSF @goodfellow_ian think there's room for a good pop sci book on AI. Surprising not to see this tried (much history, impact, + instruction, not intuitions). @hardmaru @robo_skills @OpenAI is it taking some random actions? RT @hardmaru: Evolution Strategy Variant + OpenAI Gym https://t.co/t2R0QQ5qcH Been busy with personal stuff and non-arXivy work stuff but hopefully catching up on arXiv tonight or tomorrow. RT @JeremyMcLellan: Rule of Thumb: Anyone who puts "PhD" at the end of their name on a book cover did not get a PhD in what the book is abo… @AlxCoventry don't know From Anderson's Security Engineering... https://t.co/FSiusByz1j @sknthla what would count as evidence for/against the AI/autonomy ones? @__jm thx RT @mark_riedl: A desideratum on Human-Centered AI https://t.co/kOq9MAEImk https://t.co/OrZ7AvM9En "After 1989: The New Wave of Chinese Science Fiction," Mingwei Song: https://t.co/gPD6fvCqKf RT @hardmaru: Open Philanthropy Project $2.4mm grant to MILA to work on technical AI Safety research. More grad students and GPUs! https://… @zacharylipton @botminds agreed on that! @jackclarkSF will email @zacharylipton @botminds (more likely than those who make no forecasts/don't learn from them or are wrong often) @zacharylipton @botminds to be good N+x forecasters. Maybe we disagree on N and x, maybe x v small, but short term=falsifiable soon at least @zacharylipton @botminds my pt. was that's an unfair standard/begs the Q (for a long time). Alternative hypo: good N forecasters more likely @zacharylipton @botminds seems like making forecasts on diff timescales, updating re: models/predictability as they time out = good approach @zacharylipton @botminds hard to argue with you until N years pass (where N = number of years for which prediction is interesting) @botminds @zacharylipton don't really have time to argue this in detail RN but I disagree with that characterization Writing is def a good form of/tool for thinking, but preparing a talk makes you cut to the essence by assuming a shorter IRL attention span. Gave my first talk on (international) AI agreements today. Great feedback. 📑🔜. Also reminded me that I find preparing talks very helpful... RT @paul_scharre: Worried like @elonmusk that #artificialintelligence is a long-term risk? @FHIOxford has 2 new AI strategy jobs open: http… Interview with Dario Amodei of OpenAI on AI, AI safety, etc. https://t.co/TW9zbnIQVQ @Shuping_Ruan @jvmancuso @KaiLashArul not that I'm aware of, but Google has various RL-related patents that AFAIK they don't enforce. @zacharylipton per point at the end, may turn out AI is very predictable (my Atari forecasts have gone well so far), need 2 try to know :) @zacharylipton this is part of why I like making medium term (longer than an experiment, shorter than many years) forecasts + checking em. "RT @FeryalMP: Is Imitation Learning the Route to Humanoid Robots? (Stefan Schaal, 1999) https://t.co/U8DVRKWwWF https://t.co/SHLzhGvBJ4" @davegershgorn https://t.co/zdv8pPS4mA RT @MirowskiPiotr: Dario Amodei from @OpenAI talks about research and collaboration on AI safety between OpenAI and @DeepMindAI: https://t.… RT @catherineols: I'm so excited that cocosci frameworks are being applied to human-AI interaction. This is a great pairing :) https://t.co… "Pragmatic-Pedagogic Value Alignment," Fisac et al., Berkeley: https://t.co/XHsoAI1361 @davegershgorn gonna need to use that when I don't have an answer to a question after a talk... RT @OpenAI: Releasing PPO, a new class of reinforcement learning algorithms that excel at simulated robotics tasks: https://t.co/MsGrJDCfxK… @swirlOsquirrel @goodfellow_ian the headline/fight framing is somewhat misleading. RT @SophieCFischer: #China Unveils National #AI Development Plan to Become a World Leader in #AI by 2025 @nytimes v @EBKania #tech https://… RT @EBKania: China's State Council issued guideline on development of AI, goal of becoming global innovation center by 2030. https://t.co/Y… RT @goodfellow_ian: MIT Technology Review article on the adversarial example competition: https://t.co/ke1z6KihrT Join today if it sounds f… RT @theophaneweber: New work on agents using imagination/models of the environment and combining model-based and model-free ideas to solve… RT @DeepMindAI: Two new papers describe agents that learn to imagine and use their imaginations to make plans. Read our blog: https://t.co/… @twiecki @weballergy I can but it's a long conversation ;) publication on it soonish... Will catch up on arXiv soon... @patrickc @eekedm I especially like the "trust and amplify" section (and nice term)! @venkatesanragav congrats! RT @DeepMindAI: New paper: leveraging demonstration data to achieve state-of-the-art results for 17 Atari games https://t.co/BCI1jqrLAZ htt… RT @jordnb: My work presented at Bayesian Deep Learning workshop at NIPS. You can get SotA performance with a simple Bayesian prior on a pr… RT @KaiLashArul: The paper itself is really well written, but nevertheless her blog post on meta-learning is a nice little intro: https://t… RT @KaiLashArul: Model-Agnostic Meta-Learning by Chelsea Finn et al. is one of my favourite papers of this year - simple, but tackling the… "Neuroscience-Inspired Artificial Intelligence," @demishassabis et al.: https://t.co/JW2utxTFBy RT @ESYudkowsky: @ogrisel @pfau @Miles_Brundage We're going to train a discriminator and make Mexico supervise it! @ankurhandos fortunately there aren't too many must read books yet @ankurhandos blogs and news articles. @fchollet hope the weather is Xceptional RT @pfau: @Miles_Brundage Not true. It has terrible and biased gradients. Totally unfair. Blog post explaining the new paper by Saunders et al. at Oxford/Stanford, on human oversight of RL systems - https://t.co/HapOm6Yuxw RT @ogrisel: @pfau @Miles_Brundage He does not quite like CNNs. Trump's favorite deep learning framework is definitely Caffefe. RT @santoroAI: Great blog post on learning-to-learn by Chelsea Finn https://t.co/H62hFH3pCf "RT @robmccargow: The @LordsAICom have launched their call for evidence on the implications of #AI Deadline ➡️ 6th September 2017 https://t.…" @weballergy agreed! @alex_peys yup @JoshuaParikh yes "I'll be really brief" disclaimers at meetings convey zero information. Not correlated with length of the following comment. What would that look like, though? 🤔 tough one. Have some ideas, to be continued... I'm quoted briefly here re: the need to consider international agreements on AI: https://t.co/L7JH2VGlPy RT @timhwang: 🚨 FINAL WEEK 🚨 The CFP deadline for “The California Review of Images and Mark Zuckerberg” is July 26. Get in there: https://t… RT @fchollet: Some of my thoughts on the future of deep learning: https://t.co/PweWuM1C8h - This is the follow-up to yesterday's post on th… @guyvdb @_jyan_ what do you mean by above the fringe? @guyvdb @_jyan_ see also the Extended Data Tables 6 and 7 (2015 no handicap CS and entry 2 in table 7) @guyvdb @_jyan_ to be clear (there are many versions) I mean policy net + value net, no rollout. That looks >2k Elo to me, v <2k for CS. @guyvdb @_jyan_ see table for rollout free score v. Crazy Stone. @markus_with_k @weballergy at least one other: https://t.co/6k3cC7JHMP also some with Zoubin Gharamaini w/ dual affiliation @guyvdb @_jyan_ thr AlphaGo paper shows this. @davegershgorn neeerd @mark_riedl ooo sounds cool. To be continued... @mark_riedl (also by my colleagues btw so I'm well aware of the awareness of that prob. :) ) "The Reversible Residual Network: Backpropagation Without Storing Activations," Gomez and Ren et al., Toronto/Uber: https://t.co/b1XTJxpekG "ADAPT: Zero-Shot Adaptive Policy Transfer for Stochastic Dynamical Systems," Harrison and Garg et al.: https://t.co/eY2jfJcPia "Knowledge-Guided Recurrent Neural Network Learning for Task-Oriented Action Prediction," Lin et al.: https://t.co/7Crlsz3mIe "Overcoming Catastrophic Interference by Conceptors," He and Jaeger: https://t.co/c05X64NcVY "Visual Question Answering with Memory-Augmented Networks," Ma et al.: https://t.co/AJmrDT3NMY @mark_riedl it's in the abstract v. explicitly...have you looked at it yet? "MoCoGAN: Decomposing Motion and Content for Video Generation," Tulyakov et al.: https://t.co/YERbXS7V9K "Iris: A Conversational Agent for Complex Tasks," Fast et al.: https://t.co/R5qDTZlDqG "Translational Recommender Networks," Tay et al.: https://t.co/aooXDroG11 "Learning to select data for transfer learning with Bayesian Optimization," Ruder and Plank: https://t.co/LU4qlSdhyq @mark_riedl that is discussed. "Evolutionary Training of Sparse Artificial Neural Networks: A Network Science Perspective," Mocanu et al.: https://t.co/Tk3mCq5GL5 "AI Challenges in Human-Robot Cognitive Teaming," Chakraborti et al.: https://t.co/x3ommIa5KL "Reinforcement Learning for Architecture Search by Network Transformation," Cai et al.: https://t.co/NcqVvKvXoX "Tracking as Online Decision-Making: Learning a Policy from Streaming Videos with RL," Supancic III and Ramanan: https://t.co/TAhzjZk0wi "Control of a Quadrotor with Reinforcement Learning," Hwangbo et al.: https://t.co/FmaZirSLqA "GLSR-VAE: Geodesic Latent Space Regularization for Variational AutoEncoder Architectures," Hadjeres et al.: https://t.co/dlGTqErIwp "An Ensemble Boosting Model for Predicting Transfer to the Pediatric Intensive Care Unit," Rubin et al.: https://t.co/HzVbP4St6B "Theoretical insights into the optimization landscape of over-parameterized shallow NNs," Soltanolkotabi et al.: https://t.co/WApCq1IkPr "Deep Learning to Attend to Risk in ICU," Nguyen et al.: https://t.co/GKY2WqOE8P "Cosmological model discrimination with Deep Learning," Schmelzle et al.: https://t.co/efqdzb28Vr "Variational approach for learning Markov processes from time series data," Wu and Noé: https://t.co/5SRXaBPpoV "On the Performance of Forecasting Models in the Presence of Input Uncertainty," Sangrody et al.: https://t.co/iF7xAYfw7Z "Reverse Curriculum Generation for Reinforcement Learning," Florensa et al.: https://t.co/nqjiFVtLm2 (videos: https://t.co/92GMOC6oaM) Great work by some of my colleagues. arXiv papers, July 18 - "Trial without Error: Towards Safe Reinf. Learning via Human Intervention," Saunders et al.: https://t.co/4GaeDdLYR5 @zacharylipton seems to have been fixed. "I’m a tremendous fracker" - rare case where quoting someone out of context makes them more accurate... https://t.co/uiWzGQWMyN RT @jackclarkSF: Adversarial examples AKA magic eye brain-manglers for machines. Little @OpenAI blog re some experiments from the weekend.… @_jyan_ @guyvdb agree w/ some pts need to avoid overinvesting in NNs, but it's def very much a personal POV/has issues (he notes may be missing things tho) @_jyan_ @guyvdb (specifically re: human-levelness). some parts also just wrong (AlphaGo without MCTS is in fact "competitive" already) @_jyan_ @guyvdb lots of work in DL(+) does the sort of stuff he says is absent (reasoning), and I don't see DL ppl claiming the things he attributes to them @_jyan_ @guyvdb Just read it carefully and think that while Jonathan was perhaps glib in dismissing it w/o reading, the author does miss much of DL today RT @fchollet: My quick write-up on the limitations of deep learning: https://t.co/9upBSqsOOb It's meant as an intro to tomorrow's post on t… RT @memotv: This is so very good https://t.co/ROzGEnuDPo Also available for free: https://t.co/VHqJwD4UDH Highly recommended for those interested in security, just take your time :) Read most of the papers I wanted to this weekend, but not as much in Anderson's Security Engineering textbook. So big/good, it's a struggle. @_jyan_ yes, I've mentioned before that it'd be fun to do a documentary about such ppl :-) wasted computer vision research for example @_jyan_ /think far ahead...pretty normal human things, even w/o this guy :) @_jyan_ If people just cared about appeals to authority, they'd maybe defer to Stuart Russell, but many don't. Also don't want 2 feel like bad guys @_jyan_ Hmm. there will always be >0 dissenters w/in community (see: climate), but not sure it matters if 1% or 20%. Psych factors maybe more impt @_jyan_ Lemme know what you think if/when you read it. I'll prob. check out on bus tomorrow... @_jyan_ Still, when someone with some credibility (lots of cites on Bayes nets etc.) writes at length, worth checking out. Usually just soundbites. @_jyan_ haven't read but looked interesting. Good to be skeptical about DL though I'm also bullish. +wait til someone tells him humans are animals 😬 Fin. "Capturing the diversity of biological tuning curves using generative adversarial networks," Arakami et al.: https://t.co/2sZg3mrBAG "Kernel Method for Detecting Higher Order Interactions in multi-view Data," Alam et al.: https://t.co/zBjTdPA8ae "Cultivating DNN Diversity for Large Scale Video Labelling," Bober-Irizar et al.: https://t.co/5gITz646LO "Ergodic Coverage In Constrained Environments Using Stochastic Trajectory Optimization," Ayvali et al.: https://t.co/n7ANoFzm5g "Discriminative Optimization: Theory and Applications to Computer Vision Problems," Vongkulbhisal et al.: https://t.co/N0JEX3Qiwv "Image-based Proof of Work Algorithm for the Incentivization of Blockchain Archival of Interesting Images," Billings https://t.co/lRH7M3WFYV "Model compression as constrained optimization, w/ app. to NNs. Part II: quantization," Carreira-Perpiñán+Idelbayev: https://t.co/cXpYBZJUoL "Weakly Submodular Maximization Beyond Cardinality Constraints: Does Randomization Help Greedy?," Chen et al.: https://t.co/qfktVkRiKD "Advances in Artificial Intelligence Require Progress Across all of Computer Science," Hager et al.: https://t.co/L5Qjot4n0e "Comparison of Multiple Features and Modeling Methods for Text-dependent Speaker Verification," Liu et al.: https://t.co/l17ySM96EP "Inner-Scene Similarities as a Contextual Cue for Object Detection," Arbel et al.: https://t.co/o5Qbd1pp9r "Modeling Harmony with Skip-Grams," Sears et al.: https://t.co/HkqymcvGgB "LIUM Machine Translation Systems for WMT17 News Translation Task," Garcia-Martinez et al.: https://t.co/f8Sq5jPuxI "Linguistic Markers of Influence in Informal Interactions," Prabhumoye et al.: https://t.co/jetL0pcgLU "CUNI System for the WMT17 Multimodal Translation Task," Helcl and Libovický: https://t.co/WIJ9HWau0z "Freeway Merging in Congested Traffic based on Multipolicy Decision Making with Passive Actor Critic," Nishi et al.: https://t.co/JeUbpGqhNM "LIUM-CVC Submissions for WMT17 Multimodal Translation Task," Caglayan et al.: https://t.co/RttpIQfZXK "Temporal Modeling Approaches for Large-scale Youtube-8M Video Understanding," Li et al.: https://t.co/apBlcLBp4x "Guiding InfoGAN with Semi-Supervision," Spurr et al.: https://t.co/mfZENcTgtR "Cross-genre Document Retrieval: Matching between Conversational and Formal Writings," Jurczyk and Choi: https://t.co/P4nbV3NbRO "Autonomous Racing with AutoRally Vehicles and Differential Games," Williams et al.: https://t.co/J6sHRAEKbg "Evaluating Semantic Parsing against a Simple Web-based Question Answering Model," Talmor et al.: https://t.co/XSKhOg0eaM "Human-Level Intelligence or Animal-Like Abilities?," Adnan Darwiche: https://t.co/p4fdESSdvd "Lenient Multi-Agent Deep Reinforcement Learning," Palmer et al.: https://t.co/aQIXoCkLBQ "Sustainable computational science: the ReScience initiative," Rougier and Hinsen et al. (many authors): https://t.co/GZtk7JzkeM "Tensor-Based Backpropagation in Neural Networks with Non-Sequential Input," Agarwal and Huang: https://t.co/W408nY5KYg "f-GANs in an Information Geometric Nutshell," Nock et al.: https://t.co/nIbAgThagl arXiv papers, July 17 - "Bayesian Optimization for Probabilistic Programs," Rainforth et al.: https://t.co/0fu36YXkVb RT @coreylynch: PILQR: https://t.co/sU3LSVjQQP. Super low sample complexity RL (DDPG needs 10x more samples to solve same sim door opening;… @hardmaru @mark_riedl still, think it's reasonable hypothesis that they jumped gun a bit b4 underlying tech ready, and by the time it was, didn't have edge in it @hardmaru Yes, I agree with what @mark_riedl said a while back about their challenges being understandable given what they're trying to do... TL;DR: IBM has a lot of competition, isn't clearly making a lot of money with the Watson division, AI as a service is hard. Didn't read the whole thing but this seemed like a pretty reasonable report. https://t.co/nhFb3pzBcA @robyncaplan I'm sure it's better than these: https://t.co/ocpPBjpwVI Good panel discussion on young people in the US and China: https://t.co/XV4Yu9l1cr @zacharylipton (but yes, the average depth of attention to each is not radically more than that - abstract skim to paper skim = ~60%+ of em) @zacharylipton These have been piled up for the past week :) All caught up on the last week! Tweeted the start of each thread for reference. RT @Miles_Brundage: arXiv papers, July 14 - "Merge or Not? Learning to Group Faces via Imitation Learning," He et al., SenseTime: https://t… RT @Miles_Brundage: arXiv papers, July 13 - "Learning Macromanagement in StarCraft from Replays using Deep Learning," Justesen and Risi: ht… RT @Miles_Brundage: arXiv papers, July 12 - SCAN: Learning Abstract Hierarchical Compositional Visual Concepts," Higgins et al, DeepMind ht… RT @Miles_Brundage: arXiv papers, July 11 - "Revisiting Unreasonable Effectiveness of Data in Deep Learning Era," Sun et al., Google/CMU ht… RT @Miles_Brundage: arXiv papers, July 10 - "Emergence of Locomotion Behaviours in Rich Environments," Heess et al., DeepMind: https://t.co… @nik_limi interesting papers from the last week. normally I tweet them daily but fell behind so catching up. Fin. "TasselNet: Counting maize tassels in the wild via local counts regression network," Lu et al.: https://t.co/fKJIKajEjm "An Analysis of Human-centered Geolocation," Wang et al.: https://t.co/l5xeBcfapC "A Generalized Recurrent Neural Architecture for Text Classification with Multi-Task Learning," Zhang et al.: https://t.co/7pLyCU4Cgo "Deep Bilateral Learning for Real-Time Image Enhancement," Gharbi et al.: https://t.co/42vGPdGIER "Adaptive Binarization for Weakly Supervised Affordance Segmentation," Sawatzky and Gall: https://t.co/ZCmvrsVjdJ "Towards Crafting Text Adversarial Samples," Samanta and Mehta: https://t.co/dSZP7z8OzI "Unsupervised Learning of Task-Specific Tree Structures with Tree-LSTMs," Choi et al.: https://t.co/KvLDKB6Glk "Deep Reinforcement Learning Attention Selection for Person Re-Identification," Lan et al.: https://t.co/MCOkUQaQMr "Deciding Probabilistic Program Equivalence in NetKAT," Smolka et al.: https://t.co/H0gQF2ucOy "Understanding State Preferences With Text As Data: Introducing the UN General Debate Corpus," Baturo et al.: https://t.co/IQYGaTwhM9 "Model ID+Controller Parameter Optimization for an Autopilot Design for Auto. Underwater Vehicles," Taubert et al.: https://t.co/N1uAPgNFlq "Compressed Representation of Dynamic Binary Relations with Applications," Brisaboa et al.: https://t.co/fMTfLx6SXp "A Local-Search Algorithm for Steiner Forest," Groß et al.: https://t.co/kW2plm6Tzs "Constraint Handling Rules with Binders, Patterns and Generic Quantification," Serrano and Hage: https://t.co/PjFLlwTrl4 "Improving speaker turn embedding by crossmodal transfer learning from face embedding," Le et al.: https://t.co/T8IPxGNpys "Robust Imitation of Diverse Behaviors," Wang et al.: https://t.co/upLhtBBswP "Object Handover Prediction using Gaussian Processes clustered with Trajectory Classification," Lang et al.: https://t.co/0Q1rFWnKEo "Synthesis-based Robust Low Resolution Face Recognition," Shekhar et al.: https://t.co/el3xgPUr64 "Best-Effort Inductive Logic Programming via Fine-grained Cost-based Hypothesis Generation," Schuller and Kazmi: https://t.co/svpwCMteSi "Stochastic Variance Reduction Gradient for a Non-convex Problem Using Graduated Optimization," Chen et al.: https://t.co/riK6D8HaHI "Primal-Dual Group Convolutions for Deep Neural Networks," Zhang et al.: https://t.co/7xcD2UGleE "To Walk or Not to Walk: Crowdsourced Assessment of External Vehicle-to-Pedestrian Displays," Fridman et al.: https://t.co/lnUKUKO5qU "Anisotropic Diffusion-based Kernel Matrix Model for Face Liveness Detection," Yu and Jia: https://t.co/3lpAV4tzwR "A New Algorithm to Automate Inductive Learning of Default Theories," Shakerin et al.: https://t.co/9KqQznusb2 "Finding polynomial loop invariants for probabilistic programs," Feng et al.: https://t.co/popNdZ8IPy "Learning in High-Dimensional Multimedia Data: The State of the Art," Gao et al.: https://t.co/ZOG27mvPkL "Feature Joint-State Posterior Estimation in Factorial Speech Processing Models using DNNs," Khademian et al.: https://t.co/7BBCt0skwc "PELESent: Cross-domain polarity classification using distant supervision," Correa Jr. et al.: https://t.co/4FMCeqnY8G "Vision-Based Classification of Social Gestures in Videochat Sessions," Yao and Yarosh: https://t.co/PZHR2CaNtQ "Model-Based Speech Enhancement in the Modulation Domain," Wang and Brookes: https://t.co/v2ycBBa3Fc "Cappuccino: Efficient [CNN] Inference Software Synthesis for Mobile System-on-Chips," Motamedi et al.: https://t.co/Sf1k7Rd9MF "Integration of LiDAR and Hyperspectral Data for Land-cover Classification: A Case Study," Ghamisi et al.: https://t.co/24O3ERCMlm "Local Activity-tuned Image Filtering for Noise Removal and Image Smoothing," Zhao et al.: https://t.co/bVVHvs5D2W "Controlling Linguistic Style Aspects in Neural Language Generation," Ficler and Goldberg: https://t.co/CZMYUXxV2z "Deepest Neural Networks," Raul Rojas: https://t.co/UrGRCvuSJH "Few-Shot Learning Through an Information Retrieval Lens," Triantafillou et al. (Vector Institute - 1st I've seen?): https://t.co/8SGgZM9EkI "Detection of bimanual gestures everywhere: why it matters, what we need and what is missing," Shah et al.: https://t.co/Urqq3PBOS2 "Flexible human-robot cooperation models for assisted shop-floor tasks," Darwish et al.: https://t.co/VR26cI8oyV "Mathematical Models of Adaptation in Human-Robot Collaboration," Nikolaidis et al.: https://t.co/YkbK3nbIGB "Exploiting the Tradeoff between Program Accuracy+Soft-error Resiliency Overhead for ML Workloads," Shi et al.: https://t.co/OWiF2ZwOl8 "Class-Weighted Convolutional Features for Visual Instance Search," Jimenez et al.: https://t.co/2SVatKKFJd "Neural Machine Translation between Herbal Prescriptions and Diseases," Sun-Chong Wang: https://t.co/Y5AXc8znnQ "GraphMP: An Efficient Semi-External-Memory Big Graph Processing System on a Single Machine," Sun et al.: https://t.co/cGBoASNleB "Visual Analytics of Movement Pattern Based on Time-Spatial Data: A Neural Net Approach," Chen et al.: https://t.co/8E8EAruOco "Exploiting Active Subspaces in Global Optimization: How Complex is your Problem?," Palar and Shimoyama: https://t.co/vTeFzwrXNA "Deep CNN Framework for Audio Event Recognition using Weakly Labeled Web Data," Kumar and Raj: https://t.co/DKlT9RVaKy "A Fast Integrated Planning and Control Framework for Autonomous Driving via Imitation Learning," Sun et al.: https://t.co/cUrmI7Bqv5 "Predicting the Quality of Short Narratives from Social Media," Wang et al.: https://t.co/47z3WmULsk "MDNet: A Semantically and Visually Interpretable Medical Image Diagnosis Network," Zhang et al.: https://t.co/2RmmWXiLzC "Weakly Supervised Cross-Lingual Named Entity Rec. via Effective Annotation + Representation Projection," Ni et al.: https://t.co/wWIZV79mwa "Hyperspectral Image Restoration via Total Variation Regularized Low-rank Tensor Decomposition," Wang et al.: https://t.co/ZEieUgLw0f "Tailoring Artificial Neural Networks for Optimal Learning," Aceituno et al.: https://t.co/LiBpbWHbFO "Self Adversarial Training for Human Pose Estimation," Chou et al.: https://t.co/4imForTIwK "Deep Learning for Vanishing Point Detection Using an Inverse Gnomonic Projection," Kluger et al.: https://t.co/5iiI5IehYD "Application of Transfer Learning Approaches in Multimodal Wearable Human Activity Recognition," Chen et al.: https://t.co/clw2ow7gL8 "Translation-based Recommendation," He et al.: https://t.co/KusMfLR41L "Embedding Visual Hierarchy with Deep Networks for Large-Scale Visual Recognition," Zhao et al.: https://t.co/9ozFEWaGmL "Fast Asymmetric Fronts Propagation for Image Segmentation," Chen and Cohen: https://t.co/eT7ykLekzM "Effective Approaches to Batch Parallelization for Dynamic Neural Network Architectures," Suarez and Zhu: https://t.co/L6KJsUWUK2 "Representation Learning and Adversarial Generation of 3D Point Clouds," Achlioptas et al.: https://t.co/cxZsyspEHM "Generating Realtime Motion Plans from Complex Natural Language Commands Using Dynamic Grounding Graphs," Park et al https://t.co/08VL78FP89 "Detection of AQM on Paths using Machine Learning Methods," Baykal et al.: https://t.co/J30bS0nySi "Efficient Vector Representation for Documents through Corruption," Minmin Chen: https://t.co/W7ac3goPDZ "Correlational Dueling Bandits with Application to Clinical Treatment in Large Decision Spaces," Sui et al.: https://t.co/Oloe6AELbR "Towards Zero-Shot Frame Semantic Parsing for Domain Scaling," Bapna et al.: https://t.co/2LtLekV1Q1 "Skeleton-based Action Recognition Using LSTM and CNN," Li et al.: https://t.co/eh61QiVHAI "Evaluating race and sex diversity in the world's largest companies using deep neural networks," Chekanov et al.: https://t.co/NM2i9xaBr1 "Information Theoretic Model Predictive Control: Theory and Applications to Autonomous Driving," Williams et al.: https://t.co/Ym9IdGZPvN "Fast Stochastic Hierarchical Bayesian MAP for Tomographic Imaging," McKay et al.: https://t.co/RtnTKuDdsm "Why Modern Open Source Projects Fail," Coehlo and Valente: https://t.co/QIO4FlrPSl "Learning Efficient Image Representation for Person Re-Identification," Yang et al.: https://t.co/9HXOsEKzDB "Adaptive Correlation Filters with Long-Term and Short-Term Memory for Object Tracking," Ma et al.: https://t.co/OeA1wWERKJ "Enhanced Deep Residual Networks for Single Image Super-Resolution," Lim et al.: https://t.co/l3KixFgpqL "A Brief Survey of Text Mining: Classification, Clustering and Extraction Techniques," Allahyari et al.: https://t.co/WdnfLkaMyf "Topology Reduction in Deep Convolutional Feature Extraction Networks," Wiatowski et al.: https://t.co/uSFAkvUTVO "Accelerated Stochastic Power Iteration," De Sa et al.: https://t.co/FQIqbOk2gh "Overcoming the curse of dimensionality: Solving high-dimensional partial differential equations using DL,"Han et al https://t.co/yzMEwy0kNn "Variational Inference via Transformations on Distributions," Saxena et al.: https://t.co/rA5SR1QvjF "An Adaptive, Multivariate Partitioning Algorithm for Global Optimization of Nonconvex Programs," Nagarajan et al.: https://t.co/ErvgelaIlL "Deep Semantic Segmentation for Automated Driving: Taxonomy, Roadmap and Challenges," Siam et al.: https://t.co/4L1GIMizpz "Bayesian Models of Data Streams with Hierarchical Power Priors," Masegosa et al.: https://t.co/9fhEeX7Gai "Deep Reinforcement Learning for Improving Downlink mmWave Communication Performance," Mismar+Evans: https://t.co/Rqlx6WTWEO "Learning Mixture of Gaussians with Streaming Data," Raghunathan et al.: https://t.co/MrsBJgItzr "Global optimality conditions for deep neural networks," Yun et al.: https://t.co/wV8PbEnL66 "Automated versus DIY methods for causal inference: Lessons learned from a data analysis competition," Dorie et al.: https://t.co/2vAue7rWbb "Composition Properties of Inferential Privacy for Time-Series Data," Song and Chaudhuri: https://t.co/FCyVCotydt "Subdeterminant Maximization via Nonconvex Relaxations and Anti-concentration," Ebrahimi et al.: https://t.co/3sqmE7B8S6 "Semi-Supervised Haptic Material Recognition for Robots using Generative Adversarial Networks," Erickson et al.: https://t.co/xtJO4dqZLm "Subspace Clustering with Missing and Corrupted Data," Charles et al.: https://t.co/wlTd3xpKm4 "Adversarial Examples, Uncertainty, +Transfer Testing Robustness in Gaussian Proc. Hybrid Deep Nets," Bradshaw et al https://t.co/6dyyYRnZvF "Nonlinear Sequential Accepts and Rejects for Identification of Top Arms in Stochastic Bandits," Shahrampour+Tarokh: https://t.co/ro0R6YNECB "Residual Value Forecasting Using Asymmetric Cost Functions," Dress et al.: https://t.co/UisxU9i71a "An Interactive Greedy Approach to Group Sparsity in High Dimension," Qian et al.: https://t.co/vh5hpfxnKR "A case study of Empirical Bayes in User-Movie Recommendation system," Dey et al.: https://t.co/qZyvcOmHlu "A Reconfigurable Streaming Deep Convolutional Neural Network Accelerator for Internet of Things," Du et al.: https://t.co/8RjH3rssdq "A Separation-Based Design to Data-Driven Control for Large-Scale Partially Observed Systems," Yu et al.: https://t.co/MEwEW69E44 "Robot Autonomy for Surgery," Yip and Das: https://t.co/Rv0HcjYc41 "TAPAS: Two-pass Approximate Adaptive Sampling for Softmax," Yu et al.: https://t.co/mC4nzx1Ila "Lexicographic choice functions," Van Camp et al.: https://t.co/6C5ZixG55u "Automatic Understanding of Image and Video Advertisements," Hussain et al.: https://t.co/wT8BqlsW07 "Improving Neural Parsing by Disentangling Model Combination and Reranking Effects," Fried et al.: https://t.co/zCsEAbT0Ly "Hardware-efficient on-line learning through pipelined truncated-error backpropn in binary-state nets,"Mostafa et al https://t.co/3YSX9DjDKS "On Study of the Reliable Fully CNNs with Tree Arranged Outputs (TAO-FCN) for Handwritten String Rec.," Wang et al.: https://t.co/B7T0Fmdgth Fin. "Malware in the Future? Forecasting Analyst Detection of Cyber Events," Bakdash et al.: https://t.co/ogGP79HqpO "Deductive and Analogical Reasoning on a Semantically Embedded Knowledge Graph," Douglas Summers-Stay: https://t.co/28tNnNpqum "A non-projective greedy dependency parser with bidirectional LSTMs," Vilares et al.: https://t.co/vqiUd7KzcK "DeepTrend: A Deep Hierarchical Neural Network for Traffic Flow Prediction," Dai et al.: https://t.co/ONMKdApN3w "A Survey on Resilient Machine Learning," Kumar and Mehta: https://t.co/i67B1tPoyc "Dataset for a Neural Natural Language Interface for Databases (NNLIDB)," Brad et al.: https://t.co/ZQxmVqwYed "RegNet: Multimodal Sensor Registration Using Deep Neural Networks," Schneider et al.: https://t.co/v3Lii6BrEC "Foreground Detection in Camouflaged Scenes," Li et al.: https://t.co/CuV2fmwwM4 "Adversarial Generation of Training Examples for Vehicle License Plate Recognition," Wang et al.: https://t.co/uURQ7cr3Ut "Refining Raw Sentence Representations for Textual Entailment Recognition via Attention," Balazs et al.: https://t.co/7zvjQtfpVG "Learning the Latent "Look": Unsupervised Discovery of a Style-Coherent Embedding from Fashion Images," Hsiao et al: https://t.co/oXogpyCa0M "Trump vs. Hillary: What went Viral during the 2016 US Presidential Election," Darwish et al.: https://t.co/2GFyl5bxfI "Automated Game Design Learning," Osborn et al.: https://t.co/xQAHvWxdat "Hierarchical Deep Recurrent Architecture for Video Understanding," Tang et al.: https://t.co/D4HwwLnQSr "A simple but tough-to-beat baseline for the Fake News Challenge stance detection task," Riedel et al.: https://t.co/VoVBFNxU08 "Learning the Einstein-Podolsky-Rosen correlations on a Restricted Boltzmann Machine," Steven Weinstein: https://t.co/naVtvavUAg "Deep Learning-Based Communication Over the Air," Dorner et al.: https://t.co/WnZ0TP1jvj "Least Square Variational Bayesian Autoencoder with Regularization," Gautaman Ramachandra: https://t.co/gbFJ4kkHcs "tick: a Python library for statistical learning, with a particular emphasis on time-dependent modeling"-Bacry et al https://t.co/iCe7jRtMeU "Fast Amortized Inference and Learning in Log-lin. Models with Randomly Perturbed Nearest N. Search," Mussmann et al https://t.co/W1IJ6MEPVB "Multiscale dynamics of rat locomotion," Shan and Mason: https://t.co/N9i4SB1dsW "Dynamic Stochastic Approximation for Multi-stage Stochastic Optimization," Lan and Zhou: https://t.co/7kDqcI9EGG "Sensitivity Analysis for Mirror-Stratifiable Convex Functions," Fadili et al.: https://t.co/zBzUE6OAuI "Accelerated Variance Reduced Stochastic ADMM," Liu et al.: https://t.co/WX1Ko1VHp9 "Recommendation with k-anonymized Ratings," Sakuma and Osame: https://t.co/4RE96zUYQG "Efficient mixture model for clustering of sparse high dimensional binary data," Smieja et al.: https://t.co/U0TQxweMBn "DeepCodec: Adaptive Sensing and Recovery via Deep Convolutional Neural Networks," Mousavi et al.: https://t.co/tqqYokjk3w "Underdamped Langevin MCMC: A non-asymptotic analysis," Cheng et al.: https://t.co/XuTdLg23Qb "Unsupervised robust nonparametric learning of hidden community properties," Langovoy et al.: https://t.co/Go8fAOQQql "Multi-Task Learning Using Neighborhood Kernels," Yousefi et al.: https://t.co/eawLMCOQVG "Initialising Kernel Adaptive Filters via Probabilistic Inference," Castro et al.: https://t.co/K4hjqc2tGu Fin. "An Introduction to the Practical and Theoretical Aspects of Mixture-of-Experts Modeling," Nguyen and Chamroukhi: https://t.co/wjVIbKn1ad "Deep Gaussian Embedding of Attributed Graphs: Unsupervised Inductive Learning via Ranking," Bojchevski+Gunnemann: https://t.co/yK1RWLskm7 "Proximally Guided Stochastic Subgradient Method for Nonsmooth, Nonconvex Problems," Davis and Grimmer: https://t.co/4ivpq4LLd0 "Robust Visual Tracking via Hierarchical Convolutional Features," Ma et al.: https://t.co/lqabDvlF1a "Source-Target Inference Models for Spatial Instruction Understanding," Tan and Bansal: https://t.co/GFqCWraJHf "Catching Zika Fever: Application of Crowdsourcing+ML for Tracking Health Misinformation on Twitter," Ghenai+Mejova: https://t.co/WB0Lg4Nu0U "Fastest Convergence for Q-learning," Devraj and Meyn: https://t.co/YCXnfBsqep "Pixel-variant Local Homography for Fisheye Stereo Rectification Minimizing Resampling Distortion," Zhou et al.: https://t.co/rIK5osqaRK "N-GrAM: New Groningen Author-profiling Model," Basile et al.: https://t.co/rexWOm3gHJ "DeepProf: Performance Analysis for Deep Learning Applications via Mining GPU Execution Patterns," Gu et al.: https://t.co/WCNPRPuFox "Large-scale Multiview 3D Hand Pose Dataset," Gomez-Donoso et al.: https://t.co/KKBbUfrn2l "A Decentralized Multi-Agent Unmanned Aerial System to Search, Pick Up, and Relocate Objects," Bahnemann et al.: https://t.co/hOa0hm596s "Deep Fisher Discriminant Learning for Mobile Hand Gesture Recognition," Xie et al.: https://t.co/5xaLcTYxpW "Structured Sparse Ternary Weight Coding of Deep Neural Networks for Efficient Hardware Implementations," Boo+Sung: https://t.co/vdXCu89fFu "A Deep Learning Approach for Blind Drift Calibration of Sensor Networks," Wang et al.: https://t.co/XeAUdr9fBm "Speaker-independent Speech Separation with Deep Attractor Network," Chen et al.: https://t.co/l1fW0xbv9O "Adversarial Dropout for Supervised and Semi-supervised Learning," Park et al.: https://t.co/gnJ6GTxHZS "Machine Learning for Realistic Ball Detection in RoboCup SPL," Bloisi et al.: https://t.co/zj9xtxNyJc "Elephant Search with Deep Learning for Microarray Data Analysis," Mrutyunjaya Panda: https://t.co/MFmCcjMs7X "Multitask Learning for Fine-Grained Twitter Sentiment Analysis," Balikas et al.: https://t.co/62Vt3Z3MNC "Discriminative Block-Diagonal Representation Learning for Image Recognition," Zhang et al.: https://t.co/PiSX8wN6Bn "Score-informed syllable segmentation for a cappella singing voice with convolutional neural networks," Pons et al.: https://t.co/E4hfxjeH1n "Benchmarking Data Analysis and Machine Learning Applications on the Intel KNL Many-Core Processor," Byun et al.: https://t.co/mpnPtLhfDk "Deep Learning for Sensor-based Activity Recognition: A Survey," Wang et al.: https://t.co/CdadkWKfbz "Creatism: A deep-learning photographer capable of creating professional work," Fang and Zhang: https://t.co/SPaZ8j3E8F "Distributionally Robust Optimization Techniques in Batch Bayesian Optimization," Rontsis et al.: https://t.co/V7HVu7uJpl RT @kchonyc: interesting tutorial at SIGIR'17 https://t.co/loZbpIceKE Fin. "Neural Networks for Information Retrieval," Kenter et al.: https://t.co/pHrT13OrtD "Parsing with Traces: An O(n^4) Algorithm and a Structural Representation," Kummerfeld and Klein: https://t.co/B9QcuX5flW "Learning Features from Co-occurrences: A Theoretical Analysis," Yanpeng Li: https://t.co/1sXxBPJdjH "Visually Profiling Cities from Mobile Device Recorded Movement Data of Millions of City Residents," Shi et al.: https://t.co/JJm5P3Cked "Be Careful What You Backpropagate: A Case For Linear Output Activations & Gradient Boosting," Oland et al.: https://t.co/Ps7H34H7fv "SEA-PARAM: Exploring Schedulers in Parametric MDPs," Arming et al.: https://t.co/2BAmoFlhIi "Do Convolutional Networks need to be Deep for Text Classification?," Le et al.: https://t.co/kM6w14i80e "Disentangling Motion, Foreground and Background Features in Videos," Lin et al.: https://t.co/KoE2JUPZ2z "Automatic Recognition of Deceptive Facial Expressions of Emotion," Ofodile et al.: https://t.co/iplq9D3dHY "Discrete Multi-modal Hashing with Canonical Views for Robust Mobile Landmark Search," Zhu et al.: https://t.co/26xdlFomSu "Large-scale Video Classification guided by Batch Normalized LSTM Translator," Jae Yoo: https://t.co/LEqP7wtzNP "Stable Distribution Alignment Using the Dual of the Adversarial Distance," Usman et al.: https://t.co/Yk1b92yzdO "Constraints, Lazy Constraints, or Propagators in ASP Solving: An Empirical Analysis," Cuteri et al.: https://t.co/youp2yZK1u "Query-Aware Sparse Coding for Multi-Video Summarization," Ji et al.: https://t.co/4cvA1IZl5t "Dependency Injection for Programming by Optimization," Kocsis and Swan: https://t.co/qu0bKGtb3c "Leveraging the Path Signature for Skeleton-based Human Action Recognition," Yang et al.: https://t.co/lvI4mSxFEp "Towards End-to-end Text Spotting with Convolutional Recurrent Neural Networks," Li et al.: https://t.co/HVlMkird0v "Learning Photography Aesthetics with Deep CNNs," Malu et al.: https://t.co/MiSZOKwwHq "Predicting Causes of [Query] Reformulation in Intelligent Assistants," Sano et al.: https://t.co/zfJ84LjJ5G "Automatic Mapping of NES Games with Mappy," Osborn et al.: https://t.co/JDt06cec0t "Negative Sampling Improves Hypernymy Extraction Based on Projection Learning," Ustalov et al.: https://t.co/vAwfOCqAs3 "Unsupervised body part regression using convolutional neural network with self-organization," Yan et al.: https://t.co/6bkGcTboHb "A Formal Framework to Characterize Interpretability of Procedures," Dhurandhar et al.: https://t.co/bAltQtcfR9 "Mechanics Automatically Recognized via Interactive Observation: Jumping," Summerville et al.: https://t.co/cMk8Mpkpzy "A Critique of a Critique of Word Similarity Datasets: Sanity Check or Unnecessary Confusion?," Minh Le: https://t.co/Riza8WFPHO I'm hearing disturbing reports that the new Planet of the Apes movie is good. RT @_nat_en: Uber Releases Open Source Project for Differential Privacy https://t.co/DA0QKo3K7x @AnthroPunk yes, this is what I gathered. @tdietterich So since brilliant is extreme, quite brilliant actually means brilliant, but quite good does not. @tdietterich from what I gather, there may be exceptions but the general rule is for it to strengthen the adjective if extreme, weaken otherwise. @KaiLashArul but it worked out in the end, came back in and clarified re ignorance of UK usage :) @KaiLashArul he def took it as a not good, asked me again "quite?" and i was like yeah, then the room for improvement thing. RT @three_passions: Lady Doctor!! https://t.co/QqX5b3jdcI ("quite good" = US "very good" = UK "meh") Thank you Google, cell service, and people who make graphics about British people for pulling me out of that one. "Me at cafe: ""The short black was quite good btw"" ""Quite? I suppose there's always room for improvement."" *Googles* ""No I actually liked it!""" RT @BraddJaffy: The president has tweeted 6 times in 3 days promoting an event being held at his business—from which he has not divested—wh… @qhardy (though I think the "Musk has big goals and changes his mind" hypothesis=plausible - from AI as nukes to radical decentralization) @qhardy yes I think the Mars and AI things are unrelated @qhardy agreed, there should be skepticism from such quarters (though I personally think the most parsimonious explanation is altruism) @qhardy (and/or I'm totally missing your tone :) ) @qhardy How is it another part of tech? Both OpenAI and Tesla would be affected by any serious AI policy. But I do agree his motives seem altruistic RT @sadmonsters: Every one of Trump's associates is the same undercover detective in increasingly absurd disguises: https://t.co/WousrTyIPx RT @alan_winfield: I think a "Blade Runner law" that makes it illegal to deploy any AI bot - or hardware robot - that poses as a human is e… RT @Yascha_Mounk: Need a reminder of the human cost of dictatorship? All these are journalists who criticized Putin--and died under mysteri… It's So Many PDFs Sunday! RT @squinkyelo: My mom is extremely good at Facebook https://t.co/7hzNuPFIx6 RT @dissruption: "I sell books." versus "I sell whatever the fuck I want." $AMZN https://t.co/j0TTnE7wFc RT @hardmaru: Quirks of the arXiv. Some are quite funny. Krioukov wrote a paper to prove his innocence in "The Proof of Innocence" https://… @AnthroPunk congrats! "RT @Smerity: Don't worry about adversarial attacks on ML just yet - reality's enough of an attack vector! O_o (105mph = 169km/h) https://t.…" Very progressive and timely pick. The 13th Doctor is **drumroll** Skynet. @robmccargow I would put it more gently myself for sure :) @JoshRubin12 shoot me an email and let me know more about your background/interests/views on it! see mail symbol at the top here- https://t.co/LDoKl877oV Working on the verification bit right now, btw, happy to talk to folks interested :) @robmccargow ha, wouldn't say leading, but trying to do my part :-) In both cases, though, similar issues IMO--what developments should be allowed, game-theoretic stuff, verification of agreements/policy etc. Also interesting that he made arg from corporate POV - don't want to get left out. Point more often made re: auton. weapons/national racing. Think I'm making some progress on this but it's tricky :) TL;DR: AI development --> collective action prob on safety bc racing, policy could help. Prob true but soln unclear. https://t.co/vjiGkxdMDz RT @Recode: Elon Musk warns American governors to pro-actively regulate artificial intelligence https://t.co/OY25BcfYab https://t.co/aQhhFR… @mark_riedl @fchollet https://t.co/ED2VQaGko4 TFW you get falsely accused of queue-jumping in the UK... https://t.co/fc8ykCpQey RT @AmericanSoWoke: Citizen, you have 5 seconds to renew your Prime membership. https://t.co/Hqug2Kvn03 RT @mark_riedl: Fuck cancer https://t.co/N7NPvpQtUq "RT @Miles_Brundage: Thoughts on this Chinese DL supercomputing stuff? https://t.co/OxRFQriWGU Paper: https://t.co/IIWHNCa2rw Code: https…" It's Security Saturday! https://t.co/jtfypSgan6 RT @LiYuan6: China had seen this show of cursing anti-revolutionary relatives & thanking the gov't before, like in Cultural Revolution. Now… RT @Reza_Zadeh: Rest In Peace Maryam. You were an inspiration to mathematicians the world over. https://t.co/oVsml0Jr4w RT @DeepMindAI: Distral is a new robust RL algorithm that learns multiple tasks simultaneously and transfers knowledge efficiently https://… @ArtirKel right series, turns out the comment was on part 5. @WesHerche hmm. Hadn't thought of it that way, can just vaguely discern the difference @ArtirKel btw: see Lighthill debate video and the first comment on youtube. @ArtirKel ya but i figured there's a term, besides un/antiposh... @ArtirKel I know the term chav but is that correlated with accent? I can finally distinguish Scottish, posh English, non-posh English, and a few regional Englishes. Brits - what is the opposite of a posh accent? @SmithaMilli it is not unrelated to this - https://t.co/40CQXR5IrR ;) Entering phase 3 of editing... https://t.co/aUzWz8Tsmd RT @jonfildes: Running at the weekend like... https://t.co/skRPZLJ5qP RT @ankurb: Not to miss while at #CFIConf: There's an art exhibition on at the Webb library, on art made with AI. This particu… https://t.c… RT @hardmaru: AWS EC2 launched new G3 instances with NVIDIA M60 GPUs. The g3.16xlarge gets you 4 GPUs + 64 vCPUs + a lot of RAM. https://t.… RT @EBKania: China's deep data pool, computing power, and research talent could enable it to match or beat U.S. in AI. https://t.co/BBiRdUl… @_jyan_ Interesting. CC @EBKania (paper may require access but fair amount of detail in the article) "Thoughts on this Chinese DL supercomputing stuff? https://t.co/OxRFQriWGU Paper: https://t.co/IIWHNCa2rw Code: https://t.co/z2fz7eM8Wj" @BanKillerRobots @80000Hours @icracnet @PAXvoorvrede @Article36 @JodyWilliams97 @NobelWomen Thanks for pointing this out and apologies - CC @robertwiblin @_jyan_ very helpful, thanks! :) @_jyan_ what's the TL;can't read? "RT @j2bryson: The whole day looks good, including RIGHT NOW. I'm on this afternoon #trust #ai #aiethics https://t.co/ozgAwlqsbe" @j2blather maybe general purpose technology in econ. sense? @timhwang was thinking about this the other day "RT @negar_rz: We opened a few new research internship positions at @element_ai. Apply here: https://t.co/TqiJ4vbRer" @john_omalia not sure! Maybe the concept learning one... To be continued... "Evidence for eligibility traces in human learning," Lehmann et al.: https://t.co/geD9BNtLr1 "Kafnets: kernel-based non-parametric activation functions for neural networks," Scardapane et al.: https://t.co/fz8bkvNwFU "Foolbox v0.8.0: A Python toolbox to benchmark the robustness of machine learning models," Rauber et al.: https://t.co/SPunaRb5fS "Prediction and Control with Temporal Segment Models," Mishra et al., Berkeley/OpenAI (revised): https://t.co/BbIDrLcYrk "Autoencoder-augmented Neuroevolution for Visual Doom Playing," Alvernaz and @togelius: https://t.co/OQ9bq1jfwP "Representation Learning for Grounded Spatial Reasoning," Janner et al.: https://t.co/m2O6Y3sXtK "Quasar: Datasets for Question Answering by Search and Reading," Dhingra et al.: https://t.co/dJPh2RKmKe "Distral: Robust Multitask Reinforcement Learning," Teh et al., DeepMind: https://t.co/vVA8wGowex "Deep Learning with Topological Signatures," Hofer et al.: https://t.co/hZ8TXneJjx RT @Gregory_C_Allen: Our report on #AI and National Security was published by @Harvard @BelferCenter https://t.co/qkqOH0mzJX #cyber #AIno… "A Brief Study of In-Domain Transfer and Learning from Fewer Samples using A Few Simple Priors," Pickett et al.: https://t.co/oesZvHP7e3 arXiv papers, July 14 - "Merge or Not? Learning to Group Faces via Imitation Learning," He et al., SenseTime: https://t.co/jUbubXyHIO RT @Salavon: Seinfeld to Family Guy snippet. gan/autoencoder hybrid (discriminator & z recovery loss) https://t.co/Z2PZxFd8pr Great conversations at #CFIConf - lots of new research ideas brewing, and motivation to wrap up existing ones! @GrahamStarr could make for a good submission to @timhwang's journal... "RT @robmccargow: Credit to @LeverhulmeCFI for an impressive 40.6% female panellist representation at their #CFIConf #WomenInAI #HeForShe #A…" ⬇️⬇️⬇️ https://t.co/sFTAE8ZP8E RT @Annaleen: Ravens have learned how to barter. I welcome our snarky, feathered overlords. https://t.co/fP7Xe5b04D RT @ericjang11: Research Blog:Using Deep Learning to Create Professional-Level Photographs. This is amazing. https://t.co/cZf1eAOf0i via @g… Reading - "Challenges for [AI] Transparency" by @adrian_weller: https://t.co/chcDHIZjtN @aprilaser @Slate congrats! RT @skaasj: Imitation from Observation! Very important advance in imitation learning https://t.co/1mOsZcieFC Stuart Russell recommends The Machine Stops as v. early sci-fi illustration of (Wall-E-esque) human enfeemblement risk - agreed! #CFIConf RT @erichorvitz: MSR AI brings together top talent in AI subdidciplines to pursue key aspirations https://t.co/DASH90Sb6X @MSFTResearch @Re… When leaders in AI called autonomous weapons "Kalashnikovs of tomorrow" in open letter, not sure they meant this... https://t.co/sB7j3KgpFP RT @serkancabi: Our latest agent design is out. It attempts a task and learn from all the other possible goals incidentally accomplished al… TIL "lad" roughly = "bro": https://t.co/qX77qDvuFp RT @rbhar90: New paper with @vijaypande lab and Merck Collaborators: "Is Multitask Deep Learning Practical for Pharma?" https://t.co/139z8D… "RT @markus_with_k: Learning for multiple tasks/goals in parallel. Recent work by @DeepMindAI and @OpenAI https://t.co/DPMbuBwkBD https://t.…" RT @LeverhulmeCFI: CFI Conference - Live Stream https://t.co/sehcKSe9wl @marnovo which of course doesn't mean the work isn't valuable (that was my original point :) ) @marnovo good luck - for what it's worth, I'm v. skeptical (+ to be clear, I meant trying to beat the best algorithm across all games, not just one) @marnovo by whom? DeepMind with their jargon again... https://t.co/danfH9E4eG (sidenote: that's a common theme. Atari's good as a sanity test for new ideas, but don't bother trying to beat DeepMind on raw scores) To be continued... "Value Prediction Network," Oh et al.: https://t.co/yq2AqQn36N (Atari results nothing to write home about but conceptually interesting) "NO Need to Worry about Adversarial Examples in Object Detection in Autonomous Vehicles," Lu and Sibai et al.: https://t.co/UhM6tSF7Nd arXiv papers, July 13 - "Learning Macromanagement in StarCraft from Replays using Deep Learning," Justesen and Risi: https://t.co/ngKu3jyWDU @robinsloan @hardmaru @mtyka @archillect + 💯 @jmac_ai same! RT @jmac_ai: @Miles_Brundage I very much feel this way. Much of my life and philosophy is informed by what we've learned in AI research. The book Algorithms to Live By is a good/successful example of efforts to make CS relevant, though not AI-specific. RT @mark_riedl: Facebook call for proposals on dialogue research https://t.co/cN55YLQtZA @tsimonite @bradplumer see also: chapter in Robot Futures by Illah Nourbkhash (sp) about other forms of disruption Another difference: https://t.co/8B8jGhqoAo Seems legit. https://t.co/GwOrtsnIzy Big disanalogy: Cherry complains about philosophy paper paywalls, not an issue for AI. I think AI is also of broad relevance, beyond just people being able to write/run programs - important concepts re: human/agent predicament. Ofc, math/rigor needed for internal purposes, but Cherry makes good pts about lack of clear explanations as barrier to impact. (from Myisha Cherry's chapter) Rigor-->math, philosophy-->AI? https://t.co/T2zNvmFWda @rivatez @ankurhandos (of course philo is relevant to everyone, but I meant there are themes relevant to other disciplines too, eg impact) @rivatez @ankurhandos it's great so far, + relevant to non-philos. May tweet some thoughts about it when have read more RT @romanyam: Fake news are about to become much faker ... https://t.co/nLSbaFnL15 @rivatez too 1337. Found it at a bookstore in Edinburgh, think it just came out. 👍 https://t.co/T7ZEn5YCKL RT @KaiLashArul: Fantastic idea to help improve reproducibility in DL! https://t.co/q9pcP0c3eQ RT @shakir_za: Africans must be part of the coming advances in ML. This is our vision for .@DeepIndaba. Share your thoughts with us. #Afric… Productivity hack: forget for a few weeks that Netflix exists. Not very scalable, though. @KaiLashArul instead of (/in addition to) algo name, search repository/class etc name? "async-rl learning rate" on Google found - https://t.co/kyN7jwntY9 @L_badikho That'd be great! RT @goodfellow_ian: NIPS 2017 adversarial examples challenge: https://t.co/g0Nt8BxefX Test your defenses against others' adversarial exampl… @KaiLashArul Reddit+Github+...? :) "import RedditTrawler as rt // finds hyperparameters on Reddit https://t.co/rO7Uq6r0H8" Women, minorities, and other underrepresented groups are especially encouraged to apply. Come work on fun/important topics w/ great folks! FHI is soliciting applications for (Senior) Research Fellows 2 investigate big picture Qs re future of humanity+AI: https://t.co/1h72JYGkWI @deontologician thanks! @_jyan_ should be easier :) @_jyan_ would prefer sooner, long time from now ;) I have several for end of 2017, made 7 months ago, u could forecast last 5 months, - @_jyan_ I like your precision though in any case :) @_jyan_ maybe make shorter term predictions to test your calibration? As I've said before, that seems narrow... To be continued... "The Intentional Unintentional Agent: Learning to Solve Many Continuous Control Tasks Simultaneously"-Cabi et al, DM https://t.co/PZXB55PLoD "Learning to Imitate Behaviors from Raw Video via Context Translation," Liu and Gupta et al., Berkeley/OpenAI: https://t.co/jyaD7PPXaJ "Meta-Learning with Temporal Convolutions," Mishra and Rohaninejad et al., Berkeley/OpenAI: https://t.co/ols1NKY8cI "Learning Visual Reasoning Without Strong Priors," Perez et al., MILA etc.: https://t.co/1wW8A0efJz "A step towards procedural terrain generation with GANs," Beckham and Pal: https://t.co/0XSFODpKGy "Learning like humans with Deep Symbolic Networks," Zhang and Sornette, ETH: https://t.co/OkLHKmtmzI "Learning Heuristic Search via Imitation," Bhardwaj et al., CMU: https://t.co/Y5XwM44oWC arXiv papers, July 12 - SCAN: Learning Abstract Hierarchical Compositional Visual Concepts," Higgins et al, DeepMind https://t.co/KVQ0UdRZEd Going to start the Wednesday papers thread now as I want to get out of the habit of merging days. Plan to finish yesterday's. We'll see... or the OpenAI ones...or the Servey Levine ones. 😑 TFW you can't even keep up with just the DeepMind papers this week 😬 RT @demishassabis: Humbled and honoured by what Ke Jie had to say about his #AlphaGo experience in a recent interview: https://t.co/ohlCgAT… RT @demishassabis: Congratulations to the brilliant Ke Jie on his win at National Games of China - on an amazing 20-game winning streak sin… It *sounds* epic but I had my hopes dashed by a very similar expertise/book topic pair very recently (Levesque book on GOFAI). Wanted: review of this book on AI/hardware by editor (w Hinton back in day) of Parallel Models of Associative Memory https://t.co/EfqXxi8TKA My accidental whirlwind journey today is finished (Edinburgh-->London-->Oxford-->Cambridge). Settled in Cam. for @LeverhulmeCFI conference! Fin. @Aelkus @gwern yes, though one could read this paper as suggesting value in big generic datasets, then finetune w small on prob of interest (i.e. that those with the most data will have the best AI) Other stuff matters, too. Point being: data matters, and a lot of data labeling still needs to be done, but this doesn't really support a data-terministic view... In that world, it may make sense to use diff. privacy etc. to aggregate data across a bunch of firms/orgs to get MOAR but not just 2-3 orgs. At that point, even doubling doesn't help all that much for these sort of scaling rates, and algos, compute etc. are differentiators again. Now, imagine we are at the point, or get to the point, where adding another order of mag. is infeasible bc $/useless bc compute limits... However, an order of mag. is a lot, and not enough Turkers in the world (yet) to go much further, so the web stuff and other tricks are key. Another point: there are several more magnitudes to go! This is hardly all the data Google could label. But, per Gwern, need compute (etc.). Also, this makes me a bit more bullish about webly-supervised learning: low label quality didn't change the fact that much more data helped. First of all, as usual, @gwern had some nice commentary, emphasizing the continued importance of hardware... https://t.co/EPaxEKWFvm https://t.co/w3cFlkll4Z Few quick thoughts on this paper - the headline is of course that data matters, but other possible takeaways, too. https://t.co/Xb39XvvKIt RT @iamtrask: If you're in London on the 24th, I'll be talking on Homomorphically Encrypted DL & Decentralized Training Apps https://t.co/h… RT @googleresearch: Does the success of #DeepLearning in computer vision scale with the size of the training dataset? Find out at https://t… *not actually a GAN though @srbutner bc there isn't enough on the Internet obv @gwern thanks, I hadn't looked carefully. RT @gwern: @Miles_Brundage I don't think it's a GAN but an adversarial optimizer/style transfer thing, based on https://t.co/gR7usSO7sj Generative Adversarial Naughtiness - GAN that generates porn-looking images (NSFW). https://t.co/D1BU7Cyktq @HaydnBelfield intro'd is what I've seen most I think RT @vkrakovna: Hopes and fears of AI researchers in probabilities - an excellent visualization by @KatjaGrace https://t.co/t80Kku1iIi via @… RT @tcwittes: Remember: https://t.co/wvedOmifHN https://t.co/CrdwVkaYR4 @_jyan_ @gosainnn not super familiar with their papers but seem decent at least @_jyan_ @gosainnn also was smaller. If SenseTime really 500, that's like DM today. Could be good deal even if lower quality than DM @_jyan_ @gosainnn doesn't seem crazy high to me @_jyan_ @gosainnn even if it were just 100 researchers sitting in a room, though, that's the same order of mag. as DeepMind when bought @gosainnn dunno. But they publish a pretty decent amount, wouldn't be surprised by 100+ researchers. cc @_jyan_ @KaiLashArul 👍 RT @KaiLashArul: NoisyNet-A3C (with LSTM) implemented in @PyTorch: https://t.co/rkIx793Acf. Glad to see the end of entropy maximisation! Se… This valuation isn't just a face recognition thing but AI skill thing - SenseTime has published a lot, inc. at NIPS: https://t.co/DqDn0wJ5rT @j2bryson I'll be there as well, see you then! @levendowski @katecrawford @mer__edith many thanks also for the great live tweets! :) RT @weballergy: 'we find that the performance on vision tasks still increases linearly with orders of magnitude of training data size': int… RT @SmithaMilli: Co-organizing Reliable ML workshop at ICML, submission deadline is July 17! https://t.co/S0CR2lYKmx Feel free to reach out… To be continued... "Vision-Based Multi-Task Manipulation 4 Inexpensive Robots Using End-To-End Learning from Demo.," Rahmatizadeh et al https://t.co/GPptlB3hFm @mark_riedl but that's if it were in the same units/chart as physics...would be fun to have an intra-AI chart. @mark_riedl I'd say most of it is in the basic physics vicinity, +/- a bit, on the X axis, but varies a lot by sub-area/presentation on the Y axis...? "Don't Avoid T A M A This T E Relevant paper S https://t.co/HzZNKa3rBi" That paper is 🔥🔥🔥🔥🔥🔥🔥 arXiv papers, July 11 - "Revisiting Unreasonable Effectiveness of Data in Deep Learning Era," Sun et al., Google/CMU https://t.co/WyUE1PqHv2 Follow @levendowski for live tweets of AI Now (now) and other good stuff (later). Fin. "Non-smooth Non-convex Bregman Minimization: Unification and new Algorithms," Ochs et al.: https://t.co/YpEmcRCOco "Sampling of Temporal Networks: Methods and Biases," Rocha et al.: https://t.co/loVxteCAu6 "Matrix-Based Characterization of the Motion and Wrench Uncertainties in Robotic Manipulators," Sovizi et al.: https://t.co/7s9DjE5uYQ "A Probabilistic Calculus of Cyber-Physical Systems," Lanotte et al.: https://t.co/5TPGnUrKyp "Model for Explaining Citations in Scholarly Publications: A Conceptual Overview of the Lit.," Tahamtan and Bornmann https://t.co/mjgHAjBbXN "Text Summarization Techniques: A Brief Survey," Allahyari et al.: https://t.co/NKF6SdAXEx (Barone and Sennrich) "A parallel corpus of Python functions + documentation strings for automated code documentation + code generation": https://t.co/6cueLJfe9P "Fair Personalization," Celis and Vishnoi: https://t.co/HV87w2UgNz "Journal of Open Source Software (JOSS): design and first-year review," Smith et al.: https://t.co/E3R8ycNrBz "Data-Driven Robust Control for Type 1 Diabetes Under Meal and Exercise Uncertainties," Paoletti et al.: https://t.co/6kCXdF7HIh "Generative Adversarial Models for People Attribute Recognition in Surveillance," Fabbri et al.: https://t.co/FdoFphkfWB "The 2017 Hands in the Million Challenge on 3D Hand Pose Estimation," Yuan et al.: https://t.co/P8BCW9xoHb "Computational Models of Tutor Feedback in Language Acquisition," Nevens and Spranger: https://t.co/8DK2GqOFY4 "A multi-layer image rep. using Regularized Residual Quantization: app. to compression+denoising," Ferdowsi et al.: https://t.co/xLFDdpOhRJ "Syntactic Markovian Bisimulation for Chemical Reaction Networks," Cardelli et al.: https://t.co/Z2f7PFVpCl "SigNet: Convolutional Siamese Network for Writer Independent Offline Signature Verification," Dey et al.: https://t.co/eX4drU6I8i "Sparse Approximation of 3D Meshes using the Spectral Geometry of the Hamiltonian Operator," Choukroun et al.: https://t.co/e4yeESqBmT "Deep Discrete Hashing with Self-supervised Pairwise Labels," Song et al.: https://t.co/SK2lCJY37o "A spatiotemporal model with visual attention for video classification," Shan and Atanasov: https://t.co/nbtS7c4Yof "Image Segmentation Algorithms Overview," Yuheng and Hao: https://t.co/DlniShiRbY "InferSpark: Statistical Inference at Scale," Zhao et al.: https://t.co/7WT1Bk1Vaj "A Tutorial on Thompson Sampling," Russo et al.: https://t.co/eT6OSFXREc "Automatic Classification of Bright Retinal Lesions via Deep Network Features," Sadek et al.: https://t.co/BVweI3LERM "On the Compactness, Efficiency, and Representation of 3D CNNs: Brain Parcellation as a Pretext Task," Li et al.: https://t.co/tPxl0cKxuR "A Generalised Seizure Prediction w/ CNNs 4 Intracranial and Scalp Electroencephalogram Data Analysis," Truong et al https://t.co/alm7SmB8SM "Well-Founded Operators for Normal Hybrid MKNF Knowledge Bases," Ji et al.: https://t.co/rEYgZO13oI "MPG - A Framework for Reasoning on 6 DOF Pose Uncertainty," Feiten and Lang: https://t.co/guyVMcQd8u "Graph Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting," Li et al.: https://t.co/CQ0sxEpoFT "Event Schema Induction using Tensor Factorization with Back-off," Nimishakavi and Talukdar: https://t.co/sH7fYIo9y8 "Deep Character-Level Click-Through Rate Prediction for Sponsored Search," Edizel et al.: https://t.co/Lfpst1J3WI "AMIDST: a Java Toolbox for Scalable Probabilistic Machine Learning," Masegosa et al.: https://t.co/8e33VCLJCb "Simple Classification using Binary Data," Needell et al.: https://t.co/SvvTcwDIcj "Exhaustive search for sparse variable selection in linear regression," Igarashi et al.: https://t.co/PWGtyevHau @starsandrobots too anthropomorphic for my tastes. would def lose in a gunfight to mine due to associated inefficiencies @ethanchiel @hardmaru a suicide-evoking emoji is apt in that context... "⠀ ⠀ ⠀ 🤖 　 Robot sheriff on duty. 🤖 🤖 🤖 🤖　🤖 🤖 👇 🤖 🤖 👇 　 🤖 🤖 　 🤖　 🤖 　 👢 👢" RT @martinzapfe: We @CSS_Zurich @eth_en are hiring a senior researcher on 'governance of emerging security technologies' - apply here https… RT @wattenberg: Delighted to announce PAIR: People + AI Research initiative. Let's add HCI and design to classic machine learning! https://… @y0b1byte not sure, will check out, thx! Also note the big role of generative adversarial imitation learning (GAIL) by Ho and Ermon, getting a shout out in 2/3 abstracts. Note there are 2 new sim robotics papers on arxiv from DM and one not yet up - see post 4 summaries/link to latter - https://t.co/hYMONporKe RT @DeepMindAI: Three new papers on learning flexible motor skills in simulated environments https://t.co/wdGfxkE79t https://t.co/eIH1Olnjsp Very important list of fictional bears. https://t.co/LBr5uY0Xg0 Very important list of animals with fraudulent diplomas. https://t.co/cjynfNlOc1 RT @ShaneLegg: I have to admit, I've become quite attached to these little walkers :-) The obstacles they learn to overcome are really ama… @y0b1byte sadly out of town this week! enjoy. To be continued... "Learning Loss Functions for Semi-supervised Learning via Discriminative Adversarial Nets," dos Santos et al., IBM: https://t.co/fZD6RIzckw "A Nested Attention Neural Hybrid Model for Grammatical Error Correction," Ji et al., Microsoft: https://t.co/tLN0m2zefs "Long-Term Memory Networks for Question Answering," Ma et al., SUNY/Linkedin/PARC/etc.: https://t.co/xjiOEBNjp2 "A causal framework for explaining the predictions of black-box sequence-to-sequence models," Alvarez-Melis+Jaakola: https://t.co/3rDqt7H58X "Zero-Shot Deep Domain Adaptation," Peng et al., Siemens: https://t.co/NTFd6AfUGU "Transferring End-to-End Visuomotor Control from Simulation to Real World for a Multi-Stage Task," James et al., ICL https://t.co/hAJKK31smk "End-to-End Learning of Semantic Grasping," @ericjang11 et al. at Google/Google Brain/X: https://t.co/FcBxIUQJzp TL;DR/W: The Frankenstein baby of AlphaGo, hierarchical RL, and GAIL/GANs - learn low level actions from human mo-cap, learn high level w RL Video abstract: https://t.co/9MiPKiCPJs (lots of related videos linked to in the paper, but that'll give you the gist) "Learning human behaviors from motion capture by adversarial imitation," Merel et al., DeepMind: https://t.co/T45akuHUpW Video: https://t.co/lYHu3TkjFa arXiv papers, July 10 - "Emergence of Locomotion Behaviours in Rich Environments," Heess et al., DeepMind: https://t.co/A7r3ZJskSp RT @ericjang11: 3/ Think picking & placing diverse widgets in a warehouse by category (tool, toy, shovel), where widget instances haven't b… RT @ericjang11: 2/ TL;DR: ext. of prior work with parallel robotic learning of grasping, except now we teach them to pick up a user-command… RT @ericjang11: Excited to share our new paper from Google Brain Robotics! End-to-end Learning of Semantic Grasping https://t.co/DkLKzYOVrA… Fin (for last week). "When the Optimum is also Blind: a New Perspective on Universal Optimization," Adamczyk et al.: https://t.co/HfKm1dsdH7 "On the Role of Text Preprocessing in NN Architectures," Camacho-Collados and Pilehvar: https://t.co/caGUXB5l5b "Tensor-Train Recurrent Neural Networks for Video Classification," Yang et al.: https://t.co/waN8RkT0CR "Embodied Flight with a Drone," Cherpillod et al.: https://t.co/GxW4yMB8D8 (people using a drone suit-table thing to fly drone fly better) "Data Analytics on Online Labor Markets: Opportunities and Challenges," Feldman et al.: https://t.co/16hGFIFkkN "A Simple Approach to Learn Polysemous Word Embeddings," Sun et al.: https://t.co/N4oTeBzjdL "Simultaneous Optimization of Neural Network Weights and Active Nodes using Metaheuristics," Ojha et al.: https://t.co/T1NVuzDhOG Interesting - "Climbing the Kaggle Leaderboard by Exploiting the Log-Loss Oracle," Jacob Whitehill: https://t.co/IhFh3IKqAs "Single-Queue Decoding for Neural Machine Translation," Shu and Nakayama: https://t.co/zfwNbzlUlI "Efficient Strategy Iteration for Mean Payoff in Markov Decision Processes," Křetínský + Meggendorfer: https://t.co/IRhfjaAKYc "Achieving Secure and Differentially Private Computations in Multiparty Settings," Acar et al.: https://t.co/MQH7fJ9PC1 "Calibrated Fairness in Bandits," Liu et al.: https://t.co/Im3PnEJ3Us "Informed Asymptotically Optimal Anytime Search," Gammell et al.: https://t.co/l8ineIONtF "An Interactive Tool for Natural Language Processing on Clinical Text," Trivedi et al.: https://t.co/OVhSrnHQgg "Trust-PCL: An Off-Policy Trust Region Method for Continuous Control," Nachum et al.: https://t.co/PKGsLgyIHX "RIDDLE: Race and ethnicity Imputation from Disease history with Deep LEarning," Kim and Rzhetsky: https://t.co/vLmDZfQZIc "Gaussian Processes Semantic Map Representation," Jadidi et al.: https://t.co/x6iSFxVPPg "Information-gain computation," Anthony Di Franco: https://t.co/n0UTgRX06z "A Deep Network with Visual Text Composition Behavior," Hongyu Guo: https://t.co/Ys3knH8WfQ "Fairness at Equilibrium in the Labor Market," Hu and Chen: https://t.co/Qpkl5nEI1W "Multimedia Semantic Integrity Assessment Using Joint Embedding Of Images And Text," Jaiswal et al.: https://t.co/JSO6gU9Bbf "SSGAN: Secure Steganography Based on Generative Adversarial Networks," Shi et al.: https://t.co/y9WKmv3LAc "Cross-Lingual Sentiment Analysis Without (Good) Translation," Abdalla and Hirst: https://t.co/gPysMkKv09 "PathRec: Visual Analysis of Travel Route Recommendations," Chen et al.: https://t.co/WmIvZJLh4p "RON: Reverse Connection with Objectness Prior Networks for Object Detection," Kong et al.: https://t.co/91VzWFCOEC "Generalized Task-Parameterized Movement Primitives," Huang et al.: https://t.co/N9ikRRCbX7 "Automated Lane Detection in Crowds using Proximity Graphs," Heldens et al.: https://t.co/hbDggMP3oz "Context Aware Document Embedding," Zhu and Hu: https://t.co/WzhyN09j7r "Parallel Particle MCMC with Poisson Resampling," Miasodejow et al.: https://t.co/Ivu0d5Xrtz "Convergence Analysis of Optimization Algorithms," Kim et al.: https://t.co/BTC0ssJeis "Indefinite Kernel Logistic Regression," Liu et al.: https://t.co/9408m16HYp "Nonparametric Marginal Analysis of Recurrent Events Data under Competing Risks," Bowen Li: https://t.co/DinTV8nseW "A Data Science Approach to Understanding Residential Water Contamination in Flint," Chojnacki et al.: https://t.co/LT8VLdi7fo "Early stopping for kernel boosting algorithms: A general analysis with localized complexities," Wei et al.: https://t.co/3tINi1Vvwm "Statistical comparison of (brain) networks," Fraiman and Fraiman: https://t.co/oLfADhbICc "Graph Based Recommendations: From Data Representation to Feature Extraction and Application," Tiroshi et al.: https://t.co/NHBVEKfyzA "Laplacian-Steered Neural Style Transfer," Li et al.: https://t.co/cJckbWmyeg "Multiple Range-Restricted Bidirectional Gated Recurrent Units with Attention for Relation Classification," Kim+Lee: https://t.co/b3zX3kiVbs "Learning-based Image Enhancement for Visual Odometry in Challenging HDR Environments," Gomez-Ojeda et al.: https://t.co/Wxf7TgQrbt "Combining Forward and Backward Abstract Interpretation of Horn Clauses," Bakhirkin and Monniaux: https://t.co/nAyfqp6hSv "SADA: A General Framework to Support Robust Causation Discovery with Theoretical Guarantee," Cai et al.: https://t.co/JgdBnOc0UK "R-PHOC: Segmentation-Free Word Spotting using CNN," Ghosh and Valveny: https://t.co/5eVteqADFj "Learning to Design Games: Strategic Environments in Deep Reinforcement Learning," Zhang et al.: https://t.co/uR9FXJtRX1 "Benchmarking Denoising Algorithms with Real Photographs," Plotz and Roth: https://t.co/C004AS9owt "Robust Multi-Image HDR Reconstruction for the Modulo Camera," Lang et al.: https://t.co/CnbWHOGxlQ "A dataset for Computer-Aided Detection of Pulmonary Embolism in CTA images," Masoudi et al.: https://t.co/KqyQApsiRI "Automated Experiment Design for Data-Efficient Verification of Parametric MDPs," Polgreen et al.: https://t.co/vaLAF0cOul "Web Video in Numbers - An Analysis of Web-Video Metadata," Rossetto and Schuldt: https://t.co/YzU1E9csEK "Align and Copy: UZH at SIGMORPHON 2017 Shared Task for Morphological Reinflection," Makarov et al.: https://t.co/FdsuudIvY7 "Improving Content-Invariance in Gated Autoencoders for 2D and 3D Object Rotation," Lattner + Grachten: https://t.co/LW60FtQdlO "An Attention Mechanism for Answer Selection Using a Combined Global and Local View," Bachrach et al.: https://t.co/U0wyJPZGWV "Towards lightweight convolutional neural networks for object detection," Anisimov and Khanova: https://t.co/LSqDwbmss3 "AlignGAN: Learning to Align Cross-Domain Images with Conditional Generative Adversarial Networks," Mao et al.: https://t.co/kPNh52EYtE "Video Representation Learning + Latent Concept Mining 4 Large-scale Multi-label Video Classification," Huang et al https://t.co/rOSgCsdVNX "Efficient Approximate Query Answering over Sensor Data with Deterministic Error Guarantees," Brito et al.: https://t.co/83qWBNLB7T "Machine Learning, Deepest Learning: Statistical Data Assimilation Problems," Abarbanel et al.: https://t.co/mJTu6d7R78 "SHADHO: Massively Scalable Hardware-Aware Distributed Hyperparameter Optimization," Kinnison et al.: https://t.co/y925yyU4BD "Theory of the superposition principle for randomized connectionist representations in NNs," Frady et al.: https://t.co/7TMycMriKk "The Complex Negotiation Dialogue Game," Romain Laroche et al.: https://t.co/ubIoggSd0X "Convolutional 2D Knowledge Graph Embeddings," Dettmers et al.: https://t.co/p3sDI7Wfux "Like trainer, like bot? Inheritance of bias in algorithmic content moderation," Binns et al.: https://t.co/ndLOEIUNYw "Creative Robot Dance with Variational Encoder," Augello et al.: https://t.co/wvmG0SGX42 "Hidden-Markov-Model Based Speech Enhancement," Dzibela and Sehr: https://t.co/eq7wzddD6s "Kernel Scaling for Manifold Learning and Classification," Lindenbaum et al.: https://t.co/lLC8nGKlFC "LittleDarwin: a Feature-Rich + Extensible Mutation Testing Framework for Large+Complex Java Systems," Parsai et al https://t.co/7uY3VgqJQM "Analysis of the Rising Threat of Subverting Privacy Technologies," Craig Ellis: https://t.co/4IXzjwV5Wy "Interpretable & Explorable Approximations of Black Box Models," Lakkaraju et al.: https://t.co/cx90NxuaIL "Stochastic, Distributed and Federated Optimization for Machine Learning," Jakub Konečný (thesis): https://t.co/m6uU0KW6Nz "UPSET and ANGRI: Breaking High Performance Image Classifiers," Sarkar et al.: https://t.co/8m9DV8SnIb "Shakespearizing Modern Language Using Copy-Enriched Sequence-to-Sequence Models," Jhamtani et al.: https://t.co/540kx340Cu "Publish or impoverish: An investigation of the monetary reward system of science in China (1999-2016)," Quan et al. https://t.co/elcS94rbL1 "Unsupervised Submodular Rank Aggregation on Score-based Permutations," Qi and Tejedor: https://t.co/BhwUuO4RdV "CharManteau: Character Embedding Models For Portmanteau Creation," Gangal et al.: https://t.co/LSNVHl3UVS "Complexity Metric for Code-Mixed Social Media Text," Ghosh et al.: https://t.co/5wmkAjb2Ho (will tweet em after I finish the end of last week's papers soon) Some fun DeepMind locomotion papers today ==> Silly Walk Sunday! "Sentiment Identification in Code-Mixed Social Media Text," Ghosh et al.: https://t.co/UO4r2QPQYx "More Flexible Diff. Privacy: The Application of Piecewise Mixture Distributions in Query release," Smith et al.: https://t.co/9aJSdd5QF8 "A Survey of Recent Advances in CNN-based Single Image Crowd Counting and Density Estimation," Sindagi and Patel: https://t.co/AFlaKkjhL0 "The Complexity of Human Computation: A Concrete Model with an Application to Passwords," Blum and Vempala: https://t.co/hYqJv00gM7 "Data-Driven Sparse Structure Selection for Deep Neural Networks," Huang and Wang: https://t.co/s6Wt6RAtYY "Like What You Like: Knowledge Distill via Neuron Selectivity Transfer," Huang and Wang: https://t.co/xnNApZmybT "DarkRank: Accelerating Deep Metric Learning via Cross Sample Similarities Transfer," Chen et al.: https://t.co/WrWjhU4xu2 "Copy-move Forgery Detection based on Convolutional Kernel Network," Liu et al.: https://t.co/boeWCA1c1l "R-Rec: A rule-based system for contextual suggestion using tag-description similarity," Singh et al.: https://t.co/bGIvhadei9 "Adversarial Representation Learning for Domain Adaptation," Shen et al.: https://t.co/pN0tFjfOH1 "ProtoDash: Fast Interpretable Prototype Selection," Gurumoorthy et al.: https://t.co/O09r3jkfXG "Complex and Holographic Embeddings of Knowledge Graphs: A Comparison," Trouillon and Nickel: https://t.co/nvKbYBAJzp "Label Organized Memory Augmented Neural Network," Shankar and Sarawagi: https://t.co/7N6prMSOfg "Model compression as constrained optimization, w/ app to neural nets- Part I: general framework," Carreira-Perpiñán https://t.co/Qdb4s6y9Y3 "Estimating the Fundamental Limits is Easier than Achieving the Fundamental Limits," Jiao et al.: https://t.co/2DMihO0ygo "A note on the impossibility of 'fairness,'" @ThomasMiconi: https://t.co/nF8g6lAo3F "Machine Learning Tests for Effects on Multiple Outcomes," Ludwig et al.: https://t.co/Iz28DApkfL "Loss impresses human beings more than gain in the decision-making game," Shen and Jiang: https://t.co/WxgvQFag1M "Cerebellar-Inspired Learning Rule for Gain Adaptation of Feedback Controllers," Herreros et al.: https://t.co/gXTBevXCbd "Regression Phalanxes," Zhang et al.: https://t.co/Siy2THAiWl "Robust Optimization for Non-Convex Objectives," Chen et al.: https://t.co/qiCy9327Cs "A simple efficient density estimator that enables fast systematic search," Wells and Ting: https://t.co/jbkz0V5UmC "Appearance invariance in convolutional networks with neighborhood similarity," Tasdizen et al.: https://t.co/J7FXkeREbk "Discriminatory Transfer," Lan and Huan: https://t.co/8aJsOd7l9U "Automated Problem Identification: Regression vs Classification via Evolutionary Deep Networks," Dufourq and Bassett https://t.co/R8VydTcOOU "Causal Consistency of Structural Equation Models," Rubenstein et al.: https://t.co/Ps19H4YvIp "Learning to Avoid Errors in GANs by Manipulating Input Spaces," Alexander Jung: https://t.co/sesQLpz5rZ "Learning Deep Energy Models: Contrastive Divergence vs. Amortized MLE," Liu and Wang: https://t.co/6Xqkfk470I "Structured Black Box Variational Inference for Latent Time Series Models," Bamler and Mandt: https://t.co/vz5N46wJMB "Zero-Shot Fine-Grained Classification by Deep Feature Learning with Semantics," Li et al.: https://t.co/NdSVSOaY41 "Visualizing the Consequences of Evidence in Bayesian Networks," Champion + Elkan: https://t.co/7Usl9tQsK4 "Arabic Character Segmentation Using Projection Based Approach with Profile's Amplitude Filter," Mousa et al.: https://t.co/q7UjUEKj9t "Deep Representation Learning with Part Loss for Person Re-Identification," Yao et al.: https://t.co/00bSBjwYo5 "Aggregating Frame-level Features for Large-Scale Video Classification," Chen et al.: https://t.co/yxEaT3Z6ke "Selective Deep Convolutional Features for Image Retrieval," Hoang et al.: https://t.co/Gx3d69vIVw "One-Shot Fine-Grained Instance Retrieval," Yao et al.: https://t.co/pKjiKz8ZAb "Spatial and Angular Resolution Enhancement of Light Fields Using Convolutional Neural Networks," Gul/Gunturk: https://t.co/wZ2UfbeCdO "The Maximum Cosine Framework for Deriving Perceptron Based Linear Classifiers," Bshouty et al.: https://t.co/iKaKHGMYGk "Learning Human Pose Models from Synthesized Data for Robust RGB-D Action Recognition," Liu and Mian: https://t.co/9MLPBBtf1o "Conditional generation of multi-modal data using constrained embedding space mapping," Chaudhury et al.: https://t.co/rZYmyDGwH7 "XBadges: Identifying and training soft skills with commercial video games," Alloza et al.: https://t.co/12PbCf2PL5 "Identification of non-linear behavior models with restricted or redundant data," Carbillet et al.: https://t.co/0NHZLn30cM "Optimization Beyond the Convolution: Generalizing Spatial Relations with End-to-End Metric Learning," Jund et al.: https://t.co/DpjosbzOGC "Multilingual Hierarchical Attention Networks for Document Classification," Pappas and Popescu-Belis: https://t.co/XtkBJWQPXo "Window-of-interest based Multi-objective Evolutionary Search for Satisficing Concepts," Farhi+Moshaiov: https://t.co/e2UiN0wcUr "Characterizing videos, audience and advertising in Youtube channels for kids," Araujo et al.: https://t.co/v551mR0Vu7 "Automatic estimation of harmonic tension by distributed representation of chords," Nikrang et al.: https://t.co/rJTPeYPK09 "An empirical study on the effectiveness of images in Multimodal Neural Machine Translation," Delbrouck and Dupont: https://t.co/eo8iE1voGz "Logically automorphically equivalent knowledge bases," Aladova and Plotkin: https://t.co/6ga8iUzK1b "Skeleton-aided Articulated Motion Generation," Yan et al.: https://t.co/OPTkBctZJS "Maintaining cooperation in complex social dilemmas using deep reinforcement learning," Lerer and @alex_peys, FAIR: https://t.co/giFexeab9C "Improving Slot Filling Performance with Attentive Neural Networks on Dependency Structures," Huang et al.: https://t.co/XhNUqKhLyp "Discriminative Localization in CNNs for Weakly-Supervised Segmentation of Pulmonary Nodules," Feng et al.: https://t.co/vOHECrDddt "Deep-learning-based data page classification for holographic memory," Shimobaba et al.: https://t.co/zOdiobYhhP "Improving LSTM-CTC based ASR performance in domains with limited training data," Jayadev Billa: https://t.co/8xOGJ1QGje "High-Quality Face Image SR Using Conditional Generative Adversarial Networks," Bin et al.: https://t.co/B1jwEqOQ33 "Cardiologist-Level Arrhythmia Detection with Convolutional Neural Networks," Rajpurkar and Hannun et al.: https://t.co/kluCn6hXiX "Hindsight Experience Replay," Andrychowicz et al., OpenAI: https://t.co/Mb8wv0GIpP July 5-7 paper thread starts here, intro got broken somehow - https://t.co/X688OuVU3I "Multiscale sequence modeling with a learned dictionary," van Merriënboer et al.: https://t.co/5bj5riKXcN Cont'd, including the rest of the week -"CNN features are also great at unsupervised classification," Guérin et al.: https://t.co/EgBkRy0Uee @chrisalbon perfect RT @JuddLegum: In other news, I'm hiring the guy who just robbed my house to install a new security system https://t.co/M9ea82AqJn RT @deliprao: This is a credible threat. We think generated images don't look so real today, but a year ago what's possible today was consi… RT @anneapplebaum: Great idea. Also we should create an anti terrorist unit with ISIS and an anti chemical weapon unit with Assad https://t… Update: Edinburgh is 💯 RT @mark_riedl: This will make it much less likely that the next great tech company will be founded in the US. https://t.co/s8tLsj5KJK RT @DG_Rand: "The Rise and Fall of Cognitive Control"-Blog on our Psych Rev paper modeling population dynamics+cognitive control https://t… Visiting Edinburgh/Scotland for the first time today :) RT @ColinKahl: Ivanka Trump replaces her father at the G-20 leaders table when POTUS leaves for bilats. Not normal. https://t.co/a3EuQQzWoP RT @fchollet: "If you want a picture of the future, imagine a boot stamping on a face — forever" https://t.co/6Czj6vlBbc RT @rcalo: Come work with me https://t.co/eqSk4QmGV2 https://t.co/I3bC5fbyY4 RT @erichorvitz: Editorial in Science on AI & its influences now avail: https://t.co/H8yDm6yMFj @TheOfficialACM @IEEEorg @ACLU @Partnershi… RT @hardmaru: Trust-PCL: An Off-Policy Trust Region Method for Continuous Control, from @GoogleBrain https://t.co/bz2zzgkSjs @hholst80 ah, yes, I see your point :) yeah I think it's just the simulation part @hholst80 don't know what you mean. the one I just mentioned does...? RT @timhwang: Submit to "The California Review of Images and Mark Zuckerberg"! Seeking articles deconstructing his visual culture https://t… 40,000 frames per second, train in a day... https://t.co/ejoh9v8OIz RT @fbOpenSource: Introducing ELF - An extensive, lightweight, and flexible platform for game research. https://t.co/jiHJ9WHLPx "CNN features are also great at unsupervised classification," Guérin et al.: https://t.co/EgBkRy0Uee "Cardiologist-Level Arrhythmia Detection with Convolutional Neural Networks," Rajpurkar and Hannun et al.: https://t.co/kluCn6hXiX RT @dustinvtran: I think the more we learn about neural nets, the more statements such as "uninterpretable", "data inefficient", or "noncau… RT @brianklaas: The fate of the world lies in the hands of people who apparently failed book a hotel room in time for the president. https:… @jeremyphoward ah haha :) RT @DeepMindAI: Two DeepMind Health patient workshops coming up - in London on Fri (now full), still spaces in Manchester (12 July) https:/… "RT @brianklaas: If Trump is attacking Obama, Russia interfered and he didn't do enough When it's about Trump's election, it's a fake news…" "RT @noahkunin: This was heart and gut wrenching to write. Why I'm leaving @18F: https://t.co/s3o3JX5MlE Wishing the absolute best for ever…" (will catch up on arXiv soon-ish) "Hindsight Experience Replay," Andrychowicz et al., OpenAI: https://t.co/Mb8wv0GIpP RT @opheliathistle: look at this roo petting a doggo https://t.co/vQRCMi2ePD RT @Recode: Google’s newest AI team is setting up in Canada https://t.co/PHgfx6gS6k https://t.co/pjkt6Zzogq "Structure Optimization for Deep Multimodal Fusion Networks using Graph-Induced Kernels," Ramachandram et al.: https://t.co/GpkJsBOtwF "OPEB: Open Physical Environment Benchmark for Artificial Intelligence," Mirzaei et al.: https://t.co/ECPIar1B2m "Parallel Bayesian Online Deep Learning for Click-Through Rate Prediction in Tencent Advertising System," Liu et al: https://t.co/Wc47dj0dA1 "DeepStory: Video Story QA by Deep Embedded Memory Networks," Kim et al.: https://t.co/kMApK47829 "Deep Jointly-Informed Neural Networks," Humbird and Peterson et al.: https://t.co/2khI6hHVFb "ELF: An Extensive, Lightweight + Flexible Research Platform 4 Real-time Strategy Games," Tian et al., FB/Oculus (?) https://t.co/7igVmUfUZx RT @etzioni: First exit of startup incubated at https://t.co/xjxG3f5pGB. Congrats to Xuchen Yao and team! https://t.co/IGwXSQMFX3 RT @kr_t: In this week's edition of "how not to chatbot": https://t.co/DViEdBOdxM RT @hardmaru: Comprehensive Cat Generation using DCGAN, DCGAN+SELU, WGAN, WGAN-GP, and LSGAN. 😺. https://t.co/kUiloISuKO https://t.co/ss1CS… CanadAI continues to grow: https://t.co/DnfjdaTLwA RT @DeepMindAI: We're opening a research office in #Edmonton, Canada, in collaboration with @UAlberta, led by RL pioneer Rich Sutton https:… "Efficient Probabilistic Performance Bounds for Inverse Reinforcement Learning," Brown and Niekum: https://t.co/S9DhqZQP2v @PatrickOmid thanks! @jeremyphoward re: what? To be continued... "ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices," Zhang et al.: https://t.co/QSUhaNjmfL "Senior Programmers: Characteristics of Elderly Users from Stack Overflow," Kowalik and Nielek: https://t.co/WgkDFubAjp "Zero-Shot Transfer Learning for Event Extraction," Huang et al.: https://t.co/dKE10FXyh2 "Modulating early visual processing by language," de Vries and Strub et al.: https://t.co/SZj0ngXkth "Visually Grounded Word Embeddings and Richer Visual Features for Improving Multimodal NMT," Delbrouck et al.: https://t.co/WHryaT5AST "Multiscale sequence modeling with a learned dictionary," van Merriënboer et al.: https://t.co/5bj5riKXcN "arXiv papers, July 5* - ""The Fall of the Empire: The Americanization of English,"" Gonçalves et al.: https://t.co/Ez8ZVg9FrZ *not 4th, sadly" RT @danpfeiffer: Take a moment and absorb just how insane it is that the US President won't say anything to Putin about Russia interfering… RT @rubinovitz: @Miles_Brundage "identify the presence of simulated threats under a variety of object types, clothing types, and body types… RT @rubinovitz: @Miles_Brundage I'm pretty fascinated with/mortified by this Kaggle challenge as well https://t.co/PK8NfWYfMd RT @nikete: @Miles_Brundage I'm all seriousness, model organisms are needed in collective cognition / ai and society research. Recidivism… RT @nikete: @Miles_Brundage It is not a good b model organism in that ground truth daya is super scarce and replication very difficult, bu… RT @nikete: @Miles_Brundage Now like the polio of ai bias research @nikete nice analogy :) (specifically, the COMPAS data seems to be making the rounds) Recidivism prediction as the drosophilia of AI bias research. Fin. "A criterion for 'easiness' of certain SAT problems," Bernd Schuh: https://t.co/wO50FEyAkM "Image Companding and Inverse Halftoning using Deep Convolutional Neural Networks," Hou and Qiu: https://t.co/KfnEzeV0bc "Efficient Attention using a Fixed-Size Memory Representation," @dennybritz,* @MelodyGuan,* and @lmthang: https://t.co/rR5cegn7Fx "An Empirical Study on Collaborative Architecture Decision Making in Software Teams," Dasanayake et al.: https://t.co/XMWAeZ7MYH "Exploring the Imposition of Synaptic Precision Restrictions For Evolutionary Synthesis of DNNs," Shafiee et al.: https://t.co/DTV6jprQvh "Multisided Fairness for Recommendation," Robin Burke: https://t.co/oElkP2uzSN "Disinformation and Social Bot Operations in the Run Up to the 2017 French Presidential Election," Emilio Ferrara: https://t.co/YbxvN5V1Sv "Synthesizing Deep Neural Network Architectures using Biological Synaptic Strength Distributions," Karimi et al.: https://t.co/c91eyrU69E "Adversarial Image Alignment and Interpolation," Viren Jain: https://t.co/pQqIwN9B6B "Better than Real: Complex-valued Neural Nets for MRI Fingerprinting," Virtue et al.: https://t.co/EDOIZAgrEe "Racial Disparity in NLP: A Case Study of Social Media African-American English," Blodgett and O'Connor: https://t.co/gx8tBfc9oA "Multiple VLAD encoding of CNNs for image classification," Li et al.: https://t.co/dmlo0rPiBf "Failing to Learn: Autonomously Identifying Perception Failures for Self-driving Cars," S.R. et al.: https://t.co/N89lKLp0Wa "LivingLab PJAIT: Towards Better Urban Participation of Seniors," Kopec et al.: https://t.co/togEkRXq38 "Complexity Analysis of a Trust Funnel Algorithm for Equality Constrained Optimization," Curtis et al.: https://t.co/y2a3gzfH9I "Time Series Forecasting Based on Variational Recurrent Model," Daniel Hsu: https://t.co/q8GKpeZXkp "Temporal HeartNet: Towards Human-Level Automatic Analysis of Fetal Cardiac Screening Video," Huang et al.: https://t.co/tKPicw6ikz "DeepIGeoS: A Deep Interactive Geodesic Framework for Medical Image Segmentation," Wang et al.: https://t.co/GUUX2ezqCh "Examplar-Based Face Colorization Using Image Morphing," Persch et al.: https://t.co/eUwtT8iGy9 "Siamese Learning Visual Tracking: A Survey," Roman Pflugfelder: https://t.co/hAnxwjvJhC "How algorithmic popularity bias hinders or promotes quality," Nematzadeh et al.: https://t.co/XxCgZfr0Rc "A Linear Algebra Approach to Fast DNA Mixture Analysis Using GPUs," Samsi et al.: https://t.co/j3rAbb38vO "Recommender System for News Articles using Supervised Learning," Chaturvedi et al.: https://t.co/pXxFr91SW5 "A Projected Inverse Dynamics Approach for Dual-arm Cartesian Impedance Control," Lin et al.: https://t.co/weoLTQxEYF "Generalised Wasserstein Dice Score for Imbalanced Multi-class Segmentation using Holistic CNNs," Fidon et al.: https://t.co/CsfGiT8MGe "End-to-End Learning of Video Super-Resolution with Motion Compensation," Makansi et al.: https://t.co/hE8yZTO4Rw "A Distance Between Populations for n-Points Crossover in Genetic Algorithms," Castelli et al.: https://t.co/afj7EkZjPP """Detection + Localization of Image Forgeries using Resampling Features + Deep Learning,"" Bunk* et al.: https://t.co/YR7OifmV4k *v. apropos" "What happens when software developers are (un)happy," Graziotin et al.: https://t.co/PMdc61oo1o "Deep Ranking Model by Large Adaptive Margin Learning for Person Re-identification," Wang et al.: https://t.co/PVeAkxOUIa "Pedestrian Alignment Network for Large-scale Person Re-identification," Zheng et al.: https://t.co/h3581h0H5N "On Asymptotic Properties of Hyperparameter Estimators for Kernel-based Regularization Methods," Mu et al.: https://t.co/hXILqvJ5Ej "Convolutional Dictionary Learning: Acceleration and Convergence," Chun and Fessler: https://t.co/xDm2pBtiNS "Physics Inspired Optimization on Semantic Transfer Features: An Alt. Method 4 Room Layout Estimation," Zhao et al.: https://t.co/kHyoW3XKNx "Vectorial Dimension Reduction for Tensors Based on Bayesian Inference," Ju et al.: https://t.co/YQXkckbV1k "Adaptive Stimulus Selection in ERP-Based BCIs by Maximizing Expected Discrimination Gain," Kalika et al.: https://t.co/tv4UxWAl8h "Reciprocal Recommender System for Learners in Massive Open Online Courses (MOOCs)," Prabhakar et al.: https://t.co/YS0XFKGTxS "Sampling-based Planning of In-Hand Manipulation with External Pushes," Chavan-Dafle and Rodriguez: https://t.co/0ld97n934i "DeltaPhish: Detecting Phishing Webpages in Compromised Websites," Corona et al.: https://t.co/nF6Te8ovDY "Stochastic Configuration Networks Ensemble for Large-Scale Data Analytics," Wang and Cui: https://t.co/izNl479omd "Grammatical Error Correction with Neural Reinforcement Learning," @KeisukeS_ et al.: https://t.co/1UBom66FQD "Where to Play: Retrieval of Video Segments using Natural-Language Queries," Lee et al.: https://t.co/OnRB93eTuM "DAG-based Long Short-Term Memory for Neural Word Segmentation," Chen et al.: https://t.co/ZX56346cpd "Deep GrabCut for Object Selection," Xu et al.: https://t.co/RhEFxCeopV "Modifying Optimal SAT-based Approach to Multi-agent Path-finding Problem to Suboptimal Variants," Surynek et al.: https://t.co/bivpM3GT60 "On Black-Box Transformations in Downward-Closed Environments," Warut Suksompong: https://t.co/sX2Nf1nKtm "Sequential Experimentation to Efficiently Test Automated Vehicles," Huang et al.: https://t.co/otFr97NYZu "Predicting User-Interactions on Reddit," Glenski and Weninger: https://t.co/9VdOYPXQ30 "Rank-1 Constrained Multichannel Wiener Filter for Speech Recognition in Noisy Environments," Wang et al.: https://t.co/p09Xq5LBDo "An Approach for Weakly-Supervised Deep Information Retrieval," MacAvaney et al.: https://t.co/kuT6tQxjqc "Quantum phase recognition via unsupervised machine learning," Broecker et al.: https://t.co/V6zLawcWmV "Learning Fair Classifiers: A Regularization-Inspired Approach," Bechavod and Ligett: https://t.co/xPL5Si8QaK "Fairer and more accurate, but for whom?," Chouldechova and G'Sell: https://t.co/xzJwXtox0x "Synthesizing Deep Neural Network Architectures using Biological Synaptic Strength Distributions," Karimi et al.: https://t.co/c91eyrU69E "SAM: Semantic Attribute Modulated Language Modeling," Hu et al.: https://t.co/YvihHTc2sk "Dimensionality reduction with missing values imputation," Gahar et al.: https://t.co/aMzRK49PJA "Efficient Correlated Topic Modeling with Topic Embedding," He et al.: https://t.co/NE0K0LlWmR "Efficient Cost-Sensitive Learning for Recommendation," Peng et al.: https://t.co/ox8cxyjmcf "On Scalable Inference with Stochastic Gradient Descent," Fang et al.: https://t.co/KsQ50fTF5P "Location Dependent Dirichlet Processes," Sun et al.: https://t.co/uF1nCerLvo "Some methods for heterogeneous treatment effect estimation in high-dimensions," Powers et al.: https://t.co/i1a3G952jQ "Deep Convolutional Framelets: A General Deep Learning for Inverse Problems," Ye and Han: https://t.co/lWslyT6d7u "Generalization Properties of Doubly Online Learning Algorithms," Lin and Rosasco: https://t.co/0dciV0VTHz RT @NandoDF: An awesome presentation covering some of the most exciting aspects of deep RL and control. https://t.co/ThSAHAWel5 @bleddb @kennethpayne01 thx, that's been on my short list of possible picks, will be sure to check it out! @erikbryn Happy 4th! And thanks for writing MPC, picked it up recently and look fwd to reading it soon :) Also, happy 4th of July from the UK :) Anyone have good book recommendations on the space race? RT @MelodyGuan: New @emnlp2017 paper just out on arXiv! "Efficient Attention using a Fixed-Size Memory Representation" https://t.co/gvSZR2g… @aiatheart yeah, confusing... @JoshuaParikh good track records are helpful, +not obviously being clueless about technical details. But it's intrinsically pretty uncertain @JoshuaParikh Forrester reports too expensive, can't evaluate :) but generally it's a hard problem, don't have criteria off top of my head @oliver90ng seems like good way to learn about basic + state of art deep RL, from top people in field, so if serious about DRL, probably, ya More tomorrow... "Learning Deep Latent Spaces for Multi-Label Classification," Yeh and Wu et al.: https://t.co/mxPsUo3Ftt "Dual Supervised Learning," Xia et al.: https://t.co/5YPwd3C2R8 "Zero-Shot Learning - A Comprehensive Evaluation of the Good, the Bad and the Ugly," Xian et al.: https://t.co/LE8v8V6HXz "From Parity to Preference-based Notions of Fairness in Classification," Zafar et al.: https://t.co/gWOIdPcAJ0 "Heterogeneous Supervision for Relation Extraction: A Representation Learning Approach," Liu and Ren et al.: https://t.co/C14pa5hc1G "Fair Pipelines," Bower et al.: https://t.co/Cs1wdIwocB (sidenote: lots of the recent cool papers are from FATML 2017, which sounds great, wish I could make it) "Data Decisions and Theoretical Implications when Adversarially Learning Fair Representations," Beutel et al.: https://t.co/2wLAdLOdM0 "Parle: parallelizing stochastic gradient descent," Chaudhari et al.: https://t.co/MJyhPwOhBD "Hashing Over Predicted Future Frames for Informed Exploration of Deep Reinforcement Learning," Yin and Pan: https://t.co/H6uDx0fUZa "Variance Regularizing Adversarial Learning," Grewal,* Hjelm,* and Bengio: https://t.co/Krkumw5JxQ "Synthetic Spoken Data for Neural Machine Translation," Hassan et al., MSFT: https://t.co/pkLfUEciM3 "Sample-efficient Actor-Critic RL with Supervised Data for Dialogue Management," Su et al., Cambridge: https://t.co/GtpBSE89vo arXiv papers, July 4 - "Teacher-Student Curriculum Learning," @tambetm et al., OpenAI: https://t.co/2kFPfctZ4D @jackclarkSF only imported beers, I assume... "Lifelong Learning in Costly Feature Spaces," Balcan et al.: https://t.co/zvjvzuPxUT "How biased is your model? Concentration Inequalities, Information and Model Bias," Gourgoulias et al.: https://t.co/prlDI8Yp3k "A selectional auto-encoder approach for document image binarization," Calvo-Zaragoza and Gallego: https://t.co/gmAXKeijUn (Ahmadi and Tani) "Bridging the Gap btwn Probabilistic+Det'istic Models: A Simulation Study on a Var Bayes Predictive Coding RNN": https://t.co/lDSklFhw3J "Is it ethical to avoid error analysis?," Garcia-Martín and Lavesson: https://t.co/WF564xeDhx "Improving Session Recommendation with Recurrent Neural Networks by Exploiting Dwell Time," Dallmann et al.: https://t.co/Ap8jGdtD1k "SMC Faster R-CNN: Toward a scene-specialized multi-object detector," Mhalla et al.: https://t.co/12WvbWrK0D "Rule-Mining based classification: a benchmark study," Luck et al.: https://t.co/KWdG9vJ5pT "RE-PACRR: A Context and Density-Aware Neural Information Retrieval Model," Hui et al.: https://t.co/3BxV0OBr5p "Parameterized Complexity of CSP for Infinite Constraint Languages," Ruhollah Majdoddin: https://t.co/DAA8faxqcU "What Happens 2 Intentional Concepts in Requirements Engineering If Intentional States Cannot Be Known?"-Ivan Jureta https://t.co/IM0F7o3GsZ "Navigate, Understand, Communicate: How Developers Locate Performance Bugs," Baltes et al.: https://t.co/Vzck2lXItA "Tableaux for Policy Synthesis for MDPs with PCTL* Constraints," Baumgartner et al.: https://t.co/tcwMgSTBqr "From Big Data to Big Displays: High-Performance Visualization at Blue Brain," Eilemann et al.: https://t.co/m9Ye1wgKbJ "Design Activism for Minimum Wage Crowd Work," Mankar et al.: https://t.co/Vq9nyBqGez "Chatbots as Conversational Recommender Systems in Urban Contexts," Kucherbaev et al.: https://t.co/7DhJ0cu7t4 "Superpixel-based semantic segmentation trained by statistical process control," Park et al.: https://t.co/JCPQzX3o30 "Turned 70? It is time to start editing Wikipedia," Nielek et al. https://t.co/jXfCgJLS4C (title bad; abt WikiP editing usability 4 elderly) "A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem," Jiang et al.: https://t.co/IT1Qw8qXas "Providing Effective Real-time Feedback in Simulation-based Surgical Training," Ma et al.: https://t.co/npXqUcHDZD "Automated Audio Captioning with Recurrent Neural Networks," Drossos et al.: https://t.co/fQmN7mMQAp "The Authority of 'Fair' in Machine Learning," Skirpan and Gorelick: https://t.co/KBqCG0N9VL "Efficient, High-Quality Stack Rearrangement," Han et al.: https://t.co/pjo3CQaNdr "Scalable Asymptotically-Optimal Multi-Robot Motion Planning," Dobson et al.: https://t.co/FrS7lKJaWn "Graph Convolutional Networks for Molecules," Zhenpeng Zhou: https://t.co/2aeRPxk6Rg "Multi-armed Bandit Problems with Strategic Arms," Braverman et al.: https://t.co/O8K2sACqHN "Hypothesis Testing For Densities and High-D. Multinomials: Sharp Local Minimax Rates," Balakrishnan/Wasserman: https://t.co/2crMPZTaji "Towards Understanding Generalization of Deep Learning: Perspective of Loss Landscapes," Wu et al.: https://t.co/cUmecqfGJY "Bolt: Accelerated Data Mining with Fast Vector Compression," Blalock and Guttag: https://t.co/wwGl9kSBop "Towards Bursting Filter Bubble via Contextual Risks and Uncertainties," Takahashi and Zhang: https://t.co/mzOBFND1cX "Neural Sequence Model Training via α-divergence Minimization," Koyamada et al.: https://t.co/fTsnrqDuNl "Optimization Methods for Supervised Machine Learning: From Linear Models to Deep Learning," Curtis and Scheinberg: https://t.co/j5pCeyYXG0 "On Fairness, Diversity and Randomness in Algorithmic Decision Making," Grgić-Hlača et al.: https://t.co/QE533XA8g5 This looks 💯 "Probabilistic Active Learning of Functions in Structural Causal Models," Rubenstein et al.: https://t.co/aP2pid0VHo @jackclarkSF In retrospect, this would have been the correct response to your tweet: https://t.co/kRAFrV0ETv "Collaborative-controlled LASSO for Constructing Propensity Score-based Estimators in High-D. Data," Ju et al.: https://t.co/2p8lNlZJzT "Noisy Hamiltonian Monte Carlo for doubly-intractable distributions," Stoehr et al.: https://t.co/QP0yLgCipf "Exploring the Human Connectome Topology in Group Studies," Keiriz et al.: https://t.co/39xdvh4L4S "SafetyNets: Verifiable Execution of Deep Neural Networks on an Untrusted Cloud," Ghodsi et al.: https://t.co/NBEowBh084 arXiv papers, July 3 - "Noisy Networks for Exploration," Fortunado, Azar, and Piot et al., DeepMind: https://t.co/c7vymdTBF0 @timhwang yesss @jackclarkSF 👍 RT @NMRPerrin: Good to see @DeepMindAI admit they got things wrong, and discuss how they are learning lessons https://t.co/06qNhH3MGs Dug in deeper and still confused, missing something re: why the mean for duel is so high, medians generally low-CC @marcgbellemare thoughts? "SafetyNets: Verifiable Execution of Deep Neural Networks on an Untrusted Cloud," Ghodsi et al.: https://t.co/NBEowBh084 Will get to the rest of arXiv tomorrow - hung up on this Atari/exploration business (https://t.co/c7vymdTBF0). In the meantime, one other - (but it also may have been already?? To be continued!) If these results are comparable, though, seems like the best mean score is now within the range I forecasted earlier this year (1500-4000%). Confused as to why the baseline score for dueling network is so high, way higher than reported in orig. paper, most be diff evaluation... ...and some gains on median vs. baselines, but not overall median SOTA. Other stuff + this, though, should give great results. Better exploration yields big gains on Atari with little overhead. Need to look more carefully at results but at first glance, v. high mean. "Noisy Networks for Exploration," Fortunato, Azar, and Piot et al. at DeepMind: https://t.co/c7vymdTBF0 Fin. "Skill Learning by Autonomous Robotic Playing using Active Learning and Creativity," Hangl et al.: https://t.co/GxtPQp1jU9 "Large-scale Datasets: Faces with Partial Occlusions and Pose Variations in the Wild," Alafif et al.: https://t.co/i005LlJFPt "Memory-augmented Chinese-Uyghur Neural Machine Translation," Zhang et al.: https://t.co/fdRDJMLlro "Proceedings of the First International Workshop on Deep Learning and Music," Herremans and Chuan: https://t.co/BO1RAcy0A9 "Do Deep Neural Networks Suffer from Crowding?," Volokitin et al.: https://t.co/5FDfsknnJ9 "Relating Complexity-theoretic Parameters with SAT Solver Performance," Zulkowski et al.: https://t.co/FH0ISApvJD "The Minor Fall, the Major Lift: Inferring Emotional Valence of Musical Chords through Lyrics," Kolchinsky et al.: https://t.co/mfJII5eJUj "Neural Question Answering at BioASQ 5B," Wiese et al.: https://t.co/0fy54FF7FI "Detecting Small Signs from Large Images," Meng et al.: https://t.co/xQ3GK3GDab "Illuminating Pedestrians via Simultaneous Detection & Segmentation," Brazil et al.: https://t.co/11GZS40qMJ "Training a Fully Convolutional Neural Network to Route Integrated Circuits," Jain et al.: https://t.co/e1fDKroZv2 "Managing a Fleet of Autonomous Mobile Robots (AMR) using Cloud Robotics Platform," Singhal et al.: https://t.co/Fvw4azPIFh "Cross-Country Skiing Gears Classification using Deep Learning," Rassem et al.: https://t.co/hOoUDoiYtI "Re-Evaluating the Netflix Prize - Human Uncertainty and its Impact on Reliability," Jasberg and Sizov: https://t.co/QGNczEcOUs "TimeNet: Pre-trained deep recurrent neural network for time series classification," Malhotra et al.: https://t.co/ZTZsF8nl4G "Gabor frames and deep scattering networks in audio processing," Bammer et al.: https://t.co/5iwsnsWZKn "Recurrent Residual Learning for Action Recognition," Iqbal et al.: https://t.co/WTYXvx1zp8 "Auto-Encoder Guided GAN for Chinese Calligraphy Synthesis," Lyu et al.: https://t.co/7aoIayjN3M "Topometric Localization with Deep Learning," Oliveira et al.: https://t.co/mS3LnyPZdM "Controlled Tactile Exploration and Haptic Object Recognition," Regoli et al.: https://t.co/KDfSGpujKQ "Material Recognition CNNs and Hierarchical Planning for Biped Robot Locomotion on Slippery Terrain," Brandao et al. https://t.co/9rVsbuEEZl "Generating Appealing Brand Names," Hiranandani et al.: https://t.co/78NlSZs6d1 "Retinal Vessel Segmentation in Fundoscopic Images with Generative Adversarial Networks," Son et al.: https://t.co/NO3r8yGC3x "Data-driven Natural Language Generation: Paving the Road to Success," Novikova et al.: https://t.co/4lEDgguXWP "CASCONet: A Conference dataset," Luo and Lyons: https://t.co/z0OgtAZXGo "Neural SLAM," Zhang et al.: https://t.co/RG2FwmftVA "Misinformation spreading on Facebook," Zollo and Quattrociocchi: https://t.co/qVqt4oupTS "Uncooperative MoCap Gait Identification for Video Surveillance with Incomplete and Noisy Data," Balazia and Sojka: https://t.co/8g0QXJZJ1J "Deep learning bank distress from news and numerical financial data," Cerchiello et al.: https://t.co/B48CjLfcb5 "Default Logic and Bounded Treewidth," Fichte et al.: https://t.co/gb1uzEPiRO "autoBagging: Learning to Rank Bagging Workflows with Metalearning," Pinto et al.: https://t.co/qrGvnFH18p "Nonconvex Finite-Sum Optimization Via SCSG Methods," Lei et al.: https://t.co/RDSpX2mzBk "Perceptual Adversarial Networks for Image-to-Image Transformation," Wang et al.: https://t.co/3w9HVtrDqr "Energy-Based Sequence GANs for Recommendation and Their Connection to Imitation Learning," Yoo et al.: https://t.co/SXew0wHQ66 "The E2E Dataset: New Challenges For End-to-End Generation," Novikova et al.: https://t.co/zNlWtouLf3 "Hierarchical Attentive Recurrent Tracking," Kosoriek et al.: https://t.co/U7dwi0b7VP "Learning Knowledge Graph Embeddings with Type Regularizer," Kotnis and Nastase: https://t.co/mTNLpoGiAS "The YouTube-8M Kaggle Competition: Challenges and Methods," Zou et al.: https://t.co/CyGy8dV5xg "Deep Learning Based Large-Scale Automatic Satellite Crosswalk Classification," Berriel et al.: https://t.co/ueT6mOSI8c "Alternative Semantic Representations for Zero-Shot Human Action Recognition," Wang and Chen: https://t.co/5kXXAgRcYn "The difference between memory and prediction in linear recurrent networks," Sarah Marzen: https://t.co/TikMO3wgST "Toward Computation and Memory Efficient NN Acoustic Models with Binary Weights and Activations," Liang Lu: https://t.co/1M63ro04bq "Learning to Learn: Meta-Critic Networks for Sample Efficient Learning," Sung et al.: https://t.co/uc3IEeyDFn "Frame-Semantic Parsing with Softmax-Margin Segmental RNNs and a Syntactic Scaffold," Swayamdipta et al.: https://t.co/IDgXNvp3vZ "Distributional Adversarial Networks," Li et al.: https://t.co/QUwWAF5gJQ "Flow-free Video Object Segmentation," Vora and Raman: https://t.co/JdB0VnajlG "Toward Inverse Control of Physics-Based Sound Synthesis," Pfalz and Berdahl: https://t.co/z5LlMFSaRU "The Relationship Between Emotion Models and Artificial Intelligence," Bartneck et al.: https://t.co/yNoZXpa3ps "Frame-Based Contin. Lexical Semantics through Expo. Family Tensor Factorization+Semantic Proto-Roles,"Ferraro et al https://t.co/MQ1xBq6UvF "Online Convolutional Dictionary Learning," Liu et al.: https://t.co/fzsXx8h51C "Recurrent neural networks with specialized word embeddings for health-domain named-entity recognition"-Unanue et al https://t.co/4td7bZrOZR "R2CNN: Rotational Region CNN for Orientation Robust Scene Text Detection," Jiang et al.: https://t.co/1BMA7Q9vri "Multi-scale Multi-band DenseNets for Audio Source Separation," Takahashi and Mitsufuji: https://t.co/s5JYKm0Glt "Path Integral Networks: End-to-End Differentiable Optimal Control," Okada et al.: https://t.co/P45ry7UYbp "Actor-Critic Sequence Training for Image Captioning," Zhang et al.: https://t.co/5hVjXm4rC8 "Co-salient Object Detection Based on Deep Saliency Nets + Seed Propagation over an Integrated Graph," Jeong et al.: https://t.co/Y5gI6kZzLX "Stronger Baselines for Trustable Results in Neural Machine Translation," Denkowski and Neubig: https://t.co/gtIMH0ZmJm "Speaking Style Authentication Using Suprasegmental Hidden Markov Models," Ismail Shahin: https://t.co/gXWZUzHJ42 "Using Second-Order HMM to Improve Speaker Identification Rec. Performance under Neutral Condition," Ismal Shahin: https://t.co/K0HwQfOLWG "Interpretability via Model Extraction," Bastani et al.: https://t.co/0SG2PH2Hxb "Two-Stage Synthesis Networks for Transfer Learning in Machine Comprehension," Golub et al.: https://t.co/6m9L0GQ7yR "Relevance of Unsupervised Metrics in Task-Oriented Dialogue 4 Evaluating Natural Language Generation," Sharma et al https://t.co/6SlA06IWaa "Generalization Error Bounds for Extreme Multi-class Classification," Lei et al.: https://t.co/ghuhzPJF5j "Towards Monocular Vision based Obstacle Avoidance through Deep Reinforcement Learning," Xie et al.: https://t.co/kOCMgN1mKM "New Fairness Metrics for Recommendation that Embrace Differences," Yao and Huang: https://t.co/KQoiUZ5WEv "Runaway Feedback Loops in Predictive Policing," Ensign et al.: https://t.co/tavRBXa4gI "Rational Trust Modeling," Mehrdad Nojoumian: https://t.co/gxe0Z5jLoJ "What's Mine is Yours: Pretrained CNNs for Limited Training Sonar ATR," McKay et al.: https://t.co/cYY4E5miQH "Automatic Mapping of French Discourse Connectives to PDTB Discourse Relations," Laali and Kosseim: https://t.co/8LtI35VYFC "Towards Understanding the Dynamics of Generative Adversarial Networks," Li et al.: https://t.co/40qfvO4Ct4 "Automatic Face Image Quality Prediction," Best-Rowden and Jain: https://t.co/GXBHIG98kM "Scale-Aware Face Detection," Hao et al.: https://t.co/a5mO1FTxHL "Optimal Control for Multi-Mode Systems with Discrete Costs," Mousa et al.: https://t.co/601jQht9QU "Logics + practices of transparency + opacity in real-world applications of public sector machine learning," @mikarv https://t.co/KYcc2vvwOb "Named Entity Disambiguation for Noisy Text," Eshel et al.: https://t.co/UUR8K0Rh3U "Neural Sequence Prediction by Coaching," Chen et al.: https://t.co/6iTk5gQM31 "A Fixed-Point of View on Gradient Methods for Big Data," Alexander Jung: https://t.co/DtWdEpqry8 "Efficiency of quantum versus classical annealing in non-convex learning problems," Baldassi and Zecchina: https://t.co/rfe7CqFakj "Unsupervised Learning via Total Correlation Explanation," Greg ver Steeg: https://t.co/I75hr6jWlV "An Actor-Critic Contextual Bandit Algorithm for Personalized Mobile Health Interventions," Lei et al.: https://t.co/7aEN005g9h "(Machine) Learning to Do More with Less," Cohen et al.: https://t.co/oZ8Tw0N3mW "Bayesian Semisupervised Learning with Deep Generative Models," Gordon and Hernandez-Lobato: https://t.co/U0hqbJbbhj "Image classification using local tensor singular value decompositions," Newman et al.: https://t.co/Ppc2JWORYJ "Feature uncertainty bounding schemes for large robust nonlinear SVM classifiers," Couellan and Jan: https://t.co/bc0NWTupna Cont'd, inc. June 29+30- "Generalising Random Forest Parameter Optimisation to Include Stability + Cost," Liu et al: https://t.co/oJyOWkYCYi RT @dandrezner: Or it's, you know, both. https://t.co/OVxvzKSqYl RT @joshchafetz: Circuses. No bread. RT @LibyaLiberty: When you hear "all-girls robotics team from Afghanistan", you'd assume the Taliban would be what stops their success, not… RT @ColinKahl: Bossert, one of the supposed adults at the WH, becomes an instant apologist for Trump's incitement against the media https:/… RT @dandrezner: Thank goodness Hillary Clinton, whose alleged scandals might have tarnished the presidency, is not in the Oval Office. http… 😑 https://t.co/XnGEKOcvOe @botminds @GoAbiAryan but yes I agree there is room for improvement @botminds @GoAbiAryan still significantly better than existing systems/most humans without search, deep learning has *some* humanlike aspect @botminds @GoAbiAryan I assume she was talking about the one labeled 5, about Go. @GoAbiAryan Nice. Some others done by others since, as well (non-HMM speech recognition, non-trivial good task performance via evolution, etc) https://t.co/InDMOEh6PZ RT @brianklaas: You settled a fraud case with Trump University for $25 million. https://t.co/Rt8UOOrZp6 Um https://t.co/jK9M3PTKeZ RT @richardcraib: Posted a new update on Numerai and NMR https://t.co/oz7aXAZ3sf RT @Abebab: China has overtaken the US and UK as the top destination for anglophone African students https://t.co/oVzHFIqZBY via @qzafrica… @a16z link broken? RT @mikarv: @Miles_Brundage last I heard it was sophisticated RT @ClickHole: Incredible. https://t.co/SzK2QZ7ria https://t.co/TXiviqAeUQ RT @lawfareblog: Matt Tait: The Time I Got Recruited to Collude with the Russians https://t.co/D1AY1mQkBy Did you know that AI is advanced? Hearing rumors that it's complex, too. https://t.co/iY8vQ2503m RT @ericgeller: OSTP's science division is now officially empty. https://t.co/k1psB8cW75 https://t.co/CWT2k4mFT7 RT @ArmsControlWonk: Two hours later, Trump still hasn't finished this thought. 🤡 https://t.co/H2h2Lbh5Lu No pressure to actually catch up because it's not my main platform + finding cool stuff on Twitter while mobile --> ~infinite windows. I thought I knew what it was like to have an out of control number of tabs in a browser, until there stopped being limits on Safari mobile. @starsandrobots thx for clarifying, I (actually) didn't get it :) @beaucronin @ChrisDiehl without aiming for a net case, I tried to look at some possible absolute benefits here: https://t.co/HvWYsp78w9 @beaucronin @ChrisDiehl net benefit/harm seems hard to prove w/o big assumptions about safety risks or lack thereof, policy/lack thereof etc RT @awjuliani: A demo I put together showing DQN learning to control the agent in a simple @unity3d environment. https://t.co/iiJEaKk9hv RT @erichorvitz: Angels on the head of a pin: https://t.co/eEGuCa47IA MS Research effort puts AI on tiny devices. @compcomcon @TheOfficialA… @etzioni @katherinebailey this from Goel et al. is the closest I'm aware of, but still not quite there - https://t.co/fNpV0052dY RT @ScientistTrump: Thank you to Science Magazine naming me "Scientist of the Year" - a great honor! Trump University labs must hang framed… @GoAbiAryan bonus for knowing some people involved, I understand the title/topic in case someone asks...kind of arbitrary but err on the inclusive side. @GoAbiAryan ..just an application to new problem but some novelty of approach, bonus for deep reinforcement learning related b/c I understand it better, @GoAbiAryan I tweet ~ 30-60 out of 150-200, spend maybe 1 min average, some read in full and some just skim for a few sec; criteria - interesting, not.. @mark_riedl just saw it the other day. Suspect few know about it, maybe a soft launch sort of situation. RT @sarahdoingthing: https://t.co/aWZesonMSo @mark_riedl both sets of services shrouded in some mystery, though, so hard to say exactly how comparable they are @mark_riedl Think Google does, too? https://t.co/vpP97SfUV0 Good thread... https://t.co/BGsS5YXmve @mark_riedl Google is notably trying to play that game, too, though (esp. Google Cloud), it's just not essential for their existence... Might not get to today's arXiv papers tonight but will catch up eventually! @Smerity would be interested to in a summary of/examples of their tactics/offers at some point... maybe a blog post someday? :) RT @AlanMackworth: 2nd Ed. of #AI text “Artificial Intelligence: Foundations of Computational Agents” by @davpoole and me. 1/4 #AIFCA https… RT @kamalikac: A very welcome move by ACL. @icmlconf / @NipsConference take note :-) https://t.co/0o7LBqrcOm SenseTime and Megvii, which both publish fair amt and focus on deep learning for image/video understanding, selling services to police etc. See also: https://t.co/lfDSAYq0An Good article on face recognition in China: https://t.co/DPkQG7gSxQ RT @OpenAI: High-performance Python library for robotics simulation: https://t.co/WRmxWCinIx https://t.co/6WCNW282QD RT @sentientist: Waiting to eat until everyone has their food is a marshmallow test for adults where instead of 2 marshmallows you signal c… RT @DeepMindAI: Using cognitive psychology to address 'black box' interpretability. Read our blog at https://t.co/pnsmD3iTNj by S. Ritter &… RT @santoroAI: Our new paper uses methods from Cog. Psychology to probe the biases of neural networks. With @dgtbarrett and others: https:/… "RT @rsalakhu: New Initiative, CMU AI, Unifies Expertise Across Departments and Disciplines https://t.co/EBKnuVIQbw https://t.co/B6Bs7iiiZ1" RT @techreview: Could the impact of artificial intelligence take China by surprise? https://t.co/HFJnFCODKF To be continued... "Unsupervised Feature Selection Based on Space Filling Concept," Laib and Kanevski: https://t.co/z4tQiFnxed "When Neurons Fail," @L_badikho and Guerraoui: https://t.co/Ibs3pw5y1z "Reexamining Low Rank Matrix Factorization for Trace Norm Regularization," Ciliberto et al.: https://t.co/Tg02Xt9GjX "On conditional parity as a notion of non-discrimination in machine learning," Ritov et al.: https://t.co/JPhaWUCvhT "Hierarchical Model for Long-term Video Prediction," Wang et al.: https://t.co/kZNCONVoeP "Forecasting and Granger Modelling with Non-linear Dynamical Dependencies," Gregorova et al.: https://t.co/xLZcNiWIKq "Fast and robust tensor decomposition with applications to dictionary learning," Schramm and Steurer: https://t.co/C4TMvCJUnP "Fast Algorithms for Learning Latent Variables in Graphical Models," Soltani and Hegde: https://t.co/VBFgVsvW4s "Learning Local Feature Aggregation Functions with Backpropagation," Katharopoulos et al.: https://t.co/WuVAiL3bGU "MolecuLeNet: A continuous-filter convolutional neural network for modeling quantum interactions," Schütt et al.: https://t.co/j0Gs7XTa5G "Preserving Differential Privacy in Convolutional Deep Belief Networks," Phan et al.: https://t.co/9eFXH7auDV "A Unified approach for Conventional Zero-shot, Generalized Zero-shot and Few-shot Learning," Rahman et al.: https://t.co/xkMXfE442c "VoxCeleb: a large-scale speaker identification dataset," Nagrani et al.: https://t.co/op3ZkvQd8y "Developing Bug-Free Machine Learning Systems With Formal Mathematics," Selsam et al.: https://t.co/7hLlHjK68a "Exploring Generalization in Deep Learning," Neyshabur et al.: https://t.co/Y6fEa8ofqA "Cognitive Psychology for Deep Neural Networks: A Shape Bias Case Study," Ritter and Barrett et al., DeepMind: https://t.co/WLD2xNHN7R arXiv papers, June 28 - "Gradient Episodic Memory for Continuum Learning," Lopez-Paz and Ranzato, FAIR: https://t.co/IlnY82QoeF Fin, for a few minutes at least. (Wei et al.) "Personalized Acoustic Modeling by Weakly Sup. Multi-Task DL using Acoustic Tokens Discovered from Unlabeled Data," https://t.co/8VjddzbnPN "Learning to Map Vehicles into Bird's Eye View," Palazzi et al.: https://t.co/T15vEvr3ks "Bounds on the Satisfiability Threshold for Power Law Distributed Random SAT," Friedrich et al.: https://t.co/Dw6RPvrhjh "Image Processing in Floriculture Using a robotic Mobile Platform," Garcia-Torres and Caro-Prieto: https://t.co/wue9mHw4ez "Approximate Steepest Coordinate Descent," Stich et al.: https://t.co/oL7hL3XmQf "StreamLearner: Distributed Incremental Machine Learning on Event Streams: Grand Challenge," Mayer et al.: https://t.co/Fx69CnSwF9 "Deep Semantic Classification for 3D LiDAR Data," Dewan et al.: https://t.co/tQVXPzSqFw "Semantically Informed Multiview Surface Refinement," Blaha et al.: https://t.co/Gquz6tL6Vk "Multi-Label Learning with Label Enhancement," Shao et al.: https://t.co/ZEteFZKzAT "Bayesian Brain meets Bayesian Recommender - Towards Systems with Empathy for the Human Nature," Jazberg and Sizov: https://t.co/5nToa5QUOO "Handling PDDL3.0 State Trajectory Constraints with Temporal Landmarks," Marzal et al.: https://t.co/hs88VrpAGA "Skeleton-Based Action Recognition Using Spatio-Temporal LSTM Network with Trust Gates," Liu et al.: https://t.co/j0zfduoP4c "Deep Semantics-Aware Photo Adjustment," Nam and Kim: https://t.co/YTyj2waUbb "Few-shot Object Detection," Dong et al.: https://t.co/YEru0SBznq "Between Homomorphic Signal Processing + DNNs: Constructing Deep Algorithms 4 Polyphonic Music Transcription," Li Su https://t.co/SMCjQkVdFV "YoTube: Searching Action Proposal via Recurrent and Static Regression Networks," Zhu et al.: https://t.co/T9jzBDcPsx "End-to-end Learning of Image based Lane-Change Decision," Jeong et al.: https://t.co/pUWiZoYYHm "English-Japanese Neural Machine Translation with Encoder-Decoder-Reconstructor," Matsumura et al.: https://t.co/yq4up5gjhO "Robust Video-Based Eye Tracking Using Recursive Estimation of Pupil Characteristics," Terence Brouns: https://t.co/Eq1TOFaboH "Automatic Synonym Discovery with Knowledge Bases," Qu et al.: https://t.co/7QQEKQPEP6 "A preference elicitation interface for collecting rich recommender datasets," Analytis et al.: https://t.co/JDY8uC792u "Automated text summarisation and evidence-based medicine: A survey of two domains," Sarker et al.: https://t.co/OlOePX7Tf6 "Beyond Bilingual: Multi-sense Word Embeddings using Multilingual Context," Upadhyay et al.: https://t.co/VRJj2nnMTI "Photometric Stereo by Hemispherical Metric Embedding," Bartal et al.: https://t.co/nVUAi9vBuh "ToolNet: Holistically-Nested Real-Time Segmentation of Robotic Surgical Tools," Garcia-Peraza-Herrera et al.: https://t.co/93YkU0PVfG "Scalable multimodal convolutional networks for brain tumour segmentation," Fidon et al.: https://t.co/B7OKo0RSEy "Flexible Rectified Linear Units for Improving Convolutional Neural Networks," Qiu and Cai: https://t.co/q43h0rNoqh "Specifying Non-Markovian Rewards in MDPs Using LDL on Finite Traces (Preliminary Version)," Brafman et al.: https://t.co/mAngsdk7lD "An Algorithm for Supervised Driving of Cooperative Semi-Autonomous Vehicles (Extended)," Altche et al.: https://t.co/LnzTIfIbsa "A Deep Neural Architecture for Sentence-level Sentiment Classification in Twitter Social Networking," Nguyen+Nguyen https://t.co/WPmLaVfExB "Irregular Convolutional Neural Networks," Ma et al.: https://t.co/6w6BKSDhLa "Auto-Encoding User Ratings via Knowledge Graphs in Recommendation Scenarios," Bellini et al.: https://t.co/EnI81CH9wO "Iterative Shrinkage-Thresholding Algorithm Inspired Deep Network for Image Compressive Sensing," Zhang+Ghanem: https://t.co/8xD3GbjqlR "Semi-supervised Text Categorization Using Recursive K-means Clustering," Gowda et al.: https://t.co/EjTABChLvy "Large-Scale Human Activity Mapping using Geo-Tagged Videos," Zhu et al.: https://t.co/I3AjXle084 "Encoder-Decoder Shift-Reduce Syntactic Parsing," Liu and Zhang: https://t.co/wPwlno1a1x "Reservoir Computing on the Hypersphere," M. Andrecut: https://t.co/Oiq2i02G47 "Preserving Intermediate Objectives: One Simple Trick to Improve Learning for Hierarchical Models,"Ravichander et al https://t.co/JmULJe2HZe "Cross-lingual Speaker Verification with Deep Feature Learning," Li et al.: https://t.co/lRmiOvaEuX "Deep Speaker Verification: Do We Need End to End?," Wang et al.: https://t.co/8dnxD3bAZ7 "Loom: Exploiting Weight and Activation Precisions to Accelerate Convolutional Neural Networks," Sharify et al.: https://t.co/gCWYm48wYo "HARP: Hierarchical Representation Learning for Networks," Chen et al.: https://t.co/gvhCsZHLTU "Image Forgery Localization Based on Multi-Scale Convolutional Neural Networks," Liu et al.: https://t.co/pMiMzb2uTu "Towards the Evolution of Multi-Layered NNs: A Dynamic Structured Grammatical Evolution Approach," Assunção et al.: https://t.co/3QPRbzYcFp "Deep Network Flow for Multi-Object Tracking," Schulter et al.: https://t.co/qdaOddPpb4 "Paying More Attention to Saliency: Image Captioning with Saliency and Context Attention," Cornia et al.: https://t.co/fapQGpHUpF "Inverse Ising inference by combining Ornstein-Zernike theory with deep learning," Alpha Lee: https://t.co/8KoW9QPi6Y "On Sampling Strategies for Neural Network-based Collaborative Filtering," Chen et al.: https://t.co/IIBgpNrT5M "Methods for Interpreting and Understanding Deep Neural Networks," Montavon et al.: https://t.co/inrQ4tsxX6 "Temporal-related Convolutional-RBM capable of learning relational order via RL procedure?," Zizhuang Wang: https://t.co/cdhQbkDoXe "There and Back Again: A General Approach to Learning Sparse Models," Sharan et al.: https://t.co/3Yg33HMWlO "Top-down Transformation Choice," Torsten Hothorn: https://t.co/yR1wwKWWHL "Spectrally-normalized margin bounds for neural networks," Bartlett et al.: https://t.co/zWE45XnsLX "Evolving Spatially Aggregated Features from Satellite Imagery for Regional Modeling," Kriegman et al.: https://t.co/avknmJlh4J "Target contrastive pessimistic risk for robust domain adaptation," Kouw and Loog: https://t.co/qU3rDxDeg9 "Matrix Hilbert Space," Yunfei Ye: https://t.co/rYBjz5l5qc "A Contemporary Overview of Probabilistic Latent Variable Models," Rick Farouni: https://t.co/1t7QQN9V85 "A Unified Analysis of Stochastic Optimization Methods Using Jump System Theory and Quadratic Constraints"-Hu et al: https://t.co/a9d2oV6GYc "Faster ICA by preconditioning with Hessian approximations," Pierre et al.: https://t.co/oaEVoA7RB3 "GPU-acceleration for Large-scale Tree Boosting," Zhang et al.: https://t.co/7rv6PLmncP "Iterative Random Forests to detect predictive and stable high-order interactions," Basu et al.: https://t.co/Oh1NnIfLka "Efficient Manifold and Subspace Approximations with Spherelets," Li and Dunson: https://t.co/xYxOLAxZ7P "Cognitive Subscore Trajectory Prediction in Alzheimer's Disease," Givon et al.: https://t.co/auy8r2Tdlj "Informed Sub-Sampling MCMC: Approximate Bayesian Inference for Large Datasets," Maire et al.: https://t.co/n8Lq7BJxFh "Dr.VAE: Drug Response Variational Autoencoder," Rampasek and Goldenberg: https://t.co/Uwub90GCAK RT @marcgbellemare: Nice work by Martin et al. extending pseudo-counts to model uncertainty over features! https://t.co/fMxdfIwK7f "RT @togelius: Second public draft of ""Artificial Intelligence and Games"" by @yannakakis and me available now: https://t.co/nctY2rfcZu" RT @Klonick: .@MargotKaminski & I wrote @nytimes op-ed about how understanding the way FB governs speech is crucial to democracy https://t.… O0O0O0 https://t.co/xJMgC2Ghs4 RT @cholodovskis: This is a great paper! I definitely recommend! I wish I had a couple of extra hours in my day to try it out! https://t.co… ICML workshop on reliable ML in the wild - submissions due July 17: https://t.co/4crNY3nKm2 More tomorrow... "Uncertainty Decomposition in Bayesian Neural Networks with Latent Variables," Depeweg et al.: https://t.co/p8mAVdOsSK "Generative Encoder-Decoder Models for Task-Oriented Spoken Dialog Systems with Chatting Capability," Zhao et al.: https://t.co/6qhCe5tgak "GANs Trained by a Two Time-Scale Update Rule Converge to a Nash Equilibrium," Heussel et al.: https://t.co/oQOyxYhrvX "Natural Language Does Not Emerge 'Naturally' in Multi-Agent Dialog," Kottur et al.: https://t.co/lGKq45he2V "Deep Mixture of Diverse Experts for Large-Scale Visual Recognition," Zhao et al.: https://t.co/4bcxG89MaG "Decomposing Motion and Content for Natural Video Sequence Prediction," Villegas et al.: https://t.co/Xr4w93bQij "Do GANs actually learn the distribution? An empirical study," Arora and Zhang: https://t.co/eibmDvsGM3 "A Meta-Learning Approach to One-Step Active Learning," Contardo et al.: https://t.co/XUHnI4ljem "Collaborative Deep Learning in Fixed Topology Networks," Jiang et al.: https://t.co/vHYuR0hCn7 arXiv papers, June 27 - "Count-Based Exploration in Feature Space for Reinforcement Learning," Martin et al., ANU: https://t.co/fWI4Oxo60F And the one on interpretability: https://t.co/dOuoKDHlvh Submissions to the ICML workshop on reproducibility in ML: https://t.co/sv8bLoui5X @mjntendency this is the closest resource - https://t.co/Ifx95Mbmbl @mjntendency so, AI experts saying things about future AI capabilities w/ dates that have passed? If so, no, sadly, not aware of such a thing :( Should you get a PhD in machine learning? Nice guide from @80000Hours: https://t.co/2fua1W2w5c Nice term used by Lighthill - "the artificial intelligentsia." And yes, I'm focusing on that part, not the idiot grumpy President part... the T part is new, I think. Quick reminder that Trump keeps calling himself T despite ample other ways to make the character limit work. https://t.co/nK7eQdYgJQ RT @demishassabis: Brilliant Ke Jie has gone on an incredible 13-game winning streak since the #AlphaGo match - what an inspiration! https:… RT @xuenay: World Taekwondo Federation changes name over 'negative connotations' https://t.co/nn2g9o59AL Fin. "Asymptotics of ABC," Paul Fearnhead: https://t.co/e92IK5ZJbM "Toward Goal-Driven Neural Network Models for the Rodent Whisker-Trigeminal System," Zhuang et al.: https://t.co/O9WyTJ2rcT 🐭 "A Variance Maximization Criterion for Active Learning," Yang and Loog: https://t.co/AQtLFgVXWs "A-NICE-MC: Adversarial Training for MCMC," Song et al.: https://t.co/NnZwyjWTdM "A Note on Learning Algorithms for Quadratic Assignment with Graph Neural Networks," Nowak et al.: https://t.co/MYPbDEM8A4 "Deep Transfer Learning: A new deep learning glitch classification method for advanced LIGO," George et al.: https://t.co/Tbr6TPvh5t "Social Bots: Human-Like by Means of Human Control?," Grimme et al.: https://t.co/eOM7orNAFh "Specializing Joint Representations for the task of Product Recommendation," Nedelec et al.: https://t.co/C3ty57hfeC "Causal Embeddings for Recommendation," Bonner and Vasile: https://t.co/7tNCTuMQbu "How Much Data is Enough? A Statistical Approach with Case Study on Longitudinal Driving Behavior," Wang et al.: https://t.co/QFPL1njvDV "Computational Controversy," Timmermans et al.: https://t.co/Ej9Avxe1dd "Testing Piecewise Functions," Hanneke and Yang: https://t.co/wqDyJt6c4h "Training Adversarial Discriminators for Cross-channel Abnormal Event Detection in Crowds," Ravanbakhsh et al.: https://t.co/x6UomhJ8oc "A Decision Support System using an Enhanced Class Outlier w/ Automatic MLP for Diabetes Prediction," Jahangir et al https://t.co/oH4XOhQBeX "Contextual Sequence Modeling for Recommendation with Recurrent Neural Networks," Smirnova and Vasile: https://t.co/oH6oG8VNfe "End-to-end Conversation Modeling Track in DSTC6," Hori and Hori: https://t.co/Zl2xn2bnHg "Stochastic Planning with Conflicting Temporal Logic Goals," @dkasenberg and Scheutz: https://t.co/Pr7Tro9EcF "Learning Spatial-Aware Regressions for Visual Tracking," Sun et al.: https://t.co/28XEKCvyRK "Mining Features Associated with Effective Tweets," Xu and Chawla: https://t.co/UPP5NHoFO8 "Binary Latent Representations for Efficient Ranking: Empirical Assessment," Maciej Kula: https://t.co/lTkn5WnN5p "Personalization in Goal-Oriented Dialog," Joshi et al.: https://t.co/REfCqrwBRe "Inter-Session Modeling for Session-Based Recommendation," Ruocco et al.: https://t.co/fC2K5nAKaI "ParVecMF: A Paragraph Vector-based Matrix Factorization Recommender System," Alexandridis et al.: https://t.co/JVl9drMpqy "Comparing Neural and Attractiveness-based Visual Features for Artwork Recommendation," Dominguez et al.: https://t.co/1fMAxvy7u0 "Neural Machine Translation with Gumbel-Greedy Decoding," Gu et al.: https://t.co/ISMvgcnlwV "Deep Hashing Network for Unsupervised Domain Adaptation," Venkateswara et al.: https://t.co/JxzjjrOzQm "Model Selection with Nonlinear Embedding for Unsupervised Domain Adaptation," Venkateswara et al.: https://t.co/PeRSrFiKvw "Design Choices for Data Governance in Platform Ecosystems: A Contingency Model," Lee et al.: https://t.co/yjppIBWNX9 "Joint Prediction of Depths, Normals and Surface Curvature from RGB Images using CNNs," Dharmasiri et al.: https://t.co/vKT9SLjewr "Named Entity Recognition with stack residual LSTM and trainable bias decoding," Tran et al., IBM: https://t.co/gBGRyYmrAi arXiv papers, June 26 - "Sampling Matters in Deep Embedding Learning," Wu et al., at (mostly) Amazon: https://t.co/zBflBsMn3r Come for Lighthill's explosive hand gestures about combinatorial explosion, stay for the history... The Lighthill debate on AI, 1973 - Lighthill vs. Michie, McCarthy, and Gregory: https://t.co/bfj3OziqXq RT @willmorgan66: "A PhD student is someone who forgoes current income in order to forgo future income." @AcademicsSay It's Sisyphus Sunday! *Needs moar law discussion, though, as @rcalo notes. @rcalo yeah does seem like omission regardless of categorization (there is philosophy discussed which is very not SS)- Hart cited but not much else @rcalo Is that considered social science? In any case, the answer seems to be no This is quite comprehensive... https://t.co/R7hSPW6W6H Fin. "Improving text classification with vectors of reduced precision," Wrobel et al.: https://t.co/gw0wExjzH7 "A Thorough Formalization of Conceptual Spaces," Bechberger and Kühnberger: https://t.co/2fKOOnidGX "FA*IR: A Fair Top-k Ranking Algorithm," Zehlike et al.: https://t.co/fTbTIXEhGi "Session Analysis using Plan Recognition," Mirsky et al.: https://t.co/qEC9YPzjzF "Mining Significant Microblogs for Misinformation Identification: An Attention-based Approach," Liu et al.: https://t.co/8R512OEUsP "Short-Term Forecasting of Passenger Demand under On-Demand Ride Services: A Spatio-Temporal DL Approach," Ke et al https://t.co/Sy8iFSGfBX "Learning Graphical Models Using Multiplicative Weights," Klivans and Meka: https://t.co/SE5F4vKN8z "Using Artificial Tokens to Control Languages for Multilingual Image Caption Generation," Tsutsui and Crandall: https://t.co/MzUyMdwaZd "Low Resolution Face Recognition Using a Two-Branch Deep CNN Architecture," Zangeneh et al.: https://t.co/Kq2b8pje6F "Topic Modeling for Classification of Clinical Reports," Kayi et al.: https://t.co/p0qbz6qYq7 "A novel tool to facilitate using voice-controlled devices [Echo] for research," Firth et al.: https://t.co/SZNiCN1xoe "Satellite Imagery Feature Detection using Deep CNN: A Kaggle Competition," Iglovikov et al.: https://t.co/WZNFwXkCOE "Using Social Media to Predict the Future: A Systematic Literature Review," Phillips et al.: https://t.co/m2dTCc6EBy "Advanced Steel Microstructure Classification by Deep Learning Methods," Azimi et al.: https://t.co/UW762usDWO "Informed Sampling for Asymptotically Optimal Path Planning," Gammell et al.: https://t.co/Ampnma0uvZ "The Compressed Model of Residual CNDS," Qassim et al.: https://t.co/1xhNylBzIs "THUMT: An Open Source Toolkit for Neural Machine Translation," Zhang et al.: https://t.co/z6fbRgqNZU "Outlier Regularization for Vector Data and L21 Norm Robustness," Jiang and Ding: https://t.co/nshoCCM1yQ "Extract with Order for Coherent Multi-Document Summarization," Nayeem and Chali: https://t.co/GesT3p1Xxb "A Hybrid Approach with Multi-channel I-Vectors and CNNs for Acoustic Scene Classification," Eghbal-zadeh et al.: https://t.co/ePKyHiHczY "SPLBoost: An Improved Robust Boosting Algorithm Based on Self-paced Learning," Wang et al.: https://t.co/E6EgcvqfuZ "A Divergence Bound for Hybrids of MCMC+Variational Inference + an Application to Langevin Dynamics and SGVI," Domke https://t.co/IaRV7gAyN7 "A Unified Approach to Adaptive Regularization in Online and Stochastic Optimization," Gupta et al.: https://t.co/Q5v514Qtpk "Infinite Mixture Model of Markov Chains," Reubold et al.: https://t.co/RSGsOvY7zB "On comparing clusterings: an element-centric framework unifies overlaps and hierarchy," Gates et al.: https://t.co/Dx0CzCUZWh "Statistical Consistency of Kernel PCA with Random Features," Sriperumbudur and Sterge: https://t.co/n83qaJhuHf "Unsure When to Stop? Ask Your Semantic Neighbors," Goncalvez et al.: https://t.co/zrRxlKRFfY "Bayesian model selection for exponential random graph models via adjusted pseudolikelihoods," Bouranis et al.: https://t.co/HjrCIv4Q3F "A Deep NN with Minimal Chemistry Knowledge Matches the Performance of Expert-developed QSAR/QSPR Models," Goh et al https://t.co/4pOf1jOVtj "Flexible High-Dimensional Unsupervised Learning with Missing Data," Wei and McNicholas: https://t.co/bvl3Jfp35t "An online sequence-to-sequence model for noisy speech recognition," Chiu and Lawson et al.: https://t.co/FyAINak7c1 "Representation Learning using Event-based STDP," Tavanei et al.: https://t.co/Vh5p0tftbl "Toward Real-Time Decentralized Reinforcement Learning using Finite Support Basis Functions," Lobos-Tsunekawa et al. https://t.co/D9YoZg90Hy "Object Detection Using Deep CNNs Trained on Synthetic Images," Rajpura et al.: https://t.co/osPWa9JUzU "Combined Task and Motion Planning as Classical AI Planning," Ferrer-Mestres et al.: https://t.co/3UBFGcv3XJ "Ensemble Framework for Real-time Decision Making," Rodgers and Levine: https://t.co/aQL8d9VcRu "Interpretable Predictions of Tree-based Ensembles via Actionable Feature Tweaking," Tolomei et al.: https://t.co/jja22mEIwq "Improved Optimization of Finite Sums with Minibatch Stochastic Variance Reduced Proximal Iterations," Wang+Zhang: https://t.co/hKMoMkdO6v "The Theory is Predictive, but is it Complete? An Application to Human Perception of Randomness," Kleinberg et al.: https://t.co/sOAxaP2vIE "Concept Drift and Anomaly Detection in Graph Streams," Zambon et al.: https://t.co/By6EhiR7pk "A giant with feet of clay: on the validity of the data that feed machine learning in medicine," Cabitza et al.: https://t.co/3PVnDhn1Iu "Most Ligand-Based Benchmarks Measure Overfitting Rather than Accuracy," Wallach and Heifets: https://t.co/rORv3MmB6z "Learning Efficient Point Cloud Generation for Dense 3D Object Reconstruction," Lin et al.: https://t.co/8QTSIVoHdS "Language That Matters: Statistical Inferences for Polarity Identification in Natural Language," Prollochs et al.: https://t.co/nQ8lDlTWGt "A Generative Model of Group Conversation," Morrison and Martens: https://t.co/CypII8dzJs "Two-Stream Convolutional Networks for Dynamic Texture Synthesis," Tesfaldet et al.: https://t.co/wi3pqK1pPI "Faster Monte-Carlo Algorithms for Fixation Probability of the Moran Process on Undirected Graphs," Chatterjee et al https://t.co/JUDEdTxWbZ "cGAN-based Manga Colorization Using a Single Training Image," Hensman and Aizawa: https://t.co/Crjoawh7hN "Learnable pooling with Context Gating for video classification," Miech et al.: https://t.co/rrGNbAy18e (1st on Kaggle 8M video challenge) "Effective Spoken Language Labeling with Deep Recurrent Neural Networks," Dinarelli et al.: https://t.co/i4S268b5Zp "MEC: Memory-efficient Convolution for Deep Neural Network," Cho and Brand: https://t.co/82EiZhOuUk "Analysis of dropout learning regarded as ensemble learning," Hara et al.: https://t.co/EIT6Dhq7Xa "Multi-Level and Multi-Scale Feature Aggregation Using Sample-level Deep CNNs for Music Classification," Lee+Nam: https://t.co/I7PYm33aSQ "GM-Net: Learning Features with More Efficiency," Chen and Li: https://t.co/W0yvG4VEn4 "Comicolorization: Semi-automatic Manga Colorization," Furusawa et al.: https://t.co/Fe0ek6I7nj "Cross-language Learning with Adversarial Neural Networks: Application to Community Question Answering," Joty et al: https://t.co/uU4EdVPxsm "Deep Learning Autoencoder Approach for Handwritten Arabic Digits Recognition," Loey et al.: https://t.co/ZPrK4PuM2E "Compact Tensor Pooling for Visual Question Answering," Shi et al.: https://t.co/4V7Nrzup7K "Using CNNs in Robots w/ Limited Computational Resources: Detecting NAO Robots while Playing Soccer," Cruz et al.: https://t.co/yB5BeluBzs "The NAO Backpack: An Open-hardware Add-on for Fast Software Development with the NAO Robot," Mattamala et al.: https://t.co/YOQboDbVLK "Recognition of Grasp Points for Clothes Manipulation under unconstrained Conditions," Martínez and Ruiz-del-Solar: https://t.co/BV0yZWGa7l "Graph-based Neural Multi-Document Summarization," Yasunaga et al.: https://t.co/VpCFN92NeF "Crowdsourcing with Sparsely Interacting Workers," Ma et al.: https://t.co/zwVjulD4Vu "Word-Entity Duet Representations for Document Ranking," Xiong et al.: https://t.co/s6T7rX7Nyc "Co-Fusion: Real-time Segmentation, Tracking and Fusion of Multiple Objects," Runz and Agapito: https://t.co/ycYAa566Bw "Analog CMOS-based Resistive Processing Unit for Deep Neural Network Training," Kim et al.: https://t.co/sFnczwmtsW "End-to-End Neural Ad-hoc Ranking with Kernel Pooling," Xiong et al.: https://t.co/sYoSUtI0bM "MAGIX: Model Agnostic Globally Interpretable Explanations," Puri et al.: https://t.co/pqDifcnj2H "Comparison of Time-Frequency Representations for Environmental Sound Classification using CNNs," M. Huzaifah: https://t.co/Hb4SV1H18u "Balanced Quantization: An Effective and Efficient Approach to Quantized Neural Networks," Zhou et al.: https://t.co/FgM75ETu3c "Improving Condition- and Environment-Invariant Place Recognition with Semantic Place Categorization," Garg et al.: https://t.co/R5BSqFx2DK "Comparing Series-Parallel and Parallel Feedforward Network Training," Ribeiro and Aguirre: https://t.co/86krwCQ3U8 "Distributed Least-Squares Iterative Methods in Networks: A Survey," Shi et al.: https://t.co/LtIj6j4Fbm "CAN: Creative Adv. Networks, Generating "Art" by Learning About Styles+Deviating from Style Norms," Elgammal et al https://t.co/bKeM8NJ2hR "Deep Learning Methods for Improved Decoding of Linear Codes," Nachmani et al.: https://t.co/3HJYvBLlKe "A Wavenet for Speech Denoising," Rethage et al.: https://t.co/HtQewcyWMk "A hybrid supervised/unsupervised machine learning approach to solar flare prediction," Benvenuto et al.: https://t.co/cITG3159zK "Fine-Grained Cat'ization via CNN-Based Auto Extraction+Integration of Object-Level+Part-Level Features," Sun et al. https://t.co/Bjh2dUX5R8 "Pixels to Graphs by Associative Embedding," Newell and Deng: https://t.co/gbTAUj6Bpt "An approach to reachability analysis for feed-forward ReLU neural networks," Lomuscio and Maganti: https://t.co/2z9wJUsdPw "An End-to-End Computer Vision Pipeline for Automated Cardiac Function Assessment by Echocardiography," Deo et al.: https://t.co/1VGrZRp9Gb "Deep Supervision for Pancreatic Cyst Segmentation in Abdominal CT Scans," Zhou et al.: https://t.co/SOipwNFWeY "A Minimal Developmental Model Can Increase Evolvability in Soft Robots," Kriegman et al.: https://t.co/wDxBGQYNR2 "Jointly Learning Word Embeddings and Latent Topics," Shi et al.: https://t.co/wAUT2bUXOV "Explanation in Artificial Intelligence: Insights from the Social Sciences," Tim Miller: https://t.co/MO4JdBuHop "A Self-Adaptive Proposal Model for Temporal Action Detection based on Reinforcement Learning," Huang et al.: https://t.co/3SpHyEun2j "Automatic Quality Estimation for ASR System Combination," Jalalvand et al.: https://t.co/QylRCKhVAT "Gated-Attention Architectures for Task-Oriented Language Grounding," Chaplot et al.: https://t.co/RYbAYtamts "RelNet: End-to-end Modeling of Entities & Relations," Bansal et al.: https://t.co/wRdB2qHj4f "Curvature-aware Manifold Learning," Yangyang Li: https://t.co/5dFrNNrljX "Continuum Limit of Posteriors in Graph Bayesian Inverse Problems," Trillos and Sanz-Alonso: https://t.co/6KhF3zA7YJ "Explaining Recurrent Neural Network Predictions in Sentiment Analysis," Arras et al.: https://t.co/8WgB9w7pAw "Constrained Bayesian Optimization with Noisy Experiments," Letham et al.: https://t.co/kcykV3Vvvp "The energy landscape of a simple neural network," Gamst and Walker: https://t.co/VeFPdWdKL8 "Compressive Statistical Learning with Random Feature Moments," Gribonval et al.: https://t.co/vTyjMXwNYZ "Scalable Multi-Class Gaussian Proc. Classification using Expectation Propagation"-Villacampa-Calvo+Hernández-Lobato https://t.co/md0ua2VK4Y "A Useful Motif for Flexible Task Learning in an Embodied Two-Dimensional Visual Environment," Fiegelis and Yamins: https://t.co/JJGFK2M0pi More papers from June 21-23: "Feeding the human brain model," Tiesinga et al.: https://t.co/o8PCxhJmXh "I'll be able to concentrate on reading in the park," he said. https://t.co/9fAr5Fqns0 RT @pashulman: Shows include "Everyone is Living Their Best Life Except You" and "Your Uncle is Pretty Racist" https://t.co/AYgaPC9NQh RT @NandoDF: The man who helped turn the World rather! Can't believe they haven't given him a Turing Award still. https://t.co/x0TTIecJMI @visarga point wasn't that there's no progress, just that it's hard to anticipate how things will play out @visarga I agree, though GANs were years after this, ppl focused on supervised soon after RT @nilaffle: This gorilla looks like he decided to have this undergrad philosophy lecture outside since it's a nice day https://t.co/c8Ada… @tdietterich they have, though there was kind of a gap between the 2012 unsupervised hype and GANs now, with supervised in btwn, and GANs still tricky Was able to find some ImageNet coverage in 2014, when big improvements also happened, but couldn't find similar coverage in 2012. Also interesting that the AlexNet paper is much more widely cited now, 10x more, not sure if it got attention outside AI community at time. This was true, though: "Potential applications include improvements to image search, speech recognition + machine language translation." The unsupervised hype didn't pan out, people went back to supervised learning and then RL, though people still dabble in unsupervised stuff. Much has changed since then. Deep learning is more efficient (16k processors for image rec.??). X's AI-->Brain. Ng-->Baidu-->deeplearning.ai 5 years ago today, people got excited/NYT covered Google X's deep learning research: https://t.co/XIp8w1qtmu RT @zeynep: You misunderstand. He's not running, just doing a full virtual reality simulation of someone who is. (Ignore the professional c… RT @hugo_larochelle: @Miles_Brundage @rsalakhu This is also very related to https://t.co/MwCjOOOreB by @honglaklee and collaborators (to ap… RT @DeepMindAI: Our new paper shows how to build agents that execute declarative programs expressed in a simple formal language: https://t.… RT @AndrewYNg: Launching my new project! Hope will help many of you: deeplearning.ai More announcements soon. #deeplearniNgAI https://t.co/… @davegershgorn boring af @davegershgorn who? RT @DefTechPat: How Not to Win an #AI Arms Race With #China my latest for @DefenseOne https://t.co/CKp3up7eIO RT @LeverhulmeCFI: Tickets are now available for our conference! https://t.co/KGshAXIsAv #CFIConf #AI @FHIOxford @UCBerkeley @imperialcolle… RT @NandoDF: @Miles_Brundage Don't forget https://t.co/lluKklA9DO Three steps, with much more research ahead. Tried some website's denoiser and it seemed better than this. SEGAN samples also seem good but don't want to download 1 gig of SEGAN weights Don't have a good baseline, though. Certainly not as good as the ones they showed, but this is outside that distribution, so unsurprising. "Another 1 - JFK didn't work well, too low quality I think... Original: https://t.co/9pnGYLEXE9 Denoised: https://t.co/vWxSvXnSzE Not great" *crickets* the earliest known recording of JFK it is! That was false, I want to do it again now that I have it installed. What should I denoise? Suspect I could get good results with fine-tuning (that was 1st attempt) but main goal was just to see if I could run it, so done for now :) And the best part - (ostensibly) the noise: https://t.co/fRTlWY4v5Z (aka Trump with lisp) "Original: https://t.co/69mRux5M30 (ostensibly) denoised: https://t.co/qiww3I3U5b (inter-speech noise gone, but bad quality for voice proper)" Tried out WaveNet denoiser... not great, but entertaining, results... also ran it fast/didn't do any fine tuning. Trying to see how to share (samples at the last link) "Very nice speech denoising results with a Wavenet-based approach: https://t.co/HtQewcyWMk https://t.co/eXIbDQVCUG https://t.co/BXhTZCMDuu" @tallinzen :) language grounding has been in the air for like, ever. But it's a specific variation thereof: 3D, "go to the [bigger/etc. ] X" with RL Wouldn't really call this simultaneous discovery, as they take v. different approaches, but interesting that the problem was "in the air"... CMU vids: https://t.co/y2CR2MRZJX DeepMind vid: https://t.co/2B2PHB4Ofl CMU: https://t.co/RYbAYsSL4S DeepMind: https://t.co/jhvX0qhuG3 ...lots of similarities (deep RL, A3C, similar tasks), also differences (UNREAL-like architecture vs. "gated-attention unit"...interesting. CMU and DeepMind both came out with similar papers on language grounding in 3D environments w/ multi-task + zero-shot learning this week... The Megazord paper's infrastructure is now in place. Brace for edits! https://t.co/V5Y87aSc2G RT @alteredq: Synthetic people created by neural nets (Imaginary People + #DeepWarp): https://t.co/atgV3epKN1 #webgl (thanks to @mtyka + @y… @beaucronin I saw it @beaucronin 💯 RT @goodfellow_ian: GeekPwn 2017 offers a 5 million RMB prize to white hat AI hackers: https://t.co/vhA70WflR3 @goodfellow_ian cool! cc @timhwang @rcalo sad! "RT @trevolafoam: ICYMI: @DeepMindAI is expanding its legal team. Could be your dream job. It is for me, anyway :) https://t.co/WK41dfUyDC" @_jyan_ lol I wouldn't say *very* soon, but good points That's it for now... "Comparing deep neural networks against humans: object recognition when the signal gets weaker," Geirhos et al.: https://t.co/xO2Ncey57Q "Expert and Non-Expert Opinion about Technological Unemployment," @TobyWalsh: https://t.co/zNFe6ywFNJ Very interesting to see a paper from a major tech company on how their advertisements work, and that it uses somewhat fancy deep learning... "Deep Interest Network for Click-Through Rate Prediction," Zhou et al., Alibaba: https://t.co/mmJMPwUfnh "Saliency Guided End-to-End Learning for Weakly Supervised Object Detection," Lai and Gong: https://t.co/UnJM0qDilQ "Policy Gradient Methods for RL with Function Approximation and Action-Dependent Baselines," Thomas and Brunskill: https://t.co/geh3SntYcg "Observational Learning by Reinforcement Learning," Borsa et al., DM: https://t.co/8YgO1g8W7C "Structure Learning in Motor Control: A Deep Reinforcement Learning Model," Weinstein and Botvinick, DeepMind: https://t.co/J8zXHrSXbV Grouping together June 21 and 22 papers, hope to get caught up in a few days, but for now, a handful from tonight... RT @y0b1byte: Model-free RL in a nutshell. https://t.co/25x1sTTEzi @davegershgorn this would be a great time for them to put up a blog post about DeepSkyNetCatcher @davegershgorn if someone who studies nerdy distinctions between weird AI scenarios won't nit pick about such things, who will? 🤖 May not catch up fully on arXiv for another day or so... TBD. @davegershgorn and I think way you put it is plausible guess of long-term tactics, just not literally true as stated. also, it's super hot here so grumpy @davegershgorn + shield-ness than 1 suggested there - more like, give everyone their own shields, not be a big shield themselves. But narrative evolving, @davegershgorn and yes, agree, hard to say from outside what is/isn't happening; based on remarks from Musk et al., though, I'd ascribe a diff. model of + @davegershgorn not against calling a (n ambitious) spade a spade; if anything, would find grander ascribed goal like "save world from bad AI" more accurate @davegershgorn sry if I'm being too literal, quite plausible @davegershgorn is it supposed to be cheeky? I read it as literal and false... :/ @davegershgorn still don't get how it's accurate to call that their mission... @davegershgorn I don't follow. Second part is a paraphrase of their mission, former is 1 imaginable route to that goal which there's no sign of them doing 😑 https://t.co/dQpc1qmNiK @davegershgorn strange characterization of OpenAI's mission (first/detect part) - AFAIK that's just one of several "special project" ideas they listed once @davegershgorn what part of ADVANCED don't you understand RT @McFaul: Instead of pondering Thucydides, how about discussing & hiring an Assistant Secretary for the region. Its the end of June. http… "RT @dennybritz: Learning about the world through video https://t.co/GdHxFCn3Hk Very cool new dataset by @twentybn" RT @timhwang: Tracking AI/ML progress: long discussed, no action. @EFF, as usual, is putting their code where their mouth is https://t.co/2… RT @DeepMindAI: Really excited to be launching a partnership with @MusgrovePark hospital to help deliver faster, better care: https://t.co/… RT @timhwang: dat targeted advertising 👏 https://t.co/UknYPH7asP "RT @Thucydiocy: The Thucydides Trap Is a load of crap. ""You can't blame me For tensions in the South China Seas,"" Says Thucydides." @_jyan_ consistent w/ Musk's portfolio model of addressing interplanetary, x-risk, and enviro stuff... but I do agree AI is especially important! @_jyan_ after sleeping on this... it's quite plausible that he'll continue collaborating with folks there-Tesla open-sources patents; OpenAI collabs RT @NandoDF: Prototypical Networks for Few-shot Learning - Simple and effective @kswersk https://t.co/mH1hRIuIXP RT @rbhar90: TL;DR open source will make drug discovery better, and there are a number of basic tools we can build to help! RT @rbhar90: I've written a new blog post: "Building the Open Source Drug Discovery Ecosystem" https://t.co/BqvKkf5hJl RT @pfau: Maluuba really missed an opportunity to call their multi-headed RL agent the HYbrid Deep Reward Architecture (think about it). "RT @jackclarkSF: Additional pubs with dedicated AI reporters: - CNBC - TechCrunch - VentureBeat https://t.co/6RIZIMggtb" More tomorrow or Thursday! Have some papers of my own to write ✍️ "Using deep learning to reveal the neural code for images in primary visual cortex," Kindel et al.: https://t.co/dsiPLEOCEh "Optimal modularity and memory capacity of neural networks," Rodriguez et al.: https://t.co/tICBKkfpVn Mysterious startup hint or just unusual phrasing? :) @DoctorJosh https://t.co/D2BRX32N24 "Scalable Co-Optimization of Morphology and Control in Embodied Machines," Cheney et al.: https://t.co/IhUv4bZfzf "User Intent Classification using Memory Nets: A Comparative Analysis for a Limited Data Scenario"-Bhardwaj+Rudnicky https://t.co/o3XZPXcO6g "Sub-domain Modelling for Dialogue Management w/ Hierarchical Reinforcement Learning," Budzianowski et al, Cambridge https://t.co/bVU4ih0hZ7 "Towards Proof Synthesis Guided by Neural Machine Translation for Intuitionistic Propositional Logic"-Sekiyama et al https://t.co/2W8FKkoedj "Data-Efficient Reinforcement Learning with Probabilistic Model Predictive Control," Kamthe and Deisenroth: https://t.co/3kJJfCFGcV "Inference in Deep Networks in High Dimensions," Fletcher and Rangan: https://t.co/GmcC9SaaOM "VAIN: Attentional Multi-agent Predictive Modeling," Yedid Hoshen, FAIR: https://t.co/TjhzmFKcIc "Generalization and Equilibrium in Generative Adversarial Nets (GANs)," Arora et al.: https://t.co/PtwohkDtox (updated ICML version) "Dualing GANs," Li et al.: https://t.co/PbQvUZUvCK Not to be confused with dueling GANs, aka GANs. Musk poaches from Musk. https://t.co/FCxiA2lh5n "Robust and Efficient Transfer Learning with Hidden-Parameter Markov Decision Processes," Killian and Dalton et al.: https://t.co/foovjduErd ...and "Grounded Language Learning in a Simulated 3D World," Hermann and Hill et al.: https://t.co/jhvX0qhuG3 Video: https://t.co/2B2PHBmp6T arXiv papers, June 21 - starting off with a pair of DeepMind papers, "Programmable Agents," @notmisha et al.: https://t.co/qUY38lOBIA Probably should have been transfer learning Tuesday, oh well (I told you I'd run out) It's Training Data Tuesday! "RT @dennybritz: Tesla hires deep learning expert Andrej Karpathy to lead Autopilot vision https://t.co/eEd6nyGRpK Congrats to the cool new…" @Dennis_CFE @Blondegirlfrnd thanks! @moyix thanks! @spudy12 @SwiftOnSecurity that does seem to be the consensus... @archinfosec @SwiftOnSecurity helpful, thx! @xieish @SwiftOnSecurity looking to draw the line somewhere short of everyone in all orgs :) point taken, though. @FemiAbodunde @SwiftOnSecurity @CyberDomain thx! @xieish @SwiftOnSecurity there are definitely big definition issues, but one could at least hope for a range of estimates for diff definitions, or just one w/ a def. Fin. I told you it was Many Papers Monday! "Rethinking Atrous Convolution for Semantic Image Segmentation," Chen et al.: https://t.co/iXrAQcHrfa "Accelerating Innovation Through Analogy Mining," Hope et al.: https://t.co/vrDi9MC4P3 "Fatiguing STDP: Learning from Spike-Timing Codes in the Presence of Rate Codes," Moraitis et al.: https://t.co/HfXzBYcQPL "A Large-Scale CNN Ensemble for Medication Safety Analysis," Akhtyamova et al.: https://t.co/bZ9x49gwO7 "Coresets for Vector Summarization with Applications to Network Graphs," Feldman et al.: https://t.co/qFjhPfMOKC "Rotation Invariance Neural Network," Shiyuan Li: https://t.co/pSnchdOXMb "Variants of RMSProp and Adagrad with Logarithmic Regret Bounds," Mukkamala and Hein: https://t.co/LEZCR3J59f "Truly Multi-modal YouTube-8M Video Classification with Video, Audio, and Text," Wang et al.: https://t.co/UrVX4NdmdT "Combining Stream Mining and Neural Networks for Short Term Delay Prediction," Grzenda et al.: https://t.co/FdZ8H4I3gG "Sample, computation vs storage tradeoffs for classification using tensor subspace models," Chaghazardi and Aeron: https://t.co/PAnAXuW2Aw "Kapre: On-GPU Audio Preprocessing Layers for a Quick Implementation of Deep NN Models with Keras," Choi et al.: https://t.co/BBx07pU1zH "Exploring Content-based Artwork Recommendation with Metadata and Visual Features," Messina et al.: https://t.co/tvRVlk6aiI "Look No Further: Adapting Experience History to the Temporal Characteristics of the Environment," Bruce et al.: https://t.co/LwUthwfW6a "An Empirical Study of Mini-Batch Creation Strategies for Neural Machine Translation," Morishita et al.: https://t.co/LvQijDJhHr "Dipole: Diagnosis Prediction in Healthcare via Attention-based Bidirectional Recurrent Neural Networks," Ma et al.: https://t.co/tFBY48otWX "Coupled 3D Convolutional Neural Networks for Audio-Visual Recognition," Torfi et al.: https://t.co/1yF5Ym1wFs "Addressing Item-Cold Start Problem in Recommendation Systems using Model Based Approach and DL," Obadic et al.: https://t.co/7Sl7IrYOHu "Using Deep Networks for Drone Detection," Aker and Kalkan: https://t.co/TaeqV3ycbN "Tversky loss function for image segmentation using 3D fully convolutional deep networks," Salehi et al.: https://t.co/YRCuHW3qB4 "Towards the Improvement of Automated Scientific Document Categorization by Deep Learning," Thomas Krause: https://t.co/OJYTPnt6s7 "Dimensionality Reduction using Similarity-induced Embeddings," Passalis and Tefas: https://t.co/ptY8wB23ZK "Sparse Neural Networks Topologies," Bourely et al.: https://t.co/ir5klMLhkt "Knowledge Transfer for Out-of-Knowledge-Base Entities: A Graph Neural Network Approach," Hamaguchi et al.: https://t.co/ZLFFjiVP9x "A Divide and Conquer Approach to Cooperative Distributed Model Predictive Control," Kong et al.: https://t.co/QREXMl9zhF "An Entropy-based Pruning Method for CNN Compression," Luo and Wu: https://t.co/JEzzPOcnLX "Control Variates for Stochastic Gradient MCMC," Baker et al.: https://t.co/jKdm3EHwsw "A framework for Multi-A(rmed)/B(andit) testing with online FDR control," Yang et al.: https://t.co/FUnF49d2kn "Deep learning-based numerical methods for high-D parabolic partial diff. equations + backward SDEs," E et al.: https://t.co/HoqHINWg9D "Solving Integer Linear Programs with a Small Number of Global Variables and Constraints," Dvorak et al.: https://t.co/o9ZR0nxbg1 "Recent Advance in Content-based Image Retrieval: A Literature Survey," Zhou et al.: https://t.co/2Or8prLEXs "Consistent feature attribution for tree ensembles," Lundberg and Lee: https://t.co/31mQle4Rx8 "Learning to Schedule Deadline- and Operator-Sensitive Tasks," Rosemarin et al.: https://t.co/Q7KEX2uhn8 "Guided Depth Upsampling for Precise Mapping of Urban Environments," Wirges et al.: https://t.co/PZIreodGwf "Massive Semantics to empower Touristic Service Providers," Akbar et al.: https://t.co/RJZ8HILXdO "Visual Decoding of Targets During Visual Search From Human Eye Fixations," Sattar et al.: https://t.co/O1nfhw0Vcp "Leveraging web resources for keyword assignment to short text documents," Singhal et al.: https://t.co/nFOx14byGA "Bayesian Joint Modelling for Object Localisation in Weakly Labelled Images," Shi et al.: https://t.co/aDqcI10RQm "Modified Frank-Wolfe Algorithm for Enhanced Sparsity in Support Vector Machine Classifiers," Alaiz and Suykens: https://t.co/pWYnVGGoxJ "'Everything I Disagree With is #FakeNews': Correlating Political Polarization+ Spread of Misinfo.," Ribeiro et al.: https://t.co/3xfhWTbL0B "Local Differential Privacy for Physical Sensor Data and Sparse Recovery," Gilbert and McMillan: https://t.co/KZStjk92OG "Fixed-Rank Approximation of a Positive-Semidefinite Matrix from Streaming Data," Trapp et al.: https://t.co/oqJdmgBaYM "Variational Inference Methods for Tweedie Compound Poisson Models," Yang et al.: https://t.co/P5QWdYrNMk "A deep learn.-inspired model of the hippocampus as storage device of the brain extended dataset" Alessandro Fontana https://t.co/Es1joGgcgo "Distributed synaptic weights in a LIF neural network and learning rules," Perthame et al.: https://t.co/UXtr431Jfw "Pedestrian Prediction by Planning using Deep Neural Networks," Rehder et al.: https://t.co/tK5GTpOO2v "Feature analysis of multidisciplinary scientific collaboration behaviors: A case study on PNAS," Xie et al.: https://t.co/8zVHAEMmXS "Synaptic mechanisms of interference in working memory," Zachary Kilpatrick: https://t.co/V2I0lvnygL "Learning image interest and saliency from pairwise image comparisons," Michael Burke: https://t.co/xYexa3U0oT "An a Priori Exponential Tail Bound for k-Folds Cross-Validation," Abou-Moustafa and Szepesvari: https://t.co/geWQ85A9R8 "Mirror descent in non-convex stochastic programming," Zhou et al.: https://t.co/vbJWz4QBRe RT @shaohua0116: I implemented Relation Network and Sort-of-CLEVR in @tensorflow proposed by @DeepMindAI please share&visit my GitHub https… RT @PatrickOmid: My @PyTorch implementation of Neural Combinatorial Reinforcement Learning is up 😃https://t.co/iqB8jrEtMp Bonus points for estimates at gov't agencies. Seeing lots of "there will be a bajillion unfilled jobs in 20XX" estimates, not actual data. Does anyone know of good data on the size of the global cybersecurity workforce? Stuff I've found so far is not very good. @ArtirKel haha https://t.co/qngpdKrAiq https://t.co/lWYsozmkXX Yay EFF. Also, more work is needed!! https://t.co/NWDHgnNUqP @davegershgorn interesting that DeepBlue was such an outlier/didn't visibly affect trend, I guess bc compute heaviness @davegershgorn sorry, 1875 @davegershgorn 2010 RT @EFF: When it comes to artificial intelligence, what's hype and what's real progress? We're gathering data to find out. https://t.co/M1O… RT @jackclarkSF: If you take a look you'll find some data compiled by myself and @Miles_Brundage in here. More data needed! https://t.co/sU… Working on a big interdisciplinary paper like https://t.co/6c8PI9RJ25 @botminds @rbhar90 @AlxCoventry @_jyan_ @pfau so it's definitely not "rare" but might be "relatively" rare :) Not sure, though, could be plurality or majority. Only used small sample @botminds no. @adam_will_do_it @samim Apple wears the pants in this relationship, and also is the pants @samim kinda get Google and FB locations but... @samim lol what does this mean? @rekmarks not speaking to public, but speaking publicly - he's surely well aware when there are cameras... "Huge, very large" https://t.co/ODaBivyGjl RT @markus_with_k: Our team at Berkeley AI Research (BAIR) is launching a blog, with weekly posts describing cutting-edge ML research https… @Sam_L_Shead + for a restrictive definition (eg masters/phd) are far fewer in # than that as free agents RN, so seems aspirational if true @Sam_L_Shead even if accurate measure of job listings mentioning AI, seems like it'd not capture AI ppl who are often recruited w/o listing @Sam_L_Shead ah, someone else tweeted a slide listing open jobs. Seems not exactly the same (many ppl hired w/o job listings, not all "AI ppl") but OK @Sam_L_Shead says who, Amazon? Based on what data on the Google side? "RT @ID_R_McGregor: Japanese Robot Sumo. I was aware of it, but had no idea it moved so fast. None of this footage has been sped up. htt…" RT @jackclarkSF: Read this guide! https://t.co/M32CgVmYYC @_jyan_ we should discuss this more but going to sleep :) @ThomasMiconi @fchollet +1 That's it for tonight! "Neural Phrase-based Machine Translation," Huang and Wang et al., MSFT: https://t.co/Ap3ZXMQhRh Few days ago - all attention. This - no attn "Bayesian Conditional Generative Adversarial Networks," Abbasnejad et al.: https://t.co/bQqACTowsI "Learning Hierarchical Information Flow with Recurrent Neural Modules," Hafner et al, Brain/DeepM: https://t.co/QPfO7xd1cx Thalamus-inspired "Gradient Diversity Empowers Distributed Learning," Yin et al.: https://t.co/b8cLTGMkbA "A Closer Look at Memorization in Deep Networks," Arpit, Jastrzebski, Ballas, and @DavidSKrueger et al.: https://t.co/0EfHe7eC15 "Expected Policy Gradients," Ciosek and Whiteson: https://t.co/iXoCi0E8m3 "Deep Counterfactual Networks with Propensity-Dropout," Alaa et al.: https://t.co/GIaCiP6S9u "SVCCA: Singular Vector CCA for Deep Understanding and Improvement," Raghu et al., Brain/Cornell/Uber: https://t.co/4YIXVzOngH "Dex: Incremental Learning for Complex Enviros. in Deep RL," Erickson+Zhao: https://t.co/EBqHwIjQtG RL enviro toolkit for continual learning arXiv papers, June 20 - "Towards Deep Learning Models Resistant to Adversarial Attacks," Mądry et al., MIT: https://t.co/j2DTMsj7f6 It's Many Papers Monday! Can't remotely get through them all tonight but will share a few... Stuff I've seen+/could quickly find relevant clips from, off of https://t.co/cX7i3eBaKr --> ~half inhuman, 1/4 human, 1/4 hard to classify. @_jyan_ @theophaneweber @fchollet @pfau https://t.co/gsqrXhQupw @theophaneweber @fchollet @_jyan_ @pfau Not comprehensive, but in that sample, seems like a bit more inhuman, but lots of hard cases. @theophaneweber @fchollet @_jyan_ @pfau Here's what I came up with - green = (leaning) humanlike, red = (leaning) inhuman, black = especially hard to classify or mixed/transition. https://t.co/JwRJvzQXQw @fchollet @theophaneweber @_jyan_ @pfau But examples keep coming up, so I'm going to code all of these I know the right label for: https://t.co/cX7i3eBaKr @fchollet @theophaneweber @_jyan_ @pfau I Robot counts b/c not full on android (I should have used that criterion, not humanoid), though Terminator and AI borderline "@theophaneweber @_jyan_ @pfau it did! Nice call... So we have (excluding humanoids) Her, Iron Man, 2001: A Space Odyssey*, Moon*, Interstellar *flattish affect" @benpopper TacoTron, DeepVoice 2 which incorporates TacoTron among other things. @AndreTI true - forgot about that, for some reason remembered it as robotic sounding. Ahead of its time in lots of ways... @_jyan_ @pfau + Samantha et al. in Her, prob. various others, but still the minority, I think. Sci-fi has imagined AI with various abilities, but human-like voices are relatively rare there. IRL, will happen before many other things. RT @Miles_Brundage: "Zero-Shot Task Generalization with Multi-Task Deep Reinforcement Learning," Oh et al.: https://t.co/LHfSCw0mSP RT @Miles_Brundage: "Value-Decomposition Networks For Cooperative Multi-Agent Learning," Sunehag et al., DeepMind: https://t.co/axQfythbaq "RT @AngeBassa: For twelve weeks of nine-to-five one-on-one instruction with Hinton himself? Absolutely. Otherwise, definitely no. https://…" RT @hardmaru: One Model to Learn Them All. Single model classifies ImageNet, NMT, Image Captioning, Speech Recognition, Parsing. https://t.… @adam_will_do_it @jackclarkSF I think Cameron Diaz teaching a class on AI history is more interesting than me being part of it... @adam_will_do_it @jackclarkSF lmao @jackclarkSF As noted there, subscribing to Import AI is a no-brainer: https://t.co/LnL4KZcuPJ @jackclarkSF More seriously, thanks for the Import AI shout out re: the AI policy/strategy career guide! (https://t.co/ivoC1YnOvw) @jackclarkSF (I swear, I only spent like five mins on that, colleagues) TFW @jackclarkSF calls you an AI paper tsar... https://t.co/cOxMlJJmCd RT @_brohrer_: Occasionally there is a radically new idea in ML. This is one. https://t.co/sTpr07yA5X "RT @brianklaas: Time between London van attack by Muslims & angry Trump tweet: 1 hour Time between London van attack killing Muslims & any…" @ivan_bezdomny congrats! @nonsensews @_jyan_ ...maybe > productive than if placed elsewhere, can talk to ppl at various places/share ideas. Though DM has high internal concentration too @nonsensews @_jyan_ prob should have said network effects, not econs of scale. meant something like: a given person working in DL in place where many DL ppl... @_jyan_ more generally, they prob benefit from Bay Area economies of scale of deep learning ppl @_jyan_ do they publish more papers? Seems plausible but haven't looked closely at that. Yeah, GB can collab more easily, but some DM-GB/GR collab 2 @_jyan_ I'd say DM demonstrated plausibility of deep RL, DL itself Google Brain probably gets more credit for than DM (as do Hinton/MILA/etc.) @_jyan_ what do you mean by resource? people? hardware? DM has more people, and both draw on same (or at least similar) compute pools AFAIK... Fin. "Interactive 3D Modeling with a Generative Adversarial Network," Liu et al.: https://t.co/gz2rVD1AoV "A Fully Trainable Network with RNN-based Pooling," Li et al.: https://t.co/1dxNFSGIRR "The Monkeytyping Solution to the YouTube-8M Video Understanding Challenge," Wang et al.: https://t.co/S2v4nW6epc "Veiled Attributes of the Variational Autoencoder," Dai et al.: https://t.co/1wABbsDnT9 "AI-Powered Social Bots," Terrence Adams: https://t.co/g5aH8MSfw4 "An Automatic Approach for Document-level Topic Model Evaluation," Bhatia et al.: https://t.co/bhYjf06jiX "Deal or No Deal? End-to-End Learning for Negotiation Dialogues," Lewis et al., FAIR/Georgia Tech: https://t.co/dT9maAKSIo "Deriving Compact Laws Based on Algebraic Formulation of a Data Set," Xu and Stalzer: https://t.co/zzyY0sb2Cv "A Mixture Model for Learning Multi-Sense Word Embeddings," Nguyen et al.: https://t.co/jssaGl717h @_jyan_ wouldn't call that a "leak", big conference :) but yeah, good connection btwn the two @_jyan_ perhaps! Will be interesting to see. "Bib2vec: An Embedding-based Search System for Bibliographic Information," Yoneda et al.: https://t.co/o7bIWUlCjE "Personal Food Computer: A new device for controlled-environment agriculture," Ferrer et al.: https://t.co/0KNGgZUJMZ Evaluating Noisy Optimisation Algorithms: First Hitting Time is Problematic," Lucas et al.: https://t.co/RgSnIKzUWu "Plan, Attend, Generate: Character-level Neural MT w/ Planning in the Decoder," Gulcehre+Dutil et al., MILA/Maluuba: https://t.co/ANPN0JiM9f @_jyan_ doesn't nec. imply some big project @_jyan_ May not have been finished at this point. In any case, lots of papers say there are areas for further improvement etc. "Ensembling Factored Neural MT Models for Automatic Post-Editing and Quality Estimation," Chris Hokamp: https://t.co/3SWISJscLq "Topic supervised non-negative matrix factorization," MacMillan and Wilson: https://t.co/BGMYjEUgL5 "Joint Extraction of Entities and Relations Based on a Novel Tagging Scheme," Zheng et al.: https://t.co/mwX6lrD2Gv "Learning Disjunctions of Predicates," Bshouty et al.: https://t.co/riJNxts5dI "Face Clustering: Representation and Pairwise Constraints," Shi et al.: https://t.co/3wSOsKHTIE "A new look at clustering through the lens of deep convolutional neural networks," Borji and Dundar: https://t.co/Dnk8zyA37B "Distributed Transfer Linear Support Vector Machines," Zhang and Zhu: https://t.co/LusW3SBGDM "Hierarchical Label Inference for Video Classification," Nauata et al.: https://t.co/SwkDKg9NMO "Extracting Formal Models from Normative Texts," Camilleri et al.: https://t.co/RV1ewLsPOb "Measuring Personalization of Web Search," Hannak et al.: https://t.co/oefRdA1yU1 "The Evolution of Neural Network-Based Chart Patterns: A Preliminary Study," Ha and Moon: https://t.co/yoQUjWCF41 "Robotic Ironing with 3D Perception and Force/Torque Feedback in Household Environments," Estevez et al.: https://t.co/3g0HwYeTWZ Junhyuk Oh strikes again! His "Action-Conditional Video Prediction using Deep Networks in Atari Games" made a splash a while back... "Zero-Shot Task Generalization with Multi-Task Deep Reinforcement Learning," Oh et al.: https://t.co/LHfSCw0mSP "Perceptual Generative Adversarial Networks for Small Object Detection," Li et al.: https://t.co/2BxIP9VTFG "From Propositional Logic to Plausible Reasoning: A Uniqueness Theorem," Kevin Van Horn: https://t.co/HwFQoEJyrb "Dynamic Filters in Graph Convolutional Networks," Verma et al.: https://t.co/Ao0P98iPac "Self-ensembling for domain adaptation," French et al.: https://t.co/eSGzq0mtwV "Structured Best Arm Identification with Fixed Confidence," Huang et al.: https://t.co/9stS17b4gN "Improving Scalability of Inductive Logic Programming via Pruning and Best-Effort Optimisation," Kazmi et al.: https://t.co/4VpUL1Ow4n "Biased Bagging for Unsupervised Domain Adaptation," van Laarhoven and Marchiori: https://t.co/0fJPFr4vBf "An Overview of Multi-Task Learning in Deep Neural Networks," @seb_ruder: https://t.co/5iORSvdmVG "Generalization for Adaptively-chosen Estimators via Stable Median," Feldman and Steinke: https://t.co/94gt0wYKqr "Learning with Feature Evolvable Streams," Hou et al.: https://t.co/9z0awFYArP "Multispectral and Hyperspectral Image Fusion Using a 3-D Convolutional Neural Network," Palsson et al.: https://t.co/DOQIbsRb4b "L2 Regularization versus Batch and Weight Normalization," Twan van Laarhoven: https://t.co/28oV2SBoxB "Local Feature Descriptor Learning with Adaptive Siamese Network," Huang et al.: https://t.co/evOjoh5WjF "Deep Generative Models for Relational Data with Side Information," Hu et al.: https://t.co/4OXnNKB5BH "Value-Decomposition Networks For Cooperative Multi-Agent Learning," Sunehag et al., DeepMind: https://t.co/axQfythbaq "arXiv papers, June 19 - ""One Model To Learn Them All,"" Kaiser et al., Google Brain/Research: https://t.co/GTb9EaExKy 1⃣🤖✍️👀👂" It's "So, Miles won't be going to bed early" Sunday! Some wild stuff on arXiv. @ivan_bezdomny good luck! @GarrulousGeoff well, that does cover a pretty wide range of scenarios... @fchollet doesn't preclude subgoals, intrinsic motivation etc but arbitrary goal generation seems hard to evaluate/consider intelligence-y @fchollet at some point, though, having more precise def useful in measuring prog/making things empirical etc -fixing goals 1 way to do that @fchollet I agree, insofar as I use my vague definition, the mileage I get out of it is just more impressedness from more general approaches @fchollet some of it is definitely inside the border tho IMO @fchollet (a la Legg/Hutter 2007 but more informal)... agree we shouldn't be too restrictive, just seems like goal generation is borderline @fchollet think that's where we differ then :) not dogmatic about it but v roughly think of it as ability to achieve many goals in many envs @fchollet if any @fchollet what's your definition of intelligence? @fchollet certainly a big part of being human, whether or not it fits under intelligence banner @fchollet seems like more of a wisdom thing in the general case, bordering on ethics in some cases, than intelligence per se, no? @fchollet agree for cases where it can increase intelligence/achievement, but more broadly, goal creation as intelligence seems problematic- @iamtrask that is interesting! could you clarify? are you talking about initialization? or local minima? any references? :) (not that philosophy is irrelevant to AI... a lot of it is.. I'm just not focusing on that subset in this rabbit hole RN) Talking to a new philosopher sent me down a philosophy rabbit hole for the last few hours... help, tell me something interesting about AI :) RT @anorangeduck: Complete code and data now avaliable for Phase-Functioned Neural Networks for Character Control! https://t.co/5PRLimaIEB… RT @TheGradient: We just put online all the talks for NIPS 2016 workshop on nonconvex optimizations. Do not miss the amazing talks: https:/… RT @RealAAAI: #AAAI2018 Call for Papers Released . Abstract/Paper deadlines 9/8 & 9/11. Submission length increased! https://t.co/L6f8ddo0… "RT @BKCHarvard: We're looking for a Project Coordinator to help advance our work on the Ethics & Governance of #AI at @Harvard https://t.co…" RT @ACLU: The ACLU will not be scaling back https://t.co/K9MpLo0NQH @lidija_sekaric yep :) @juliagalef how is corgicon a thing and why don't they have a world/Oxford tour? It's Sunny Saturday! https://t.co/fOE6qnJbSU RT @rxflg: The best laid plans... #Caturday @20committee https://t.co/HUp08v5GJT RT @balajiln: Check out new paper with @DeepMindAI colleagues @elaClaudia, @dwf, @shakir_za on understanding connections between auto-encod… @jackclarkSF (or super successful cloud provider, perhaps) @jackclarkSF discussed something similar recently re: resistance to automation...now no 1 target for opposition, DJI for service automation could change RT @jackclarkSF: Prediction: At some point there's gonna be a DJI-style company for little home robot arms and Rhoomba-lites that are progr… @gwern astute compute. @pfau haha :) That was one of my favorites. Also menacing inhaler [of data]. ...manage chin liner, Manila cringe hen, angelic harem inn, and anal cheer mining. Some good anagrams of machine learning: menacing inhaler, a channeling emir, arcane hem lining, cranial hinge men, annealing rich me... @samim haha nice :) *old man voice* back in my day, people used logical approaches for logical things... This is cool, but also note that sudoku is easy. Did this for class without neural nets and I suck at programming... https://t.co/fTMXf1493R Nice short TED talk by philosopher Neil Sinhababu on moral luck - enjoyed meeting him earlier: https://t.co/nkCloJYSCz Enjoying this interview with @timhwang: https://t.co/toxjvVmzDc @L_badikho maybe also something to do with academic calendars, students Googling stuff for class... @L_badikho (I really don't know, though, good Q) @L_badikho ICML? @L_badikho (there's a peak in late January, which is around the same time) @L_badikho I think it might be the AlphaGo Nature publication. @kwlzn @ogrisel Christmas and Thanksgiving, is what I've been told RT @goodfellow_ian: Another paper showing that several proposed defenses against adversarial examples don't hold up to scrutiny: https://t.… @timhwang ooo! RT @magnord: 1. Is SELU (https://t.co/8OM9jd5AIF) better than ReLU for reinforcement learning? TLDR: Probably not. Details in following twe… RT @timhwang: Favorite paper of the week is, of course, the joint @OpenAI - @DeepMindAI piece on low-cost human oversight in RL https://t.c… RT @DeepMindAI: New work exploiting target derivatives: better distillation, sample complexity, and SynthGrad training of ImageNet! https:/… RT @SophieCFischer: Comprehensive reading guide on the ethics, politics, economics and governance of #AI compiled by the Global Politics of… Post on what deep learning can't do - https://t.co/dPnl8wBdyD "Generally agree with the AI isn't magic narrative, butttttt fruit dinosaurs complicate the picture a bit :) https://t.co/m06IzbLDT0" RT @chrisrodley: More AI-generated creatures! Dinosaurs X 19th century engravings of fruit 🐉🍓 https://t.co/pwiVSJHZU9 @EricBattenberg oh, zucchini was also more popular, I think, though not potatoes level @_jyan_ (Cousin It) @_jyan_ It https://t.co/02E5OY2zFf @EricBattenberg potatoes are way too popular :) think that's it. Forgot the S in Brussels sprouts the first time. Turns out that correctly spelled Brussels sprouts are less popular, DL ahead since 2015. https://t.co/7maG3edPsa @hivehum @vondellswain Thanksgiving and Christmas have been suggested as hypotheses "RT @dlowd: @Miles_Brundage Brussels sprouts are the same size as 11-week-old fetuses: https://t.co/BVGaeArsGv ...so in 29 weeks we should…" This is a Very Serious Metric. #SquadGoals Deep learning will soon be more popular than Brussels sprouts. https://t.co/GFA8tsvqJh @makc3d @hardmaru there is a point (it's a career guide - to help people move into AI policy), but not the one you said. look at it if interested :) RT @hardmaru: These kind of weapons development reminds me of the article written by @Miles_Brundage & why AI Policy is important. https://… RT @enricoferrero: Had a great time contributing to the collaborative writing of this review of #deeplearning in biology and medicine! http… Backstory on the FreezeOut paper in this batch: https://t.co/dIAEsWhutT That's it for this week! https://t.co/t7DQJQD0g1 "Learning Deep ResNet Blocks Sequentially using Boosting Theory," Huang et al.: https://t.co/Z5uK2iJski "DOTE: Dual cOnvolutional filTer lEarning for Super-Resolution and Cross-Modality Synthesis in MRI," Huang et al.: https://t.co/7fP73wNpiE "Multi-objective Bandits: Optimizing the Generalized Gini Index," Busa-Fekete et al.: https://t.co/PMFvFIfyoA "DSRIM: A Deep Neural IR Model Enhanced by a Knowledge Resource Driven Representation of Documents," Nguyen et al.: https://t.co/3ZLZfS4c0n "A survey of cross-lingual embedding models," Sebastian Ruder: https://t.co/eP91Hlz61R "Distributed Differential Privacy By Sampling," Joshua Joy: https://t.co/Zy30uL2sP1 "Arabian Horse Identification Benchmark Dataset," Taha et al.: https://t.co/ClRz5wCZe1 "Towards Grounding Conceptual Spaces in Neural Representations," Bechberger and Kuhnberger: https://t.co/7lsCCnYxN2 "S-Net: From Answer Extraction to Answer Generation for Machine Reading Comprehension," Tan et al.: https://t.co/3KAtQtfraM "Foveated Video Streaming for Cloud Gaming," Illahi et al.: https://t.co/IuV0ru5TJu "Holistic Planimetric prediction to Local Volumetric prediction for 3D Human Pose Estimation," Moon et al.: https://t.co/GfmdujCctG "Suggestive Annotation: A Deep Active Learning Framework for Biomedical Image Segmentation," Yang et al.: https://t.co/GNESk8lah1 "Target Curricula via Selection of Minimum Feature Sets: a Case Study in Boolean Networks," Fenn and Moscato: https://t.co/kOMqYK599C "Recent Progress of Face Image Synthesis," Lu et al.: https://t.co/wsu12EaQht "Adversarial Example Defenses: Ensembles of Weak Defenses are not Strong," He et al.: https://t.co/geCZxCsVqE "Planning with Verbal Communication for Human-Robot Collaboration," Nikolaidis et al.: https://t.co/Eoh2JQosZK "Adaptive Feature Selection: Computationally Efficient Online Sparse Linear Regression under RIP," Kale et al.: https://t.co/7sHwMfsG60 "Learning a visuomotor controller for real world robotic grasping using easily simulated depth images"-Viereck et al https://t.co/TxvHu7QDTe "Proximal Backpropagation," Frerix et al.: https://t.co/f3yccUcxF5 "Bias and high-dimensional adjustment in observational studies of peer effects," Eckles and Bakshy: https://t.co/Sfnob306hp "Accelerated Extra-Gradient Descent: A Novel Accelerated First-Order Method," Diakonikolas and Orecchia: https://t.co/0iieWfxP6k """Research Topics Map: rtopmap,"" Hossain and Kobourov: https://t.co/88oYxnOrqS https://t.co/NbRekSkYNA" "Information Potential Auto-Encoders," Zhang et al.: https://t.co/brPdMxwmHo "Differentially Private Learning of Undirected Graphical Models using Collective Graphical Models," Bernstein et al. https://t.co/gnPZiizHo7 "Reinforcement Learning under Model Mismatch," Roy et al.: https://t.co/kUKCCoPMnA "A Practical Method for Solving Contextual Bandit Problems Using Decision Trees," Elmachtoub et al.: https://t.co/mj2w6j82wV "Stochastic Gradient MCMC Methods for Hidden Markov Models," Ma et al.: https://t.co/W1jr3L56dc "Stochastic Training of Neural Networks via Successive Convex Approximations," Scardapane and Di Lorenzo: https://t.co/NbCQirkLo5 "Robust Submodular Maximization: A Non-Uniform Partitioning Approach," Bogunovic et al.: https://t.co/1cqMT4w00E "Second-Order Kernel Online Convex Optimization with Adaptive Sketching," Calandriello et al.: https://t.co/9x4SZww8of "Generalized Bouncy Particle Sampler," Wu and Robert: https://t.co/lpAtx0BioV "Average of Recentered Parallel MCMC for Big Data," Wu and Robert: https://t.co/E7pQdl042B "Computational models of long term plasticity and memory," Stefano Fusi: https://t.co/qxpEqETTy7 "Gradient Descent for Spiking Neural Networks," Huh and Sejnowski: https://t.co/2d6NOQ7kju "FreezeOut: Accelerate Training by Progressively Freezing Layers," Brock et al.: https://t.co/kPtqD5Xjv0 *Mirhoseini and Pham et al. for that one "Variational Approaches for Auto-Encoding Generative Adversarial Networks," Rosca and @balajiln et al., DeepMind: https://t.co/H1vO80I7IW "Sobolev Training for Neural Networks," Czarnecki et al., DeepMind: https://t.co/LoZucgdFNA AKA machine learning to figure out where to run your machine learning models... arXiv papers, June 16 - "Device Placement Optimization with Reinforcement Learning," Mirhoseini and Pham, G. Brain: https://t.co/e2Syl2S600 It's There are several Alphabet papers Thursday! @hardmaru +9,000 RT @RebeccaCrootof: Because I can only go so long without writing something about #AWS. https://t.co/56dzCPa88E RT @SmithaMilli: Well, that's one way to explain complex machine learning models https://t.co/IyccMmIiw7 RT @seb_ruder: For everyone interested in optimization with SGD, I updated my blog post with descriptions of AdaMax and Nadam https://t.co/… RT @vkrakovna: An extensive guide to careers in AI policy from 80,000 Hours https://t.co/fQdEGXgaDc RT @iamaidang: Code for Transformer, SliceNet and the soon to be announced MultiModel will be available shortly at: https://t.co/3KFY8fU2ci! Wild stuff from folks at Rutgers. https://t.co/YYyLrkXVk1 https://t.co/CZiRCsab0O "The two children are eating the balloon animal" and "A woman is trying on a microscope" are my faves. These are unusually entertaining GAN text samples for some reason (braces for GAN-text tomatoes) https://t.co/UvbDLyZdcC https://t.co/TSoAatFeeJ @katyanna_q 👍 RT @timhwang: loved doing this piece for @logic_magazine, diagnosing the legacy of mid-2000s beliefs in “the wisdom of the crowds” https://… @timhwang @AwesomeOttawa you proved my point, though, that was great content @timhwang @Canada2020 *he is advising RT @timhwang: 🎉 AI/ML People: On stage w Yoshua Bengio later today for the @Canada2020 conference! Questions I should ask? Stream: https://… @timhwang @Canada2020 how/why he advising 12094 companies (not sure if you should actually ask this but it's something I think about :) ) @_jyan_ @davegershgorn haha I wouldn't worry about a Snaptelligence explosion @timhwang @AwesomeOttawa can you explain how you consume information at some point for the rest of us who are less interesting? :) RT @moyix: @Miles_Brundage Has anyone tried using retweets and likes as a reward signal? It works pretty well for humans... @moyix Dunno! RT @santoroAI: Very cool (and rapid!!) progress: third-party implementation of an RN claiming some amazing results on NLVR https://t.co/wJh… @_jyan_ hah "RT @dnraposo: MIT Tech Review wrote a nice piece about our recent paper on relational reasoning! https://t.co/jCSpcbtZ8o" RT @machinestarts: DeepMind AI learns like a toddler! Nice method of training - humans judge early progress, AI learns based on that https:… @graphific thx! :) RT @NicolasPapernot: A new blog post with @goodfellow_ian explaining some of the challenges faced when verifying machine learning models: h… @swapanj162 @80000Hours this also covers related topics a bit https://t.co/q8L0GwuynH @swapanj162 @80000Hours not aware of one on AI research in general, though here's a syllabus on AI safety in particular - https://t.co/MrqF1O9ZDd @_jyan_ haven't read closely yet :( @AlxCoventry @jackclarkSF @hardmaru haha I love it RT @goodfellow_ian: New blog post with @NicolasPapernot on why verification methods for machine learning are so difficult: https://t.co/JgC… @jackclarkSF @hardmaru might create some negative externalities if ppl dont see corrections, but as you say, success rate hopefully goes up @jackclarkSF @hardmaru and twitter is useful for that - I expect ppl to point out issues so OK promoting stuff then correcting later @thinkmariya I can't take credit for the general concept/term of interactional expertise, just that application it :) glad you like it! @hardmaru same. @rubinovitz @hardmaru as I promote some, but alas, I rely on the hivemind a lot :) @rubinovitz @hardmaru 1. do i know the people? 2. is it deep RL? did ppl retweet a lot/say nice things about it? last part is a bit circular @ThomasMiconi @hardmaru @80000Hours haha I wish I could read even a quarter of all the stuff I tweet... @hardmaru everyone does! But those who are AI wokest know that they are not woke ;) many ppl propagate fake AI news and never realize it @mark_riedl maybe not suitable for NNs though @mark_riedl use existing stuff like Scratch's design? https://t.co/th3adRp4zw RT @mark_riedl: In my spare time I am implementing a visual programming language for neural networks. https://t.co/ScAWfSbOm7 Paul Christiano post on AI corrigibility: https://t.co/6nslnIhtSw @hannahgais lol this is so painful. Why do people follow him again? Fin. "Learning and Evaluating Musical Features with Deep Autoencoders," Bretan et al., GA Tech/Google: https://t.co/fqBujb4fkh "Identifying Condition-Action Statements in Medical Guidelines Using Domain-Independent Feat's," Hematialam+Zadrozny https://t.co/HuJnHLkurx "Modeling Multimodal Clues in a Hybrid Deep Learning Framework for Video Classification," Jiang et al.: https://t.co/gT9mEYR0dL "Learning local shape descriptors with view-based convolutional networks," Huang et al.: https://t.co/Nf3TgPB9YM "Large-Scale YouTube-8M Video Understanding with Deep Neural Networks," Akopyan and Khashba: https://t.co/eSaT1RMbsM "Idea density for predicting Alzheimer's disease from transcribed speech," Sirts et al.: https://t.co/4ASuW0zoM5 "Empirical Analysis of the Hessian of Over-Parametrized Neural Networks," Sagun et al.: https://t.co/S0x5p8chZp "Hybrid Collaborative Recommendation via Semi-AutoEncoder," Zhang et al.: https://t.co/KzPT8jiSGS "ν-net: Deep Learning for Generalized Biventricular Cardiac Mass and Function Parameters," Winther et al.: https://t.co/gVBSCneBpG "Fine-grained human evaluation of neural versus phrase-based machine translation," Klubicka et al.: https://t.co/qd2W7k9UnI "Zoom-in-Net: Deep Mining Lesions for Diabetic Retinopathy Detection," Wang et al.: https://t.co/kFofCFaGeG "Multi-Lane Perception Using Feature Fusion Based on GraphSLAM," Abramov et al.: https://t.co/nCuWOBAQDT "MATIC: Adaptation and In-situ Canaries for Energy-Efficient Neural Network Acceleration," Kim et al.: https://t.co/l2PxzohrsX "Transfer Learning for Neural Semantic Parsing," Fan et al., Amazon: https://t.co/jLzR0uGrh4 "RoboCup 2D Soccer Simulation League: Evaluation Challenges," Prokopenko et al.: https://t.co/bTe4cUFfgO "Photo-realistic Facial Texture Transfer," Kaur et al.: https://t.co/juYPsHPWLc "Accurate Pulmonary Nodule Detection in Computed Tomography Images Using Deep CNNs," Ding et al.: https://t.co/n0aEW1XxAC "When Image Denoising Meets High-Level Vision Tasks: A Deep Learning Approach," Liu et al.: https://t.co/ub0Ov2OXuH "Teaching Compositionality to CNNs," Stone et al.: https://t.co/lC64MzqWcG (also Vicarious) "Schema Networks: Zero-shot Transfer with a Generative Causal Model of Intuitive Physics," Kansky et al: https://t.co/ZVpkytAoT2 (Vicarious) "Action Search: Learning to Search for Human Activities in Untrimmed Videos," Alwassel et al.: https://t.co/HBWt6YwU5b "Transfer entropy-based feedback improves performance in artificial neural networks," Herzog et al.: https://t.co/4hpkNQXm2D "von Mises-Fisher Mixture Model-based Deep learning: Application to Face Verification," Hasnat et al.: https://t.co/qqzZ8aDx12 (guess I should have said the twenty billionth) (from the startup twentybn, apparently the 230489th company Yoshua Bengio advises) "The 'something something' video database for learning and evaluating visual common sense," Goyal et al.: https://t.co/MqPWL0ICd0 "Online Convolutional Dictionary Learning for Multimodal Imaging," Degraux et al.: https://t.co/1SW1iywuLS "Automatic Localization of Deep Stimulation Electrodes Using Trajectory-based Segmentation Approach," Nieto et al.: https://t.co/NYOl92UMR5 "Adversarially Regularized Autoencoders for Generating Discrete Structures," Zhao et al.: https://t.co/Ce0MHNqWba "Identifying Spatial Relations in Images using Convolutional Neural Networks," Haldekar et al.: https://t.co/TvnoNlhbGS "Sampling-Based Optimal Control Synthesis for Multi-Robot Systems under Global Temporal Tasks," Kantaros + Zavlanos: https://t.co/SzIOL4PzLS "Neural Models for Key Phrase Detection and Question Generation," Subramanian et al.: https://t.co/XOyo53EzrM (also Maluuba) "Hybrid Reward Architecture for Reinforcement Learning," van Seijen et al.: https://t.co/x77diwKzlX (the Ms. Pac Man Maluuba paper) "Evaluating Personal Assistants on Mobile devices," Kiseleva and de Rijke: https://t.co/VHKrR6MfCp "Reinforcement learning account of network reciprocity," Ezaki and Masuda: https://t.co/Q5X7vWzkWj "On Calibration of Modern Neural Networks," Guo et al.: https://t.co/htEqQVMztr "Deep Learning Methods for Efficient Large Scale Video Labeling," Skalic, Pekalski, and Pan: https://t.co/aonjrUfaah "A Fast Foveated Fully Convolutional Network Model for Human Peripheral Vision," Fridman et al.: https://t.co/qHXeq1jNgW "Optimization by a quantum reinforcement algorithm," A. Ramezanpour: https://t.co/WyQyWK6B4Q "Leveraging Node Attributes for Incomplete Relational Data," Zhao et al.: https://t.co/lFaTCqHZTt "Provable benefits of representation learning," Arora and Risteski: https://t.co/u5lSrYKbwg "Accelerated RL Algos w/ Nonparametric Func. Approximation 4 Opportunistic Spectrum Access," Tsiligkaridis+Romero: https://t.co/a75qeVaaGc "On Optimistic versus Randomized Exploration in Reinforcement Learning," Osband and Van Roy: https://t.co/0k9ajXu8VJ (I love the phrase webly-supervised. No, it's not a typo, no, this isn't the first use of it, and yes, it means what you'd probably guess) "Learning without Prejudice: Avoiding Bias in Webly-Supervised Action Recognition," Rupprecht et al.: https://t.co/dn3NycsftO arXiv papers, June 15 - "SEARNN: Training RNNs with Global-Local Losses," Leblond et al.: https://t.co/QxCvztMadX Maluuba and Vicarious made my "Find: reinforcement" exercise on the arXiv CS page more anti-climactic than usual today :( @mark_riedl haha, I was going to say something earlier... "breakthrough" as red flag. RT @Zergylord: @Miles_Brundage The feature engineering makes all deep learning comparisons dubious. They should compare against other "obje… @etzioni @StocktonSays I assume this should say it was just accepted (not presented)? https://t.co/hTsUYM14ZV @adam_will_do_it not sure that pupper would be very helpful with this. But it is an RL system... RL system for telling you which RL stories to care about today... "RT @ylecun: AI agents learn to negotiate through dialogs using reinforcement learning. Paper here:... https://t.co/pBsRaQleu1" @jackclarkSF @tsimonite @samim Peter Dayan gave a list of untried reinf. learning ideas at AAAI this year, too (though seems he/DeepMind are working through them ASAP)... @samim @KaiLashArul I've joked (but not rly) before that the best way to accelerate AI progress would be to stop publication for a few months so ppl can read ;) RT @NipsConference: One day left to submit a #NIPS2017 tutorial proposal! https://t.co/rzJvfvY7fu RT @KaiLashArul: @Miles_Brundage Their system also has issues of its own that DRL can deal with OK. Next steps could easily be replacing so… RT @KaiLashArul: @Miles_Brundage I like it. Whole lot of hand-engineering, but they really nailed some holes with current DRL systems. (haven't read it closely yet) Anyone have thoughts on the Vicarious paper? This is basically what happened w supercomputing HW, or at least that's a story I've heard (haven't looked closely): https://t.co/k4O0Gake94 RT @KaiLashArul: @Miles_Brundage https://t.co/oQZxC73OlG RT @Miles_Brundage: Working with folks at @80000Hours, I wrote a guide to careers in AI policy/strategy. Check it out here: https://t.co/iv… @steverathje2 @FLIxrisk @BillyRathje1 @80000Hours @elonmusk thanks! :) (I'm an Atari evaluation fan, just an unusual amount in one day) It's Why is Atari suddenly hot again Wednesday! @davegershgorn there was also this last year - https://t.co/9AKBnZhpam @steverathje2 @FLIxrisk @BillyRathje1 @80000Hours "sorely" needed? ;) I didn't write that headline so not wedded to it, but there are very few such people and many open problems @AMP_SV thanks! :) Flagging again for the CA crowd just waking up :) https://t.co/i8khZ3YkKa @seb_ruder @dennybritz @80000Hours thanks! :) RT @singularityEvnt: @Miles_Brundage Interesting work, but I wonder how many reward functions would be required to solve a more complicated… And as @botminds notes, didn't blow away the *very* best human, but that's pretty hard. Def >> average Would like to see results on many games w/ same sort of hand coding or learned foci @botminds @_jyan_ sure, almost all humans though. As noted by @singularityEvnt, there is hand crafting - maybe still broader applicability? They said ~"have an agent attend to each of these" @mrdrozdov (folding chocolate on conveyor belt or whatever Lucy and Ethel were doing = reading papers) @mrdrozdov it's intended to just refer to the insane stream of papers and the difficulty of keeping up @singularityEvnt basically they just said "here are things to pay attn to" @singularityEvnt true, some handcrafting - do you think the technique could have wider use though, or learn the reward decomp? @_jyan_ after they learn to zero out people's accounts... unless you count algo trading (not really maxing though) Impressive - Hybrid Reward Architecture blows away A3C and humans on Ms. Pac Man: https://t.co/B5tIwZAgKJ RT @FHIOxford: Interested in AI strategy as a career? Great podcast/article from @80000Hours interviewing @Miles_Brundage https://t.co/QQAU… @80000Hours See also 80,000 Hours's job board, which lists some promising opportunities open right now at DeepMind, UCLA, etc.: https://t.co/fSAG7P2VJS @terahlyons @80000Hours thanks! :) RT @terahlyons: A great primer by @80000Hours and @Miles_Brundage on the growing field of individuals shaping the future of AI: https://t.c… @80000Hours Related interview: https://t.co/FLInnIrt04 Working with folks at @80000Hours, I wrote a guide to careers in AI policy/strategy. Check it out here: https://t.co/ivoC1Y6dDY @psygnisfive damn it, do I have to watch it now? Fin. "Temporally Efficient Deep Learning with Spikes," O'Connor et al.: https://t.co/YJupSrWHOe "Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networks," Quadrana et al.: https://t.co/n61O5mvUru "Hardening Malware Detection Systems Against Cyber Maneuvers: An Adversarial Machine Learning Approach," Chen et al: https://t.co/RqEXjyjH7Z "Prediction of Muscle Activations for Reaching Movements using Deep Neural Networks," Khan and Stavness: https://t.co/VlCkTbp1EW "Predicting Research that will be Cited in Policy Documents," Kale et al.: https://t.co/jEgbIsso3u "An Exploration of Neural Sequence-to-Sequence Architectures 4 Automatic Post-Editing," Junczys-Dowmunt+Grundkiewicz https://t.co/KSWkQVlo89 "Video Imagination from a Single Image with Transformation Generation," Chen et al.: https://t.co/c9L8Fcj8En "From MEGATON to RASCAL: Surfing the Parameter Space of Evolutionary Algorithms," Sipper et al.: https://t.co/Qei57xIwAv "Joint Max Margin and Semantic Features for Continuous Event Detection in Complex Scenes," Abbasnejad et al.: https://t.co/bokmjnniGg "Zero-Shot Relation Extraction via Reading Comprehension," Levy et al.: https://t.co/V0FS5fqeLn "Beyond Monte Carlo Tree Search: Playing Go with Deep Alternative NN and Long-Term Evaluation," Wang et al.: https://t.co/ecMBrWwOKh "On Natural Language Generation of Formal Argumentation," Cerutti et al.: https://t.co/9hYAHBRHCt "Recurrent Inference Machines for Solving Inverse Problems," Putzky and Welling: https://t.co/6bPwPgz0z4 "Getting deep recommenders fit: Bloom embeddings for sparse binary input/output networks," Serrà and Karatzoglou: https://t.co/j6fgSbx67d "RELink: A Research Framework and Test Collection for Entity-Relationship Retrieval," Saleiro et al.: https://t.co/sKsMv6jPR8 "Modelling prosodic structure using Artificial Neural Networks," Bernandy et al.: https://t.co/UEND0FJA3c "Accelerated Dual Learning by Homotopic Initialization," Daneshmand et al.: https://t.co/jr70Iq1DOd "Long-Term Video Interpolation with Bidirectional Predictive Network," Chen et al.: https://t.co/CaYuh0byjF (that one's from Snap and co) "SEP-Nets: Small and Effective Pattern Networks," Li et al.: https://t.co/N3eb3AJHWr "Item Difficulty-Based Label Aggregation Models for Crowdsourcing," Chi Hong: https://t.co/l5VTylqH7f (first time I've seen an arxiv paper with built-in patent #... 🤔 ) "A simple automatic gain control for memory efficient and high performance training of deep CNNs," Brendan Ruff: https://t.co/C3WKRc9Akq "A New Probabilistic Algorithm for Approximate Model Counting," Ge et al.: https://t.co/PCoppB02AF "Clustering High Dimensional Dynamic Data Streams," Braverman et al.: https://t.co/YTnHB9sFgw "Six Challenges for Neural Machine Translation," Koehn and Knowles: https://t.co/90xmXTFPHq "Criteria Sliders: Learning Continuous Database Criteria via Interactive Ranking," Tompkin et al.: https://t.co/4CxxLkD2n8 "Google Cardboard Dates Augmented Reality: Issues, Challenges + Future Opportunities," Perla+Hebbalaguppe: https://t.co/MoP72JxcnV "Dionysius: A Framework for Modeling Hierarchical User Interactions in Recommender Systems," Wang et al., Linkedin: https://t.co/E7UhNXKlx3 "RNNs with Top-k Gains for Session-based Recommendations," Hidasi and Karatzoglou: https://t.co/CawwuPtbmN "'(Weitergeleitet von Journalistin): The Gendered Presentation of Professions on Wikipedia," Zagovora et al.: https://t.co/DjkxRYlHgt "Attention-based Vocabulary Selection for NMT Decoding," Sankaran et al.: https://t.co/c6vuHMAu7Y "Query-by-Example Search with Discriminative Neural Acoustic Word Embeddings," Settle et al.: https://t.co/Cv8XqRisPh "Encoding of phonology in a recurrent neural model of grounded speech," Alishahi et al.: https://t.co/KmHOWGAQ7r "Verb Physics: Relative Physical Knowledge of Actions and Objects," Forbes and Choi: https://t.co/IbsUwyB5ok "Learning to Detect Sepsis with a Multitask Gaussian Process RNN Classifier," Futoma et al.: https://t.co/qJwKmGY0uR "Fractional Langevin Monte Carlo: Exploring Lévy Driven Stochastic Differential Equations for MCMC," Umut Şimşekli: https://t.co/phITEcJXtB "Causal Discovery in the Presence of Measurement Error: Identifiability Conditions," Zhang et al.: https://t.co/GwT0igNR5a "A Supervised Approach to Extractive Summarisation of Scientific Papers," Collins et al.: https://t.co/viC7RdaAFC "A Well-Tempered Landscape for Non-convex Robust Subspace Recovery," Maunu et al.: https://t.co/eXQVO0tyk2 "Recurrent Latent Variable Networks for Session-Based Recommendation," Chatzis et al.: https://t.co/Uly4WLPlEZ "Provable Alternating Gradient Descent for Non-negative Matrix Factorization with Strong Correlations," Li and Liang https://t.co/fEmMCklVBU "Gradient descent GAN optimization is locally stable," Nagarajan and Kolter: https://t.co/2UfTyJpM5w "Multilevel Clustering via Wasserstein Means," Ho et al.: https://t.co/XsOajZY3Eq "General Latent Feature Models for Heterogeneous Datasets," Valera et al.: https://t.co/7UkFQbcbnb "Meta learning Framework for Automated Driving," El Sallab et al., Valeo: https://t.co/knB82jjEfQ "Analyzing the Robustness of Nearest Neighbors to Adversarial Examples," Wang et al.: https://t.co/QLd8uJ4SXi "Adversarial Feature Matching for Text Generation," Zhang et al.: https://t.co/5dCSJ475yC "Mix & Match Hamiltonian Monte Carlo," Radivojević and Akhmatskaya: https://t.co/IovVk2WOy5 "Lost Relatives of the Gumbel Trick," Balog et al.: https://t.co/ZeBAZvdAd6 "SmoothGrad: removing noise by adding noise," Smilkov et al.: https://t.co/jg7ZG6Y861 @_jyan_ not discussing def. isn't solution, but proposing good solutions (the harder part :) ), emphasizing non-zero sum possibilities (easy) helps It's Tricky Title Tuesday! (I'm going to run out of these soon, btw) @rbhar90 I know the feeling!! @rbhar90 liking the blog posts! :) RT @rbhar90: I've written a new blog post on "Machine Learning with Small Data." Small data ML is the future :) https://t.co/OVNZf2LxCK @negamuhia yep, also discussed here (published after that) https://t.co/z1S648nTsy H/T @calebwatney for article @AMP_SV agreed. @AMP_SV which is a bad idea - restricting their investment or not? It's actually time for some game theory... *which isn't to say the US shouldn't defend their interests (as should/will China), but consider big picture, not local one-off improvements Potentially beginning of a very bad road. Don't know exactly what's being envisioned, but we don't want a spiraling AI/robotics arms race. It's not clear just how (more on this in the next 24 hours!) but we should def learn from the past. See this thread: https://t.co/jpqzmpLkxp This is very troubling. Yes, AI is security-relevant, but we should be trying to avoid this sort of race dynamic. https://t.co/shKr5asJBr RT @nytimes: President Trump wants to eliminate this energy research program. A top scientific panel says it's working well. https://t.co/a… https://t.co/oAViEntPLg "Image Matching via Loopy RNN," Luo et al.: https://t.co/nAVpQvWTOJ "Deep Optimization for Spectrum Repacking," Newman et al.: https://t.co/R24SrR6Q7w "Bio-Inspired Multi-Layer Spiking NN Extracts Discriminative Features from Speech Signals," Tavanaei + Maida: https://t.co/Thn4KOV5aj "Deep Adaptive Feature Embedding with Local Sample Distributions for Person Re-identification," Wu et al.: https://t.co/Vs04r16JY8 "Trimming and Improving Skip-thought Vectors," Tang et al.: https://t.co/g9ww7kIPB7 "Rethinking Skip-thought: A Neighborhood based Approach," Tang et al.: https://t.co/qSZI6djfhO "Diversity-aware Multi-Video Summarization," Panda et al.: https://t.co/SKYyLslgh9 "Off The Beaten Lane: AI Challenges In MOBAs Beyond Player Control," Cook et al.: https://t.co/gAbr5qZI5p "Multi-View Surveillance Video Summarization via Joint Embedding and Sparse Optimization," Panda and Roy-Chowdhury: https://t.co/kfsyhkVAmS "Collaborative Summarization of Topic-Related Videos," Panda and Roy-Chowdhury: https://t.co/D5eqoVaewk "Unsupervised Adaptive Re-identification in Open World Dynamic Camera Networks," Panda et al.: https://t.co/NfzNtsiRhC "A Survey of Recent Advances on Deep Learning Techniques for Electronic Health Record (EHR) Analysis," Shickel et al https://t.co/zlhMI9Q8NY "RARD: The Related-Article Recommendation Dataset," Beel et al.: https://t.co/dP3BWzcp0T "PatternNet: A Benchmark Dataset for Performance Evaluation of Remote Sensing Image Retrieval," Zhou et al.: https://t.co/zghpxpvSSu "Learning Large-Scale Topological Maps Using Sum-Product Networks," Kaiyu Zheng: https://t.co/tBMmVv5LR0 "Adversarial Network Bottleneck Features for Noise Robust Speaker Verification," Yu et al.: https://t.co/7Xm4qU5xfl "A Full Non-Monotonic Transition System for Unrestricted Non-Projective Parsing," Fernández-González+Gómez-Rodríguez https://t.co/Dw8FRU6UB7 "Generic Axiomatization of Families of Noncrossing Graphs in Dependency Parsing," Yli-Jyrä and Gómez-Rodríguez: https://t.co/JTZDaq9Iql "Exploring Automated Essay Scoring for Nonnative English Speakers," Nigam and Goyal: https://t.co/NGXuRtvrIp "Few-Shot Image Recognition by Predicting Parameters from Activations," Qiao et al.: https://t.co/aGn14orSwq "Optimal Auctions through Deep Learning,"Dütting et al.: https://t.co/xFXA4X3dRr "Deep Learning for Precipitation Nowcasting: A Benchmark and A New Model," Shi et al.: https://t.co/86jxHQjYa9 "Scientific document summarization via citation contextualization and scientific discourse," Cohan and Goharian: https://t.co/hiccV2Ba4L "Point Linking Network for Object Detection," Wang et al.: https://t.co/557mqDieai "Neural Domain Adaptation for Biomedical Question Answering," WIese et al.: https://t.co/IjoCIlIgw3 "Noisy Softplus: an activation function that enables SNNs to be trained as ANNs," Liu et al.: https://t.co/WOrlMoofle "Streaming Non-monotone Submodular Maximization: Personalized Video Summarization on the Fly," Mirzasoleiman et al.: https://t.co/kkfh0K6rRv "Action and perception for spatiotemporal patterns," Biehl and Polani: https://t.co/ry2BSE23N6 "Candidate sentence selection for language learning exercises," Pilan et al.: https://t.co/kV5vsnH70B "Exploring the similarity of medical imaging classification problems," Cheplygina et al.: https://t.co/u0WiEaIVJs "Progressive+Multi-Path Holistically Nested NNs for Pathological Lung Segmentation from CT Images," Harrison et al.: https://t.co/9aVX8iHvBG "SEVEN: Deep Semi-supervised Verification Networks," Noroozi et al.: https://t.co/sr7x0V9AJj "Certified Defenses for Data Poisoning Attacks," Steinhardt,* Koh,* and Liang: https://t.co/v2LXcblWpB 💯 "Acoustic data-driven lexicon learning based on a greedy pronunciation selection framework," Zhang et al.: https://t.co/WsNDhpU2Rz "Large-Scale Plant Classification with Deep Neural Networks," Ignacio and Heredia: https://t.co/mQikgs7IaQ "Group Invariance and Stability to Deformations of Deep Convolutional Representations," Bietti and Mairal: https://t.co/UxfzzbgHZJ "Enhancing SDO/HMI images using deep learning," Baso and Ramos: https://t.co/JKT9VkdF2P "Semantic Entity Retrieval Toolkit," Van Gysel et al.: https://t.co/fycbf08n49 "Deep Recurrent Neural Networks for seizure detection and early seizure detection systems," Sachin Talathi: https://t.co/gBqHSxX60b "Low Complexity Gaussian Latent Factor Models and a Blessing of Dimensionality," Ver Steeg and Galstyan: https://t.co/yoOq5G12NM "Dealing w/ Integer-valued Variables in Bayesian Optimization w/ Gaussian Processes"Garrido-Merchán+Hernández-Lobato https://t.co/2UQJEcE0X6 "Practical Gauss-Newton Optimisation for Deep Learning," Botev et al.: https://t.co/3LKyhrnswR "Fast Approximate Spectral Clustering for Dynamic Networks," Martin et al.: https://t.co/oXGCzd3C5z "Random Forests, Decision Trees, and Categorical Predictors: The "Absent Levels" Problem," Timothy Au: https://t.co/S60MDiHQGf "Deep reinforcement learning from human preferences," Christiano et al.: https://t.co/Kje9ua0r6x (the aforementioned OpenAI/DeepMind paper) "An Alternative to EM for Gaussian Mixture Models: Batch and Stochastic Riemannian Optimization," Hosseini and Sra: https://t.co/QMiI2QkgZh "Confident Multiple Choice Learning," Lee et al.: https://t.co/3ZcmDx55d3 "Sliced Wasserstein Kernel for Persistence Diagrams," Carriere et al.: https://t.co/enhsARUYJ8 "Neural networks and rational functions," Matus Telgarsky: https://t.co/30BLzxyYU7 "Stepwise regression for unsupervised learning," Jonathan Landy: https://t.co/jDDEFFq4LK "Recovery Guarantees for One-hidden-layer Neural Networks," Zhong et al.: https://t.co/w2LvyK6Qvu "Generate Identity-Preserving Faces by Generative Adversarial Networks," Li and Luo: https://t.co/yvfhpp3Bo9 "Critical Hyper-Parameters: No Random, No Cry," Bousquet et al.: https://t.co/ShJdu60jLP "Toward Optimal Run Racing: Application to Deep Learning Calibration," Bousquet et al.: https://t.co/YCpoObEXV3 "Enriched Deep Recurrent Visual Attention Model for Multiple Object Recognition," Ablavatski et al.: https://t.co/Ub5lFOkDc3 "Tackling Over-pruning in Variational Autoencoders," Yeung et al.: https://t.co/GW6O4KrMcE @jackclarkSF Trained a reward predictor on a lot of binary questions to researchers... https://t.co/GNfcDozGk2 RT @matt_levine: so Uber's Let's Try Not To Be So Sexist initiative lasted ... a bit under seven minutes? https://t.co/MdYlZh8Ion BTW, I recommend reading both DeepMind and OpenAI's blog posts on their new AI safety paper - complementary points/examples. TIL OpenAI has a Brain residency-esque deep learning fellowship program: https://t.co/5Ll38fs5kO One of my favorite AI montages in a while (from OpenAI's blog post on their and DeepMind's new paper): https://t.co/5kJl3PfwE1 @adam_will_do_it lol https://t.co/auGNnWuP5J Clarifai has a page about the animal vs. food thing apparently! https://t.co/XLeBgaqC9M @adrepd thanks! still making some tiny tweaks (in "soft launch" right now) but will be pushing it more soon - glad you like it! @anderssandberg yeah, thought about that. I think there's prob value in highlighting/making concrete need for anti insider coercion measures @beaucronin https://t.co/EnejJq4Uas @beaucronin https://t.co/yykt4O1MQb RT @ilyasut: https://t.co/3WPsF831vR = @OpenAI & @DeepMindAI collab = a hyperefficient semisupervised RL algorithm, solving hard tasks from… RT @DeepMindAI: New work on AI safety with @OpenAI describes an RL system that learns through human feedback https://t.co/bUa55t0RQU https:… RT @gdb: Writing reward functions for complex tasks is hard. @OpenAI + @DeepMindAI collaboration to instead learn the reward: https://t.co/… Exciting collaboration between OpenAI and DeepMind on AI safety! Look forward to seeing more of this in the future. https://t.co/o60uvHcv5Z RT @OpenAI: Using human feedback rather than code to specify a task: https://t.co/3YzBUM9flo Safety collaboration with @DeepMindAI https://… RT @magnord: SELU (purple, green) vs ReLU (yellow) on Breakout using A3C. Opposite of Pong results, SELU much worse than ReLU. To be contin… RT @magnord: @gambsgambs @hardmaru @Miles_Brundage FYI, although SELU on Pong was an improvement, both Breakout and Space Invaders have neg… @girishsastry didn't make a ton of progress yet, just getting to modern times :) It's fun, not yet sure if worth the length - ask me later RT @goodside: @Miles_Brundage I think it entered ML through this Reddit post — original non-ML source mentioned in comments: https://t.co/… RT @mark_riedl: .@teahamster and I wrote a desideratum on studying, representing, and evaluating human computation games https://t.co/MozRI… @hardmaru @GoogleBrain as long as Transformer becomes Optimize Prime, I'll be happy.... @toysoldier182 hm, good question. I guess I'd enjoy a clear explanation of CPUs vs. GPUs training vs. inference in that context, + lots of examples. Maybe someone else has a better history of this? Think pics went viral last year (muffins look like chihuahuas! no mention of AI), someone mentioned in talk, now it's a Very Hard AI Problem Tried sleeping dog/bagel - worst was (low confidence) "food" for a v. confusing (head obscured) dog, never called it a bagel or vice versa. @hardmaru @GoogleBrain or something Trump did? @hardmaru @GoogleBrain what will be longest remembered from the past few days - SELUs or Transformer? RT @hardmaru: @GoogleBrain They had to inject sinusoids to make the network learn information about relative position, since there's no rec… RT @hardmaru: @GoogleBrain This model can reach a new SOTA for NMT tasks after being trained for only ~ twelve hours on eight P100 GPUs. RT @hardmaru: Attention Is All You Need, from @GoogleBrain. No RNNs, No CNNs, Just Attention. Very fast training; SOTA on WMT'14. https://t… @KristenThomasen this is true :) Maybe true at some point, maybe anthropomorphizing, dunno. Clarifai gives cute/puppy etc for dogs, crunchy/food/delicious etc for chicken. I'm going to fact check all of these that I see. This and the chihuahua/muffin one were no problem for Clarifai... https://t.co/zyUv6wDoFB @HueManjf same! To be continued tomorrow... https://t.co/NnTqrKjRw3 "Exploring the Syntactic Abilities of RNNs with Multi-task Learning," Enguehard et al.: https://t.co/moQCQV1Csk "Big Data, Data Science, and Civil Rights," Barocas @s010n et al.: https://t.co/bJ23qqsQ0i "Visual Search at eBay," Yang et al. at [guess which org]: https://t.co/i0g1xsz4Nj "Online Learning for Neural Machine Translation Post-editing," Peris et al.: https://t.co/DADBHmiUag "Exploring Convolutional Networks for End-to-End Visual Servoing," Saxena et al.: https://t.co/TWI7Fmjglx "Data-Efficient Policy Evaluation Through Behavior Policy Search," Hanna et al.: https://t.co/kB64eYJUC2 "Actor-Coordinator-Critic Net for "Learning-to-Communicate" w/ Deep Multi-agent Reinforcement Learning," Mao et al.: https://t.co/4BWsCKEMKK *Gideon and Khorram et al. at UMich Ann Arbor/IBM. Cool to see application of progressive nets. "Progressive Neural Networks for Transfer Learning in Emotion Recognition," Gideon et al.: https://t.co/RDMBMFL8xH "A Framework for Exploring and Evaluating Mechanics in Human Computation Games," Siu et al.: https://t.co/RJ6CoSb1It "Style Transfer for Sketches with Enhanced Residual U-net and Auxiliary Classifier GAN," Zhang et al.: https://t.co/ceCY1dOylV "DAC-h3: A Proactive Robot Cog Arch. to Acquire+Express Knowledge Abt the World+the Self"-Moulin-Frier/Fischer et al https://t.co/c8KmBeZQLh "Channel-Recurrent Variational Autoencoders," Shang et al.: https://t.co/qP1EOORrVp "Learning Gradient Descent: Better Generalization and Longer Horizons," Lv et al.: https://t.co/HY1n4cNh5m (ICML version) "YellowFin and the Art of Momentum Tuning," Zhang et al.: https://t.co/lql4AEDlfs "Large-Scale Evolution of Image Classifiers," Real et al.: https://t.co/31ApUMMScV (ICML version of Brain paper, looks like some new stuff) https://t.co/YhXeGzYkmS (those CMU/Petuum folks are publishing a lot lately, anyone have an opinion?) "Poseidon: An Efficient Communication Architecture for Distributed Deep Learning on GPU Clusters," Zhang et al.: https://t.co/ov1TvD6rD5 "An Online Learning Approach to Generative Adversarial Networks," Grnarova et al.: https://t.co/KDlf2EyAW1 "Decoupling Learning Rules from Representations," Thomas et al.: https://t.co/VDUpoujseE Oh and it's called Transformer, and they continue the recent Brain trend of specifying exact compute usage. 💯 "On the WMT 2014 [E-to-F], our model establishes a new single-model SOTA BLEU score of 41.0 after training for 3.5 days on 8 GPUs" (yes, it said equal contribution from all those). Super impressive stuff on neural machine translation from folks at Google Brain/Research. @_jyan_ but one has to have *some* sort of probability distribution, so arguing super long timelines seem unlikely also has a place, IMO @_jyan_ i think it sounds more reasonable, and also happens to be true :) could turn out to be way easier or harder than we think. much uncertainty arXiv papers, June 13 - "Attention Is All You Need," Vaswani/Shazeer/Parmar/Uzkoreit/Jones/Gomez/Kaiser/Polosukhin: https://t.co/KMscVIhqQo @_jyan_ insofar as there's a consensus, it's that marginal impact of safety/strategy work way higher in fast scenarios even if unlikely, merits attn @_jyan_ we're in touch w/ them as well, though we also have thought about the issue a lot and have a range of timeline views :) @_jyan_ vs most ppl admit in surveys they haven't thought about it much. I often see ppl change times mid-convo :) in any case hope u had good chat! @_jyan_ OPP is on the far end of the spectrum of having thought about such things IMO :) have written many blog posts etc. abt it, funded grants... @AMP_SV thanks! I try to keep it interesting :) It's Machine Translation Monday on arXiv. "|￣￣￣￣￣￣ | | there are | | too many | | papers | |_＿＿＿＿＿__| (\__/) || (•ㅅ•) || / 　 づ" RT @_rockt: Check out interview w/ Matt Gardner (@nlpmattg) & Waleed Ammar (@waleed_ammar) from @allenai_org on our recent paper https://t.… @deliprao https://t.co/PXtFN0dgrG Excerpts from the executive summary: https://t.co/yEstm4hVDw "The Perfect Heist: Recipes from Around the World": https://t.co/V7mmaSSxWx "The fish rots from the dorsal fin, definitely not the head - the head is fine," as they say. https://t.co/ruE9AF1fXz "RT @JamesGleick: President Who’s Accomplished Literally Nothing Calls Achievement “Record-Setting” https://t.co/4R3iKyilEY https://t.co/dH…" @AMP_SV @jeffbigham wait they fired him? last I heard the meeting had gone on six hours. gosh, got too hung up on GANgate @AMP_SV @jeffbigham hear they have a bold and visionary CEO Expecting to see some deep learning this year - we'll see! https://t.co/UpHHzL4Mvc @davegershgorn hey gets a shout out later lol @theindianapple CC @magnord @neuroecology @magnord @hardmaru it's from the paper Self-Normalizing Neural Networks: https://t.co/p3j7oaJkM7 @davegershgorn blown away by the ML storm RT @magnord: SELU (orange) vs ReLU (cyan) on Atari Pong using A3C. SELU is a major improvement (thx @hardmaru and @Miles_Brundage for link… RT @SELUAppendix: 💔 Why does nobody want to read me 😉 https://t.co/FONCCJInka @kennethpayne01 has occurred to me, might be too hard, though.. ICYMI @JohnDanaher and I wrote this a little while back on AI, cognitive scarcity, and inequality. Thoughts welcome: https://t.co/WrTYS7LLIw RT @JasonKander: Your presidency is going really well when you're retweeting a clip of Geraldo Rivera handicapping your chances of impeachm… @botminds @jackclarkSF see - https://t.co/QQPFljnYXu @botminds @jackclarkSF Did this in an AI class, actually - I think it was a very valuable exercise. In that case it was already published papers, though. RT @sleepinyourhat: After all that arguing, want to work on an NLU task with clear evaluation? Three more days to submit systems. https://t… @deliprao I could be spreading meta^2-fake news @deliprao I dunno, haven't looked, I just assumed it was hypey b/c bots/AI. Learning to earn with gradient descent. @deliprao meta-fake news. @lucidrains That'd be awesome! I'll shoot you an email. Others may have thoughts on criteria for this... @jasonbaldridge @jackclarkSF But really, this needs >1 person, with people filling in their expertise. @jackclarkSF has done valiant prototypes of this, more to be done. I endorse this, especially if it involves backpay and there is a premium for speed ;) https://t.co/wGgUz3ke8g https://t.co/2wXjaDUVgj "End-to-End Musical Key Estimation Using a Convolutional Neural Network," Korzeniowski and Widmer: https://t.co/QOTnCaOkR4 "Deriving a Representative Vector for Ontology Classes with Instance Word Vector Embeddings," Jayawardana et al.: https://t.co/iNkmKcBhft "Characterizing Types of Convolution in Deep Conv Recurrent NNs for Robust Speech Emotion Recognition," Huang et al. https://t.co/QPEFdnYBen "Multi-Modal Obstacle Detection in Unstructured Environments with Conditional Random Fields," Kragh and Underwood: https://t.co/OcfNeycgps "Bandit Models of Human Behavior: Reward Processing in Mental Disorders," Bouneffouf et al.: https://t.co/U3NCx1LBKD "MirBot, a collaborative object recognition system for smartphones using CNNs," Pertusa et al.: https://t.co/RYnTChfHKE "DCCO: Towards Deformable Continuous Convolution Operators," Johnander et al.: https://t.co/wFAZr1WRVR "Global Convergence of the (1+1) Evolution Strategy," Tobias Glasmachers: https://t.co/nof8dL3yjB "Face Detection through Scale-Friendly Deep Convolutional Networks," Yang et al.: https://t.co/k2LIKXB1Sv "Assigning personality/identity to a chatting machine for coherent conversation generation," Qian et al.: https://t.co/dvfBJ1Htmi "Weakly supervised training of deep CNNs for overhead pedestrian localization in depth fields," Corbetta et al.: https://t.co/wR6hAACtph """A Tutor Agent for MOBA Games,"" do Nascimento Silva and Chaimowicz: https://t.co/IqxbX3h9Jt *also in League of Legends" "From Bayesian Sparsity to Gated Recurrent Nets," He et al.: https://t.co/Uqu5dtC9ru "TextureGAN: Controlling Deep Image Synthesis with Texture Patches," Xian et al.: https://t.co/jODAZwT3Vd "Learning to Embed Words in Context for Syntactic Tasks," Tu et al.: https://t.co/MkP76U9S8h "Dynamic Difficulty Adjustment on MOBA Games," Silva et al.: https://t.co/6jrt7cQBed "Rapid Randomized Restarts for Multi-Agent Path Finding Solvers," Cohen et al.: https://t.co/niGeV4FENX "The FastMap Algorithm for Shortest Path Computations," Cohen et al.: https://t.co/stB3SNwjfB """On the Development of Intelligent Agents for MOBA Games,"" do Nascimento Silva and Chaimowicz: https://t.co/JObejq9uBS *w League of Legends" "Setting Players' Behaviors in World of Warcraft through Semi-Supervised Learning," Nery et al.: https://t.co/MPLmwNl7kA "Evolutionary Multitasking for Multiobjective Continuous Optimization," Yuan et al.: https://t.co/egzplzItGa "Source Forager: A Search Engine for Similar Source Code," Kashyap et al.: https://t.co/uiDHXDZBbP "Use of Multimodal Features in Spoken Human-Robot Interaction," Novikova et al.: https://t.co/b4BLcII05W "Advances in Joint CTC-Attention based E2E Speech Recognition with a Deep CNN Encoder and RNN-LM," Hori et al.: https://t.co/UCTZBEcUvF "CortexNet: a Generic Network Family for Robust Visual Temporal Representations," Canziani and Culurciello: https://t.co/18BlPqBZol "Climbing a shaky ladder: Better adaptive risk estimation," @mrtz: https://t.co/uMFrkHFNSe "Demystifying the Characteristics of 3D-Stacked Memories: A Case Study for Hybrid Memory Cube," Hadidi et al.: https://t.co/bRUtdpzFuR "Ethical Artificial Intelligence - An Open Question," Pavaloiu and Kose: https://t.co/rGcoCASPkS @VenkatNagaswamy if I get tired of other stuff, I'll consider it :) but it should probably be >1 person, and preferably some w/ more expert knowledge "Manifold Regularized Slow Feature Analysis for Dynamic Texture Recognition," Miao et al.: https://t.co/tPAuw5EQq7 "Learning to Detect Red Lesions in Fundus Photographs: An Ensemble Approach based on Deep Learning," Orlando et al.: https://t.co/yxgeGx3xqE "Depthwise Separable Convolutions for Neural Machine Translation," Kaiser, Gomez, and @fchollet: https://t.co/8scXKEcO30 "Learning optimal wavelet bases using a neural network approach," Andreas Søgaard: https://t.co/99khdcwN4Q Fun aside while I take a break from arXiv stuff: new Xbox has a 6 teraflop GPU. ~ half a Titan Xp. Fast, dunno if you could do DL on it, tho "Okutama-Action: An Aerial View Video Dataset for Concurrent Human Action Detection," Barekatain et al.: https://t.co/VrJ5LzBnfG "Symmetry Learning for Function Approximation in Reinforcement Learning," Mahajan and Tulabandhula: https://t.co/C4pzQ97lCb "Gated Orthogonal Recurrent Units: On Learning to Forget," Jing and Gulcehre et al.: https://t.co/cPQofgyitu "Optimizing expected word error rate via sampling for speech recognition," Matt Shannon, Google (w/ Home data): https://t.co/EAM9fet32Y "Unsupervised object learning from dense equivariant image labelling," Thewlis et al.: https://t.co/Ca189nIN5j "TIP: Typifying the Interpretability of Procedures," Dhurandhar et al.: https://t.co/Z537oVWk3g "A Maximum Matching Algorithm for Basis Selection in Spectral Learning," Quattoni et al.: https://t.co/yx9vPVff1v "Avoiding Discrimination through Causal Reasoning," Kilbertus et al.: https://t.co/6WPCxhPp1H "Assessing the Performance of Deep Learning Algorithms for Newsvendor Problem," Zhang and Gao: https://t.co/Yuc4t6bgNR "Time Series Using Exponential Smoothing Cells," Abrami et al.: https://t.co/JVh89UC0PC "Monte-Carlo Tree Search by Best Arm Identification," Kaufmann and Koolen: https://t.co/WDC2w82wfz arXiv papers, June 12 - "Learning to Learn from Noisy Web Videos," Yeung et al.: https://t.co/y3E8Wvq9b7 RT @fchollet: Using SliceNet, a convolutional seq2seq model inspired by Xception and ByteNet. Depthwise separable convolutions are the futu… RT @fchollet: Our new paper: state-of-the-art results in machine translation at a considerably reduced computational cost. https://t.co/bRm… "Soon U N me will experience Death by ArXiv Yay" "RT @jengolbeck: I'm working on a study of purchased retweets. Reviewing a fake account & found @realDonaldTrump weekly address RTed. He's…" @visarga lol it is pretty humble! ;) RT @rbpless: "Deep Feature Interpolation", by Paul Upchurch, Jake Gardner, @Jimantha, Kavita Bala, Kilian Weinberger + me) accepted to CVPR… Making some progress on a paper! :) 💡➡️📃 RT @jackclarkSF: I'm writing a short story about a misanthropic robot for tomorrow's Import AI. Read&subscribe: https://t.co/oGP26oOXWC RT @yashar: WATCH: In 7.5 years @PreetBharara never received a phone call from Pres Obama. He received 3 from Trump in 1 month. https://t.… Asimov had this covered 64 years ago - "automatobile." A bit long, though. https://t.co/q66flDTudv @AMP_SV @jeffbigham in any case, they didn't pay a huge price, granted per Jeff's point. Polls show people love Google. @jeffbigham @AMP_SV Google Glass? @jeffbigham you just need to say the word cyborg more. @jeffbigham tech cos have lots of HCI people, though, right? just not working on AI and/or gettin respect? @jeffbigham dunno. I read "AI and HCI: Two Fields Divided by a Common Focus" a few years ago and loved it, though, but I don't run an AI company... @jeffbigham *won't that. Hopefully not, obvi, just saying it doesn't provide much evidence either way :-) @jeffbigham wasn't that/won't always be the case? HCI as Rodney Dangerfield. @girlziplocked [the US] will continue to be the cleanest and most environmentally friendly country on Earth [post-Paris pullout]" - Trump @uwnlp hmm, why would that be better? assuming shares are priced accurately, no reason to think they'd go up vs. down...returns from AI maybe >> @tetisheri "more work is needed" @tetisheri yes, fair point. Clearly corps will not rush to adopt this, but I think useful to have some fleshed out proposals w/ design considerations. @tetisheri not sure what you mean, but the paper is more about surveys/different designs for how it could work than saying it's technically hard. "Worker-Owned Cooperative Models for Training Artificial Intelligence,"" Sriraman et al.: https://t.co/OfB6kIC3gc 🤔 https://t.co/O7iGwgyV5t" RT @rbhar90: I've written a new blog post "Software Patents are Obsolete in the Age of AI" https://t.co/4knxeGO0Pa RT @erichorvitz: Whether optimistic about #AI, concerned about rough edges, long-term futures, or mix of hopeful & anxious, much to be acco… "RT @ThomasMiconi: ""In the future, every paper will be widely reimplemented within 15 minutes."" - Andy Warhol, more or less." RT @kevin_zakka: Wrote a short summary of "Self-Normalizing Networks" https://t.co/uhkjCbcO19 The SELU paper came out Thursday night. 📃🔜🛠💻 https://t.co/tjN6uhbl88 "RT @ylecun: @Miles_Brundage They should have cited this 1994 paper by Simard et al. https://t.co/8dxFxid2nS" RT @patrickthealba: AI/DL/NLP Twitter sphere right now. #nlproc https://t.co/t2YYGoJwz1 Fin. "ShiftCNN: Generalized Low-Precision Architecture for Inference of Convolutional Neural Networks," Gudovskiy+Rigazio https://t.co/A100JumAki "Training Quantized Nets: A Deeper Understanding," Li et al.: https://t.co/SOB2WQ55m0 "On the Robustness of Deep Convolutional Neural Networks for Music Classification," Choi et al.: https://t.co/Fxo1QBTtxX "Energy-Efficient Hybrid Stochastic-Binary Neural Networks for Near-Sensor Computing," Lee et al.: https://t.co/4unWmaRPcb "Active Learning for Structured Prediction from Partially Labeled Data," Khodabandeh et al.: https://t.co/MoPKHQaxY9 "Learning to Extract Semantic Structure from Documents Using Multimodal Fully CNN," Yang et al.: https://t.co/9eJaUQCvBw "Generative-Discriminative Variational Model for Visual Recognition," Yeh et al.: https://t.co/dPZmwTFOnT "Stacked Convolutional and Recurrent Neural Networks for Music Emotion Recognition," Malik et al.: https://t.co/bdKY01jrAa "Sound Event Detection Using Spatial Features and Convolutional Recurrent Neural Network," Adavanne et al.: https://t.co/jVb5ewWlvC "PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space," Qi et al.: https://t.co/8iq2BXDlZz "Seamless Integration and Coordination of Cognitive Skills in Humanoid Robots: A Deep Learning Approach," Hwang/Tani https://t.co/1AHKH5vQtM "Improving Semantic Relevance for Seq.-to-Seq. Learning of Chinese Social Media Text Summarization," Ma et al.: https://t.co/rgcUHOXcnp "Image Captioning with Object Detection and Localization," Yang et al.: https://t.co/P1yNSEviDi "Learning Deep Representations for Scene Labeling with Guided Supervision," Wang et al.: https://t.co/NngWj0XAgr "Clustering of body parts from simultaneous tactile and linguistic input using sequential mapping," Stepanova et al. https://t.co/hOSxrMO3O1 "Responsible Autonomy," @vdignum: https://t.co/LFICgJA1s1 "Joint Workshop on Bibliometric-enhanced IR and NLP for Digital Libraries (BIRNDL 2017)," Chandrasekaran et al.: https://t.co/jemCcCPjB4 "Pain-Free Random Differential Privacy with Sensitivity Sampling," Rubinstein and Alda: https://t.co/KGZEPhdfvX "Surprise Search for Evolutionary Divergence," Gravina et al.: https://t.co/k5jHYybFYr "Decoupling 'when to update' from 'how to update'," Malach and Shalev-Shwartz: https://t.co/wFJBe1Et8O "Reading Twice for Natural Language Understanding," Dirk Weissenborn: https://t.co/bIy1yE1LjB "Learning Local Receptive Fields and their Weight Sharing Scheme on Graphs," Vialette et al.: https://t.co/QQEqgi4TAJ "An Efficient Approach for Object Detection+Tracking of Objects in a Video w/ Variable Background," Ray+Chakraborty: https://t.co/2UqgfPZ4hF "Low-shot learning with large-scale diffusion," Douze et al.: https://t.co/pEw6JJXwRM "On learning the structure of Bayesian Networks and submodular function maximization," Caravagna et al.: https://t.co/DhlCHvkiwE "A Convex Framework for Fair Regression," Berk et al.: https://t.co/klBsENXyun "Distribution-Free One-Pass Learning," Zhao and Zhou: https://t.co/2cHlvAWmnZ "OrbTouch: Recognizing Human Touch in Deformable Interfaces with Deep Neural Networks," Larson et al.: https://t.co/tLHVsSswRv "Clustering with t-SNE, provably," Linderman and Steinerberger: https://t.co/dxYf71NR11 "Nuclear Discrepancy for Active Learning," Viering et al.: https://t.co/JmhfGktniz "Principled Detection of Out-of-Distribution Examples in Neural Networks," Liang and Srikant: https://t.co/rddR2mWLC5 "Improving Variational Auto-Encoders using convex combination linear Inverse Autoregressive Flow," Tomczak+Welling: https://t.co/K7nyL2H4J2 "Outlier Detection Using Distributionally Robust Optimization under the Wasserstein Metric," Chen and Paschalidis: https://t.co/jsNSOH3NlI "The Generalized Cross Validation Filter," Bottegal and Pillonetto: https://t.co/ZiDAS356PS "Context encoders as a simple but powerful extension of word2vec," Franziska Horn: https://t.co/qbL8Ey8sbZ "Scaling up the Automatic Statistician: Scalable Structure Discovery using Gaussian Processes," Kim and Teh: https://t.co/f5Nd24VeD5 "Meta-Learning for Construction of Resampling Recommendation Systems," Burnaev et al.: https://t.co/oZHBJdONa8 "Predictive Coding-based Deep Dynamic Neural Network for Visuomotor Learning," Hwang et al.: https://t.co/69MNyj4I0r "Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networks," Wu et al.: https://t.co/7JzbLYpw8r @tdietterich what kind of tour? Not sure what you're referring to. #SafetySaturday https://t.co/uWkAp9EsSN RT @MaluubaInc: We propose a joint model for question answering & question generation. Learning to ask may boost ability to answer https://… @Thomas__Arnold say more? @_jyan_ but, perhaps useful to give ppl a rough sense of the level of general/narrow intelligence. @_jyan_ but I'm also not sure how helpful those are for understanding the inner workings of AI systems. Rats aren't dreaming all the time either :) @_jyan_ people are semi-familiar with non-hum. animals (though they systematically underestimate em :) ). Schmidhuber talks about rats/monkeys a lot What's the value added of human/bio-analogies? Is it unreasonable to expect ppl to understand AI systems on own terms? When helpful/harmful? ICYMI for the NBA/US crowd, ranted about problems w/ AI anthropomorphism last night - curious what ppl think - https://t.co/iFCvSahNWz @yoavgo the best of times and the worst of times... machine translation everywhere, but only somewhat understandable. needs GANs obviously ;-) RT @fchollet: Handcrafted, bespoke, one-of-a-kind activation function. As a neural network artisan, I can't wait to try it https://t.co/CzS… "RT @yoavgo: A response to @ylecun . Can someone please put this on facebook? https://t.co/Yg5EzfAgCl https://t.co/31i0Pr8hp8" @rbhar90 was prob stated too strongly by NYT @rbhar90 there are def some studies suggesting figures like that, but dunno what the sample or definition was off the top of my head @sidharthmsk Neil Lawrence has a paper on this on arXiv RT @zacharylipton: @Miles_Brundage Actually it's stochastic hill climbing :P Interesting thoughts on my thoughts on AI and anthropomorphism - see also discussion above/below... https://t.co/ydKgyeV05f @sidharthmsk since evo couldn't get out of some local maxima/minima, benefits of computers re: storage/speed etc.. but dunno for sure obv :) @sidharthmsk my intuition is we'll eventually end up somewhere v. different (except parts needed for understanding/interacting w/ humans) RT @Miles_Brundage: Re: anthropomorphism of AI, partly prompted by @alexismadrigal's tweets - he/others right to point out that neural nets… RT @Miles_Brundage: RA jobs at @FHIOxford (https://t.co/4VzR34ktpx ) +the Center for Effective Altruism (https://t.co/6HtspJZSJW ) working… Work with Zoubin Ghahramani and Adrian Weller on making AI "scalable, reliable, and interpretable": https://t.co/tJiBF230aJ P.S. maybe not as persuasive as that could have been b/c I picked relatively simple architectures, but others are even harder to analogize. @chris_brockett hahaha. It's from a family movie! :) Guess it thinks it's a gross murder scene or something. But agent-y != human-y and AI will continue to be pretty weird. That's OK as long as we are aware of that/make it ethically/safely etc. Fin. I think there's some need for analogies, and as Dennett would say, the intentional stance (https://t.co/b8Tioqeaps) is often useful... AI researchers sometimes learn from humans, but sometimes do better w/o doing it like that. Evolution couldn't try everything/is imperfect. You don't gain that much in terms of intuition by anthropomorphizing AI/deep learning/machine learning etc. It's mostly just different. Then you set them off on their adventures again, this time learning from each others' former lives. Kinda weird, but that's my point... They try out diff. approaches to playing the games. Every once in a while, they reattach to your brain, and you ponder what to make of this. https://t.co/Eh6UBjVyxe You plop down several Thing hands +they play Atari for you on several consoles. They're OK but dispensable, you'll wipe their memories soon. RT @mat_kelcey: @fchollet @Miles_Brundage @hardmaru https://t.co/o6Kf9uq3tt @mat_kelcey @fchollet @hardmaru I'll say this: nice bowtie! RT @imalikshake: My very first blog post. I hope you find it interesting! "Neural Translation of Musical Style" https://t.co/oUfqehceLQ htt… @AMP_SV not that I'm aware of but that sounds fun :) and plenty of data! It's Big Picture Weekend! 😀 https://t.co/bmpNJ3ZDDI Another perspective on the DL/NLP/arXiv discussion - direct link: https://t.co/Yb2tB7wFk3 https://t.co/I4QFO5Fx06 "What the Hell Do You Want from Me: Memoirs of an Early DQN." Sequel: "It's Been a Dream: My Last Few Hours of Kicking Ass at Atari." @mgubrud @alexismadrigal not sure I totally follow but sounds like interesting arg, have you elaborated it anywhere? "RT @RikeFranke: Changes in who German public trusts, April 2016 vs June 2017: France +5 UK -13 Turkey -15 US -37 percentage points. https:…" @mgubrud @alexismadrigal my point was (or one point was), if want to make analogies, look at micro + macro level, not just if NNs present @mgubrud @alexismadrigal one could say that's > humany (taking actions, improve over time, balancing exploration/exploit) than NN classifier @mgubrud @alexismadrigal dunno bout that but I agree there are >0 brain-like elements of deep learning. But cf. e.g. shallow learning RL... @drtowerstein yes, symbolic stuff even weirder in its own way :) @drtowerstein yeah that's my point. One can think of them usefully as agent-like (goals, plans etc) but their "experience" not humanlike And other architectures are even crazier to think of as human-ish. They're quite alien in how they work (e.g. A3C). So, yeah, AI is weird. Oh and the person has two brains (target network). And forgets stuff after a few hours. And is always kinda dreaming (experience replay). That person with the headset has a controller, starts playing game. At first has no clue what's what. Gets zapped or shot of heroin (reward) DQN gets pixel inputs...not really a "screen" the way we see it, at least at first, just some numbers, but w/e, think human w/ VR headset. but this understates how problematic anthropomorphism is. E.g. DQN - let's pretend the neural net layers are brainish + see where this goes. Re: anthropomorphism of AI, partly prompted by @alexismadrigal's tweets - he/others right to point out that neural nets not v. brain-like... @markus_with_k what do you think of that paper? @ferrouswheel @jackclarkSF *+ my original point was about coverage, not just what he/the company does... journalists should also be more skeptical @ferrouswheel @jackclarkSF I like Ben/am aware of his papers but irrelevant to e.g https://t.co/IZ1Bf8LVe2 (and yes Hanson not only 1 to oversell, doesn't make OK tho) @ferrouswheel @jackclarkSF my concern is less w/ what work is done behind the scenes than how it's portrayed - this is what it says on site: https://t.co/DeKnjtZR9Q RT @yoavgo: Added a clarification post to deal with some common reactions: https://t.co/elwEJXpXvq https://t.co/zyRcIKsblQ @hardmaru lol just looked at it, it's insane. @jackclarkSF they fell behind in the last few hours RT @jackclarkSF: Update: this data gathering operation is still going! Any help appreciated! Join me in creating IMAGINARY GEOGRAPHIES VIA… RT @erichorvitz: Excited about a broadening base of partners of the @PartnershipAI. https://t.co/CtUdy8xR1K "RT @katyanna_q: Neat bit of research from DeepMind - simple relational network can be plugged into other NN for reasoning 👌 https://t.co/Z…" One takeaway is that framing mattered a *lot*. "researchers don’t seem to be aware that their predictions vary a lot" More analysis of the results from Grace et al.'s survey of AI researchers (by @KatjaGrace): https://t.co/2qC4F8OJCc "RT @RepAdamSchiff: Comey: He dangled my job. Demanded loyalty. Wanted Flynn case dropped. Wanted Russia cloud lifted. Fired me. Trump: I'm…" @gambsgambs why? @ferrouswheel @jackclarkSF ..any plausible architecture - seems clearly to invoke canned sentences whereas existing NLP just isn't that good @ferrouswheel @jackclarkSF has nothing to do with DL or the specifics of any architecture, has to do w/ demos suggesting state of AI beyond RT @BBCOxford: Election results 2017: Lib Dems gain Oxford West and Abingdon https://t.co/Ilf8UdtDCb "RT @BBCBreaking: It's official: #HungParliament for UK. No party can win a majority https://t.co/jpy6wsvCIX #GE2017 #BBCelection https://t…" @AMP_SV also UKIP doing esp badly @AMP_SV yeah, they wanted/expected to increase majority, may be losing it instead (though may still be able to make govt) VICE documentary on Corbyn last year: https://t.co/IJnq12JWGp RT @piersmorgan: As exit poll looms, I repeat my prediction: Conservatives to win by 90-100 seat majority. #GE17 RT @girlziplocked: RIP UKIP #Ge2017 "A Roadmap for the Rigorous Science of Interpretability"-talk by Finale Doshi-Velez https://t.co/UunX4TJyuv see also https://t.co/8WTp3bvpG7 @AMP_SV @jackclarkSF @alexismadrigal @davegershgorn @katyanna_q @halhod (looks at list of top 20 party cities, finds Montreal and Barcelona on it and no LA) never mind, I hereby hand in my party credentials @AMP_SV @jackclarkSF @alexismadrigal @davegershgorn @katyanna_q @halhod NIPS parties were getting notorious even in cities that aren't notorious for partying... 🤔 @alexismadrigal @AMP_SV @jackclarkSF @davegershgorn @katyanna_q @halhod prob. going as well, would love to chat there! @pmarca reading 4 books at once or 1 book a minute? :) More tomorrow... "Leveraging deep neural networks to capture psychological representations," Peterson et al.: https://t.co/wGy9je7wQR "Forward Thinking: Building and Training Neural Networks One Layer at a Time," Hettinger et al.: https://t.co/kLQJwLSgwC "Generative Autotransporters," Wu and Huang et al.: https://t.co/lITkwclDkU "Self-Normalizing Neural Networks," Klambauer et al.: https://t.co/p3j7oaJkM7 """Fast Black-box Variational Inference through Stochastic Trust-Region Optimization,"" Regier et al.: https://t.co/41Dx5s5CKY" "Real-valued (Medical) Time Series Generation with Recurrent Conditional GANs," @_hylandSL and Esteban: https://t.co/9fpbbBYcWX "Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour," Goyal et al.: https://t.co/grTYybiO1z "Meta Networks," Munkhdalai and Yu (revised): https://t.co/lDTkKrBzXc "Generalized Value Iteration Networks: Life Beyond Lattices," Niu, Chen, and Guo et al.: https://t.co/yoyq9jdtwm "Unlocking the Potential of Simulators: Design with RL in Mind," Antonova and Cruciani: https://t.co/1JJFWSFLuV arXiv papers, June 9 - "Creating Virtual Universes Using Generative Adversarial Networks," Mustafa et al.: https://t.co/rR9AhtmNup @iandanforth ? RT @stuarttinworth: Huge cheers at Oxford East as Labour hold the seat #GE2017 @BBCSouthToday https://t.co/BiBkZP7huK RT @ThomasMiconi: MACHINE LEARNING HAS GONE TOO FAR, SHUT IT DOWN AT ONCE!!! https://t.co/jrhiolNvAX @sknthla post-9/11 politics was not that fun either... @jackiefloyd omgg. British Mexican food is so bad :( @jackiefloyd have already used that to describe the election tonight.. SoftBank buys Boston Dynamics and Schaft from Alphabet. https://t.co/ftBpfc0TV5 It's simulation night on arXiv. Tell us what you really think, Yoav - https://t.co/erfHaxq49M https://t.co/GO7jk1yOsa RT @yoavgo: So I took some time and wrote this medium post about this language generation paper. https://t.co/bkj2EbOIcP https://t.co/7Tw7R… Finally reading some of Sutton & Barto's RL textbook, 2.0 - https://t.co/9hLKg1WW90 @sknthla why against generational interests? @sknthla when the dust settles, though, you'll have a lot of followers who take Honest Loyalty seriously. 2017 equivalent of the stress-inducing NYT Trump/Clinton probability thing... https://t.co/e8WCgCXqCC @AMP_SV @jackclarkSF @davegershgorn @katyanna_q @alexismadrigal @halhod also more $ for journalists to go to conferences and stuff, I'd think... seems too rare. @AMP_SV @jackclarkSF @davegershgorn @katyanna_q @alexismadrigal @halhod yep, it's moving in the right direction. Cloning would just speed it up. :) @AMP_SV exit poll says possible hung parliament (--> possible coalition gov't/new election), contra Tory hope 4 >> majority, not all results in tho @AMP_SV @jackclarkSF @davegershgorn @katyanna_q @alexismadrigal @halhod no one (even experts) has time to read/understand every paper, but some effort would prevent accepting Hanson bots at face value etc... @AMP_SV @jackclarkSF ~2 types of AI writing - those who try to get right, +most don't. Tryers growing (@davegershgorn, @katyanna_q, @alexismadrigal, @halhod etc) @_jyan_ @FHIOxford like the Internet thing you mentioned before? Seems v. unlikely to me, tho I like idea of collect. intelligence (see Global Brain institute) @AMP_SV @jackclarkSF If I could clone myself I'd also love to get into the AI journalism game with at least one copy. So much exciting stuff to write about! @AMP_SV @jackclarkSF hence why John Hammond's services are required @AMP_SV @jackclarkSF it is hard, for sure. Doable but hard, lots of good ppl are upping their game now that AI Is A Thing. Import AI prob unparalleled though IMO @_jyan_ @FHIOxford yeah, I think things are moving in that direction (MIRI now putting a lot of focus on ML safety, Concrete Problems paper = near+long term) @jackclarkSF Jack 2 interviews Jack Prime abt OpenAI, Jack 3 writing Import AI Daily, Jack 4 writing a book. Other good explainers too but I'm a fanboy.. OTOH, perhaps this is a symptom, + disease = ppl don't know about AI, inc. journalists. Solution: clone @jackclarkSF https://t.co/taWyqE9eul @_jyan_ @FHIOxford for me, bigger consideration = stuff like this - disproportionate impact if happens soon https://t.co/9yPos2sVEu @_jyan_ @FHIOxford would be interested to see ur arg fleshed out. we're pretty cognizant of this, though not so much bc of thinking likely, "Final results* coming in a little over two hours... *of a bunch of AI papers, what else?" @Brett_Fujioka AlphaGo. (can't vote, alas, but know some Lib Dem + Labour supporters) RT @sarahjeong: ok like... what the fuck happened to polling data and predictive models between 2008 and now? did numbers jump the shark? @sknthla coalition government of Cromwell and AlphaGo @botminds @Zergylord one could as AI != ML but don't need rigorous definition to clearly exclude canned dialogue "RT @BBCBreaking: UK #GE2017 exit poll projects: Conservative 314 Labour 266 SNP 34 Lib Dem 14 Plaid 3 Green 1 UKIP 0 Other 18 https://t.…" @psygnisfive @Zergylord Steven said animatronics which I took to imply design for lifelikeness, not intelligence, but maybe used more widely @Zergylord @psygnisfive the objection we have is not to actual research but canned lines being portrayed as AI @psygnisfive @Zergylord I'm not that familiar w/ Kismet but recall it more about social psych/reading affect/dialogue stuff than hardware..? @psygnisfive @Zergylord human-face-like animatronics (Hanson's claim to fame) isn't much related to MIT robotics either, though. RT @Zergylord: Someone needs to remind reporters that animatronics has zero overlap with AI. Might as well quote Goofy on the reality of th… Eisenhower's woke diary. https://t.co/bSIfVXax8C RT @FHIOxford: FHI (https://t.co/qpYJLWFP4O ) and CEA (https://t.co/gxF5aXJLQc ) are hiring for research assistants for a book at existenti… Please stop covering Hanson Robotics's silly stunts - https://t.co/KKdOjDjqPs @iamtrask @davegershgorn I discovered their CTO: https://t.co/CG2bxKSYw5 @davegershgorn looks like BS RA jobs at @FHIOxford (https://t.co/4VzR34ktpx ) +the Center for Effective Altruism (https://t.co/6HtspJZSJW ) working on existential risk! RT @jackclarkSF: New @OpenAI research lets us teach agents to compete, collaborate, and communicate. Creates agents w/clever teamwork https… RT @dandrezner: The Comey hearing was: RT @OpenAI: Agents that learn to collaborate and compete: https://t.co/HleUa9JtQH RT @alxndrkalinin: #Pytorch code for @DeepMindAI's "A simple neural network module for relational reasoning" (Relational Networks) https://… @trochee not that I'm aware of, but that'd be awesome Good summary of a recent AI safety paper by folks at ANU and DeepMind: https://t.co/6UdqdUsDXg "C O M E Y H E Artificial R Intelligence N G" @samim kind of happened already ;) https://t.co/40CQXR5IrR RT @dandrezner: Pro tip: if you follow up "I've never seen hatred like this," with "To me, they're not even people," you've given away the… @Smerity I have a suspicion that people are starting to notice that arxiv--> people actually reading stuff. :) Seen a lot of super old stuff lately @Smerity It's also kinda old (2016, ancient history! ;) ), wasn't sure if should tweet it. RT @mark_riedl: My AI safety NSF proposal was rejected. So I guess that means we are all doomed. Sorry. RT @jackclarkSF: If you'd like to help me make a little bit of data for a CycleGAN experiment, then follow these instructions.5 mins! https… Last but not least, the most timely of all - "UK General Election 2017: a Twitter Analysis," Cram et al.: https://t.co/muHUBMUKr1 "Comparative Analysis of Open Source Frameworks 4 ML w Use Case in 1-Threaded and Multi-Thr. Modes," Kochura et al https://t.co/4cvCJGH6h2 "Insights into Analogy Completion from the Biomedical Domain," Newman-Griffis et al.: https://t.co/8gITaGFPfe "Gated Recurrent Neural Tensor Network," Tjandra et al.: https://t.co/lSITxVCDpu "Incorporating Network Built-in Priors in Weakly-supervised Semantic Segmentation," Saleh et al.: https://t.co/X2lYTiie1j "Synthesizing Filamentary Structured Images with GANs," Zhao et al.: https://t.co/FtklpC8Z2b "Learning to Represent Mechanics via Long-term Extrapolation and Interpolation," Ehrhardt et al.: https://t.co/n5ltNQJFgx "How Important is Syntactic Parsing Accuracy? An Empirical Evaluation on Sentiment Analysis," Gómez-Rodríguez et al. https://t.co/wMJSYOeE1W "BiSeg: Simultaneous Instance Segmentation and Semantic Segmentation with Fully Convolutional Networks," Pham et al. https://t.co/P3CymweXlV "Semi-Supervised Phoneme Recognition with Recurrent Ladder Networks," Tietz et al.: https://t.co/CJtGZ5w0O1 "DeLiGAN : Generative Adversarial Networks for Diverse and Limited Data," Gurumurthy and Sarvadevabhatla et al.: https://t.co/PH0FQJjALy "Stacked Convolutional and Recurrent Neural Networks for Bird Audio Detection," Adavanne et al.: https://t.co/MWn38RbZYY "DeepSketch2Face: A Deep Learning Based Sketching System for 3D Face and Caricature Modeling," Han et al.: https://t.co/DiHXpiI9pX "Question Answering and Question Generation as Dual Tasks," Tang et al., MSR Beijing: https://t.co/g3pVUxxsXB "Imposing Hard Constraints on Deep Networks: Promises and Limitations," Márquez-Neila et al.: https://t.co/056aGD09mu "Network Sketching: Exploiting Binary Structure in Deep CNNs," Guo et al.: https://t.co/5i7HGf602d "Unsupervised Neural-Symbolic Integration," Son Tran: https://t.co/nGA3pOWl5c "From the Lab to the Desert: Fast Prototyping and Learning of Robot Locomotion," Luck et al.: https://t.co/a05sQ6ih3v "Synergistic Union of Word2Vec and Lexicon for Domain Specific Semantic Similarity," Sugathadasa et al.: https://t.co/lBXVJa4Bgp "Deep Convolutional Decision Jungle for Image Classification," Baek et al.: https://t.co/orOefx857j "Predicting drug-target interactions via sparse learning," Pech et al.: https://t.co/RUVKIu5SAs "Graph Convolutional Matrix Completion," van den Berg et al.: https://t.co/WXjYfEABXb "Deep Learning: Generalization Requires Deep Compositional Feature Space Design," Mrinal Haloi: https://t.co/6ZI0vbl7Mj "Inductive Representation Learning on Large Graphs," Hamilton and Ying et al.: https://t.co/wwLuHmj7JZ "Efficient Reinforcement Learning via Initial Pure Exploration," Putta and Tulabandhula: https://t.co/DopfN7LqPc "Are Saddles Good Enough for Deep Learning?," Sankar and Balasubramanian: https://t.co/PqjgTwqD8w "A Mention-Ranking Model for Abstract Anaphora Resolution," Marasovic et al.: https://t.co/KnLcVEpH1Z "InfoVAE: Information Maximizing Variational Autoencoders," Zhao et al.: https://t.co/FUGc7lNxjH "Driver Action Prediction Using Deep (Bidirectional) Recurrent Neural Network," Olabiyi et al., Toyota: https://t.co/vQ3DJhRwE5 Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments," Lowe and Wu et al., OpenAI/Berkeley: https://t.co/x5LkZ767mL arXiv papers, June 8 - "Parameter Space Noise for Exploration," Plappert et al., OpenAI: https://t.co/1H27Jiy6sZ you ready?? https://t.co/MyueuefUgn It's deep RL night tonight. "Information Bottleneck in Control Tasks with Recurrent Spiking Neural Networks," Vasu and Izquierdo: https://t.co/r8JQ8gFPWt "Deep Latent Dirichlet Allocation with Topic-Layer-Adaptive Stochastic Gradient Riemannian MCMC," Cong et al.: https://t.co/tpuDKHBxD5 "Facial Emotion Detection Using Convolutional NNs and Representational Autoencoder Units," Prudhvi Raj Dachapally: https://t.co/1Pg710CpuN "Parallel+Distributed Thompson Sampling 4 Large-scale Accelerated Explor. of Chemical Space," Hernandez-Lobato et al https://t.co/supsBdsn0P "GAN and VAE from an Optimal Transport Point of View," Genevay et al.: https://t.co/SXMQnfwAN4 "Random Search for Hyperparameters using Determinantal Point Processes," Dodge et al.: https://t.co/9m4byMfVnD "Stochastic Gradient Monomial Gamma Sampler," Zhang et al.: https://t.co/0TRQ1pQGOX "Robust Online Multi-Task Learning with Correlative and Personalized Structures," Yang et al.: https://t.co/Ej5mby3iRu "Deep Alignment Network: A convolutional neural network for robust face alignment," Kowalski et al.: https://t.co/zMqyu70cql "SegAN: Adversarial Network with Multi-scale L1 Loss for Medical Image Segmentation," Xue et al.: https://t.co/rMwJNxUcWq "StreetStyle: Exploring world-wide clothing styles from millions of photos," Matzen et al.: https://t.co/2syR8catz6 "Marmara Turkish Coreference Corpus and Coreference Resolution Baseline," Schuller et al.: https://t.co/vzfsTHgZk5 "Dynamical patterns in individual trajectories toward extremism," Cao et al.: https://t.co/JRNGGTFUvc "Efficient Antihydrogen Detection in Antimatter Physics by Deep Learning," Sadowski et al.: https://t.co/ZsmGW7q2zO "Visual attention models for scene text recognition," Ghosh et al.: https://t.co/SRPBfvPPds "Beyond Volume: The Impact of Complex Healthcare Data on the Machine Learning Pipeline," Feldman et al.: https://t.co/20q5tHTvsw "Accessing Data while Preserving Privacy," Kellaris et al.: https://t.co/fY3OL4iHjC "Deep learning for extracting protein-protein interactions from biomedical literature," Peng and Lu: https://t.co/IMCeAyBCvv "Acquisition of Translation Lexicons for Historically Unwritten Languages via Bridging Loanwords," Bloodgood+Strauss https://t.co/JIPmcvtvuN "Extracting Hierarchies of Search Tasks & Subtasks via a Bayesian Nonparametric Approach," Mehrotra and Yilmaz: https://t.co/h9ukmgcYKL "Sample-Efficient Learning of Mixtures," Ashtiani et al.: https://t.co/07ftlYtNoe "Text Summarization using Abstract Meaning Representation," Dohare and Karnick: https://t.co/MJh0HFbYEk "A General-Purpose Tagger with Convolutional Neural Networks," Yu et al.: https://t.co/TVJuUwOEAG "Label-Dependencies Aware Recurrent Neural Networks," Dupont et al.: https://t.co/LRmvaxo603 "Deep Factorization for Speech Signal," Wang et al.: https://t.co/bCYV05LjQh "Localization of JPEG double compression through multi-domain convolutional neural networks," Amerini et al.: https://t.co/GPnNAWwHEJ Clarifying Astrophysics's Relation to Life with Spatial Autoencoder Generative Adversarial Networks: https://t.co/RuANqa8FOL RT @KELLYWEILL: Comey's opening statement sounds like a Tinder horror story. https://t.co/Umrjhmj0kS RT @katecrawford: My talk on AI, authoritarianism, and what we should do about it: I gave this in March, feels more urgent now https://t.co… This is perfect. https://t.co/dLAOuVaiPV RT @aljwhite: BORIS JOHNSON ASKED A FORTUNE TELLER FOR A PREDICTION AND THIS HAPPENED https://t.co/u8oGKPSThm RT @amandataub: When ur defending democratic norms by deploying sheer overwhelming social awkwardness https://t.co/b83ehH4T5J https://t.co/… RT @edatpost: READ IT YOURSELF: James Comey's prepared testimony to the Senate Intelligence Committee: https://t.co/e70ErEO3U9 RT @OriolVinyalsML: It's never clear how to measure overfitting in GANs, but generating up to 4kx4k res faces is pretty drastic! https://t.… @deliprao Baidu's Deep Voice 2 supposedly makes it fast. Either way, not sure *how* but if Apple's hyping human-like Siri, within reach IMO @cybertreiber @mikarv CC @iamtrask RT @ShaneLegg: When something this simple is this powerful, you're probably onto something https://t.co/KGA9vt6yih @semiDL I don't know exactly what it'll look like but I'm pretty confident it'll be figured out soon. Apple is hyping the humanness of new Siri. @semiDL Tacotron and Deep Voice 2 are pretty fast/cheap, I think, /will get cheaper, and can be done by cloud (or trained then loaded to phone) @tdietterich Probably not. Just said they'd sound human, not seem/act human :-) I do expect substantial user experience improvement but not in few months +Makes psych research on anthropomorphism > relevant (ppl respond differently to human-like, + voices in general). Again, 🤔 End of an era... Will kids "get" robotic voice imitations/jokes? Seems like within a few months, most digital assistants will sound human, not robotic, because of WaveNet, Tacotron, etc... 🤔 mas mañana... "Retrosynthetic reaction prediction using neural sequence-to-sequence models," Liu et al.: https://t.co/GrQ3LmCGCC "Assessing the Linguistic Productivity of Unsupervised Deep Neural Networks," Phillips and Hodas: https://t.co/PVFhcqXuGQ "Learning Paraphrastic Sentence Embeddings from Back-Translated Bitext," Wieting et al.: https://t.co/ctuxhPZWx6 "Transferring Knowledge from Discriminative Learning to a Generative Visual Dialog Model," Lu et al.: https://t.co/x5OinGJW0d "Visual pathways from the perspective of cost functions and multi-task deep neural networks," Scholte et al.: https://t.co/srwWRVen3B "A Frame Tracking Model for Memory-Enhanced Dialogue Systems," Schulz and Zumer et al., Microsoft Maluuba: https://t.co/1c3WLmnT5j "Adversarial-Playground: A Visualization Suite for Adversarial Sample Generation," Norton and Qi: https://t.co/rlrEHcgLxJ arXiv papers, June 7 - "UCB and InfoGain Exploration via Q-Ensembles," Chen et al., OpenAI: https://t.co/kUbE9nEfhv w/ Atari results. @mattpetersen_ai there will be lots more jobs than ppl for years to come, I'm quite sure :) Relevant to AI today. Can't expect policy-makers to figure it (AI safety, avoiding arms races etc.) all out - int'l scientist dialogue impt. One often hears about scientists being overruled on Hiroshima/Nagasaki, less so about scientists collab'ing in post-Cold War nuke securing.. @SiegfriedHecker, from "Adventures in scientific nuclear diplomacy." https://t.co/xXMCBopteR RT @Miles_Brundage: I very highly recommend this post by @iamtrask on encrypted AI surveillance for reconciling privacy and security: https… RT @mark_riedl: Reinforcement learning with corrupted reward channels https://t.co/YWWBkQm8gR blog post by Tom Everitt @ericjang11 @hardmaru was that really unanticipated? Maybe the extent, but I'd think that was part of the goal... @mikarv CC @iamtrask @mikarv with all these characteristics, though? saw a specific proposal related to graphical models elsewhere, quite limited... @AMP_SV @Smerity @Stanford @a16z indeed... Very excited about this idea - very plausible and important yet neglected. Most important thing you'll read today, for sure. Check it out! @adropboxspace @Smerity @Stanford @a16z fair point. @Smerity @Stanford @a16z can't even finish class before - https://t.co/v3xun9MNdf @Smerity @Stanford @a16z Is a16z soliciting pitches? recruiting? I guess that makes sense, still feels gross to me. That's it for now... FYI, was *very* selective today, left out many potentially interesting papers. The Global War on Error continues... "Neuro-RAM Unit with Applications to Similarity Testing and Compression in Spiking Neural Networks," Lynch et al.: https://t.co/W7U6W7faKv "Learning Whenever Learning is Possible: Universal Learning under General Stochastic Processes," Steve Hanneke: https://t.co/ffMEVqHMiJ "Bayesian LSTMs in medicine," van der Westhuizen and Lasenby: https://t.co/vcfltAPYbf "Deep MIMO Detection," Samuel et al.: https://t.co/FiQy9lMMe8 "InfiniteBoost: building infinite ensembles with gradient descent," Rogozhnikov and Likhomanenko: https://t.co/i3Of8FxAHR "On the Emergence of Invariance and Disentangling in Deep Representations," Achille et al.: https://t.co/7pmyzJradS "Active learning machine learns to create new quantum experiments," Melnikov et al.: https://t.co/IcmYHu2Yev "Information, Privacy and Stability in Adaptive Data Analysis," Adam Smith: https://t.co/xk9i8SUxf4 "Ensemble Bayesian Optimization," Wang et al.: https://t.co/JZxu9PorzE "One-Sided Unsupervised Domain Mapping," Benaim and Wolf: https://t.co/kJghTh5hYN "MobiRNN: Efficient Recurrent Neural Network Execution on Mobile GPU," Cao et al.: https://t.co/qN6dhHemsR """IDK Cascades: Fast Deep Learning by Learning not to Overthink,"" Wang et al.: https://t.co/D4kWPuWj9T (love the title)" "Learning Person Trajectory Representations for Team Activity Analysis," Mehrasa et al.: https://t.co/69wenZFnY8 "Heterogeneous Face Attribute Estimation: A Deep Multi-Task Learning Approach," Han et al.: https://t.co/ZncBrxdDNU "Learning by Association - A versatile semi-supervised training method for neural networks," Häusser et al.: https://t.co/CPyljT7ZqX "Concept Transfer Learning for Adaptive Language Understanding," Zhu and Yu: https://t.co/o3nUlViCKT "Concurrence-Aware Long Short-Term Sub-Memories for Person-Person Action Recognition," Shu et al.: https://t.co/9bsnrKz4m2 "See, Hear, and Read: Deep Aligned Representations," Aytar et al.: https://t.co/PlAh3UhFkU "Context-aware, Adaptive and Scalable Android Malware Detection through Online Learning," Narayanan et al.: https://t.co/0QwHXTCj3J "Financial Series Prediction: Comparison Between Precision of Time Series Models and Machine L. Methods," Qian+Gao: https://t.co/NnYDGPxt3S "Semantic Vector Encoding and Similarity Search Using Fulltext Search Engines," Rygl et al.: https://t.co/PBFhH0mIKQ "Visuospatial Skill Learning for Robots," Ahmadzadeh et al.: https://t.co/5Z0HRzeSLp "Order embeddings and character-level convolutions for multimodal alignment," Wehrmann et al.: https://t.co/5MroYv8ht8 "Where and Who? Automatic Semantic-Aware Person Composition," Tan et al.: https://t.co/6hawmE7tmR "Personalized Age Progression with Bi-level Aging Dictionary Learning," Shu et al.: https://t.co/JO1N1rifNQ "Face R-CNN," Wang et al.: https://t.co/NbsNKE3cLP "CRNN: A Joint Neural Network for Redundancy Detection," Fu et al.: https://t.co/WDtjv8QaPq "Actor-Critic for Linearly-Solvable Continuous MDP with Partially Known Dynamics," Nishi et al.: https://t.co/H4rth8mbTQ "An ROS-based Shared Commun. Middleware 4 Plug & Play Modular Intelligent Design of Smart Systems" Chakraborti et al https://t.co/D6g5TvyZAf "Graphons: A Nonparametric Method to Model, Estimate, and Design Algorithms for Massive Networks," Borgs+Chayes: https://t.co/WhSevBX6Mv "Binary Patterns Encoded CNNs for Texture Recognition and Remote Sensing Scene Classification," Anwer et al.: https://t.co/OCvLcK9qNc "One-step and Two-step Classification for Abusive Language Detection on Twitter," Park and Fung: https://t.co/PQRGjun8vm "Compressing Deep Neural Network Structures for Sensing Systems with a Compressor-Critic Framework," Yao et al.: https://t.co/R3uOUeBUu6 "Hierarchical LSTM with Adjusted Temporal Attention for Video Captioning," Song et al.: https://t.co/49z6eZVAQV "Learning Structured Semantic Embeddings for Visual Recognition," Li et al.: https://t.co/0aTKWyTFts "Deep learning evaluation using deep linguistic processing," Kuhnle and Copestake: https://t.co/vastiaqEWS "Neuroevolution on the Edge of Chaos," Filip Matzner: https://t.co/TavyF8ibw1 "Event Representations for Automated Story Generation with Deep Neural Nets," Martin et al.: https://t.co/lZ1cpLtBHa "Yeah, Right, Uh-Huh: A Deep Learning Backchannel Predictor," Ruede et al.: https://t.co/9O5y6sumaV "Submanifold Sparse Convolutional Networks," Graham and van der Maaten: https://t.co/FbwsTvrokX "Time-Varying Formation Controllers for Unmanned Aerial Vehicles Using Deep Reinforcement Learning," Conde et al.: https://t.co/85CNY5ymzb "Multi-Observation Elicitation," Casalaina-Martin et al.: https://t.co/jwg6yvVbju "ToPs: Ensemble Learning with Trees of Predictors," Yoon et al.: https://t.co/H28Kc9SMVH "Language Generation with Recurrent Generative Adversarial Networks without Pre-training," Press et al.: https://t.co/vCgcIfgaCL "NullHop: A Flexible Convolutional NN Accelerator Based on Sparse Representations of Feature Maps," Aimar et al.: https://t.co/1x5UV1ohp1 "A method for the online construction of the set of states of an MDP using Answer Set Programming," Ferreira et al.: https://t.co/tIqicHWBTA "Reservoir Computing for Detection of Steady State in Performance Tests of Compressors," Antonelo et al.: https://t.co/T31sheFhlZ "Visual Interaction Networks," Watters et al.: https://t.co/8CvuOfmcvR "A Joint Model for Question Answering and Question Generation," Wang, Yuan, and Trischler: https://t.co/GlRhDk6NAv arXiv papers, June 6 - "Learning Neural Programs To Parse Programs," Chen et al.: https://t.co/zo29n6uW5S I very highly recommend this post by @iamtrask on encrypted AI surveillance for reconciling privacy and security: https://t.co/5BcMeKbMNI RT @DeepMindAI: Simple but powerful approaches to relational reasoning: https://t.co/9Dg4ue5B03 New blog by @santoroAI @dnraposo & Nick Wat… RT @chrmanning: 🤔 That @Forbes “Contributor” @peterahigh expanded NLP as neuro-linguistic programming undermines his technical cred… https:… RT @iamtrask: Safe Crime Prediction - Homomorphic Encryption + Deep Learning for Less Intrusive Surveillance https://t.co/g4HFg61OjD @adam_will_do_it This doesn't hurt either https://t.co/ykLrQtVV8d RT @SybilT2: OMG, Bob Costa reports that in lieu of "war room," Trump intends to be "his own messenger" and will tweet WHILE Comey testifie… @sknthla haha k @sknthla have you read Against Democracy? @davegershgorn "an area of artificial intelligence known as “deep” or “unsupervised” learning"...also starting each definition w "complex" 👎 @_jyan_ hmm will be interesting to see that. Have you looked at the AGI Roadmapping Institute/GoodAI's stuff on this? @_jyan_ I'm not that sure but think it is plausible/worth taking v seriously RT @mcxfrank: Very exciting work - how can probabilistic inference explain apparently suboptimal reasoning patterns (like anchoring and adj… (= one reason I'm pretty bullish about AI progress over the next decade... thousands to tens of thousands of people in the pipeline) AI class the size of a medium size AI conference. https://t.co/cn86oStjgo RT @drfeifei: 2/2 This is for the largest DL course at Stanford https://t.co/gy3ZWjGbws 750+ students, poster session at Stanford 12-3pm Bi… RT @drfeifei: 1/2 #AI press friends, plz contact @jcjohnss if you are interested in checking out the poster session of our deeplearning cla… @AMP_SV thanks! @AMP_SV is that worth watching overall? RT @NandoDF: One of the most important deep learning papers of the year, thus far. https://t.co/tepaqQLmwV RT @santoroAI: Excited about our new paper on relational reasoning, with @dnraposo @PeterWBattaglia and others at DeepMind. https://t.co/Qt… @santoroAI In any case, some amazing progress going on in visual reasoning these days. @santoroAI Note: Johnson et al. also showed big CLEVR jump recently https://t.co/RheG8c2b9z tho authors of DM paper say not comparable bc extra signal. @santoroAI (there are other good results, too, but flagging the CLEVR one as that's seemed like a difficult dataset as of late) @santoroAI Great work, @santoroAI and Raposo et al.! @santoroAI I've been mostly sticking to the tweeting papers in a thread thing, but this deserves its own thread. From subhuman to superhuman overnight. """A simple neural network module for relational reasoning,"" @santoroAI and Raposo et al., DeepMind: https://t.co/WUFADvtrZF Massive jump!!! https://t.co/tlBDH4AXkA" RT @rcalo: Scholarships for women interested in artificial intelligence. https://t.co/l0vGltYL4L ht @ZacharyGraves Soft submission deadline of June 29. Open to folks w/ backgrounds on CS, law, social science etc. sides. Great oppo. for moving into field! Good job in AI policy/strategy alert - "PULSE Fellowship in AI, Law, and Policy," generous salary + flexible scope: https://t.co/rUp9MQrN0W @davegershgorn I used The Secret @davegershgorn are you gonna write an AI/Apple summary? @m2n037 not all, I skim them to make sure they're interesting/relevant to my followers. @m2n037 no. @adam_will_do_it at least if one accepts "tonight's arXiv" as a suitable shorthand for "tonight's batch of arXiv papers"... but, yeah, tired @adam_will_do_it what I said made sense. :) Tired from running a workshop so may or may not be able to get to tonight's arXiv tonight... "A Vision-Guided Multi-Robot Cooperation Framework for Learning-by-Demonstration and Task Reproduction," Huang et al https://t.co/D7HWm289BO "Deep Learning: A Bayesian Perspective," Polson and Sokolov: https://t.co/WsQaLXgEge "Classification of meaningful and meaningless visual objects: a graph similarity approach," Mheich et al.: https://t.co/hSw6w8hgyU "Fast approximate Bayesian inference for stable differential equation models," Maybank et al.: https://t.co/lcCenXJbLK "Bias-Variance Tradeoff of Graph Laplacian Regularizer," Chen and Liu: https://t.co/5N3tLso01M "Streaming Bayesian inference: theoretical limits and mini-batch approximate message-passing," Manoel et al.: https://t.co/bcTwuHZI5b "NMTPY: A Flexible Toolkit for Advanced Neural Machine Translation Systems," Caglayan et al.: https://t.co/udXELMEsKu "Machine Assisted Analysis of Vowel Length Contrasts in Wolof," Gauthier et al.: https://t.co/ZFje4cx9h4 "Function Assistant: A Tool for NL Querying of APIs," Richardson and Kuhn: https://t.co/Sc651hicE5 "Personalized Pancreatic Tumor Growth Prediction via Group Learning," Zhang et al.: https://t.co/KGWQmEIj47 "Dynamic Stripes: Exploiting the Dynamic Precision Requirements of Activation Values in NNs," Delmas et al.: https://t.co/BWl2fDNg5f "Discriminative conditional restricted Boltzmann machine 4 discrete choice +latent variable modelling," Wong et al.: https://t.co/TA5nLnGguw "Morphological Embeddings for Named Entity Recognition in Morphologically Rich Languages," Gungor et al.: https://t.co/UilW86nu4i "A Vision System for Multi-View Face Recognition," Shams et al.: https://t.co/k7AVzeVL3o "Temporal correlation detection using computational phase-change memory," Sebastian et al.: https://t.co/3qkp8dewQ6 "CATERPILLAR: Coarse Grain Reconfigurable Architecture 4 Accelerating the Training of Deep NNs," Li and Pedram: https://t.co/W9TMZ4Kyib "Data Augmentation of Wearable Sensor Data for Parkinson's Disease Monitoring using CNNs," Um et al.: https://t.co/s2nkPvWEpG "Integrated Deep and Shallow Networks for Salient Object Detection," Zhang et al.: https://t.co/9Evj5JpOGg "Recursive Cross-Domain Face/Sketch Generation from Limited Facial Parts," Song et al.: https://t.co/4S410pDufk "Rank Persistence: Assessing the Temporal Performance of Real-World Person Re-Identification," Karanam et al.: https://t.co/IyAxS0xmA7 "Exception-Based Knowledge Updates," Slota and Leite: https://t.co/iKD3w7an6c "Image Restoration from Patch-based Compressed Sensing Measurement," Nie et al.: https://t.co/yCEYwcTZWs "Joint Modeling of Topics, Citations, and Topical Authority in Academic Corpora," Kim et al.: https://t.co/B9k4L6UqRC "Attentive Convolutional Neural Network based Speech Emotion Recognition," Neumann and Vu: https://t.co/nmDCA6mfEU "Dual-reference Face Retrieval: What Does He/She Look Like at Age `X'?," Hu et al.: https://t.co/u6uOJXAoFg "Robust Deep Learning via Reverse Cross-Entropy Training and Thresholding Test," Pang et al.: https://t.co/Qhwcx1yGrc "Joint Matrix-Tensor Factorization for Knowledge Base Inference," Jain and Murty et al.: https://t.co/z9WVi4ZFUl "Prosodic Event Recognition using Convolutional Neural Networks with Context Information," Stehwien and Vu: https://t.co/TQLFGqfpfF "Temporal Action Labeling using Action Sets," Richard et al.: https://t.co/GfNWoDpjVU "Hashtag-centric Immersive Search on Social Media," Gao et al.: https://t.co/T5wDXF91eJ "Weight Sharing is Crucial to Succesful Optimization," Shalev-Shwartz et al.: https://t.co/rHsKWgoZTg Super wild idea... basically, give people's e-bikes a boost in particular areas that are polluted to reduce breathing rate/pollution intake. "Cyberphysics, pollution mitigation, and pedelecs," Sweeney et al.: https://t.co/FALLLdJxfz RT @DrBeef_: Trained a GAN on a dataset of oil paintings I scraped - Epoch ~2500 and some of them are starting to look real! https://t.co/T… @davegershgorn guess I'm (a) nobody, then @y0b1byte whoa, congrats on the coverage! :) RT @timhwang: Statements beginning with "No one is working on..." or "No one is talking about...": sometimes locally true, globally almost… RT @AliMakhzani: Our new paper, "PixelGAN autoencoders": semi-supervised learning with GAN inference networks and PixelCNN decoders https:/… More tomorrow... "Hyperparameter Optimization: A Spectral Approach," Hazan et al.: https://t.co/sTtjDJWYt4 "On Unifying Deep Generative Models," Hu et al., CMU/Petuum: https://t.co/YD4CjJNvxv "Latent Attention Networks," Grimm et al.: https://t.co/7VijuTretF "PixelGAN Autoencoders," @AliMakhzani and Frey: https://t.co/OXnY1j37MQ arXiv papers, June 5 - "Tensor Contraction Layers for Parsimonious Deep Nets," Kossaifi et al., Amazon AI: https://t.co/nWdJATBJT4 "RT @JohnDingell: Trump still hasn't appointed an FBI Director, the DOJ is in shambles, and he spent the entire weekend golfing. But please…" RT @AFP: #BREAKING London mayor 'has more important things to do' than respond to Trump tweets: spokesman @RikeFranke great book. I'm late on Snow Crash/all his other stuff though @elidourado @ArtirKel @danwwang @techreview AlphaGo has played many orders of magnitude more games than any human has - question asked about expert play with comparable training. @elidourado @ArtirKel @danwwang @techreview this was a misinterpretation on MIT TR's part FYI - see this thread: https://t.co/eZWeX7NTlL @sknthla doesn't surprise me...the relevant hashtags are dumpster fires of idiot Americans right now RT @rrrrrrhiannon: this man saved my life. he screamed at me to run. please help me find him so i can thank him #LondonBridgeAttack https:/… RT @DeepSpiker: Take that continuous control people. Such a long way to go. https://t.co/OoX2GhEZwp "RT @syhw: The CfP for our Video Games and Machine Learning workshop at ICML2017 has arrived https://t.co/hUH4QTrQJ8 (cc @togelius @OriolVin…" RT @b3ta: "covfefe" by ? - just FP'd: https://t.co/ZcQKv4zMv0 https://t.co/xTisSbOGkH RT @elonmusk: It's starting to feel kinda normal to reuse rockets. Good. That's how it is for cars & airplanes and how it should be for roc… @chrisalbon just listen at 16x speed @AMP_SV last I checked, his personal account had not but the other official POTUS one which is sometimes (but not always) coherentish did RT @lidija_sekaric: The change has been very rapid, too. Energy transitions don't have to take half a century, it seems. https://t.co/XVi… RT @metpoliceuk: Please continue to avoid #LondonBridge & #BoroughMarket if you can. Please do not call 999 unless it is an emergency. RT @jinxgoh: @MarkHoffarth @NeilLewisJr @PennyPexman @GordPennycook Actual footage of my advisor vs me trying to get a job https://t.co/MEd… TFW you have thousands of intelligence/military/homeland security officials at your disposal, but want to promote pixelated sirens instead. https://t.co/vv4wcs6FN1 "rights" https://t.co/cJEnxgU08z @histoftech @tnmoc 3rd is Colossus, I think (from your talk) :) RT @conorduffy_7: In light of what's happening on London Bridge, re-upping this. https://t.co/3wgio0IHHy RT @ericjang11: TFW when Pieter Abbeel authors more papers in a week than I read. RT @fchollet: Google web search interest around deep learning frameworks over time. If you remember Q4 2015 and Q1-2 2016 as confusing, you… @samim @togelius @yannakakis +1 "RT @togelius: .@yannakakis and I are excited to announce the first public draft of the Artificial Intelligence and Games book: https://t.co…" @PatrickOmid hmm, not loading for me either. CC @karpathy @sknthla fascinating, thx for sharing! RT @patrickc: If interested in our learnings, email us at environment@stripe.com. Businesses of all sizes can do it. RT @patrickc: For the past few months, we've been figuring out how to make Stripe carbon neutral. Nearly ready to go. RT @rbhar90: Interesting article, but still haven't seen any killer apps of neuromorphic chips https://t.co/CefsWz15Kk RT @timhwang: in @slate today with @samuelwoolley, talking about online misinformation campaigns and platform transparency: https://t.co/je… Lots of others to explore, as well. A few that got multiple recommendations, FYI, are The Three Body Problem, Sapiens, Behave. Thanks all for the great recommendations! See replies if you want book recs from Miles-following types of folks :) https://t.co/YGqzrulDYN Could probably find better or comparable results for each of those in a specialized app/website, but impressive to do all of them decently. Quite good results here from folks at Facebook, Sorbonne, and INRIA. https://t.co/I7ZrohORzc @davegershgorn rejoice that I had GPUs! @Altimor great read, read it a while back. RT @RobertIger: As a matter of principle, I've resigned from the President's Council over the #ParisAgreement withdrawal. @togelius @Aelkus or have the computer step into you 🤖 @AlxCoventry @Smerity @EdHenry_ I saw that pt made by @robinhanson here which, along with length/work etc, deterred me from reading it a bit @AMP_SV @gchrupala rings a bell... @gchrupala I like it! @gchrupala is that a quote from the book? @miss_speech I just watched the trailer for it and it does seem like it'd be quite moving. thanks! @miss_speech very helpful, thanks! @miss_speech what did you like about Gilchrist's short stories (/which collection)? Didn't glean much from Wikipedia, just says has persistent characters @EdHenry_ embarrassingly, I haven't read Three-Body Problem. It's that good? @Brett_Fujioka yes. @Aelkus what should I be looking at on the latter? 2016 proceedings? What's the best book you've read lately? @gwern I was wondering about that... That's it for this week! "Machine Learning Based Crackle Detection in Lung Sounds," Grønnesby et al.: https://t.co/08DLXj8Erg "A Learning Based Optimal Human Robot Collaboration with Linear Temporal Logic Constraints," Wu et al.: https://t.co/0KLVj6286z "Megapixel Size Image Creation using Generative Adversarial Networks," Marco Marchesi et al.: https://t.co/sywurCs7jK quite high res stuff https://t.co/AQTdDey5y2 "Free energy-based reinforcement learning using a quantum processor," Levit et al.: https://t.co/n6xPbNP2k3 "Putting a Face to the Voice: Fusing Audio and Visual Signals Across a Video to Determine Speakers," Hoover et al.: https://t.co/OmA1sQi3JD "Learning Time-Efficient Deep Architectures with Budgeted Super Networks," Veniat and Denoyer: https://t.co/1kTweBG8AB "Biased Importance Sampling for Deep Neural Network Training," Katharopoulos and Fleuret: https://t.co/2yRvei6JQS "Using GPI-2 for Distributed Memory Paralleliziation of the Caffe Toolbox to Speed up Deep NN Training," Kuehn et al https://t.co/YDbnmepHaK "Automatic Differentiation using Constraint Handling Rules in Prolog," Samer Abdallah: https://t.co/SmNSG8G1CX "Depth Structure Preserving Scene Image Generation," Zhang et al.: https://t.co/TanLVPmcKp "Deep Learning for Hate Speech Detection in Tweets," Badjatiya et al.: https://t.co/atddwzME4F "Shared Autonomy via Hindsight Optimization for Teleoperation and Teaming," Javdani et al.: https://t.co/tD9rOVRstq "Cross-modal Common Representation Learning by Hybrid Transfer Network," Huang et al.: https://t.co/NKuCv7tnZg "Natural Language Generation for Spoken Dialogue System using RNN Encoder-Decoder Networks," Tran and Nguyen: https://t.co/YZnxO7kdjx "Semantic Refinement GRU-based Neural Language Generation for Spoken Dialogue Systems," Tran and Nguyen: https://t.co/lMzMj4Icn7 "Superhuman Accuracy on the SNEMI3D Connectomics Challenge," Lee et al.: https://t.co/5QFSiCAOur "One button machine for automating feature engineering in relational DBs," Lam et al., IBM: https://t.co/ndQub7lDWT comparison to Kaggle ppl "Using of heterogeneous corpora for training of an ASR system," Trmal et al.: https://t.co/z3ieaxICwP "Learning to Compute Word Embeddings on the Fly," Bahdanau et al.: https://t.co/iTNmUl9o06 "Integer Echo State Networks: Hyperdimensional Reservoir Computing," Kleyko et al.: https://t.co/vXrOpw9HYk "Discovering Discrete Latent Topics with Neural Variational Inference," Miao et al.: https://t.co/OgTmYAgbAh "Grounding Symbols in Multi-Modal Instructions," Hristov et al.: https://t.co/ePTkOOTAzv "Fader Networks: Manipulating Images by Sliding Attributes," Lample et al.: https://t.co/n9Vu4OeqTI "DiracNets: Training Very Deep Neural Networks Without Skip-Connections," Zagoruyko + Komodakis: https://t.co/58yeGmNWIy "Deep Mutual Learning," Zhang et al.: https://t.co/38oreNBm6f "Semantic Specialisation of Distributional Word Vec. Spaces using Monolingual + Cross-Ling Constraints"-Mrkšić et al https://t.co/idfIS3dNKU (that one and the next one have some Apple authors - seems like them publishing at least a bit is firmly A Thing now) "Morph-fitting: Fine-Tuning Word Vector Spaces with Simple Language-Specific Rules," Vulić et al.: https://t.co/G0xXf57hYf "Discriminative k-shot learning using probabilistic models," Bauer et al.: https://t.co/Tiaw6wqbRF "Deep Generative Adversarial Networks for Compressed Sensing Automates MRI," Mardani et al.: https://t.co/74l4vNN8Oy "Toward Robustness against Label Noise in Training Deep Discriminative Neural Networks," Arash Vahdat: https://t.co/OpIgKrMfYa "Subjective fairness: Fairness is in the eye of the beholder," Dimitrakakis et al.: https://t.co/9dh21GSfam "Supervised Quantile Normalisation," Le Morvan and Vert: https://t.co/9YJxDPNbBR "Efficient learning with robust gradient descent," Holland and Ikeda: https://t.co/hj39rDNy3O "Learning Disentangled Representations with Semi-Supervised Deep Generative Models," Siddharth et al.: https://t.co/Gfjph3FGcN "Blind nonnegative source separation using biological neural networks," Pehlevan et al.: https://t.co/eze8ogi7nK "A Metaplastic Architecture for the Emergence of Lognormal Firing Rates and Realistic Topology," Tosi/Beggs: https://t.co/asQkEEbnaw "A Formal Approach to Modeling the Cost of Cognitive Control," Ozcimder et al.: https://t.co/QSBzF5uIYE "Interpolated Policy Gradient: Merging On-Policy and Off-Policy Gradient Estimation for Deep RL," Gu et al.: https://t.co/QdI58LJynP "Transfer Learning for Speech Recognition on a Budget," Kunze et al.: https://t.co/VXPO7qtnV8 "Sinkhorn-AutoDiff: Tractable Wasserstein Learning of Generative Models," Genevay et al.: https://t.co/hvleYgaJYY arXiv papers, June 2 - "Teaching Machines to Describe Images via Natural Language Feedback," Ling and Fidler: https://t.co/iH1NZcdBMd *spend @iandanforth it definitely isn't. And by "manageable" I mean "I spent 5-10% of my waking hours filtering through the flood of AI developments, OMG plz help." The Global War on Error Rates has slowed down a bit, though. Tonight is manageable. Sorry to inform you but people wrote more good papers. I'll probably write a blog post on this when the next AlphaGo paper comes out, and reflect on what I got right/wrong about it last year. Good discussion of AlphaGo from @karpathy: https://t.co/rDCE16Sr8G @_jyan_ @techreview worked on it? Sure. Got the same results? That'd be very surprising to me. @_jyan_ @techreview so can't really comment, happy to discuss in DMs :) @_jyan_ @techreview Well they didn't claim to be first 2 work on Atari, tho some of the ppl who did subsequently joined :) I don't know what ur evidence is tho @_jyan_ @techreview (but even there, weird variation across companies) @_jyan_ @techreview openness varies across areas, though, for sure. AlphaGo = extreme case on research side, driverless cars = extreme case on applied @_jyan_ @techreview Plausible, but openness is still quite high, semi-durable for a few years IMO. But we'll see! Maybe need a falsifiable metric to forecast ;) @_jyan_ @techreview Will probably revisit this issue when the next AlphaGo paper comes out. @_jyan_ @techreview I've discussed that in blog post on AG, have updated views a bit since but overall still think secret large effort = part of why surprising @techreview Fin. @techreview ...and doing that means not focusing on just the median 50% numbers but also noting the wide variation, and few areas of agreement... @techreview ...but in absence of good data/benchmarks (which ppl are working on, but a ways to go), makes sense to take experts at least semi-seriously. @techreview For the record, I agree expert opinion should be taken with a grain of salt, hence why I like making and testing data-based forecasts... @techreview Anyway, I recommend folks read the actual paper - quite interesting results: https://t.co/VVtluIHBQL @techreview Question specified that the AI system would have comparable games played vs. a human. Visible even in figure highlighted in article. In this case, reason given for why results=bad is respondents getting AlphaGo wrong, but Q in survey is different from AlphaGo @techreview Glad to see coverage of Grace et al.'s fascinating survey results, but articles getting lots of stuff wrong ... https://t.co/kTNkZd8Fwr @azeem see upper right corner here - https://t.co/LDoKl877oV @azeem @sundarpichai @hardmaru Trump withdrawing from the Paris accord on climate change RT @karpathy: We are organizing a DeepRL bootcamp, with top notch instructors from Berkeley/DeepMind/OpenAI https://t.co/MtgTw3ac8g apply b… RT @billpeduto: As the Mayor of Pittsburgh, I can assure you that we will follow the guidelines of the Paris Agreement for our people, our… RT @elonmusk: Am departing presidential councils. Climate change is real. Leaving Paris is not good for America or the world. Great talk from @histoftech on her book Programmed Inequality on the history of women in British computing. https://t.co/jJItoD2WJG RT @timhwang: finally finished reading the reluplex paper on formal guarantees in deep neural nets and it is 🔥 https://t.co/6QfB5bhhNz @dribnet @jackclarkSF @hardmaru awesome!! Super excited to see what you come up with. @y0b1byte it does that a lot, weirdly. I think what it does is fixate on proper nouns... @deliprao hahah. I hope you succeed in that and share the tale :-) @deliprao I don't get it :( @TheAnnaGat haha :) @ArtirKel Good question :) dunno the answer. Some definitely seem to merit it. In some cases the name is just an application, not new architecture :/ @madebyollin @jackclarkSF hmm yeah could see that being a problem. @madebyollin @jackclarkSF (and/or broaden to non-actors - https://t.co/wEREJvyZNr) @madebyollin @jackclarkSF maybe try lists of currently living ppl, more likely to have digital files of caricatures than some of those? e.g. https://t.co/405GIVvqqz @madebyollin @jackclarkSF nice! @shriphani @jackclarkSF @hardmaru @dribnet could also try a bunch of unpaired images of celeb X and caricatures of X in various styles but prob not enough data on 1 person (obama?) @shriphani @jackclarkSF @hardmaru @dribnet hmm.. @shriphani @jackclarkSF @hardmaru @dribnet +not sure that there wouldn't be too much variation in terms of caricature style, faces, orientation etc. to get good results w/o pairedness @shriphani @jackclarkSF @hardmaru @dribnet in any case, I hope someone tries at some point... or I muster the nerve to do it on my work laptop @shriphani @jackclarkSF @hardmaru @dribnet right, but would think it'd make sense to leverage pairedness if available, no? @jackclarkSF @hardmaru @dribnet (10k for each of caricature/celeb photos) @jackclarkSF @hardmaru @dribnet yeah... don't have good intuition for it but FWIW I was surprised by how abundant the data is. I'd estimate getting 10k paired images=doable @jackclarkSF @hardmaru @dribnet The image search strategy assumed a need for paired images, but I guess you could be even more cavalier with CycleGANs... in theory @jackclarkSF have you/do you know if anyone has tried this?https://t.co/tBQ6vz60sh @jackclarkSF super cool, though. How much fine tuning did that need? RT @jackclarkSF: An ancient map of Babylon, transmuted via CycleGAN into a modern Google Map & Satellite View https://t.co/TIH82rLmxc @jackclarkSF CycleGANs are insane. Why did you have to remind me that I enjoy playing with AI :( Today I learned that I say "and so forth" way too often in interviews (/possibly in other contexts) 😑 @jackclarkSF this gives me a theory about your Egyptology question 🤔 RT @jackclarkSF: Having fun with CycleGAN - using it to reconstruct ancient maps as modern satellite photos. https://t.co/DMJpEu4YaP RT @MonaJalal_: Couldn't upload the CVPR paper to #arxiv because it requires it to be #texlive :/ Is there a very fast fix for this? https:… RT @eboyden3: Can you fix errors in the connectome, based on knowledge of what neurons look like? A machine learning approach. https://t.co… "SuperSpike: Supervised learning in multi-layer spiking neural networks," Zenke and @SuryaGanguli: https://t.co/09nc0lJsB7 "Variational Sequential Monte Carlo," Naesseth et al.: https://t.co/to7qtYry4c "Non-Markovian Control with Gated End-to-End Memory Policy Networks," Perez and Silander: https://t.co/j3F4h1OvcR "FALKON: An Optimal Large Scale Kernel Method," Rudi et al.: https://t.co/5RxOWaHS50 "Spectral Norm Regularization for Improving the Generalizability of Deep Learning," Yoshida and Miyato: https://t.co/wfnuWzag58 "Sequential Dynamic Decision Making with Deep Neural Nets on a Test-Time Budget," Zhu et al.: https://t.co/eLyQpVlsv3 "Sparse and low-rank approximations of large symmetric matrices using biharmonic interpolation," Turek and Huth: https://t.co/yixeiOi93T "Identification of Gaussian Process State Space Models," Eleftheriadis et al.: https://t.co/8cxPWBpTXB "Objective-Reinforced Generative Adversarial Networks (ORGAN) for Sequence Generation Models," Guimaraes et al.: https://t.co/faeNxfXOTD "Surface Networks," Kostrikov et al.: https://t.co/MzumsyKvRS "Large Linear Multi-output Gaussian Process Learning for Time Series," Feinberg et al.: https://t.co/RTMAQ5hnEX "Greedy Algorithms for Cone Constrained Optimization with Convergence Guarantees," Locatello et al.: https://t.co/6iH1z4GLT5 "Adversarial Generation of Natural Language," Rajeswar et al.: https://t.co/NE2lPqYeWM "The ALAMO approach to machine learning," Wilson and Sahinidis: https://t.co/YTO3H9Bzk9 "Unsupervised Learning of Disentangled Representations from Video," Denton and Birodkar: https://t.co/W6PSxzlMs4 "Optimization of Tree Ensembles," Velibor V. Mišić: https://t.co/4PnP3c8NQl "Morphological Error Detection in 3D Segmentations," Rolnick et al.: https://t.co/wmZ70nCNFw "The Morphospace of Consciousness," Arsiwalla et al.: https://t.co/ZvS5tk54qA "Semi-Supervised Learning for Detecting Human Trafficking," Alvari et al.: https://t.co/Cv3FvsaHXc "Character Composition Model with CNNs for Dependency Parsing on Morphologically Rich Languages," Yu and Vu: https://t.co/1H46Atzo0U "Practical Neural Network Performance Prediction for Early Stopping," Baker et al.: https://t.co/E1R8uAZqkz "Experience Replay Using Transition Sequences," Karimpanal and Bouffanais: https://t.co/CuuI7ql9ZU "Estimating Human Intent for Physical Human-Robot Co-Manipulation," Townsend et al.: https://t.co/2l8t4TJSlh "Generic Tubelet Proposals for Action Localization," He et al.: https://t.co/8Bey6T0FnV "Working hard to know your neighbor's margins:Local descriptor learning loss," Mishchuk et al.: https://t.co/C3TZaSsl7m "Lifelong Multi-Agent Path Finding for Online Pickup and Delivery Tasks," Ma et al.: https://t.co/6d7LBWHLs7 "Deep Learning for Environmentally Robust Speech Recognition: An Overview of Recent Developments," Zhang et al.: https://t.co/ZfrQmR5UF6 "Propositional Knowledge Representation in Restricted Boltzmann Machines," Son Tran: https://t.co/vTRkMJZ7nU "Does the Geometry of Word Embeddings Help Doc. Classif? A Case Study on Persistent Homology Based Reps"Michel et al https://t.co/CDb5uBHzK4 "Weakly Supervised Generative Adversarial Networks for 3D Reconstruction," Gwak et al.: https://t.co/aM9xxshD6A "Provably Safe Robot Navigation with Obstacle Uncertainty," Axelrod et al.: https://t.co/WK6CnhGFxJ "Design of Deep Neural Networks as Add-on Blocks for Improving Impromptu Trajectory Tracking," Zhou et al.: https://t.co/nbMKGfVJL2 "Real-Time Robot Localization, Vision, and Speech Recognition on Nvidia Jetson TX1," Tang et al.: https://t.co/luPgFupf7v "Distributed Simulation Platform for Autonomous Driving," Tang et al.: https://t.co/PeqjiJSst8 "Target Aware Optimal Visual Navigation for UAVs," Potena et al.: https://t.co/hPPrh0PUYA "Deep Supervised Discrete Hashing," Li et al.: https://t.co/53tllAkdSg "Adversarial Ranking for Language Generation," Lin et al.: https://t.co/9W1erRCr2W "End-to-end Differentiable Proving," Rocktaschel (@_rockt) and Riedel: https://t.co/SyBgl0fSrJ "3D Mesh Segmentation via Multi-branch 1D Convolutional Neural Networks," George et al.: https://t.co/MQ1ZrAGwOR "Neuron Segmentation Using Deep Complete Bipartite Networks," Chen et al.: https://t.co/tHjavgi0rF "EvaluationNet: Can Human Skill be Evaluated by Deep Networks?," Kim and Ro: https://t.co/R5fFZVCllx "HiNet: Hierarchical Classification with Neural Network," Wu and Saito: https://t.co/yJgpJmS6Tu "Controllable Invariance through Adversarial Feature Learning," Xie et al.: https://t.co/3NJMzmLIg2 "Mining Frequent Learning Pathways from a Large Educational Dataset," Patel et al.: https://t.co/dEw9F7GOgC "Representation Learning by Rotating Your Faces," Tran et al.: https://t.co/VEZfg4ZhX4 "Reinforcement Learning for Learning Rate Control," Xu et al.: https://t.co/CNeEQrTz5a "Learning When to Attend for Neural Machine Translation," Li/Zhu: https://t.co/hYlFv07LV9 "Adversarial Inversion: Inverse Graphics with Adversarial Priors," Tung et al.: https://t.co/6JA9z4k7uA "Are distributional reps ready for the real world? Evaluating word vecs 4 grounded perceptual meaning"-Lucy/Gauthier https://t.co/gaLaWYTn7E "Long-term Correlation Tracking using Multi-layer Hybrid Features in Sparse and Dense Environments," Baisa et al.: https://t.co/dMuTVV3o3P "Emergence of Language with Multi-agent Games: Learning to Communicate with Sequences of Symbols," Havrylov/Titov: https://t.co/1klwhfdWs4 "Criticality & Deep Learning II: Momentum Renormalisation Group," Oprisa and Toth: https://t.co/iXFn1tDE8U arXiv papers, June 1 - "The Atari Grand Challenge Dataset," Kurin (@y0b1byte) et al.: https://t.co/kfh3oAbG2v @mtrc Clickbaity headline, but the survey in question is of NIPS/ICML paper authors, not random futurologists. Fun chat about the future of AI, existential risk, work, privacy, etc. with some young Montreal folks - https://t.co/FrKggMe1rx @davegershgorn right? People don't appreciate how big of a deal Tencent is... RT @marcgbellemare: Our new paper is out! Surprising results re: Wasserstein distance. Expecting plenty of Seinfeld jokes. W/@balajiln and… RT @SandraWachter5: Check out our new @sciencemagazine @SciRobotics paper, accountability in #AI #Robotics https://t.co/I4R4LUJL4A with @b_… "Knowledge Base Completion: Baselines Strike Back," Kadlec et al.: https://t.co/wRl7gbymhi "A Kernel Redundancy Removing Policy for Convolutional Neural Network," Liu et al.: https://t.co/eSAkgqMalw "Generating Steganographic Text with LSTMs," Fang et al.: https://t.co/CKry4WdTqw "Efficient Decentralized Visual Place Recognition From Full-Image Descriptors," Cieslewski + Scaramuzza: https://t.co/oTURyY3430 "Deep manifold-to-manifold transforming network for action recognition," Zhang et al.: https://t.co/HeNSIOqZNy "Multi-View Task-Driven Recognition in Visual Sensor Networks," Taalimi et al.: https://t.co/1cJ43XJroR "Cautious Model Predictive Control using Gaussian Process Regression," Hewing and Zeilinger: https://t.co/yLG8JypGPy "A Residual DL Arch. for Crowd Counting, Violent Behaviour Detection+ Crowd Density Level Classific.," Marsden et al https://t.co/mMYiVN1P7l "Auditing Search Engines for Differential Satisfaction Across Demographics," Mehrotra et al.: https://t.co/IjetVOcgse "Feature Squeezing Mitigates and Detects Carlini/Wagner Adversarial Examples," Xu et al.: https://t.co/kO9yJovk6M "Domain Adaptation with Randomized Multilinear Adversarial Networks," Long et al.: https://t.co/dDKmrPxC8m "Discovering Visual Concept Structure with Sparse and Incomplete Tags," Wang et al.: https://t.co/HBWcVqS2au "Optimizing Memory Efficiency for Convolution Kernels on Kepler GPUs," Chen et al.: https://t.co/KjMcLwVIWU "Character-Based Text Classification using Top Down Semantic Model for Sentence Representation," Wu et al.: https://t.co/90zuUn1lbU "Parcellation of Visual Cortex on high-resolution histological Brain Sections using CNNs," Spitzer et al.: https://t.co/Pv562kDJZg "IRGAN: A Minimax Game for Unifying Generative and Discriminative Information Retrieval Models," Wang et al.: https://t.co/bl8mKeaaVQ "Implications of Decentralized Q-learning Resource Allocation in Wireless Networks," Wilhelmi et al.: https://t.co/HVNclLMVSz "Exploiting Restricted Boltzmann Machines and Deep Belief Networks in Compressed Sensing," Polania and Barner: https://t.co/VpauODHgCz "RSI-CB: A Large Scale Remote Sensing Image Classification Benchmark via Crowdsource Data," Li et al.: https://t.co/3lGiLHpXUv "Robust Tracking Using Region Proposal Networks," Ren et al., SenseTime: https://t.co/o46cjpRzLD "Unsupervised Person Re-identification: Clustering and Fine-tuning," Fan et al.: https://t.co/6atnE5hg6o (I see what they did there...) "MOBA: a New Arena for Game AI," Silva and Chaimowicz: https://t.co/LtctjEgu53 "Fine-grained acceleration control for autonomous intersection management using deep RL," Mirzaei and Givargis: https://t.co/kMRN5F6Kzb "Learning-based Formal Synthesis of Cooperative Multi-agent Systems," Dai et al.: https://t.co/y6zEhjMqJS "Learning End-to-end Multimodal Sensor Policies for Autonomous Navigation," Liu et al.: https://t.co/Dsa76ZJiSI "Discriminatively Learned Hierarchical Rank Pooling Networks," Fernando and Gould: https://t.co/P0faYJIFIL "Learning to Generate Chairs with Generative Adversarial Nets," Zamyatin and Filchenkov: https://t.co/Pb5U718TBV "On the 'Calligraphy' of Books," Marinho et al.: https://t.co/1Niq712YkY "Collaborative Deep Learning for Speech Enhancement: A Run-Time Model Selection Method Using Autoencoders,"Minje Kim https://t.co/kiMWtj3lyp "Indoor UAV Navigation to a Rayleigh Fading Source Using Q-Learning," Ciftler et al.: https://t.co/BUmrVun4nG "DNN-based uncertainty estimation for weighted DNN-HMM ASR," Novoa et al.: https://t.co/kLiUEdFvIH "Classification of Major Depressive Disorder via Multi-Site Weighted LASSO Model," Zhu et al.: https://t.co/whgZuSizJy (quite the team here) "Jeffrey's prior sampling of deep sigmoidal networks," Hayden et al.: https://t.co/DlOIr8lmGf "Fast learning rate of deep learning via a kernel perspective," Taiji Suzuki: https://t.co/t3tIdj5tOu "Gradient Descent Can Take Exponential Time to Escape Saddle Points," Du et al.: https://t.co/7W2LpmWrcn "Federated Multi-Task Learning," Smith et al.: https://t.co/aQ20RBe7cJ "Online to Offline Conversions and Adaptive Minibatch Sizes," Kfir Levy: https://t.co/zyI0LYpgEK "Recurrent Estimation of Distributions," Oliva et al.: https://t.co/IVg3JLQAbo "Neural Embeddings of Graphs in Hyperbolic Space," Chamberlain et al.: https://t.co/XnPQjR7LNN "Fair Inference On Outcomes," Nabi and Shpitser: https://t.co/wA18BzVPx2 "Model Selection in Bayesian Neural Networks via Horseshoe Priors," Ghosh and Doshi-Velez: https://t.co/qbA0dDZChM RT @deliprao: T-3 hours before we release test data for Task I of #FakeNewsChallenge (stance detection). Time for Some stats! RT @karpathy: New post on placing AlphaGo in context of AI research https://t.co/tI3VkUGYsT trying to mix in a pinch of low-level depth to… RT @MSNBC: Spicer on 'covfefe' tweet: "The president and a small group of people know exactly what he meant." https://t.co/URM4mW8pmO RT @weballergy: 'Deep Learning is Robust to Massive Label Noise': encouraging results. https://t.co/6nJCbPWwZ3 #deeplearning #machinelearni… RT @EdFelten: Unpacking the debate over "explainability" of AI algorithms. New blog post. https://t.co/xZgltRoPQh RT @zeynep: My book is creative commons! If it sells a bit, I'll donate the $$ to refugees+my publisher can do this for others.😀 https://t.… RT @gilbertjasono: Got an unhinged email from a Trump supporter and Google's suggested replies are 100% perfect https://t.co/HIQWuSxy7v @davegershgorn not that far off actually https://t.co/uozYFpAjSJ @davegershgorn https://t.co/dnKIfCT5at @levendowski don't worry, we've got you covfefered Last one... https://t.co/SZdKSspkpl @adam_will_do_it 👨‍⚖️🇺🇸 RT @fchollet: https://t.co/NnWAp0xtGY @fchollet beat me to it Figure 1 from the preprint of "Convergence of Value Function Estimates For Exploration (COVFEFE)," Trump et al.: https://t.co/hhYCInqDAL Covfeferacy of Dunces Not sure about this season of House of Covfefe RT @sarahjeong: https://t.co/C5mQrW5Cps More tomorrow... "Iterative Machine Teaching," Liu et al.: https://t.co/bq3jpjepax "Joint auto-encoders: a flexible multi-task learning framework," Epstein et al.: https://t.co/FrtUEnumm2 "Generative Models of Visually Grounded Imagination," Vedantam et al.: https://t.co/1wgvVXdCtM TFW half of your face is created by a Cramer GAN... https://t.co/auPAYwNbbn "The Cramer Distance as a Solution to Biased Wasserstein Gradients," @marcgbellemare et al.: https://t.co/ZUMIgFAx1K "Deep Learning for Ontology Reasoning," Hohenecker and Lukasiewicz: https://t.co/jqyAMFQE8n "Emergent Language in a Multi-Modal, Multi-Step Referential Game," Evtimova et al.: https://t.co/8pFi7lsI3Y "The Numerics of GANs," Mescheder et al.: https://t.co/syWyn946Fr "Multi-Modal Imitation Learning from Unstructured Demonstrations using Generative Adversarial Nets," Hausman et al.: https://t.co/TNgKU3S113 "Universal Reinforcement Learning Algorithms: Survey and Experiments," Aslanides et al.: https://t.co/KObuY0A9gK "End-to-end Active Object Tracking via Reinforcement Learning," Luo and Sun et al., Tencent/Peking U: https://t.co/bvhJcOAu8D "Multi-Labelled Value Networks for Computer Go," Wu et al.: https://t.co/6nV0SY4A3o arXiv papers, May 31 - "Constrained Policy Optimization," Achiam et al.: https://t.co/oOKc15rtth RT @gosainnn: First (Maluuba) Microsoft... google... Facebook.. now IBM joins the Montreal AI party https://t.co/1lWoTvgjo0 @gwern *gulp* @jackiefloyd thanks! Yeah, I've watched some of those, as well, thought it was pretty good. Found this way more concise, though: https://t.co/ObuHndtAmB @markus_with_k that one is TIMIT, but there are similar results for Penn TreeBank, permuted MNIST, and a few others This, from Baidu folks, is pretty interesting... https://t.co/3CpfShzI7q 😯 https://t.co/jcAzuiu0bu IBM opening an AI lab in MontreAIl, CanAIda: https://t.co/73hR71jdqr Next two books on my reading list 😍 https://t.co/OBFSL2AIdm RT @natfriedman: Announcing the first AI Grant Fellows: https://t.co/4z8jfTB1Sw https://t.co/oHcmOgZZIm That's it for a few hours :) https://t.co/xjvTZGeLb1 "Semi-Supervised Model Training for Unbounded Conversational Speech Recognition," Walker et al.: https://t.co/4vGIwjMUNm "A Multi-strength Adversarial Training Method to Mitigate Adversarial Attacks," Song et al.: https://t.co/ekCiH5jfbk "Deep Matching and Validation Network--An E2E Solution to Constrained Image Splicing Loc'zation+Detection," Wu et al https://t.co/xDYH1lFOrT "Nearest Neighbour Radial Basis Function Solvers for Deep Neural Networks," Meyer et al.: https://t.co/TW2JfbAC1g "Good Semi-supervised Learning that Requires a Bad GAN," Dai et al.: https://t.co/6KNZ4q4jb3 "Deep Complex Networks," Trabelsi et al.: https://t.co/BudFavZDxV "PVEs: Position-Velocity Encoders for Unsupervised Learning of Structured State Representations," Jonschkowski et al https://t.co/kxJ0T33wPe "Adversarial Learning: A Critical Review and Active Learning Study," Miller et al.: https://t.co/QvqBDifHX2 "BMXNet: An Open-Source Binary Neural Network Implementation Based on MXNet," Yang et al.: https://t.co/zaPKPGCtej "Convergence Analysis of Two-layer Neural Networks with ReLU Activation," Li and Yuan: https://t.co/n128oZtsSM "Cross-modal Subspace Learning for Fine-grained Sketch-based Image Retrieval," Xu et al.: https://t.co/vYquxExMwr "Care about you: towards large-scale human-centric visual relationship detection," Zhuang et al.: https://t.co/jQeFYhyGDg "Understanding Abuse: A Typology of Abusive Language Detection Subtasks," Waseem et al.: https://t.co/1Y86VlkMiZ "Listen, Interact and Talk: Learning to Speak via Interaction," Zhang et al.: https://t.co/1gyGLncTxf "Dilated Residual Networks," Yu et al.: https://t.co/1MbUhIDSMZ "Probabilistic Program Abstractions," Holtzen et al.: https://t.co/Yvusw1sO6e "Neural Semantic Parsing by Character-based Translation: Experiments w/ Abstract Meaning Reps," van Noord/Bos: https://t.co/ZNZbIW9VE6 "Deep Learning for User Comment Moderation," Pavlopoulos et al.: https://t.co/jc8SYW8XTc "Supervised Complementary Entity Recognition with Augmented Key-value Pairs of Knowledge," Xu et al.: https://t.co/Zg7ajMVGdV "Ensemble of Part Detectors for Simultaneous Classification and Localization," Zhang et al.: https://t.co/4Q5onUB0j8 "Towards Metamerism via Foveated Style Transfer," Deza et al.: https://t.co/j5GWIJbY7n "Role Playing Learning for Socially Concomitant Mobile Robot Navigation," Li et al.: https://t.co/KGItwSxfXx (using TRPO) "Pose-Aware Person Recognition," Kumar et al.: https://t.co/fnTGWOlnay "Kronecker Recurrent Units," Jose et al.: https://t.co/a6Vu8lqQzi "Human-Robot Collaboration: From Psychology to Social Robotics," Bütepage and Kragic: https://t.co/anBQ9bquli (looks like a nice review) "Machine Learned Learning Machines," Sheneman and Hintze: https://t.co/pNwIlZlcUT "On Multilingual Training of Neural Dependency Parsers," Zapotoczny et al.: https://t.co/n3L5NTgopb "Black-box Testing of First-Order Logic Ontologies Using WordNet," Alvez et al.: https://t.co/mJ7Jbu0x6O "Automatic White-Box Testing of First-Order Logic Ontologies," Alvez et al.: https://t.co/ViegAahbPu "Who's to say what's funny? A computer using Language Models and Deep Learning, That's Who!," Yan and Pedersen: https://t.co/KXfWlWbK33 "Towards Visual Ego-motion Learning in Robots," Pillai and Leonard: https://t.co/u1hWhPICwa "Feature Incay for Representation Regularization," Yuan et al.: https://t.co/Gf877oEWdb "Multiplex model of mental lexicon reveals explosive learning in humans," Stella et al.: https://t.co/5TnerrKPxP "Mammalian Value Systems," Sarma and Hays (updated version): https://t.co/45e6fW0uTn "Multiple Source Domain Adaptation with Adversarial Training of Neural Networks," Zhao et al.: https://t.co/NwfuKmkPCL "Fisher GAN," Mroueh and Sercu: https://t.co/J4RokYqIUh "Targeted Learning with Daily EHR Data," Sofrygin et al.: https://t.co/W1d5ZN65ee "Vocabulary-informed Extreme Value Learning," Fu et al.: https://t.co/J9qVeCHkGe "word2vec Skip-Gram with Negative Sampling is a Weighted Logistic PCA," Landgraf and Bellay: https://t.co/MMsbF39KlQ """AMPNet: Asynchronous Model-Parallel Training for Dynamic Neural Networks,"" Gaunt et al.: https://t.co/VQvsGXkqTo" "Lifelong Generative Modeling," Ramapuram et al.: https://t.co/oCZQGmWdWF "Boltzmann Exploration Done Right," Cesa-Bianchi et al.: https://t.co/11LE6W6Rcs "Latent Intention Dialogue Models," Wen and Miao et al.: https://t.co/1tPy7nuJO9 "Distributed Convolutional Sparse Coding," Moreau et al.: https://t.co/33uAYsS0qj "Improving the Expected Improvement Algorithm," Qin et al.: https://t.co/CyRfdScJei "Learning Data Manifolds with a Cutting Plane Method," Chung et al.: https://t.co/zMeHKgnxAN "Conditional CycleGAN for Attribute Guided Face Image Generation," Lu et al.: https://t.co/Q21UfkO8m7 "Fast Single-Class Classification and the Principle of Logit Separation," Keren et al.: https://t.co/qqoXWr1xXe "Auto-Encoding Sequential Monte Carlo," Le et al.: https://t.co/h5zAZ6kYYp "Implicit Variational Inference with Kernel Density Ratio Fitting," Shi et al.: https://t.co/AdeshITF52 "Dimensionality reduction for acoustic vehicle classification with spectral clustering," Sunu and Percus: https://t.co/5XZEnCw26M "Efficient Modeling of Latent Information in Supervised Learning using Gaussian Processes," Dai et al.: https://t.co/XM6GzVWit0 "Deep Learning for Spatio-Temporal Modeling: Dynamic Traffic Flows and High Frequency Trading," Dixon et al.: https://t.co/FGuJlbTquN arXiv papers, May 30 - "Should Robots be Obedient?," @SmithaMilli et al.: https://t.co/QCARhH4Mds RT @NandoDF: Nice short tutorial overview of gating mechanisms for neural networks in this paper. https://t.co/WMM8vI2Y83 RT @brianklaas: Russian officials absolutely are laughing about how Trump is achieving their longstanding goal of splintering the German-Am… Lots of good new arXiv stuff 😬 Will try to get through it tonight... RT @weballergy: 'Contextual Explanation Networks': interpretability as regularization. https://t.co/UkYh6wOuNc #deeplearning #machinelearni… RT @jackclarkSF: This research lets an AI infer the mechanics of a game engine. Wrote about it in today's Import AI. Read&subscribe: https:… "Detecting and Explaining Crisis," Kshirsagar et al.: https://t.co/Bff2ZboNba "Enhancement of SSD by concatenating feature maps for object detection," Jeong et al.: https://t.co/UnBvmMoJjY "A Sampling Theory Perspective of Graph-based Semi-supervised Learning," Anis et al.: https://t.co/35j3EwdGg2 "Biomedical Event Trigger Identification Using Bidirectional Recurrent Neural Network Based Models," Rahul et al.: https://t.co/sBWochNkDB "ASR error management for improving spoken language understanding," Simonnet et al.: https://t.co/b7HL83JjKO "Predicting Human Interaction via Relative Attention Model," Yan et al.: https://t.co/0sl3jMvONw "Human Trajectory Prediction using Spatially aware Deep Attention Models," Varshneya and Srinivasaraghavan: https://t.co/2ykL5H4XPw "Deep Learning for Lung Cancer Detection: Tackling the Kaggle Data Science Bowl 2017 Challenge," Kuan et al.: https://t.co/nUC9vrHZBM "Hierarchical Cellular Automata for Visual Saliency," Qin et al.: https://t.co/y8lDep6vZu "Text-Independent Speaker Verification Using 3D Convolutional Neural Networks," Torfi et al.: https://t.co/UD4h4hyQAr "Learnable Programming: Blocks and Beyond," Bau et al.: https://t.co/pn9KQFI1Pw "Learning to Optimize: Training Deep Neural Networks for Wireless Resource Management," Sun et al.: https://t.co/MOZqkHDGF2 "Multimodal Machine Learning: A Survey and Taxonomy," Baltrušaitis et al.: https://t.co/0kiaXUqGPz "Unsupervised Feature Learning for Writer Identification and Writer Retrieval," Christlein et al.: https://t.co/KHujpD7xcf "Pose Guided Person Image Generation," Ma et al.: https://t.co/e2NsTKJcXW "Operation Frames and Clubs in Kidney Exchange," Farina et al.: https://t.co/FWH3Jk9g7P "Smoothing Method for Approximate Extensive-Form Perfect Equilibrium," Kroer et al.: https://t.co/x60BLDeYCI "End-to-end Global to Local CNN Learning for Hand Pose Recovery in Depth data," Madadi et al.: https://t.co/yMc3yP6iCy "Learning a Robust Society of Tracking Parts," Burceanu and Leordeanu: https://t.co/XVZBj0AT3R "Towards meaningful physics from generative models," Cristoforetti et al.: https://t.co/Wpy60Cpe4o "Style Transfer from Non-Parallel Text by Cross-Alignment," Shen et al.: https://t.co/jYjqVdDArw "Latent Geometry and Memorization in Generative Models," Matt Feiszli: https://t.co/lRPQtsEVy6 "Diagonal Rescaling For Neural Networks," Lafond et al.: https://t.co/2h7GF7Reez "Stabilizing Training of Generative Adversarial Networks through Regularization," Roth et al.: https://t.co/jNEFFtKrWj "An Efficient Algorithm for Bayesian Nearest Neighbours," Giuseppe Nuti: https://t.co/WcVmNLShiY "Classification regions of deep neural networks," Fawzi and Moosavi-Dezfooli et al.: https://t.co/99j9RH39Zd "Learning Causal Structures Using Regression Invariance," Ghassami et al.: https://t.co/KRmBiArz3F RT @ramez: India canceled 14GW of new coal plants this month, as solar prices plunge: https://t.co/gW4439BbF4 RT @NateSilver538: 🤔 https://t.co/Brk7qOaCfE Back in the UK! 🛬 🛫More tomorrow! "Predictive State Recurrent Neural Networks," Downey et al.: https://t.co/b04kfCFOwD "A Neural Framework for Generalized Topic Models," Card et al.: https://t.co/3ORlTDnq85 "Risk-Sensitive Cooperative Games for Human-Machine Systems," Capponi et al.: https://t.co/TSTLQ3pvU9 "Convergent Tree-Backup and Retrace with Function Approximation," Touati et al.: https://t.co/l9ugeZfbGR "Analysis of universal adversarial perturbations," Moosavi-Dezfooli et al.: https://t.co/5fYvsJhaL7 arXiv papers, May 29 - "Bayesian GAN," Saatchi and Gordon Wilson: https://t.co/vLX8TZtTj9 Specifically the Review, Magazine, and book review sections. Back in the day, I'd open dozens of tabs, now just a few. @alexjc Lol... also, forgot how huge that computer was! @adam_will_do_it online, at least TFW you don't know if it's you or the Sunday edition of the New York Times that is getting more boring... @samim good question for @BVLSingler :) RT @solomonout: Memorial outside the MAX station where two men were fatally stabbed last night in #Portland after defending Muslim women fr… @willknight ...using LSTMs, probably :) RT @sarahjeong: Fund for the families of the men who died yesterday. I am heartbroken for their loss. https://t.co/9H7IhUiFs7 @RikeFranke (also, gonna get that Heinlein book soon!) @RikeFranke good luck!! :) https://t.co/nkdtqpxGq5 RT @rao2z: On the proposed US budget and preparing for the future with #AI . https://t.co/vQCOcxMpK9 https://t.co/uytmuCYaWM @botminds mostly thinking it's a complex problem. "Saudi Arabia isn’t just a conservative country with different values we shouldn’t judge. It is a modern Gilead." https://t.co/rDac9sQCzE AlphaGo wins game 3 by resignation, defeating Ke Jie 3-0 in the match. @jackclarkSF seems plausible. RT @vkrakovna: Excellent survey of AI researchers (NIPS&ICML authors) on when AI will exceed human performance in various domains https://t… @davegershgorn @evanpro see also this thread - https://t.co/NfT07KdPUE RT @MatthewGuz: Updated CGAN Pokemon! Starting to get some really nice looking results, these come from halfway through training the latest… @Brett_Fujioka I hear he requested a secret line to Krispy Kreme. So busted! Good to see/meet a lot of you in the Bay! And sorry to those I couldn't meet, ended up staying shorter than expected. @davegershgorn but democracy @mark_riedl you should only accept their money if you get one. RT @demishassabis: #TeamGo and #PairGo were both fun and fascinating - just a hint of what humans and machines can do together :) Congrats… AlphaGo wins against the team of 5 by resignation. @BrianSJ3 @AnthroPunk was referring to the AlphaGo match. Things aren't looking good for Team Human. @quasimondo lol omg @quasimondo good horror movie posters! Humans are running out of their main time soon... https://t.co/nnkNgytbaf """Perhaps we should clarify...ponnuki means coconut, I believe, in Japanese."" ""...no."" (AlphaGo commentary)" AlphaGo is playing a team of humans right now. Fun times! Here's that post - https://t.co/v3T3kfd8hI h/t @ballforest https://t.co/1Eqqa4PQAH @semiDL not sure. That's it for this week! :) https://t.co/c2uAQXPg2h "First-spike based visual categorization using reward-modulated STDP," Mozafari et al.: https://t.co/P4YDaxlPjm "The free energy principle for action and perception: A mathematical review," Buckley et al.: https://t.co/AEN2JFJboj "Proximity Variational Inference," Altosaar et al.: https://t.co/gnUdMnGcUr "Implicit Regularization in Matrix Factorization," Gunasekar et al.: https://t.co/TVT423JIqZ "Asynchronous Parallel Bayesian Optimisation via Thompson Sampling," Kandasamy et al.: https://t.co/hPvIVkk6BZ "Towards Consistency of Adversarial Training for Generative Models," Sinn and Rawat: https://t.co/GfGROCDDtO "Expectation Propagation for t-Exponential Family Using Q-Algebra," Futami et al.: https://t.co/DLS3J0Hku3 "Lat-Net: Compressing Lattice Boltzmann Flow Simulations using Deep Neural Networks," Oliver Hennigh: https://t.co/TgFGaFSZgj "Doubly Stochastic Variational Inference for Deep Gaussian Processes," Salimbeni and Deisenroth @mpd37: https://t.co/iXHhzUDHVb "Gated XNOR Networks: Deep NNs w/ Ternary Weights + Activations under a Unified Discretization Framework"-Deng et al https://t.co/OQxJQ8BNXf "Filtering Variational Objectives," @cjmaddison, Lawson, and Tucker et al.: https://t.co/EsfdTaSqTv "Investigation of Using VAE for i-Vector Speaker Verification," Pekhovsky + Korenevsky: https://t.co/rYzvPcZNII "Can Decentralized Algo's Outperform Centralized Algo's? A Case Study for Decentralized Parallel SGD," Lian et al.: https://t.co/mTBGtdBKhl "Modeling The Intensity Function Of Point Process Via Recurrent Neural Networks," Xiao et al.: https://t.co/wP7ZKkpomY "Beyond Parity: Fairness Objectives for Collaborative Filtering," Yao and Huang: https://t.co/G8GAtLRZOe "Unsupervised Learning Layers for Video Analysis," Zhao et al.: https://t.co/xi4OBPXBbI "Exploring the Regularity of Sparse Structure in Convolutional Neural Networks," Mao et al.: https://t.co/oAmdAc15m7 "Towards a Knowledge Graph based Speech Interface," Kumar et al.: https://t.co/UYsRAJgx6p "Jointly Learning Sentence Embeddings and Syntax with Unsupervised Tree-LSTMs," Maillard et al.: https://t.co/FMWIOgmArq "Learning Structured Text Representations," Liu and Lapata: https://t.co/yjdNMBiC1Z "Neural Attribute Machines for Program Generation," Amodio et al.: https://t.co/APAPsA0bxg "Deep image representations using caption generators," Mopuri et al.: https://t.co/zK3x8LWTF9 "Online Edge Grafting for Efficient MRF Structure Learning," Chaabene and Huang: https://t.co/9GkjR3PN3Y "Data-Driven Program Completion," Lu et al.: https://t.co/Sm7gHLMO8u "Deriving Neural Architectures from Sequence and Graph Kernels," Lei et al.: https://t.co/I2Tj4LSOgx "Weakly Supervised Semantic Segmentation Based on Co-segmentation," Shen et al.: https://t.co/CQ8uhndwen "Max-Cosine Matching Based Neural Models for Recognizing Textual Entailment," Xie and Hu: https://t.co/44h55LSSg9 "The cost of fairness in classification," Menon and Williamson: https://t.co/IpaZFlcDA5 "MagNet: a Two-Pronged Defense against Adversarial Examples," Meng and Chen: https://t.co/eZnkKp5amI "Cross-Domain Perceptual Reward Functions," Edwards and Isbell: https://t.co/7XvJ6WEdRD "Neural Decomposition of Time-Series Data for Effective Generalization," Godfrey and Gashler: https://t.co/ABLpPP28zB "Attention-based Natural Language Person Retrieval," Zhou et al.: https://t.co/FwXO57scet "Counterfactual Multi-Agent Policy Gradients," Foerster and Farquhar et al., Oxford: https://t.co/o5zm2wrotv w/ StarCraft results "Visual Servoing from Deep Neural Networks," Bateaux et al.: https://t.co/cyaj8UslmB "Deep Voice 2: Multi-Speaker Neural Text-to-Speech," Arik et al., Baidu: https://t.co/QBM9lJGSWy Where's the demo? They'll prob post soon "Efficient, Safe, and Probably Approximately Complete Learning of Action Models," Stern and Juba: https://t.co/tes3J3wqyS "DeepSecure: Scalable Provably-Secure Deep Learning," Rouhani et al.: https://t.co/AgScs2fDWA "Logic Tensor Networks for Semantic Image Interpretation," Donadello et al.: https://t.co/bP0Ys3B6yj "Cultural Diffusion and Trends in Facebook Photographs," You et al.: https://t.co/8uJ75WTLgP "Optimal Cooperative Inference," Yang et al.: https://t.co/q4dJ7vw8Br "Approximation and Convergence Properties of Generative Adversarial Learning," Liu et al.: https://t.co/AgsXtrH4hJ "Principled Hybrids of Generative and Discriminative Domain Adaptation," Zhao et al.: https://t.co/CGmDebPhuF """Learning to Pour,"" Huang and Sun: https://t.co/GamZN1nNkb (sad that this wasn't called ""When it RNNs, It Pours""" arXiv papers, May 26 - "State Space Decomposition + Subgoal Creation for Transfer in Deep RL," Sahni + Kumar et al.: https://t.co/oXWQZgvrDB @davegershgorn speak for yourself https://t.co/4nmMvzuAB6 @daviottenheimer I like the idea as stated by you, but this is more like swapping back and forth... would rather see human consult AlphaGo That's apparently how it's usually done in pair Go, but still strange. Not what I envisioned (human using AlphaGo as advisor). Really strange way of doing the pairing... https://t.co/1HyhBY9Veo @venkatesanragav :( good luck! @venkatesanragav I thought it sounded v. similar! Haven't looked closely yet RT @dennybritz: Woke up and wondering why there are so many unread tweets today. Must be an Uber scandal or @Miles_Brundage catching up on… RT @thinkmariya: Manual human review of illegal terrorist or abuse content takes a psychological toll, isn't always supported well https://… @nateaff ..in absence of good benchmarks/data gathering across tasks etc. People working on that too, but seems reasonable to also ask Qs @nateaff yes, uniformity is helpful. Ongoing work uses same Qs. And I agree it's not strong evidence, but do think it counts for something.. FIN. "Towards Interrogating Discriminative Machine Learning Models," Guo et al.: https://t.co/WmsFNGjWH1 "Data-driven Random Fourier Features using Stein Effect," Chang et al.: https://t.co/FZnEG2k3Sb "Multi-Level Variational Autoencoder: Learning Disentangled Reps from Grouped Observations," Bouchacourt et al.: https://t.co/QmsIxH6Nek "Improved Semi-supervised Learning with GANs using Manifold Invariances," Kumar et al.: https://t.co/MG090GGTJ7 "Audio-replay attack detection countermeasures," Lavrentyeva et al.: https://t.co/P40TVxp1kf "Anti-spoofing Methods for Automatic Speaker Verification System," Lavrentyeva et al.: https://t.co/ljuY0dYlDR "Flow-GAN: Bridging implicit and prescribed learning in generative models," Grover et al.: https://t.co/8hSGGjk4Zv "Dense Transformer Networks," Li et al.: https://t.co/Zf7nDkOxZZ "Safe Model-based Reinforcement Learning with Stability Guarantees," Berkenkamp et al.: https://t.co/xHU0ImIp2R "Grounded Recurrent Neural Networks," Vani et al.: https://t.co/7IPzu6Uqic "Multi-Task Learning for Contextual Bandits," Deshmukh et al.: https://t.co/tZ55hibRsW "Towards Understanding the Invertibility of Convolutional Neural Networks," Gilbert et al.: https://t.co/XbnYgckQ6T "Bayesian Compression for Deep Learning," Louizos et al.: https://t.co/XeTFYVce69 "Train longer, generalize better: closing the generalization gap in large batch training of NNs," Hoffer et al.: https://t.co/zBcUriJUGE "Causal Effect Inference with Deep Latent-Variable Models," Louizos et al.: https://t.co/Oruxh4lO8E "Joint Distribution Optimal Transportation for Domain Adaptation," Courty et al.: https://t.co/JbuEiyU1Eg "Semantically Decomposing the Latent Spaces of Generative Adversarial Networks," Donahue et al.: https://t.co/HnYFih5W2Q "Parallel Stochastic Gradient Descent with Sound Combiners," Maleki et al.: https://t.co/5dVPzSzjka "Training Deep Convolutional Neural Networks with Resistive Cross-Point Devices," Gokmen et al.: https://t.co/cBStdfQE9Y "Large Scale Empirical Risk Minimization via Truncated Adaptive Newton Method," Eisen et al.: https://t.co/O0K8n484qy "Poincaré Embeddings for Learning Hierarchical Representations," Nickel and Kiela: https://t.co/CkKjkU0pLW "Learning multiple visual domains with residual adapters," Rebuffi et al.: https://t.co/z6BaPrFYdi "Wasserstein Learning of Deep Generative Point Process Models," Xiao et al.: https://t.co/7vXij6lyMG "Consistent Multitask Learning with Nonlinear Output Relations," Ciliberto et al.: https://t.co/EeuXNmpXQy "Ridesourcing Car Detection by Transfer Learning," Wang et al.: https://t.co/7Jok80nNxn "Fast and Differentially Private Algorithms for Decentralized Collaborative Machine Learning," Bellet et al.: https://t.co/IQRO40kHIk "Sluice networks: Learning what to share between loosely related tasks," Ruder et al.: https://t.co/nKSEJ4oS3q "Visualizing LSTM decisions," van der Westhuizen and Lasenby: https://t.co/aUjBGMtzNJ "Learning to Succeed while Teaching to Fail: Privacy in Closed Machine Learning Systems," Sokolic et al.: https://t.co/axkY85WLJb "The Marginal Value of Adaptive Gradient Methods in Machine Learning," Wilson et al.: https://t.co/8ArpvEI6vZ "3D CNNss for Brain Tumor Segmentation: A Comparison of Multi-resolution Architectures," Casamitjana et al.: https://t.co/SVGqTAQtlY "Community Detection with Graph Neural Networks," Bruna and Li: https://t.co/QBaOdl7XhF "The brain as an efficient and robust adaptive learner," Deneve et al.: https://t.co/X74ZmkWAUP "Continual Learning in Generative Adversarial Nets," Seff et al.: https://t.co/D43f7UzeE1 "Facial Expression Recognition Using Enhanced Deep 3D Convolutional Neural Networks," Hasani and Mahoor: https://t.co/7FcRsOz3EM "SmartPaste: Learning to Adapt Source Code," Allamanis and Brockschmidt: https://t.co/RGHi029dqI "DepthCut: Improved Depth Edge Estimation Using Multiple Unreliable Channels," Guerrero et al.: https://t.co/6UOSt7h0oC "Ask the Right Questions: Active Question Reformulation with Reinforcement Learning," Buck et al.: https://t.co/y2k5fPPgrQ "Stabilizing GAN Training with Multiple Random Projections," Neyshabur et al.: https://t.co/IGbQCwxNIk "Iterative Machine Learning for Output Tracking," Santosh Devasia: https://t.co/OOMAwhDSot "TricorNet: A Hybrid Temporal Convolutional and Recurrent Network for Video Action Segmentation," Ding and Xu: https://t.co/VYKjEKH0el "Minimax Statistical Learning and Domain Adaptation with Wasserstein Distances," Lee and Raginsky: https://t.co/kPzMtDjKTV "Use Privacy in Data-Driven Systems: Theory and Experiments with Machine Learnt Programs," Datta et al.: https://t.co/IOkDjPZqC7 "StegIbiza: Steganography in Club Music Implemented in Python," Szczypiorski and Zydecki: https://t.co/1RX32loIx1 "Cost-Performance Tradeoffs in Fusing Unreliable Computational Units," Donmez et al.: https://t.co/KSYb7QMmc7 "Convolutional Networks with MuxOut Layers as Multi-rate Systems for Image Upscaling," Michelini and Liu: https://t.co/sWgfKmpp1s "Learning to Associate Words and Images Using a Large-scale Graph," Ya et al.: https://t.co/gKod3374UF "Simulation Experiment of BCI Based on Imagined Speech EEG Decoding," Wang et al.: https://t.co/1nZdvE2GAJ "Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset," Carreira and Zisserman: https://t.co/vzHKxb1L9J "An Out-of-the-box Full-network Embedding for Convolutional Neural Networks," Garcia-Gasulla et al.: https://t.co/xSLMjxwODy "Semantic Softmax Loss for Zero-Shot Learning," Ji et al.: https://t.co/2aeEkpgITL "W2VLDA: Almost Unsupervised System for Aspect Based Sentiment Analysis," Garcia-Pablos et al.: https://t.co/lmPmUxVd5e "Individualized Risk Prognosis for Critical Care Patients: A Multi-task Gaussian Process Model," Alaa et al.: https://t.co/wZ0K1VUxIV "LOGAN: Evaluating Privacy Leakage of Generative Models Using Generative Adversarial Networks," Hayes et al.: https://t.co/9HXx0A3Dyl "CayleyNets: Graph Convolutional Neural Networks with Complex Rational Spectral Filters," Levie et al.: https://t.co/gWxeBkM8nw "Computer vision-based food calorie estimation: dataset, method, and experiment," Liang and Li: https://t.co/HHJlGwO5bc "AIXIjs: A Software Demo for General Reinforcement Learning," John Aslanides: https://t.co/zEDwweIAoV "Learning Robust Object Recognition Using Composed Scenes from Generative Models," Wang et al.: https://t.co/AaudaXaxSY "Global Guarantees for Enforcing Deep Generative Priors by Empirical Risk," Hand and Voroninski: https://t.co/5tVPMHmhdL "Learning to Prune Deep Neural Networks via Layer-wise Optimal Brain Surgeon," Dong et al.: https://t.co/BQ8dQK2MYY "Boosting the accuracy of multi-spectral image pan-sharpening by learning a deep residual network," Wei et al.: https://t.co/bLtQ75w5T1 "Building Emotional Machines: Recognizing Image Emotions through Deep Neural Networks," Kim et al.: https://t.co/civ2ytq1Mh "Extracting Light from the Beclouded: An Approach to Classifier Evasion in the Dark," Dang et al.: https://t.co/pric8QtMQs "Pyramid: Enhancing Selectivity in Big Data Protection with Count Featurization," Lecuyer et al.: https://t.co/W0Ud9kNBYG "Shake-Shake regularization," Xavier Gastaldi: https://t.co/YPmavIaP50 "Image Segmentation by Iterative Inference from Conditional Score Estimation," Romero et al.: https://t.co/P6DSpN3sV9 "Learning to Mix n-Step Returns: Generalizing lambda-Returns for Deep Reinforcement Learning," Sharma et al.: https://t.co/cn5w20POYa "Sketched Answer Set Programming," Paramonov et al.: https://t.co/lFifYt1too "The Do's and Don'ts for CNN-based Face Verification," Bansal et al.: https://t.co/5jCl7BPNDx "Learning Semantic Relatedness From Human Feedback Using Metric Learning," Niebler et al.: https://t.co/8moLsCWbhD "Structured Image Classification from Conditional Random Field with Deep Class Embedding," Goldman and Goldberger: https://t.co/aFXLkSjc5a "Generative Partition Networks for Multi-Person Pose Estimation," Nie et al.: https://t.co/E1PuFCKupR "On the impact of quantum computing tech. on future devs in high-performance scientific computing," Moller/Vuik: https://t.co/oaDsXxuY1n "CrossNets: A New Approach to Complex Learning," Agarwal et al.: https://t.co/a6IC2pp6XD "Recurrent Additive Networks," Lee et al.: https://t.co/sJyuUbTMvb "DeepMasterPrint: Generating Fingerprints for Presentation Attacks," Bontrager et al.: https://t.co/mKUUxZ9Sma "Generalizing the Role of Determinization in Probabilistic Planning," Pineda and Zilberstein: https://t.co/FSkcvkOdhg "Incorporating Depth into both CNN and CRF for Indoor Semantic Segmentation," Jiang et al.: https://t.co/lizXDVngXB "Spelling Correction as a Foreign Language," Zhou et al.: https://t.co/HPNwhttkza "Mixed Membership Word Embeddings for Computational Social Science," James Foulds: https://t.co/9g4FkmTn0F "Stabilizing Adversarial Nets With Prediction Methods," Yadav et al.: https://t.co/7s2JvntPKn "Structural Compression of Convolutional Neural Networks Based on Greedy Filter Pruning," Abbasi-Asl + Yu: https://t.co/3nJuU0sdvf "Forecasting Hand and Object Locations in Future Frames," Fan et al.: https://t.co/aDXzjUC4zn "Lower Bound On the Computational Complexity of Discounted Markov Decision Problems," Chen and Wang: https://t.co/UTfBoH8H9I "The Effect of Temperature on Amdahl Law in 3D Multicore Era," Yavits et al.: https://t.co/qGfEj8iWLK "Responsive Action-based Video Synthesis," Ilescu et al.: https://t.co/f2z8GwfIx9 "Learning to Factor Policies + Action-Value Functions: Factored Action Space Reps for Deep RL," Sharma et al.: https://t.co/bjwsPsn8Ne "Search Engine Guided Non-Parametric Neural Machine Translation," Gu et al.: https://t.co/ZXxysBLLJG "Adversarial Examples Are Not Easily Detected: Bypassing Ten Detection Methods," Carlini and Wagner: https://t.co/Ohih3oVzjk "Batch Reinforcement Learning on the Industrial Benchmark: First Experiences," Hein et al.: https://t.co/Uy8SqHMYQT "Recurrent Scene Parsing with Perspective Understanding in the Loop," Kong and Fowlkes: https://t.co/LihuU3UTRa "Diffusion-based neuromodulation can eliminate catastrophic forgetting in simple neural networks," Velez and Clune: https://t.co/rpTkQMkNoj "Adapting Low-Cost Platforms for Robotics Research," Karimpanal et al.: https://t.co/zHrHHC86YC "Quadruplet Network with One-Shot Learning for Visual Tracking," Dong et al.: https://t.co/mrfS1u9uLA "RankPL: A Qualitative Probabilistic Programming Language," Tjitze Rienstra: https://t.co/QJ5aqo9aYg "GAR: An efficient and scalable Graph-based Activity Regularization for semi-supervised learning," Kilinc and Uysal: https://t.co/QekrWYcGSl "Securing Deep Neural Nets against Adversarial Attacks with Moving Target Defense," Sengupta et al.: https://t.co/cndKvemPtY "PixColor: Pixel Recursive Colorization," Guadarrama et al.: https://t.co/l5osQrGaYK "Towards Real World Human Parsing: Multiple-Human Parsing in the Wild," Li et al.: https://t.co/mIioac0Le5 "Multi-Stage Variational Auto-Encoders for Coarse-to-Fine Image Generation," Cai et al.: https://t.co/BBiNEdTxUr "The High-Dimensional Geometry of Binary Neural Networks," Anderson and Berg: https://t.co/RuDqATUapY "Espresso: Efficient Forward Propagation for BCNNs," Pedersoli et al.: https://t.co/4X9wkyVSvC "Nestrov's Acceleration For Second Order Method," Ye and Zhang: https://t.co/XzivNneeHz "VAE with a VampPrior," Tomczak and Welling: https://t.co/kQHj9hPOnN "Facial Affect Estimation in the Wild Using Deep Residual and Convolutional Networks," Hasani and Mahoor: https://t.co/TRyvza9dPj "TernGrad: Ternary Gradients to Reduce Communication in Distributed Deep Learning," Wen et al.: https://t.co/V1vAQ7kB8u "Infrastructure for Usable Machine Learning: The Stanford DAWN Project," Bailis et al.: https://t.co/XpcdcbSzKO "Statistical inference using SGD," Li et al.: https://t.co/YOvcir29rq "Follow the Signs for Robust Stochastic Optimization," Balles and Hennig: https://t.co/qCB5QY8Hng "Backprop without Learning Rates Through Coin Betting," Orabona and Tommasi: https://t.co/4tAl4jcswD "A unified view of entropy-regularized Markov decision processes," Neu et al.: https://t.co/j3o125MRXO "Information-theoretic analysis of generalization capability of learning algorithms," Xu and Raginsky: https://t.co/kv3iFjMYMK "Regularizing deep networks using efficient layerwise adversarial training," Sankaranarayanan et al.: https://t.co/KNOJcn6pFr "On-the-fly Operation Batching in Dynamic Computation Graphs," Neubig and Goldberg et al.: https://t.co/c9W2iliXLG "A unified approach to interpreting model predictions," Lundberg and Lee: https://t.co/wqKS4N7nAn "Relaxed Wasserstein with Applications to GANs," Guo et al.: https://t.co/ouoUdMpLZe "Accelerated Inference for Latent Variable Models," Zhang and Perez-Cruz: https://t.co/J1vhPBZ9EP "Ensemble Adversarial Training: Attacks and Defenses," Tramer et al.: https://t.co/q8563CgtLg "Stochastic Recursive Gradient Algorithm for Nonconvex Optimization," Nguyen et al.: https://t.co/cE9ynCXKz9 "AIDE: An algorithm for measuring the accuracy of probabilistic inference algorithms," Cusumano-Towner et al.: https://t.co/VKmqz8uRqD "Structured Bayesian Pruning via Log-Normal Multiplicative Noise," Neklyudov et al.: https://t.co/T6ZvJMhfMN "Ensemble Sampling," Lu and Van Roy: https://t.co/jXlGvpq8x1 "Forward Thinking: Building Deep Random Forests," Miller et al.: https://t.co/VfTu2CEx51 "Balanced Policy Evaluation and Learning," Nathan Kallus: https://t.co/1lCOmvFR40 "Annealed Generative Adversarial Networks," Mehrjou et al.: https://t.co/9wZL3tV8BK "Learning from Complementary Labels," Ishida et al.: https://t.co/BQi8HR7Rdx "Batch Size Matters: A Diffusion Approximation Framework on Nonconvex Stochastic Gradient Descent," Li et al.: https://t.co/Y5zzvsO8tU "Deep Reinforcement Learning with Relative Entropy Stochastic Search," Tangkaratt et al.: https://t.co/ylGtbSWbUx "From optimal transport to generative modeling: the VEGAN cookbook," Bousquet et al.: https://t.co/UIkqy6PFSo "A Regularized Framework for Sparse and Structured Neural Attention," Niculae and Blondel: https://t.co/n2YDRJyxVg "VEEGAN: Reducing Mode Collapse in GANs using Implicit Variational Learning," Srivastava et al.: https://t.co/ZFUvvHSuJQ "An Asynchronous Distributed Framework for Large-scale Learning Based on Parameter Exchanges," Joshi et al.: https://t.co/LVHOA0210F "Concrete Dropout," Gal et al.: https://t.co/KSBCvgEnDx "Real Time Image Saliency for Black Box Classifiers," Dabkowski and Gal: https://t.co/sK6U6Il3MU "Softmax Q-Distribution Estimation for Structured Prediction: A Theoretical Interpretation for RAML," Ma et al.: https://t.co/aNmRFQ761g "Shallow Updates for Deep Reinforcement Learning," Levine and Zahavy et al.: https://t.co/8gdwC27Q83 @Aelkus @moyix Fine Art also beat Ke Jie. RT @demishassabis: #AlphaGo wins game 2. What an amazing and complex game! Ke Jie pushed AlphaGo right to the limit. @jwan584 dunno. just found that pic on google images. (not even close to done FYI, taking a break) "Formal Guarantees on the Robustness of a Classifier against Adversarial Manipulation," Hein and Andriushchenko: https://t.co/1WcVE4vgAr "Local Monotonic Attention Mechanism for End-to-End Speech Recognition," Tjandra et al.: https://t.co/QZePZJTctt "Two-Stream 3D Convolutional Neural Network for Skeleton-Based Action Recognition," Liu et al.: https://t.co/rIuzTj7oTB "Black-Box Attacks against RNN based Malware Detection Algorithms," Hu and Tan: https://t.co/5PZhq7H9Yy "Look, Listen and Learn," Arandjelović and Zisserman: https://t.co/9c9zQnJFEq "Correlation Alignment by Riemannian Metric for Domain Adaptation," Morerio and Murino: https://t.co/OO8yxMExXY "Unmasking the abnormal events in video," Ionescu et al.: https://t.co/D7zgm94KHU "Logical Learning Through a Hybrid Neural Network with Auxiliary Inputs," Wan and Song: https://t.co/K2eLJrmQ4L "Salient Object Detection with Semantic Priors," Nguyen and Liu: https://t.co/0Ev3vXwvQk "Unbiasing Truncated Backpropagation Through Time," Tallec and Ollivier: https://t.co/Yt2Swr8NhJ "Ridiculously Fast Shot Boundary Detection with Fully Convolutional Neural Networks," Michael Gygli: https://t.co/Js2sKoqfq2 "Enhanced Experience Replay Generation for Efficient Reinforcement Learning," Huang et al.: https://t.co/anWyB6zucB "Music Playlist Continuation by Learning from Hand-Curated Examples and Song Features," Vall et al.: https://t.co/iPzcXzjutD "Explaining Transition Systems through Program Induction," Penkov and Ramamoorthy: https://t.co/Aj9O0soZ69 "Detecting Adversarial Examples in Deep Networks with Adaptive Noise Reduction," Liang et al.: https://t.co/64E7xcvDuz "Better Text Understanding Through Image-To-Text Transfer," Kurach et al.: https://t.co/DQs7he1fHK "AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actions," Gu et al.: https://t.co/GKfUFu10PM "Continuous State-Space Models for Optimal Sepsis Treatment - a Deep Reinforcement Learning Approach," Raghu et al.: https://t.co/jdcvhAykdg "Deep Learning of Grammatically-Interpretable Representations Through Question-Answering," Palangi et al.: https://t.co/iWDYsUxpsZ "Thinking Fast and Slow with Deep Learning and Tree Search," Anthony et al.: https://t.co/TCTVL3QDXH "pix2code: Generating Code from a Graphical User Interface Screenshot," Tony Beltramelli: https://t.co/7MX9qrSXws "Living Together: Mind and Machine Intelligence," Neil Lawrence: https://t.co/TxLQq6yb7N "A Low-Power Accelerator for Deep Neural Networks with Enlarged Near-Zero Sparsity," Huan et al.: https://t.co/nGR6u6Aj63 "Convergence Analysis of Batch Normalization for Deep Neural Nets," Ma and Klabjan: https://t.co/forQNQq84f "Training with Confusion for Fine-Grained Visual Classification," Dubey et al.: https://t.co/LPiw8Gj9Ve "Unrolled Optimization with Deep Priors," Diamond et al.: https://t.co/8pNboeDncy "Detection Algorithms for Communication Systems Using Deep Learning," Farsad and Goldsmith: https://t.co/p1HZKMt0pi "Neural Network Memory Architectures for Autonomous Robot Navigation," Chen et al.: https://t.co/64tfkOwHU3 "Compressing Recurrent Neural Network with Tensor Train," Tjandra et al.: https://t.co/wH76BBMSrR "Contextualizing Citations for Scientific Summarization using Word Embeddings and Domain Knowledge," Cohan+Goharian https://t.co/5iWmNmR4v0 "Learning from partial correction," Dasgupta and Luby: https://t.co/tGibRVaTsu "Patchnet: Interpretable Neural Networks for Image Classification," Radhakrishnan et al.: https://t.co/rA9O6JAwx7 "Visual Semantic Planning using Deep Successor Representations," Zhu et al.: https://t.co/6YQAEQe66E "Universal Style Transfer via Feature Transforms," Li et al.: https://t.co/45nPZBYgEr "From source to target and back: symmetric bi-directional adaptive GAN," Russo et al.: https://t.co/N13TKYpgjB "Parsing with CYK over Distributed Reps: "Classical" Syntactic Parsing in the Novel Era of NNs," Zanzotto+Cristini: https://t.co/0mji6Iijej "How a General-Purpose Commonsense Ontology can Improve Performance of Learning-Based Image Retrieval," Icarte et al https://t.co/Tp8IVlBB7w "Adaptive Detrending to Accelerate Convolutional GRU Training for Contextual Video Recognition," Jung et al.: https://t.co/PXU93thomt "Stochastic Sequential Neural Networks with Structured Inference," Liu et al.: https://t.co/XBzRv4MMoY "Continual Learning with Deep Generative Replay," Shin et al.: https://t.co/cPnDTA7XtE "Open-Category Classification by Adversarial Sample Generation," Yu et al.: https://t.co/lQk5LG5oCN "VANETs Meet Autonomous Vehicles: A Multimodal 3D Environment Learning Approach," Maalej et al.: https://t.co/bo8pis73KS "Deep Rotation Equivariant Network," Li et al.: https://t.co/rwVjtNAZT7 "Self-supervised learning of visual features through embedding images into text topic spaces," Gomez et al.: https://t.co/eRRrVPcIIh "Fast-Slow Recurrent Neural Networks," Mujika et al.: https://t.co/OIjtcXG5yM "Robot Introspection with Bayesian Nonparametric Vector Autoregressive Hidden Markov Models," Wu et al.: https://t.co/RsCEfHGzLL "Efficiently applying attention to sequential data with the Recurrent Discounted Attention unit," Maginnis+Richemond https://t.co/7iayPB4eks "Input Fast-Forwarding for Better Deep Learning," Ibrahim et al.: https://t.co/UzRVA8CVwA "Second-Order Word Embeddings from Nearest Neighbor Topological Features," Newman-Griffis and Fosler-Lussier: https://t.co/gzp6BV6GZm "Clinical Intervention Prediction and Understanding using Deep Networks," Suresh et al.: https://t.co/uO8SgbKRvu "The Prediction Advantage: A Universally Meaningful Performance Measure 4 Classification+Regression," El-Yaniv et al https://t.co/xozmUX6Hcu "Selective Classification for Deep Neural Networks," Geifman and El-Yaniv: https://t.co/3UxyT2NKlM "Interpreting Blackbox Models via Model Extraction," Bastani et al.: https://t.co/OIN6DSYzoQ "An effective algorithm for hyperparameter optimization of neural networks," Diaz et al.: https://t.co/RZlrs9MsQa "Sequence Summarization Using Order-constrained Kernelized Feature Subspaces," Cherian et al.: https://t.co/B9xey17Thq "MMD GAN: Towards Deeper Understanding of Moment Matching Network," Li et al.: https://t.co/LI74keXqEq "Generative Model with Coordinate Metric Learning for Object Recognition Based on 3D Models," Wang and Deng: https://t.co/GT60EsZ5nh "Model-Based Planning in Discrete Action Spaces," Henaff et al.: https://t.co/UFavFnFWnb Gonna tweet some arXiv papers from May 23-25 - couldn't look at it all, SO much new stuff, so take my selections with a huge grain of salt! https://t.co/HvUtxl7LvZ @_jyan_ but in any case expert opinion is varied and should be taken with a grain of salt! @_jyan_ IMO this survey had better methods (better phrasing of Qs, randomized order etc) +population (less self selected) than previous ones @_jyan_ well, different populations, too :) @davegershgorn or went down @davegershgorn don't know what you mean there but I assume what Demis meant was something like - AG's win % stayed same for several Ke moves @_jyan_ lol I doubt the respondents were that strategic... but I hope AI benefits all! :) RT @demishassabis: Incredible. According to #AlphaGo evaluations Ke Jie is playing perfectly at the moment. @_jyan_ Dunno, they're probably not :) I suppose the arg. would be that book = more originality, quality... but I'm with you in thinking it's weird @gwern It's been pre-referenced in a few places before, like in Dafoe/Bostrom/Flynn's paper on policy desiderata, and some talks. I did not expect the big variation across region, for example. Quite interesting. Highly recommend folks check this paper out - most credible expert survey to date IMO, and some fascinating results. "When Will AI Exceed Human Performance? Evidence from AI Experts," Grace et al.: https://t.co/VVtluIq0sb (it's pretty pleasant, though) I know the "waiting for the AlphaGo match livestream to start" song way too well... RT @DeepMindAI: Anticipation is building for #AlphaGo17 match 2 with #KeJie! Watch it live here: https://t.co/PCzlgucIhl @davegershgorn you should chat with Blake Borgeson, nice guy @davegershgorn looks like fun! RT @Seinfeld2000: Pope Your Enthusiasm https://t.co/joAC3sk5oe @davegershgorn C2? RT @OpenAI: We're releasing OpenAI Baselines, reliable implementations of RL algorithms. Today: DQN & 3 variants: https://t.co/Mw0gCIwv1Z RT @genekogan: run fast-style-transfer on your webcam. including models for kandinsky, hokusai, picasso, lichtenstein & google maps https:/… RT @vkrakovna: New AI safety paper on helping RL agents overcome reward corruption and avoid reward hacking... https://t.co/CC7l5sMoZa RT @SimonHendriksen: https://t.co/6MEXM7CQAX RT @karpathy: Ran some quick numbers on ICML accepted papers https://t.co/muBweFvinN Google "wins" ICML, involved in 10% of papers. ~25% ar… @lidija_sekaric @SolarInMASS not sure I follow but yes, google search involves some AI, including deep learning, likewise for Goog Assistant RT @weballergy: 'Continual Learning in Generative Adversarial Nets': training under changing distributions. https://t.co/LyuDhv8Yly #deeple… RT @IAugenstein: New paper on learning what to share in multi-task learning https://t.co/kdTTsj50yp @seb_ruder @joabingel @soegaarducph #dl… RT @samim: pix2code: "Generating Code from a Graphical User Interface Screenshot": https://t.co/JF9apVicIq https://t.co/cJuWKNa5NI RT @mikarv: w @lilianedwards—Slave to the Algorithm? Why a "Right to Explanation" is Probably Not the Remedy You are Looking For https://t.… ...but that doesn't seem super likely to me. - IMO, is some sort of weakness introduced in new system bc of architectural changes/hardware reductions, not that superhuman AI infeasible, Relevant datapoint: Ke Jie has already lost a bunch to Tencent's Fine Art AI. Most likely scenario for Ke Jie (or team of humans) losing- @Davidramli @ArtirKel now, people would screw it up, but AlphaGo is held in such high esteem already that they may defer to it mostly anyway @Davidramli @ArtirKel yes, the "get in the way" part is why I specified near term. Eventually useless. Certainly a possibility that even ... @ArtirKel @Davidramli I suspect that's true at least for the near future, but I'm esp. interested in falsifiable near term guesses :) I'm pretty uncertain about it but leaning AlphaGo... Anyone willing to guess who will win between AlphaGo and a team of pros? RT @weballergy: 'Visualizing LSTM Decisions': on interpretability in recurrent neural networks. https://t.co/RAJ5YRtAC9 #deeplearning #mach… RT @teamfaceplant: What a story. RIP #RogerMoore https://t.co/ftNrsVxEqy Melania rejecting Trump's hand is pretty funny but this with remains the best Trump/hand moment so far: https://t.co/PEHfeQTRKo Super behind on arXiv papers + leaving on trip (can't even tweet all the new deep RL stuff right now 😯) but will catch up soonish! RT @chrisdonahuey: Semantically decompsed GANs (SD-GANs): generate distinct images depicting the same person. Work w/ @zacharylipton https:… "Reinforcement Learning with a Corrupted Reward Channel," Everitt et al., ANU/DeepMind: https://t.co/oqxxI9mKt6 @Ted_Underwood Books of pretty much any sort are a treat/luxury in a world with so many good/more efficient papers :) So stoked to get some serious reading done on a plane tomorrow :) RT @NicolasPapernot: In a recent paper, we introduce ensemble adversarial training to thwart black-box attacks on MNIST & ImageNet https://… @sknthla random: have you read the book Raven Rock? Just picked it up. Has you written all over it... RT @ErnestMoniz: Proposed FY18 #TrumpBudget represents retreat of US leadership on energy innovation/security & environmental protection. M… RT @ReelQuinn: By the time they get to Brussels she’s just going to mace him https://t.co/SXLvbjwCaT RT @brianklaas: Notes left at Yad Vashem, Israel's Holocaust memorial museum. Trump on left, Obama on right. So horribly tone deaf. https:/… @halhod he (@jgkoomey) would prob know if such analysis exists @halhod check out eg Koomey @halhod there are studies on computing lifecycles but not familiar with it @halhod right, I don't know of such an analysis but it'd certainly have a better shot of humans winning if low polluting human baseline @halhod on order of households/tens of households consumption in terms of CO2 but presumably more favorable comparison 4 AlphaGo if lifetime @halhod I did a rough calc of AlphaGo operating emissions at the time, though not training, and both lower now... @halhod well that's a different Q/kinda different from the flop formulation but again, don't know of such analysis @halhod um I'd think it'd be poor humans in developing countries. but don't know if such analysis @halhod bit of work on green computing, degradable robots etc but nothing super comprehensive im aware of @halhod not 100% sure I get it (eg ecosystem impact of AI vs human doing X)? In any case, dont think so RT @Klonick: <self-promotion> Media: Need someone to discuss implications of leaked FB docs? I've been studying it the last 18 mos. </self-… RT @OxfordshireCC: Flags at County Hall in Oxford are flying at half-mast as a mark of respect for the tragic events in #Manchester https:/… @alexjc single machine in the original paper meant something like 1 GPU and 48 CPUs. Dunno bout here. Maybe a TPU "pod" announced recently. RT @alexjc: David Silver emphasizes that #AlphaGo tries to maximize the probability of winning, not to increase victory margin. Close match… RT @demishassabis: Game went to a count. #AlphaGo won by just half a point, the closest margin possible. Ke Jie played a great game. @marwinsegler @alexjc just finished. AlphaGo won RT @demishassabis: #AlphaGo wins game 1! Ke Jie fought bravely and some wonderful moves were played. @vgr globe at a new center bring established (anti extremist ideology thing) (and AlphaGo is well above it now) Looks like AlphaGo will win. As I said last year, it seems that in the space of possible Go skill levels, humans occupy a fairly small band. First Ke Jie/AlphaGo match is about halfway over. @EBKania (the match overall, though not the livestream - curious why the distinction? B/C it's on YouTube? Unfiltered commentary?) @EBKania hmm - the caveat at the bottom seems important, as China Daily is covering it... "RT @ArianaGrande: broken. from the bottom of my heart, i am so so sorry. i don't have words." RT @hardmaru: AIXIJS is a JavaScript demo for running General RL agents in the browser. Extensible framework for Bayesian RL. https://t.co/… RT @demishassabis: Ke Jie is using the ideas #AlphaGo used in the master series of online games in January against AlphaGo :) intriguing to… Didn't expect to be watching another AlphaGo match in 2017 but alas, here I am... https://t.co/LRvFvcdjBz RT @demishassabis: Game 1 vs the great Ke Jie about to start!! So exciting to be here. #AlphaGo @RikeFranke I also disagree with a number of points :) long story but tl;dr nothing super new here RT @JoeNBC: Agreed. Stop with the damn loops on cable news. You'd do less harm just writing a check to the terrorist organization of your c… RT @hardmaru: PixColor: Pixel Recursive Colorization. New colorization approach from @GoogleBrain using PixelCNN. https://t.co/fNZgdX246U h… RT @zeynep: Don't share gory pics. People have loved ones watching. Don't put panicked people on endless loop on TV. That's literally goal… @fchollet @yoavgo @hardmaru indeed it was. @fchollet @hardmaru (but don't know if it was a fair/accurate quotation) @fchollet @hardmaru Believe it was attributed to Yoshua Bengio. RT @tdietterich: @Miles_Brundage @jackclarkSF Yes, tonight might be Peak GAN. At least it is probably a new high water mark. Ah - so, just follow Jack, then! Which you should also be doing anyway... https://t.co/ENYzwmgDaS @jackclarkSF In the meantime, however, this title is TOO good not to tweet - "How to Train Your DRAGAN," Kodali et al.: https://t.co/neIhoboL45 Way too much to do decent first pass tonight - in the meantime, see @jackclarkSF's spreadsheet in Import AI newsletter (which u should read) (ML on arXiv) 😑 https://t.co/YuZVq0SLHv RT @onthemedia: As reports from the #Manchester arena come in, keep in mind that in the immediate aftermath news outlets will get it wrong.… @botminds @IgorCarron @_jyan_ *former chief of neurology. Book author is relevant role I guess. OK to solit blame btwn him/NYT/marketing/etc @botminds @IgorCarron @_jyan_ neuro prof! I could be too harsh but my model is -expert in A writes pop things about B/C with little research @botminds @IgorCarron @_jyan_ I do agree marketers have been successful though! @botminds @IgorCarron @_jyan_ I wouldnt pick on some random comment section person, but professors in top pubs should get basic facts right @botminds @IgorCarron @_jyan_ I have a higher bar for a NYT oped than some layperson. NYT is the gatekeeper here. @tdietterich certainly some.. though E.g.the "neural nets don't understand failure" bit's weird - arguably that (error) is all they get! :) @adam_will_do_it @nytimes "I've tried everything: language processing, cryptography, coding!" (the movie Transcendence) Let's stop slandering AI and 4 year olds by comparing them to Trump. (the Watson *group* does deep learning now but he seemed to refer to be referring to the Jeopardy Watson system in context) For the non-AI folks - none of those is a deep learning system. One is an organization, and the other two didn't use deep learning. @_jyan_ lmao From: https://t.co/GkCgmwJDkc I just died inside. @nytimes, you can do better than this. https://t.co/1Ov9HOlaR0 @j2bryson (also, looks like fun!) @j2bryson I was going to tweet something earlier about the singularity of AI ethics conferences, and wasn't aware if this one! RT @mpshanahan: New paper by my PhD student Nat Dilokthanakul on intrinsic motivation and hierarchical reinforcement learning - https://t.c… RT @AstroKatie: Update: There are too many things. #academia @Brett_Fujioka @Aelkus simple: I don't read most of em :) @Aelkus *DNAk memes. I should sleep more. @Aelkus didn't mean for that to also double as a k-means joke, but it kinda works... @Aelkus DNAk means @chrisalbon needs more Benny Hill music. @mikarv agreed We were talking about online dating specifically but they could do other stuff, as well, of course... Was just talking about this the other day...Facebook would prob be good at this if they did it (bc data, skill etc). https://t.co/6zm51zQEUy RT @rao2z: New #GMAIL #AI improved my response time TREMENDOUSLY when students send papers for comments! Can't wait to try it for conf. pap… https://t.co/wKSqeokEBq "Bayesian Nonparametric Poisson Process Allocation," Ding et al.: https://t.co/oBLwKXAX5H "Analysis of Thompson Sampling for Gaussian Process Optimization in the Bandit Setting," Basu and Ghosh, Linkedin: https://t.co/kZM1GfBH5g "Estimating Accuracy from Unlabeled Data: A Probabilistic Logic Approach," Platanios et al.: https://t.co/XIACm3JlfV "EE-Grad: Exploration and Exploitation for Cost-Efficient Mini-Batch SGD," Donmez et al.: https://t.co/0pCaS5srI5 "Spatial Variational Auto-Encoding via Matrix-Variate Normal Distributions," Wang et al.: https://t.co/xygE5LftY9 "Pixel Deconvolutional Networks," Gao et al.: https://t.co/jlwDB3ymR3 "The Kernel Mixture Net.: A Nonparametric Method 4 Condit. Density Estimation of Cont. Rand. Vars," Ambrogioni et al https://t.co/7zcUrlHEVO "Scalable Variational Inference for Dynamical Systems," Gorbach and Bauer et al.: https://t.co/Sl392g63OF "A Unified Framework for Stochastic Matrix Factorization via Variance Reduction," Zhou et al.: https://t.co/CkMn165S77 "Learning Effective Representations from Clinical Notes," Dubois et al.: https://t.co/tDU5qVWgtj "The Landscape of Deep Learning Algorithms," Zhou and Feng: https://t.co/fICuBbWeN4 "Masked Autoregressive Flow for Density Estimation," Papamakarios et al.: https://t.co/09SFFEQ3Za "Machine learning 4 classification + quantification of monoclonal antibody preparations for cancer therapy"-Le et al https://t.co/Lr4SS3lvpx "Gradient Estimators for Implicit Models," Li and Turner: https://t.co/ziv4887YBE "Deep adversarial neural decoding," Güçlütürk and Güçlü et al.: https://t.co/25Ur58oDpo "Hyperspectral Band Selection Using Unsup Non-Linear Deep Auto Encoder to Train External Classifiers," Ahmad et al.: https://t.co/N2W3AqE7Wq "Atari games and Intel processors," Adamski et al.: https://t.co/Pn3mOpRgXB "Posterior sampling for reinforcement learning: worst-case regret bounds," Agrawal and Jia: https://t.co/QHxQ5Hu0BW "What are the Receptive, Effective Receptive, and Projective Fields of Neurons in CNNs?," Le and Borji: https://t.co/ebpjV1k3HG "A Survey of Neuromorphic Computing and Neural Networks in Hardware," Schuman et al.: https://t.co/htmBGVhL3d 88 pages + 2682 references 😯 "What do We Learn by Semantic Scene Understanding for Remote Sensing imagery in CNN framework?," Li et al.: https://t.co/AaUueQ7Zvt "CNN-Based Joint Clustering and Rep. Learning w/ Feature Drift Compensation for Large-Scale Image Data," Hsu/Lin: https://t.co/L91VZZIYrG "Induction of Interpretable Possibilistic Logic Theories from Relational Data," Kuzelka et al.: https://t.co/SG57cbOGoo "Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics," Kendall et al.: https://t.co/Qb9oMaaPFQ "A Comparison of Reinforcement Learning Techniques for Fuzzy Cloud Auto-Scaling," Arabnejad et al.: https://t.co/eIUV0kyTFO "Building effective deep neural network architectures one feature at a time," Mundt et al.: https://t.co/hJ2G70N4zm "Deep-LK for Efficient Adaptive Object Tracking," Wang et al.: https://t.co/JaPufgrgKK "The Conference Paper Assignment Problem: Using Order Weighted Averages to Assign Indivisible Goods," Lian et al.: https://t.co/hBDWLFejBY "Online Signature Verification using Recurrent Neural Network and Length-normalized Path Signature," Lai et al.: https://t.co/TqEPn3FAdx "Prediction of Sea Surface Temperature using Long Short-Term Memory," Zhang et al.: https://t.co/5Iq2uP5T6R "Learning Convolutional Text Representations for Visual Question Answering," Wang and Ji: https://t.co/CfPh8cpdh4 "Exploring the structure of a real-time, arbitrary neural artistic stylization network," Ghiasi et al., Brain/MILA: https://t.co/18o1xOj752 "The Kinetics Human Action Video Dataset," Kay et al.: https://t.co/Kxb5CGgcgX New DeepMind dataset: https://t.co/G18H4U5zKE arXiv papers, May 22 - "Feature Control as Intrinsic Motivation for Hierarchical RL," Dilokthanakul et al.: https://t.co/alPlCjIS4F Will share some cool papers shortly... Surprised the batch of arXiv papers was somewhat manageable, then remembered the cutoff was Friday, so this is the early bird NIPS batch... RT @DeepMindAI: We’re not the only ones excited about the Future of Go Summit, China’s top Go players are too. 2 days to #AlphaGo17 https:/… "Limited-Memory Matrix Adaptation for Large Scale Black-box Optimization," Loshchilov et al.: https://t.co/6Om4Tq5C7m "Fake it till you make it: Fishing for Catfishes," Magdy et al.: https://t.co/n7eS79zZ2V "TableQA: Question Answering on Tabular Data," Vakulenko and Savenkov: https://t.co/S5fgRPKmrd "Universal Dependencies Parsing for Colloquial Singaporean English," Wang et al.: https://t.co/kfIYueh3aI "Evolving Ensemble Fuzzy Classifier," Pratama et al.: https://t.co/bFSxB9j8Le "Towards Robotically Supported Decommissioning of Nuclear Sites," Mascarich et al.: https://t.co/ASFra2gueK "Fashion Forward: Forecasting Visual Style in Fashion," Al-Halah et al.: https://t.co/o72ys4DW3i "Scalable Exact Parent Sets Identification in Bayesian Networks Learning with Apache Spark," Karan and Zola: https://t.co/6slZFB14H4 "Decoding Sentiment from Distributed Representations of Sentences," Ponti et al.: https://t.co/3PCoSQavNc "Political Footprints: Political Discourse Analysis using Pre-Trained Word Vectors," Christophe Bruchansky: https://t.co/4LXGHQsENP "Optimizing and Visualizing Deep Learning for Benign/Malignant Classification in Breast Tumors," Yi et al.: https://t.co/eHh7zH6wHp "Identification and Off-Policy Learning of Multiple Objectives Using Adaptive Clustering," Karimpanal and Willhelm: https://t.co/Prp093Ar3F ...Behera et al. at Sears (sears-iously) "Distributed Vector Representation Of Shopping Items, The Customer And Shopping Cart To Build A Three Fold Recommendation System," ... "CardiacNET: Segmentation of Left Atrium and Proximal Pulmonary Veins from MRI Using Multi-View CNN," Mortazi et al. https://t.co/ioFBoucOkh "Approximate Bayesian inference as a gauge theory," Sengupta and Friston: https://t.co/uAZgDdc9gM "Learning Spatiotemporal Features for Infrared Action Recognition with 3D CNNs," Jiang et al.: https://t.co/1lDVfVmouj "I Probe, Therefore I Am: Designing a Virtual Journalist with Human Emotions," Bowden et al.: https://t.co/tjhhe8Ek2U Last of the pre-NIPS batch! Few more - "Self-Learning Monte Carlo Method: Continuous-Time Algorithm," Nagai et al.: https://t.co/63T7aYnyNi RT @ashleyfeinberg: steve bannon looks so uncomfortable here and it rules https://t.co/GlPQJPUTts @yoavgo read somewhere that it was Stephen Miller, the Muslim Ban guy @_jyan_ lol @girlziplocked very weird movie. RT @dandrezner: I knew AI was a game-changer but still.... https://t.co/RNF8EMYa7B *won't lose a 1-on-1 game. Maybe 60% re: the group game. Specifically, I gave 90% chance AlphaGo wouldn't lose in 5 game match. Would add: maybe 70% confident it won't lose a game. We'll see! :) ... plausibly, AlphaGo vs. 5 ppl maybe different. I suspect not. Likewise, if AlphaGo weaker (e.g. bc trained from scratch), less confident. Re: the AlphaGo thing in China this week... anyone want to make predictions? :) I've said before AlphaGo won't lose to a human again... but- RT @anitaleirfall: Wittgenstein invented the emoticon. 😊 https://t.co/6XXKpG2SPi Time to catch up on AI papers. Tomorrow night will be a doozy! RT @rao2z: Fantastic idea that cleanly separates time stamping concerns from peer review concerns! I hope someone at @arxiv is listening! h… RT @ditzkoff: "As a token of my goodwill, I present to you a gift: this protocol droid. He is hardworking and will serve you well." https:/… RT @AlisonGopnik: My op-ed in the NY Times , why saying Trump is a 4-year-old is an insult to 4-year-olds (marvelous picture tells... https… @edersantana @adam_will_do_it @deliprao he did end up getting the nuggets. @deliprao not bad! You should get free Wendy's chicken nuggets... @vgr use of driverless cars for murder RT @ylecun: Nice TEDx talk by Yoshua Bengio about AI, deep learning, the reasons of our common interest in... https://t.co/QVeQPKNohy "RT @adhdphd: ByeBye mr-data-pipeline Try to check the dashbrd but it already died Stay up all night reading work on arXiv Singin soon Im go…" RT @zeynep: .@Microsoft should buy @malwaretechblog a house. They charge hospitals extra $$$ for security, while he stepped up voluntarily… RT @zeynep: He halted the viral ransomware shutting down hospitals, and this is his reward. Words fail to express my outrage at clickbait "… RT @Smerity: @Miles_Brundage @Google Android also has this problem if you use "Ok Google". I can unlock my phone with my voice - a friend s… (this particular one also sounds poorly designed, why allow so many tries? SAD!) Prob. won't see large-scale use of latter tomorrow, but def. eventually/prob. within a few years, and password still needed - why roll out? Voice recognition for identification is a trap, and not just for this reason (also, voice transfer w/ AI). https://t.co/0a0T4UpAmN "RT @yottapoint: Best Comey quote ever. https://t.co/lTHtHiq4LO https://t.co/VE1WfZJUCO" RT @hannawallach: Final count: 3297 submissions to this year's @NipsConference!!! #NIPS2017 RT @goodfellow_ian: NIPS submission ID for NIPS 2017 is already greater than the total number of submissions to NIPS 2016 https://t.co/k3uV… RT @mer__edith: 📣DeepMind seeks critical thinkers tackling AI policy & ethics. Join a brilliant team at the center of the action! 🔥https://… @davegershgorn think that's consistent with the recruitment hypothesis - Honda, Toyota also pub some, have something to prove, Google doesnt @davegershgorn let alone driverless car stuff @davegershgorn agreed. Think it's a pretty recalcitrant culture, but yeah. And even now, big disparity across areas (little on search pubd) Good luck to all finishing up NIPS papers! @davegershgorn they "have to," but not for your benefit (keeping researchers happy and recruiting future ones) @hardmaru https://t.co/W0CCntdDEy @hardmaru love that video RT @shaneharris: That secret intel source Trump discussed with Russia? It was the US's best source on ISIS terror plots. https://t.co/xw0G… RT @SmithaMilli: Stuart's TED talk on human-compatible AI https://t.co/14DdXEpXAJ Whoa, did not even mean to do that fancy gif thing... 🤔 (from Bueno de Mesquita and Smith's "The Dictator's Handbook) https://t.co/ARS76eKXZZ @clarkamiller prob. other possibilities that I'm not thinking of, as well... @clarkamiller detecting/flagging domination, encouraging broad participation, flagging ad hominems, taking notes, ... Bad = ~ opposite... @clarkamiller big space of possible tech. If left just to market/power, prob. not good. Potentially good portions of design space: ... RT @RyanSheales: Stop what you're doing. Please show respect to this cover from Spanish magazine 'Tapas'. https://t.co/3AT7fmpBih RT @darth: "isnt comey supposed to be here tonight has any body seen james comey" https://t.co/x2GLNK5w74 (Benioff doesn't seem to be claiming it's learning from the conversation, but that could be useful/is what I'm referring to re: Kim's stuff) Skeptical, but something useful like this is conceivable- see e.g. @_beenkim's cool work analyzing meeting patterns. https://t.co/RtSWCXAeKL To be continued tomorrow or Sat... "Target-Quality Image Compression with Recurrent, Convolutional Neural Networks," Covell et al.: https://t.co/zzrX9Zn7d5 "MUTAN: Multimodal Tucker Fusion for Visual Question Answering," Ben-younes et al.: https://t.co/xU6ORiztQG "DeepXplore: Automated Whitebox Testing of Deep Learning Systems," Pei et al.: https://t.co/qBdFhm4eCN "Agent-Centric Risk Assessment: Accident Anticipation + Risky Region Localization," Zeng et al: https://t.co/7KNk2cvJ7T w/ Epic Fail dataset "Re3: Real-Time Recurrent Regression Networks for Object Tracking," Gordon et al.: https://t.co/XW5DZlNPUB "Delving into adversarial attacks on deep policies," Kos and Song: https://t.co/jwiOerYdgd "Learning a bidirectional mapping btwn human whole-body motion + nat. language using deep RNNs," Plappert et al.: https://t.co/O4YmLfllWI "Learning Texture Manifolds with the Periodic Spatial GAN," Bergmann et al.: https://t.co/M75N85fOGO "Automatic Goal Generation for Reinforcement Learning Agents," Held, Geng, and Florensa et al.: https://t.co/FS1Fz7TDgA arXiv papers, May 19 - "ParlAI: A Dialog Research Software Platform," Miller et al., Facebook: https://t.co/m9ugzX8KTi "RT @benjaminwittes: Boom https://t.co/tAagbJTpXD" RT @benjaminwittes: Boom https://t.co/SEGx3m6jzI @iandanforth maybe there are, dunno :) @iandanforth no...should I? @awmannes Does "Sad!" count? The Global War on Error Rates begins soon after (slow trickle of ICML/NIPS papers with no end in sight). (more casualties but also more interesting tech developments in WW2) Conference deadline-related World WarXiv 1 is tonight... WW2 is Sunday night. @ArtirKel noooooo RT @sethmoulton: As the Representative of Salem, MA, I can confirm that this is false. https://t.co/8yJIzZBSE8 @hardmaru @rupspace @schmidhubered no one is safe @hardmaru @rupspace @schmidhubered lmao "RT @BryanWeaverDC: ""An 'extremely credible source' has called my office and told me that @BarackObama's birth certificate is a fraud."" ---…" Has anyone read Geoffrey West's book Scale yet? Interesting topics/like his papers but I leafed through it/read excerpts and seems rambly... (sorry, I'm in a trolling mood) Remember Jibo? @edersantana it's still Viv (and/or I don't totally get the joke) Remember Viv? "Rise of the humanbot," @ricard_sole: https://t.co/wv1QGZRYB6 "Transfer Learning for Named-Entity Recognition with Neural Networks," Lee and Dernoncourt et al.: https://t.co/qU7dL0jKvk "Utility of general and specific word embeddings for classifying translational stages of research," Major et al.: https://t.co/m5xSFM5a14 "An Investigation of Newton-Sketch and Subsampled Newton Methods," Berahas et al.: https://t.co/IwXdgMxnfr "Sub-sampled Cubic Regularization for Non-convex Optimization," Kohler and Lucchi: https://t.co/QWbXQzJBWL "Co-clustering through Optimal Transport," Laclau et al.: https://t.co/HedLlVkg8M "Higher-Order Constrained Horn Clauses and Refinement Types," Burn et al.: https://t.co/7PkOSfjgbg "Practical Processing of Mobile Sensor Data for Continual Deep Learning Predictions," Katevas et al.: https://t.co/OXYJ9ZNTxm "Learning to Represent Haptic Feedback for Partially-Observable Tasks," Sung et al.: https://t.co/awbYwKWoR7 "A deep level set method for image segmentation," Tang et al.: https://t.co/l0xxBlYhRK "Deep Diagnostics: Applying Convolutional Neural Networks for Vessels Defects Detection," Filippov et al.: https://t.co/QcZyyl8L6l "Predicting protein functions from sequence+interactions using a deep ontology-aware classifier," Kulmanov et al.: https://t.co/PEdMAoLJCZ "Information Geometry Approach to Parameter Estimation in Hidden Markov Models," Masahito Hayashi: https://t.co/cjDOXY9Dkx "Know-Evolve: Deep Reasoning in Temporal Knowledge Graphs," Trivedi et al.: https://t.co/tQldeCPUIy "Small cities face greater impact from automation," Frank et al.: https://t.co/8mRx6K00DU "Motion-Compensated Autonomous Scanning for Tumour Localisation using Intraoperative Ultrasound," Zhang et al.: https://t.co/1QGTcP5VPn "The Effect of Collective Attention on Controversial Debates on Social Media," Garimella et al.: https://t.co/mCH4qbad2n "LCDet: Low-Complexity Fully-Conv. NNs for Object Detection in Embedded Systems," @subarnaT et al., UCSD/Qualcomm: https://t.co/Q4Ac3Cv8YY "Subregular Complexity and Deep Learning," Avcu et al.: https://t.co/uxuja1n3hH "A Novel Neural Network Model for Joint POS Tagging and Graph-based Dependency Parsing," Nguyen et al.: https://t.co/5Q9XoM1dFg "Differentially Private Release of Public Transport Data: The Opal Use Case," Asghar et al.: https://t.co/1tI77Z1xjy "Utility Maximizing Sequential Sensing Over a Finite Horizon," Ferrari et al.: https://t.co/ayGhujUrrp "AI, Native Supercomputing and The Revival of Moore's Law," Chien-Ping Lu: https://t.co/RLRTjpu28R "REMIX: Automated Exploration for Interactive Outlier Detection," Fu et al.: https://t.co/feOjL1FKDq "Frame Stacking and Retaining for Recurrent Neural Network Acoustic Model," Tian et al. Alibaba Shenma Search: https://t.co/vwhPjG8juc "Learning a Hierarchical Latent-Variable Model of Voxelized 3D Shapes," Liu et al.: https://t.co/Wo9fWt1i18 Yang et al.: https://t.co/DNJtb7kxj5 "Automatic Vertebra Labeling in Large-Scale 3D CT using Deep Image-to-Image Network with Message Passing and Sparsity Regularization," ... "One Shot Joint Colocalization and Cosegmentation," Abhishek Sharma: https://t.co/F3isnXQy10 "PaMM: Pose-aware Multi-shot Matching for Improving Person Re-identification," Cho and Yoon: https://t.co/489j3w7NR2 "Learning to Identify Ambiguous and Misleading News Headlines," Wei et al.: https://t.co/DCebbhvygV "Target Type Identification for Entity-Bearing Queries," Garigliotti et al.: https://t.co/i3g5MWJxIw "Joint Learning from Earth Observation and OpenStreetMap Data to Get Faster Better Semantic Maps," Audebert et al.: https://t.co/v8yYDcIqT9 "Pitfalls and Best Practices in Algorithm Configuration," Eggensperger et al.: https://t.co/65F72QPfJP "HR-CTC: A Large Human Resource Corpus for Text Classification," Xu et al.: https://t.co/jGWjCbU7yG "Six DOF Localization of Endoscopic Capsule Robots using RNNs embedded into a CNN," Turan et al.: https://t.co/okD4JpMFuc "Modeling Cooperative Navigation in Dense Human Crowds," Vemula et al.: https://t.co/W5uOzMOuqS arXiv papers, May 18 - "Unlabeled Data for Morphological Generation w Character-Based Seq2Seq Models," Kann+Schutze: https://t.co/7Ktqjpc4im @hardmaru @kastnerkyle @kcimc no :( "Active Control of Camera Parameters for Object Detection Algorithms," Wu and Tsotsos: https://t.co/6yV7Thx8fs "Ensemble of heterogeneous flexible neural trees using multiobjective genetic programming," Ojha et al.: https://t.co/hfl1v04sbI "Metaheuristic Design of Feedforward Neural Networks: A Review of Two Decades of Research," Ojha et al.: https://t.co/dUoK329FC0 "IAN: The Individual Aggregation Network for Person Search," Xiao et al.: https://t.co/H8HDqJlJPv "New Reinforcement Learning Using a Chaotic Neural Network for Emergence of 'Thinking'," Shibata and Goto: https://t.co/PQ7dXRYKLt "Through a Gender Lens: An Empirical Study of Emoji Usage over Large-Scale Android Users," Chen et al.: https://t.co/I8Cf5PqF4g "Joint Geometrical and Statistical Alignment for Visual Domain Adaptation," Zhang et al.: https://t.co/XPfbu483P0 "WordFence: Text Detection in Natural Images with Border Awareness," Polzounov et al.: https://t.co/c3QG6XNaqG "A Biomimetic Vocalisation System for MiRo," Moore and Mitchinson: https://t.co/mY4xu03kwk "Music generation with variational recurrent autoencoder supported by history," Tikhonov and Yamshchikov: https://t.co/MEKAHGoriR "Handwritten Urdu Character Recognition using 1-Dimensional BLSTM Classifier," Amed et al.: https://t.co/LdgfE9aF4H "A Non-Rigid Map Fusion-Based RGB-Depth SLAM Method for Endoscopic Capsule Robots," Turan et al.: https://t.co/6R1VIvzclE "A Deep Learning Based 6 Degree-of-Freedom Localization Method for Endoscopic Capsule Robots," Turan et al.: https://t.co/3aQwon0XxH "A Biomedical Information Extraction Primer for NLP Researchers," Surag Nair: https://t.co/6GqfkyYnPB "Online Article Ranking as a Constrained, Dynamic, Multi-Objective Optimization Problem," Balasubramanian et al.: https://t.co/odJ9xabggE "All-relevant feature selection using multidimensional filters with exhaustive search," Mnich and Rudnicki: https://t.co/sIpmvTiorJ "Subjective Knowledge Acquisition and Enrichment Powered By Crowdsourcing," Meng et al.: https://t.co/Gcy3awYS6B "Parallel Search with no Coordination," Korman and Rodeh: https://t.co/IjAkvW2mRU "Cloudroid: A Cloud Framework for Transparent and QoS-aware Robotic Computation Outsourcing," Hu et al.: https://t.co/iHkU1tQzlw "Sparse Coding by Spiking Neural Networks: Convergence Theory and Computational Results," Tang et al.: https://t.co/W8iv0mnR58 "Real-Time Adaptive Image Compression," Rippel and Bourdev: https://t.co/CIkiq4JtOC "The power of deeper networks for expressing natural functions," Rolnick and @tegmark: https://t.co/sT45ZqQtPB "Distributed Statistical Machine Learning in Adversarial Settings: Byzantine Gradient Descent," Chen et al.: https://t.co/RswQYlywzu "NeuroNER: an easy-to-use program for named-entity recognition based on neural networks," Dernoncourt et al.: https://t.co/rDJcpyrJhn "Learning Edge Representations via Low-Rank Asymmetric Projections," Abu-El-Haija et al.: https://t.co/iL3rCVZkkJ "Hierarchical Temporal Representation in Linear Reservoir Computing," Gallicchio et al.: https://t.co/kvUAgFBgT4 "Demystifying Relational Latent Representations," Dumančić and Blockeel: https://t.co/232DVugOxn RT @bogpunk: The future is great https://t.co/84X3pZ4h5n @catehall Former FBI Director Robert Mueller appointed as special prosecutor for Russia stuff. Trump gave lame commencement address. RT @fchollet: If you are a researcher, you can apply now to start accessing Google Cloud TPUs for training your models --for free! https://… About as much human attention goes into watching YouTube videos everyday as was put into the entire Manhattan Project. RT @Tess_Townsend: We've been updating #i017 https://t.co/sBpC3Qbg4w @Tess_Townsend see also - https://t.co/WrTYS7LLIw @zackbeauchamp Milan Svolik? Reading this now: https://t.co/WmQKU3z5UV RT @TheAnnaGat: When you have to specify a republic is the "People's", it's usually not. RT @thehill: UPDATE: Paul Ryan backs Chaffetz' push to get Comey memo https://t.co/o38vJ9lRTv https://t.co/44Hnrc6XZ1 RT @histoftech: I'll be speaking at the Oxford University Internet Institute on June 1st. If you're in the U.K. I'd love to see you! https:… @histoftech awesome! Will try to make it. @deliprao 👍 @ericjang11 @mat_kelcey we already know it...even the color! https://t.co/jVvUYI5x8p @hardmaru I am dreading next Monday post-NIPS deadline :-O @awmannes you there for the GET conference? if so you and @HaydnBelfield should chat :) RT @dansinker: Comey at the king, you best not miss. To be continued tomorrow... "Learning Image Relations with Contrast Association Networks," Lu et al.: https://t.co/sdJaGyFhxD "Picasso: A Neural Network Visualizer," Henderson and Rothe: https://t.co/rKGHYyqnvX "Intel RealSense Stereoscopic Depth Cameras," Keselman et al.: https://t.co/3GtgqA1WTs "Text-based Adventures of the Golovin AI Agent," Kostka et al.: https://t.co/NgVefoDjKM "WebVision Challenge: Visual Learning and Understanding With Web Data," Li et al.: https://t.co/h4qyzuvR0d "Learning Hard Alignments with Variational Inference," Lawson, Tucker, and Chiu et al.: https://t.co/lY2pIDqPxE "Cooperative Learning with Visual Attributes," Batra and @deviparikh: https://t.co/eSL1UJV47Z "Learning Probabilistic Programs Using Backpropagation," Avi Pfeffer: https://t.co/IWNXdVul9J "Testing Reading Tactics for Automated Reading Assistance: Is it Useful to Apply Old Knowledge?," Yu and Menzies: https://t.co/OmZvmuRG3o "Key-Value Retrieval Networks for Task-Oriented Dialogue," Eric and Manning: https://t.co/53dKnJM46L "PatternNet and PatternLRP -- Improving the interpretability of neural networks," Kindermans et al.: https://t.co/HuqIdV7mbW "Learning Features for Offline Handwritten Signature Verification using Deep CNNs," Hafemann et al.: https://t.co/641kOQwvbp "Probabilistically Safe Policy Transfer," Held et al.: https://t.co/CqA6E3WulW That one's about human safety *from* AIs, but what about not breaking robots? Have no fear, arXiv has that covered tonight, too... arXiv papers, May 17 - "Repeated Inverse Reinforcement Learning for AI Safety," Amin,* Jiang,* and Singh: https://t.co/MszOskLeI7 It's Safety Night on arXiv... @guillefix lol I remember when a Makani kite could fit in the lobby at the ARPA-E summit... they grow up so fast. https://t.co/a2t5KnOySq RT @ARPAE: Congratulations ARPA-E alum #Makani, whose “energy kite” could transform how we harvest electricity from the wind! https://t.co/… RT @FHIOxford: Excited that FHI will be joining @PartnershipAI alongside many great non-profit and for-profit partners https://t.co/R36Zq7K… RT @erichorvitz: eBay, Intel, Salesforce, SAP, Sony, and other for-profit & non-profit orgs. become partners of @PartnershipAI https://t.co… Excited that @FHIOxford and many other non-profits and companies are joining @PartnershipAI! https://t.co/ecfDdE8MXn "RT @FullFrontalSamB: It's official. America has broken Wolf Blitzer. https://t.co/LIr2FBcZJj" RT @PartnershipAI: The Latest: Partnership on AI Strengthens Its Network of Partners and Announce First Initiatives https://t.co/jHQKwidd9z… Me RN: should I point at the dish at this Lebanese restaurant+look dumb, or risk mispronouncing it+look dumb? Trump: https://t.co/KbKrWlkCBR @trochee @jackclarkSF sorry :( @ThomasMiconi I wish TARS were my desktop... WannaCry screenshot's from Google Images https://t.co/kG3t8m6ocp @filar @JohnDanaher thanks! Big Deal Alert! Hits on some of the trends (learning from demo + in simulation) that could make robots really scale. https://t.co/ZBCGRu9u49 FIN. Except I couldn't even finish this tweetstorm without @jackclarkSF sharing something I had to retweet... #sAIgh "Learning task structure via sparsity grouped multitask learning," Kshirsagar et al.: https://t.co/yNuVQfZWG1 "Convex Coupled Matrix and Tensor Completion," Wimalawarne et al.: https://t.co/uOBXQ7I3At "Unimodal probability distributions for ordinal classification," Beckham and Pal: https://t.co/tW3gvUQH6f "Probabilistic Matrix Factorization for Automated Machine Learning," Fusi and Elibol: https://t.co/6EqA7vNj52 "GP-ILQG: Data-driven Robust Optimal Control for Uncertain Nonlinear Dynamical Systems," Lee et al.: https://t.co/lVXy07l7Pn "Curiosity-driven Exploration by Self-supervised Prediction," Pathak et al.: https://t.co/LHcGuzSDHK Project page: https://t.co/KL3rihoiIo "RT @jackclarkSF: Most skills aren't easy to define, so new OpenAI research lets us teach robots new skills through demonstration https://t.…" "Detecting Statistical Interactions from Neural Network Weights," Tsang et al.: https://t.co/5MxHy0TShV "Mosquito Detection with Neural Networks: The Buzz of Deep Learning," Kiskin et al.: https://t.co/dWfJIzo3Ii "Extending Defensive Distillation," @NicolasPapernot and McDaniel: https://t.co/0qWsYaiwjz "Texture features for the reproduction of the perceptual organization of sound," van Elburg and Andringa: https://t.co/q84DPdgggn "Comparing Titles vs. Full-text for Multi-Label Classification of Scientific Papers and News Articles," Galke et al https://t.co/g18NxNyPnM "Constrained Bayesian Networks: Theory, Optimization, and Applications," Beaumont and Huth: https://t.co/mxvkJUp2Hh "Horn Maximum Satisfiability: Reductions, Algorithms & Applications," Marquez-Silva et al.: https://t.co/4Udb0TplGm "Deep Learning Microscopy," Rivenson et al.: https://t.co/u2VgB7Zrus "On the Complexity of Semantic Integration of OWL Ontologies," Kazakov and Ponomaryov: https://t.co/mfqfh1C9gT "Person Re-Identification by Deep Joint Learning of Multi-Loss Classification," Li et al.: https://t.co/C87WdAf0Y4 "Fundamental Limits of DNA Storage Systems," Heckel et al.: https://t.co/o3WckKrPZh "Gabor Filter Assisted Energy Efficient Fast Learning Convolutional Neural Networks," Sarwar et al.: https://t.co/Bj8kU1Y4So "High-Precision Trajectory Tracking in Changing Envs Through L1 Adaptive Feedback+Iterative Learning," Pereida et al https://t.co/CUkw2yuSYj "Bias and variance in the social structure of gender," Altenberger and Ugander: https://t.co/MN1Jw8KX56 "Automatically Redundant Features Removal for Unsupervised Feature Selection via Sparse Feature Graph," Han et al.: https://t.co/GjVOjUCRXz "Benchmark for Complex Answer Retrieval," Nanni et al.: https://t.co/yv38yMLMu6 "Learning Semantic Correspondences in Technical Documentation," Richardson and Kuhn: https://t.co/oR6Vaumlwn "Combination of Hidden Markov Random Field and Conjugate Gradient for Brain Image Segmentation," Guerrout et al.: https://t.co/5DU4lSn7IT "Extracting urban impervious surface from GF-1 imagery using one-class classifiers," Yao et al.: https://t.co/JsvqpABz1c "Deep neural networks on graph signals for brain imaging analysis," Guo et al.: https://t.co/ftNPURzRiG "Revisiting IM2GPS in the Deep Learning Era," Vo et al.: https://t.co/gCuE4hp3Q0 "Annotating and Modeling Empathy in Spoken Conversations," Alam et al.: https://t.co/wKzZ3mc4jl "Efficient Parallel Methods for Deep Reinforcement Learning," Clemente et al.: https://t.co/4v7fEla8Kd Code: https://t.co/3FouFMNhqJ "Awareness improves problem-solving performance," Jose Fontanari: https://t.co/BiFE7peqN4 "Automated Robotic Monitoring and Inspection of Steel Structures and Bridges," Hung La: https://t.co/6qULiSjchy "Talking to Your TV: Context-Aware Voice Search w/ Hierarchical Recurrent Neural Networks," Rao et al., Comcast etc. https://t.co/D6LJIVKPXz "Convergence Analysis of Proximal Gradient with Momentum for Nonconvex Optimization," Li et al.: https://t.co/gdezIDH2HY @Luke_Metz "GeneGAN: Learning Object Transfiguration and Attribute Subspace from Unpaired Data," Zhou et al.: https://t.co/DKniCIsgbj @Luke_Metz "Musical Instrument Recognition Using Their Distinctive Characteristics in ANNs," Toghiani-Rizi + Windmark: https://t.co/JQ1q31orlA @Luke_Metz "Discrete-Continuous Splitting for Weakly Supervised Learning," Laude et al.: https://t.co/KECTWSm6oe "Discrete Sequential Prediction of Continuous Actions for Deep RL," @Luke_Metz et al.: https://t.co/CPz3Iok8Zo "Joint Modeling of Content and Discourse Relations in Dialogues," Qin et al.: https://t.co/g1CkNYKFH7 "AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles," Shah et al., MSFT: https://t.co/Gv1U6KOizZ "Single Image Super-Resolution Using Multi-Scale Convolutional Neural Network," Jia et al.: https://t.co/Li5EtgV8v5 "Learning Semantics for Image Annotation," Tariq and Foroosh: https://t.co/ow5eAGN9qz "Generative Adversarial Networks for Multimodal Representation Learning in Video Hyperlinking," Vukotic et al.: https://t.co/UF9OylGeG5 "Tuning Modular Networks with Weighted Losses for Hand-Eye Coordination," Zhang et al.: https://t.co/rM1DEj1cAk "Design Criteria to Architect Continuous Experimentation for Self-Driving Vehicles," Giaimo and Berger: https://t.co/pgIZtMqLPH "Emotion in Reinforcement Learning Agents and Robots: A Survey," Moerland et al.: https://t.co/Fr5zJdf3sR "Representation learning of drug and disease terms for drug repositioning," Manchanda and Anand: https://t.co/vbY45Ewux3 "Design of a Very Compact CNN Classifier 4 Online Handwritten Chinese CR Using DropWeight+Global Pooling" Xiao et al https://t.co/LhEcPjjSdk "Annotation of Car Trajectories based on Driving Patterns," Moosavi et al.: https://t.co/gujNfSbeez "Modeling of the Latent Embedding of Music using Deep Neural Network," Xing et al.: https://t.co/w1wI4sg9by "CLBlast: A Tuned OpenCL BLAS Library," Cedric Nugteren: https://t.co/8bBpNKL1LF "Strategically knowing how," Fervari et al.: https://t.co/GGaq7rrRVF "Learning from Clinical Judgments: Semi-Markov-Modulated Marked Hawkes Processes for Risk Prognosis," Alaa et al.: https://t.co/J5xi5CEjX4 arxiv papers, May 16 - "Comparison of Maximum Likelihood and GAN-based training of Real NVPs," Danihelka et al.: https://t.co/gOJ8J9s6kZ RT @jbarro: THE LEAK IS COMING FROM INSIDE YOUR FACE https://t.co/qmvMU9KazU RT @janexwang: New sci-fi short story! This one was a lot of fun to write: Sue L. https://t.co/Eh6hT9p4rB RT @WillieGeist: Dave Chappelle tonight in NY on his November SNL monologue: "I was the first guy on TV to say 'Give Trump a chance.' I f**… @sknthla been meaning to read a book about them. "RT @davejorgenson: ""Excuse me, where's the lobby?"" ""I don't know but here is some classified information on ISIS"" https://t.co/CzLOqtVil9" Will post arXiv papers tomorrow... there are some new ones, shockingly. @robinhanson Freezing sometimes good against threatening animals/humans? @SichuLu @JohnDanaher ...permanent decline in IQ, just that short-term priming effect = reasonable proxy for effect of monetary concerns in life. @SichuLu @JohnDanaher Not sure what the Gwern link proves here, but yes, priming research generally has issues. Claim of Mullainathan et al. isn't that prime =... RT @balajiln: New paper with @DeepMindAI colleagues on comparison of GAN-training and maximum likelihood training using Real-NVP: https://t… @SichuLu @JohnDanaher Also plausible=diminishing returns on better assistants at some point, or that increasing slack a bit helps a lot. Lots of uncertainties. @SichuLu @JohnDanaher not sure what your criticism was re: the 15 g thing? Re: other points, yes, quite plausible rich benefit disproportionately. RT @lawfareblog: Bombshell: Initial thoughts from the Lawfare team on the Washington Post’s game-changing story: https://t.co/Ndr9qwHgUi ICYMI/in case you want to read something tentatively positive+not Trump-related - we wrote about AI and inequality: https://t.co/YZ2XzT46dr RT @OpenAI: Roboschool, open-source software for simulating robots, integrated with OpenAI Gym: https://t.co/FNPLqbb7vA. *representations of AI in media Also, this prayer to Turing, "transcribed by R. Fisher post-Singularity" lol: https://t.co/Ifta11JD0L Wikipedia also has something similar, but they have different gaps - https://t.co/7624SPlnAT TIL Bob Fisher has a detailed page on media representations in AI - https://t.co/u9yDlgyrke Including this number - https://t.co/cX7i3eBaKr RT @NandoDF: Looking forward to the tsunami wave of papers that is just about to hit the arxiv #nips2017 What new things are we about to le… RT @natfriedman: The list of 45 AI Grant finalists is now up at https://t.co/9wgdrbGhfW. Congrats to all the finalists, and thanks to every… Schelling pulling an "RT != endorse" in 1966... https://t.co/tArqdxJciC I see this example a lot, but doesn't actually seem hard (tried some with Clarifai's demo and it worked fine).... https://t.co/Ib2Qt6MgmW RT @Miles_Brundage: I wrote a blog post with @JohnDanaher on AI and inequality - check it out and let us know what you think! https://t.co/… @j2bryson @JohnDanaher thanks! :) RT @JohnDanaher: How Assistive AI Could Alleviate Social Inequality (w @Miles_Brundage) https://t.co/6FBbMW1Jld #ethics #AI https://t.co/Ie… @sameasiteverwaz @JohnDanaher oh, yes - thanks for pointing this out! @sameasiteverwaz @JohnDanaher Thanks! :) I'm looking to see what the error is... this appears to be the same spelling we used?: https://t.co/M7ZCtjf9YM I wrote a blog post with @JohnDanaher on AI and inequality - check it out and let us know what you think! https://t.co/vmX9uWugwg "RT @conradhackett: Each dot is a US adult's guess about the location of North Korea https://t.co/t8MJNNSiXF https://t.co/N0zqK8aHQk" "Practical Bayesian Optimization for Model Fitting with Bayesian Adaptive Direct Search," Acerbi and Ma: https://t.co/vZSzJUJp6b "Iteratively-Reweighted Least-Squares Fitting of Support Vector Machines," Nguyen and McLachlan: https://t.co/3GD1S02928 "The Network Nullspace Property for Compressed Sensing of Big Data over Networks," Alexander Jung: https://t.co/42Cbaw12Pq "Predicting Blood Pressure with Deep Bidirectional LSTM Network," Su et al.: https://t.co/1cm0sHgieS "Learning ReLUs via Gradient Descent," Mahdi Soltanolkotabi: https://t.co/q69scrK1Jw "Imagination improves Multimodal Translation," Elliott and Kádár: https://t.co/XLExgTN2yA "A rational analysis of curiosity," Dubey and Griffiths: https://t.co/dopvrj3tyd "Reconfiguring the Imaging Pipeline for Computer Vision," Buckler et al.: https://t.co/xSwQhFEC19 "Object-Level Context Modeling For Scene Classification with Context-CNN," Javed and Nelakanti: https://t.co/YibMQ8VHM9 "An overview and comparative analysis of Recurrent Neural Networks for Short Term Load Forecasting," Bianchi et al.: https://t.co/OzIBpU95c3 "Theseus: Incentivizing Truth Discovery in Mobile Crowd Sensing Systems," Jin et al.: https://t.co/BBAybYZQHi "Cross-Dataset Recognition: A Survey," Zhang et al.: https://t.co/VjpHte8H33 "Negative Results in Computer Vision: A Perspective," Ali Borji: https://t.co/nSUcGHoamQ "Evaluating vector-space models of analogy," Chen et al.: https://t.co/pXfXJm1tWQ "Arc-swift: A Novel Transition System for Dependency Parsing," Qi and Manning: https://t.co/UtpCYUuZdQ "Adaptive Feature Representation for Visual Tracking," Han et al.: https://t.co/iE3qOhCKrN "Using Satellite Imagery for Good: Detecting Communities in Desert and Mapping Vaccination Activities," Shakeel+Ali: https://t.co/dacD8IXINJ "R2-D2: ColoR-inspired Convolutional NeuRal Network (CNN)-based AndroiD Malware Detections," Huang et al.: https://t.co/Y6fHCPN1gm "TraX: The visual Tracking eXchange Protocol and Library," Luka Čehovin: https://t.co/sSLr8fg2hp "Learning to Refine Object Contours with a Top-Down Fully Convolutional Encoder-Decoder Network," Liu et al.: https://t.co/IejrgbEGlP "External Prior Guided Internal Prior Learning for Real Noisy Image Denoising," Xu et al.: https://t.co/owM5vyzKWW "Spatial-Temporal Recurrent Neural Network for Emotion Recognition," Zhang et al.: https://t.co/rm8QkvOKXA "Self-Committee Approach for Image Restoration Problems using Convolutional Neural Network," Ahn and Cho: https://t.co/oS53GwA3Pr "A natural approach to studying schema processing," Fletcher and Wennekers: https://t.co/C4ZOLEEjEz "Hardware Automated Dataflow Deployment of CNNs," Abdelouahab et al.: https://t.co/6Ua8FUlOsY "Clingcon: The Next Generation," Banbara et al.: https://t.co/SfGXnmd2cL [next generation of clingo/related ASP solvers] "Provably Safe+Robust Drone Routing via Sequential Path Planning: A Case Study in SF + the Bay Area," Chen et al.: https://t.co/yg4JJxpswz "Towards a Principled Integration of Multi-Camera Re-ID + Tracking through Optimal Bayes Filters," Beyer et al.: https://t.co/ebJl0j1VKL "Molecular Generation with Recurrent Neural Networks," Esben Bjerrum: https://t.co/MSHyXohYwk "Forecasting using incomplete models," Vadim Kosoy: https://t.co/920FYo6pCm "Single Image Action Recognition by Predicting Space-Time Saliency," Safaei an Foroosh: https://t.co/F0GFKe2lks arXiv papers, Monday, May 15 - "Reducing Bias in Production Speech Models," @EricBattenberg et al., Baidu: https://t.co/AVoWQttTwR @histoftech something something blonde bombshell... Blog post inbound! @mark_riedl looks Batmobileish RT @ValdisKrebs: https://t.co/suI27d2GPG @fchollet I like it! "RT @gstsdn: The AC-GAN paper was accepted to ICML. https://t.co/ZMTqaLw0YC https://t.co/kVlanJzl32" Enjoying Doctorow's latest novel, Walkaway. RT @j_winterton: Brilliant. Thank you @MalwareTechBlog ! https://t.co/W5X2FtKz01 @_jyan_ @hardmaru @waitbutwhy pretty sure title is right. Hard to see but it's definitely more than 10 rows per section. @_jyan_ ah, yes, listed as a draft on the site. @hardmaru @waitbutwhy my reaction exactly. @_jyan_ yep, saw the Shane thing. And dunno, but I'll tweet it when it's on arXiv, soon I'd think (looks like that's the less polished version) (papers aren't up yet, expect some on arXiv in the coming weeks) Accepted papers, IJCAI 2017: https://t.co/tEeVuNUnA6 Wish this were about Battlestar Galactica... Blavatnik School of Government is pretty cool, too, though. https://t.co/hykXBBZTao "I can't even with this headline lol: ""If we're living in a simulation, this UK startup probably built it."" 🤔 https://t.co/oEIsGDvhQs" @GuoXiaohui No. Not sure if it's been accepted/if so, where. RT @trochee: When you come up with a really cool neural nets idea and read @Miles_Brundage 's Twitter feed on the same morning https://t.co… RT @mark_riedl: Band name generation! The name of my next band will be... https://t.co/gfrYsql4mf RT @tressiemcphd: jesus. our destruction is good ad business for social media and that's not a good thing https://t.co/VqTHiIEzMh RT @matthaig1: Whenever I worry about reader reviews I always remember Shakespeare's average star rating on Goodreads is only a 3.8. RT @rpbp: @realDonaldTrump If only we could export all things that produce bullshit. https://t.co/W2eB6Bbsni RT @HMRoff: Cray announces AI-Focused supercomputers - Neowin https://t.co/edNOlFG7H2 @BenedictEvans there are more on TripAdvisor. That's it for this week! :) "Bayesian Distribution Regression," Law et al.: https://t.co/2DnCwoBRTD "Fast Stochastic Variance Reduced ADMM for Stochastic Composition Optimization," Yu and Huang: https://t.co/xfKq2Vs9S9 "Dynamic Compositional Neural Networks over Tree Structure," Liu et al.: https://t.co/WuFcIBNLPK "On the role of words in the network structure of texts: application to authorship attribution," Akimushkin et al.: https://t.co/uNxYOdRK2j "A First Empirical Study of Emphatic Temporal Difference Learning," Ghiassian et al.: https://t.co/q5cIZWBOkr If I had a nickel for each promising transfer/incremental/lifelong learning paper in 2017...well, I wouldn't be rich but I'd have a $1 or so "Incremental Learning Through Deep Adaptation," Rosenfeld and Tsotsos: https://t.co/lQVu9GCAWk "Sketching Word Vectors Through Hashing," QasemiZadeh et al.: https://t.co/TvHdo4M1Hr "Probabilistic Image Colorization," Royer et al.: https://t.co/ahExtDaBuS "Robot Planning w/ Mathematical Models of Human State+Action"-Anca Dragan https://t.co/wnUbKqeqS7 Looks like good review of her group's work "Phase recovery and holographic image reconstruction using deep learning in neural networks," Rivenson et al.: https://t.co/YJvgmzyZQl "Hardware-Software Codesign of Accurate, Multiplier-free Deep Neural Networks," Tann et al.: https://t.co/vTFOzmAInB "A Feature Embedding Strategy for High-level CNN representations from Multiple ConvNets," Akilan et al.: https://t.co/3qeUxs5RzL "Learning to see people like people," Song et al.: https://t.co/zSITHLPIYC "A Deep Reinforced Model for Abstractive Summarization," Paulus et al., Salesforce/Metamind: https://t.co/q0ORfKCQFU "A Minimal Span-Based Neural Constituency Parser," Stern et al.: https://t.co/cDvjrsK4Jq "Learning 3D Object Categories by Looking Around Them," Novotny et al.: https://t.co/oTJSoCr6wK "Learning with Noise: Enhance Distantly Supervised Relation Extraction with Dynamic Transition Matrix," Luo et al.: https://t.co/UD1RImGwAP "A survey of Community Question Answering," Barun Patra: https://t.co/LjZ8QA67sJ "Swarm-Enabling Technology for Multi-Robot Systems," Chamanbaz et al.: https://t.co/3j4ImoQSez "SCNet: Learning Semantic Correspondence," Han et al.: https://t.co/GpSDIPqk82 """A Generative Model of People in Clothing,"" Rassner et al.: https://t.co/RxpTOf8ofD Looks great til you get up close...but it'll get there. https://t.co/mYd8cytfdV" "Net2Vec: Deep Learning for the Network," Gonzalez et al.: https://t.co/yoU7r9vWXR "Program Induction by Rationale Generation: Learning to Solve+Explain Algebraic Word Problems," Ling et al, DeepMind https://t.co/fB4Sob5thO https://t.co/1F9nx9LJw9 (you know an area is moving faster when there's a need for a review <2 years after the seminal paper on it...) arXiv papers, May 12 - "Neural Style Transfer: A Review," Jing et al.: https://t.co/3QT6Un2u3E SourceForge, 2004: 78,000 open source projects. GitHub, 2017: 19.4 million active repositories. RT @abigail_e_see: Live Monet style transfer at #GTC17! https://t.co/dcY1dfOK5L Quite good results! https://t.co/6mni1Ytk8n "RT @RichardSocher: A new reinforcement and deep learning model for summarization.It generates long language sequences that make sense. htt…" RT @fermatslibrary: Individual dots moving along straight lines. 😲 #mathart https://t.co/orsbme7gOP RT @TobyonTV: The White House has announced Chet Americanman as the new director of the #FBI. https://t.co/5QFKUewKay RT @Zergylord: First draft of my meta model-based RL paper now arxiv: https://t.co/OxMU6gsOKI would love any feedback :) "Survey of Visual Question Answering: Datasets and Techniques," Akshay Gupta: https://t.co/DMUvLRIJ9c "The Pragmatics of Indirect Commands in Collaborative Discourse," Lamm and Eric: https://t.co/5kPFBH6LNe "Predicting the Driver's Focus of Attention: the DR(eye)VE Project," Palazzi et al.: https://t.co/ye4gGizb12 "Context-Aware Hierarchical Online Learning for Performance Maximization in Mobile Crowdsourcing," Müller et al.: https://t.co/o4EAn9HRzJ "Analysing Data-To-Text Generation Benchmarks," Perez-Beltrachini and Gardent: https://t.co/JaRslAXtLX "Flexible and Creative Chinese Poetry Generation Using Neural Memory," Zhang et al.: https://t.co/6np7MHr994 "Efficient and Scalable View Generation from a Single Image using Fully Convolutional Networks," Bae et al.: https://t.co/giaiap4lVi "Deep Speaker Feature Learning for Text-independent Speaker Verification," Li et al.: https://t.co/Aa7Ayqc8te "A Survey of Deep Learning Methods for Relation Extraction," Shantanu Kumar: https://t.co/QRPGr5b6d0 "Sparse Interacting Gaussian Processes: Efficiency+Optimality Theorems of Autonomous Crowd Navigation,"Pete Trautman https://t.co/h5E5xdBiyF "Learning RGB-D Salient Obj. Detection using backgr. enclosure, depth contrast+top-down features," Shigematsu et al. https://t.co/gSl6LM5hbi "Solving Multi-Obj. MDP w/ Lexico. Preference: An application to stoch. planning w/ multiple quantile obj.," Li/Sun: https://t.co/Hod4ZZ7GqC "Collaborative Descriptors: Convolutional Maps for Preprocessing," Kataoka et al.: https://t.co/qdkcmEWOnj ...Shafiee et al.: https://t.co/i764Cwu6fo .@Zergylord "Discovery Radiomics via Evolutionary Deep Radiomic Sequencer Discovery for Pathologically-Proven Lung Cancer Detection," ... ".@Zergylord ""DeepTingle,"" Khalifa et al.: https://t.co/GjU5JP2soa (as in: https://t.co/HhAGj0UgdM)" .@Zergylord "Relevance-based Word Embedding," Zamani/Croft: https://t.co/yKUvlFu6D1 .@Zergylord "TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension," Joshi et al., UW/AI2: https://t.co/i23fqU2PKi .@Zergylord "CORe50: a New Dataset and Benchmark for Continuous Object Recognition," Lomonaco and Maltoni: https://t.co/b0tBJKW9Th .@Zergylord "Data Governance for Platform Ecosystems: Critical Factors and the State of Practice," Lee et al.: https://t.co/u5yfOeHKpc .@Zergylord "Sukiyaki in French style: A novel system for transformation of dietary patterns," Kazama et al.: https://t.co/qJ6MhEZ2Sz .@Zergylord "Improving Frame Semantic Parsing with Hierarchical Dialogue Encoders," Bapna et al., Google Research: https://t.co/SQM10QDiwq .@Zergylord "Predicting membrane protein contacts from non-membrane proteins by deep transfer learning," Li et al.: https://t.co/uKP3iV7DhD ".@Zergylord ""DeepDeath:* Learning to Predict the Underlying Cause of Death w/ Big Data,"" Hassanzadeh et al.: https://t.co/9qlXmnlTEk *good villain name" .@Zergylord "Context Attentive Bandits: Contextual Bandit with Restricted Context," Bouneffouf et al.: https://t.co/3ha7d44JPb .@Zergylord "Integral Policy Iterations for Reinforcement Learning Problems in Continuous Time and Space," Lee and Sutton: https://t.co/rUxJDHgTT7 .@Zergylord "Inferring and Executing Programs for Visual Reasoning," Johnson et al., Stanford/FB: https://t.co/RheG8c2b9z Bigly gains on CLEVR dataset.. May 11 arXiv papers - "Deep Episodic Value Iteration for Model-based Meta-Reinforcement Learning," by @Zergylord: https://t.co/pKX3s8Vo43 @truetechnicolor see discussion here - https://t.co/TCR2XkR4t3 "Geometry of Optimization and Implicit Regularization in Deep Learning," Neyshabur et al.: https://t.co/lMV8Kifnus "Convolutional Dictionary Learning via Local Processing," Papyan et al.: https://t.co/5xVM6viE6p "Manifold Relevance Determination: Learning the Latent Space of Robotics," Pete Trautman: https://t.co/0x4ybKzYME "Phonetic Temporal Neural Model for Language Identification," Tang et al.: https://t.co/ypqDuNRQ8g "Deep Spatio-temporal Manifold Network for Action Recognition," Li et al.: https://t.co/ENq7S30vY9 "CHAM: action recognition using convolutional hierarchical attention model," Yan et al.: https://t.co/ukU25tykFA "A Mathematical Theory of Human Machine Teaming," Pete Trautman: https://t.co/N2j9BqTfBm "CAD Priors for Accurate and Flexible Instance Reconstruction," Birdal and Ilic: https://t.co/sF3sxhi3OL "A simple yet effective baseline for 3d human pose estimation," Martinez et al.: https://t.co/xzDuO9gk8m "Large-scale, Fast and Accurate Shot Boundary Detection through Spatio-temporal CNNs," Hassanien et al.: https://t.co/LcRvBNqFJ5 "Drug-drug Interaction Extraction via Recurrent Neural Network with Multiple Attention Layers," Yi et al.: https://t.co/II7j5qwoKx "Deep Projective 3D Semantic Segmentation," Lawin et al.: https://t.co/YrWszaZ45I "Logical Parsing from Natural Language Based on a Neural Translation Model," Li et al.: https://t.co/ncqHHYry30 "Bayesian Joint Topic Modelling for Weakly Supervised Object Localisation," Shi et al.: https://t.co/THW0JRbMec "Model Complexity-Accuracy Trade-off for a Convolutional Neural Network," Atul Dhingra: https://t.co/yCBgfutRkX "Deep Person Re-Identification with Improved Embedding," Jin et al.: https://t.co/SJHSXMMmpH "READ-BAD: A New Dataset and Evaluation Scheme for Baseline Detection in Archival Documents," Gruning et al.: https://t.co/zFNx8YWL9w "Frequentist Consistency of Variational Bayes," Wang and Blei: https://t.co/oKHsEP0WcK "RT @samim: Generative Rug #6 (fullres: https://t.co/ktwwBSrlNF) https://t.co/e6uU5Iqxd7" RT @jwan584: Jensen announces NVIDIA GPU Cloud. Did NV just pivot to a services company ala AWS?? #GTC2017 https://t.co/aRdKkYplP9 RT @jwan584: Woah—NVIDIA just won Toyota. Major win for NV Xavier chip. #GTC2017 https://t.co/ZhxZG0gdYW RT @jwan584: Nvidia's Volta chip specs is out. What a monster. https://t.co/FXUjtSZQM8 RT @infinite_scream: AAAAAAAAAAAAAAAAAAAAHHHHHHHHHHHHHHH RT @NandoDF: Differentiable neural computers as alternatives to parallel Bayesian optimization for hyperparameter tuning of other networks… RT @AstroKatie: TFW you have a massive to-do list at work but you keep getting distracted by your home country's descent into an authoritar… @AtulAcharya possible. It was published earlier today on that FB page RT @poolio: Jointly train classifier & adversarial example generator, GAN-style -> improved adv. robustness & generalization https://t.co/7… More tomorrow! "Generative Adversarial Trainer: Defense to Adversarial Perturbations with GAN," Lee et al.: https://t.co/xKRMgcbnYV "Stable Architectures for Deep Neural Networks," Haber and Ruthotto: https://t.co/0WxWj4zPZ3 "Residual Squeeze VGG16," Qassim et al.: https://t.co/nKuGLK0Rsr arXiv papers, May 10: "Convolutional Sequence to Sequence Learning," Gehring et al: https://t.co/ZZ3daMMaji Also see https://t.co/fw4MVOmbQm .@LovedeepSG FIN...until the next batch. https://t.co/ACQSfm17R9 .@LovedeepSG "The concurrence of form and function in developing networks: An explanation for synaptic pruning," Millán et al.: https://t.co/XRY3lvgFH6 .@LovedeepSG "Finding Bottlenecks: Predicting Student Attrition with Unsupervised Classifier," Sajjadi et al.: https://t.co/7nMBePT9tA .@LovedeepSG "Learning of Gaussian Processes in Distributed and Communication Limited Systems," Tavassolipour et al.: https://t.co/VQPcPl1Q7w .@LovedeepSG "Cross-label Suppression: A Discriminative and Fast Dictionary Learning with Group Regularization," Wang and Gu: https://t.co/XcTCnyjl7I .@LovedeepSG "Geometry and Dynamics for Markov Chain Monte Carlo," Barp et al.: https://t.co/2ncNBDuTWU "Multiple Imputation Using Deep Denoising Autoencoders," @LovedeepSG and Wang: https://t.co/7M4w8cFmbY "Continuous Experience-aware Language Model for Recommender Systems using Brownian Motion," Mukherjee et al.: https://t.co/cjmEdjHDpH "Credible Review Detection with Limited Information using Consistency Analysis," Mukherjee et al.: https://t.co/CP74JJAyVE "Leveraging Joint Interactions for Credibility Analysis in News Communities with Continuous CRF," Mukherjee/Weikum: https://t.co/wemAmRJMHu "DropIn: Making Reservoir Computing Neural Networks Robust to Missing Inputs by Dropout," Bacciu et al.: https://t.co/6l3HnuIiwg "Performance Limits on the Classification of Kronecker-structured Models," Jindal and Nokleby: https://t.co/7SRX8I9i38 "Item Recommendation with Evolving User Preferences and Experience," Mukherjee et al.: https://t.co/MNLrL2Qzvx "Exploring Latent Semantic Factors to Find Useful Product Reviews," Mukherjee et al.: https://t.co/6ZqQVUtMRR "Face Super-Resolution Through Wasserstein GANs," Chen and Tong: https://t.co/gi9rUzbdas "Nonlinear Information Bottleneck," Kolchinsky et al.: https://t.co/pHi44EhX4e "A comprehensive study of batch construction strategies for recurrent neural networks in MXNet," Doetch et al.: https://t.co/rCym5c8RDz "Max-Pooling Loss Training of Long Short-Term Memory Networks for Small-Footprint Keyword Spotting," Sun et al.: https://t.co/Z9qeTG7u1J "Learning Representations of Emotional Speech w/ Deep Convolutional Generative Adversarial Networks," Chang/Scherer: https://t.co/yYeUGjpaNh (Disappointed that wasn't a @rcalo tweet generating GAN, from the name) "CaloGAN: Simulating 3D High Energy Particle Showers in Multi-Layer Electromag. Calorimeters w GANs," Paganini et al https://t.co/1idBbLcxAm "How to Balance Privacy and Money through Pricing Mechanism in Personal Data Market," Nget et al.: https://t.co/bC2ICzuZ8c "Light Field Video Capture Using a Learning-Based Hybrid Imaging System," Wang et al.: https://t.co/zAK18InHNo "Real-Time User-Guided Image Colorization with Learned Deep Priors," Zhang et al.: https://t.co/qkerMG0KRP https://t.co/WT0UCxICHK "Generative Cooperative Net for Image Generation and Data Augmentation," Xu et al.: https://t.co/KcRlnrEqOd "Multi Resolution LSTM For Long Term Prediction In Neural Activity Video," Song et al.: https://t.co/LbvnXtpJpx "Keeping the Bad Guys Out: Protecting and Vaccinating Deep Learning with JPEG Compression," Das et al.: https://t.co/gLKDtQrqGn "Ontology-Aware Token Embeddings for Prepositional Phrase Attachment," Dasigi et al.: https://t.co/5mzjH5CLYf "Obj.Detection by Spatio-Temporal Analysis+Tracking of the Detected Objs in a Video w Variable Background"-Ray et al https://t.co/EInvn7KQ01 "Learning non-maximum suppression," Hosang et al.: https://t.co/MEgaSHUhzK "Temporal Segment Networks for Action Recognition in Videos," Wang et al.: https://t.co/sVTIvkOvQa "Face Recognition Machine Vision System Using Eigenfaces," Fares Jalled: https://t.co/6AmDBcxZEO "Density Estimation for Geolocation via Convolutional Mixture Density Network," Iso et al.: https://t.co/e4gIoJSzNY "High-Level Concepts for Affective Understanding of Images," Ali et al.: https://t.co/SrxowVFJdY "Adaptive Traffic Signal Control: Deep RL Algorithm with Experience Replay and Target Network," Gao et al.: https://t.co/UsnUGzKmCc "What Can Help Pedestrian Detection?," Mao et al.: https://t.co/o7eiarWS39 "Deep Descriptor Transforming for Image Co-Localization," Wei et al.: https://t.co/pgaZ7tFYyu "Scene Text Eraser," Nakamura et al.: https://t.co/nyblkafsQt Interesting approach for making otherwise privacy-problematic data usable... "Spatiotemporal Recurrent Convolutional Networks for Traffic Prediction in Transportation Networks," Yu et al.: https://t.co/sNuCiWzQQn ...Giraldo-Zuluaga et al.: https://t.co/T2U7vhtlF1 "Automatic Recognition of Mammal Genera on Camera-Trap Images using Multi-Layer Robust Principal Component Analysis and Mixture NNs,"... "Combating Human Trafficking with Deep Multimodal Models," Tong et al.: https://t.co/AFCkJ9d8q1 "ChineseFoodNet: A large-scale Image Dataset for Chinese Food Recognition," Chen et al.: https://t.co/HI2bfdA6Y9 "Metacontrol for Adaptive Imagination-Based Optimization," @jhamrick et al.: https://t.co/bYv6b80rq6 "Handwritten Bangla Digit Recognition Using Deep Learning," Alom et al.: https://t.co/jEbvae2eC7 "TrajectoryNet: An Embedded GPS Trajectory Representation for Point-based Classification Using RNNs," Jiang et al.: https://t.co/AjDTAfx0NH "End-to-end Source Separation with Adaptive Front-Ends," Venkataramani and Smaragdis: https://t.co/bUFntbVAOX "Deep Visual Attention Prediction," Wang and Shen: https://t.co/04RQrZc91i "Toward Low-Flying Autonomous MAV Trail Navigation using Deep NNs for Environmental Awareness," Smolyanskiy et al.: https://t.co/4ou4RBRjC2 "Learning Discriminative Relational Features for Sequence Labeling," Nair et al.: https://t.co/P9Ji28BGZR "A Design Methodology for Efficient Implementation of Deconvolutional Neural Networks on an FPGA," Zhang et al.: https://t.co/iHGm7jTgY7 ...Huang et al.: https://t.co/OAYssd3Ua2 "Simultaneous Super-Resolution and Cross-Modality Synthesis of 3D Medical Images using Weakly-Supervised Joint Convolutional Sparse Coding," "A Study and Comparison of Human and Deep Learning Recognition Performance Under Visual Distortions," Dodge/Karam: https://t.co/XV01pNLwDf "Context-Aware Trajectory Prediction," Bartoli et al.: https://t.co/bdnEvtRjiL RT @ditzkoff: So tired of these reboots. https://t.co/GcfhfMnnj9 "On human motion prediction using recurrent neural networks," Martinez et al.: https://t.co/oBG5XJ1Xm3 "Stock Volatility Prediction Using Recurrent Neural Networks with Sentiment Analysis," Liu et al.: https://t.co/PFiay8TCtu "Image Annotation using Multi-Layer Sparse Coding," Tariq and Faroosh: https://t.co/8TJuqcXL0b "Learning Distributed Representations of Texts and Entities from Knowledge Base," Yamada et al.: https://t.co/xYDpGGBTV4 "Citation sentence reuse behavior of scientists: A case study on massive biblio. text dataset of CS," Singh et al.: https://t.co/E1H2OLfYFq "On Using Active Learning and Self-Training when Mining Performance Discussions on Stack Overflow," Borg et al.: https://t.co/dlJC7vtZCK "Face Detection, Bounding Box Aggregation+Pose Estimation 4 Robust Fac. Landmark Loc'sation in the Wild," Feng et al https://t.co/oR4guM7aUd "Group Marching Tree: Sampling-Based Approximately Optimal Motion Planning on GPUs," Ichter et al.: https://t.co/xDsH3wL9R1 "DeepCorrect: Correcting DNN models against Image Distortions," Borkar and Karam: https://t.co/mYS4M5BHe1 "Knowledge-Guided Deep Fractal Neural Networks for Human Pose Estimation," Ning et al.: https://t.co/qCmb1DOrdx "Robust Motion Planning via Perception-Aware Multiobjective Search on GPUs," Ichter et al.: https://t.co/oYOht3SSFH "Analogical Inference for Multi-Relational Embeddings," Liu et al.: https://t.co/D8PUu6FiMW Rest of the batch *deep breath*--"Deep Patch Learning for Weakly Sup. Object Classification + Discovery," Tang et al https://t.co/zWDfTHEiLW RT @nktpnd: This second paragraph is one for the history books. #Comey https://t.co/0HWkd4OBFH RT @Snowden: This FBI Director has sought for years to jail me on account of my political activities. If I can oppose his firing, so can yo… RT @neuroconscience: Are we really watching the USA slow motion trianwreck into an authoritarian state? @BenedictEvans yup RT @polynoamial: Added Libratus AI Poker comp results to our paper. New material, and more approachable for a general audience: https://t.c… RT @hardmaru: Neural Models for Information Retrieval. Good review paper on this subject. https://t.co/kQAaq0PEGZ https://t.co/FqvuzGOYkL RT @deliprao: Rejection notice for the classic Bahl et al machine translation paper: "The crude force of computers is not science." #nlproc… RT @karpathy: MT with CNNs from FB https://t.co/01Od0QdOU4 CNNs are nice (shorter causal chain, more parallel), should often be tried in pl… @lidija_sekaric that's what Twitter is for ;) RT @zacharylipton: Quick recap on my trip to NYU Algorithms and Explanations. Who, what, where, when, why, and what comes next? https://t.c… Moar tomorrow... "Supervised Learning of Universal Sentence Representations from Natural Language Inference Data," Conneau et al., FB https://t.co/7WrEWNFb5L @danieldewey That'd be nice! Will make a note to ping her. "Safe + Nested Subgame Solving for Imperfect-Information Games," @polynoamial and Sandholm: https://t.co/LUFmJwEIYD Updated w Libratus stuff Demo - https://t.co/kZYWlc7U5W "You said that?," Chung,* Jamaludin,*+Zimmerman: https://t.co/XQAPOgAhzj Results not great yet but small data - this'll get better quickly https://t.co/MYdBITJl0k Plot twist: naturally, the WiFi starts working again right after I say that and tweet stuff from my phone. So, maybe some more tonight... @jeremyphoward @lucidrains interested! That's it for now b/c WiFi issues; more from tonight's (big) batch tomorrow :) " energy dissipation is ~1 fJ/per spike...3 orders smaller in comparison w..IBM TrueNorth system" (curious if @lidija_sekaric has thoughts?) "Developing All-Skyrmion Spiking Neural Network," He and Fan: https://t.co/VIwbuhJPyb "Mnemonic Reader for Machine Comprehension," Hu et al.: https://t.co/AdI3roPpTX "Learning Distributed Representations of Texts and Entities from Knowledge Base," Yamada et al.: https://t.co/xYDpGGBTV4 "Machine Learning with World Knowledge: The Position and Survey," Song and Roth: https://t.co/vJJG6ZYwqz ArXiv papers for May 9th - "Geometric GAN," Lim and Ye: https://t.co/llniJ58kwA @kylebrussell yo :) I'll be in San Francisco May 24-26 - let me know if you want to chat :) @janexwang haha watching that right now. Maybe an AI safety emergency :) Sally Yates owning @tedcruz just now made me lol. #SallyYatesIsAPatriot RT @rcalo: If you are a PhD candidate interested in a post doc at the University of Washington around artificial intelligence policy, pleas… @dkasenberg not that I'm aware of though that'd be nice! RT @_rockt: 1/ Recordings of talks from the 1st NIPS Workshop on Neural Abstract Machines & Program Induction are now online! https://t.co/… (if it isn't on there already, dunno, not using it :) ) We'll prob see ~this incorporated into the Google Cloud video API soon (some authors from Goog.). From search for nouns to search for verbs. Makes a real-time Babelfish seem > tractable - got the speed (storage prob OK too?), just need better performance :) https://t.co/ayJgHyrcZL "KATE: K-Competitive Autoencoder for Text," Chen and Zaki: https://t.co/x1ERgzWkRG "Matrix Factorization with Side and Higher Order Information," Shah et al.: https://t.co/GWxFIjk4j0 "A Workflow for Visual Diagnostics of Binary Classifiers using Instance-Level Explanations," Krause et al.: https://t.co/9OKoy8yHv0 "Detecting Adversarial Samples Using Density Ratio Estimates," @LovedeepSG: https://t.co/bOL8A2aLpj "Unsupervised learning of object landmarks by factorized spatial embeddings," Thewlis et al.: https://t.co/tGRahUi8Fj "Group invariance principles for causal generative models," Besserve et al.: https://t.co/tOmp3e8zyv "SLDR-DL: A Framework for SLD-Resolution with Deep Learning," Cheng-Hao Cai: https://t.co/0iKAZrQdiy "S-OHEM: Stratified Online Hard Example Mining for Object Detection," Li et al.: https://t.co/GtFCGAh22w "Data Readiness Levels," @lawrennd: https://t.co/U5q0PWwrFv "Multiple Instance Learning for Malware Classification," Stiborek et al.: https://t.co/ttrRHFrD1W "Sequential Attention," Brarda et al.: https://t.co/zM6GhxiRV8 "Analysis and Design of Convolutional Networks via Hierarchical Tensor Decompositions," Cohen et al.: https://t.co/u6fhgqe1kR "Deep Speaker: an End-to-End Neural Speaker Embedding System," Li, Ma, Jiang, and Li et al., Baidu: https://t.co/scbyBQG35c "Building Morphological Chains for Agglutinative Languages," Ozen and Can: https://t.co/4maRhQISV2 "Hospital-scale Chest X-ray DB+Benchmarks on Weakly-Sup. Classif+Loc'zation of Common Thorax Diseases," Wang et al.: https://t.co/tGQ7jU9r5L "Fairness Incentives for Myopic Agents," Kannan et al.: https://t.co/AAD01Xo0sW "Value Iteration for Long-run Average Reward in Markov Decision Processes," Ashok et al.: https://t.co/Wp6wkfvGHd "We believe this is the best published accuracy/speed trade-off of an NMT system." "Sharp Models on Dull Hardware: Fast and Accurate Neural Machine Translation Decoding on the CPU," Jacob Devlin-MSFT https://t.co/G2Ric5yhLS "On Identifying Disaster-Related Tweets: Matching-based or Learning-based?," To et al.: https://t.co/9s6ErrifhP "Machine Comprehension by Text-to-Text Neural Question Generation," Yuan, Wang, Gulcehre+Sordoni et al, Maluuba/MILA https://t.co/NOzPV5Azfc "Cross-lingual Distillation for Text Classification," Xu and Yang: https://t.co/9XAKNPy6G4 "Motion Prediction Under Multimodality with Conditional Stochastic Networks," Fragkiadaki et al.: https://t.co/89H9D5SpHU "A Probabilistic Model for Collaborative Filtering with Implicit and Explicit Feedback Data," Nguyen et al.: https://t.co/DvsAc8MVWO "GRASS: Generative Recursive Autoencoders for Shape Structures," Li et al.: https://t.co/IF0bXrVZty "TALL: Temporal Activity Localization via Language Query," Gao et al.: https://t.co/F3P0JmddTq "Bridging btwn Comp. + Robot Vision through Data Augmentation: a Case Study on Obj. Recognition," D'Innocente et al: https://t.co/dV8zo1jxr3 "Joint RNN Model for Argument Component Boundary Detection," Li et al.: https://t.co/gqb7mQb6nu "Characterizing and Improving Stability in Neural Style Transfer," Gupta et al., Stanford: https://t.co/99fqWIm9dJ "Part-based Deep Hashing for Large-scale Person Re-identification," Zhu et al.: https://t.co/UrR7qHmBpJ "Unified Embedding and Metric Learning for Zero-Exemplar Event Detection," Hussein et al.: https://t.co/b2U9hhjAIo arXiv papers, May 8: "Exponential scaling of neural algorithms - a future beyond Moore's Law?," James Aimone: https://t.co/CnMp71qsvM RT @fchollet: True, but also, a lot of people aren't comfortable with Nazis in positions of power. I think that played a huge role in this… @ashleyfeinberg 6 minutes apart from each other... 🤔 RT @fchollet: Whatever the final count end up being, ~40% of the vote going to Le Pen is pretty scary. Should be a wake-up call for Europe. RT @fchollet: Looking like Macron will be the new French president with ~60% of the vote. Just where the polls had him. @jwan584 ADAS? @jwan584 no product perhaps, but projects/collaborations, no? Bought Mobileye... RT @sarahkendzior: Eric is my favorite Trump, for he is the dumbest Trump. Always saying the quiet part out loud. https://t.co/tra0dStjDf @clarkamiller @ASU_SFIS def. a problem in AI sometimes, and other areas - indeed in this case, it's a psych paper/journal :) "The rat-a-gorical imperative: Moral intuition and the limits of affective learning," Joshua Greene (PDF): https://t.co/7vttvc9yEi Blackwell's bookstore as TARDIS. https://t.co/sLoB3miVry RT @thorstenbenner: "Good journalism isn’t being led by the nose to whatever the hackers think one should focus on." https://t.co/7II39kodmA RT @Miles_Brundage: Friday, May 5 papers - "Auto-painter: Cartoon Image Generation from Sketch by Using Conditional GANs," Liu et al.: http… RT @hardmaru: The evolution of intelligence in mammalian carnivores. https://t.co/giuTphZWcS RT @DG_Rand: Join me in @SwingLeft's effort for 2018 defeat of Swing District Reps voting for Trumpcare! $ split across districts https://t… It me. https://t.co/ELfx7ZBN7h @_jyan_ log normal distribution with peak near same place would be smoother/similar @_jyan_ why the kinks near the top? @_jyan_ re: why so many, one needn't solve it all to have useful stuff @_jyan_ any estimate involving one year and no confidence interval is too confident :) "RT @soumithchintala: https://t.co/ZLLNLvm1EP a framework for research on dialog agents from FAIR. dataset APIs, mechanical turk interfaces…" @_jyan_ @AlxCoventry @katherinebailey (though that's kind of my point - I don't make hard AI/AGI distinction, think we have general-ish stuff, humans aren't 100% general etc :) ) @_jyan_ @AlxCoventry @katherinebailey perhaps, but again, I am quite sure they're not there yet :) think we'll see some cool Uni transfer stuff soon but still limited in some way @_jyan_ @AlxCoventry @katherinebailey I'm v confident they're not :) I mean, engineering is part of that (AlphaGo scaling, Universe, etc.) but no secret AGI projects @_jyan_ @AlxCoventry @katherinebailey started engineering what? @katherinebailey @_jyan_ @AlxCoventry intrinsic motivation and exploration research has made some progress, for example. @katherinebailey @_jyan_ @AlxCoventry I still see that as a problem progress can be made on, though, not v mysterious, just hard... @katherinebailey @_jyan_ @AlxCoventry maybe! I do hope we make more progress in reward/goal learning and not just in attaining reward :) @katherinebailey @_jyan_ @AlxCoventry don't think it's conceptually problematic to have intrinsic reward, or to have goals change over time, etc., hard part is having it work :) @katherinebailey @_jyan_ @AlxCoventry I think this is a pretty smooth transition/we have some generality already, e.g deep RL with auxiliary rewards for prediction, control, etc. @ArtirKel @elonmusk Or Schrödinger's Drill... @elonmusk Something Something Schrödinger? @ericjang11 (/reliable livestreaming of talks and allowing remote ppl to ask Qs) @ericjang11 That's all true, but I think you'd get a decent fraction of the value for much, much less $ by reliably recording talks + having longer Q+A. @_jyan_ @AlxCoventry @katherinebailey and DQN is somewhat similar...AlphaGo different but maybe special? anyway, many issues here @_jyan_ @AlxCoventry @katherinebailey DNC was arguably out of date by time published :) original NTM paper was on arxiv.. @_jyan_ @_not_Ian_ @katherinebailey got a paper on this cooking :) @_jyan_ @katherinebailey what iinfo, and if you expect it, why don't you just say 2027 :) [FWIW, I think that's plausible, but much longer also plausible] @hardmaru did a trial for Nicholas Cage and it looks like it'd work OK... @hardmaru maybe get pic pairs via Google Image searches of "[name of famous actor from list] headshot" and "[name] caricature", first few results :) @hardmaru yeah, a bit click baity. I'd like to see photo --> caricature or cartoon, with not-just-color transformations. @clarkamiller (dozens of papers at confs on transparency, robustness, 0 I know of on trust for own sake -though military/HRI ppl discuss over/under trust) @clarkamiller yeah, strange post. FWIW, not representative of convo in AI community (maybe some UX people?). Much work by AI ppl on the earning trust part "MapReduce Particle Filtering with Exact Resampling and Deterministic Runtime," Thiyagalingam et al.: https://t.co/vBq27luoRa "Learning with Confident Examples: Rank Pruning for Robust Classification with Noisy Labels," Northcutt et al.: https://t.co/yAXVUy0snc "Semi-Supervised AUC Optimization based on Positive-Unlabeled Learning," Sakai et al.: https://t.co/04kT1UkGho "Link Mining for Kernel-based Compound-Protein Interaction Predictions Using a Chemogenomics Approach," Ohue et al.: https://t.co/v65jIAhgkD "Semi-supervised cross-entropy clustering with information bottleneck constraint," Smieja and Gieger: https://t.co/DDOQczmSfu "Fourth-order Tensors with Multidimensional Discrete Transforms," Liu and Wang: https://t.co/1Ss8QPEf3B "VNect: Real-time 3D Human Pose Estimation with a Single RGB Camera," Mehta et al.: https://t.co/GQQbl2u3kN "cuTT: A High-Performance Tensor Transpose Library for CUDA Compatible GPUs," Hynninen and Lyakh: https://t.co/e9HVRSunl5 "A Formal Semantics for Data Analytics Pipelines," Drocco et al.: https://t.co/Z6QathWnhl "I Want to Believe: Journalists and Crowdsourced Accuracy Assessments in Twitter," Buntain and @jengolbeck: https://t.co/qYGiB8iyi4 "Compressing DMA Engine: Leveraging Activation Sparsity for Training Deep Neural Networks," Rhu et al.: https://t.co/EvVxZm2IJA "Learning Hierarchical Shape Segmentation and Labeling from Online Repositories," Yi et al.: https://t.co/VNXiUTDbJh "Semi-Global Weighted Least Squares in Image Filtering," Liu et al.: https://t.co/DwBz4N5xOk "Probabilistic Typology: Deep Generative Models of Vowel Inventories," Cotterell and Eisner: https://t.co/CRBeNwa0nf "Dissipation of stop-and-go waves via control of autonomous vehicles: Field experiments," Stern et al.: https://t.co/pIvHCNB5EJ "Generative Convolutional Networks for Latent Fingerprint Reconstruction," Svoboda et al.: https://t.co/LaTc2vTonN "Optimal Approximation with Sparsely Connected Deep Neural Networks," Bölcskei et al.: https://t.co/wsykervFEm "Attributes2Classname: A discriminative model for attribute-based unsupervised zero-shot learning," Demirel et al.: https://t.co/fdZeY3Gyr7 "Deep 360 Pilot: Learning a Deep Agent for Piloting through 360° Sports Video," Hu et al.: https://t.co/VCPNi7TTPO "Am I Done? Predicting Action Progress in Videos," Becattini et al.: https://t.co/s0TGrOpAbU "From Zero-shot Learning to Conventional Supervised Classification: Unseen Visual Data Synthesis," Long et al.: https://t.co/VKRBDrHheK "Pixel Normalization from Numeric Data as Input to Neural Networks," Sane and Agrawal: https://t.co/BnpRTdyEOI "Fast k-means based on KNN Graph," Deng and Zhao: https://t.co/UgIfPA5nAO "A Reasoning System for a First-Order Logic of Limited Belief," Christoph Schwering: https://t.co/3LETzYPNEm "A Deep Learning Perspective on the Origin of Facial Expressions," Breuer and Kimmel: https://t.co/VhaNVElaJg "A Hybrid Approach to Video Source Identification," Iuliani et al.: https://t.co/FGcWSwnkBp (sidenote: I love the term tubelet. It's a slice in space-time from a video, basically) "Action Tubelet Detector for Spatio-Temporal Action Localization," Kalogeiton et al.: https://t.co/gWaLzUjG4p "An Active Learning Approach to the Falsification of Black Box Cyber-Physical Systems," Silvetti et al.: https://t.co/1M1YRW42oR "Recurrent Soft Attention Model for Common Object Recognition," Ren et al.: https://t.co/3VtodjKfxy "Toward Open Set Face Recognition," Günther et al.: https://t.co/bZvLhg4MDn Friday, May 5 papers - "Auto-painter: Cartoon Image Generation from Sketch by Using Conditional GANs," Liu et al.: https://t.co/4L9CVIJtJN RT @DeepStackAI: The DeepStack paper was just published in the print edition of Science, and we made the front cover! https://t.co/utr9smWq… RT @realDonaldTrump: It’s Thursday. How many people have lost their healthcare today? RT @venkatesanragav: @Miles_Brundage We reimplemented @goodfellow_ian's original GAN and avoided the zoo of new ones for simplicity.. bette… RT @venkatesanragav: @Miles_Brundage Results are shown only for MNIST and SVHN and CIFAR10, frankly because we didn't have a good enough GA… RT @venkatesanragav: A cool new use of GANs to continually learn. https://t.co/eimjjp5OUg #GANs @venkatesanragav thanks! Yeah, I tweeted about it when it came out and am still working my way through it. Nice work! @katherinebailey can you share who the people are? Very interested in this sort of thing :-) @katherinebailey did they specify what they meant exactly? Strangely specific date, almost Kurzweilian... RT @zeynep: .@actblue now has a single page to donate to challengers to wavering, vulnerable Rs who may vote yes—unless spooked. https://t.… @davegershgorn lol "RT @SenKamalaHarris: Retweet if you: -Have a preexisting condition -Love someone with a preexisting condition -Fear your insurance will b…" @Aelkus perhaps rationalization of said emotions, but ya fyi @Aelkus cf https://t.co/ZAFH5ldm7r "Quantified advantage of discontinuous weight selection in approximations with deep neural nets," Dmitry Yarotsky: https://t.co/nLa3YQLVfs "FOIL it! Find One mismatch between Image and Language caption," Shekhar et al.: https://t.co/1l7y10mTzU "Going Wider: Recurrent Neural Network With Parallel Cells," Zhu et al.: https://t.co/ZHrX4e3Syx "Formal Verification of Piece-Wise Linear Feed-Forward Neural Networks," Ruediger Ehlers: https://t.co/6IkbjIOIV8 "Learning Cross-Domain Disentangled Deep Representation with Supervision from A Single Domain," Fu et al.: https://t.co/UgisBHxVbw "A General Safety Framework for Learning-Based Control in Uncertain Robotic Systems," Fisac et al.: https://t.co/vaGakbomgL "On the effectiveness of feature set augmentation using clusters of word embeddings," Balikas et al.: https://t.co/VxhysXRPdO "Amortized Inference and Learning in Latent CRFs 4 Weakly-Supervised Semantic Image Segmentation," Pandey/Dukkipati: https://t.co/QfK0oEVUUr "The Forgettable-Watcher Model for Video Question Answering," Xue et al.: https://t.co/TLqigInf0y "Part-based Weighting Aggregation of Deep Convolutional Features for Image Retrieval," Xu et al.: https://t.co/FlbdE6uqb9 "A Hybrid Architecture for Multi-Party Conversational Systems," de Bayser et al.: https://t.co/2wgu7AAU6h "Lifelong Metric Learning," Sun et al.: https://t.co/uIeN44jzLz "Local Shrunk Discriminant Analysis (LSDA)," Gao et al.: https://t.co/RFXAlKKyut "Analyzing Knowledge Transfer in Deep Q-Networks for Autonomously Handling Multiple Intersections," Isele et al.: https://t.co/aU9K8Xe4Fa "Navigating Intersections with Autonomous Vehicles using Deep Reinforcement Learning," Isele et al.: https://t.co/UBEcH7zELH (all of the driverless car stuff today is from Honda) "Towards Full Automated Drive in Urban Environments: A Demonstration in GoMentum Station, California," Cosgun et al: https://t.co/na1xwp5xvK "Cascaded Boundary Regression for Temporal Action Detection," Gao et al.: https://t.co/wu4UwYfwvs "Shading Annotations in the Wild," Kovacs et al.: https://t.co/H1bjF6O3LO "Out-of-focus: Learning Depth from Image Bokeh for Robotic Perception," Cristofolo and Wang: https://t.co/1vuJbC4qYN "Improving fitness: Mapping research priorities against societal needs on obesity," Cassi et al.: https://t.co/GC5vLeqhL9 "Sustaining Moore's Law Through Inexactness," Augustine et al.: https://t.co/gwyOxl1nQQ "On Tackling the Limits of Resolution in SAT Solving," Ignatiev et al.: https://t.co/EpT9wGsM97 "Ternary Neural Networks with Fine-Grained Quantization," Mellempudi et al.: https://t.co/615vzrqEoX "Chunk-Based Bi-Scale Decoder for Neural Machine Translation," Zhou et al.: https://t.co/2GlMDwovr8 "Gabor Convolutional Networks," Luan et al.: https://t.co/Dh3WPeWUa6 "Data-Driven Synthesis of Smoke Flows with CNN-based Feature Descriptors," Chu and Thuerey: https://t.co/a7vlMAZ8Rs "Answer Set Programming for Non-Stationary Markov Decision Processes," Perreira et al.: https://t.co/1l2KBkAKhh "Learning to Estimate 3D Hand Pose from Single RGB Images," Zimmermann and Brox: https://t.co/EVWGuplSEb "Weakly-supervised Visual Grounding of Phrases with Linguistic Structures," Xiao et al.: https://t.co/wAZoQVhRth "Rational ignorance: simpler models learn more from finite data," Mattingly et al.: https://t.co/XV0wOXyDlb "Neural Models for Information Retrieval," Mitra and Craswell: https://t.co/5D42a5ZfVk "Summarized Network Behavior Prediction," Shih-Chieh Su: https://t.co/GZnxhHFrdY "Balanced Excitation and Inhibition are Required for High-Capacity, Noise-Robust Neuronal Selectivity," Rubin et al: https://t.co/pS122q3Uy1 "A Rule-Based Computational Model of Cognitive Arithmetic," Pati et al.: https://t.co/sBaVFRao0i Thursday, May 4th papers: "Efficient Spatio-Temporal Gaussian Regression via Kalman Filtering," Todescato et al.: https://t.co/J28ktPxs9m RT @benwikler: Stop TrumpCare. Melt the phone lines. This @MoveOn line connects you to your GOP Rep: 844-432-0883 /8 More on the Fyre Fest preparation/lack thereof: https://t.co/4rQ3zvte7B @timmaughan are your neighbors ok? RT @NateSilver538: 1. So I have a looooong article up on the Comey letter's impact, and how the media covered it. https://t.co/6M6EdUgTRF @erfannoury yeah that's what I meant. Sounds like it's worth trying to me. @erfannoury hmm. Yeah you could send new tweets, then make a moment out of both threads maybe? @dennybritz I argued against the "new jobs = better jobs" theory here: https://t.co/rVkqVtcd1i @erfannoury the point was to basically join the same thread...but anyway, yeah, nto sure how best to do this :/ @erfannoury I meant what I'm currently doing (respond to one paper with the next). Most of the time can fit the paper+author+link. RT @MaxBoot: Dismaying! This is the amorality of the Nixon-Kissinger foreign policy but without the knowledge or skill in application. http… RT @erichorvitz: Heading to board retreat of @PartnershipAI hosted at @macfound. Thematic pillars of attention now available at https://t.… @erfannoury you could continue on the same thread, or share a hashtag..? dunno @erfannoury I'm not sure, honestly... @halhod much of which isn't technically novel but just application to the nth medical area. takes time 2 skim all of them and there are tons @halhod no, one can and I think has had various benchmarks for this (Kaggle, competitions etc), more just a matter of time- lots of stuff, RT @Miles_Brundage: Papers from Wed., May 3 -- "A Strategy for an Uncompromising Incremental Learner," Venkatesan et al.: https://t.co/csOb… @halhod I stopped tweeting most deep learning for med classification a while ago, so much stuff (not just this task). @edersantana @markus_with_k You'd survive with Import AI/rxiv-sanity/other ppl :) but I do think I add some value so will try, just not scalable to many more papers! @markus_with_k @edersantana It's a fair request, but prob. won't happen soon as it'd be nontrivially harder - prob 10+mins more (/almost ready to give up already) :) ..and sometimes RT the thread to address 1 concern(not seeing tweets). Can't accommodate all suggestions but hope this helps most ppl! (2/2) (end of May 3 paper tweets) Thanks everyone for the feedback on the experiment, btw. I think what I'm going to do is the threading, (1/2) "Central and peripheral vision for scene recognition: A neurocomputational modeling exploration," Wang and Cottrell: https://t.co/1eHqqbXXXQ "A Novel Approach to Forecasting Financial Volatility with Gaussian Process Envelopes," Rizvi et al.: https://t.co/Np6QbVTn8m "One-Class Semi-Supervised Learning: Detecting Linearly Separable Class by its Mean," Bauman and Bauman: https://t.co/OLrppMx1or "Scalable MCMC for Bayes Shrinkage Priors," Johndrow and Orenstein: https://t.co/aTlHMq69Sp "Redundancy in active paths of deep networks: a random active path model," Huang et al.: https://t.co/nL6RLBiS9m "Regularizing Model Complexity and Label Structure for Multi-Label Text Classification," Wang et al.: https://t.co/PpJZNhktTk "Nonlinear Kalman Filtering with Divergence Minimization," Gultekin + Paisley: https://t.co/tWUyIkiToM (looks interesting, + I may have been wrong about Peak GAN being a few weeks ago...are we there yet?) "Show, Adapt and Tell: Adversarial Training of Cross-domain Image Captioner," Chen et al.: https://t.co/c5ceBzw3qJ "Error Corrective Boosting for Learning Fully Convolutional Networks with Limited Data," Roy et al.: https://t.co/zj4auHkGn2 "Scalable Surface Reconstruction from Point Clouds with Extreme Scale and Density Diversity," Mostegel et al.: https://t.co/XRXT3MRHkH "Smart Assessment of and Tutoring for Computational Thinking MOOC Assignments using MindReader," Hasan Jamil: https://t.co/5ZHEDSpMan "Foundations of Intelligent Additive Manufacturing," Garanger et al.: https://t.co/rdJvgoeite "Active Image-based Modeling," Huang et al.: https://t.co/mz4gRUVNCy "Modeling Source Syntax for Neural Machine Translation," Li et al., Soochow/Tencent: https://t.co/VSRx3MVlvs "Maximum Resilience of Artificial Neural Networks," Cheng et al.: https://t.co/jXPT3GbRHd "Entity Linking with people entity on Wikipedia," Yan and Khurad: https://t.co/qzFLb7TkiP "Correcting for Non-Markovian Asymptotic Effects using Markovian Representation," Vitali Volovoi: https://t.co/Y0QiEkPRN4 "The N-Tuple Bandit Evolutionary Algorithm for Automatic Game Improvement," Kunanusont et al.: https://t.co/uQasiLBSdL "Transforming Bell's Inequalities into State Classifiers with Machine Learning," Ma and Yung: https://t.co/6qmUCsFI7k "Talking Open Data," Neumaier et al.: https://t.co/27KvzbbWKq A bot that tells you about open data, basically. "STAIR Captions: Constructing a Large-Scale Japanese Image Caption Dataset," Yoshikawa et al.: https://t.co/i8VbEnF9X1 """Visual Attribute Transfer through Deep Image Analogy,"" Liao et al.: https://t.co/Z8l2diWxjH Some wild stuff in here... https://t.co/pAIIg4VVx4" "Multi-view Unsupervised Feature Selection by Cross-diffused Matrix Alignment," Wei et al.: https://t.co/tUIramR63s "BLENDER: Enabling Local Search with a Hybrid Differential Privacy Model," Avent et al.: https://t.co/MMr3mxXYV3 "Investigation of Different Skeleton Features for CNN-based 3D Action Recognition," Ding et al.: https://t.co/8suw37IXit Claims big gain from LAUs--also notable for motley crew of affiliations - Tencent, DeeplyCurious, Baidu, Chinese Ac. Sciences, Dublin City U "Deep Neural Machine Translation with Linear Associative Unit," Wang et al.: https://t.co/f7cFRwAaDg "Transfer Learning by Ranking for Weakly Supervised Object Annotation," Shi et al.: https://t.co/0srOJBABQB "'Liar, Liar Pants on Fire': A New Benchmark Dataset for Fake News Detection," WIlliam Yang Wang: https://t.co/9o1MgHaBfN (from Kurzweil and co. at Google, with a hint of Kurzweil boosterism thrown in. Curious what NLPeople think of this. Claims to beat seq2seq) "Efficient Natural Language Response Suggestion for Smart Reply," Henderson et al.: https://t.co/kqsh83MFxN "Bayesian Image Quality Transfer with CNNs: Exploring Uncertainty in dMRI Super-Resolution," Tanno et al.: https://t.co/9DXS9dEOVm "MACA: A Modular Architecture for Conversational Agents," Truong et al.: https://t.co/PLYS4AkbF7 "From Imitation to Prediction, Data Compression vs NNs for Natural Language Processing," Laura et al.: https://t.co/boZPNvYl3h "Submodular Trajectory Optimization for Aerial 3D Scanning," Roberts et al.: https://t.co/H8iCiNRcbd "Argumentation-based Security for Social Good," Karafili et al.: https://t.co/xahEItrxA2 "Combining Task-oriented and Non-task-oriented Spoken Dialogue Systems," Akasaki and Kaji: https://t.co/sLrDqUzWiB "Robust, Informative Human-in-the-Loop Predictions via Empirical Reachable Sets," Driggs-Campbell et al.: https://t.co/biDsxuO4LX "A Teacher-Student Framework for Zero-Resource Neural Machine Translation," Chen et al.: https://t.co/VoaXygZ3V3 "Dense-Captioning Events in Videos," Krishna et al., Stanford: https://t.co/IaahfqEw9J Big video captioning dataset. "Social Robot Modelling of Human Affective State," Skillicorn et al.: https://t.co/WlE7Hc4soI Not sure how impressive results are b/c just MNIST etc. but v. interesting - generative modeling + distillation to avoid catast. forgetting. Papers from Wed., May 3 -- "A Strategy for an Uncompromising Incremental Learner," Venkatesan et al.: https://t.co/csObNdTTco +1 to pushing back on roboflation. 👍 https://t.co/M8UhwyXkIW @OptimizingMind @togelius @mikarv lmao. @mark_riedl dunno re Alexa but Siri can def. answer more Qs than b4..but I'd guess experts break in <30 seconds, no big diff btwn for 10/20 for non-exps @mark_riedl Yes, this is crazy. Says more about the distribution of people's familiarity with AI/comfort with boring convos than any tech developments. @filippie509 @iandanforth and some stuff that maybe shouldn't matter (e.g. know the person, don't tweet stuff I don't understand, vague feeling) but that's the gist.. "@filippie509 @iandanforth + I get it/seems important + reputable people/institutions + clear/readable - class paper - uninteresting application/not novel - sketchy" @filippie509 @iandanforth Yes, they are selected. It is a subset of arXiv that I think people might find interesting/useful, based on various characteristics. """A weaker structural Markov property for decomposable graph laws,"" Green and Thomas: https://t.co/n1zwU7PFI9 /end of May 2 batch" "On the convergence of Hamiltonian Monte Carlo," Durmus et al.: https://t.co/2MHgM6dAWT "Learning with Changing Features," Dhurandhar et al.: https://t.co/oVXZuiQ68X "Scaling Active Search using Linear Similarity Functions," Venkatesan et al.: https://t.co/EqunSruZpD "Representation Learning+Pairwise Ranking for Implicit+Explicit Feedback in Recommendation Systems," Trofimov et al. https://t.co/occdGrrtW6 "Generative Modeling with Conditional Autoencoders: Building an Integrated Cell," Johnson et al.: https://t.co/8DbyzgtyVJ "Discourse-Based Objectives for Fast Unsupervised Sentence Representation Learning," Jernite et al.: https://t.co/rIoazpb5MY "Learning Multimodal Transition Dynamics for Model-Based Reinforcement Learning," Moerland et al.: https://t.co/QjJjz5sRj8 "Single image depth estimation by dilated deep residual CNN and soft-weight-sum inference," Li et al.: https://t.co/jrnzgW13Fq "Machine Vision System for 3D Plant Phenotyping," Chaudhury et al.: https://t.co/5ouGMHgdYC "Attacking Machine Learning models as part of a cyber kill chain," Tam Nguyen: https://t.co/KsggAzIU0Z "Forced to Learn: Discovering Disentangled Representations Without Exhaustive Labels," Romanov and Rumshisky: https://t.co/wZ2EhaVrZ7 "Query-adaptive Video Summarization via Quality-aware Relevance Estimation," Vasudevan et al.: https://t.co/rR7km6L657 "A System for Accessible Artificial Intelligence," Olson et al.: https://t.co/mW4dLaK3JI "Towards well-specified semi-supervised model-based classifiers via structural adaptation," Sun et al.: https://t.co/1VrmniZ6fq "The Promise of Premise: Harnessing Question Premises in Visual Question Answering," Mahendru et al.: https://t.co/tzO7mvK9iA "Stochastic Learning on Imbalanced Data: Determinantal Point Processes for Mini-batch Diversification," Zhang et al: https://t.co/frsWUqXgs1 "Spotting the Difference: Context Retrieval+Analysis for Improved Forgery Detection and Localization," Brogan et al: https://t.co/1xRJblTFv7 "Mind the Class Weight Bias: Weighted Maximum Mean Discrepancy for Unsupervised Domain Adaptation," Yan et al.: https://t.co/CotMr8419W "Speech-Based Visual Question Answering," Zhang et al.: https://t.co/EgraNtuIgL "Generalized orderless pooling performs implicit salient matching," Simon et al.: https://t.co/DtsaRw5ltX "Deep Multi-view Models for Glitch Classification," Bahaadini et al.: https://t.co/yAOCdkKKtM "The Pose Knows: Video Forecasting by Generating Pose Futures," Walker et al.: https://t.co/Tw8KetvrfS "Safe Trajectory Synthesis for Autonomous Driving in Unforeseen Environments," Kousik et al.: https://t.co/236luJio2m "Learning to Ask: Neural Question Generation for Reading Comprehension," Du et al.: https://t.co/vOTarxUT25 "Semi-supervised sequence tagging with bidirectional language models," Peters et al.: https://t.co/LvMdYOHsyC "Cnvlutin2: Ineffectual-Activation-and-Weight-Free Deep Neural Network Computing," Judd et al.: https://t.co/cyOxH2qQQE "Online Learning with Expert Automata," Mohri and Yang: https://t.co/u2NlLZ8sYZ "*-Liftings for Differential Privacy," Barthe et al.: https://t.co/6BPv3UiS13 "Extending and Improving Wordnet via Unsupervised Word Embeddings," Khodak et al.: https://t.co/SJpOf0CA8G "A Conditional Variational Framework for Dialog Generation," Shen et al.: https://t.co/31q4FPOmmC "Generative Neural Machine for Tree Structures," Zhou et al.: https://t.co/WmRKqpMKGy "Quantifying Mental Health from Social Media with Neural User Embeddings," Amir et al.: https://t.co/ORgPZgn1oL "Deep Learning in the Automotive Industry: Applications and Tools," Luckow et al., BMW etc.: https://t.co/7xp5jMInkO "Scalable Twin Neural Networks for Classification of Unbalanced Data," Pant et al.: https://t.co/8skQFxAxae "Revisiting Recurrent Networks for Paraphrastic Sentence Embeddings," Wieting and Gimpel: https://t.co/kQiJbUzzhV "Predicting Foreground Object Ambiguity and Efficiently Crowdsourcing the Segmentation(s)," Gurari et al.: https://t.co/XrX68HGwTy "Adversarial PoseNet: A Structure-aware Convolutional Network for Human Pose Estimation," Chen et al.: https://t.co/h9GBQFacUW "Level Playing Field for Million Scale Face Recognition," Nech + Kemelmacher-Shlizerman: https://t.co/inhm9T217x "Dependency Parsing with Dilated Iterated Graph CNNs," Strubell and McCollum: https://t.co/fKXcg6BKIO "Model Transfer for Tagging Low-resource Languages using a Bilingual Dictionary," Fang and Cohn: https://t.co/HHgBPlhHsC "Learning Topic-Sensitive Word Representations," Fadaee et al.: https://t.co/A5dvlIYLxB "Data Augmentation for Low-Resource Neural Machine Translation," Fadaee et al.: https://t.co/6hiNW6cQTF (Tuesday, May 2 batch) "Detecting Drivable Area for Self-driving Cars: An Unsupervised Approach," Liu et al.: https://t.co/8lK14JIwFu Trying an experiment. Will tweet papers in one long thread as opposed to separate tweets. Let me know if more/less useful. @fchollet why such a big gap? RT @emilytroutman: "It requires 45 times as many killed in an African disaster to achieve the same probability of media coverage as for a d… RT @sleepinyourhat: New paper w/ Yacine Jernite: A fast(!), discriminative version of SkipThought https://t.co/hQZ0N9cqLS https://t.co/pnto… @robinsloan yes. Bobbie Draper for President. RT @TUSK81: Usually this wld be the point where Trump just says "fuck it," declares business bankruptcy, then starts another venture, like… @ArtirKel and it is.... ? @davegershgorn congrats @erichorvitz! Well deserved. (maybe I should include AlphaGo? I don't know. For some reason I distinguish MCTS from planning/SAT solvers but maybe that's inappropriate) Don't think I've seen super impressive demo of deep/symb stuff (e.g. couldn't value iteration nets do the stuff here?) but prob. eventually. ...look at it in recent papers, and I'm sure many more are being cooked up. Seems tricky but important (why not use fast solvers?). Will get to other new arXiv stuff tom. Had to share that 1 as I think deep/symbolic stuff is interesting. Some others (e.g. Garnelo et al.)+ "Classical Planning in Deep Latent Space: Bridging the Subsymbolic-Symbolic Boundary," Asai and Fukunuga: https://t.co/APYu95BOcL RT @benjaminwittes: #NotesFromUnderTrump, Day 102: That feeling when you're prez, you suck up to a murderous dictator & he blows you off ht… RT @RadioFreeTom: OH COME ON https://t.co/28TrE2RSQX RT @MattHourihan: A first cut at nominal #science & tech budget numbers in the FY17 omnibus. Almost complete departure from what POTUS was… @semiDL yes, sarcastic ("NBD" is used when it actually is a big deal :) ) @semiDL "no big deal" Demo: https://t.co/2CzoxlDRuz Sidenote: I wonder if @BarackObama knows how many AI papers/demos he's in... Haven't looked super closely yet but looks like the main thing is tree search on net structure space. Curious what ppl who know more think. "Substochastic Monte Carlo Algorithms," Jarret and Lackey: https://t.co/PdmgnQXDyt "Yes, Machine Learning Can Be More Secure! A Case Study on Android Malware Detection," Demontis et al.: https://t.co/7KNFOKTB20 "A Unified Approach of Multi-scale Deep and Hand-crafted Features for Defocus Estimation," Park et al.: https://t.co/PXZPkcMRaU "Not All Dialogues are Created Equal: Instance Weighting for Neural Conversational Models," Lisan and Bibauw: https://t.co/7omOfhGDwN "Neural Word Segmentation with Rich Pretraining," Yang et al.: https://t.co/ENajHXd09K "Past, Present, Future: A Computational Investigation of the Typology of Tense in 1000 Languages," Asgari/Schutze: https://t.co/qzLhdYaHaJ "Unbiased Shape Compactness for Segmentation," Dolz et al.: https://t.co/1yLXBnDvGM "How consistent are our discourse annotations? Insights from mapping RST-DT and PDTB annotations," Demberg et al.: https://t.co/dAnbJbqPau "Traffic Light Control Using Deep Policy-Gradient and Value-Function Based Reinforcement Learning," Mousavi et al.: https://t.co/HQ6rvv6N1I "On weight initialization in deep neural networks," Siddharth Krishna Kumar: https://t.co/crpWcwEQe5 "Learning Spatiotemporal-Aware Representation for POI Recommendation," Liu et al.: https://t.co/meyDdZC9OP "Image reconstruction by domain transform manifold learning," Zhu et al.: https://t.co/2N4k6GksgZ "Outline Colorization through Tandem Adversarial Networks," Kevin Frans (high school student, NBD): https://t.co/XC3DGDaAYy "Active Collaborative Ensemble Tracking," Meshgi et al.: https://t.co/s2erQIcf5w "Automatic Real-time Background Cut for Portrait Videos," Shen et al.: https://t.co/RNXaV4HnPv "Neural Ranking Models with Weak Supervision," Dehghani et al.: https://t.co/Pg0J5AFFCF "Word Affect Intensities," Saif Mohammad: https://t.co/br1D4hXQKv "Mapping Instructions and Visual Observations to Actions with Reinforcement Learning," Misra et al.: https://t.co/BAlq3TSLVG "Genealogical Distance as a Diversity Estimate in Evolutionary Algorithms," Gabor and Belzner: https://t.co/bxvk1amPI2 "Time-Sensitive Bandit Learning and Satisficing Thompson Sampling," Russo et al.: https://t.co/UrkBphz2Kx "Deep Face Deblurring," Chrysos et al.: https://t.co/VaoATLsMlV "Audio-based performance evaluation of squash players," Hajdu-Szucs et al.: https://t.co/eqTvPXjcV6 "GazeDirector: Fully Articulated Eye Gaze Redirection in Video," Wood et al.: https://t.co/RF0zIvfgkO "Learning a Neural Semantic Parser from User Feedback," Iyer et al.: https://t.co/iX0R4EM5tG "Obstacle Avoidance through Deep Networks based Intermediate Perception," Yang and Konam et al.: https://t.co/IfGwoPZtOg "Improving Facial Attribute Prediction using Semantic Segmentation," Kalayeh et al.: https://t.co/2fwr4iKQQX "Action Understanding with Multiple Classes of Actors," Xu et al.: https://t.co/U9mtqDFJn7 "Artificial Intelligence Based Malware Analysis," Pfeffer and Ruttenberg et al.: https://t.co/7f3JCxzlB3 "A Siamese Deep Forest," Utkin and Ryabinin: https://t.co/ySsLAsG8OB "Deep Feature Learning for Graphs," Rossi et al.: https://t.co/uvD3JL3EJQ "Stochastic Proximal Gradient Algorithms for Penalized Mixed Models," Fort et al.: https://t.co/BT1idJnxVE "Parseval Networks: Improving Robustness to Adversarial Examples," Cisse et al., FAIR: https://t.co/JEjD3TTsxK "DeepArchitect: Automatically Designing and Training Deep Architectures," Negrinho and Gordon: https://t.co/h7PjErH39K RT @vkrakovna: My highlights from this week's ICLR conference, focusing on machine learning security... https://t.co/r8hgYhNyYJ Some cool/humorous results here: https://t.co/LVFJ7ZTuYA @Mvandepanne @pittsburghjoe2 also not working for me. Cool video! RT @Mvandepanne: Our most fun project yet! DeepRL for physics-based running, soccer-dribbling, and more! https://t.co/gBkTA25I2m (sound: A… RT @memotv: ...#GAN trained on art collections of 150 museums watching me draw... https://t.co/yArZLauzSI @levendowski great place! @_jyan_ hardware, data, impact... there are pros and cons, of course, though RT @mer__edith: Theranos, but for music festivals @semiDL lack of revenue actually a good thing from acquihire POV (easier transition to working on new company's products :) ) @semiDL what better acquihire targets are there? /why would that be easier? RT @DeepStackAI: Learn more about #DeepStackAI and its predecessors in this talk by @MichaelHBowling at @UAlbertaCS https://t.co/yGx6f9hXMC… Oh yeah, I forgot about Megvii for some reason. https://t.co/1fyoaxiu80 @tetisheri quite relevant, thx! More generally, curious what ppl think of the Chinese AI startup scene - any notable players outside of Baidu/Alibaba/Tencent/academia/govt? Surprised SenseTime hasn't been bought yet. Seems like one of the few Chinese AI startups that publishes a lot. Anyone know what's up there? RT @natfriedman: With three days left to apply for https://t.co/9wgdrbGhfW, happy to announce some new benefits for winners: https://t.co/8… @kchonyc ah - thanks! :) @kchonyc nice slides. What was the bit about "potential security threat?" referring to? Update: it is in fact interesting. https://t.co/JWMgWxVsJr RT @deliprao: Tencent AI research lab in Seattle! @jasonbaldridge @maidylm hmm. interesting. I was looking at Top Tweets, seemed mostly nat lang proc. but All Tweets = bit more neuro ling. @jasonbaldridge @maidylm Hm, NLP seems to be mostly NLP (not neurolinguistic programming or other things). :) Is NLproc more common/precise? RT @stanfordnlp: Better neural abstractive summarization—@abigail_e_see. Great blog post https://t.co/znGbjszddb—Final @acl2017 paper https… RT @genekogan: my new meat puppet. running #pix2pix live on a webcam https://t.co/wVc5DuCXeG @markus_with_k @jackclarkSF @adam_will_do_it @AI_progress I'm maybe a 30-50% increase in tastiness per day away from abandoning the (one-person-based) filtering effort. Lots of time... @jackclarkSF @markus_with_k @adam_will_do_it @AI_progress Subjectively, I don't think my standards have gone down, if anything they've gone up, but would need to do a blind test or something to know @jackclarkSF @markus_with_k @adam_will_do_it @AI_progress I also am curious whether papers have gotten..tastier..lately or if higher arxiv/not-on-arxiv ratio, or total #, or my standard decreased :) @jackclarkSF @markus_with_k @adam_will_do_it @AI_progress would be interested in cases of different taste to improve my model :) @markus_with_k @adam_will_do_it @AI_progress (though that could lead to confusing thread w/ replies, harder to discuss specific paper. TL;DR not sure right approach, sry if TMI :) ) @markus_with_k @adam_will_do_it @AI_progress Might try experiment of tweet-threading a day's arxiv so ppl can skim through it at once, not distributed randomly throughout one's feed. @markus_with_k @adam_will_do_it @AI_progress ...+ some could in theory but hard (e.g correctly attribute author order when relevant - no universal format for this/not on arxiv metadata) @markus_with_k @adam_will_do_it @AI_progress Definitely non-random (I'd come up with ~80+% the same if did same day twice w/ wiped memory) but not v automatable (e.g. sketchiness signs) @markus_with_k @adam_will_do_it @AI_progress I may write a blog post summarizing my method at some point, bc lots of ppl ask - small bits could be automated, but def not all; @adam_will_do_it @markus_with_k @AI_progress what will the bot do exactly? @thinkmariya not yet, but I like Scheutz's work so probably will. "Multimodal Word Distributions," Athiwaratkun + Wilson: https://t.co/ohda6EKMgF (Smith et al.) "A Dig. Neuromorph. Arch Efficiently Facilitating Complex Synaptic Response Functions Applied to Liq State Machines" https://t.co/rOYKMOyiTn "Multi-Metrics Learning for Speech Enhancement," Fu et al.: https://t.co/7bBdLEOZss "Spectral Ergodicity in Deep Learning Architectures via Surrogate Random Matrices," Suzen et al.: https://t.co/3w6d9lQNNI Looks interesting - "Limits of End-to-End Learning," Tobias Glasmachers: https://t.co/9ePNejXBkQ "Failures of Gradient-Based Deep Learning," Shalev-Shwartz et al. (v2): https://t.co/yYo13OuNHu "Deep Cross-Modal Audio-Visual Generation," Chen et al.: https://t.co/xUM6spwhDo "Diversity driven Attention Model for Query-based Abstractive Summarization," Nema et al.: https://t.co/g1EyQ38SdC "Joint Semantic and Motion Segmentation for dynamic scenes using Deep Convolutional Networks," Haque et al.: https://t.co/lrXcmhAX23 "Semantic Autoencoder for Zero-Shot Learning," Kodirov et al.: https://t.co/sCFuerZSLb "The MacGyver Test - A Framework for Evaluating Machine Resourcefulness + Creative Problem Solving," Sarathy+Scheutz https://t.co/6jR6GhCVDa "From Characters to Words to in Between: Do We Capture Morphology?," Vania and Lopez: https://t.co/08gTydGLeY "A New Type of Neurons for Machine Learning," Fan et al.: https://t.co/YtEfK8Z2Rl "Deep Convolutional Neural Network to Detect J-UNIWARD," Guanshuo Xu: https://t.co/5KkhPwwJUk "Neural AMR: Sequence-to-Sequence Models for Parsing and Generation," Konstas et al.: https://t.co/DzeWcUuyYP "Question Answering on Knowledge Bases and Text using Universal Schema and Memory Networks," Das et al.: https://t.co/u1fEe0IFPv "Learning Structured Natural Language Representations for Semantic Parsing," Cheng et al.: https://t.co/iQ3KnkII77 "Duluth at SemEval-2017 Task 7: Puns upon a midnight dreary, Lexical Semantics for the weak and weary," Ted Pedersen https://t.co/8ZnjC7A2bq Interesting: "Tweeting AI: Perceptions of AI-Tweeters (AIT) vs Expert AI-Tweeters (EAIT)," @maidylm, Dudley + @rao2z https://t.co/VK4APGPOME "A wearable general-purpose solution for Human-Swarm Interaction," Eduardo Castelló Ferrer: https://t.co/84c9i8zy7j "A GRU-Gated Attention Model for Neural Machine Translation," Zhang et al.: https://t.co/GWMLI2eoew "DeepCCI: End-to-end Deep Learning for Chemical-Chemical Interaction Prediction," Kwon and Yoon: https://t.co/Tp1q0NEpI1 "DNA Steganalysis Using Deep Recurrent Neural Networks," Bae et al.: https://t.co/qDpNgKaaZe "Locality Preserving Projections for Grassmann manifold," Wang et al.: https://t.co/1WTYfNdVZ5 "No More Discrimination: Cross City Adaptation of Road Scene Segmenters," Chen et al.: https://t.co/8f1ja7enzu "A Survey of Neural Network Techniques for Feature Extraction from Text," Vineet John: https://t.co/yDUnSidAgP "ICNet for Real-Time Semantic Segmentation on High-Resolution Images," Zhao et al.: https://t.co/xe8Z4O2dFF "Failsafe Mechanism Design of Multicopters Based on Supervisory Control Theory," Quan et al.: https://t.co/DX1Z3hClx5 "BAM! The Behance Artistic Media Dataset for Recognition Beyond Photography," Wilber et al.: https://t.co/v2oZrfoIBm "Dissecting Robotics - historical overview and future perspectives," Zammaloa et al., Acubotics (dunno if good): https://t.co/Xpu7RrPZXB "Saliency Benchmarking: Separating Models, Maps and Metrics," Kummerer et al.: https://t.co/zx0PHMdouZ "End-to-End Multimodal Emotion Recognition using Deep Neural Networks," Tzirakis et al.: https://t.co/0n4PtcB8sz "Full-Page Text Recognition: Learning Where to Start and When to Stop," Moysset et al.: https://t.co/9N5hFMnlGZ "Sparse Hierachical Extrapolated Parametric Methods for Cortical Data Analysis," Honnorat and Davatzikos: https://t.co/wuEc1RpRJi "Deep Functional Maps: Structured Prediction for Dense Shape Correspondence," Litany et al.: https://t.co/rRJz14izRj "On the implausibility of classical client blind quantum computing," Aaronson et al.: https://t.co/xq0j1LnP3e @hardmaru was gonna say something similar, but you put it better :-) @ArtirKel @hardmaru I'm reading with a big grain of salt. The style is at least funny :) @botminds (I gather MuJoCo is even worse) @botminds no worries. I have misgivings too, no benchmark is perfect, but it's one of the most general-ish control benchmarks we have :) @botminds the training time isnt being searched for, + again, robustness to hyperparam variation = step in direction of addressing that pt @botminds I agree; + early learning is more impressive than learning after super long training (eg Neural Episodic Control = faster early) RT @quasimondo: It's training GAN! Hallelujah! @hardmaru thanks for reminding me I actually need to read this :) "Accelerating Stochastic Gradient Descent," Jain et al.: https://t.co/xso9eMZMVR "A Generalization of Convolutional Neural Networks to Graph-Structured Data," Hechtlinger et al.: https://t.co/0K9l8ymItb "From Language to Programs: Bridging Reinforcement Learning and Maximum Marginal Likelihood," Guu et al.: https://t.co/pmGA75j7uw "Friendships, Rivalries, and Trysts: Characterizing Relations between Ideas in Texts," Tan et al.: https://t.co/l7NMlRyVRp "Pre-computed Liquid Spaces with Generative Neural Networks and Optical Flow," Bonev et al. (with Android app): https://t.co/dtldtIg5NB "Multi-View Dynamic Facial Action Unit Detection," Romero et al.: https://t.co/mhtLIWESSd "Automatic Compositor Attribution in the First Folio of Shakespeare," Ryskina et al.: https://t.co/aEokkGNyAP "Explaining How a Deep NN Trained with End-to-End Learning Steers a Car," Bojarski et al., NVIDIA (w/ hint of GOOG): https://t.co/f7UjVJ8kxB "An ensemble-based online learning algorithm for streaming data," Nguyen et al.: https://t.co/4KNo6ELHBf "Spatio-temporal Person Retrieval via Natural Language Queries," Yamaguchi et al.: https://t.co/4zoQ86dhTX "On Improving Deep Reinforcement Learning for POMDPs," Zhu et al.: https://t.co/JkUDY7JLop "Deep Text Classification Can be Fooled," Liang et al.: https://t.co/8Vt9MU4QPh "Topically Driven Neural Language Model," Lau et al.: https://t.co/TyfwYa1uK2 "The loss surface of deep and wide neural networks," Nguyen and Hein: https://t.co/ENCjbbvTj1 "Riemannian Optimization for Skip-Gram Negative Sampling," Fonarev et al.: https://t.co/pJhBQneXvZ "SphereFace: Deep Hypersphere Embedding for Face Recognition," Liu et al.: https://t.co/r5xZDxdmrz "Enriching Complex Net's w/ Word Emb's for Detecting Mild Cog. Impairment from Speech Transcripts," Dos Santos et al https://t.co/sw4HgEzXVw "A Recurrent Neural Model w/ Attention for the Recognition of Chinese Implicit Discourse Relations," Ronnqvist et al https://t.co/jrA2nNxdaY "Punny Captions: Witty Wordplay in Image Descriptions," Chandrasekaran et al.: https://t.co/ikqLCQ8w27 "C-VQA: A Compositional Split of the Visual Question Answering (VQA) v1.0 Dataset," Agrawal et al.: https://t.co/C0sSpI63Wm "Predicting Financial Crime: Augmenting the Predictive Policing Arsenal," @BrianClifton_ et al.: https://t.co/y53ExmPwEq @juliagalef in any case, I agree there is such a phenomenon, just quibbling about the particular case :) @juliagalef I'd find it less/not at all funny if the machine were needed, though perhaps I also think $400 for press button vs. squeeze would be funny @juliagalef Another interpretation is that people think it's funny that the convenience gains/dollar were massively more than advertised (bc squeezable) @botminds no, I'm comparing 1 neural net + hyperparameter setting to 1 human. One can look at best-net-per-game, but that's different/not my focus @botminds So? Going from sub-X to over-X is progress. @botminds And re: hyperparams, that's part of why UNREAL is impressive (robustness to hyperparameter variation). @botminds Then call it better-than-a-particular-professional-game-tester-human. Not wedded to terminology, point is, big progress in last few years. Handmaid's Tale show is not available overseas. Sad! (actually sad, though) RT @JanelleCShane: Fun w/ @mark_riedl 's dataset of all the plot summaries in @Wikipedia : https://t.co/uAqJZ8ISBS More: https://t.co/e1XmK… "RT @mpd37: Video recordings of #DALI2017 workshop on Data-Efficient RL: https://t.co/9QKfRW2Kg8" @edersantana @jimmfleming ya, see ICLR's Facebook page @jimmfleming yep :) @nishantiam videos available on the ICLR Facebook page. Afternoon session Tuesday, 2nd to last talk (Jaderberg) RT @anderssandberg: People only understand what you mean when you say "50-50". And not always then either. https://t.co/kLEaISPcxl Mind still blown by extreme scalability of UNREAL. Didn't watch all of ICLR livestream, but that seems notable from what I did watch... @botminds I think it is reasonable for a system that isnt tailored to one game to be compared to a non specialist human @botminds we could talk about this all day (yes, it is an imperfect measure) but I am referring to Mnih et al 2015's human tester Again, if I understand Jaderberg et al. correctly, 300%+ mean + ~1500% mean demonstrated on multiple versions of same agent. 1 agent=doable. Not the slide on Montezuma's Revenge but still think superhuman this year=doable. Likewise mean/median (best agent scores shows possibility) "Multi-Task Video Captioning with Video and Entailment Generation," Pasunuru and Bansal: https://t.co/J02NmUf38H "Continuously Differentiable Exponential Linear Units," Jonathan Barron: https://t.co/R7zWVWLh6Q "Learning from Ontology Streams with Semantic Concept Drift," Lecue et al.: https://t.co/iYsnsYtUt2 "Streaming Word Embeddings with the Space-Saving Algorithm," May et al.: https://t.co/qm29nqAA09 "Real-time Teaching Cues for Automated Surgical Coaching," Malpani et al.: https://t.co/0bPiGLWP0r "A Challenge Set Approach to Evaluating Machine Translation," Isabelle et al.: https://t.co/AhPMzMKX67 "Can Saliency Information Benefit Image Captioning Models?," Tavakoli et al.: https://t.co/k4mPQ88BeH "Ruminating Reader: Reasoning with Gated Multi-Hop Attention," Gong and Bowman: https://t.co/URIupVTTWL Fortunately, there's a competition for that :) at least one... "Development of An Autonomous Bridge Deck Inspection Robotic System," La et al.: https://t.co/ZEHEcTNLqx "Prominent Object Detection and Recognition: A Saliency-based Pipeline," Tavakoli and Laaksonen: https://t.co/1FP7tRBk0V (Sidenote, not about this paper: so much on this topic lately, which are fake news?) "Some Like it Hoax: Automated Fake News Detection in Social Networks," Tacchini et al.: https://t.co/wobY7g7Ctp Looks interesting - "Learning of Human-like Algebraic Reasoning Using Deep Feedforward Neural Networks," Cai et al.: https://t.co/qetJAv69Hd "A Labeling-Free Approach to Supervising Deep Neural Networks for Retinal Blood Vessel Segmentation," Yongliang Chen https://t.co/eX1OLkyLTd "Decision Stream: Cultivating Deep Decision Trees," Ignatov and Ignatov: https://t.co/csP0fIARvk "Tapping the sensorimotor trajectory," Berthold and Hafner: https://t.co/FeUhG8hWOG "280 Birds with 1 Stone: Inducing Multiling. Taxonomies from Wikip. using Character-level Classification"Gupta et al https://t.co/mzgjQiaD3b "Joint POS Tagging and Dependency Parsing with Transition-based Neural Networks," Yang et al.: https://t.co/nqHInAnTcB "Skeleton-based Action Recognition with Convolutional Neural Networks," Li et al. - claims big improvement https://t.co/yKi4f7sb3m "Adversarial Multi-Criteria Learning for Chinese Word Segmentation," Chen et al.: https://t.co/1bKQhhxoJT "Speeding up Convolutional Neural Networks By Exploiting the Sparsity of Rectifier Units," Shi and Chu: https://t.co/SDi1hNffco "Inception Recurrent Convolutional Neural Network for Object Recognition," Alom et al.: https://t.co/9afaffbhBf "Automatic Anomaly Detection in the Cloud Via Statistical Learning," Hochenbaum et al., Twitter: https://t.co/pEBo0T8kmP "Joint Sequence Learning and Cross-Modality Convolution for 3D Biomedical Segmentation," Tseng et al.: https://t.co/kpvKCNvEmq "DeepAM: Migrate APIs with Multi-modal Sequence to Sequence Learning," Gu et al.: https://t.co/6qzCIuG47T "Introspective Generative Modeling: Decide Discriminatively," Lazarow and Jin et al.: https://t.co/CHFlW9kOEy "Introspective Classifier Learning: Empower Generatively," Jin et al.: https://t.co/6EEmNcEkpH "Unsupervised Learning of Depth and Ego-Motion from Video," Zhou et al., Google: https://t.co/8WY1WRkLsf "SfM-Net: Learning of Structure and Motion from Video," Vijayanarasimhan et al.: https://t.co/2bswjkozlg "Hand Keypoint Detection in Single Images using Multiview Bootstrapping," Simon et al.: https://t.co/HumUZf2BQj "A relevance-scalability-interpretability tradeoff with temporally evolving user personas," Panigrahi + Fawaz: https://t.co/swgZ7bsZLW "Deep Over-sampling Framework for Classifying Imbalanced Data," Ando and Huang: https://t.co/IcGvEi44c5 "Sufficient Markov Decision Processes with Alternating Deep Neural Networks," Wang et al.: https://t.co/zWgZT2UkIm "Abstract Syntax Networks for Code Generation and Semantic Parsing," Rabinovich, Stern, and Klein: https://t.co/7GzKTbDfTQ "Semi-supervised Bayesian Deep Multi-modal Emotion Recognition," Du et al.: https://t.co/SFothjehJo "Fine-Grained Entity Typing with High-Multiplicity Assignments," Rabinovich and Klein: https://t.co/xiaYyYi980 "A decentralized proximal-gradient method with net. independent step-sizes+separated convergence rates," Li et al.: https://t.co/cdbdE4taaE "Active Bias: Training a More Accurate Neural Network by Emphasizing High Variance Samples," Chang et al.: https://t.co/ziOhpPtk09 "Bootstrapping Graph Convolutional NNs for Autism Spectrum Disorder Classification," Anirudh + Thiagarajan: https://t.co/NJ7twnhJhF "Dynamic Model Selection for Prediction Under a Budget," Nan and Saligrama: https://t.co/bGoKiOpDPy "Stein Variational Gradient Descent as Gradient Flow," Qiang Liu: https://t.co/PRB3Ms4aIw "Neurogenesis+multiple plasticity mech's enhance associative mem..in a spiking NN model of the hippocampus"-Chua+Tan https://t.co/LgDk6af2x1 "Sharing deep generative representation for perceived image reconstruction from human brain activity," Du et al.: https://t.co/pMu72UwMz0 "Scalable Planning with Tensorflow for Hybrid Nonlinear Domains," Wu et al.: https://t.co/zi2MqJpQrx https://t.co/6JJwvXwnvS RT @abursuc: There's an error in my tweet: performance of 2 hrs until superhuman level is actually for 3D maze navigation, not Montezuma #i… "Molecular De Novo Design through Deep Reinforcement Learning," Olivecrona et al.: https://t.co/TdZvPltkPP @_jyan_ lol no @iandanforth UNREAL is described here (https://t.co/TGWvGTqyoL) but I don't think there's a paper on the scale-up (yet). RT @royalsociety: What are the potential socio-economic impacts of #machinelearning over the next decade? Report: https://t.co/8bNj4L25Qz… @botminds @IgorCarron @maxjaderberg recent progress still impressive if you filter for that (e.g. Montezuma which Max discussed) I said there would be >120% by the end of the year - looks like it's pretty close :) https://t.co/vhnkCyXJvR @maxjaderberg In any case, also some interesting stuff in the talk on scaling UNREAL to many workers, comparison to ev. strategies, etc. https://t.co/A8GtbqkR21 @maxjaderberg If I understand paper (talk didn't discuss figure at length), 250% is median for 1 agent, 331%=best agent score for each game? @maxjaderberg @maxjaderberg at #ICLR2017 on UNREAL + Atari - fits well with my forecasts, though I think (per paper), this is diff. hyperparams per game? https://t.co/R01N1keqvh RT @demishassabis: Really enjoyed writing this article on AI's transformative potential for scientific discovery for @FTMag #MastersofScien… RT @Recode: Google is updating its search to demote fake news https://t.co/wn0AdlCjid https://t.co/BYSjTZ2GOr RT @coreylynch: Result of a very fun @GoogleBrain residency: Self-supervised robotic imitation of human motion https://t.co/IGZogw3abl http… https://t.co/OdGAeH8Bmw "Deep Learning for Content-Based, Cross-Modal Retrieval of Videos and Music," Hong et al.: https://t.co/bx7MUS2pEz "Sarcasm SIGN: Interpreting Sarcasm with Sentiment Based Monolingual Machine Translation," Peled and Reichart: https://t.co/zq7yCusd1W "ScaleNet: Guiding Object Proposal Generation in Supermarkets and Beyond," Qiao et al.: https://t.co/HyQnvN4ac6 "Towards Distributed Machine Learning in Shared Clusters: A Dynamically-Partitioned Approach," Sun et al.: https://t.co/xdPkrP3Hgz "Batch-Expansion Training: An Efficient Optimization Paradigm for Machine Learning," Derezinski et al.: https://t.co/1XiF9epEeF "On Face Segmentation, Face Swapping, and Face Perception," Nirkin et al.: https://t.co/4X2PGN2neq "Distant Supervision for Topic Classification of Tweets in Curated Streams," Mohammed et al.: https://t.co/03vNPxEPdQ "SREFI: Synthesis of Realistic Example Face Images," Banerjee et al.: https://t.co/BVjfrX7BtA "Multi-Objective Deep Q-Learning with Subsumption Architecture," Tomasz Tajmajer: https://t.co/rfvONDElTh "A Review on Deep Learning Techniques Applied to Semantic Segmentation," Garcia-Garcia et al.: https://t.co/fu827nUiEH "Deep Multitask Learning for Semantic Dependency Parsing," Peng et al.: https://t.co/7lFUYcFiar "Large-Scale Sleep Condition Analysis Using Selfies from Social Media," Peng et al.: https://t.co/0zSaFnLiD7 "Affect-LM: A Neural Language Model for Customizable Affective Text Generation," Ghosh et al.: https://t.co/PFiMgCOkw7 "Medical Text Classification using Convolutional Neural Networks," Hughes et al.: https://t.co/V0XvmdnNdB "Time-Contrastive Networks: Self-Supervised Learning from Multi-View Observation," Sermanet and @coreylynch et al.: https://t.co/jgw3dEZQiA "Misspecified Linear Bandits," Ghosh et al.: https://t.co/KwOZ2Pq0GH "Deep Keyphrase Generation," Meng et al.: https://t.co/VfHw4nzZHT "Learning to Skim Text," Yu et al., Google: https://t.co/HlHd0Uve54 "Argument Mining with Structured SVMs and RNNs,"Niculae et al.: https://t.co/mehLfqusV2 "Turing at SemEval-2017 Task 8: Sequential Approach to Rumour Stance Classification w/ Branch-LSTM," Kochkina et al https://t.co/FiP6UlfZGa "What is the Essence of a Claim? Cross-Domain Claim Identification," Daxenberger et al.: https://t.co/1TKtODIbmt "FilteredWeb: A Framework for the Automated Search-Based Discovery of Blocked URLs," Darer et al.: https://t.co/S9cPSo5ZTb "RL Based Dynamic Selection of Auxiliary Objectives with Preserving of the Best Found Solution," Petrova+Buzdalova: https://t.co/7O0LITWTEy "Semi-supervised Multitask Learning for Sequence Labeling," Marek Rei: https://t.co/WZq8Xaj0gQ "Found in Translation: Reconstructing Phylogenetic Language Trees from Translations," Rabinovich et al.: https://t.co/btw0O9RTpc "Dense 3D Facial Reconstruction from a Single Depth Image in Unconstrained Environment," Zhang et al.: https://t.co/r9Dp8OYS6S "Learning Symmetric Collaborative Dialogue Agents with Dynamic Knowledge Graph Embeddings," He et al.: https://t.co/HcdGxVOQYr "An Analysis of Action Recognition Datasets for Language and Vision Tasks," Gella and Keller: https://t.co/0ANsVFO7rk "Compositional abstraction and safety synthesis using overlapping symbolic models," Meyer et al.: https://t.co/UFGHwkzmWD "Being Negative but Constructively: Lessons Learnt from Creating Better VQA Datasets," Chao et al.: https://t.co/hXIx4AvWqU "Robust Incremental Neural Semantic Graph Parsing," Buys and Blunsom: https://t.co/FATwz27dpS "Analysis of Vanilla Rolling Horizon Evolution Parameters in General Video Game Playing," Gaina et al.: https://t.co/vCLNs1OKlr "Selective Encoding for Abstractive Sentence Summarization," Zhou et al.: https://t.co/ssvj1fV4Hl "k-FFNN: A priori knowledge infused Feed-forward Neural Networks," Dumpala et al.: https://t.co/oFYKBdq17x "Fast and Accurate Neural Word Segmentation for Chinese," Cai et al.: https://t.co/4kz2Dt0yQ7 "Learning to Create and Reuse Words in Open-Vocabulary Neural Language Modeling," Kawakami et al.: https://t.co/KtpHeCG956 "Skeleton Key: Image Captioning by Skeleton-Attribute Decomposition," Wang et al.: https://t.co/sJqhiYqsQI "Differentiable Scheduled Sampling for Credit Assignment," Goyal et al.: https://t.co/IlNnqCcQJz "General Video Game AI: Learning from Screen Capture," Kunanusont et al.: https://t.co/QC8M1j8XSW "Population Seeding Techniques for Rolling Horizon Evolution in General Video Game Playing," Gaina et al.: https://t.co/twc7rrwZZM "A* CCG Parsing with a Supertag and Dependency Factored Model," Yoshikawa et al.: https://t.co/e78IwwYjlP "Second-order Temporal Pooling for Action Recognition," Cherian and Gould: https://t.co/b42mxSQKaN "Neural Machine Translation via Binary Code Prediction," Oda et al.: https://t.co/TN7Jfg5yEG "Learning weakly supervised multimodal phoneme embeddings," Chaabouni et al.: https://t.co/U8fbwrhYfG "Residual Attention Network for Image Classification," Wang et al.: https://t.co/3rnhWi29wE "Measuring the Accuracy of Object Detectors and Trackers," Bottger et al.: https://t.co/FBnQfefzbp "Joint Modeling of Text and Acoustic-Prosodic Cues for Neural Parsing," Tran et al.: https://t.co/dJpPeZTVo3 "Supervised Adversarial Networks for Image Saliency Detection," Pan and Jiang: https://t.co/Q0PXhTVtmX (somehow I missed that Kaiming He is at Facebook now... ) "Detecting and Recognizing Human-Object Interactions," Gkioxari et al., Facebook: https://t.co/xc9KwVypBQ "Stochastic Constraint Programming as Reinforcement Learning," Prestwich et al.: https://t.co/DRM6vV6XaT "Scatteract: Automated extraction of data from scatter plots," Cliche et al.: https://t.co/iobiXIR2B5 "Geometric Matrix Completion with Recurrent Multi-Graph Neural Networks," Monti et al.: https://t.co/96R1BrCCs3 "Adversarial Neural Machine Translation," Wu et al.: https://t.co/0ANKD9Spuf "Robust, Deep and Inductive Anomaly Detection," Chalapathy et al.: https://t.co/CBccf0TSqz "Asynchronous Distributed Variational Gaussian Processes," Peng et al.: https://t.co/PYvKYnIGAg "A Neural Network model with Bidirectional Whitening," Fujimoto and Ohira: https://t.co/fKhY28a7ud Still have a lot more to share, but just flagging those up front. Also: gonna skip ACL stuff I don't get, + some medical stuff (too much). 2. "Translating Neuralese," Andreas et al.: https://t.co/RfQJHWYXnE Two of the coolest papers tonight - 1.: "Naturalizing a Programming Language via Interactive Learning," Wang et al.: https://t.co/zJtUBz3JKe @uwnlp lots of ACL stuff @mat_kelcey the gods of AI are trying to make those of us who aren't at ICLR feel better about missing the parties, keeping us busy tonight... Wild night on arXiv tonight. "RT @rossgoodwin: Some early results from an LSTM I'm training on @mark_riedl's WikiPlots corpus of every plot summary on @Wikipedia https:…" @RobWortham theyre the subset of papers that I think are potentially important/interesting 2 followers. Don't read all, at least skim though RT @goodfellow_ian: #iclr2017 at 4:30 PM, come check out poster C16, "Adversarial Machine Learning at Scale" https://t.co/eVsjcgVeng https:… @ArtirKel yes, I just got to the intonation part. Of that set, I thought Trump was best. The Obama voice seems better than the Trump/Clinton ones to me... more data? https://t.co/lQIMoBikYD @Aelkus *nope @Aelkus now e RT @rivatez: paying tribute to @hubertdreyfus , thank you for everything. https://t.co/3rGZhevoLU On the bright side, I'm glad they're wasting their advertising money on me. 🙄 https://t.co/3O7UoI1M8q "Bandit Structured Prediction for Neural Sequence-to-Sequence Learning," Kreutzer et al.: https://t.co/GwxNML8E2z "Accurately + Efficiently Interpreting Human-Robot Instructions of Varying Granularities," Arumugam/Karamcheti et al https://t.co/NjYEHdRMQG "Making Neural Programming Architectures Generalize via Recursion," Cai et al.: https://t.co/8YBh1FpwoQ one of the Best Paper Awards at ICLR "Attention Strategies for Multi-Source Sequence-to-Sequence Learning," Libovický and Helcl: https://t.co/3ghLvEdCOE "Attend to You: Personalized Image Captioning with Context Sequence Memory Networks," Park et al.: https://t.co/DSRCqo9Sbe "Road to safe autonomy with data and formal reasoning," Fan et al.: https://t.co/gRZNeTfbuB "Neural System Combination for Machine Translation," Zhou et al.: https://t.co/kxLff3qFIj "Hierarchical 3D fully convolutional networks for multi-organ segmentation," Roth et al.: https://t.co/OT8w5c8YXD "Improving Context Aware Language Models," Jaech and Ostendorf: https://t.co/OtegVAlxEj "A data set for evaluating the performance of multi-class multi-object video tracking," Chakraborty et al.: https://t.co/SxkPzAd3Zu "Robust Multi-view Pedestrian Tracking Using Neural Networks," Alom and Taha: https://t.co/ShIFUQGdyD "NormFace: L2 Hypersphere Embedding for Face Verification," Wang et al.: https://t.co/2ZGnVsagsE "SwellShark: A Generative Model for Biomedical Named Entity Recognition without Labeled Data," Fries et al.: https://t.co/sXQpZwouSo "Deep Clustering via Joint Convolutional Autoencoder Embedding and Relative Entropy Minimization," Dizaji et al.: https://t.co/DiaQMBh9mc "Efficient Gender Classification Using a Deep LDA-Pruned Net," Tian et al.: https://t.co/MX8jprWQ0S "A Reinforcement Learning Approach to Weaning of Mechanical Ventilation in Intensive Care Units," Prasad et al.: https://t.co/upAEmFQiGb "Equivalence Between Policy Gradients and Soft Q-Learning," Schulman et al., OpenAI/Berkeley: https://t.co/sw6Y8oAWWe "Entropy-SGD: Biasing Gradient Descent Into Wide Valleys," Chaudhari et al.: https://t.co/aku7q0fKXu "Hard Mixtures of Experts for Large Scale Weakly Supervised Vision," Gross et al., FB: https://t.co/W5AiiUbYjP "Learned D-AMP: A Principled CNN-based Compressive Image Recovery Algorithm," Metzler et al.: https://t.co/8UHCYWQVSm "Mutual Information, Neural Networks and the Renormalization Group," Koch-Janusz and Ringel: https://t.co/izWMARFdcM "Feed-forward approximations to dynamic recurrent network architectures," Dylan Muir: https://t.co/YAdhog0nkh @Brett_Fujioka I dunno who they is. Distill has good stuff for neural nets/some other ML stuff... I.e. would also be cool to see such things for search, planning, logic, etc. Big fan of this. Would love to see it for AI (Distill is great/in that general spirit, but not a broad-based intro). https://t.co/YipwF3sefX RT @dnvolz: Wow. Uber secretly tracked users after they deleted app. Tim Cook found out, threatened Kalanick w/ App Store deletion until Ub… @Aelkus Ashley Madison was close. @iandanforth dunno, maybe ask @iclr2017 @ankurhandos I got a fair amount of no's when it should actually be no (though also inaccurate no's) Lol, this is pretty fun to play with. Quite hit or miss. https://t.co/RdAS1To4KJ https://t.co/qA8v2d4Zym "RT @DhruvBatraDB: Visual Dialog: Code, demo, code for demo. And that's where the recursion stops :-). Nice work team! https://t.co/RuwjcQ…" There is livestreaming, though! I'm not cool enough to be at ICLR :( RT @erichorvitz: Harnessing deep learning to do program synthesis https://t.co/6hd2quxNhG Interesting & promising step in AI. @MSFTResearch… @drkatedevlin ooo I'll have to check it out, thanks :) @chrisalbon you make the best food. RT @willmacaskill: Because gravity slows down time, the earth's core is 2.5 years younger than its surface. https://t.co/AvkREEbWTi "Recommendations for you in books" is the only section that seems to fulfill its own promise... Overfitting? (maybe) I've looked at everything in the space of things I'm interested? (unlikely) I don't understand what those phrases mean? Why is "Related to items you've viewed" on Amazon just stuff I've viewed, and "Inspired by your browsing history"=*mostly* browsed stuff? @AMP_SV damn. I lol'd, too perfect RT @HrSaghir: 8 of 10 people on the team that built Google's TPU have left to form Groq inc. with 10 M VC backing https://t.co/Jxa5u74e07 There was earlier work in 2015 on SOC, but I think just bot vs. bot. In this case, DRL bot beats humans. CC @polynoamial (in Settlers of Catan) https://t.co/F4ytZTy6Yx "Evaluating Persuasion Strategies and Deep RL methods for Negotiation Dialogue agents," Keizer et al.: https://t.co/Eb4ETz9wtu "Knowledge Transfer for Deep Reinforcement Learning with Hierarchical Experience Replay," Yin and Pan, NTU Singapore https://t.co/T4s5DnGdoW "Supervised ML Algorithms Can Classify Open-Text Feedback of Doctor Performance With Human-Level Accuracy"Gibbons ea https://t.co/4yGdxf2Zb1 @Aelkus Newell, I think. Never gotten around to reading it, though. "RT @RexDangerSeeker: Just closed the wifi-enabled Gateradero®'s* $200m A Round with @kpcb @alphabetincUS @Gatorade. DM for B Round info *n…" RT @mat: Exclusive look at one of the pods for Juicero's new $700 seltzer machine https://t.co/De2LgeuGCQ @AMP_SV and squeeze fruits amd vegetables by hand. SAD! RT @JesseJenkins: ZERO funding opportunities posted by DOE's offices of Fossil, Nuclear, or Energy Efficiency & Renewable Energy or ARPA-E… RT @JesseJenkins: Funding for new #energy #research at Dept of @Energy has slowed under Trump: https://t.co/MDF2Y9uVCE Not good for America… RT @googleresearch: A blend of computer vision and image processing techniques allows PhotoScan to take glare-free pictures of pictures htt… TFW you don't want to look at the camera but the GAN wants you to... https://t.co/8InFDX19s5 https://t.co/Sb8v9U9bmo "Dynamic Graph Convolutional Networks," Manessi et al.: https://t.co/E7oI32FCx5 "Segmentation of the Proximal Femur from MR Images using Deep Convolutional Neural Networks," Deniz et al.: https://t.co/riri9E8syM "Learning to Acquire Information," Pu et al.: https://t.co/ao45Ary0zq "Knowledge Fusion via Embeddings from Text, Knowledge Graphs, and Images," Thoma et al.: https://t.co/7HtrbpsbV9 "Predicting Cognitive Decline with Deep Learning of Brain Metabolism and Amyloid Imaging," Choi and Jin: https://t.co/c00na5hlOL "Performance Limits of Stochastic Sub-Gradient Learning, Part II: Multi-Agent Case," Ying and Sayed: https://t.co/mVThc5HlXi "Every Untrue Label is Untrue in its Own Way: Controlling Error Type with the Log Bilinear Loss," Resheff et al.: https://t.co/oj5CYO6CUK "Fast Generation for Convolutional Autoregressive Models," Ramachandran et al: https://t.co/8tplwR9xys 21x+183x speedup 4 WaveNet+PixelCNN++ "Semi-supervised classification for dynamic Android malware detection," Chen et al., Intel: https://t.co/pktvcoHpLg "Retrospective Higher-Order Markov Processes for User Trails," Wu and Gleich: https://t.co/E36Xay2qxl "BB_twtr at SemEval-2017 Task 4: Twitter Sentiment Analysis with CNNs and LSTMs," Mathieu Cliche: https://t.co/8SvlJddisy "SAFS: A Deep Feature Selection Approach for Precision Medicine," Nezhad et al.: https://t.co/dZl3PViwj7 "Monte Carlo Tree Search with Sampled Information Relaxation Dual Bounds," Jiang et al.: https://t.co/hYLPwOXz6X "End-to-End Multi-View Networks for Text Classification," Guo et al.: https://t.co/bHNHXQQM7r "An Interpretable Knowledge Transfer Model for Knowledge Base Completion," Xie et al.: https://t.co/smWcVb3wiM "Global Relation Embedding for Relation Extraction," Su and Liu et al.: https://t.co/HFk8AWlu56 "SemEval-2017 Task 8: RumourEval: Determining rumour veracity and support for rumours," Derczynski et al.: https://t.co/EcI7mDmKM8 "Call Attention to Rumors: Deep Attention Based Recurrent Neural Networks for Early Rumor Detection," Chen et al.: https://t.co/YNvv857Kik "Cross-domain Semantic Parsing via Paraphrasing," Su and Yan: https://t.co/scb7NoduQk "BranchConnect: Large-Scale Visual Recognition with Learned Branch Connections," Ahmed and Torresani: https://t.co/LouetIv1Dy "Enhancing Person Re-identification in a Self-trained Subspace," Yang et al.: https://t.co/bTLBmsvDsG @adam_will_do_it Spoiler: correlation is >0 "Understanding the Mechanisms of Deep Transfer Learning for Medical Images," Ravishankar et al., GE: https://t.co/lqBniJd0QX "End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Network," de Vos et al.: https://t.co/ssl83B2gWC "Neural End-to-End Learning for Computational Argumentation Mining," Eger et al.: https://t.co/0APxRqs4e8 "Exploring epoch-dependent stochastic residual networks," Carrara et al.: https://t.co/cvyXZl0n11 "End-to-end representation learning for Correlation Filter based tracking," Valmadre and Bertinetto et al., Oxford: https://t.co/CF3t4A0Cx1 "Softmax GAN," Min Lin: https://t.co/PqFskgPPGn "Improved Neural Relation Detection for Knowledge Base Question Answering," Yu et al., IBM: https://t.co/LPqc5HUFlG "A Nuclear-norm Model for Multi-Frame Super-Resolution Reconstruction from Video Clips," Zhao and Chan: https://t.co/2wujUWqjPA "RL with External Knowledge and Two-Stage Q-functions for Predicting Popular Reddit Threads," He et al.: https://t.co/q6C7vxH1hI "Temporal Action Detection with Structured Segment Networks," Zhao et al.: https://t.co/pRS4yiAaSx "Towards Large-Pose Face Frontalization in the Wild," Yin et al.: https://t.co/9CUmoXn2Mm ^ with GANs @tdietterich But, not sure. @tdietterich I suspect we are in it or just passed it, due to all the ICLR and ICML submissions. Maybe a new hype cycle for NIPS 2017? The GANcast for today is: 2 new GANs. RT @waitbutwhy: It's finally here: the full story on Neuralink. I knew the future would be nuts but this is a whole other level. https://t.… RT @cvondrick: amazing generations of the video future! Red border means output, green is input. https://t.co/PByeC0rtnQ https://t.co/LaHm0… RT @GaryMarcus: Commonsense reasoning with radically incomplete information.By Ernie Davis @GaryMarcus N. Frazier-Logue @NYUScience https:… @dennybritz personal assistants, domestic robots could have a big impact, but tech not there yet. @guicho271828 @fchollet it was an April Fool's joke. Don't think too hard about it :) RT @Jackstilgoe: Can anyone point me to proper academic explorations of the "Is Google making us dumb?" question? Links between tech and hu… @Jackstilgoe not aware of anything very academic but I'll RT to help :) @Jackstilgoe the late Daniel Wegner had some studies on this https://t.co/lrC2T5MHWs @fchollet but a human standing on the building will always be taller... https://t.co/FGJCkj4rMf "RT @mark_riedl: 110k+ story plots from English Wikipedia for your (neural net’s) reading pleasure https://t.co/HVbAM5MW6H (plus code to do…" RT @LeverhulmeCFI: Join us on 18 May to hear @AlisonGopnik on the differences between adult & child learning (surprising results!) https:… RT @adschina: Behind veil of Chinese white-hat hackers https://t.co/4Hj1Inw2jR Butian has 30k registered hackers, 60% born after 1990 RT @cjack: Marie Hicks is talking abt https://t.co/MApqfxJd9w today at 4 at @datasociety! 💻 🎉 Free tix details (+ livestream): https://t.co… RT @allenai_org: New #NLP and Vision techniques will be needed to tackle the challenges introduced by our new TQA dataset. Learn more https… Big improvement on standardized test taking (though still far from unsolved) from AI2 folks. https://t.co/H9QrUmDYeg Lots of good data on historical progress here... cc @jackclarkSF Pretty good results: https://t.co/UZGzzG2EQY "Importance Sampled Stochastic Optimization for Variational Inference," Sakaya and Klami: https://t.co/zJ7xxPEV0b "Universal Adversarial Perturbations Against Semantic Image Segmentation," Metzen et al.: https://t.co/y8usGN25gt "Noise-Tolerant Interactive Learning from Pairwise Comparisons with Near-Minimal Label Complexity," Xu et al.: https://t.co/xq6L9fsvZ3 "Deterministic Quantum Annealing Expectation-Maximization Algorithm," Miyahara et al.: https://t.co/W0fSCIb90E "Deep Occlusion Reasoning for Multi-Camera Multi-Target Detection," Baque et al.: https://t.co/UsALJMxqm5 "Accurate Single Stage Detector Using Recurrent Rolling Convolution," Ren et al., SenseTime: https://t.co/PPdQPlX8h9 "Redefining Context Windows for Word Embedding Models: An Experimental Study," Lison and Kutuzov: https://t.co/504uQqu1YY "Simultaneous Policy Learning and Latent State Inference for Imitating Driver Behavior," Morton and Kochenderfer: https://t.co/LQXku6Rmh6 "Network Dissection: Quantifying Interpretability of Deep Visual Representations," Bau and Zhou et al.: https://t.co/8xeZOSKfnT "Learn to Model Motion from Blurry Footages," Li et al.: https://t.co/2o9yua21I5 Looks good - "Learning to Generate Long-term Future via Hierarchical Prediction," Villegas et al.: https://t.co/g7Yg5fwK8F "Generative Face Completion," Li et al.: https://t.co/w9r5kO21Ro "The True Destination of EGO is Multi-local Optimization," Wessing and Preuss: https://t.co/GWgT5TdT7T "Making Sense of Unstructured Text Data," Li et al.: https://t.co/BTagLVcLOZ "Computer Vision for Autonomous Vehicles: Problems, Datasets and State-of-the-Art," Janai et al.: https://t.co/tpOJbL0rep "Learning to Reason: End-to-End Module Networks for Visual Question Answering," Hu et al.: https://t.co/Lys9XGJ5u2 nearly 50% < error v SOTA "Beating Atari with Natural Language Guided Reinforcement Learning," Kaplan, Sauer, and Sosa: https://t.co/5L9VzG7HMv "Annotating Object Instances with a Polygon-RNN," Castrejon et al.: https://t.co/7lHXnvQyGc "Extractive Summarization: Limits, Compression, Generalized Model and Heuristics," Verma and Lee: https://t.co/LUucBelkP0 "Discovering Evolutionary Stepping Stones through Behavior Domination," Meyerson and Miikkulainen: https://t.co/Ju3KVD4oNf "Answering Complex Questions Using Open Information Extraction," Khot et al.: https://t.co/DuWTsTV7H4 "already being integrated into ... system widely used by US law enforcement agencies to combat human trafficking" 👍 https://t.co/4yOvQpYkfJ "Using Contexts and Constraints for Improved Geotagging of Human Trafficking Webpages," Kapoor et al.: https://t.co/f5aE98e2wr "A Large Self-Annotated Corpus for Sarcasm," Khodak et al.: https://t.co/FXtIhDf95D """Learning to Fly by Crashing,"" Gandhi et al.: https://t.co/PAsbl8bKuR https://t.co/LbUYjdqh1P" "Stochastic Gradient Twin Support Vector Machine for Large Scale Problems," Wang et al.: https://t.co/bJXKmIM4vz "Skeleton Boxes: Solving skeleton based action detection with a single deep CNN," Li et al.: https://t.co/chIXifryms "Skeleton based action recognition using translation-scale invar. image mapping and multi-scale deep cnn," Li et al: https://t.co/OyxfweH4Hc "Effects of the optimisation of the margin distribution on generalisation in deep architectures," Szymanski et al.: https://t.co/c2uZyyT7A1 "CNN based music emotion classification," Liu et al.: https://t.co/KyEDna301o TFW your algorithm's (DANN - pic here) emoji generation skills are deemed non-competitive compared to the new stuff: https://t.co/1cwVUDpVpD https://t.co/Bri1POOwDg "Unsupervised Creation of Parameterized Avatars," Wolf et al., Facebook/Tel Aviv: https://t.co/o3qIRvwsyR https://t.co/CLNawu09eZ "On Measuring Bias in Online Information," Pitoura et al.: https://t.co/76Kuv32W9p "Learning Video Object Segmentation with Visual Memory," Tokmakov et al.: https://t.co/CgZ0t3yvxO "Adversarial Multi-task Learning for Text Classification," Liu et al.: https://t.co/gfK8CcJGMP "Understanding Task Design Trade-offs in Crowdsourced Paraphrase Collection," Jiang et al.: https://t.co/P6rSDybeyB Another possible stage 4 is "Let's gather some data." But maybe that's stage 5, or the shrug is stage 5 depending on how that goes. Stages of AI progress enlightenment. Semi-serious... https://t.co/rZVJXT2yTO RT @maidylm: Our recent paper on leveraging automated planning techniques to improve crowsourced planning #humansintheloop #humanMachineCol… RT @ryan_t_lowe: Announcing the 'Conversational Intelligence Challenge' at NIPS 2017! Submit chatbots that can hold convos about news artic… RT @goodfellow_ian: Nice comparison of differentially private ML benchmarks put together by @npapernot to track state of the art: https://t… RT @cvondrick: Unsupervised Learning by Predicting Noise by Bojanowski and Joulin. Cool yet simple idea that works quite well!! https://t.c… RT @DeepMindAI: We've open sourced the Differentiable Neural Computer! Built with #Sonnet and #TensorFlow. Available here: https://t.co/sJr… @EricBattenberg not all of them, I look at them first/don't look at non-AI stuff :) @_jyan_ yeah...this was probably also written a while ago, but still... @kovasb @ra @timsgardner First publication: Rectal Probe Insertion with Deep Reinforcement Learning? RT @kchonyc: recommended to read together with https://t.co/SrGtU8RyWS by @tarfandy and others https://t.co/RF8RbsUU9T "A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference," Williams et al.: https://t.co/cGGPt5BBFQ "An Empirical Analysis of NMT-Derived Interling Embeddings...Use in Parallel Sent. Identification"España-Bonet et al https://t.co/cdsx7EvcbX "A Study of Deep Learning Robustness Against Computation Failures," Vialatte and Leduc-Primeau: https://t.co/JofyAYvYxa "Representing Sentences as Low-Rank Subspaces," Mu et al.: https://t.co/vtVaOxY9La "Baselines and test data for cross-lingual inference," Agic and Schluter: https://t.co/ugAYEzmyBU "Semantic Similarity from Natural Language and Ontology Analysis," Harispe et al.: https://t.co/uFqdfQGHhw (book preprint) "Peer Truth Serum: Incentives for Crowdsourcing Measurements and Opinions," Faltings et al.: https://t.co/T9fb81ZK9E "Sentiment analysis based on rhetorical structure theory: Learning deep NNs from discourse trees," Kraus/Feuerriegel https://t.co/lWckZn11ti "Deep Self-Taught Learning for Weakly Supervised Object Localization," Jie et al., Tencent/NU Singapore: https://t.co/p0l7eIQjB7 "SearchQA: A New Q&A Dataset Augmented with Context from a Search Engine," Dunn et al.: https://t.co/pEaIAlaHBF "Video Object Segmentation using Supervoxel-Based Gerrymandering," Griffin and Corso: https://t.co/kQsiuW7zGR "Stein Variational Autoencoder," Pu et al.: https://t.co/EoajQm6HPp "On Predicting Geolocation of Tweets using Convolutional Neural Networks," Huang and Carley: https://t.co/jtcuJS21WA "The Emergence of Canalization and Evolvability in an Open-Ended, Interactive Evolutionary System," Huizinga et al.: https://t.co/s3S8qVcQQi "Exploring Sparsity in Recurrent Neural Networks," Narang et al., Baidu: https://t.co/qhDP77ZTi1 (they had another related paper not that long ago)...for real, though, this is a serious issue if people are using these this for real stuff This guy really has it out for this API :) - "Google's Cloud Vision API Is Not Robust To Noise," Hosseini et al.: https://t.co/YRJEappHVM "O^2 TD: (Near)-Optimal Off-Policy TD Learning," Liu et al.: https://t.co/Lm909D2Lgc "Understanding Negations in Information Processing: Learning from Replicating Human Behavior," Prollochs et al.: https://t.co/16guWgf4sP "Diagonal RNNs in Symbolic Music Modeling," Subakan et al.: https://t.co/w41Nek24ez "Does Neural Machine Translation Benefit from Larger Context?," Jean/Lauly/Firat/@kchonyc: https://t.co/itHmbrQ44a "Learning Piece-wise Linear Models from Large Scale Data for Ad Click Prediction," Gai et al., Alibaba etc.: https://t.co/FCpMA2Jp6f "Stein Variational Adaptive Importance Sampling," Han and Liu: https://t.co/Wi4sxgik09 "Unsupervised Learning by Predicting Noise," Bojanowski and Joulin, Facebook: https://t.co/TAWq1NJ0dO RT @shakir_za: Announcing the Deep Learning Indaba; to stimulate participation of fellow Africans in Machine Learning. Help spread the word… "Improving Object Detection With One Line of Code," Bodla et al.: https://t.co/dMQdG9NRom "Multi-View Image Generation from a Single-View," Zhao et al.: https://t.co/Fb9CssfmHg "Gang of GANs: Generative Adversarial Networks with Maximum Margin Ranking," Juefei-Xu et al.: https://t.co/woxJJoGOXV "MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications," Howard et al.: https://t.co/sjHLUNSPBy "A Neural Architecture for Generating Natural Language Descriptions from Source Code Changes," Loyola et al.: https://t.co/8nkUo6sFQx "Setting Up Pepper For Autonomous Navigation And Personalized Interaction With Users," Perera et al.: https://t.co/ZqLf0mFUY7 "Harvesting Multiple Views for Marker-less 3D Human Pose Annotations," Pavlakos et al.: https://t.co/aRMMOx2dNu "AnchorNet: A Weakly Supervised Network to Learn Geometry-sensitive Features For Semantic Matching," Novotny et al.: https://t.co/Xvm6GQf0bp "Towards String-to-Tree Neural Machine Translation," Aharoni and @yoavgo: https://t.co/nHUWVu941r "Learn-Memorize-Recall-Reduce A Robotic Cloud Computing Paradigm," Liu et al.: https://t.co/6lJoYsdCxO "A Comprehensive Review of Smart Wheelchairs: Past, Present and Future," Leaman and La: https://t.co/2pWauKqcOu "Video Fill In the Blank using LR/RL LSTMs with Spatial-Temporal Attentions," Mazaheri et al.: https://t.co/qt2VXxYwnY "RACE: Large-scale ReAding Comprehension Dataset From Examinations," Lai et al.: https://t.co/qOuIeZ63hQ "Graph Convolutional Encoders for Syntax-aware Neural Machine Translation," Bastings et al.: https://t.co/JpbbUnIe6f "Temporal Action Localization by Structured Maximal Sums," Yuan et al.: https://t.co/c0zpZy7LiB "NEXT: A Neural Network Framework for Next POI Recommendation," Zhang et al.: https://t.co/xHvlsMs1nF "Neural Paraphrase Identification of Questions with Noisy Pretraining," Tomar et al.: https://t.co/3C2nMShoar "User-transparent Distributed TensorFlow," Vishnu et al.: https://t.co/LzOOjOSXHH "Distributional model on a diet: One-shot word learning from text only," Wang et al.: https://t.co/0VfODXu5Dv "Cross-lingual Abstract Meaning Representation Parsing," Damonte and Cohen: https://t.co/d1TC4Viv09 "Neural Extractive Summarization with Side Information," Narayan et al.: https://t.co/iwznqEaMzb "Translation of Patent Sentences with a Large Vocabulary of Technical Terms Using NMT," Long et al.: https://t.co/pGm3Ho7YXf "Neural Machine Translation Model with a Large Vocabulary Selected by Branching Entropy," Long et al.: https://t.co/FmxbiuW9et "ShapeWorld - A new test methodology for multimodal language understanding," Kuhnle and Copestake: https://t.co/Mn0t4RKdEP "Interpretable 3D Human Action Analysis with Temporal Convolutional Networks," Kim and Reiter: https://t.co/INHCIlEO5J "Sparse Communication for Distributed Gradient Descent," Aji and Heafield: https://t.co/cKHMWtcKZU "End-to-end 3D face reconstruction with deep neural networks," Dou et al.: https://t.co/Dq87pNDmed "CNN Feature boosted SeqSLAM for Real-Time Loop Closure Detection," Bai et al.: https://t.co/k8XzTVa9Qk "Probabilistic programs for inferring the goals of autonomous agents," Cusumano-Towner et al.: https://t.co/atc3sQlxr3 "Adversarial and Clean Data Are Not Twins," Gong et al.: https://t.co/mYKTFobR5X "Introspection: Accelerating Neural Network Training By Learning Weight Evolution," Sinha et al.: https://t.co/I9UUUgzrNl "AMTnet: Action-Micro-Tube regression by end-to-end trainable deep architecture," Saha et al.: https://t.co/isTpoRPNHq "Deep Relaxation: partial differential equations for optimizing deep neural networks," Chaudhari et al.: https://t.co/0n6IdvbQPT "Deep Joint Entity Disambiguation with Local Neural Attention," Ganea and Hofmann: https://t.co/oTlO13AVpc "Multimodal Prediction and Personalization of Photo Edits with Deep Generative Models," Saeedi et al.: https://t.co/k72gCbI1ZX "Big Universe, Big Data: Machine Learning and Image Analysis for Astronomy," Kremer et al.: https://t.co/rPUarEjOq3 "The Effect of Learning Rates Enjoyed by Stochastic Optimization with Progressive Variance Reduction," Fanhua Shang: https://t.co/xXztIDNZkY "Morpheo: Traceable Machine Learning on Hidden data," Galtier and Marini: https://t.co/z9JmGHillQ Like Numerai but for other data... "Deep Learning Based Regression and Multi-class Models for Acute Oral Toxicity Prediction," Xu et al.: https://t.co/t6ifzTvsFQ "k-Means is a Variational EM Approximation of Gaussian Mixture Models," Lücke and Forster: https://t.co/qhWoLNUzQu RT @DeepMindAI: Reactor: a new off-policy actor-critic DeepRL agent. Sample and numerical efficient, achieving SOTA on Atari 2600 https://t… RT @gneubig: New #ACL2017 paper on teaching neural nets to read Chinese, Japanese, and Korean from pixels!: https://t.co/7FlPE4zL81 https:/… AI for Social Good Summer Lab at McGill - opportunity for women getting into AI, deadline April 21: https://t.co/TjJAngTWaU Lots of stuff on arXiv tonight even by my standards - will tweet some of the rest tomorrow :) In addition to the new architecture, interesting evaluation here (using Elo scores): https://t.co/qsT1RakO0C "Effective Warm Start for the Online Actor-Critic Reinf. Learning based mHealth Intervention," Zhu at al., UMich: https://t.co/i75kgAVnlj "The Reactor: A Sample-Efficient Actor-Critic Architecture," Gruslys et al., DeepMind: https://t.co/bRiLM7vwNK "MUSE: Modularizing Unsupervised Sense Embeddings," Lee and Chen: https://t.co/3QmTufhinV "Task-Oriented Query Reformulation with Reinforcement Learning," Nogueira and @kchonyc: https://t.co/qKO62JMOkc It's RL night on arXiv! :) RT @catherineols: If you're a research engineer attending #ICLR2017, join fellow RE's at lunch meetup on Monday! (Researchers, tell your en… RT @egrefen: We welcome already published work as cross-submissions to #RepL4NLP. Come present your work again after @acl2017! https://t.co… "RT @zacharylipton: In the @guardian's ""Meet Erica"", it's hard to tell if the journalists are deceiving the audience or themselves. https:…" RT @abigail_e_see: Check out the blog post "Taming Recurrent Neural Networks for Better Summarization" for our new @acl2017 paper! https://… @willknight I was thinking shitty Chappie. RT @openelex: City of Detroit produced a lookup tables for its absentee precincts in 2016. It's in Excel. But wait for it: the values are C… "TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answering," Jang et al.: https://t.co/2UIinZwi6Q "Parity Objectives in Countable MDPs," Kiefer et al.: https://t.co/XIzFY4ON3X "Deep Structured Learning for Facial Action Unit Intensity Estimation," Walecki et al.: https://t.co/0kYStIZRuC "Visual Recognition of Paper Analytical Device Images for Detection of Falsified Pharmaceuticals," Banerjee et al.: https://t.co/l0MssdETJW "On Generalized Bellman Equations and Temporal-Difference Learning," Yu et al.: https://t.co/AN7AOI5wlF "Liquid Splash Modeling with Neural Networks," Um et al.: https://t.co/L9ZFbQN1y7 "Bringing Structure into Summaries: Crowdsourcing a Benchmark Corpus of Concept Maps," Falke and Gurevych: https://t.co/XS4zSzgCIH "Optimizing Differentiable Relaxations of Coreference Evaluation Metrics," Le and Titov: https://t.co/eUlfxuD1QV "How Robust Are Character-Based Word Embeddings in Tagging+MT Against Wrod Scramlbing or Randdm Nouse?"Heigold et al https://t.co/676OkRJWfg "Incremental learning of high-level concepts by imitation," Alibeigi et al.: https://t.co/aQ27uwyzNW "DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agents," Lee et al.: https://t.co/R28btO3Vg8 "Using Source Code Metrics and Ensemble Methods for Fault Proneness Prediction," Kumar et al.: https://t.co/sA4jwoybth "Get To The Point: Summarization with Pointer-Generator Networks," See et al.: https://t.co/6A23MUjIK1 "Runtime Analysis of the (1+(λ,λ)) Genetic Algorithm on Random Satisfiable 3-CNF Formulas," Buzdalov and Doerr: https://t.co/9jHGqLo5pu "Fast Monte Carlo Algorithms for Tensor Operations," Tarzanagh and Michailidis: https://t.co/M6A6waOLNs "Exploiting Cross-Sentence Context for Neural Machine Translation," Wang et al., Dublin City U./Tencent: https://t.co/P05DqgXvQn "Environment-Independent Task Specifications via GLTL," Littman et al.: https://t.co/kvc84aaTaS "An entity-driven recursive neural network model for chinese discourse coherence modeling," Xu et al.: https://t.co/IyD9DA8vlD "Deep API Programmer: Learning to Program with APIs," Bhupatiraju et al.: https://t.co/I5iJsDrPJ2 "Dataset Augmentation for Pose and Lighting Invariant Face Recognition," Crispell et al.: https://t.co/AipPAYFrOw "Belief State Planning for Autonomously Navigating Urban Intersections," Bouton et al., Stanford/Honda: https://t.co/gqaIfuK7C1 "CBinfer: Change-Based Inference for Convolutional Neural Networks on Video Data," Cavigelli et al.: https://t.co/MVfGPdjzrO "FastVentricle: Cardiac Segmentation with ENet," Lieman-Sifry et al.: https://t.co/TB5sNIuCpf """Ultrafast photonic reinforcement learning based on laser chaos,"" Naruse et al.: https://t.co/zzPeWG0n8h *chin scratch emoji*" "Reward-based stochastic self-configuration of neural circuits," Kappel et al.: https://t.co/XOFDsPOqAR "Close Yet Distinctive Domain Adaptation," Luo and Wang et al.: https://t.co/hunlG2KneD "Cross-media Similarity Metric Learning with Unified Deep Networks," Qi et al.: https://t.co/6bPpWTV8NR "Stochastic Gradient Descent as Approximate Bayesian Inference," Mandt et al.: https://t.co/HdvkHY821y "Non-parametric Estimation of Stochastic Differential Equations with Sparse Gaussian Processes," Garcia et al.: https://t.co/Rz0S1yQGsD RT @BenjySarlin: The president wishes you a peaceful day reflecting on family, prayer, Chinese trade tactics, his tax returns, and his winn… @omitevski also: Concrete Problems in AI Safety paper; Paul Christiano works on safety actively (see AI Alignment blog); prob more to come. Academics gonna academic... https://t.co/8mk2MGJmRK RT @djrothkopf: Trump's Easter morning tweetstorm is a sign of a disturbed, defensive, misguided man who has no business in a position of r… @ankurhandos I think lots of core GOFAI ideas will be rediscovered eventually, but lots of handcrafted features for perception stuff... ¯\_(ツ)_/¯ @ankurhandos There should be a documentary or something about AI ppl whose work became obsolete via deep learning :) not everyone obvi but some in e.g CV @ankurhandos nice. seems pretty ahead of its time :) @ankurhandos gotcha :) @ankurhandos curious to know what you meant exactly then :) @ankurhandos do you not count the MDL stuff and mean prediction gain stuff as info gain? @ankurhandos oh, that - yeah, ad hoc seems appropriate, but still seemed like pretty good results + included b/c it seems like an important problem. @ankurhandos the convergence stuff, framing of it as ensemble approach, + taxonomy of multiagent approaches seemed somewhat new and interesting to me. @ankurhandos The advisor one? (Twitter's making it hard for me to tell what you're responding to :) ) Yeah I didn't get much from the cost fn stuff, but+ K, that's it with Recent Cool Stuff for now. Semi-random, but tried to focus on stuff for which there aren't blog posts/much attn already. "Differentiable Learning of Logical Rules for Knowledge Base Completion," Yang et al.: https://t.co/QOyXMzO4dh Logic + deep learning = ??? "Scaffolding Networks for Teaching and Learning to Comprehend," Celikyilmaz et al.: https://t.co/ahDalwNDT9 Lots of cool ideas here... "Automated Curriculum Learning for Neural Networks," Graves et al.: https://t.co/6FM7Mhf8CD Speaks for itself... "Learning from Demonstrations for Real World Reinforcement Learning," Hester et al.: https://t.co/BK4xnTLzQi bootstrapping DRL with demos "Composite Task-Completion Dialogue System via Hierarchical Deep RL," Peng et al.: https://t.co/2olkcNb1kT Good results w/ HDRL in dialogue "Collaborative Deep Reinforcement Learning," Lin et al.: https://t.co/8szaKHl0sK multiagent knowledge distillation in deep RL. "FeUdal Networks for Hierarchical Reinforcement Learning," Vezhnevets et al.: https://t.co/Kw7v9Vxr4r FuNs have fun learning hierarchically "Neural Episodic Control," Pritzel et al.: https://t.co/QUYN0ayu2m Fast learning via good use of memory. Long term perf. unclear, though... "Robust Adversarial Reinforcement Learning," Pinto et al.: https://t.co/uiLUn1mOZR GAN-ish, part A destabilizes B --> more robust locomotion "Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks," Finn et al.: https://t.co/8Nq19lbKFR Again, title speaks for itself... "Learning Gradient Descent: Better Generalization and Longer Horizons," Lv and Jiang et al.: https://t.co/HY1n4cNh5m Nice meta-L results. "Accelerating Deep RL through the Discovery of Continuous Subgoals," Lee et al.: https://t.co/7skMQlf02A Nice fast Montezuma's Rev. learning "Learned Optimizers that Scale and Generalize," Wichrowska et al.: https://t.co/OuPNSFMP2x includes good review of recent meta stuff. "Intrinsic Motivation and Automatic Curricula via Asymmetric Self-Play," Sukhbaatar et al.: https://t.co/UxnEsVoxzi GAN-ish unsup. learning "End-to-end optimization of goal-driven and visually grounded dialogue systems," Strub et al.: https://t.co/vomvy5g3RL Deep RL 4 viz dialog "Deep Decentralized Multi-task Multi-Agent RL under Partial Observability," Omidshafiei et al.: https://t.co/h2qxOZsOaD Lots going on here.. "Recurrent Environment Simulators," Chiappa et al.: https://t.co/il8l4IF4MK Possibly big step forward for model-based RL. "One-Shot Imitation Learning," Duan et al.: https://t.co/AJx7I3fEpx Speaks for itself. I'm very bullish on imitation learning's applications "Multi-Level Discovery of Deep Options," Fox and Krishnan et al.: https://t.co/eY3uekeysW Lots of options/hierarchical deep RL these days... "Multi-Advisor Reinforcement Learning," Laroche et al.: https://t.co/iYOQVhlUbX RL ensemble stuff and some other new tricks. "Encoder Based Lifelong Learning," Triki and Aljundi et al.: https://t.co/jZ0yEzUfzL One of a few cool new approaches 4 lifelong learning. "A Laplacian Framework for Option Discovery in Reinforcement Learning," Machado et al. https://t.co/ExDqiX9lfl Nice "eigenpurposes" concept. "Count-Based Exploration w/ Neural Density Models," Ostrovski et al: https://t.co/vcpZiqa4JJ Especially liked the "Pushing the limits" part. Here are some (a dozen or two) especially cool papers from the past few months, since I'm going through em... Mostly deep RL/meta-learning: @zacharylipton Ah, gotcha - thanks for clarifying! @Namanjain020 it's getting hard to do the former, though, cuz so many papers :) @Namanjain020 I usually just take the time to do a first pass on arXiv itself, plus also take into account what other people seem excited about. @Namanjain020 I read a fair amount of intro/conclusions though, and skim the rest @Namanjain020 I don't read the vast majority that I tweet. Skim most, only detailed read that are very few relevant to my interests. @zacharylipton would be interested in your def. of novelty/metric for significant contribution in either case... @zacharylipton in what sense are most ML conf papers not technically novel? Seems to me most make at least *some* contribution. Or do you mean not *very*? RT @mat_kelcey: recruiter email, on saturday night, for wall st firm, offering seven figure sign on bonus https://t.co/aJmvbnAXqv @meganesque @robinhanson @anderssandberg @amcafee Besides the gender issue, graphic oversimplifies a bit for humor... I'd say ~half of those ppl fit into the view I called "middle ground" Big absolute performance improvements on Hearthstone + Django programming-from-natural-lang tasks with neural nets: https://t.co/fYroxNrlFa RT @erichorvitz: Are you the Partnership's founding Exec Director? or perhaps you know the right person to help us take to the air? https:… @_jyan_ Not really our core competency/goal, and we're pretty small... When I open my "AI papers" folder... https://t.co/vNgjrG5faB @robinhanson @anderssandberg @amcafee "unlikely very soon," though, is part of that POV, though. @robinhanson @anderssandberg @amcafee as distinct from "oh my God" (which seems like an uncharitable characterization, or very rare view) or "unlikely" (b/c deep uncertainty). @robinhanson @anderssandberg @amcafee ...sufficient preparation, the default outcome is bad, but timeframes are uncertain, some work can be done now, more good work = less risk. @robinhanson @anderssandberg @amcafee I was referring to "more likely screwed the less good work on it." Saying a bit more: the purportedly (by me) common view is that without... @robinhanson @anderssandberg @amcafee I agree. @robinhanson @anderssandberg @amcafee Middle ground btwn those seems more common to me, but perhaps some equivocation. (Some) journalists certainly highlight extreme narratives. @robinhanson @anderssandberg @amcafee Seems more like spectrum of views to me, on timeline/difficulty of problem. Between those: more likely screwed the less good work on it. @robinhanson @anderssandberg @amcafee (doesn't settle it, but that scenario's plausibility combined w/ other considerations like https://t.co/SL2u3ZIDIq suggest early work good) @robinhanson @anderssandberg @amcafee Christiano's idea of prosaic AGI alignment=relevant https://t.co/nyn8FIItPH May turn out sequential insights needed + we have most info now. RT @lidija_sekaric: Another #renewable source that will be too cheap to meter. And #windpower costs are still declining. https://t.co/mrhOD… "RT @nsfaber: There is a #parasite that enters a #fish, kills the fish's tongue + replaces it! It reproduces in the fish's mouth. https://t.…" RT @marcgbellemare: Our paper on Automated Curriculum Learning is out! Intrinsic motivation meets deep net optimization https://t.co/8SXFiU… @_jyan_ Deputy PM thing is part of why I think it's about PR. Can't speak to the details of project but if it's humanoid wielding gun, is stupid :) @unterix no prob! @unterix https://t.co/vlr0LYNN2c @_jyan_ I don't think/hope they put much money into this... had robot for other purposes, wanted to signal that they're doing cool/important stuff @unterix no...GAN with convolutional nets. About a third of all papers citing the original GAN paper (2014) were published in the first few months of this year. #AIpapergeddon @jackclarkSF (and yes, ridiculous on multiple levels) @jackclarkSF I wasn't subtweeting you, for the record :P Lots of people tweeting about it. You would probably need soft hands, or thinner fingers, for that, + good software, and at some point the gun should just be part of the bot. ...besides the movie not showing any impressive behavior, it makes no sense to put guns in a robot that couldn't even pick up/reload them. Don't really wanna give the Russian gun-wielding robot thing more attention than it deserves, but for the record, it is just a PR stunt... RT @j2bryson: Video of @aylin_cim @random_walker and I talking about our #ai semantics and human-like biases work. https://t.co/Fs5SE7lQcl :-O https://t.co/vrLMxwoct1 https://t.co/YDtby5jJgG @jnhwkim @hardmaru @kcimc @douglas_eck Schmidhubered (more or less) https://t.co/yJu9DZDXRB @hardmaru @jnhwkim @kcimc @douglas_eck RNNbrandt? "A Position-Aware Deep Model for Relevance Matching in Information Retrieval," Hui et al.: https://t.co/kNGgUUL0Yv "Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution," Lai et al.: https://t.co/HHxfznaHEb "Deep Reinforcement Learning-based Image Captioning with Embedding Reward," Ren et al.: https://t.co/qI1P7GVtnz "What's in a Question: Using Visual Questions as a Form of Supervision," Ganju et al.: https://t.co/BMFbwitb6u "Land Cover Classification via Multi-temporal Spatial Data by Recurrent Neural Networks," Ienco et al.: https://t.co/VbYGqHDCst "Interspecies Knowledge Transfer for Facial Keypoint Detection," Rashid et al.: https://t.co/qEBQPNm7jJ "A Neural Model for User Geolocation and Lexical Dialectology," Rahimi et al.: https://t.co/7zrPQ8bCLf "ApproxDBN: Approximate Computing for Discriminative Deep Belief Networks," Xu et al.: https://t.co/96oHcqd0Sh "Fully Distributed and Asynchronized Stochastic Gradient Descent for Networked Systems," Ying Zhang: https://t.co/LcFWl3wEja "Global and Local Perception GAN for Photorealistic+Identity Preserving Frontal View Synthesis," Huang et al.: https://t.co/vlr0LYNN2c "DCFNet: Discriminant Correlation Filters Network for Visual Tracking," Wang et al.: https://t.co/T1fO23Swp5 "Learning to Estimate Pose by Watching Videos," Chakraborty and Namboodiri: https://t.co/QzqCwsozc3 "Solving ill-posed inverse problems using iterative deep neural networks," Adler and Oktem: https://t.co/Wc8UGjuR8x "Hide-and-Seek: Forcing a Network to be Meticulous for Weakly-supervised Object+Action Localization," Singh and Lee: https://t.co/qWuQmFcasy "Spatial Memory for Context Reasoning in Object Detection," Chen and Gupta: https://t.co/bFiXAOtqj2 "Room for improvement in automatic image description: an error analysis," van Miltenburg and Elliott: https://t.co/dYkwbYAQZZ "Video Acceleration Magnification," Zhang et al.: https://t.co/I9ggOxGVCQ "Learning Joint Multilingual Sentence Representations with Neural Machine Translation," Schwenk et al.: https://t.co/zpQmbx8RUx "A Procedural Texture Generation Framework Based on Semantic Descriptions," Dong et al.: https://t.co/aTnH6JCn4Q "Neural Face Editing with Intrinsic Image Disentangling," Shu et al.: https://t.co/40cPQ8tpBQ "Explaining the Unexplained: A CLass-Enhanced Attentive Response (CLEAR) Approach to Understanding DNNs"-Kumar et al https://t.co/0eimUBJyPl "A Search for Improved Performance in Regular Expressions," Cody-Kenna et al.: https://t.co/nSbZNNcybp "Cross-lingual and cross-domain discourse segmentation of entire documents," Braud et al.: https://t.co/NWX9ekSNCj "Recognizing Activities of Daily Living from Egocentric Images," Cartas et al.: https://t.co/h0uXHemDTU "DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networks," Flunkert et al.: https://t.co/L9yXXhnbjZ "Learning Latent Representations for Speech Generation and Transformation," Hsu et al.: https://t.co/OpGVFFDASz "On the effect of Batch Normalization and Weight Normalization in Generative Adversarial Networks," Xiang and Li: https://t.co/poDStObRnn "Virtual Adversarial Training: a Regularization Method for Supervised and Semi-supervised Learning," Miyato et al.: https://t.co/sB2yV6nJf8 "Value Directed Exploration in Multi-Armed Bandits with Structured Priors," Cserna et al.: https://t.co/tQGSp9aAAN "Discriminative Bimodal Networks for Visual Localization and Detection with Natural Language Queries," Zhang et al.: https://t.co/oAR520fMXm "ZigZag: A new approach to adaptive online learning," Foster et al.: https://t.co/AksxV0uCoA "3D Deep Learning for Biological Function Prediction from Physical Fields," Golkov et al.: https://t.co/U6JS6scb3p "Virtual to Real Reinforcement Learning for Autonomous Driving," You and Pan et al.: https://t.co/cZBTmiCjGG "Shape-independent Hardness Estimation Using Deep Learning and a GelSight Tactile Sensor," Yuan et al.: https://t.co/GefAy6jZzL "Incremental Skip-gram Model with Negative Sampling," Kaji and Kobayashi: https://t.co/DCrc8xXVCI @lidija_sekaric We can know it has high accuracy on stuff for which we have ground truth labels but fair point re: real world (/changing distribution) cases @j2bryson @aylin_cim @random_walker much deserved recognition for great work - congrats! "Learning Two-Branch Neural Networks for Image-Text Matching Tasks," Wang et al.: https://t.co/s3efi49z2S "https://t.co/ZfW1OwKBno: A new Large-scale Point Cloud Classification Benchmark," Hackel et al.: https://t.co/pYZD1VDr3F "Attention-Set based Metric Learning for Video Face Recognition," Hu et al.: https://t.co/GT18FaTMsk "Unsupervised part learning for visual recognition," Sicre et al.: https://t.co/PKRa3aRrNE "Counterexample Guided Inductive Optimization," Araujo et al.: https://t.co/xfwmVrigpQ "Deep Extreme Multi-label Learning," Zhang et al.: https://t.co/DYPF70ZsJK "Real-time On-Demand Crowd-powered Entity Extraction," Huang et al.: https://t.co/WPppl3WtIZ "Representation Stability as a Regularizer for Improved Text Analytics Transfer Learning," Riemer et al.: https://t.co/bpb0cQfDDV "Sampling-based speech parameter generation using moment-matching networks," Takamichi et al.: https://t.co/KjktHRBrRA "Predictive-Corrective Networks for Action Detection," Dave et al.: https://t.co/W4svJjBxUo "Automatic Discov, Association Estimation+Learning of Semantic Attributes for 100 Categories," Al-Halah+Stiefelhagen https://t.co/4C3yqk1raR "Instance-Level Salient Object Segmentation," Li et al.: https://t.co/nNVhB9gytG "RT @j2bryson: Semantics derived automatically from language corpora contain human-like biases https://t.co/HO5KrGNm9G @aylin_cim @j2bryson…" "Deep Contextual Recurrent Residual Networks for Scene Labeling," Le et al.: https://t.co/xOOAFZajz0 "Reformulating Level Sets as Deep Recurrent Neural Network Approach to Semantic Segmentation," Le et al.: https://t.co/X98lLbEaWv "Investigation of Very Deep CNN and Advanced Training Strategies for Document Image Classification," Afzal et al.: https://t.co/kQiS0phrUM "Attention-based Extraction of Structured Information from Street View Imagery," Wojna et al.: https://t.co/3Kmz3ylYwH "Learning Detection with Diverse Proposals," Azadi et al.: https://t.co/IKaq56GjId "Unsupervised Spatio-Temporal Embeddings for User and Location Modelling," Yang and Eickhoff: https://t.co/M1ntCiJfWP "Creativity: Generating Diverse Questions using Variational Autoencoders," Jain et al.: https://t.co/pu2ceFS0xC "CNN-SLAM: Real-time dense monocular SLAM with learned depth prediction," Tateno et al.: https://t.co/I9Tao2jNI0 "Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problems," Meinhardt et al.: https://t.co/MBULwyesZ5 "What do Neural Machine Translation Models Learn about Morphology?," Belinkov et al.: https://t.co/OSwYq9B2dy "Deep Neural Network Based Precursor microRNA Prediction on Eleven Species,"Thomas and Sael: https://t.co/HnWXn9GWrm "Energy Propagation in Deep Convolutional Neural Networks," Wiatowski et al.: https://t.co/dfIiKFjxPb "MAGAN: Margin Adaptation for Generative Adversarial Networks," Wang et al.: https://t.co/miEz238sY0 "Robustly Learning a Gaussian: Getting Optimal Error, Efficiently," Diakonikolas et al.: https://t.co/bbSxGRmXth "Preferential Bayesian Optimization," Gonzalez et al., Amazon: https://t.co/WlrPBBMZ0M RT @SecDef19: The #MOAB explosive yield is 0.011 kilotons, typical nuclear yield is 10-180 kilotons - the US alone possesses over 7000 nucl… @ArtirKel see also: https://t.co/3Vw1ntgGvG @ArtirKel there should have been real world rewards for sample efficient learning... @ArtirKel that's...great and pretty much what I'd expect :) @ArtirKel I'll try to make it next time :) was out of town. @ArtirKel WideMind RT @hardmaru: Wrote a short article on sketch-rnn. https://t.co/joPHQwgQlD RT @OriolVinyalsML: Pretty sketchy research: https://t.co/atNlVYNOzM https://t.co/03SAl5X0R7 RT @markus_with_k: Bootstrapping RL by imitation learning. Looking forward to seeing the approach applied to real world robotics problems.… RT @alexjc: Incredible! A Neural Parametric Singing Synthesizer #ML https://t.co/7X5Cq3SZb7 Female Spanish voice is outstanding, mixed w/ a… Have to sleep early tonight so only have time for those two highlights :) more papers tomorrow night... "Learning from Demonstrations for Real World Reinforcement Learning," Hester et al., DeepMind: https://t.co/BK4xnTLzQi Very cool stuff! https://t.co/wikxLmfjfa RT @hardmaru: A Neural Representation of Sketch Drawings. My work on generative vector image modelling with recurrent neural nets. https://… RT @LawDavF: Totally Random Unstable Momentary Policy https://t.co/4MqxL5p1hu RT @blakehounshell: who knew north korea could be so complicated https://t.co/yHch5kzEeK @halhod there's essentially no left support... <10%. Much right disgruntlement about Syria though @halhod on the right you mean? RT @mark_riedl: Initial attempt to generate Pokémon with a Generative Adversarial Network https://t.co/F3J0deajRS Will be in London tomorrow, let me know if you want to meet up after 5:30 or so :) @justinhendrix ah :) @justinhendrix I don't get it :) @nycmedialab Just recognizing styles, not producing them :) not inconceivable someday, though... "On Feature Reduction using Deep Learning for Trend Prediction in Finance," Troiano et al.: https://t.co/1Y2gvL5orr "Forecasting Human Dynamics from Static Images," Chao et al.: https://t.co/ZMR1VocgCu "A-Fast-RCNN: Hard Positive Generation via Adversary for Object Detection," Wang et al.: https://t.co/oMVBcJemhZ "Quality Aware Network for Set to Set Recognition," Liu et al.: https://t.co/VyESjvDOik "Deep Learning for Multi-Task Medical Image Segmentation in Multiple Modalities," Moeskops et al.: https://t.co/SGBlfS66aB "Online Video Deblurring via Dynamic Temporal Blending Network," Kim et al.: https://t.co/gD5lkope3B "Unfolding and Shrinking Neural Machine Translation Ensembles," Stahlberg and Byrne: https://t.co/6si5WZxddW "Learning Deep CNN Denoiser Prior for Image Restoration," Zhang et al.: https://t.co/9gBApu23kH "A Robust Blind Watermarking Using Convolutional Neural Network," Mun et al.: https://t.co/jXCXXkf896 "Reconstruction of three-dimensional porous media using generative adversarial neural networks," Mosser et al.: https://t.co/4fNB7OqiQs "Mining Object Parts from CNNs via Active Question-Answering," Zhang et al.: https://t.co/vY4r52FnLl "Later-stage Minimum Bayes-Risk Decoding for Neural Machine Translation," Shu and Nakayama: https://t.co/ysUoYol0jF "EAST: An Efficient and Accurate Scene Text Detector," Zhou et al.: https://t.co/XgxHfPCZMU "Deep Multimodal Representation Learning from Temporal Data," Yang et al.: https://t.co/NP2a54FDT2 "Improving Pairwise Ranking for Multi-label Image Classification," Li et al.: https://t.co/gQe7SQVenP "Detecting Visual Relationships with Deep Relational Networks," Dai et al.: https://t.co/KHSYVlUxsK "WRPN: Training and Inference using Wide Reduced-Precision Networks," Mishra et al.: https://t.co/dhZL31MvPp "Action Unit Detection with Region Adaptation, Multi-labeling Learning and Optimal Temporal Fusing," Li et al.: https://t.co/nmRVShN2y6 "DRAW: Deep networks for Recognizing styles of Artists Who illustrate children's books," Hicsonmez et al.: https://t.co/Q7x37aeHcQ "Semantically Consistent Regularization for Zero-Shot Recognition," Morgado and Vasconcelos: https://t.co/rO4pwXVrnb "Learning from Multi-View Structural Data via Structural Factorization Machines," Lu et al.: https://t.co/Rtf78JvFE3 "Tight Lower Bounds for Differentially Private Selection," Steinke and Ullman: https://t.co/puD7xHwGI7 "Weakly-Supervised Spatial Context Networks," Wu et al.: https://t.co/VwmY1wS3xr "Field of Groves: An Energy-Efficient Random Forest," Takhirov et al.: https://t.co/7pGrhrGIVP "CERN: Confidence-Energy Recurrent Network for Group Activity Recognition," Shu et al.: https://t.co/C99FS4dWgJ "Federated Tensor Factorization for Computational Phenotyping," Kim et al.: https://t.co/CoCKYYiJGU "struc2vec: Learning Node Representations from Structural Identity," Figueiredo et al.: https://t.co/0ue7GccGne "Continuously tempered Hamiltonian Monte Carlo," Graham and Storkey: https://t.co/Ijt83ESVaq "Massively parallel MCMC for Bayesian hierarchical models," Goudie et al.: https://t.co/ekjAIJHXcE @hardmaru saw a pretty good badminton robot in China... RT @samim: All this talk about "The Fourth Industrial Revolution" is boring. Let's talk about the second renaissance instead. RT @rbhar90: Check out first two chapters of "Tensorflow for Deep Learning", my new book with @Reza_Zadeh and @OReillyMedia! https://t.co/9… RT @genekogan: you can now visualize layers & classify images ~60fps w/ ofxDarknet. real-time feature extraction in @openframeworks https:/… RT @cybertreiber: "A measure of the amount that the network learns from each data sample is provided as a reward" ... very clever. https://… @_jyan_ @dustinvtran that too :) @dustinvtran I don't pay super close attention to the filtering time bc there's some more careful reading/skimming interspersed...but ya prob 30-60 mins @dustinvtran ~5-10 mins to pick which to take some sort of look at, ~10-30 mins to open/glance at them to determine tweetworthiness, ~5 to actually tweet @dustinvtran ...and sometimes I do "Find" on the big CS page for stuff I'm interested in, like "reinf" for RL, before scanning the whole thing. @dustinvtran I just go straight to the website. The pages update at slightly different times, but consistent across days. CS, then ML etc few mins later. To be continued... "Interpretable Explanations of Black Boxes by Meaningful Perturbation," Fong and Vedaldi, Oxford: https://t.co/mrXnXeCeXD "Optimized Data Pre-Processing for Discrimination Prevention," Calmon et al., IBM: https://t.co/UX5vnnIrHP "Show, Ask, Attend, and Answer: A Strong Baseline For Visual Question Answering," Kazemi + Elqursh, Google: https://t.co/rsQjgilTXu "Simplified Stochastic Feedforward Neural Networks," Lee et al., KAIST: https://t.co/duqM5yHmGL "Automated Curriculum Learning for Neural Networks," Graves et al., DeepMind: https://t.co/6FM7Mhf8CD "A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction," Qin et al.: https://t.co/aKvfknJUgh "The Space of Transferable Adversarial Examples," Tramèr et al.: https://t.co/JtuTSH6sH5 "Stochastic Neural Networks for Hierarchical Reinforcement Learning," Florensa et al., Berkeley/OpenAI: https://t.co/wwSfg3UqdM "Composite Task-Completion Dialogue System via Hierarchical Deep Reinforcement Learning," Peng et al., MSFT/CUHK: https://t.co/2olkcNb1kT "Data-efficient Deep Reinforcement Learning for Dexterous Manipulation," Popov et al., DeepMind: https://t.co/VhJxsSnDmM @hardmaru @johndburger It's awesome. Read it. "@zacharylipton My colleague Stuart Armstrong on heroin case here - https://t.co/SE78JnbVDu another view of on IRL @Thomas__Arnold https://t.co/GQqcPgqETs" "Deep Reinforcement Learning framework for Autonomous Driving," El Sallab et al.: https://t.co/jxxCIkyWG2 "Supervised Infinite Feature Selection," Eskandari and Akbas: https://t.co/quKpGpRSXx "BigHand2.2M Benchmark: Hand Pose Dataset and State of the Art Analysis," Yuan et al.: https://t.co/8HDM9CU5IY "Estimating Tactile Data for Adaptive Grasping of Novel Objects," Hytinnen et al.: https://t.co/JMafR9iY1R "Modeling Temporal Dynamics and Spatial Configurations of Actions Using Two-Stream RNNs," Wang+Wang: https://t.co/3SCq31Popb "A Linearly Relaxed Approximate Linear Program for Markov Decision Processes," Lakshminarayanan et al.: https://t.co/SS8Op3QJmn "Deep Generative Adversarial Compression Artifact Removal," Galerti et al.: https://t.co/an4uC7kUUe "An Empirical Evaluation of Visual Question Answering for Novel Objects," Ramakrishnan et al.: https://t.co/jGzVUUW8RM "First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations," Garcia-Hernando et al.: https://t.co/psYJXKbLsi "Coupled Deep Learning for Heterogeneous Face Recognition," Wu et al.: https://t.co/sfeDrEq4AH "Weakly-supervised Transfer for 3D Human Pose Estimation in the Wild," Zhou et al.: https://t.co/PXAXENa3NK "Learning Cross-Modal Deep Representations for Robust Pedestrian Detection," Xu et al.: https://t.co/jgu98KzZBy "GoDP: Globally optimized dual pathway system for facial landmark localization in-the-wild," Wu et al.: https://t.co/g1qFlj1GjW "Learning Where to Look: Data-Driven Viewpoint Set Selection for 3D Scenes," Genova et al.: https://t.co/yPMwvHmmzv "Pixelwise Instance Segmentation with a Dynamically Instantiated Network," Arnab and Torr: https://t.co/aixCNAEV67 "A Trolling Hierarchy in Social Media and A Conditional Random Field For Trolling Detection," Luis Gerardo Mojica: https://t.co/1Qu0k2rHZV "Time-Contrastive Learning Based Unsupervised DNN Feature Extraction for Speaker Verification," Sarkar et al.: https://t.co/6MrTVki6Jz "Voice Conversion Using Sequence-to-Sequence Learning of Context Posterior Probabilities," Miyoshi et al.: https://t.co/KfnVar9ffw "Fast Spectral Clustering Using Autoencoders and Landmarks," Banijamali and Ghodsi: https://t.co/bSxUWPvmVU "Fully Con. Deep NNs for Persistent Multi-Frame Multi-Object Detection in Wide Area Aerial Videos," LaLonde et al.: https://t.co/ozvBLrE6u8 "Detail-revealing Deep Video Super-resolution," Tao et al.: https://t.co/U4SiRYu3EP "DeepPermNet: Visual Permutation Learning," Cruz et al.: https://t.co/JYI4NJelRH "Formal approaches to a definition of agents," Martin Biehl (dissertation): https://t.co/VqPasZhbho "Adaptive Relaxed ADMM: Convergence Theory and Practical Implementation," Xu et al.: https://t.co/JTw7dKldBy "Improving Implicit Semantic Role Labeling by Predicting Semantic Frame Arguments," Do et al.: https://t.co/er0cT4X5oc "Fine-grained Image Classification via Combining Vision and Language," He and Peng: https://t.co/2Umu24UzLI "Entity Linking for Queries by Searching Wikipedia Sentence," Tan et al.: https://t.co/QELzOwt4ks "Deep Affordance-grounded Sensorimotor Object Recognition," Thermos et al.: https://t.co/zu3TsqaliO "Tracking the Trackers: An Analysis of the State of the Art in Multiple Object Tracking," Leal-Taixé and Milan et al https://t.co/0FB6gEJOyM "Unsupervised prototype learning in an associative-memory network," Zhen et al.: https://t.co/yXu0qw41Vs "SemEval 2017 Task 10: ScienceIE - Extracting Keyphrases+Relations from Scientific Publications," Augenstein et al.: https://t.co/hrV4Kr7a0h "Learning Human Motion Models for Long-term Predictions," Ghosh et al.: https://t.co/Au32xE5BRC "Character-Word LSTM Language Models," Verwimp et al.: https://t.co/bhWXU6T486 "Bayesian Inference of Individualized Treatment Effects using Multi-task Gaussian Processes," Alaa + van der Schaar: https://t.co/2mV2UsVfOy "Distributed Learning for Cooperative Inference," Nedic et al.: https://t.co/jeFYlnTkCT "Word Embeddings via Tensor Factorization," Bailey and Aeron: https://t.co/mzabnyzQjm "An Algorithmic Approach to Search Games: Finding Solutions Using Best Response Oracles," Hellerstein/Lidbetter: https://t.co/kJCoIclOSz "Loss Max-Pooling for Semantic Image Segmentation," Bulo et al.: https://t.co/RcFpAPi0VG "Using CNNs and satellite imagery to identify patterns in urban environments at a large scale," Albert et al.: https://t.co/Bnr2tLOk7i "Exploring Word Embeddings for Unsupervised Textual User-Generated Content Normalization," Bertaglia et al.: https://t.co/zzZOvK7YoB "On the Fine-Grained Complexity of Empirical Risk Minimization: Kernel Methods and Neural Networks," Backurs et al.: https://t.co/AkRz3KXkE9 "Implementing a Cloud Platform for Autonomous Driving," Liu et al.: https://t.co/5TiJTKsOlB "Pay Attention to Those Sets! Learning Quantification from Images," Sorodoc et al.: https://t.co/RoXGZh42j5 "Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphs," Simonovsky and Komodakis: https://t.co/qgT5xL3bk4 "ActionVLAD: Learning spatio-temporal aggregation for action classification," Girdhar et al.: https://t.co/zto87BxAVM Tuesday arXiv papers, part 2: RT @googleresearch: Introducing an open source seq2seq framework in #TensorFlow that makes it easy to experiment with seq2seq models - http… RT @goodfellow_ian: Wired article with the GAN origin story: https://t.co/RbKvRRH39S @AlxCoventry @gwern I was referring more to @gwern's comments re embarrassment/out of touchness RT @shakir_za: See our latest paper. Building models of environments, an in depth analysis of design decisions, rollouts for hundreds of st… @gwern @AlxCoventry not sure how fair it is to fault people for not seeing something published a week before given arxiv volume... That's all I can get through from this batch tonight - more tomorrow. "Can AIs learn to avoid human interruption?," El Mhamdi et al https://t.co/3beCqlbh7W (follows up on the Safely Interruptible Agents paper) "Multi-Agent Diverse Generative Adversarial Networks," Ghosh et al.: https://t.co/YimetTIeOR "Learning Important Features Through Propagating Activation Differences," Shrikumar et al.: https://t.co/02kUnOgtGv "Distribution-free Evolvability of Vector Spaces: All it takes is a Generating Set," Nock and Nielsen: https://t.co/jFcNjTwYFX "DualGAN: Unsupervised Dual Learning for Image-to-Image Translation," Yi et al.: https://t.co/aeuvtNwxCR "DSLR-Quality Photos on Mobile Devices with Deep Convolutional Networks," Ignatov et al.: https://t.co/4LGIRKIvJq "Reinterpreting Importance-Weighted Autoencoders," Cremer et al.: https://t.co/yy8zNzCU2P "Dimensionality Reduction as a Defense against Evasion Attacks on Machine Learning Classifiers," Bhagoji et al.: https://t.co/11dgQoYnaw "Stein Variational Policy Gradient," Liu et al.: https://t.co/WY3XjXRWSu RT @danieldewey: .@DeepMindAI is hiring an AI policy researcher: https://t.co/hG7DfLHpDn "Bayesian Recurrent Neural Networks," Fortunato et al.: https://t.co/UbCfxZAl3M RT @KayFButterfield: The end of Open Cyc https://t.co/atlFLg9ZYj RT @jwan584: Google is becoming a full-stack AI company—its own data training it's own algorithms running on its own chips on its own cloud… RT @drfeifei: Running on TPU's the neural machine translation (covers 100+ languages) is now open to all @googlecloud customers https://t.c… @brubsby I haven't yet seen GANs play any (big) role in Atari, but who knows :) @ArtirKel no major tingling there at the moment. @ArtirKel oh yeah, that :P @edersantana but I assumed the leaderboards are just one algo/hyperparam set for one game. @edersantana I haven't been paying attention to them, honestly. Maybe I should. Would mainly be interested in one algo on multiple games.. @ArtirKel why? (I don't expect that, but getting impatient) I'll be disappointed if my forecasts fail because people stopped publishing Atari results :) My Atari sense is tingling. 300% median score soon? @sknthla I appreciate your restraint [emoticon redacted] @sknthla lol @dennybritz also, this: https://t.co/N0fvkhEIMM RT @dennybritz: The Wild Week in AI - Sonnet Tensorflow library; Next AlphaGo match; TPU performance study; Neural Audio Synthesis https://… @sknthla those in the underrated fields are well aware of this :) "RT @jwan584: NVIDIA's CEO responds to Google TPU performance. Claims P40 is 2x faster than TPU in GoogleNet inference. https://t.co/RJsZcQy…" @dennybritz @h4pz seems weird that that'd be banned but people can do stuff like TwitchPlaysPokemon.... discrimination! ;) @dennybritz @h4pz ah. @dennybritz @h4pz what's the problem with Twitch exactly? Also: AI safety researcher :) RT @DeepMindAI: #AlphaGo is playing again in May, in a festival designed to explore the mysteries of Go! More on our blog: https://t.co/NnH… RT @mpshanahan: UC Berkeley's Center for Human-Compatible AI are looking for a postdoc in #AI safety - https://t.co/43eoB1j7aS "A Constrained Sequence-to-Sequence Neural Model for Sentence Simplification," Zhang et al., Peking U: https://t.co/QIYYSoWf7R "Conversation Modeling on Reddit using a Graph-Structured LSTM," Zayats and Ostendorf: https://t.co/39mzOig64H "Convolutional Neural Pyramid for Image Processing," Shen et al.: https://t.co/nPXyWYja7I "Recognizing Multi-talker Speech with Permutation Invariant Training," Yu et al., Tencent/Shanghai Jiao Tong U: https://t.co/E2Uu80q6lP "An Automated Text Categorization Framework based on Hyperparameter Optimization," Tellez et al.: https://t.co/zaijRjYool "Training Triplet Networks with GAN," Zieba and Wang: https://t.co/fsYP1ny2Fm "Evolution in Groups: A deeper look at synaptic cluster driven evolution of deep neural networks," Shafiee et al.: https://t.co/MK21jlbsvC "Associative content-addressable networks with exponentially many robust stable states," Chaudhuri and Fiete: https://t.co/qfzTqJaNE5 "Recurrent Environment Simulators," Chiappa et al., DeepMind: https://t.co/il8l4IF4MK "Locally-adapted con.-based super-resolution of irregularly-sampled ocean remote sensing data," López-Radcenco et al https://t.co/dkbw6eEyMK ...https://t.co/x0gBpIj67F "Treatment-Response Models for Counterfactual Reasoning with Continuous-time, Continuous-valued Interventions," Soleimani+Subbaswamy et al.. "Jet Constituents for Deep Neural Network Based Top Quark Tagging," Pearkes et al.: https://t.co/bttiaY6SEv "Video Liveness for Citizen Journalism: Attacks and Defenses," Rahman et al.: https://t.co/DIxi6cVC8N "Speech signals frequency modulation decoding via deep neural networks," Elbaz+Zibulevsky: https://t.co/7U31LIcnUD "Supervised Deep Hashing for Hierarchical Labeled Data," Wang et al.: https://t.co/dJhU8smPjX "Conceptualization Topic Modeling," Tang et al.: https://t.co/jHGICkbdP3 "Generalized Rank Pooling for Activity Recognition," Cherian et al.: https://t.co/EZX9bBnE3j "CCL: Cross-modal Correlation Learning with Multi-grained Fusion by Hierarchical Network," Peng et al.: https://t.co/xSb3dOz5Y1 "Multi-Scale Continuous CRFs as Sequential Deep Networks for Monocular Depth Estimation," Xu et al.: https://t.co/8mjkObsAbM "Egocentric Video Description based on Temporally-Linked Sequences," Bolaños et al.: https://t.co/evO5Xukmlr "Semi-Latent GAN: Learning to generate and modify facial images from attributes," Yin et al.: https://t.co/pg2WPDnNW3 "The (1+λ) Evolutionary Algorithm with Self-Adjusting Mutation Rate," Doerr et al.: https://t.co/IckmtVcIEg "Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensor," Mueller et al.: https://t.co/pzfvzoPTDG "Privacy-Preserving Visual Learning Using Doubly Permuted Homomorphic Encryption," Yonetani et al.: https://t.co/CCQ05Ul2Pn "DeepCoder: Semi-parametric Variational Autoencoders for Facial Action Unit Intensity Estimation," Tran et al.: https://t.co/9wZQ2pAPV6 Tavakoli et al.: https://t.co/ZxOCodFzHE "Investigating Natural Image Pleasantness Recognition using Deep Features + Eye Tracking for Loosely Controlled Human-computer Interaction," "Hand3D: Hand Pose Estimation using 3D Neural Network," Deng et al.: https://t.co/kI0ooLi1Aa "Learned Watershed: End-to-End Learning of Seeded Segmentation," Wolf et al.: https://t.co/SzHcTnEZzW "Deep Unsupervised Similarity Learning using Partially Ordered Sets," Bautista et al.: https://t.co/5AyliVy0yu "TransNets: Learning to Transform for Recommendation," Catherine and Cohen: https://t.co/0x7DnRBPYc "Adversarial Generator-Encoder Networks," Ulyanov et al.: https://t.co/1iWcmiUYjx RT @goodfellow_ian: CycleGAN turning a horse video into a zebra video ( https://t.co/YYCsVt4rIP ) https://t.co/KlZlKG5k6W @kchonyc (assuming hardness of press is related to closeness to home key row... just making this up though :) ) @kchonyc seems roughly correlated with frequency of letters in English - maybe that + a hardness of pressing button factor (hence T exempt)...? @adam_will_do_it lol. @gwern maybe it's less, but I'd be surprised if it weren't already fairly parallelized/if they were just doing it on small hardware. @gwern yeah, that did sound like algo improvement. Still pretty significant compute though (if it were, say, hundreds/thousands of TPUs for a week) Very exciting, high-impact job opportunity - hope lots of good people apply! https://t.co/6IBbv2vS1m @gwern need to see clip to say > (tried to find but didn't) but assuming that's just for inference, not training, seems consistent w/ FLOPS helping @gwern nice find. where is that in the video? I still don't think v 1.0 would have happened w/o big compute. Large effort also a causal mechanism. (any such review will quickly be missing stuff, of course, +nothing from 2017, but looks like good overview up to 2016+broader significance) This looks epic - "Imitation Learning: A Survey of Learning Methods," Hussein et al.: https://t.co/TYJMB0dXsa @jeffbigham my impression is the sensationalist stuff is often people who don't just focus on AI (they cover "tech," or whatever), focused ones better @iamtrask Nice. this workshop report is (hopefully) at the "but it still sucks" stage :-) @_jyan_ who (/what sort of entity) was the requester? @ankurhandos I had the same issue moving to the UK - you'll get used to it :) @SunnyD17 + RNNs are good (vs systems with no memory) for addressing non-Markovian problems... I think, but take this with a grain of salt @dribnet I can't even do manual with a right handed stick so not in any hurry there :) @SunnyD17 I'm not sure I understand the Q/know the answer, sorry :) an Markov *Decision* Process can be addressed with an RNN ... ? @dribnet either this particular car has it on the left or somehow I found it easy to adjust :) I found turns the hardest to adjust to... (I survived) RT @jackclarkSF: Get paid to help world understand AI: FT/PT 6 mo gig (initially) to help analyze/track AI progress for The AI Index. Ping… @ArtirKel (some in the states use manual but it's the minority) @ArtirKel I made sure to get an automatic. I forgot about the wheel being on the right. https://t.co/x5ct5PN0aB @mat_kelcey @adam_will_do_it but in any case, yes, km here but i can use miles on my phone to limit the number of changes today :) @mat_kelcey @adam_will_do_it think Adam was referencing this https://t.co/H6Y4TUEUb1 @jackclarkSF you rock. I recommend it all the time :) @jackclarkSF for just one week? or all time? RT @realDonaldTrump: Now that Obama’s poll numbers are in tailspin – watch for him to launch a strike in Libya or Iran. He is desperate. Driving on the left side of the road for the first time soon... https://t.co/JMpslwo723 @Aelkus nonsense @micahstubbs @KaiLashArul there is on the next one @Aelkus when you're President, they just let you do it. RT @abuaardvark: Trump just bombed Syria. What next? My new @monkeycageblog piece https://t.co/iPtCoWvkH0 RT @sedielem: The TF wrapper we use internally at DeepMind has been open sourced. Lasagne users might like this one, it shares a lot of des… RT @DeepMindAI: Excited to release #Sonnet - a library for constructing complex Neural Network models in TensorFlow. Get started: https://t… @_jyan_ I owe you an email soon :) RT @vkrakovna: Extensive profile on careers in AI safety by @80000Hours https://t.co/gAzjXT286z RT @brianklaas: The strike was justified but it's terrifying that a narcissist obsessed w/ ratings will learn that airstrikes quickly boost… @subarnaT ah, sorry about that! @DonnyGreenberg but really, that could be fun... @DonnyGreenberg I am a paper title attractiveness model. @hardmaru know thy enemy :P @edersantana SAD! "The Relative Performance of Ensemble Methods with Deep CNNs for Image Classification," Ju et al.: https://t.co/SFuw2DxAtu "Learning Certifiably Optimal Rule Lists for Categorical Data," Angelino et al.: https://t.co/i0FvVFmnhR "Statistical Efficiency of Compositional Nonparametric Prediction," Xu et al.: https://t.co/V2Xw78mSLp This is cool - "ActiVis: Visual Exploration of Industry-Scale Deep Neural Network Models," Kahng et al.: https://t.co/KcmQw8geWS "An Online Hierarchical Algorithm for Extreme Clustering," Kobren et al.: https://t.co/Ez4whRDxP3 "Encoder Based Lifelong Learning," Triki et al.: https://t.co/jZ0yEzUfzL "Adequacy of the Gradient-Descent Method for Classifier Evasion Attacks," Han and Rubinstein: https://t.co/QmlH4UDpyn "Accelerated Stochastic Quasi-Newton Optimization on Riemann Manifolds," Roychowdhury + Parthasarathy: https://t.co/kFq88DYGhu "Nonnegative/binary matrix factorization with a D-Wave quantum annealer," O'Malley et al.: https://t.co/UR5xVvHqsK "Robust Causal Estimation in the Large-Sample Limit without Strict Faithfulness," Bucur et al.: https://t.co/SUOj1Lb1rC "Probing many-body localization with neural networks," Schindler et al.: https://t.co/Dw0xGmUV7A "Rhetorical relations for information retrieval," Lioma et al.: https://t.co/Nv5rzpcpah "Preliminary Experiments using Subjective Logic for the Polyrepresentation of Information Needs," Lioma et al.: https://t.co/wvV0RIml01 "A Subjective Logic Formalisation of the Principle of Polyrepresentation for Information Needs," Lioma et al.: https://t.co/fMmo9Ow316 "Part of Speech Based Term Weighting for Information Retrieval," Lioma and Blanco: https://t.co/w6UrOH4ET3 "Multitask Learning with Low-Level Auxiliary Tasks for Encoder-Decoder Based Speech Recognition," Toshniwal et al.: https://t.co/gTLjVL9H8m "Learning Combinatorial Optimization Algorithms over Graphs," Dai and Khalil et al.: https://t.co/GTV1EKqzTv "Multi-space Variational Encoder-Decoders for Semi-supervised Labeled Sequence Transduction," Zhou and @gneubig: https://t.co/GA9jKLw1BE "A Syntactic Neural Model for General-Purpose Code Generation," Yin and @gneubig: https://t.co/gSR4ldbyyS "Generate To Adapt: Aligning Domains using Generative Adversarial Networks," Sankaranarayanan et al.: https://t.co/qmklap92vD "Action Representation Using Classifier Decision Boundaries," Wang et al.: https://t.co/EIDyYGUt5k "Beyond triplet loss: a deep quadruplet network for person re-identification," Chen et al.: https://t.co/vadwnkkxHv "Object-Part Attention Driven Discriminative Localization for Fine-grained Image Classification," Peng et al.: https://t.co/3CdtcBB1WI "How to Make an Image More Memorable? A Deep Style Transfer Approach," Siarohin et al.: https://t.co/IwMTGcsfBs "Enhance Feature Discrimination for Unsupervised Hashing," Hoang et al.: https://t.co/kK0XjPkjNr "A Multi-view Context-aware Approach to Android Malware Detection and Malicious Code Localization," Narayanan et al. https://t.co/wtFTxhxdBS "Latent Viral Marketing, Concepts and Control Methods," Sela et al.: https://t.co/mrUfcl8KVe "Geometry of Policy Improvement," Montufar and Rauh: https://t.co/PnhPbmXZ93 "Neural Question Generation from Text: A Preliminary Study," Zhou et al.: https://t.co/FuClKBnO1b "Higher-Order Minimum Cost Lifted Multicuts for Motion Segmentation," Margret Keuper: https://t.co/O5FR6HZbrx "Bilateral Proofs of Safety and Progress Properties of Concurrent Programs," Jayadev Misra: https://t.co/kXXeJAkWyg "Incremental Transductive Learning Approaches to Schistosomiasis Vector Classification," Fusco et al.: https://t.co/nrKYQrrgor "A Conv.Tree with Deconvolution Branches: Exploiting Geom. Relationships for 1-Shot Keypt Detection," Kumar/Chellapa https://t.co/ivFXM95ESZ "Landmark Guided Probabilistic Roadmap Queries," Paden et al.: https://t.co/PDHwKfjyvR "Conformative Filtering for Implicit Feedback Data," Khawar et al.: https://t.co/JvOEohThrL "Online Hashing," Huang et al.: https://t.co/bIqvUmOFuw "Automated Latent Fingerprint Recognition," Cao and Jain: https://t.co/VHJqqc37N0 "Semantically-Guided Video Object Segmentation," Caelles and Chen et al.: https://t.co/D4cOAW32eT "The Interplay of Semantics and Morphology in Word Embeddings," Avraham and @yoavgo: https://t.co/N20i6QPsfj "Me in January: Hopefully this doesn't end in nuclear war... Me in April: Hopefully this doesn't end in a *big* nuclear war..." @AMP_SV @davegershgorn that's why it'd be easier if Dave just did it himself, and tweeted results selectively. Main thing to look out for is copying verbatim @davegershgorn @AMP_SV As a first pass, you could just remove sender info/timestamps/subjects, and put the text in here - https://t.co/ShigM1WZIY @AMP_SV @davegershgorn indeed. could be cleaned but would prob take a lot of Dave's time. @AMP_SV @davegershgorn Think @AMP_SV would be better at this :) would love to see it happen... @davegershgorn how clean is the data? Is it *just* pitches? @davegershgorn I @davegershgorn you should train an RNN on these pitch emails at some point. @ivan_bezdomny how so? /how does that affect the validity of the metric? :) Joking, but my standards for tweeting haven't changed that much, so not 100% crazy. Higher % of new papers going on arXiv, though, it seems. By this metric, AI progress has sped up around 2-3x in the past 6 months... https://t.co/w4km8hx7ar @jackclarkSF (being facetious, but it seems like that'd be pretty easy to do with some additional engineering/different data) @jackclarkSF but can it beat these folks at Wheel of Fortune? https://t.co/P1tOJS0st3 RT @rbhar90: Great write-up in the Stanford Daily about our one-shot methods for low data drug scovery https://t.co/Mzf6gFZMW3 RT @sedielem: I've been working on WaveNet autoencoders with @GoogleBrain Magenta. blog post: https://t.co/o4oDVRl9Rh paper: https://t.co/I… RT @KaiLashArul: This is industrial ML research at its best. Data for everyone to use. Code for replicability. Weights for research and oth… @edersantana SI? @edersantana bold claim. The cycle time of GAN fiddling is pretty short :) @jwan584 (I don't know the answer to the Q, just thinking out loud) @jwan584 by being better at training? By actually selling hardware (or is Google doing that with TPUs)? RT @nvidia: The TITAN Xp is here—3840 CUDA, 12 TFLOPs of brute force, and 12 GB of GDDR5X. https://t.co/IwehnnxM5D https://t.co/3kjWMqHwjM "RT @WillClinPsy: Our new meta-analysis provides evidence that autism is under-recognised in girls https://t.co/A1t4FPbuYm" RT @alexjc: WaveNet auto-encoder applied as synthesizer for musical notes, also new instrument dataset: https://t.co/kGz1XGi666 Can interpo… RT @carrasqu: @Miles_Brundage We've shown that ground states of the toric code Hamiltonian can be written as conv nets in https://t.co/oTfj… "RT @random_walker: On the Impossibility of Supersized Machines https://t.co/BVVx4REIQj This satirical paper is going on my all time favorit…" RT @politico: Trump's skeletal team will be going up against a vastly more experienced Chinese corps of experts https://t.co/4OarKPeoIm htt… @ArtirKel don't think so. RT @blakehounshell: U.S. Strategic Command, which controls America’s nuclear strike forces, is linking to Breitbart. https://t.co/qTJwrTbnan @fchollet prob wouldn't have tweeted if I didn't see Amnon Shashua was an author, sounded sketchy ;) RT @DeepStackAI: Our DeepStack implementation for NL Leduc Hold'em is now on GitHub: https://t.co/0xk6MISUXu @aarvy91 @hardmaru Not creepy in terms of the actual data, I don't think (didn't look carefully), I'm just generally concerned about surveillance getting easy "Deep Learning and Quantum Physics: A Fundamental Bridge," Levine et al.: https://t.co/8zXcsa42uY @_jyan_ @deep_rl ah, thx for flagging. I accidentally linked to it when tweeting another paper, was told it was wrong link, then forgot to reopen :) @miishke read: small fraction (100% at least glanced/skimmed, 5-10% actually read). replicated: 0. @hardmaru yes, certainly on the creepier end of the dataset spectrum. Person reidentification also kinda bothers me... @_jyan_ It's a common perspective, for sure. I also hear the opposite a fair amount. "Incremental Tube Construction for Human Action Detection," Behl et al.: https://t.co/hG214ja0xI "On the Relation between Color Image Denoising and Classification," Wu et al.: https://t.co/xZWaQ6hUx6 "Embodied AI through Distributed Adaptive Control: An Integrated Framework," Moulin-Frier et al.: https://t.co/6bbZ2HUEeN "Linear Ensembles of Word Embedding Models," Muromagi et al.: https://t.co/KhgMna9sGq "OEC: Open-Ended Classification for Future-Proof Link-Fraud Detection," Shah et al.: https://t.co/b1B3O2whnv "Data-driven Approach 2 Measuring the Level of Press Freedom Using Media Attn Diversity from Unfiltered News"An+Kwak https://t.co/PwoRy7V2ZW "What Gets Media Attention+How Media Attn Evolves Over Time - Large-scale Emp. Ev. from 196 Countries," An+Kwak: https://t.co/Q9bJXspqFX "The UMCD Dataset," Avola et al.: https://t.co/c335jWmWsq (UAV stuff) "AMIDST: a Java Toolbox for Scalable Probabilistic Machine Learning," Masegosa et al.: https://t.co/8e33VCLJCb "Non-Convex Weighted Lp Minimization based Group Sparse Representation Framework for Image Denoising," Wang et al.: https://t.co/mWWStUEI8T "Probabilistic Plan Synthesis for Coupled Multi-Agent Systems," Nikou et al.: https://t.co/d5JPzc4WLp ...Paladugu et al. "Supporting Navigation of Outdoor Shopping Complexes for Visually-impaired Users through Multi-modal Data Fusion," - https://t.co/8WwDtX0hAe "Geometry of Factored Nuclear Norm Regularization," Li et al.: https://t.co/taWcayi4RH "Joint Regression and Ranking for Image Enhancement," Chandakkar and Li: https://t.co/kulqonQ1MJ "A General Framework for Multi-vehicle Cooperative Localization Using Pose Graph," Shen et al.: https://t.co/96YLttl1r9 "Two Stream LSTM: A Deep Fusion Framework for Human Action Recognition," Gammulle et al.: https://t.co/lMGgoJfUT9 "Scene-level Programming by Demonstration," Zeng et al.: https://t.co/oNnMk8B2fs "Satellite Image-based Localization via Learned Embeddings," Kim and Walter: https://t.co/kDQSy4MQdj "DyVEDeep: Dynamic Variable Effort Deep Neural Networks," Ganapathy et al.: https://t.co/ehRKva0mMY "Parsimonious Data: How a single Facebook like predicts voting behaviour in multiparty systems," Kristensen et al.: https://t.co/AjWnDkgg3w "Pose2Instance: Harnessing Keypoints for Person Instance Segmentation," Tripathy et al.: https://t.co/VTxTnnW9Uz "Feature Squeezing: Detecting Adversarial Examples in Deep Neural Networks," Xu et al.: https://t.co/4Mu4qnXPZF "Finite Sample Analysis for TD(0) with Linear Function Approximation," Dalal et al.: https://t.co/69E6KLMdqi "CompiLIG at SemEval-2017 Task 1: Cross-Language Plagiarism Detect. Methods 4 Seman. Text. Similarity"-Ferrero et al https://t.co/aWYnKzHUDw "Quantifying Search Bias: Investigating Sources of Bias for Political Searches in Social Media," Kulshrestha et al: https://t.co/nc3JB2Z8Gq "Not All Pixels Are Equal: Difficulty-aware Semantic Segmentation via Deep Layer Cascade," Li et al.: https://t.co/GC4Q80suLn "Model-Driven Analytics: Connecting Data, Domain Knowledge, and Learning," Hartmann et al.: https://t.co/bbqlK6u7w7 "Character-based Joint Segmentation and POS Tagging for Chinese using Bidirectional RNN-CRF," Shao et al.: https://t.co/DlQ7LBgyyS "Smart Mining for Deep Metric Learning," Kumar et al.: https://t.co/wctdqSlywI "Best Practices for Applying Deep Learning to Novel Applications," Leslie Smith: https://t.co/phXo2qpIVg "Generating Descriptions with Grounded and Co-Referenced People," Rohrbach et al.: https://t.co/5Y9Q57seMJ "Isotropic reconstruction of 3D fluorescence microscopy images using convolutional neural networks," Weigert et al. https://t.co/ZxeVHaffHz "An in-depth characterisation of Bots and Humans on Twitter," Gilani et al.: https://t.co/dEJ29DVVqV "Weakly Supervised Dense Video Captioning," Shen et al.: https://t.co/oKuy1ihccX "A Unified Multi-Faceted Video Summarization System," Sahoo et al.: https://t.co/mfpoNu9Fxz "Effect of Super Resolution on High Dimensional Features 4 Unsupervised Face Recognition in the Wild," Elsayed et al https://t.co/YWnJyKtRlo "Approximation Vector Machines for Large-scale Online Learning," Le et al.: https://t.co/MQq9OZYyqp "Linear Additive Markov Processes," Kumar et al.: https://t.co/7coOLxBFfF "Convolutional Neural Networks for Page Segmentation of Historical Document Images,' Chen and Seuret: https://t.co/xda4JjoAeC "Revisiting the problem of audio-based hit song prediction using convolutional neural networks," Yang+Chou et al.: https://t.co/pxqrjq3FGs "MIT at SemEval-2017 Task 10: Relation Extraction with Convolutional Neural Networks," Lee et al.: https://t.co/5YNWdi9NCj "On Generalization and Regularization in Deep Learning: An Introduction for Data Scientists," Pirmin Lemberger: https://t.co/kYBXftoYsi "On the construction of probabilistic Newton-type algorithms," Wills and Schon: https://t.co/AruPENmPxI "Comparison Based Nearest Neighbor Search," Haghiri et al.: https://t.co/l6jTyBV8xC "Detecting confounding in multivariate linear models via spectral analysis," Janzing and Schoelkopf: https://t.co/Y6fMtAVKSk "Bayesian Inference of Log Determinants," Fitzsimons et al.: https://t.co/29JS6bw2hk "Learning Approximately Objective Priors," Nalisnick and Smyth: https://t.co/SzhRmL6nWp "Comment on 'Biologically inspired protection of deep networks from adversarial attacks'," Brendel and Bethge: https://t.co/BIVGvKmkYa "Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders," Engel and Resnick et al., Google Brain/DeepMind https://t.co/MGl1Y6X6Qw "Neural Message Passing for Quantum Chemistry," Gilmer et al., Google Brain/DeepMind: https://t.co/uich427iYh "Learning to Generate Reviews and Discovering Sentiment," @AlecRad et al., OpenAI: https://t.co/GytU9hyXGC RT @dennybritz: TPUs are amazing, but let’s not forget that this is for inference, not for training, which is often the bottleneck in resea… @benjaminwittes because he didn't really have views on it before, and wasn't paying attention. Now he's half-paying attention. RT @Miles_Brundage: If you have connections in Congress or the WH, make your voice heard in favor of ARPA-E! This is a critical time. https… @davegershgorn AI comes at you fast... RT @hardmaru: Quantifying the performance of the TPU. https://t.co/ZTEl367Bnl "RT @soumithchintala: Google's TPU paper is out. 8-bit matmul processor, large on-die memory (28MB). Excited to finally read the details.. h…" @girlziplocked congrats! RT @mtyka: WGAN, BE-GAN, WGAN2, LsGAN, CycleGAN, staahhhhp! Who's supposed to keep up with this torrent !? https://t.co/UgakwhA2pl RT @AdamBKushner: What will an unpopular president obsessed with being popular do? Escalate a foreign policy crisis. By @dandrezner https:/… RT @business: BREAKING: Bannon removed from National Security Council https://t.co/56qYpHGBeA https://t.co/hZFwcBcLx8 RT @goodfellow_ian: https://t.co/n60F80uoll @michael_nielsen Is it that different from physicists at Intel/IBM? In both cases (semiconds and AI), some (not all) undirected, but also broad goal in mind. "Probabilistic Search for Structured Data via Probabilistic Programming and Nonparametric Bayes," Saad et al.: https://t.co/YjXFGydV4q "Unsupervised Action Proposal Ranking through Proposal Recombination," Soltani et al.: https://t.co/dibMO8nHKO "AMC: Attention guided Multi-modal Correlation Learning for Image Search," Chen et al.: https://t.co/oPp6zfoCJQ "A Genetic Programming Approach to Designing Convolutional Neural Network Architectures," Suganuma et al.: https://t.co/TXkFPxC99b "Restricted Recurrent Neural Tensor Networks," Salle and Villavicencio: https://t.co/vhWjAlqhzx "Online and Linear-Time Attention by Enforcing Monotonic Alignments," Raffel et al.: https://t.co/YPK3gQY3BS "Brief Notes on Hard Takeoff, Value Alignment, and Coherent Extrapolated Volition," Gopal Sarma: https://t.co/7HQ1PEcNuM "Cascaded Segmentation-Detection Networks for Word-Level Text Spotting," Qin and Malduchi: https://t.co/4ClSYW7UDG "Guided Proofreading of Automatic Segmentations for Connectomics," Hoehn et al.: https://t.co/TEcGFMOM7e "Simultaneous Feature Aggregating and Hashing for Large-scale Image Search," Do et al.: https://t.co/Jet8yqGe9r "Interacting With a Mobile Robot with a Natural Infrastructure-Less Interface," Villani et al.: https://t.co/trtSnjfQd0 "Japanese Sentiment Classification using a Tree-Structured Long Short-Term Memory with Attention," Miyazaki et al.: https://t.co/o0PWo2cFxK "Adaptive Motion Gaming AI for Health Promotion," Paliyawan et al.: https://t.co/zhN4wpF1Wf "OctNetFusion: Learning Depth Fusion from Data," Riegler et al.: https://t.co/3GiLmSJhBx "Using Echo State Networks for Cryptography," Ramamurthy et al.: https://t.co/OFa1EncnSh "ME R-CNN: Multi-Expert Region-based CNN for Object Detection," Lee et al.: https://t.co/wYeJrmNyne "Emotional Chatting Machine: Emotional Conversation Generation with Internal and External Memory," Zhou et al.: https://t.co/cmVTv1wgUe "Deep Depth From Focus," Hazirbas et al.: https://t.co/ToddnIPZYb "Data-Injection Attacks in Stochastic Control Systems: Detectability and Performance Tradeoffs," Bai et al.: https://t.co/1jDwBFKQ6e "A comparative study of counterfactual estimators," Nedelec et al.: https://t.co/5CB85vVJrf "Geometric Insights into Support Vector Machine Behavior using the KKT Conditions," Carmichael and Marron: https://t.co/aiPO42EF0J Demo - https://t.co/DYV7sCMA1T "Voice Conversion from Unaligned Corpora using Variational Autoencoding Wasserstein GANs," Hsu et al.: https://t.co/cZMBPEpCMc Please get in touch if you are interested in ways to make your voice heard on this. While you're at it, speak up for DOE's other energy investments, too. With what's going on at EPA, we need DOE's work more than ever. See here for just some of the impacts ARPA-E has had on the US energy innovation ecosystem: https://t.co/AalzHrGSvO If you have connections in Congress or the WH, make your voice heard in favor of ARPA-E! This is a critical time. https://t.co/AqSI2clDKk Sidenote: I'm pretty impressed with (Microsoft) Maluuba so far. They put out a lot of seemingly good stuff. """Multi-Advisor Reinforcement Learning,"" Laroche et al., Maluuba*: https://t.co/iYOQVhlUbX *now ""Microsoft Maluuba""" RT @MIRIBerkeley: More on image recognition progress in AI, from data analyst Sarah Constantin: https://t.co/12znuQj1Mb RT @dmonett: "For human-AI teams to be effective, humans must also develop theory of #AI's mind, get to know its strengths, weaknesses, bel… @y0b1byte For sure! Email is in the upper right here: https://t.co/LDoKl877oV "RT @ShaneGoldmacher: Trump puts out a Syria gas-attack statement. Says it ""cannot be ignored."" Blames Obama. Says nothing about what he…" RT @karpathy: Came to visit first class of @cs231n at Stanford. 2015: 150 students, 2016: 350, this year: 750. #aiinterestsingularity https… Appropriate name. https://t.co/mWdD6yHHUW @carpedm20 is amazing - that was super fast! https://t.co/9xdDKefWk7 RT @alxndrkalinin: #PyTorch implementation of BEGAN: Boundary Equilibrium Generative Adversarial Networks by @carpedm20 https://t.co/frUVB2… RT @NBCNightlyNews: UPDATE: Reports: More than 50 people, including children, killed in suspected chemical attack and bombing in Syria. htt… @brubsby but still cool findings (e.g. pro with characteristic X like enforcement prob correlated w/ design Y like centralized monitoring) @brubsby interestingly but maybe appropriately, thats not a variable analyzed in this book (how negotiation worked). Focus is on text itself (as opposed to states not taking them seriously, or them just being copied from templates/poorly thought out, etc.) Great book on int'l agreements. Argues persuasively that they're generally rationally designed according to characteristics of probs/actors. https://t.co/YKFxSF2qKd Shoot, I just revealed my plan... Terminator 7: Skynet Rising. John and Sarah Connor are buried in a pile of arXiv papers, too busy to see the robots on the horizon. RT @jasonnurse: Dutch parliament hit by 'ransomware' attack: ANP news https://t.co/9kLvHKoT69 via @Reuters #ransomware #cyberattack #govern… RT @alexjc: Improved Training of Wasserstein GANs https://t.co/XTbRlQSune More stable, no hyper-parameter tuning, works on 101-ResNet! #ML… "RT @GokuMohandas: Notes on catastrophic forgetting and recent combating techniques. https://t.co/03Z2fezRHl" Fin. "Efficient acquisition rules for model-based approximate Bayesian computation," Jarpenvaa et al.: https://t.co/TQYWZKerID "Exploiting gradients and Hessians in Bayesian optimization and Bayesian quadrature," Wu et al.: https://t.co/QS18nlbXr8 "A Multi-Index Markov Chain Monte Carlo Method," Jasra et al.: https://t.co/yHw15i8T1D "Mixture Hidden Markov Models for Sequence Data: The seqHMM Package in R," Helske and Helske: https://t.co/j7wq2uClzs "A Transition-Based Directed Acyclic Graph Parser for UCCA," Hershcovich et al.: https://t.co/uWExHGB2Ss "AutoSVD++: An Efficient Hybrid Collaborative Filtering Model via Contractive Auto-encoders," Zhang et al.: https://t.co/Jg9Xgd11gA "Neural Lattice-to-Sequence Models for Uncertain Inputs," Sperber et al.: https://t.co/Nn4wxmx2cB "Spatiotemporal Networks for Video Emotion Recognition," Fan and Ke: https://t.co/oYwn9TM5Q7 "Chained Multi-stream Networks Exploiting Pose, Motion+Appearance 4 Action Classification+Detection"Zolfaghari et al https://t.co/WKQtxImtpf ...Seung and Zung: https://t.co/tO6wgDJN8k "A correlation game for unsup. learning yields computational interps of Hebbian excitation, anti-Hebbian inhibition, + synapse elimination" "Detection and Resolution of Rumours in Social Media: A Survey," Zubiaga et al.: https://t.co/ATYld0VyhO "Soft-to-Hard Vector Quantization for End-to-End Learned Compression of Images + Neural Networks," Agustsson et al. https://t.co/CoJEJQi4LO "The 2017 DAVIS Challenge on Video Object Segmentation," Pont-Tuset et al.: https://t.co/SjCpr6z8h7 "Big Holes in Big Data: A Monte Carlo Algorithm for Detecting Large Hyper-rectangles in High D Data," Hemley et al.: https://t.co/FHKCkbay6W "Hierarchical Surface Prediction for 3D Object Reconstruction," Hane et al.: https://t.co/vTkuyULIuU "A New Measure of Conditional Dependence for Causal Structural Learning," Etesami et al.: https://t.co/HWVAUhVp8A "Semi-Supervised Generation with Cluster-aware Generative Models," Maaloe et al.: https://t.co/078cuJ6A67 "Customizing First Person Image Through Desired Actions," Su et al.: https://t.co/qAAwnb3ykI "SafetyNet: Detecting and Rejecting Adversarial Examples Robustly," Lu et al.: https://t.co/X7BqJGrtjN ...Jiang et al.: https://t.co/K6KeFEfe3Q "Configurable, Photorealistic Image Rendering and Ground Truth Synthesis by Sampling Stochastic Grammars Representing Indoor Scenes"... "Snapshot Ensembles: Train 1, get M for free," Huang and Li et al.: https://t.co/YAu2ZEQRb0 "Multiple Instance Detection Network with Online Instance Classifier Refinement," Tang et al.: https://t.co/GBtPwmKTA7 "Who Makes Trends? Understanding Demographic Biases in Crowdsourced Recommendations," Chakraborty et al.: https://t.co/SXPEKIggb8 "Real-World Recommender Systems for Academia: The Pain+Gain in Building, Operating,+Researching them," Beel/Dinesh: https://t.co/NwGKLZKfSN "Clustering-based Source-aware Assessment of True Robustness for Learning Models," Kilinc and Uysal: https://t.co/VC3Qa0mB4F "Compositional Human Pose Regression," Sun et al.: https://t.co/XfQMGWZmio "Sentiment Analysis of Citations Using Word2vec," Haixia Lu: https://t.co/PC6NKUPxEM "Multimodal Dialogs (MMD): A large-scale dataset for studying multimodal domain-aware conversations," Saha et al.: https://t.co/f7IJY0SSV3 "Adversarial Connective-exploiting Networks for Implicit Discourse Relation Classification," Qin et al.: https://t.co/XOMuaYBV7y "Transfer Learning for Improving Model Predictions in Highly Configurable Software," Jamshidi et al.: https://t.co/7gTgk1591r "A-Lamp: Adaptive Layout-Aware Multi-Patch Deep CNN for Photo Aesthetic Assessment," Ma et al.: https://t.co/Dk7GUhCBEY "Building a Neural Machine Translation System Using Only Synthetic Parallel Data," Park et al.: https://t.co/jRzILXUKGk "Aligned Image-Word Representations Improve Inductive Transfer Across Vision-Language Tasks," Gupta et al.: https://t.co/DZvjK0xTQe "Structured Parallel Programming for Monte Carlo Tree Search," Mirsoleimani et al.: https://t.co/bcB5zChCfH "Understanding Deep Representations through Random Weights," Shu et al.: https://t.co/Ab4mXvZu01 "Dense Multi-view 3D-reconstruction Without Dense Correspondences," Queau et al.: https://t.co/AKCBOjuA8j "Understanding Concept Drift," Webb et al.: https://t.co/vLrqvMUoFt "Word-Alignment-Based Segment-Level Machine Translation Evaluation using Word Embeddings," Matsuo et al.: https://t.co/PISuo13527 "Hidden Two-Stream Convolutional Networks for Action Recognition," Zhu et al.: https://t.co/cedM8eV16X "Geometric loss functions for camera pose regression with deep learning," Kendall and Cipolla: https://t.co/u81q6zU5uv "Syntax Aware LSTM Model for Chinese Semantic Role Labeling," Qian et al.: https://t.co/M4UvwpE51m "Combining Lexical and Syntactic Features for Detecting Content-dense Texts in News," Yang and Nenkova: https://t.co/yq8U3NecHE "Learning a Variational Network for Reconstruction of Accelerated MRI Data," Hammernik et al.: https://t.co/jaGkd3S0rf ...Bellafqira et al.: https://t.co/jZcwxRqnis "Secured Outsourced Content Based Image Retrieval Based on Encrypted Signatures Extracted From Homomorphically Encrypted Images," ... "Truncating Wide Networks using Binary Tree Architectures," Zhang et al.: https://t.co/uiaPQfXReT "Multi-Task Learning of Keyphrase Boundary Classification," Augenstein and Sogaard: https://t.co/M9XoM4oqkX "Capturing Hand Motion with an RGB-D Sensor, Fusing a Generative Model with Salient Points," Tzionas et al.: https://t.co/c3HIfC2Qxs "Spectral Methods for Nonparametric Models," Tung et al.: https://t.co/uZRtVT5kWa "Improved Training of Wasserstein GANs," Gulrajani et al.: https://t.co/4ViEf6PU7k "Transfer of View-manifold Learning to Similarity Perception of Novel Objects," Lin et al.: https://t.co/lGKHXaYVQl "Reading Wikipedia to Answer Open-Domain Questions," Chen et al., Facebook: https://t.co/r6kzswu4lW "One-Shot Neural Cross-Lingual Transfer for Paradigm Completion," Kann et al.: https://t.co/Q7iTZH3HUz "Frames: A Corpus for Adding Memory to Goal-Oriented Dialogue Systems," El Asri et al., Maluuba: https://t.co/mX7O4HZGAy "using just [50] examples, lay people can be trained to better predict responses +..failures of a complex VQA model" https://t.co/uhL6OeCtxq "It Takes Two to Tango: Towards Theory of AI's Mind," Chandrasekaran, Yadav, Chattopadhyay, + Prabhu et al.: https://t.co/d2wFqnrZHX BREAKING: tons of stuff on arXiv. :( @gwern Probably just some editor was annoyed or heard from someone who was. @gwern Because there's an industry that benefits from fear of supersized machines. Really, though, I don't think we violated the terms or anything. Fortunately, the supersized machine hype industry doesn't run arXiv... This quickly became the 22nd most downloaded paper of all time on https://t.co/J7qj30Au64 but then got deleted. SAD! https://t.co/wlqzQIDuOp @AlexGDimakis don't know. It isn't mentioned in the paper. @egrefen @iamtrask got the same email... RT @dandrezner: China will try to buy off the Trump administration this week. I fear that it will work. https://t.co/9X9YRhMlGz "RT @RikeFranke: The US is now registering 100 000 (hobbyist/ commercial) #drones ever 3 months https://t.co/L6duVn0ZM6" RT @bartongellman: Good Lord: 40 zero-day vulnerabilities disclosed today in your Samsung “smart” tv. Many offer easy remote surveillance.… @TerryUm_ML various ones but most recently - https://t.co/Bi0QoBLEqm @_jyan_ @hardmaru @KaiLashArul @ankurhandos but I do think he has lots of good ideas/wouldn't be surprised to see more breakthroughs from him/them. @_jyan_ @hardmaru @KaiLashArul @ankurhandos doubt there is just one remaining key, + lots of ppl are working on world models... think this is a >>Twitter length discussion :) @_jyan_ @hardmaru @KaiLashArul @ankurhandos (I also suspect it's not as simple as just crossing one threshold - vs. engineering, hardware, lots of training, etc involved in scaling up) @_jyan_ @hardmaru @KaiLashArul @ankurhandos I find that v. unlikely, but certainly more likely than other companies of comparable size. Will be interesting to see what they publish. @_jyan_ @hardmaru @KaiLashArul @ankurhandos (more than a few months ago, though :) ) @_jyan_ @hardmaru @KaiLashArul @ankurhandos He wrote in some paper something like "How long until [recursively self-improving AI or something]? Probably not in the next few months." RT @KaiLashArul: Doing a little lit review and once again amazed by Schmidhuber's work. Using RL for visual attention back in '91, before I… RT @deliprao: Who are some awesome #deeplearning /#nlproc people in India? Asking for a friend. He's doing some cool work. DM pls Activity recognition is getting pretty good. @hardmaru man, I am really uncreative. "Prediction of infectious disease epidemics via weighted density ensembles," Ray et al.: https://t.co/sOPRAjMmP0 "The Risk of Machine Learning," Abadie and Kasy (as in mean squared error stuff, not societal risk stuff): https://t.co/ZUZx6cPdmM "What-If Reasoning with Counterfactual Gaussian Processes," Schulam and @suchisaria: https://t.co/32V2aEWU6K "Diving into the shallows: a computational perspective on large-scale shallow learning," Ma and Belkin: https://t.co/mj44Deb5dd "Comparison of multi-task convolutional NN (MT-CNN) and a few other methods for toxicity prediction," Wu et al.: https://t.co/khTwDjUbnN "Audio-Visual Speech Enhancement based on Multimodal Deep Convolutional Neural Network," Hou et al.: https://t.co/l6bh84Gsia (and title) - Owhadi and Scovel: https://t.co/lVJrz5UtsE Massive "paper": "Universal Scalable Robust Solvers from Computational Information Games + fast eigenspace adapted Multiresolution Analysis" "Factorization tricks for LSTM networks," Kuchaiev and Ginsburg, NVIDIA: https://t.co/mB7GiyeeOM "Near Perfect Protein Multi-Label Classification with Deep Neural Networks," Szalkai and Grolmusz: https://t.co/GMfGYDzDeW "Catalyst Acceleration for Gradient-Based Non-Convex Optimization," Paquette et al.: https://t.co/TO8dZq7Yhw "Interpretable Learning for Self-Driving Cars by Visualizing Causal Attention," Kim and Canny: https://t.co/VB9TMsejyk "Deep Neural Network Optimized to Resistive Memory with Nonlinear Current-Voltage Characteristics," Kim et al.: https://t.co/Ve050nEjEu "Relevance Subject Machine: A Novel Person Re-identification Framework," Fedorov et al.: https://t.co/8h3Po6Tzfe "Towards a Visual Privacy Advisor: Understanding and Predicting Privacy Risks in Images," Orekondy et al.: https://t.co/pgXOekNlj5 "Tube Convolutional Neural Network (T-CNN) for Action Detection in Videos," Hou et al.: https://t.co/QPBrbR6KVN "TS-LSTM and Temporal-Inception: Exploiting Spatiotemporal Dynamics for Activity Recognition," Ma et al.: https://t.co/BYfWmO9UCx "Knowledge Rich Natural Language Queries over Structured Biological Databases," Hasan Jamil: https://t.co/YjzttcYmns "Deep 3D Face Identification," Kim et al.: https://t.co/N5uMamVhmi "N-gram Language Modeling using Recurrent Neural Network Estimation," Chelba et al.: https://t.co/LyezYZoL4H "Deep Domain Adaptation Based Video Smoke Detection using Synthetic Smoke Images," Xu et al.: https://t.co/dhazsAnTuL "Unsupervised Holistic Image Generation from Key Local Patches," Lee et al.: https://t.co/iB551X5P0I "On Self-Adaptive Mutation Restarts for Evolutionary Robotics with Real Rotorcraft," Gerard Howard: https://t.co/9w6lx3My2V "Diabetic Retinopathy Detection via Deep Conv. Nets 4 Discriminative Localization+Visual Explanation," Wang+Yang, GE https://t.co/YJoWqKYZCY "Joining Hands: Exploiting Monolingual Treebanks for Parsing of Code-mixing Data," Bhat et al.: https://t.co/Xs3p9NwG38 "Semantic-driven Generation of Hyperlapse from 360 deg. Video," Lai et al.: https://t.co/ggBgwi5Dtb "End-To-End Face Detection and Recognition," Chi et al.: https://t.co/GpGqibn1Xk "MidiNet: A Convolutional GAN for Symbolic-domain Music Generation using 1D and 2D Conditions," Yang et al.: https://t.co/qgQd9Oboyn "(DE)^2 CO: Deep Depth Colorization," Carlucci et al.: https://t.co/pyDsBB4nSn (Rad and Lepetit) "A Scalable, Accurate, Robust to Partial Occl. Method 4 Predicting...3D Poses of Challenging Objs w/out Using Depth" https://t.co/9P3jtm4D6E "Thin-Slicing Network: A Deep Structured Model for Pose Estimation in Videos," Song et al.: https://t.co/BsQ3iyeyWP "Unsupervised learning from video to detect foreground objects in single images," Croitoru et al.: https://t.co/4k5BZhtfn5 "Quicksilver: Fast Predictive Image Registration - a Deep Learning Approach," Yang et al.: https://t.co/zYKJ0e1OwY "Unifying Message Passing Algorithms Under the Framework of Constrained Bethe Free Energy Min.-zation," Zhang et al: https://t.co/XGmmTedwDU "Sentence Simplification with Deep Reinforcement Learning," Zhang and Lapata: https://t.co/9MRJlc1Hcu "Exposing Twitter Users to Contrarian News," Garimella et al.: https://t.co/rlXlddzVcq CC @TheAnnaGat "InverseFaceNet: Deep Single-Shot Inverse Face Rendering From A Single Image," Kim et al.: https://t.co/d3GTUSE161 "Learning Discourse-level Diversity for Neural Dialog Models using Conditional Variational Autoencoders," Zhao et al https://t.co/3XIS55tlp2 "Diversity of preferences can increase collective welfare in sequential exploration problems," Analytis et al.: https://t.co/bulQ05EScn "On the Impossibility of Supersized Machines," Garfinkel et al. (in case you missed it on Saturday): https://t.co/FGJCkj4rMf "Fundamental Parameters of Main-Sequence Stars in an Instant with Machine Learning," Bellinger et al.: https://t.co/nCG3LTrdME @michael_nielsen yeah, this one is a huge jump in the face department. would be interesting to see how it compares on other datasets... Super impressive image quality - "BEGAN: Boundary Equilibrium Generative Adversarial Networks," Berthelot et al: https://t.co/EeLlEx22HV https://t.co/SPdC2cV9O8 RT @roydanroy: It's 2001 all over again. https://t.co/J4YCwzk2Ye Computing nonvacuous generalization bounds for (stochastic) deep nets usin… RT @samim: Startups are Cults in the business space. https://t.co/jyLXPJFZLK RT @rajcheerfull: #innovation 👌 https://t.co/36FY5KT44X RT @NandoDF: Wednesday is my last day in Oxford. Plan to focus on teaching ML / AI summer schools in Canada (@CIFAR_News) and in Africa wit… Quick reminder that the President of the US has gone full Caligula. https://t.co/n0H3lyhSoW @deliprao besides coauthor a few Google papers, dunno. I gather he developed some OCR and text to speech products but dunno how much science v eng.. @juliagalef You may enjoy this - https://t.co/eSTvNrBgA9 different uses of the term, + context of discussion, but relevant + nice read... RT @TheRealBuzz: I applied to be a Rhodes Scholar twice and was turned down. How different my life would have been. Sometimes failures lead… @mat_kelcey lol. 12 years, actually (book was released in 2005, thought it was 2007). .@AI_Pol CC @jackclarkSF (you asked about the vid) @SparseJacobian lol that would be amazing. though AFAIK, he maintains a late 2020s human-level AI timeline + something else more singularity-y in 2030s/40s. @AMP_SV the thought has definitely occurred to me... and he is showing lots of signs of aging despite taking 100+ pills a day. @AMP_SV and announced well before April 1 :) I find it hilarious that Kurzweil is writing a book called "The Singularity is Nearer" (+ isn't that implied by the passage of 10 years?). .@AI_Pol thanks @deliprao for the video truncation link :) Video of a talk I gave yesterday on long-term AI policy at @AI_Pol: https://t.co/0AUdIbaPjv @deliprao nice :) RT @Nale: Dear Twitter - send me your riveting questions about building AI products. Specifically implications for women & underrepresented… @thinkmariya probably "unpaired image-to-image translation" and "speaking the same language," but I haven't read either fully, way behind :) @Aelkus I read it a long time ago and don't remember it well... @Aelkus why now? @RebeccaCrootof @levendowski SAD! RT @ProfDavidHart: MIT's Bill Bonvillian shows why killing ARPA-E would be foolish for climate and much else @apgoldst https://t.co/aRUfJdB… @rcalo (I'm one of them) @RebeccaCrootof and @SophieCFischer discussing lethal autonomous weapons at #WeRobot2017 right now - https://t.co/rJpmEZbsay RT @tegmark: We just posted a paper thoroughly debunking the possibility of building super-human machines in the future: https://t.co/ujYyu… RT @markus_with_k: We should always be as skeptical as on the 1st of April! RT @OpenAI: We've created the world's first Spam-detecting AI trained entirely in simulation and deployed on a physical robot: https://t.co… RT @zacharylipton: BREAKING NEWS: DeepMind Solves Artificial General Intelligence, Summons Demon. Exclusive Story: https://t.co/JFSd8c51Z9 @levendowski the livestream has a slight delay so I am continually impressed with your predictive tweets. "RT @erikbryn: Powerful new paper by @tegmark + other giants demolishes myth of super-human machines #AI #Size ht: @robinhanson https://…" @robinhanson Probably, though I wouldn't call this an argument so much as a joke. @sknthla I was a big fan of this https://t.co/zG0jBlBJOe and this https://t.co/vcpZiqa4JJ and this https://t.co/AJx7I3fEpx but impossible Q, so much "Colors in Context: A Pragmatic Neural Model for Grounded Language Understanding," Monroe et al.: https://t.co/uKcDTMfuJB "Detecting Human Interventions on the Landscape," Boyda et al.: https://t.co/9DrkXVDA3y "Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks," Zhu and Park et al.: https://t.co/8n5FnOyt5l "MoFA: Model-based Deep Convolutional Face Autoencoder for Unsupervised Monocular Reconstruction," Tewari et al.: https://t.co/kogkDESlmf "Learning Convolutional Networks for Content-weighted Image Compression," Li et al.: https://t.co/VbuqsgPKVu "Speaking the Same Language: Matching Machine to Human Captions by Adversarial Training," Shetty et al.: https://t.co/tfuIpbZEg9 "Born to Learn: the Inspiration, Progress, + Future of Evolved Plastic Artificial Neural Networks," Soltoggio et al: https://t.co/bg0pknkoIw "End-to-End MAP Training of a Hybrid HMM-DNN Model," Fritz and Burshtein: https://t.co/rNQYCx2dr8 "Improving Entity Retrieval on Structured Data," Fetahu et al.: https://t.co/GzXI2voNam "Dynamic Computational Time for Visual Attention," Li et al., Baidu: https://t.co/ikmRX4UCRX "Efficient Parallel Translating Embedding For Knowledge Graphs," Zhang et al.: https://t.co/rhjEmg0R7t "Planecell: Representing the 3D Space with Planes," Fan et al.: https://t.co/CVRSEns4OJ "DeNet: Scalable Real-time Object Detection with Directed Sparse Sampling," Tychsen-Smith and Petersson: https://t.co/ontWRvvMKA "Enter the Matrix: A Virtual World Approach to Safely Interruptable Autonomous Systems," @mark_riedl and Harrison: https://t.co/4JkGYVpuqk "Semantic Instance Segmentation via Deep Metric Learning," Fathi et al.: https://t.co/UvZjF0bvWO "Bandit-Based Model Selection for Deformable Object Manipulation," McConachie and Berenson: https://t.co/1ejoxUdQZX "SeGAN: Segmenting and Generating the Invisible," Ehsani et al.: https://t.co/0Uq4mZb9Ch "An E2E System for Crowdsourced 3d Maps for Autonomous Vehicles: The Mapping Component," Dabeer et al., Qualcomm: https://t.co/XAUo5g5Rnf "Atomic Convolutional Networks for Predicting Protein-Ligand Binding Affinity," Gomes and @rbhar90 et al.: https://t.co/RtejfhRPpC "From Deep to Shallow: Transformations of Deep Rectifier Networks," An et al.: https://t.co/0KnSJ8gy28 "Efficient Benchmarking of Algorithm Configuration Procedures via Model-Based Surrogates," Eggensperger et al.: https://t.co/Dh9F7zlTYJ "On Fundamental Limits of Robust Learning," Jiashi Feng: https://t.co/zlZ9KID9cc @levendowski @yaleisp @KristenThomasen thanks for the live tweets! RT @chris_mandle: Nice to see everyone's having a fun April Fool's Day https://t.co/gu44sDjli7 @TheAnnaGat , Bostrom/Yudkowsky; "Ethics of Brain Emulations," Sandberg; and "Is Brain Emulation Dangerous?", Sandberg/Eckersley. Maybe forgetting stuff @TheAnnaGat there isn't really much direct discussion of it, only briefly mentioned in Superintelligence, but some relevant lit: "Ethics of Art. Inte" - @carrickflynn @tegmark @anderssandberg You're forgetting someone... RT @carrickflynn: Important new paper by @tegmark, @anderssandberg, @Miles_Brundage and others: https://t.co/4z8cSGj81F RT @deliprao: I might have hit the used book store gold. https://t.co/gyqE9V0Pz8 Thanks, @catherineols! Proud to have contributed to this project along with @tegmark, @anderssandberg, and others. https://t.co/ZdyOVF9bzF RT @summerbrennan: tfw watching House of Cards is the new watching The West Wing to see a less dysfunctional White House. But yeah, if you're in the market for a fidget toy or have other uses for this sort of thing, it's pretty great. (he also expressed interest in collaborating with AI people on something, if that's of interest to anyone... image<-->shape transfer? :) ) Met the inventor of this earlier (he's also in the pic) - very fun to play with: https://t.co/MTTI50Ycq0 https://t.co/AhH111Ji1R RT @etzioni: A father-son collaboration on ethics & AI.. https://t.co/OwOJxMlT1r @etzioni nice article. might write a blog post about it at some point... RT @Walldo: So here’s a robot that prints out Trump tweets then lights them on fire. Then tweets a video https://t.co/B9nADPO9AP RT @DeepStackAI: #DeepStackAI researcher @MichaelHBowling on how #AI beat #poker pros at Texas Hold'em and why it matters https://t.co/iOeR… @hardmaru @dennybritz There will always be hype even then. Lone superintelligence hyping itself up, or humans hyping, faster than light travel... @andyjko a table of contents would be helpful... had to spend a few mins clicking through to figure out how long it was/scope. @TheAnnaGat glad you liked it, and great to meet you! Yeah, I just briefly looked at a few portions on my phone, dunno how watchable it is. Maybe better version later? https://t.co/xBI7Yb0SLV @AlxCoventry CC @AI_Pol (I think the slides are visible at some points but haven't checked carefully - watcher beware) My talk on long-term AI policy at @AI_Pol earlier starts at around 27:30 here: https://t.co/9OEJNiKrGZ RT @AI_Pol: .@Miles_Brundage talking long-term AI policy https://t.co/BaI8VV2UMk @lucaswiman yes, the other ones are less excusable. @_jyan_ @Smerity giving a talk on this shortly :) @davegershgorn ah. My dumb joke will hopefully go out on time 🙊 @davegershgorn oh wait, Sunday isn't the 1st either. I guess either is the best she could do @davegershgorn but generally.. yep @davegershgorn I think the arxiv thing was probably intended to be published on Sunday with the next batch but got in last night's... "RT @jtlevy: No handshakes with POTUS. No women meeting with VPOTUS. No eye contact with SecState. Even by my introvert standards, these gu…" RT @HMRoff: See my new piece! How understanding animals can help us make the most of artificial intelligence https://t.co/1CPwrARenT via @C… @Byron_Wan @michael_nielsen real I think... Ah, nice :) (notices the date on the first one), good work. https://t.co/Kd09rR29Og Need to sleep "early" tonight so will tweet other arXiv stuff tomorrow. Lol what is going on here... https://t.co/55vUG29d4E https://t.co/gCVvAg9u03 @gwern @quanticle Got it - thanks! @gwern @quanticle Think you meant that if he's in office, you *give* him the first amount, and otherwise he gives you the second amount, but dunno bet lingo @gwern @quanticle I meant "which of you two involved in this bet." Just don't know how to parse the phrasing of the bet tweet. RT @VitruvianMonkey: #BREAKING: Trump reacts to Mike Flynn seeking immunity with a new executive order. https://t.co/3K37AbqXiB @gwern @quanticle I'm not parsing "betting X to his Y" with high confidence... who thinks it's very likely he will be in office? @mark_riedl I guess people parent differently. Some of my fondest memories are of navigating a 2D world+getting zapped for answering Qs abt watermelons. RT @SpaceX: Falcon 9 first stage has landed on Of Course I Still Love You — world’s first reflight of an orbital class rocket. "Modeling Agents with Probabilistic Programs," an online interactive book by @FHIOxford's Owain Evans and others: https://t.co/mN6S3xU5tW RT @MaluubaInc: In Toronto today for the announcement of the Pan-Canadian Artificial Intelligence Strategy #AI 🇨🇦 https://t.co/UCtrjlpD39 @iamtrask it also generated (fears of) a poop singularity Reminder that I'll be giving a talk on long-term AI policy tomorrow in London: https://t.co/oilCKrZYnd @RebeccaCrootof super cool! congrats :) @katherinebailey @davegershgorn don't nec agree 100% with Davis either but it's the first quote I could fine @katherinebailey @davegershgorn yeah, GEB. https://t.co/ZvWJb3pyvD @katherinebailey @davegershgorn I'm a spectrumist, to riff on Dave's lingo :) sure, not human level, but it isnt search @katherinebailey @davegershgorn and ya, female + non-rich would be nice too ;) @katherinebailey @davegershgorn (he also thought we'd need to solve AI to solve chess). Would be rather see views of ppl who study this.. @katherinebailey @davegershgorn also not fan of Hofstaedter's claim (https://t.co/nkEYKaD37Q). Despite GEB, his views haven't aged well.. RT @LeverhulmeCFI: Deadline extension alert!You can now apply for our current #postdoc position #impactofAI until 23:59 on 08.04.17 https:/… @alexismadrigal who isn't? RT @Popehat: @realDonaldTrump @nytimes "Congress shall make no law abridging the freedom of speech, except to protect the delicate feels of… ...or Wednesday in the US, I guess. It's Taco Thursday, apparently. https://t.co/Hp4sCv512G @jackclarkSF actually, there's already one in the book Robot Futures, now that I think of it. @jackclarkSF if only there were a venue for a short sci-fi story about this... *chin scratch emoji* "ProcNets: Learning to Segment Procedures in Untrimmed and Unconstrained Videos," Zhou et al.: https://t.co/cqVZUg2ssT "Perception Driven Texture Generation," Gan et al.: https://t.co/bGIUSoqlMs "Two-Stream RNN/CNN for Action Recognition in 3D Videos," Zhao et al.: https://t.co/WQr0iqGC1S "Deep 6-DOF Tracking," Garon and Lalonde: https://t.co/G7dnwM6Fpc "Collective Anomaly Detection based on Long Short Term Memory Recurrent Neural Network," Bontemps et al.: https://t.co/5Qu4SJXwBK "Coordinating Filters for Faster Deep Neural Networks," Wen et al.: https://t.co/KjJ2teSMRQ "Feature Analysis + Selection for Training an End-to-End Auton Vehicle Controller Using the DL Approach," Yang et al https://t.co/NSahAaup6t "Semi-Supervised Affective Meaning Lexicon Expansion Using Semantic and Distrib. Word Reps," Alhothali+Hoey: https://t.co/bh2tNgT4Nv "Learning Similarity Function for Pronunciation Variations," Naaman et al.: https://t.co/3jY1Hd91ep "Cohesion-based Online Actor-Critic Reinforcement Learning for mHealth Intervention," Zhu et al.: https://t.co/YH4IC6i3pH "Flow-Guided Feature Aggregation for Video Object Detection," Zhu et al.: https://t.co/2Br715Kp2k "Modular, Fully-abstract Compilation by Approximate Back-translation," Devriese et al.: https://t.co/zC5ZQyqVkx "Iterative Object and Part Transfer for Fine-Grained Recognition," Shen et al.: https://t.co/YMFGnj3Du9 "Image Restoration using Autoencoding Priors," Bigdeli and Zwicker: https://t.co/hndwpAXYV8 "An Evaluation of Digital Image Forgery Detection Approaches," Kashyap et al.: https://t.co/2X6JYNBCub "Grouped Convolutional Neural Networks for Multivariate Time Series," Yi et al.: https://t.co/qR1nk9TeCe "Sentiment Recognition in Egocentric Photostreams," Talavera et al.: https://t.co/prchkJ7dcX "Towards thinner convolutional neural networks through Gradually Global Pruning," Wang et al.: https://t.co/xLax9HXBBJ "Who's Better, Who's Best: Skill Determination in Video using Deep Ranking," Doughty et al.: https://t.co/RDG0dKzOpe "On Convergence Property of Implicit Self-paced Objective," Ma et al.: https://t.co/9fsutI6H00 "One Network to Solve Them All --- Solving Linear Inverse Problems using Deep Projection Models," Chang et al.: https://t.co/EvwnCbmEsM "Learning with Privileged Information for Multi-Label Classification," Chen et al.: https://t.co/WPbTR7s3eP "Survey of the State of the Art in Natural Language Generation: Core tasks, applications + evaluation," Gatt+Krahmer https://t.co/re5N4Hzqpz "LabelBank: Revisiting Global Perspectives for Semantic Segmentation," Hu et al.: https://t.co/gwxegKXooh "Experience-based Optimization: A Coevolutionary Approach," Liu et al.: https://t.co/mtVvu2mFZz "Adaptive Gaussian process approximation for Bayesian inference with expensive likelihood functions," Wang and Li: https://t.co/aLxuOhSixO "Marginal likelihood based model comparison in Fuzzy Bayesian Learning," Pan and Bester: https://t.co/FvsZNyJPuE "Gradient-based Regularization Parameter Selection for Problems with Non-smooth Penalty Functions," Feng/Simon: https://t.co/SHRJAjXkgq "Particle Filtering for PLCA model with Application to Music Transcription," Cazau et al.: https://t.co/cyBQRV3qYr "Deep scattering transform applied to note onset detection and instrument recognition," Cazau et al.: https://t.co/zIbIWI7Eri "Unifying the Stochastic Spectral Descent for RBMs with Bernoulli or Gaussian Inputs," Kai Fan: https://t.co/vveBSWHYUQ "Efficient Private ERM for Smooth Objectives," Zhang et al.: https://t.co/P9J4TPE6Sn "Inverse Reinforcement Learning from Summary Data," Kangasrääsiö + Kaski: https://t.co/JtC90cdo1z "Automatic Argumentative-Zoning Using Word2vec," Haixia Lu: https://t.co/NNviAk1xmr "Bio-inspired Tensegrity Soft Modular Robots," Zappetti et al.: https://t.co/hGWXa4qvPU "CVAE-GAN: Fine-Grained Image Generation through Asymmetric Training," Bao et al.: https://t.co/pJLBRriKR9 "Pose-conditioned Spatio-Temporal Attention for Human Action Recognition," Baradel et al.: https://t.co/tnT4gtQ5MC "Improved Lossy Image Compression with Priming+Spatially Adaptive Bit Rates for Rec. Networks," Johnston et al, GOOG https://t.co/x8fb8afpX7 "Google Map Aided Visual Navigation for UAVs in GPS-denied Environment," Shan et al.: https://t.co/0936ZoaqY7 "The Top 10 Topics in Machine Learning Revisited: A Quantitative Meta-Study," Glauner et al.: https://t.co/5d9LFvpwdZ "Priv'IT: Private and Sample Efficient Identity Testing," Cai et al.: https://t.co/MXHzSFMRM7 "Unrestricted Facial Geometry Reconstruction Using Image-to-Image Translation," Sela et al.: https://t.co/FKFt5HSAZI https://t.co/SychjdySJ5 "Time Series Forecasting using RNNs: an Extended Attn Mechanism to Model Periods+Handle Missing Values," Cinar et al https://t.co/hSpVcKxLZl "A Short Review of Ethical Challenges in Clinical Natural Language Processing," Suster et al.: https://t.co/K568EQBWqX "Learning Inverse Mapping by Autoencoder based Generative Adversarial Nets," Junyu Luo: https://t.co/f8dDYnB3YP "Risk-Sensitive Inverse Reinforcement Learning via Gradient Methods," Ratliff and Mazumdar: https://t.co/N242fM1gR7 "Theory II: Landscape of the Empirical Risk in Deep Learning," Poggio and Liao: https://t.co/tiVyErjKT2 From the abstract... https://t.co/MOx1jH1umM "Multi-Scale Dense Convolutional Networks for Efficient Prediction," Huang et al.: https://t.co/sZzM7QLlsX As AI is used more in real systems, we need model 4 responsible disclosure of this kind of stuff. More on this soon! https://t.co/6QRoNYwPCT "Deceiving Google's Cloud Video Intelligence API Built for Summarizing Videos," Hosseini et al.: https://t.co/OlkTfQIVPY "@_jyan_ some app oriented, some less so. Most not on arxiv. e.g. https://t.co/oeNf5vyKku https://t.co/Ve0NsfkXcK https://t.co/oeNf5vyKku" @_jyan_ I did some very shallow archaeology ("alibaba neural" on Google Scholar, reverse chronological order), a few results on first few pg @_jyan_ there may be others I didn't catch the affiliations for or tweet about, but probably more applied than this SC stuff @_jyan_ good pt, that is a difference. Still, this couldn't have happened in a week :) See also (still speech rec): https://t.co/in88lrBzDt StarCraft AI nerds, analysis needed, stat! ;) https://t.co/s9I0Sseog0 @_jyan_ but interesting re: the NASA thing, I hadn't heard about that! @_jyan_ well, not 1st. I tweeted 1 few days ago, pretty sure there were some before. Think this = lagged effect of investment year ago or so CC @jackclarkSF Deep communication learning in a simulated environment, to be more specific...looks like some interesting stuff in here including transfer. Looks like more simultaneous work (to Mordatch and Abbeel, Foerster et al., etc.) on language learning: https://t.co/Y72XZv3zxc "A Deep Compositional Framework for Human-like Language Acquisition in Virtual Environment," Yu et al., Baidu: https://t.co/ZKAxNSsqCO Interested in @nntsn's take... Virtual shots fired in the StarCraft AI kinda-race: https://t.co/SQ5bpHSSER "Multiagent Bidirectionally-Coordinated Nets for Learning to Play StarCraft Combat Games," Peng et al., Alibaba/UCL: https://t.co/0kAbx0zhuW @halhod also more efficient than WN, but haven't compared to Baidu closely @halhod naturalness score is <WN, but both WN + this are early results (Baidu=more engineering). Robustness/end-to-end-ness=impressive part """Tacotron: A Fully End-to-End Text-To-Speech Synthesis Model,"" Wang et al., Google: https://t.co/pqluqMFZ5z Demos: https://t.co/tiZ8tJixYR" RT @DeepStackAI: Deepstack is 2-1 against Nate! Andrew @ThinkingPoker is up next for the rest of the Best-of-7: https://t.co/2DaQzqsg22 Not a lot of Atari on arXiv lately. Sad! @Aelkus Geoffrey Hinton Chair of Symbolic Logic @sknthla (Bane voice) "For now..." RT @mustafasuleymn: Great pnas opinion article: "Gender diversity delivers better science" https://t.co/Zj49jFZMVo RT @genevievemp: My deep learning class is halfway over. What job search resources should I recommend to my students? They are BA or MS lvl… "RT @togelius: Nice piece in VICE Motherboard about AI for game testing! https://t.co/UoMVU7aBdO with @squashstar @yannakakis @noorshak @die…" RT @DustinRMorrill: 3pm MST https://t.co/EgLAExSQ51 @sbenthall intelligence increases? On my view that prob wouldn't include most scientific ideas but covers human development+group formation RT @ArmsControlWonk: He's still rambling on about conspiracy theories. This is more unhinged than anything Nixon recorded, but in public an… @sbenthall broad use of the term intelligence explosion RT @pnhoward: two research milestones! 1) website https://t.co/OhgZbgvade hacked 2) the people we studying (bot writers) are adjusting to… (well, we were never bad at AI overall, but deep learning was a weakness in the early/mid-2000s, now center of gravity moving north again) Make America Bad at AI Again "Two researchers on Hinton’s new Toronto-based team are Iranian, one of the countries targeted by U.S. President Donald Trump’s travel bans" Vector Institute, AI non-prof in Toronto, including Hinton (so of course it had to be called the Vector Institute): https://t.co/FSwSRzzHm0 @sbenthall E.g. human-ish on few chips --> corp cluster+some tweaks. Also not sure I agree w broad use of term IE but interesting POV anyway @sbenthall I wouldn't rule out them playing *some* role though. Don't think all DL progress due to hardware/data. E.g. real prog. on Atari. @sbenthall interesting stuff. Thoughts-Lemma doesn't lead to sentence after, if hardware/data-->int. exp. Think I agree algos alone unlikely "Goal-Driven Dynamics Learning via Bayesian Optimization," Bansal et al.: https://t.co/620sK3WmS7 "Discriminative Transfer Learning for General Image Restoration," Xiao et al.: https://t.co/BywRQR0yFd "Semi and Weakly Supervised Semantic Segmentation Using Generative Adversarial Network," Souly et al.: https://t.co/F664yoLtMR "An Analysis of Visual Question Answering Algorithms," Kafle and Kanan: https://t.co/Sp9cZmetji "Efficient Two-Dimensional Sparse Coding Using Tensor-Linear Combination," Jiang et al.: https://t.co/D8mLTI6ZJa "Learning and Refining of Privileged Information-based RNNs for Action Recognition from Depth Sequences," Shi + Kim: https://t.co/J4GdEQGaGk "Towards Automatic Generation of Short Summaries of Commits," Jiang and McMillan: https://t.co/tqtcW3O2Ko Claims need for much less training data - "Lucid Data Dreaming for Object Tracking," Khoreva et al.: https://t.co/fozMQJ90xr "L2-constrained Softmax Loss for Discriminative Face Verification," Ranjan et al.: https://t.co/SLU8LuILJp "Adversarial Image Perturbation for Privacy Protection -- A Game Theory Perspective," Oh et al.: https://t.co/VQxOdG0oTE "Learned Spectral Super-Resolution," Galliani et al.: https://t.co/4iMTUqjAcI "SEGAN: Speech Enhancement Generative Adversarial Network," Pascual et al.: https://t.co/611Slhc51G "Octree Generating Networks: Efficient Convolutional Architectures for High-res. 3D Outputs," Tatarchenko et al.: https://t.co/MPhdOMKtGT "Mixture of Counting CNNs: Adaptive Integ. of CNNs Specialized to Spec. Appearance 4 Crowd Counting," Kumagai et al https://t.co/RQAajpHHzd "Fast Optimization of Wildfire Suppression Policies with SMAC," McGregor et al.: https://t.co/WIT9sRNacs "Factoring Exogenous State for Model-Free Monte Carlo," McGregor et al.: https://t.co/EubBFx58x7 "Adversarial Transformation Networks: Learning to Generate Adversarial Examples," Baluja and Fischer: https://t.co/TuYxehiNIR "Ensembles of Deep LSTM Learners for Activity Recognition using Wearables," Guan and Ploetz: https://t.co/kddBCfugNc "Graph Regularized Tensor Sparse Coding for Image Representation," Jiang et al.: https://t.co/WyV22zxK7b "Iterative Noise Injection for Scalable Imitation Learning," Laskey et al.: https://t.co/CjrPiCHvFk "Dex-Net 2.0: Deep Learning to Plan Robust Grasps w Synthetic Point Clouds and Analytic Grasp Metrics," Mahler et al https://t.co/TPSCf7bnaI "Speech Enhancement using a Deep Mixture of Experts," Chazan et al.: https://t.co/w40exufppd "Adversarial Source Identification Game with Corrupted Training," Barni and Tondi: https://t.co/B8tyycLGTY "Adaptive Simulation-based [Dogfighting] Training of AI Decision-makers using Bayesian Optimization"-Israelsen et al https://t.co/XVERngl1u2 "Convergence of the Forward-Backward Algorithm: Beyond the Worst Case with the Help of Geometry," Garrigos et al.: https://t.co/QLiua9EovN "Early Stopping without a Validation Set," Mahsereci et al.: https://t.co/oiIQYdRMI3 Fun fact: Loopy Belief Propagation is @realDonaldTrump's favorite algorithm. "Solving Non-parametric Inverse Problem in Cont. Markov Rand. Field using Loopy Belief Propagation"-Yasuda/Kataoka: https://t.co/EWeRAay2c9 "Algebraic Variety Models for High-Rank Matrix Completion," Ongie et al.: https://t.co/V9einaPFV5 "Massive-scale estimation of exponential-family random graph models with local dependence," Babkin and Schweinberger https://t.co/QctL3QkDm4 "A Tidy Data Model for Natural Language Processing using cleanNLP," Taylor Arnold: https://t.co/ecavdxnp2q Or future iterations thereof... Looks like the tech behind Amazon Connect (?) https://t.co/JE3DQvSeqF "A practical approach to dialogue response generation in closed domains," Lu et al., Amazon: https://t.co/ywo0JuM4T5 RT @hannawallach: Six days left!!!! https://t.co/WcrYbz7g9e @jackclarkSF congrats! RT @JustinWolfers: Every MBA class I ever taught was blessed with a bro boasting of his ingenuity for thinking up this one big idea https:/… It's pretty much what you thought, if you have been paying attention... https://t.co/bevWcqYAva RT @brianklaas: Trump says fetch, and Fox News runs to get it. This is not that different from using state media to spread the president's… @davegershgorn though not sure how much that predates Obama EO/if this would be on net bad... @davegershgorn far be it for me to defend Trump but it is well known that govt contracting is difficult for related reasons (pay stuff) "RT @MelodyGuan: Who Said What: Modeling Individual Labelers Improves Classification https://t.co/qnPvsY34Pn my first paper on arxiv! :)" https://t.co/BcRIFJ5Fab "Coherent Online Video Style Transfer," Chen et al.: https://t.co/FUqIjl6HBC "StyleBank: An Explicit Representation for Neural Image Style Transfer," Chen et al.: https://t.co/e2abQCgvi8 "Deep Poincare Map For Robust Medical Image Segmentation," Mo et al.: https://t.co/d11Tj2BSCw "A Cost-based Optimizer for Gradient Descent Optimization," Kaoudi et al.: https://t.co/4ILAuyJt1z "Private Learning on Networks: Part II," Gade and Vaidya: https://t.co/EEOmZRotXr "Transfer learning for music classification and regression tasks," Choi et al.: https://t.co/Jz52K0vBVS "GPU Activity Prediction using Representation Learning," Raghavan et al.: https://t.co/2FcCiqGDxr "Where to put the Image in an Image Caption Generator," Tanti et al.: https://t.co/0haEVWiM3j "Automating decision making to help establish norm-based regulations," Lopez-Sanchez et al.: https://t.co/dGqY5q10Md "Active Convolution: Learning the Shape of Convolution for Image Classification," Jeon and Kim: https://t.co/QvFy9RTy7T Very comprehensive - "Efficient Processing of Deep Neural Networks: A Tutorial and Survey," Sze et al.: https://t.co/GUH3MLIbdG "Deep Deterministic Policy Gradient for Urban Traffic Light Control," Noe Casas: https://t.co/E1XwNpvtls "Trespassing the Boundaries: Labeling Temporal Bounds for Object Interactions in Egocentric Video," Moltisanti et al https://t.co/pWQtS7eBMr "Simultaneous Perception and Path Generation Using Fully Convolutional Neural Networks," Caltagirone et al.: https://t.co/ZPSM9IEH0U "Mastering Sketching: Adversarial Augmentation for Structured Prediction," Simo-Serra et al.: https://t.co/aZDxof0QQT https://t.co/trX6sXT8mV "Multimodal deep learning approach for joint EEG-EMG data compression and classification," Said et al.: https://t.co/tXhMMrpTCc "Scaling the Scattering Transform: Deep Hybrid Networks," Oyallon et al.: https://t.co/VYrfRQOYPD "Alternative Modes of Interaction in Proximal Human-in-the-Loop Operation of Robots," Chakraborti et al.: https://t.co/aMsYDBf0bQ "On Automating the Doctrine of Double Effect," Govindarajulu and Bringsjord: https://t.co/CbvQIIfr6a "Question Answering from Unstructured Text by Retrieval and Comprehension," Watanabe et al.: https://t.co/pXS5DYOTtH "Multi-View Deep Learning for Consistent Semantic Mapping with RGB-D Cameras," Ma et al.: https://t.co/zBuvprviCO "Learning Simpler Language Models with the Delta Recurrent Neural Network Framework," Ororbia et al.: https://t.co/f9bb3UC21W "Tweet for Behavior Change: Using Social Media for the Dissemination of Public Health Messages," Gough et al.: https://t.co/DENcoODRbN "Who Said What: Modeling Individual Labelers Improves Classification," @MelodyGuan et al.: https://t.co/yTKPjUbRhZ "Open Vocabulary Scene Parsing," Zhao et al.: https://t.co/cE6JB72dPZ "SCAN: Structure Correcting Adversarial Network for Chest X-rays Organ Segmentation," Dai et al.: https://t.co/BwWgg3bvFm "Sketch-based Face Editing in Video Using Identity Deformation Transfer," Zhao et al.: https://t.co/nfUe5LwSnj https://t.co/sdCxNhpIty "Bayesian Optimization for Refining Object Proposals," Rhodes et al.: https://t.co/rTsc0O8znP "More is Less: A More Complicated Network with Less Inference Complexity," Dong et al.: https://t.co/xavbsGFh5V "Regularized Gradient Descent: A Nonconvex Recipe for Fast Joint Blind Deconvolution and Demixing," Ling+Strohmer: https://t.co/6SC1m9enXv "AMAT: Medial Axis Transform for Natural Images," Tsogkas and Dickinson: https://t.co/d4PDzg1OIl "Aversion to Uncertainty and Its Implications for Revenue Maximization," Chawla et al.: https://t.co/O0L6b56uFU "Adversarial Examples for Semantic Segmentation and Object Detection," Xie et al.: https://t.co/rIdDi4LzQ9 "Deep Residual Learning for Instrument Segmentation in Robotic Surgery," Pakhomov et al.: https://t.co/57FOLJBL4C "Balancing Selection Pressures, Multiple Objs+Neural Modularity to Coevolve Coop Agent Behavior," Rollins and Schrum https://t.co/yoqpxeryb7 "AutonoVi: Autonomous Vehicle Planning with Dynamic Maneuvers and Traffic Constraints," Best et al.: https://t.co/RTBUX6QgsH "Towards a Functional System Architecture for Automated Vehicles," Ulbrich et al.: https://t.co/gFhU9Sfoj2 "Exploration--Exploitation in MDPs with Options," Fruit and Lazaric: https://t.co/iPwKayJXzO "Inferring The Latent Structure of Human Decision-Making from Raw Visual Inputs," Li et al.: https://t.co/2bh3w8yUQF "Socially Aware Motion Planning with Deep Reinforcement Learning," Chen et al.: https://t.co/WQAbpWUxin "Transductive Zero-Shot Learning with a Self-training dictionary approach," Yu et al.: https://t.co/D9R8bORGxG "Transductive Zero-Shot Learning with Adaptive Structural Embedding," Yu et al.: https://t.co/lLqYtIq15J "Fairness in Criminal Justice Risk Assessments: The State of the Art," Berk et al.: https://t.co/M5NfcgeilC "Sequence-to-Sequence Models Can Directly Transcribe Foreign Speech," Weiss et al.: https://t.co/pKIug0Un8j "Comparing Rule-Based and Deep Learning Models for Patient Phenotyping," Gerhmann et al.: https://t.co/4R4ypHbLX8 "Count-ception: Counting by Fully Convolutional Redundant Counting," Cohen et al.: https://t.co/XHX8Z6fu20 "Binarsity: a penalization for one-hot encoded features," Alaya et al.: https://t.co/GpyWrWk2is "D.TRUMP: Data-mining Textual Responses to Uncover Misconception Patterns," Michalenko et al.: https://t.co/TdSB6x5r8b "A Scale Free Algorithm for Stochastic Bandits with Bounded Kurtosis," Tor Lattimore: https://t.co/ZDedeD8Fjz "Thompson Sampling for Linear-Quadratic Control Problems," Abeille and Lazaric: https://t.co/OIby38WCr8 "Sticking the Landing: An Asymptotically Zero-Variance Gradient Estimator for Variational Inference," Roeder et al.: https://t.co/GaYQZVmdJF "Sparse Multi-Output Gaussian Processes for Medical Time Series Prediction," Cheng et al.: https://t.co/xWdU2Nwd3b "Biologically inspired protection of deep networks from adversarial attacks," Nayebi and @SuryaGanguli: https://t.co/v6Zv4FS18Z @halhod certainly not all of it, but a decent fraction of those also have unlisted industry affiliations (maybe 1/5th or so) RT @LeverhulmeCFI: Delighted to announce our 6 new Associate Fellows! @LucyCheke @lawrennd @HMRoff @BVLSingler @maosbot @alan_winfield http… @jackclarkSF @rodolfor @davegershgorn let us know what you think! I think you'll dig it @rodolfor @davegershgorn (I enjoyed reading it but I'm perhaps not a representative sample) @rodolfor @davegershgorn it's the AI progress measurement equivalent of eating your vegetables perhaps ;) hope you enjoy later bits more! RT @s010n: CFP for 1st Workshop on Mechanism Design for Social Good https://t.co/k506eR2SN7 Organized by @red_abebe and @kiragoldner RT @CSERCambridge: CFI invites applications for a Postdoc Research Associate in an area related to the impact, ethics or nature of AI. http… RT @evawxiao: Another high-level AI exec from Baidu leaves: https://t.co/55KD0r3xO5 "Interacting Conceptual Spaces I : Grammatical Composition of Concepts," Bolt et al.: https://t.co/PTZtRUVtyI "Multi-Level Discovery of Deep Options," Fox and Krishnan et al.: https://t.co/eY3uekeysW "Deep Direct Regression for Multi-Oriented Scene Text Detection," He et al.: https://t.co/scWNoYrLYY "View Adaptive Recurrent Neural Networks for High Perf. Human Action Recognition from Skeleton Data," Zhang et al.: https://t.co/bGS3trnnUW "On the Robustness of Convolutional Neural Networks to Internal Architecture + Weight Perturbations," Cheney et al.: https://t.co/Hb94FCstJg "Single Image Super-resolution with a Parameter Economic Residual-like Convolutional Neural Network," Liang et al.: https://t.co/yjZd6Xj0Zg "Multi-stage Multi-recursive-input Fully Convolutional Networks for Neuronal Boundary DetectioShen et al.: https://t.co/WkW9DMzxru "Overcoming Catastrophic Forgetting by Incremental Moment Matching," Lee et al.: https://t.co/m7tj1d9OlD "Batch-normalized joint training for DNN-based distant speech recognition," Ravanelli et al.: https://t.co/YPbBdYcvbj "Object Region Mining w/ Adversarial Erasing: A Simple Classification to Semantic Segmentation Approach," Wei et al: https://t.co/O4AHFCWQ57 "DeepVisage: Making face recognition simple yet with powerful generalization skills," Hasnat et al.: https://t.co/45yyaK36fG "Crowdsourcing Universal Part-Of-Speech Tags for Code-Switching," Soto and Hirschberg: https://t.co/D5nqR7wIGZ "PonyGE2: Grammatical Evolution in Python," Fenton et al.: https://t.co/lWe5B1c3Ib "Joint Modeling of Event Sequence and Time Series with Attentional Twin Recurrent Neural Networks," Xiao et al.: https://t.co/U1mp89yAx5 "Smart Augmentation - Learning an Optimal Data Augmentation Strategy," Lemley et al.: https://t.co/hznE5tKXj0 "Rejection-free Ensemble MCMC with applications to Factorial Hidden Markov Models," Martens et al.: https://t.co/jGo6KKlN78 "Interactive Natural Language Acquisition in a Multi-modal Recurrent Neural Architecture," Heinrich and Wermter: https://t.co/BCl7YhEidw RT @hardmaru: It seems many 'senior' deep learning researchers have a deep bias against the use of evolutionary computing methods. Let them… @fchollet that's basically the aim of the book The Measure of All Minds. Recommend if you haven't read. RT @BFriedmanDC: This is a huge story. If true, it's likely the largest massacre of civilians by the U.S. military since Vietnam. And Iraq… RT @etzioni: But no jobs will be lost for 50-100 years according to secretary Mnuchin https://t.co/SqIFrsJMu8 @_jyan_ thanks! Cc @jackclarkSF @ericjang11 @nsaphra is ita news article with quotes/anon sources? Random post from someone? @iamtrask @jimmfleming more on this in FHI publication at some point hopefully :) (bad actors wkshop or blockchain workshop) @iamtrask @jimmfleming or perhaps some hardware connection (verified cam). Not v familiar w blockchain but heard credible ppl describe it @iamtrask @jimmfleming which would be convincing if it's technically implausible to render it in real time @iamtrask @jimmfleming one could insert blockchain hashes into it in real time to demonstrate that it was filmed *or* rendered real time @iamtrask @jimmfleming (not sure I'm optimistic. but one arg=) if mass avail, ppl distrust random vids, only trust crypto-verifiable vids RT @TUSK81: "You tired of winning yet, you orange mothe—" https://t.co/UAsOe4YH8G @AbeGong agreed, would like to see follow up w/ more connections to lit. Maybe journal article w more space @AbeGong I had same concern when first saw, suspect there were space constraints, but they do mention largeness of related work/cite a few @AbeGong why poorly executed? @johnrobb why so little $? Econ. should grow a lot by then. RT @data_nerd: #AI And Community Development Are Two Key Reasons Why Google May Win The Cloud Wars by @Gilpress - https://t.co/zYSyXIc7Zo RT @DrJJoyner: There is no fucking substance. https://t.co/HS7HJYqJ96 RT @verge: One of Uber’s self-driving cars just crashed in Arizona https://t.co/bCnaHyTPNR https://t.co/jmpQ36hj8C @RikeFranke @Muhd_Amrullah I don't endorse that characterization but there is nontrivial R+D there (Facebook, Huawei, Inria, etc) RT @RikeFranke: France is stepping up its game on #AI https://t.co/rlPoeEtzZj All quiet on the @realDonaldTrump front. SAD! RT @scottlincicome: The idea that today wasn't a massive, embarrassing and telling failure by the Trump White House is pure fantasy /1 RT @mark_riedl: Another ML conference sells out. https://t.co/scoXnbyE2Z RT @rao2z: An article that includes @RealAAAI perspectives on the recent travel restrictions: https://t.co/2DPjE0PhcM via @computerworld #… ...and there just aren't people in the relevant positions. "At all" not literally true - prob comes up at meetings with CEOs, and DOD def. thinking about it. But can't make policy w/o policy-makers.. RT @realDonaldTrump: Just shows that you can have all the cards and lose if you don’t know what you’re doing. Treasury Secretary is hardly whom one should turn to for insights on such matters. More precisely, Trump admin. isn't thinking about robotics at all, with no science advisor, chief economist, etc. https://t.co/0zPr6OEnGB RT @brianklaas: When the self-proclaimed Greatest-Dealmaker-in-the-World™ can't even win over his Republican allies, it's time to realize..… @recurseparadox @saguppa thanks, yes, I tweeted it a few weeks ago :) @AMP_SV congrats! :) RT @_hylandSL: @schock @Miles_Brundage ML part: https://t.co/Lg08vYIfie no obvious accounting for sensitive variables/bias in historical da… RT @schock: Calling the algorithmic justice league for audit https://t.co/LLMHJ7L2b4 RT @gdb: Latest work by the team: https://t.co/Rdxm2R6OUZ @AMP_SV that'd be too mainstream though. Trump knows better than those DC Swamp People @AMP_SV if only there were jobs like Sec of Labor, Chair of the Council of Economic Advisors, or Science Advisor Trump could nominate ppl to @AlfredoCanziani @adriancolyer @jackclarkSF @michael_nielsen @edersantana @GokuMohandas depending on interests, > or < 1 paper/day relevant @AlfredoCanziani @adriancolyer @jackclarkSF @michael_nielsen @edersantana @GokuMohandas these are great! but not same as curation problem @kennethpayne01 haha love it :) RT @kennethpayne01: via Oxford University Marginalia https://t.co/yuL6cDH13C RT @NicolasPapernot: Improvements were recently made to #cleverhans, including a speed-up for the JSMA attack. Get the latest copy at: http… @mark_riedl OTOH, on nearly every policy issue, Trump does nearly opposite of right thing. Inaction til impeachment/2020 maybe better? @mark_riedl now? :) @lidija_sekaric *head of CEA not NEC, maybe NEC chair exists :) @lidija_sekaric at least the OSTP director, NEC, and Sec of Labor will inform him....oh wait they dont exist :) @lidija_sekaric quite ignorant statement by him... Def uncertainty about near/medium term impacts but 50-100 is absurdly long in AI years :) RT @evawxiao: WeChat opens search index function (think Google Trends, except it only goes back 90 days). If you key in "AI", this is the r… @gwern @botminds (maybe no such thing would work, but if it did work, it'd be much easier to copy than pills) "RT @Recode: These AI bots created their own language to talk to each other. https://t.co/5p1mqSVXUq https://t.co/IW3yf59ELp" @gwern @botminds + there's incentive to sell pills, but behavioral change via app (for example) seems unlikely to be v profitable. @gwern @botminds I meant IT companies (made this distinction in discussion w/ someone else abt this point, forgot it wasn't you) - agree + @gwern @botminds by which I don't mean nec. a cure or biomedical research nec., but behavioral analysis, apps, optimal messaging, etc. @gwern @botminds conceivable to me that if Big Tech were as motivated to work on heart disease/obesity etc they'd come up w/ something cheap @gwern @botminds prob even w/ future $, other stuff is more, but I don't know enough abt e.g. heart disease to know how well spent that was. @gwern @botminds we'll see re: car costs. I'm sure it'll eventually be cheap, but tech still not there for wide use, much R+D $ to go. @santoroAI haha, indeed :) @_jyan_ @LiYuan6 why SoftBank? RT @LiYuan6: With Ng's resignation, many Baidu AI researchers lost their teacher - a role foreign AI talent plays at Chinese firms. https:/… @sknthla I'm not sure either, which part do you mean, though? (I have no strong view on the net balance FWIW) @sknthla more comprehensive social map, data, compute, and technical skill. @sknthla maybe. Adversaries have some advantages (time devoted to specific attack, first mover w/ new fakery)... defenders do, too, though: "Adversarial synapses: Hebbian/anti-Hebbian learning optimizes min-max objectives," Pehlevan et al.: https://t.co/QSXF4OWwMh "Visually grounded learning of keyword prediction from untranscribed speech," Kamper et al.: https://t.co/WDZ0PpslSB "Weakly Supervised Action Learning with RNN based Fine-to-coarse Modeling," Richard et al.: https://t.co/LXD9NV4arK "An embedded segmental k-means model for unsupervised segmentation and clustering of speech," Kamper et al.: https://t.co/lYwegIzGaU "Recurrent and Contextual Models for Visual Question Answering," Sharang and Lau: https://t.co/iw0Q2rCyQu "Quality Resilient Deep Neural Networks," Dodge and Karam: https://t.co/HTizg3Yjr9 "A Bag-of-Words Equivalent Recurrent Neural Network for Action Recognition," Richard and Gall: https://t.co/I9C7Y9NNjL "Multimodal Compact Bilinear Pooling for Multimodal Neural Machine Translation," Delbrouck and Dupont: https://t.co/DEBQvb3uqf "Sequential Recurrent Neural Networks for Language Modeling," Oualil et al.: https://t.co/g0MNyvYp9y "Is Second-order Information Helpful for Large-scale Visual Recognition?," Li et al.: https://t.co/e8o2nGx2yK "Generative Adversarial Residual Pairwise Networks for One Shot Learning," Mehrotra and Dukkipati: https://t.co/C0GL5CwdDT "Saliency-guided video classification via adaptively weighted learning," Zhao and Peng: https://t.co/r9OONghJ7B "Single Channel Audio Source Separation using Convolutional Denoising Autoencoders," Grais and Plumbley: https://t.co/fwiowkp3NF "A learning-based approach to text image retrieval: using CNN features and improved similarity metrics," Tan et al.: https://t.co/Y0a3Wvv56A "A network of deep neural networks for distant speech recognition," Ravanelli et al.: https://t.co/APs3RCM7JY "Weakly Supervised Object Localization Using Things and Stuff Transfer," Shi et al.: https://t.co/Jcx4mXvcez "Discriminatively Boosted Image Clustering with Fully Convolutional Auto-Encoders," Li et al.: https://t.co/iCF2rF98yA "Image-based Localization using Hourglass Networks," Melekhov et al.: https://t.co/mRzAIIANfu "Failures of Deep Learning," Shalev-Shwartz et al.: https://t.co/yYo13OuNHu "Recurrent Multimodal Interaction for Referring Image Segmentation," Liu et al.: https://t.co/H7Q5aUpLx3 "Planar Object Tracking in the Wild: A Benchmark," Liang et al.: https://t.co/K32RtML0FS "Diversification-Based Learning in Computing and Optimization," Glover and Hao: https://t.co/pxaWdnI5j0 "User Experience of the CoSTAR System for Instruction of Collaborative Robots," Paxton et al.: https://t.co/58p8lHveWN "Faster Reinforcement Learning Using Active Simulators," Jain and Tulabandhula: https://t.co/Y0dtuq69qa "Classification-based RNN machine translation using GRUs," Wang et al.: https://t.co/5WIc5yfCkk "Large Pose 3D Face Reconstruction from a Single Image via Direct Volumetric CNN Regression," Jackson et al.: https://t.co/eFNVqtbU5U "Fake News Mitigation via Point Process Based Intervention," Farajtabar et al.: https://t.co/8kyBthyzTT "Info.-theoretic Model Identification+Policy Search using Physics Engines w App. to Robotic Manipulation," Zhu et al https://t.co/gXr2hcMWu1 "R-C3D: Region Convolutional 3D Network for Temporal Activity Detection," Xu et al.: https://t.co/jIsU6Ynx5l "The role of zero synapses in unsupervised feature learning," Haiping Huang: https://t.co/hZ6yU4KXYW "Perspective: Energy Landscapes for Machine Learning," Ballard et al.: https://t.co/EYsa48wDel "Guided Perturbations: Self Corrective Behavior in Convolutional Neural Networks," Sankaranarayanan et al.: https://t.co/YAyP5oesak "Unsupervised Basis Function Adaptation for Reinforcement Learning," Barker and Ras: https://t.co/xQEU82n6gd "Fast Stochastic Variance Reduced Gradient Method with Momentum Acceleration for Machine Learning," Shang et al.: https://t.co/0G92pmh3kv "Data Driven Exploratory Attacks on Black Box Classifiers in Adversarial Domains," Sethi and Kantardzic: https://t.co/helVXFp7Tw "Distribution of Gaussian Process Arc Lengths," Bewsher et al.: https://t.co/A4xfmL3jv0 "Dynamic Bernoulli Embeddings for Language Evolution," Rudolph and Blei: https://t.co/AmzYwPuo4q AKA, AlphaGo-ish approach to driverless cars. "Combining Neural Networks+Tree Search 4 Task+Motion Planning in Challenging Environments," Paxton et al., Zoox/JHU: https://t.co/dIFrSHWJZX RT @rossjanderson: Cambridge is hiring: we're looking for a CISO https://t.co/Nac3NObQjY @jathansadowski was this that Zwarte Piet thing? Meanwhile, Amazon Video doesn't even have closed captions on big % of paid content!! Netflix way better about this. https://t.co/ADOMiXhrHc @gwern either way, banning possible for something like this - visible/public. And yes, I agree the funding is relatively small vs. health @gwern just one scenario, and the politics could look quite different, but I think some sort of opposition is v. plausible. @gwern disagree re: small investment (many billions), and why would it be hard to block? Teamster union opposes, Trump says JOBS, ban. @gwern sure, can be developed in isolation from regs/rent, but not nec. deployed. And it remains unsolved in its generality. RT @nervanasys: Intel is aligning all its #AI efforts under @naveengrao in a pan-Intel organization: https://t.co/Ax3y7fVTef @forbes @Intel… @AMP_SV @nikete probably true :) the self driving car thing is non-trivial, though, and undercuts arg that it's an easy tech fix somewhat @AlxCoventry @aireye not sure about that. Certainly biology is complex but driving still not totally solved either despite big effort. @AlxCoventry @aireye OOM? More common is just mentioning big sounding numbers of lives that could be saved. Plenty of big numbers available on global problems... It's plausible that taking into account problem difficult, driverless cars are one of the best ways to save lives. But haven't seen that arg @nikete yes, that's almost certainly true @nikete some good heuristics here: don't think either preventable diseases or car deaths would nec meet all of them https://t.co/JjfDaKcIzv RT @CormacHerley: I have a new paper up, on the elusive goal of doing security scientifically (pdf): https://t.co/heYZEFnWLy @nikete but I agree one should think about the social/technical ease of fixing probs in addition to scale @nikete not sure...Is health care optimization harder than infrastructural, policy, cultural changes to make self driving cars work? @nikete heart disease is often human (self-)caused... lots of either preventable or possibly future preventable things. @davegershgorn @WillOremus hamburger, though... RT @nikete: @Miles_Brundage another way to look at same (current global) data https://t.co/hUMLkaokb6 @nikete @BenedictEvans that doesn't surprise me, though, as war has declined a lot. Disease seems like better comparison @aireye yes, I consider those "tech" but I read @BenedictEvans's use of the term as more like "Silicon Valley." Though @nikete rightly notes car accidents loom larger (see lower right) when considering years of life lost: https://t.co/vtgL79zMl7 @aireye yeah definitely a lot more than nothing. But I'd bet it's a lot less than driverless car research, ad optimization etc... @aireye def some AI/bio collaboration, work on predicting hospital returns etc but seems like small scale effort at moment @aireye I'd like to see driverless cars too, but easy to say we know how after lots of investment :) /we still haven't fully solved... @aireye are we really trying though? Certainly docs/bio ppl. billions of AI/robotics $ seems unlikely to be driven by life saving... @nikete @BenedictEvans what year is the unlabeled one from? (one says 2001), In any case, yes, bigger issue from life years lost perspective Globally, it's in top ten but still far less than heart disease or stroke alone, let alone combined: https://t.co/Cw60QDGGU6 (Note that accidental deaths are high on list but include a lot more than car accidents) See e.g. CDC statistics: https://t.co/NVodALymdq I do agree it's not a trivial problem, but also not the biggest problem either. No one decided in the mid-2000s that this was the best way to save lots of lives (+ isn't);DARPA wanted to accelerate tech for own purposes. Agree they could save lot of lives, but this is a post hoc justification+still not even in top 10 causes of death... https://t.co/527RAGLuxi @deliprao @jackclarkSF research debt alert! "RT @tonyhawk: TSA agent (checking my ID): ""Hawk, like that skateboarder Tony Hawk!"" Me: exactly Her: ""Cool, I wonder what he's up to these…" RT @ColinKahl: A dark glimpse into the post-truth mind of the President of the United States. https://t.co/trfnVCnHqH @iandanforth public service. "Independently Controllable Features," Bengio et al.: https://t.co/TvzNsneBnf "Hierarchical RNN with Static Sentence-Level Attention for Text-Based Speaker Change Detection," Meng et al.: https://t.co/sv3jjnV2io "Predicting Deeper into the Future of Semantic Segmentation," Neverova and Luc et al.: https://t.co/9cZYKwxxWI "ASP: Learning to Forget with Adaptive Synaptic Plasticity in Spiking Neural Networks," Panda et al.: https://t.co/cw9Nlv0Uzz "Neural Ctrl-F: Segmentation-free Query-by-String Word Spotting in Handwritten Manuscript Collections"Wilkinson e.a. https://t.co/GDVIMMWnC5 "Gate Activation Signal Analysis for Gated RNNs and Its Correlation with Phoneme Boundaries," Wang et al.: https://t.co/OhCBj5IGZ6 "An End-to-End Approach to Natural Language Object Retrieval via Context-Aware Deep Reinf. Learning," Wu et al.: https://t.co/7z6WOPH4cJ "Deep MANTA: A Coarse-to-fine Many-Task Net. for joint 2D and 3D vehicle analysis from monocular image"-Chabot et al https://t.co/T9KH7PJbk0 "Joint Intermodal and Intramodal Label Transfers for Extremely Rare or Unseen Classes," Qi et al.: https://t.co/n5T8woEEDP "Video Frame Interpolation via Adaptive Convolution," Niklaus et al.: https://t.co/yIhbNOjHmv "Deep Photo Style Transfer," Luan et al.: https://t.co/WWkMY9bE8b "SUM: Sequential Scene Understanding and Manipulation," Sui et al.: https://t.co/6FI3x6vpaB "PKU-MMD: A Large Scale Benchmark for Continuous Multi-Modal Human Action Understanding," Liu et al.: https://t.co/Sq6lnnRzzL "RobustFill: Neural Program Learning under Noisy I/O," Devlin et al.: https://t.co/wnc7vrDuik "IOD-CNN: Integrating Object Detection Networks for Event Recognition," Eum et al.: https://t.co/cfHUfqP4Yd "Deep Learning for Explicitly Modeling Optimization Landscapes," Shumeet Baluja: https://t.co/smVL294GiR "Multitask Learning and Benchmarking with Clinical Time Series Data," Harutyunyan et al.: https://t.co/ELCxuxyWWa "Episode-Based Active Learning with Bayesian Neural Networks," Dayoub et al.: https://t.co/ndvzeRvALh "REBAR: Low-variance, unbiased gradient estimates for discrete latent variable models," Tucker et al.: https://t.co/YQiNYRUzUd "UBEV - A More Practical Algorithm for Episodic RL with Near-Optimal PAC and Regret Guarantees," Dann et al.: https://t.co/QeSZLCnDNL "Direct Acoustics-to-Word Models for English Conversational Speech Recognition," Audhkhasi et al.: https://t.co/Z61LkTiQlQ "LogitBoost autoregressive networks," Marc Goessling: https://t.co/wt1O7GUToH "Testing and Learning on Distributions with Symmetric Noise Invariance," Law et al.: https://t.co/W24f4Q9Stz "Deep Exploration via Randomized Value Functions," Osband et al.: https://t.co/WI6hJgpQqJ RT @sama: OpenAI has a new website: https://t.co/VaGG9fKeRp RT @ch402: I've been spending a lot of time thinking about what it means to be a researcher. This is the result: https://t.co/PMUQ3TmkKO RT @PyTorch: OpenAI's new paper "Evolution Strategies as a Scalable Alternative to Reinforcement Learning" implemented in @PyTorch https://… RT @AngeBassa: Do you want to science on robot data? My team’s looking for an intern–for a paid summer position. Spread the word! https://t… RT @zararah: If you’re following #Westminster, advice on using + interpreting social media for breaking news, via @onthemedia: https://t.co… RT @samgadjones: The @metpoliceuk have confirmed shots were fired at parliament. Details still emerging. RT @AndrewYNg: I will be resigning from Baidu and opening up a new chapter of my work in AI. Details here: https://t.co/YebSl9ZxD8 RT @iamtrask: How to Code and Understand @DeepMindAI's Synthetic Gradients paper. https://t.co/nIGsKUkKFB @chrisboden though there's a lot not on arXiv, where I focus, so that might just be that DL people concentrate there. @chrisboden dunno, but I think the main change hasn't been quantity of AI papers but ^ representation of deep learning in that set. @madebyollin I have not, maybe someone has though :) RT'd to help RT @madebyollin: @Miles_Brundage Have you seen any work on style transfer for singing/vocals? I've tried https://t.co/rnvL3yb4zs but result… @ryanfb that one used commentary on stuff happening for the visual impaired, embedded in DVDs. Closed captions seem easier/more plentiful. @ryanfb yeah, seems promising. Also vids. See-"Using Descriptive Video Services to Create a Large Data Source for Video Annotation Research" @davegershgorn why "lol"? @beaucronin well, presumably those dedicated will spend more time keeping up, but they may perceive themselves as even more behind. @beaucronin *especially* those? (they see more drafts, too, and cast a wider net than those on the periphery) "Learning to Generate Samples from Noise through Infusion Training," Bordes et al.: https://t.co/hEKruzKZA3 "ZM-Net: Real-time Zero-shot Image Manipulation Network," Wang et al.: https://t.co/z5mt5sDqEK "A Deterministic Global Optimization Method for Variational Inference," Saddiki et al.: https://t.co/Y8Ln46Tncv "Knowledge distillation using unlabeled mismatched images," Kulkarni et al.: https://t.co/DOeXXbsOmM "High-Resolution Breast Cancer Screening with Multi-View Deep Convolutional Neural Networks," Geras et al.: https://t.co/5OyFczewLU "Nonparametric Variational Auto-encoders for Hierarchical Representation Learning," Goyal et al.: https://t.co/iLxgAaU7kC "Cross-modal Deep Metric Learning with Multi-task Regularization," Huang and Peng: https://t.co/NQpL5Ni2NQ "Gaussian process regression for forecasting battery state of health," Richardson et al.: https://t.co/5IffVYr7PM "Verifying safety of an autonomous spacecraft rendezvous mission," Chan and Mitra: https://t.co/yqKQc7EQon "Black-Box Optimization in Machine Learning with Trust Region Based Derivative Free Algorithm," Ghanbari+Scheinberg: https://t.co/wqFBdvTgru "Multi-style Generative Network for Real-time Transfer," Zhang and Dana: https://t.co/bRLj0SWDF5 "CSI: A Hybrid Deep Model for Fake News," Ruchansky,* Seo,* and Liu: https://t.co/CHiIEl7IuE "Workload Engineering: Optimising WAN and DC Resources Through RL-Based Workload Placement," Xiu and Evans: https://t.co/MSIVUsh1EX "Active Decision Boundary Annotation with Deep Generative Models," Huijsen and van Gamert: https://t.co/c3lrW6BWaP "SORT: Second-Order Response Transform for Visual Recognition," Wang et al.: https://t.co/fCRgJBTBNM "Spatio-Temporal Facial Expression Recognition Using CNNs and Conditional Random Fields," Hasani and Mahoor: https://t.co/6DFWaXR3op "Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networks," Lai et al.: https://t.co/h89AkfhoMV "Recurrent Topic-Transition GAN for Visual Paragraph Generation," Liang et al.: https://t.co/wYpbgaR7U5 "Investigation of Language Understanding Impact for Reinforcement Learning Based Dialogue Systems," Li et al.: https://t.co/ZajopXtMhF "Pseudorehearsal in value function approximation," Marochko et al.: https://t.co/KTIHWiQAr5 "Evolving Parsimonious Networks by Mixing Activation Functions," Hagg et al.: https://t.co/wJmdM5QVcg "Deep generative-contrastive networks for facial expression recognition," Kim et al.: https://t.co/X0Cw40moXd In any case, it's an area where having a ton of data helps, and they have it. Lots of companies have 10k+ hr datasets, maybe soon see 100k+. Reports crazy low error rate, but not sure how seriously to take b/c proprietary dataset. https://t.co/hVryU0NPQ5 "Deep LSTM for Large Vocabulary Continuous Speech Recognition," Tian et al., Alibaba Shenma Search: https://t.co/Mjm9bSkJTC "GP-GAN: Towards Realistic High-Resolution Image Blending," Wu et al.: https://t.co/AxcEIcoPW0 "Improving Person Re-identification by Attribute and Identity Learning," Lin et al.: https://t.co/BRqS3NaxSV "Black-Box Data-efficient Policy Search for Robotics," Chatzilygeroudis et al.: https://t.co/CC7dEYJ8sA Yes; as someone put it (forget who), he seems to be a robot sent back in time to churn out robotics papers. https://t.co/WQX8qOwzZs Related- someone told me few years ago that human-level cloth manipulation was ~15 years away. Seems sooner now (not just b/c this paper). "Learning to Navigate Cloth using Haptics," Clegg et al.: https://t.co/6wxsmUBQ5h "Domain Randomization for Transferring Deep NNs from Simulation to the Real World," Tobin et al., OpenAI/Berkeley: https://t.co/kApDwSFqnc """One-Shot Imitation Learning,"" Duan et al., OpenAI/Berkeley: https://t.co/AJx7I3fEpx Videos: https://t.co/fAyHquq2kn" "RT @soumithchintala: I haven't seriously read a paper in a month. Wasserstein GAN cited 17 times since arxived < 2 months the field is over…" @zacharylipton congrats! RT @NidhiJThakar: How Trump budget cuts to @ENERGY funding stifle American #innovation and competitiveness. https://t.co/Kh7CdLxm8g @tara… "RT @iyadrahwan: Cooperating with Machines. Our research on the new grand challenge for AI: cooperation (not competition) with humans https:…" RT @mgdever: Fred, the last ship's cat in the Royal Navy, once received a disciplinary notice for "disgraceful behaviour" at a fishmarket.… This is pretty cool - "given a description of...game environment, [learns] to cooperate w/ people" at ~/>human-level https://t.co/tLJmk5eS5A CC @jackclarkSF Concurrent to Mordatch and Abbeel - more deep RL for communication. 4th or so DRL4C paper in last 6 months? https://t.co/b3mwf0psO8 @AlxCoventry @hardmaru aiming for something like this, but more interpretable/fewer free parameters - https://t.co/ZcBOHDYjIw @AlxCoventry @hardmaru e.g. openness in AI looked like this, or that, speed of AI progress is this/that, etc. Interactive. Buggy notebook RN @AlxCoventry @hardmaru the dependency of certain societal outcomes (namely distribution of AI capabilities) on diff assumptions/policies/etc RT @hannawallach: Join us! One-year postdoc position at MSR NYC on fairness, accountability & transparency in AI/ML. Deadline April 3. http… @hardmaru but I'll do my best w/ the time I have :) @hardmaru there are also some orthogonal (?) issues besides the ones you mentioned that are in the way - e.g. random Jupyter dependency prob @hardmaru yeah, there will definitely be something, just a question of how far it will be from hardmaru-level :) "Twitter100k: A Real-world Dataset for Weakly Supervised Cross-Media Retrieval," Hu et al.: https://t.co/GBBATgHQ8g @ryanfb thanks! will fix. @hardmaru struggling with this now. Want better visualization, but time constraints :( deciding how much to invest... @AMP_SV if it weren't for space constraints, I'd say that before pretty much everything I tweet... @skrish_13 it's not always this bad :) @aireye neither :) some curation (not all AI, some non AI, checking authors), not all worth reading 4 everyone, just potentially of interest "QMDP-Net: Deep Learning for Planning under Partial Observability," Karkus et al.: https://t.co/7b4P5mf2kJ "Tactics of Adversarial Attack on Deep Reinforcement Learning Agents," Lin et al.: https://t.co/3K34nluyIC "On the Use of Default Parameter Settings in the Empirical Evaluation of Classification Algos," Bagnall and Cawley: https://t.co/LDN5dqr7A1 "Variance Reduced Stochastic Gradient Descent with Sufficient Decrease," Shang et al.: https://t.co/0DdAZhRhH3 "Deep Neural Networks Do Not Recognize Negative Images," Hosseini and Poovendran: https://t.co/ot0lInTZA2 "Multi-fidelity Bayesian Optimisation with Continuous Approximations," Kandasamy et al.: https://t.co/JMHteQNUCm "Deciding How to Decide: Dynamic Routing in Artificial Neural Networks," McGill and Perona: https://t.co/w9jVgB130h "Efficient variational Bayesian neural network ensembles for outlier detection," Pawlowski et al.: https://t.co/jReXziyam7 "Counterfactual Fairness," Kusner and Loftus et al.: https://t.co/VB0SFpL50t "Curriculum Dropout," Morerio et al.: https://t.co/pUuPehCw8u "Deep Tensor Encoding," Sengupta et al.: https://t.co/oHzdKi4fE7 "Bernoulli Rank-1 Bandits for Click Feedback," Katariya et al.: https://t.co/O0NSTDulB4 "A Unified Treatment of Multiple Testing with Prior Knowledge," Ramdas et al.: https://t.co/ahg1ffBG82 "I2T2I: Learning Text to Image Synthesis with Textual Data Augmentation," Dong et al.: https://t.co/yHFrnfwHmf "A Systematic Study of Online Class Imbalance Learning with Concept Drift," Wang et al.: https://t.co/UBb9HBovLX "Timbre Analysis of Music Audio Signals with Convolutional Neural Networks," Pons et al.: https://t.co/jr80JmC0O0 "Second-order Convolutional Neural Networks," Yu and Salzmann: https://t.co/npWce6QroT "Boosting Dilated Convolutional Networks with Mixed Tensor Decompositions," Cohen et al.: https://t.co/jnNXRgninj "Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization," Huang and Belongie: https://t.co/mUCZnYfhs6 "Mask R-CNN," He et al., Facebook: https://t.co/C8XcnscuF7 "PatternNet: Visual Pattern Mining with Deep Neural Network," Li et al.: https://t.co/gFqBEOk4Pn "Weakly-supervised DCNN for RGB-D Object Recognition in Real-World Applications... [etc]," Sun et al.: https://t.co/5Upn3g3VyV "Multilevel Context Representation for Improving Object Recognition," Kolsch et al.: https://t.co/PRBFBIcZhY "Zero-Shot Learning by Generating Pseudo Feature Representations," Lu and Li et al.: https://t.co/LmcgB1TVSp "TAC-GAN - Text Conditioned Auxiliary Classifier Generative Adversarial Network," Dash et al.: https://t.co/U7AMN5OQjG "Semi-Supervised Learning with Competitive Infection Models," Rosenfeld and Globerson: https://t.co/06JjmWf6yU "Deep Neural Networks for Semantic Segmentation of Multispectral Remote Sensing Imagery," Kemker and Kanan: https://t.co/a50s5B6dKv "Multi-Timescale, Gradient Descent, Temporal Difference Learning with Linear Options," Kumar and Precup: https://t.co/x4XDU5KCch "Generating Multi-label Discrete Electronic Health Records using Generative Adversarial Networks," Choi et al.: https://t.co/0NnQrikbd7 "VQABQ: Visual Question Answering by Basic Questions," Huang et al.: https://t.co/wOAOxtSoBb "Recurrent Collective Classification," Fan and Huang: https://t.co/66yaVjGqGv "Detecting Oriented Text in Natural Images by Linking Segments," Shi and Bai et al.: https://t.co/kenoN36d5e "Native Language Identification using Stacked Generalization," Malmasi and Dras: https://t.co/6Z3R47KmR0 "Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learning," Das and Kottur et al.: https://t.co/zc1ytmpRZ7 "Paper2vec: Citation-Context Based Document Distributed Representation for Scholar Recommendation," Tian and Zhuo: https://t.co/7cWev5ThyB "Deep Decentralized Multi-task Multi-Agent RL under Partial Observability," Omidshafiei et al.: https://t.co/h2qxOZsOaD "TURN TAP: Temporal Unit Regression Network for Temporal Action Proposals," Gao et al.: https://t.co/E4641GNsVk "Cooperating with Machines," Crandall et al.: https://t.co/lySdPKN43M "Deformable Convolutional Networks" Dai et al.: https://t.co/f2pGltIH7v "Simpler Transfer Learning (Using "Bellwethers")," Krishna and Menzies: https://t.co/voSoYO5UOQ "Recurrent Models for Situation Recognition," Mallya and Lazebnik: https://t.co/DBiz3YZ7zI "Towards Context-aware Interaction Recognition," Zhuang et al.: https://t.co/oUrnUWio9O "Evolving Game Skill-Depth using General Video Game AI Agents," Liu et al.: https://t.co/tKKWPqhbTB "Recognition in-the-Tail: Training Detectors for Unusual Pedestrians with Synthetic Imposters," Huang and Ramanan: https://t.co/jwxmNVXLM9 "Multi-talker Speech Separation and Tracing with Permutation Invariant Training of Deep RNNs," Kolbaek et al.: https://t.co/teoz13ztQj "RoomNet: End-to-End Room Layout Estimation," Lee et al., Magic Leap: https://t.co/vAEatXrLco @ArtirKel @karpathy yes, they're related; much more context + complications in Hernandez-Orallo's account, for good and bad. Great read IMO. @karpathy The Measure of All Minds by Hernandez-Orallo is the book on intelligence evaluation. RT @benjaminwittes: #NotesFromUnderTrump, Day 60: Thoughts on today's Comey hearing from me (https://t.co/pPCys7vtRG) & @adam_i_klein (http… RT @katecrawford: Gig alert! We have a new postdoc role in our NYC lab, focused on fairness & accountability in AI. Deadline April 3. https… RT @goodfellow_ian: The paper on adversarial examples for RL by Sandy Huang and my other co-authros has been accepted to ICLR Workshops: ht… RT @goodfellow_ian: Want to learn about machine learning? Follow @distillpub RT @jbarro: Remember next time someone tells you everything Trump does is a scheme: This hearing would not be happening if not for his stup… RT @morningmoneyben: This is an outrageous lie tweeted from the official account of the president of the United States. https://t.co/X9KypL… RT @shaneharris: Settled now. FBI is investigating possible links between Russia and Trump campaign, FBI Director James Comey says in rare… RT @danieldewey: "Benign model-free RL", Christiano: https://t.co/W5XPnSti7V RT @benjaminwittes: FBI Director James Comey is testifying today on #Wiretapps and #TheRussiaConnection. How to decode what he says. Bottom… RT @pwnallthethings: Fact Check: after extensive checking of calendars, we can say with high confidence that Jun 2016 was before Nov 2016 h… RT @jackclarkSF: Writing up Monday's issue of Import AI. So much has happened! Anything I should definitely mention? https://t.co/6YqBq72ocC @chrisalbon wrong Andrew Ng, I think :) @jeffbigham not state-of-the-art now even if it ever was but learned more from that than most DL papers for sure... @jeffbigham Have you read "State-of-the-art control in Atari with shallow reinforcement learning?" (or something similar). Excellent paper! RT @jeffbigham: I want to read the papers with titles ending in, "without deep learning," yawn. https://t.co/qujh8sgy0x "Modeling Relational Data with Graph Convolutional Networks," Schlichtkrull and Kipf et al.: https://t.co/gftrNDH0pI "Adaptivity to Noise Parameters in Nonparametric Active Learning," Locatelli et al.: https://t.co/osO7bQaDoH "Autocatalytic networks in cognition and the origin of culture," Gabora and Steel: https://t.co/bpsKHzJ01f "Deep Sets," Zaheer et al.: https://t.co/8ylhvUwZJm "Pattern representation and recognition with accelerated analog neuromorphic systems," Petrovici et al.: https://t.co/C7f5xKPhtf "Conditional Accelerated Lazy Stochastic Gradient Descent," Lan et al.: https://t.co/ajBUGdptGo "Particle Value Functions," @cjmaddison et al.: https://t.co/WO0rY8PJRB "Automatically identifying wild animals in camera trap images with deep learning," Norouzzadeh et al.: https://t.co/ko9sb6rtOV "Temporal Information Extraction for QA Using Syntactic Dependencies in an LSTM-based Architecture," Meng et al.: https://t.co/tQzDw9EYSr "DropRegion Training of Inception Font Network for High-Performance Chinese Font Recognition," Zhong et al.: https://t.co/cj2KQkKonZ "Empirical Evaluation of Parallel Training Algorithms on Acoustic Modeling," Li et al.: https://t.co/3zK8JnGlsl "Learning Robust Visual-Semantic Embeddings," Tsai et al.: https://t.co/kxjiBvc41x "Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery," Schlegl et al.: https://t.co/I8cpi4otom "Implicit Gradient Neural Networks with a Positive-Definite Mass Matrix for Online Linear Equations Solving"-Ke Chen https://t.co/LsK5rMe9Os "Auxiliary Manifold Embedding for Fully Convolutional Networks," Baur et al.: https://t.co/ecnS1UZFyh "Towards Diverse and Natural Image Descriptions via a Conditional GAN," Dai et al.: https://t.co/CQEBC3m0RF "Approximation Complexity of Maximum A Posteriori Inference in Sum-Product Networks," Maua and de Campos: https://t.co/CXHohgYYkB "Attention and Localization based on a Deep Conv. Recurrent Model for Weakly Supervised Audio Tagging," Xu et al.: https://t.co/npUD09yIH2 @mark_riedl She just needs to call herself a startup. Cybersecurity+Cyberwar: What Everyone Needs to Know is in middle +also good (accessible but less narrative than Kaplan/detail than Libicki). If you want a very heavy duty analysis of cyberwar, check out Cyberspace in Peace and War by Libicki. More readable: Dark Territory, Kaplan. RT @nmeyersohn: Security's tight at Mar a Lago: "Snuck by secret service to catch this selfie. They might have told us not to go in there."… RT @EricLiptonNYT: https://t.co/jPGZQYh7Yp NCAA bracket... https://t.co/BDbx7B99TJ (vs. a few years ago) It's crazy that ICLR 2017 is single-tracked, and crazy that that's crazy. Recommended. https://t.co/dvbWUrPTe6 @AlxCoventry haven't looked at it very carefully. @iamtrask very cool stuff! RT @iamtrask: Building Safe AI: A Tutorial on Encrypted Deep Learning https://t.co/RXpsInphfy RT @otherlab: Call your representatives and ask them to preserve @ARPAE in the new budget. https://t.co/z6Ol3lmKqM RT @paleofuture: Seriously, why is Ivanka in these meetings with world leaders? Has she been given a title yet because this is just getting… "@sknthla it's spelled: ~*m~*a~*c*~h*~i*~n*~e*~. *~l*~e*~a*~r*~n*~i*~n*~g*~" @sknthla what have you done on AWS? RT @JasonLeopold: At Mar-a Lago, Trump listened in on employee phone calls using a special switchboard installed in his bedroom https://t.c… @kchonyc "interesting" is one way to put it :) "RT @BraddJaffy: Tucker Carlson asks President Trump what he reads. Trump's answer: https://t.co/ZtisPyCezw" RT @forachelP: What's at stake in proposed budget cuts to DOE. Short answer: it would be very ugly: https://t.co/batA8ynXyT RT @nalkalchbrenner: New paper update: minimal Bytenet and vanilla search with state-of-the-art results on char-to-char translation! https:… "Concentration Bounds for Two Timescale Stochastic Approximation with Applications to RL," Dalal et al.: https://t.co/q38WUJCz2j "End-to-end optimization of goal-driven and visually grounded dialogue systems," Strub et al., Inria/DeepMind/MILA: https://t.co/vomvy5g3RL "DeepVel: deep learning for the estimation of horizontal velocities at the solar surface," Ramos et al.: https://t.co/vUTEX4IkEK "Bayesian Sketch Learning for Program Synthesis," Murali et al.: https://t.co/hzTgJC5opc "Scalable Accelerated Decentralized Multi-Robot Policy Search in Continuous Observation Spaces," Omidshafiei et al.: https://t.co/36JSzpozIt "Semantic-level Decentralized Multi-Robot Decision-Making using Probabilistic Macro-Observations," Omidshafiei et al https://t.co/sYiSSJv9pS "Deep Sketch Hashing: Fast Free-hand Sketch-Based Image Retrieval," Liu et al.: https://t.co/HaacaYrRZi "ParaGraphE: A Library for Parallel Knowledge Graph Embedding," Niu and Li: https://t.co/e0koCfMV6T "Fraternal Twins: Unifying Attacks on Machine Learning and Digital Watermarking," Quiring et al.: https://t.co/TRQr5XgPiS "From visual words to a visual grammar: using lang. modelling for image classification," Foncubierta-Rodríguez et al https://t.co/4HAl1J7iu4 "Steganographic Generative Adversarial Networks," Volkhonskiy et al.: https://t.co/G3E6Qo6DiF "Database Learning: Toward a Database that Becomes Smarter Every Time," Park et al.: https://t.co/1YnBgm9XZY "Using Human Brain Activity to Guide Machine Learning," Fong et al.: https://t.co/6qDZZNzUap "Refining Image Categorization by Exploiting Web Images and General Corpus," Yao et al.: https://t.co/oD8Jcx895l "Look into Person: Self-supervised Structure-sensitive Learning and A New Benchmark for Human Parsing," Gong et al.: https://t.co/CmxnrQWunc "Large Scale Evolution of Convolutional Neural Networks Using Volunteer Computing," Travis Desell: https://t.co/G5QpZrZmgS "Aggregation of Classifiers: A Justifiable Information Granularity Approach," Nguyen et al.: https://t.co/vv6JQTU4gR "Intrinsic Motivation and Automatic Curricula via Asymmetric Self-Play," Sukhbaatar et al., Facebook: https://t.co/UxnEsVoxzi "Convolutional Recurrent Neural Networks for Small-Footprint Keyword Spotting," Arik and Kliegl et al., Baidu: https://t.co/HeFbi3FHyZ "A Study of Complex Deep Learning Networks on High Performance, Neuromorphic, and Quantum Computers," Potok et al.: https://t.co/lvriyRagQK "End-to-End Learning for Structured Prediction Energy Networks," Belanger et al.: https://t.co/UtOLJpuk0v "Efficient Online Learning for Optimizing Value of Information," Chen et al.: https://t.co/0Nvvjp7s5I "Minimax Regret Bounds for Reinforcement Learning," Azar et al.: https://t.co/IQIZPg0GFF "Shift Aggregate Extract Networks," Orsini et al.: https://t.co/HER4focFo4 RT @derekchollet: 2011's Birther is 2017's "PhoneTapper", & in the end, when no evidence exists, Trump will claim credit for clearing all t… RT @aaronecarroll: PREPARE FOR A F*$@ING TWEETSTORM OF RESULTS https://t.co/rqDhNx6tb9 RT @MarkLGoldberg: Trump seeks DEEP cuts to humanitarian relief, just as 20 million people are threatened by famine. https://t.co/lsihHD2arm RT @eveewing: when you're on a panel and someone's "question" about your research is just an extensive statement about their own research h… RT @NoahShachtman: I hate to say it, but if I wanted to undercut America's standing in the world, I'd start w medical research, diplomacy &… RT @GlennThrush: Senior aide to Hill GOP leadership on Trump/budget: 'its a joke...we've learned not to listen to anything he says or does.… RT @SamanthaJPower: Upside Down Land: State Department tweets in praise of its own evisceration https://t.co/vv6ui7XLcN RT @catherineols: Great work from colleagues Igor and @pabbeel - agents learning to use abstract symbols as a grounded, compositional langu… RT @OpenAI: Learning to communicate: https://t.co/1oNJ90GWhI RT @washingtonpost: Trump’s budget calls for seismic disruption in medical and science research https://t.co/32XWs4pBsb RT @washingtonpost: Trump’s budget takes a sledgehammer to the EPA https://t.co/LyQRyKYEhS https://t.co/AZeYR72gOr RT @washingtonpost: Many State Department programs advanced by the Obama administration will be devastated https://t.co/muQWyilZ0A https://… RT @washingtonpost: Federal health department would face a nearly 18 percent cut https://t.co/fAHp7nGUYn https://t.co/dhQYaZvZoT RT @washingtonpost: NIH would see huge budget cut under president’s proposal https://t.co/XwAkZq9nAm https://t.co/ZjAPT99a74 But seriously, that budget is really horrible. Fortunately the WH proposal isn't the last word, + industry/Cong. may help, but v. bad start. And he took away the buildings of another former place where I worked recently (CEQ). Fortunately he can't get rid of ASU/Oxford! :) Not the most damaging part (hard to know where to begin), but would also axe Woodrow Wilson Center. That + ARPA-E = two of my alma maters... TL;DR, lots of stuff, including lots of important stuff such as ARPA-E. https://t.co/bKjJfWjc9t "RT @cohan_ds: @ARPAE Heritage Foundation is pushing Trump to eliminate ARPA-E energy research https://t.co/VD89IosDdE" RT @jackclarkSF: At this stage I would pay $5 a week for a summary of AI research on Arxiv. Can we figure out a way to build something that… "Deep Embedding Forest: Forest-based Serving with Deep Embedding Features," Zhu et al.: https://t.co/CVdCsvQ7Nq "A clever elimination strategy for efficient minimal solvers," Kukelova et al.: https://t.co/vKm5iXzViU "InScript: Narrative texts annotated with script information," Modi et al.: https://t.co/1wpgQeV4xD "Hybrid Supervised-unsupervised Image Topic Visualization with Convolutional Neural Network and LDA," Zhen et al.: https://t.co/oiP2wmjHzY "Humans of Simulated New York (HOSNY): an exploratory comprehensive model of city life," Tseng et al.: https://t.co/ZUNzMucF3m "Texture segmentation with Fully Convolutional Networks," Andrearczyk and Whelan: https://t.co/H2XeUTxuJI "Learning to Discover Cross-Domain Relations with Generative Adversarial Networks," Kim et al.: https://t.co/arSP88VIqM "A Data Driven Approach for Compound Figure Separation Using Convolutional Neural Networks," Tsutsui and Crandall: https://t.co/aAn6IEcLpO "Fonduer: Knowledge Base Construction from Richly Formatted Data," Wu et al.: https://t.co/Ft8xBUKuHQ "Large Margin Object Tracking with Circulant Feature Maps," Wang et al.: https://t.co/hnUPP2dInE "Zero-Shot Recognition using Dual Visual-Semantic Mapping Paths," Li et al.: https://t.co/aw5MvtuUfD "Neural Programming by Example," Shu and Zhang: https://t.co/WNhTAGaHAZ "What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?," Kendall and Gal: https://t.co/u4jOVAFiPW "End-to-end Binary Representation Learning via Direct Binary Embedding," Liu et al.: https://t.co/BRZ0MuoC8t "Sharp Minima Can Generalize For Deep Nets," Dinh et al.: https://t.co/qGiGs2w5rc "SyntaxNet Models for the CoNLL 2017 Shared Task," Alberti et al.: https://t.co/qfXbHkuUdN "Ensemble of Neural Classifiers for Scoring Knowledge Base Triples," Yamada et al.: https://t.co/hs3TnVASVd "Emergence of Grounded Compositional Language in Multi-Agent Populations," Mordatch and Abbeel: https://t.co/4GLznGiE8z "Vision-based Robotic Arm Imitation by Human Gesture," Tiang and Xu: https://t.co/6p1ZO4IBMf "Improving Neural Machine Translation with Conditional Sequence Generative Adversarial Nets," Yang et al.: https://t.co/xODBfTeYiE "Hacker Combat: A Competitive Sport from Programmatic Dueling & Cyberwarfare," Jovonni Pharr: https://t.co/qGVZlnyUbe "Encoding Sentences with Graph Convolutional Networks for Semantic Role Labeling," Marcheggiani and Titov: https://t.co/BqfHqHTCLz "Neural Graph Machines: Learning Neural Networks Using Graphs," Bui et al.: https://t.co/nhyzimKkrA "FastQA: A Simple and Efficient Neural Architecture for Question Answering," Weissenborn et al.: https://t.co/TJMd4Yx47R "Multichannel End-to-end Speech Recognition," Ochiai et al.: https://t.co/nL2p6luDM5 "Audio Scene Classification with Deep Recurrent Neural Networks," Phan et al.: https://t.co/ol1d5G23le "Towards Moral Autonomous Systems," Charisi et al.: https://t.co/Mg1UCqeS44 "Tree Memory Networks for Modelling Long-term Temporal Dependencies," Fernando et al.: https://t.co/5kBYoC9ZcW "Joint Learning of Correlated Sequence Labelling Tasks Using Bidirectional Recurrent Neural Networks," Pahuja et al. https://t.co/NQ0wVuPWyo "Exploring Question Understanding and Adaptation in Neural-Network-Based Question Answering," Zhang et al.: https://t.co/jUYKwdqvKE "Recasting Residual-based Local Descriptors as CNNs: an Application to Image Forgery Detection," Cozzolino et al.: https://t.co/5pnAttcikd "Minimizing Maximum Regret in Commitment Constrained Sequential Decision Making," Zhang et al.: https://t.co/MJco6524yC "Resilience: A Criterion for Learning in the Presence of Arbitrary Outliers," Steinhardt et al.: https://t.co/iBD27UEL1A "Prototypical Networks for Few-shot Learning," Snell et al.: https://t.co/sJ8hbjfI7J "Understanding Black-box Predictions via Influence Functions," Koh and Liang: https://t.co/q8IQhFycVe "Learned Optimizers that Scale and Generalize," Wichrowska et al.: https://t.co/OuPNSFMP2x "Discriminate-and-Rectify Encoders: Learning from Image Transformation Sets," Tacchetti et al.: https://t.co/5cdpdlCIfv "Convergence of Deep Neural Networks to a Hierarchical Covariance Matrix Decomposition," Dehmamy et al.: https://t.co/aGYs7LIb46 "Online Learning Rate Adaptation with Hypergradient Descent," Baydin et al.: https://t.co/PIYO0lKdrT "Sensor Fusion for Robot Control through Deep Reinforcement Learning," Bohez et al.: https://t.co/n9uj3imVyq @gwern actually, just checked and it scales slightly sublinearly (another, not as good overall, algo in paper scales superlinearly). Anyway. @gwern A3C supposedly scales pretty well, though, so it's plausible it's good in that case, too. Thanks for sharing. @gwern hard to tell, but looks like within an order of magnitude, possibly more cores ("hundreds"/"thousands"). Scaling also unclear. Imagine linear speedup continues,cores increased 10x (14.4k), and 10x speedup from low precision. Train agent on all Atari games in an hour. Linear speedup in number of CPU cores=crazy. Also not aware of any papers showing anywhere near that # of cores (1440) for a task like this. This paper is important + if the proposal excerpted here works , will lead to insanely fast/parallelizable learning. https://t.co/ZgNUZc2sQ8 https://t.co/dtCOHH34gt Put another way, mean/median score for few hours of training is now approx. where it was for hundreds/thousands of hours a few years ago. ("Human-level" baseline=pro playing 2 hours. Normal people can do OK faster, unlike AI currently, but gap much narrower after few hours) Per Tsividis et al., that wouldn't be human-level in earliest stages - humans can learn to do OK immediately. But would allow apples/apples. Re: Atari efficiency: roughly, if you cut the 1 million frames in half while doubling score, + it'd be equal to human tester's time/score. https://t.co/kkChqbB8QH RT @mlcalderone: Johnston said “it’s entirely possible" that Trump sent the return because of his history of leaking to the news media. htt… @AlxCoventry nothing new today, per update at the top of the site. Will be double tomorrow. This is obviously why Maddow chose tonight to release Trump's tax return. @kleinsound I'm hopeful that @jackclarkSF will figure out a way to crowdsource my services :) Good news: no arXiv tonight. Bad news: double arXiv tomorrow night. "RT @maddow: BREAKING: We've got Trump tax returns. Tonight, 9pm ET. MSNBC. (Seriously)." RT @haldaume3: Really excited that we (finally!) have shared task details posted; please sub to mailing list for data announcements https:/… RT @demishassabis: Cool neuroscience-inspired idea to help with the critical problem of continual learning. https://t.co/G2bc6m3D5l @mark_riedl that's irrational RT @cvondrick: CVPR workshop on negative results! https://t.co/hrYo7D6Nni @rbhar90 congrats! @skrish_13 having trouble finding it right now though, sorry :( @skrish_13 I'd go with the review paper, prob. RT @poolio: New paper w/@hisspikeness, @SuryaGanguli uses intelligent synapses to solve sequences of tasks without forgetting: https://t.co… Fin. "Online Learning with Local Permutations and Delayed Feedback," Shamir and Szlak: https://t.co/K4t79YyW89 "Conjugate-Computation Variational Inference," Khan and Lin: https://t.co/gJLUSdSZea "MetaPAD: Meta Pattern Discovery from Massive Text Corpora," Jiang et al.: https://t.co/AxCSXcCS5g "DeepFM: A Factorization-Machine based Neural Network for CTR Prediction," Guo et al.: https://t.co/oivd1y3g59 "Sequential Bayesian Optimisation as a POMDP for Environment Monitoring with UAVs," Morere et al.: https://t.co/BlRJC0qYie "Hardware-Driven Nonlinear Activation for Stochastic Computing Based Deep CNNs," Li et al.: https://t.co/n8FrMBrjBI "Autoregressive Convolutional Neural Networks for Asynchronous Time Series," Binkowski et al.: https://t.co/idaqzIvBK9 "Detection of Human Rights Violations in Images: Can Convolutional Neural Networks help?," Kalliatakis et al.: https://t.co/3QHzasq3dQ """Combining Residual Networks with LSTMs for Lipreading,"" Stafylakis and Tzimiropoulos: https://t.co/6RgyNHZfNt 83% (+6.8%) on LRITW dataset" "Improving Interpretability of Deep Neural Networks with Semantic Information," Dong et al.: https://t.co/CcsWe1kIYd "SurfNet: Generating 3D shape surfaces using deep residual networks," Sinha et al.: https://t.co/HozPgUQNQn "A Compact DNN: Approaching GoogLeNet-Level Accuracy of Classification and Domain Adaptation," Wu et al.: https://t.co/rtyOgjiN0K "Prediction and Control with Temporal Segment Models," Mishra et al., Berkeley/OpenAI: https://t.co/BbIDrLcYrk "Colorization as a Proxy Task for Visual Understanding," Larsson et al.: https://t.co/HrVAvg3eFo "Automated Hate Speech Detection and the Problem of Offensive Language," Davidson et al.: https://t.co/QAetoYSBo3 "Ask Me Even More: Dynamic Memory Tensor Networks (Extended Model)," Ramachandran and Sohmshetty: https://t.co/pbA8gZhcSs "A 3D Object Detection and Pose Estimation Pipeline Using RGB-D Images," He et al.: https://t.co/hJHUY7N1bu "Viraliency: Pooling Local Virality," Alameda-Pineda et al.: https://t.co/D39AIbEXe9 https://t.co/rKDpImmghf "Real-Time Machine Learning: The Missing Pieces," Nishihara and Moritz et al., Berkeley: https://t.co/rvfHLMf1gR "Deep Image Matting," Xu et al.: https://t.co/AYKWUIgbNi RT @hardmaru: The 128-GPU "Outrageously Large Neural Network" has roughly the same number of model parameters as the number of synapses of… "Code: https://t.co/e7SxzYPBBp Also: over 250,000 GPU hours." "Massive Exploration of Neural Machine Translation Architectures," @dennybritz and Goldie et al.: https://t.co/LkuPSqg5M3 whoops, supposed to be a * after @poolio's name, sorry :) "Front-to-End Bidirectional Heuristic Search with Near-Optimal Node Expansions," Chen et al.: https://t.co/i0Xuj47FCn "Probabilistic Database Summarization for Interactive Data Exploration," Orr et al.: https://t.co/H8yTofpWqy "Convolutional Spike Timing Dependent Plasticity based Feature Learning in Spiking Neural Networks," Panda et al.: https://t.co/b96lUvoAGZ "Blocking Transferability of Adversarial Examples in Black-Box Learning Systems," Hosseini et al.: https://t.co/F9QOPVrVDB "Story Cloze Ending Selection Baselines and Data Examination," Mihaylov and Frank: https://t.co/8aG7IOnsti "DRAGNN: A Transition-based Framework for Dynamically Connected Neural Networks," Kong et al.: https://t.co/mnRoo5gC3Y "Zero-Shot Learning - The Good, the Bad and the Ugly," Xin et al.: https://t.co/ny3U7Do2PB "Deep Value Networks Learn to Evaluate and Iteratively Refine Structured Outputs," Gygli et al.: https://t.co/GoB1scKyDy "Nematus: a Toolkit for Neural Machine Translation," Sennrich et al.: https://t.co/1RugZeIi1o "Task-based End-to-end Model Learning," Donti et al.: https://t.co/bonGUBGI6i "EmbedInsight: Automated Grading of Embedded Systems Assignments," Li et al.: https://t.co/QdXdA6OLx4 "A Hierarchical Framework of Cloud Resource Allocation and Power Management Using Deep RL," Liu et al.: https://t.co/lVm7w40akE "Bayesian Optimization with Gradients," Wu et al.: https://t.co/316S7pigSt "Practical Bayesian Optimization for Variable Cost Objectives," McLeod et al.: https://t.co/OOpz7DAaSp "Langevin Dynamics with Continuous Tempering for High-dimensional Non-convex Optimization," Ye et al.: https://t.co/xjmX4KeR6E "Byzantine-Tolerant Machine Learning," Blanchard et al.: https://t.co/xMcbhpBMH0 "Multiscale Hierarchical Convolutional Networks," Jacobsen et al.: https://t.co/mRXjRbK8yv "Improved multitask learning through synaptic intelligence," Zenke,* @poolio, and @SuryaGanguli: https://t.co/p3cHqSE3hx I don't have time to vet/tweet abt all good papers on medical application of deep learning these days, but suffice it to say there are many. @togelius @ankurhandos called this successfully - https://t.co/1NQbiN9lUj + maybe @hardmaru ? @togelius apparently. They say it's a similar amt of computation... perhaps, but learning curves other than Pong wld be nice. I'm an Atari result snob apparently. Pretty good Atari results in 1 hour with evolution on a bunch of CPUs, 1 billion frames (again, like Lee et al., hard to compare... sad!). Conceptually interesting stuff in any case. Promising early (stage of training) results on Montezuma's Revenge, but hard to compare to other results at 10s of millions of frames later. "Micro-Objective Learning : Accelerating Deep RL through the Discovery of Continuous Subgoals," Lee et al.: https://t.co/7skMQlf02A "Evolution Strategies as a Scalable Alternative to Reinforcement Learning," Salimans et al., OpenAI: https://t.co/1IPWiP6GZt (on the other hand, if you haven't watched BSG, you probably should) "Battlestar Galactica in 30 Seconds" (don't watch if you haven't seen it): https://t.co/RsrGhWwUHz @jimmfleming yeah, I noticed this earlier :( needed it... RT @LeverhulmeCFI: We are recruiting! Research Assistant/Associate, Impact of AI at the CFI @Cambridge_Uni https://t.co/lKffEg0BQA #jobsacu… RT @vicenews: Watch Alex Jones do impressions of Bernie Sanders, Arnold Schwarzenegger, and Rachel Maddow https://t.co/7iW5ELNjpF RT @scott_e_reed: Sampling animations for Parallel Multiscale Autoregressive Density Estimation. https://t.co/rNabVgzPGa "The cognitive roots of regularization in language," Ferdinand et al.: https://t.co/E076A5kydR "Sample Efficient Feature Selection for Factored MDPs," Guo and Brunskill: https://t.co/KN8v5Gtel4 "Learning to represent signals spike by spike," Brendel, Bourdoukan, and Vertechi et al.: https://t.co/QWo1RbMAs8 "Applying the Wizard-of-Oz Technique to Multimodal Human-Robot Dialogue," Marge et al.: https://t.co/MLxbc2KiTu "Coping with Construals in Broad-Coverage Semantic Annotation of Adpositions," Hwang et al.: https://t.co/Vvdopql76d "Right for the Right Reasons: Training Differentiable Models by Constraining their Explanations," Ross et al.: https://t.co/h5lqTYUFXC "Integer Factorization with a Neuromorphic Sieve," Monaco and Vindiola: https://t.co/LP6zqgxrOt "Evolutionary Image Composition Using Feature Covariance Matrices," Neumann et al.: https://t.co/9x3TlLdwBI "Learning Gradient Descent: Better Generalization and Longer Horizons," Lv et al.: https://t.co/HY1n4cNh5m "What can you do with a rock? Affordance extraction via word embeddings," Fulda et al.: https://t.co/lElvPSic7w "Deep Radial Kernel Networks: Approximating Radially Symmetric Functions with Deep Networks," McCane/Szymanski: https://t.co/5atB7L0u7V "Using Options for Long-Horizon Off-Policy Evaluation," Guo et al.: https://t.co/hfj3xeuRLn "On-line Learning with Abstention," Cortes et al.: https://t.co/8Z0yvItJjA "Real-time Perception meets Reactive Motion Generation," Kappler et al.: https://t.co/rGtG43Nta7 "Interactive Program Synthesis," Le et al., Microsoft: https://t.co/k69IcEAkaR "Parallel Multiscale Autoregressive Density Estimation," @scott_e_reed et al. at DeepMind: https://t.co/9mInkKEXL4 Some interesting samples. https://t.co/Dd3mBPPHPR RT @ColinKahl: Beyond the moral implications here, this is bad strategy. Lots of dead civilians means more recruits for AQ, ISIS. https://t… Can't really summarize key takeaways from it in tweets, but trust me, it's good. Dark Territory by Kaplan is a remarkably well-written/entertaining/informative book on the history of cyberwar (there is indeed history!). RT @NicolasPapernot: My talk at @enigmaconf on adversarial examples is now up! Thanks to @goodfellow_ian and @UlfarEr for helping out https… RT @RebeccaCrootof: I managed to write about something other than #AWS! Check out "Political Hacks: State Accountability in Cyberspace" htt… "RT @NicWilko: The alphabet, arranged symmetrically by Scott Kim. This is unimaginably pleasing to me. https://t.co/vavu2ofky0" RT @HttpStatus402: 100 announcements (!) from Google Cloud Next '17 https://t.co/QDSPJmJpzi #GoogleNext17 RT @mark_riedl: Tons of AI game competitions! https://t.co/FF9HEOIDSM @sknthla pls dont hack me RT @goodfellow_ian: Congratulations @yaroslav_ganin https://t.co/tioWfHbMI4 RT @originalgriz: Trump taking credit for Obama’s economy is like someone inheriting millions from his dad and bragging about what a smart… RT @hardmaru: PyTorch Tutorial: Most of the models were implemented with less than 30 lines of code. https://t.co/ITqbIFs8KF RT @fchollet: Reminder: you can contribute to Keras 2 by sending PRs to add conversion interfaces for the 1.0 API. Looks like: https://t.co… Great talk - Thore Graepel on multiagent learning and AI: https://t.co/fgtVk998LY RT @allanfriedman: Cybersec folks often say that all IT is vulnerable, the West is just more exposed. Now there is a picture. https://t.co/… RT @markus_with_k: And now with uploaded video #turinglecture https://t.co/zLmAthb3D4 https://t.co/0kBNTKChwE @markus_with_k oo, thx for sharing! will watch later. Dunno why that hyperlink didn't work... (referenced in Kaplan's great book "Dark Territory: The Secret History of Cyber War") "Security and Privacy in Computer Systems," Willis Ware, 1967: http://130.154.3.8/content/dam/rand/pubs/papers/2005/P3544.pdf https://t.co/hMuVZpfu7T "RT @preskill: ""the remaining challenges are mostly engineering ones, rather than scientific""? No, quantum science has far to go. https://t…" RT @FHIOxford: Postdoctoral position on AI impacts at the Leverhulme Centre for the Future of Intelligence in Cambridge: https://t.co/MTAlG… @Aelkus I also am not fully sold on Third Off. but didn't get much meat from this article...intelligentization doesn't sound radically diff @Aelkus Not sure about that... US has had policies supporting AI for decades, Third Offset puts it front and center, etc...? RT @girlziplocked: Don't worry I wasn't. https://t.co/ThYJvq001I "Deep Variation-structured Reinforcement Learning for Visual Relationship and Attribute Detection," Liang et al.: https://t.co/WCGzKOx90c "UntrimmedNets for Weakly Supervised Action Recognition and Detection," Wang et al.: https://t.co/2T3RGAod7m Was just thinking about picture-to-caricature translation the other day...not what this is, but maybe data useful... https://t.co/5loFYMj9G8 "WebCaricature: a benchmark for caricature face recognition," Guo et al.: https://t.co/a9n1WTVla6 "An Approach to Autonomous Science by Modeling Geological Knowledge in a Bayesian Framework," Arora et al.: https://t.co/RZpc3WvcPo "A Structured Self-attentive Sentence Embedding," Lin et al.: https://t.co/yaOFP5m7s2 "Learning to Remember Rare Events," Kaiser et al.: https://t.co/Ksjy6OGNCn "Coordinated Multi-Agent Imitation Learning," Le et al.: https://t.co/KZQOLIHmyo "DA-RNN: Semantic Mapping with Data Associated Recurrent Neural Networks," Xiang and Fox: https://t.co/tDoZRw7iik "Deep Convolutional NN Inference with Floating-point Weights and Fixed-point Activations," Lai et al. at ARM (hmm): https://t.co/aAWGNKfwCj "Interpretable Structure-Evolving LSTM," Liang et al.: https://t.co/Kw1l5sGOpd "Fast Genetic Algorithms," Doerr et al.: https://t.co/4gQrsv5PXu "Learning Active Learning from Real and Synthetic Data," Konyushkova et al.: https://t.co/SCmZJoOcq3 Nice video: https://t.co/HPcVO6Y7Nj "Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks," Finn et al.: https://t.co/8Nq19lbKFR "Combining Model-Based and Model-Free Updates for Trajectory-Centric RL," Chebotar, Hausman, and Zhang et al.: https://t.co/5oPSzamKor RT @haldaume3: @Miles_Brundage that said I don't do robots. maybe it's different there. in which case I want the secret sauce :) RT @haldaume3: @Miles_Brundage RL should be last resort. if you have demonstrations, for chrissake throw your reward fn out the window and… @haldaume3 why? RT @haldaume3: @Miles_Brundage totally disagree with that flowchart :) Cool figure from this paper... https://t.co/Jf6Jg3eiax https://t.co/bD80wqr8H7 RT @BenLaurie: Our plans at @DeepMindAI for verifiable audit: https://t.co/IfeK4UuvUw. #TransparentAllTheThings. RT @mustafasuleymn: Really excited about this! We want to be as innovative with governance & transparency as we are with the technology its… @ankurhandos nice summary RT @ankurhandos: appealingly simple idea that is efficient in sampling experiences though needs huge memory overall to store the experience… RT @timhwang: Deep States' Rights @PittLabs @Aelkus that doesn't hurt. Also a big state. @Aelkus re: tourism - lots of random low ed. seasonal jobs, lots of random low e ppl..hard to explain but makes sense to me (grew up there) @Aelkus cuz FL is weird. Why is FL weird? Various reasons. Southern culture in close proximity to northern; tourism industry dominance; size @daviottenheimer @aprilaser still not totally following but sounds interesting, maybe send DM or multi tweets? i may be too tired too :) @daviottenheimer @aprilaser what do you mean? @aprilaser alas, didn't record long video of the demo (maybe online somewhere) but gist was a search for stuff like "horses riding left" etc @aprilaser indeed. Saw impressive demo of this even w/ small scale resources a while back - https://t.co/uhkqCfZUbC "Nearly-tight VC-dimension bounds for piecewise linear neural networks," Harvey et al.: https://t.co/pA0T1AIjvW "Multi-Robot Active Information Gathering with Periodic Communication," Lauri et al.: https://t.co/KaWiOsiKnt "Online Learning Without Prior Information," Cutkosky and Boahen: https://t.co/EeHPF0oYQz "Unsupervised Ensemble Regression," Dror et al.: https://t.co/ODdfwWCVSD "A Pursuit of Temporal Accuracy in General Activity Detection," Xiong et al.: https://t.co/4330pT5ZQu "Large Kernel Matters -- Improve Semantic Segmentation by Global Convolutional Network," Peng et al.: https://t.co/ZRH8TWbFRP "Streaming Weak Submodularity: Interpreting Neural Networks on the Fly," Elenberg et al.: https://t.co/izoY2AVqEv "Deep Bayesian Active Learning with Image Data," Gal et al.: https://t.co/eSMs9NSJGi "Learning Invariant Feature Spaces to Transfer Skills with Reinforcement Learning," Gupta and Devin et al.: https://t.co/YUZvIrlFgr "Transformation-Grounded Image Generation Network for Novel 3D View Synthesis," Park et al.: https://t.co/rxrP0TB2oK "Data Noising as Smoothing in Neural Network Language Models," Xie et al.: https://t.co/XIehogMvLe "Linguistic Knowledge as Memory for Recurrent Neural Networks," Dhingra et al.: https://t.co/e6MKJPd1De "Robust Adversarial Reinforcement Learning," Pinto et al.: https://t.co/uiLUn1mOZR "What Would You Do? Acting by Learning to Predict," Tow et al.: https://t.co/baDUKn3WQH """Towards Generalization+Simplicity in Continuous Control,' Rajeswaran+Lowrey et al https://t.co/fJUWG4nfGQ Nice vid https://t.co/HBYqgrbemE" RT @drfeifei: We have launched AI4ALL today, the umbrella org for educating and supporting diversity in AI education @ai4allorg https://t.c… @carlesgelada don't disagree, just want to know both :) @jwan584 @jackclarkSF agree, seems impressive. Progress on BabI benchmark v fast too.. @davegershgorn context? @jackclarkSF SAD! @hardmaru what you described sounded harder, though maybe not that much ;) @hardmaru brb I'll evolve one from scratch using 10^24 FLOPs. RT @moyix: @Miles_Brundage ... and non-strcpy/memcpy BOFs. And if it doesn't generalize, then it's in the realm of things that compilers al… RT @moyix: @Miles_Brundage Without those, my default assn. would be that this won't generalize to larger functions, longer-range data depen… @moyix fair points! RT @moyix: @Miles_Brundage We have plenty. They even mention Juliet but don't use it! And there's also the DARPA CGC corpus and lots of oth… Comment on "End-to-End Prediction of Buffer Overruns from Raw Source Code via Neural Memory Networks" paper - https://t.co/r6kQraVoEd @moyix how so? RT @physikite: Tfw you see one @Miles_Brundage paper tweet and you know you're in for a ride https://t.co/jsChM4K3vG "Optimizing Deep CNN-Based Queries over Video Streams at Scale," Kang et al.: https://t.co/JdNsepZdQB "Unsupervised Visual-Linguistic Reference Resolution in Instructional Videos," Huang et al.: https://t.co/QSwsOU3zLI "Leveraging Large Amounts of Weakly Supervised Data for Multi-Language Sentiment Classification," Deriu et al.: https://t.co/UalwsRGPcy "End-to-End Prediction of Buffer Overruns from Raw Source Code via Neural Memory Networks," Choi et al.: https://t.co/6qRpWB05nv "Learning from Noisy Labels with Distillation," Li et al.: https://t.co/WpeB2BztaZ "Deep Learning based Large Scale Visual Recommendation and Search for E-Commerce," Sankar et al.: https://t.co/0LSWHhBhZL "Effects of Faults, Experience, and Personality on Trust in a Robot Co-Worker," Sarkar et al.: https://t.co/k4IwMUyjqU "Triple Generative Adversarial Nets," Li et al.: https://t.co/LChs48ox0s "Sharing Residual Units Through Collective Tensor Factorization in Deep Neural Networks," Yunpeng et al.: https://t.co/Z71p8FIi27 "Deep View Morphing," Ji et al.: https://t.co/hlp46viuWw "The Feasibility of Dynamically Granted Permissions: Aligning Mobile Privacy w User Preferences," Wijesekera et al: https://t.co/mHZFwBllFZ "Deep Robust Kalman Filter," Shashua and Mannor: https://t.co/bjaUH9smQg "On the Limits of Learning Representations with Label-Based Supervision," Song et al.: https://t.co/S4LLqXlkxP "Stochastic Action Value Gradients," Okesanjo and Kofia: https://t.co/zgyw3aLFfa "RT @deaneckles: Filling out the Alphabet with data science and ML contests https://t.co/4K5oplMTJr" @AMP_SV :) (well, I didn't say there'd be no more interesting research, or that AI would be superhuman on *every* benchmark, but generally > bullish) @chris_brockett @StrongDuality does it make sense to wait that long? Couldn't it have been parallelized a *bit* more in less than that time? "RT @StrongDuality: ""..training took about 80 days for 1.5 billion samples, on 2 Nvidia K80 GPU’s (4 devices) with batch size 64 per GPU..""…" @mark_riedl I don't get it. Explain? RT @GokuMohandas: Notes on the Joint Many-Task Model. Among my fav papers in 2016, expanding on a powerful concept for future models. https… RT @ZekeJMiller: BEIJING (AP) - China proposes North Korea suspend nuclear, missile activities in exchange for halt in US-South Korea milit… Apparently this is a thing: https://t.co/kFVWSKynvu https://t.co/s3bzWkClEV "English Conversational Telephone Speech Rec. by Humans + Machines," Saon et al: https://t.co/PqlPf3nQpq TBD! I've (weakly) claimed opposite https://t.co/opJ1RfJx6t Lol what is up with this parody paper? "Stopping GAN Violence: Generative Unadversarial Networks" - Some samples... https://t.co/2kefgANMxA https://t.co/oW9IPHuoP3 No clear sign of an asymptote yet, but need to see the overall data. @AMP_SV @Smerity "fake AI bot or something" is a lot of business models/marketing strategies these days, it seems... Might estimate based on the few games reported/eyeballing the graphs at some point, though. Seaquest, Montezuma, some others=big gains. Qualitatively, still pretty fast rate of progress so I still think the mean/median will be a lot higher by the end of the year, if reported. Neural Episodic Control has them at few early stages of training, but not the usual 200 million frames. Want to see how my forecasts fare :) No mean/median late stage scores yet in latest papers using Atari :( hopefully the final versions of the papers will have them. Table from the paper comparing the search spaces of some previous approaches... https://t.co/XrcTetAzAN Reading the large-scale evolution paper and it's crazy. From practically nothing to trained neural net with evolution, hence mega-compute. RT @trevor_cox: Google has just published a huge database of everyday sounds for machine learning https://t.co/JPb76dTAbJ "RT @yaringal: Bayesian neural networks uncertainty can be used to distinguish adversarial from non-adversarial images! new results https://…" RT @jteevan: The Microsoft Research Dissertation Grant recognizes and supports diverse graduate students: https://t.co/v9AuhhQn4G RT @DefTechPat: No. https://t.co/3lpbgkCwEU RT @gdm3000: Awesome Neural Machine Translation and Seq2Seq tutorial by @gneubig https://t.co/GnsnrIOS5I RT @marcgbellemare: Our paper on PixelCNN for exploration is out! Neural alternative to CTS + practical insights into "hard" exploration ht… @markus_with_k quick :) @aqibsaeedahmed seems like it, or will be soon... @jackclarkSF sounds cool to me... @SparseJacobian https://t.co/GLmzakqGBh @SparseJacobian they use other methods. Dunno bout billions but def millions. "Axiomatic Attribution for Deep Networks," Sundarajan et al.: https://t.co/KcA5TACQ6H "Extracting Real-time Feedback with Neural Networks for Simulation-based Learning," Ma et al.: https://t.co/oW9GroUFlA "Addressing Appearance Change in Outdoor Robotics with Adversarial Domain Adaptation," @markus_with_k et al.: https://t.co/S0m5bgUDyf "Generative Compression," Santurkar et al.: https://t.co/FHYu5SUJ5R "Genetic CNN," Xie and Yuille: https://t.co/8c27IeXY33 "Using Graphs of Classifiers to Impose Declarative Constraints on Semi-supervised Learning," Bing et al.: https://t.co/UswNkC71EM "A Unified Bellman Equation for Causal Information and Value in Markov Decision Processes," Tiomkin and Tishby: https://t.co/FgrtSOsSIe "Weight-averaged consistency targets improve semi-supervised deep learning results," Tarvainen and Valpola: https://t.co/lq1EJ8eM9o @Brombadil good hierarchical RL methods are a bottleneck... @Brombadil not in just paper, I just think stuff like this may be helpful in realizing my existing forecast for SC - https://t.co/rzqLGysyfy @alexjc I thought this would get a lot of attention at the time! Doesn't seem to have but still seems very impressive. """Soft Pneumatic Gelatin Actuator for Edible Robotics,"" Shintake et al.: https://t.co/l9XC2u3PB3 Software eating world/world eating hardware https://t.co/5ifQF4Lwsn" @lidija_sekaric it doesn't hurt :) @nerdherdempire alas, I have a day job I like :) but @jackclarkSF is experimenting with solutions.. "Generative Poisoning Attack Method Against Neural Networks," Yang et al.: https://t.co/OCtoqiu1j7 "Multiplicative Normalizing Flows for Variational Bayesian Neural Networks," Luizos and Welling: https://t.co/czCJlwnC44 "Combining Self-Supervised Learning and Imitation for Vision-Based Rope Manipulation," Nair, Chen, and Agrawal et al https://t.co/OnHEEjQrPj "Generative Adversarial Nets with Labeled Data by Activation Maximization," Zhou et al.: https://t.co/4UlVtCvylw "Grammar Variational Autoencoder," Kusner et al.: https://t.co/QKtBfpRNp4 "Generative and Discriminative Text Classification with Recurrent Neural Networks," Yogatama et al., DeepMind: https://t.co/qar9PE94bP I used to at least be able to read all the cool deep RL +/or Atari-related papers, even if not all the cool deep learning papers, but now... https://t.co/iIVoOOdIoO "Generalised Discount Functions applied to a Monte-Carlo AImu Implementation," Lamont, Aslanides, @janleike + Hutter https://t.co/nw69EXqhAx @ivan_bezdomny yeah, an early and a late one - early - https://t.co/aXD43Q09F7 late - https://t.co/KXdjmTX1Mi "Multi-step Reinforcement Learning: A Unifying Algorithm," Asis,* Hernandez-Garcia,* Holland,* and Sutton: https://t.co/AHsDL4KM0P Superhuman score was attained in one run *without* extrinsic reward, per new paper. But I still think superh. average attainable this year. - specify whether I meant for a single best *run* or final average. Single best has been achieved now, this new best average = 89% of human. Sidenote: I predicted superhuman Montezuma's Revenge this year, defined as 120% of DeepMind's tester... in retrospect, too vague b/c didn't- Using only intrinsic reward from exploration (no score), got pretty good score on Montezuma's Revenge. Very interesting. "Count-Based Exploration with Neural Density Models," Ostrovski et al., DeepMind - SOTA on hard exploration games: https://t.co/vcpZiqa4JJ I put little ovals near where the Neural Episodic Control results would fit on the graph (in addition to previous results I added last yr).. https://t.co/vNNDebOuis Humans are still much faster at Atari learning but gap less dramatic than it was when Lake et al. published... https://t.co/UKHIXG2lKj "Neural Episodic Control," Pritzel et al. at DeepMind: https://t.co/QUYN0ayu2m [starts writing tweet abt how obviously sketchy this is on multiple levels, remembers there are bigger fish to fry] https://t.co/7yVKYc1dcZ The doomsday clock for human supremacy in StarCraft moved another minute towards midnight... https://t.co/Zzy0yzWhJF """the proposed approach can achieve superior perf. w/ respect to..oracle* when...demonstrator* is sub-optimal"" *same https://t.co/aMHqT0vBo8" @aprilaser @mcwm +1, their cloud effort is no joke... @cmarschner shouldn't, but I'm still interested whether there was a time when it generated a lot of enthusiasm or if it's always been niche. @brubsby not sure. I did a rough calculation and it was on the order of enough to power an average American home for a month, but uncertain. @botminds @michael_nielsen orthogonal probably wrong word. Distinguishable better (/consistent with what you just said). RT @robinhanson: "Subjects who have higher Theory of Mind are less cooperative & extract higher payoffs" in 1-shot prisoner's dilemma https… RT @dcurtisj: @miles_brundage I would guess there’s a rounding involved somwhere. RT @togelius: I used to do neuroevolution, but I'm just a mortal NYU professor and don't have the computing resources to compete in this ga… CC @hardmaru for sanity check -am I being stupid/does it make sense in context of specific experiment figures? Seems just wrong. RT @hardmaru: Large Scale Architecture Search with Reinforcement Learning and Evolution methods becoming popular. These methods will become… Compute needed to evolve a bunch of neural nets: 4*10^20. Compute needed to divide these numbers: much less. But shouldn't it be 8*10^19? https://t.co/6O8Emz6Yc2 RT @rllabmcgill: Doina Precup and Joelle Pineau are organizing for the first time the Reinforcement Learning Summer School (RLSS) https://t… @botminds @michael_nielsen whereas no one (?) disputes that in terms of power efficiency, silicon is super inefficient. @botminds @michael_nielsen CIFAR roughly eq. to human learning # recog in 1 sec. But error bars-->this could be massively fast or slow. @botminds @michael_nielsen that being said, if (super big if) humans were doing ~1 exaflops, NN's pretty efficient in terms of ops/learning. @botminds @michael_nielsen I agree it's complex but Joules/compute are orthogonal - one can compare compute while noting power inefficiency (was it ever that cool in AI, btw?) Might need to finally read this (been languishing on my bookshelf for a while) now that evolution is cool again: https://t.co/6k09ogR00x RT @hardmaru: Maybe claiming that 500 GPUs ought to be enough for everyone, is just as dangerous as claiming that "640K ought to be enough… Code for "Denoising Adversarial Autoencoders." https://t.co/HSR9Ujfemz @ArtirKel prob :) @schraderrr @azeem that's a lot but only small fraction used in this work apparently for whatever reason @Davidramli sure. "Machine Learning on Sequential Data Using a Recurrent Weighted Average," Ostmeyer and Cowell: https://t.co/g7aHqXrfY8 "Belief Propagation in Conditional RBMs for Structured Prediction," Ping and Ilher: https://t.co/PJAQZ1uCk1 "On the Behavior of Convolutional Nets for Feature Extraction," Garsia-Garulla et al.: https://t.co/NPKL2ZAE1R "Learning Identifiable Gaussian Bayesian Networks in Polynomial Time and Sample Complexity," Ghoshal + Honorio: https://t.co/wSXzjGMvx2 "Denoising Adversarial Autoencoders," @ToniCreswell and Bharath: https://t.co/MbY9kScWcy "Self-Paced Multitask Learning with Shared Knowledge," Murugesan and Carbonell: https://t.co/NFqnVeriLW "Co-Clustering for Multitask Learning," Murugesan et al.: https://t.co/GFMIgPZ1DU "A Bayesian computer model analysis of Robust Bayesian analyses," Vernon and Gosling: https://t.co/aSVmABJGDa "Differentially Private Bayesian Learning on Distributed Data," Heikkila et al.: https://t.co/p5eHT7xJPO "End-to-End Task-Completion Neural Dialogue Systems," Li et al.: https://t.co/flUNhWjGel "Unsupervised Basis Function Adaptation for Reinforcement Learning," Barker+Ras: https://t.co/i4hrqLfOl9 "Bridging Saliency Detection to Weakly Supervised Obj Detection Based on Self-paced Curric. Learning," Zhang et al.: https://t.co/dUuGKsJxOm "Percentile Policies for Tracking of Markovian Random Processes w Asymmetric Cost+Observation," Mansourifard et al: https://t.co/mcTSvNh5Pk "Context Aware Query Image Representation for Particular Object Retrieval," Laskar and Kannala: https://t.co/jqfVWQEFbE "EmotioNet Challenge: Recognition of facial expressions of emotion in the wild," Benitez-Quiroz et al.: https://t.co/gsWUWhD43c "Learning Robot Activities from First-Person Human Videos Using Convolutional Future Regression," Lee and Ryoo: https://t.co/GbUgog2RlD "Active Learning for Cost-Sensitive Classification," Krishnamurthy et al.: https://t.co/88eV43WaXd "Sequential Plan Recognition," Mirsky et al.: https://t.co/0KaQiaxqQo "Scalable Deep Traffic Flow Neural Networks for Urban Traffic Congestion Prediction," Fouladgar et al.: https://t.co/nEkBKPy3sL "DAWT: Densely Annotated Wikipedia Texts across multiple languages," Spasojevic et al.: https://t.co/XXpMOVv6lX "A Comparative Study of Word Embeddings for Reading Comprehension," Dhingra et al.: https://t.co/m8NBbGuS6B "Baxter's Homunculus: Virtual Reality Spaces for Teleoperation in Manufacturing," Lipton et al.: https://t.co/NIPgerPllj "Compositional Falsification of Cyber-Physical Systems with Machine Learning Components," Dreossi et al.: https://t.co/Si332G2EuG "Exponential Moving Average Model in Parallel Speech Recognition Training," Tian et al., Alibaba: https://t.co/9iVx9H6xKT Estimates for human brain's compute power vary, but on one estimate (1 exaflop/s), each experiment there = bit over a minute of human brain. Maybe more like 8,000 b/c Google's top line number is for 5 experiments. @hardmaru yeah, that may well be (haven't read closely), but couldn't help but point out in light of them making big deal abt their compute. Seems like too much, maybe 2 orders of mag. error bar? But calc seems right-100 GPUs, 37 1 hour generations, ~3 TFLOP each vs 4*10^20 FLOPs (very roughly around 40,000x more than they used) "Sentient Technologies: we have massive compute, see this genetic algo paper. Google: LMAO, we used 4*10^20 FLOPs. https://t.co/F6MkPzbokt" "Large-Scale Evolution of Image Classifiers," Real et al. at Google Brain/Research: https://t.co/31ApUMMScV "Controllable Text Generation," Hu et al.: https://t.co/1avkLczL38 "Virtual vs. Real: Trading Off Simulations and Physical Experiments in RL with Bayesian Optimization," Marco et al.: https://t.co/AsoOS9Q3BE "Actor-Critic Reinforcement Learning with Simultaneous Human Control and Feedback," @korymath + Pilarski: https://t.co/euBJpNTjy1 "Deeply AggreVaTeD: Differentiable Imitation Learning for Sequential Prediction," Sun et al.: https://t.co/GjJXgELJTG "EX2: Exploration with Exemplar Models for Deep Reinforcement Learning," Fu, Co-Reyes, and Levine: https://t.co/pcLLjopo2R "A Laplacian Framework for Option Discovery in RL," @cholodovskis, @marcgbellemare, + @MichaelHBowling: https://t.co/ExDqiX9lfl "FeUdal Networks for Hierarchical Reinforcement Learning," Vezhnevets et al. at DeepMind: https://t.co/Kw7v9Vxr4r "Mr. Comey has argued that the highly charged claim [by Trump re: Obama wiretap] is false and must be corrected": https://t.co/9VOdCDxdyK https://t.co/Ba6BViyOk3 @polynoamial The Resistance would be fun :) some colleagues and I played recently and discussed whether it'd be hard for AI... @polynoamial what do you mean, better options? More scientifically interesting challenge domains to work on? More useful resulting systems? "Trump Inherits a Secret Cyberwar Against North Korean Missiles," Sanger and Broad at NYT: https://t.co/xQnZALZalo Good hearing on cybersecurity (video at link): https://t.co/AzOurLrBM8 @rcalo nice title :) @aireye don't know. This is related to it https://t.co/EKIzxgib3k but don't know of any that mention it/cover overall system.. RT @BruceBartlett: Take Nixon in the deepest days of his Watergate paranoia, subtract 50 IQ points, add Twitter, and you have Trump today. RT @nytopinion: President Trump seems to have lost interest in creating a federal government https://t.co/1upCojjtuf https://t.co/x2AXtyBmLH RT @jodyavirgan: I know if I uncovered Nixon/Watergate, thirty minutes later I'd be tweeting about TV ratings. https://t.co/UXRY9sFtgx RT @JYSexton: This seems like a sustainable, reasonable way for a country to function. https://t.co/qUxatgv74M @togelius :( @mark_riedl you mean you don't read every single one of my tweets!? ;-) yeah it wasn't obvious in the paper, but some folks looked into it If only there were warning signs, like Trump's chief strategist complaining about Asian CEOs in SV or something. https://t.co/XuIOlD6Bmy @mark_riedl yes, that's been known for a while, but still v impressive + scalable w/ more/better (non-random hands) training. @timhwang let me know if you need a coauthor whose main value added is rewatching the US/UK versions... @johnrobb (may change in coming months, much to process after both), v interested in discussing more offline if willing @johnrobb aiming to inform decision makers re: neglected topics, not a ton of non-research advice to give yet beyond usual infosec recs @johnrobb 2+3=goals of both, ASU event also had 1 (public event). 2>3 to some extent for me, current focus=developing research agenda @johnrobb in terms of content or structure? I participated+also hosted related event recently (https://t.co/40CQXR5IrR), welcome suggestions @MichaelHBowling, game AI rockstar + 1 of best future-of-AI oracles I've queried, is on Twitter :) See also @DeepStackAI answering Qs on DS @MichaelHBowling @DeepStackAI indeed - and nice to see you on Twitter! :) @logangraham I'd recommend reaching out to @seb_far, who may be able to assist directly or refer you to someone else :) @rodrigodof @rcalo @robseamans @Forbes we need both (growth and redistribution). @davegershgorn @katherinebailey books by Trump can be both. RT @DeepMindAI: Our recent paper gives new theory & empirical insights for Synthetic Gradients: a method to decouple neural nets https://t.… "RT @rcalo: No, Robots Should Not Be Taxed https://t.co/Nw8j0iQpZZ by @robseamans" @logangraham (I'm not affiliated with them but share an office/know some folks there, can intro if helpful/you're not already in touch) @logangraham nice post! Something to consider-Center for Effective Altruism is in Oxford, good to talk to re prioritizing problems to solve? @timhwang and The Office and Undercover Boss and... ? (but ELR is especially specific, hmm) RT @williamstome: I also love the easy-to-understand paper-explanation-over-twitter from @DeepStackAI, which I just sent it to my #AI class… RT @williamstome: This is the most beautiful webpage I've ever seen designed to promote a scientific paper: https://t.co/g99mCOpaUG (And it… @_jyan_ indeed. "Using Synthetic Data to Train Neural Networks is Model-Based Reasoning [+ can break Captchas]," Le et al.: https://t.co/PHQvD4Kx9l "Discovery of Evolving Semantics through Dynamic Word Embedding Learning," Yao et al.: https://t.co/JMAYyawLgf "Meta Networks," Munkhdalai + Yu: https://t.co/lDTkKrBzXc "Learning the Structure of Generative Models without Labeled Data," Bach et al.: https://t.co/oid3Apk1Nk "The Unreasonable Effectiveness of Random Orthogonal Embeddings," Choromanski et al.: https://t.co/VXVsr5gmBO "Unsupervised Image-to-Image Translation Networks," Liu et al.: https://t.co/fjtPiHuZed "Opening the Black Box of Deep Neural Networks via Information," Shwartz-Ziv and Tishby: https://t.co/ryivrFz9CA "Robust Spatial Filtering with Graph Convolutional Neural Networks," Such et al.: https://t.co/sDWAKS1soH "Attentive Recurrent Comparators," Shyam et al.: https://t.co/cJephVBNYh "Mixing Complexity and its Applications to Neural Networks," Moshkovitz + Tishby: https://t.co/GbJ1MPr6vB "Deep Predictive Policy Training using Reinforcement Learning," Ghadirzadeh et al.: https://t.co/dHttSTDd2r "Generalization and Equilibrium in Generative Adversarial Nets (GANs)," Arora et al.: https://t.co/PtwohkDtox "An Analytical Formula of Pop. Gradient for 2-layered ReLU Net and its App. in Conv.+Critical Point Analysis," Tian: https://t.co/BPrTZWGIKi "Understanding Synthetic Gradients and Decoupled Neural Interfaces," Czarniecki et al.: https://t.co/u7mu7pPHod "PMLB: A Large Benchmark Suite for Machine Learning Evaluation and Comparison," Olson et al.: https://t.co/k2mkxvft4o "Learning Social Affordance Grammar from Videos: Transferring Human Interactions to Human-Robot Int's," Shu et al.: https://t.co/EiUiXfaxxg "A Distortion Based Approach for Protecting Inferences," Tsai et al.: https://t.co/hUfhA6yzSF Also from folks at Sentient (name I don't like, for the record)-"Evolving Deep Neural Networks," Mikkulainen et al.: https://t.co/XFSJhwfgzv RT @rbhar90: New preprint of mine with @vijaypande and lab: "MoleculeNet: A Benchmark for Molecular Machine Learning" https://t.co/9Yu5FO0p… RT @jackclarkSF: New papers added courtesy of the fantastic @Miles_Brundage . Help fill and benefit society as a consequence! Cc @dhruvp ht… My other brother-in-(almost-the-same)name is a dentist. Maybe there are others I'm unaware of. Apparently Myles Brundage is Director of Product at Sentient Technologies. :O https://t.co/728RNQnNd2 https://t.co/8VNeHcr04o RT @ReutersUS: BREAKING: Vice President Pence used private email for state business while Indiana governor and was hacked - Indianapolis St… RT @mmitchell_ai: WiNLP Call for Papers is out! https://t.co/vYKuvfeyhr Sounds like early stages of @karpathy's sci-fi story... https://t.co/uDQmxqhBEg @williamstome congrats!! :) "RT @randal_olson: Neat project: Someone tracked their son's first words since birth. #parenting #dataviz https://t.co/071rlMSqR5 https://t…" @annakoop yep :) very cool to see, though not super surprised (I speculated it was a future Science paper) @DeepStackAI thanks for clarifying! RT @DeepStackAI: @Miles_Brundage Ring games are definitely the future. For now, being able to play great poker w/ any stack size is a big s… RT @DeepStackAI: @Miles_Brundage We're planning a series of weekly heads-up freezeout tournaments against pros, all streamed on @Twitch @DeepStackAI could you elaborate on the freezeout structure? Humans vs. multiple AI in big-ring, heads up/everyone against DeepStack, etc. Cool announcement - https://t.co/YGk7Mf9jJn Congrats to the DeepStack team on their achievement and Science paper! (see thread) https://t.co/VWK8vYR0Ih @Aelkus see https://t.co/doooIDPWMU RT @balajiln: Check out our new paper on differentiable boundary trees with @DeepMindAI colleagues @zdanielz and charles :) https://t.co/jY… "RT @brandondamos: Our new paper - OptNet: Differentiable Optimization as a Layer in Neural Nets Paper: https://t.co/OHF5GCNB50 Code: https…" RT @erichorvitz: Article on workshop on "Envisioning & Disrupting Adverse AI Outcomes" https://t.co/4FZDeeAUDF @MSFTResearch @compcomcon #A… RT @deliprao: We released a baseline for #FakeNewsChallenge today and possibly woke up a few people from their sleep! ↗️https://t.co/Yocbq4… "HolStep: A Machine Learning Dataset for Higher-order Logic Theorem Proving," Kaliszyk, @fchollet, and Szegedy: https://t.co/yiEnK7gBuJ "Virtual-to-real Deep Reinforcement Learning: Continuous Control of Mobile Robots for Mapless Navigation," Tai et al https://t.co/tROBC9y3Sp "Personal Model Training under Privacy Constraints," Servia-Rodriguez et al.: https://t.co/QfKryqst7C "Graph-based Isometry Invariant Representation Learning," Khasanova and Frossard: https://t.co/avFQmK7HBR "Learning A Physical Long-term Predictor," Ehrhardt et al.: https://t.co/X1AxiO7E0P "Improving Object Detection with Region Similarity Learning," Gao and Lou et al.: https://t.co/fCK1rAVQI1 "Incorporating Intra-Class Variance to Fine-Grained Visual Recognition," Bai et al.: https://t.co/eIbNHKnbJN "Saliency Detection by Forward and Backward Cues in Deep-CNNs," Imamoglu et al.: https://t.co/qyXxHtR3zT "Theoretical Properties for Neural Networks with Weight Matrices of Low Displacement Rank," Zhao et al.: https://t.co/9oFuTcgIeQ "Easy over Hard: A Case Study on Deep Learning," Fu and Menzies: https://t.co/GhW2afqf2L "Revisiting Unsupervised Learning for Defect Prediction," Fu and Menzies: https://t.co/oZeOjg421i "RGB-D Salient Object Detection Based on Discriminative Cross-modal Transfer Learning," Chen et al.: https://t.co/4bFKlzXM2a "Remote Sensing Image Scene Classification: Benchmark and State of the Art," Cheng et al.: https://t.co/NUdg4C2M7O "Learning Conversational Systems that Interleave Task and Non-Task Content," Yu et al.: https://t.co/2ePer3VX73 "Gram-CTC: Automatic Unit Selection and Target Decomposition for Sequence Labelling," Liu et al.: https://t.co/wDadqaAldt "Active Tactile Object Recognition by Monte Carlo Tree Search," Zhang et al.: https://t.co/Wgn64oN2Q1 "Multi-Sensor Data Pattern Recognition for Multi-Target Localization: A Machine Learning Approach," Suresh et al.: https://t.co/tAv6a2v8y5 "Deep Image Harmonization," Tsai et al.: https://t.co/RPL5E6EGDj "Achieving non-discrimination in prediction," Zhang et al.: https://t.co/sMA7mffDDX "SceneSeer: 3D Scene Design with Natural Language," Chang et al.: https://t.co/XADvA2y2ql "Detecting Adversarial Samples from Artifacts," Feinman et al.: https://t.co/urHNCjZOuP "Provable Optimal Algorithms for Generalized Linear Contextual Bandits," Li et al.: https://t.co/dgL9OdzRne "The Statistical Recurrent Unit," Oliva, Poczos, and Schneider: https://t.co/Gs7L0m2frV "Learning to Optimize Neural Nets," Li and Malik: https://t.co/IKnfHk5jel "OptNet: Differentiable Optimization as a Layer in Neural Networks," Amos and Kolter: https://t.co/T6buKMWgzY "SARAH: A Novel Method for Machine Learning Problems Using Stochastic Recursive Gradient," Nguyen et al.: https://t.co/kecGTUwK6L "Modular Representation of Layered Neural Networks," Watanabe et al.: https://t.co/6sJWx0WyPn "Online Natural Gradient as a Kalman Filter," Yann Olivier: https://t.co/vCddRtX7xy "ste-GAN-ography: Generating Steganographic Images via Adversarial Training," Hayes and Danezis: https://t.co/bFGE40eC2x "Lossy Image Compression with Compressive Autoencoders," Theis et al.: https://t.co/pzU0U3IHyZ "Preserving Differential Privacy Between Features in Distributed Estimation," Heinze-Deml and McWilliams et al.: https://t.co/NXQJ3GSeBW @twitskeptic lol @timhwang whatever the test, Twitter's AI failed it... https://t.co/lyvkKneebs @davegershgorn seems about the same - have to factor out the noise in WaveNet (which is prob fixed now, much earlier results when published) @yoavgo could be a fun auxiliary reward for UNREAL agent. Make lots of diverse noise :) @yoavgo + combining that and better exploration (e.g. https://t.co/q5RcfgbFyZ) seems likely to take over finish line on hard games IMO... @yoavgo I think sound is typically not used, but interesting idea. re: better reward fns, auxiliary rewards helped a lot in UNREAL agent, RT @nathanieldaw: Submit to Reinforcement Learning and Decision Making RLDM2017, deadline March 4. Too many awesome speakers to list. https… "Active Learning Using Uncertainty Information," Yang and Loog: https://t.co/nn2kM7hMNC "Fast Threshold Tests for Detecting Discrimination," Pierson et al.: https://t.co/OX2GvmLvRI "Studying Positive Speech on Twitter," Sokolova et al.: https://t.co/aGg7UvQGci (there isn't much according to their definition) "Unsupervised Triplet Hashing for Fast Image Retrieval," Huang et al.: https://t.co/79bCqwDTIy "ShaResNet: reducing residual network parameter number by sharing weights," Alexandre Boulch: https://t.co/20PiMQG0p7 "Weakly- and Semi-Supervised Object Detection with Expectation-Maximization Algorithm," Yan et al.: https://t.co/LvYiJBhOnN "Borrowing Treasures from the Wealthy: Deep Transfer Learning through Selective Joint Fine-tuning," Ge and Yu: https://t.co/veLyETJWgJ "MIML-FCN+: Multi-instance Multi-label Learning via Fully Conv. Networks with Privileged Information," Yang et al.: https://t.co/4trZy3SqJM "3D Shape Segmentation via Shape Fully Convolutional Networks," Wang et al.: https://t.co/y6CJYXGTDN "On architectural choices in DL: From netw. structure to gradient convergence and param. estimation," Ithapu et al.: https://t.co/EIjrEbCRaj "Design and Approach of Team IHMC in the 2016 Cybathlon [exoskeleton competition]," Griffin et al.: https://t.co/U5LEetsgDq "Scene Flow to Action Map: A New Representation for RGB-D based Action Recognition with CNNs," Wang et al.: https://t.co/PcrYQQkz6u "Deep Clustering using Auto-Clustering Output Layer," Kilinc and Uysal: https://t.co/LFEqncDWl3 "Joint Spatio-Temporal Boundary Detection and Boundary Flow Prediction with a Fully Conv. Siamese Net.," Lei et al.: https://t.co/ySHBMcuFeZ "Enabling Sparse Winograd Convolution by Native Pruning," Li et al.: https://t.co/Emq5YVM5V7 "eXpose: A Character-Level CNN w/ Embeddings For Detecting Malicious URLs, File Paths+ Registry Keys," Saxe+Berlin: https://t.co/xoLrpoXsDC "DepthSynth: Real-Time Realistic Synthetic Data Generation from CAD Models for 2.5D Recognition," Planche et al.: https://t.co/tW6uPQxjcO "Learning Deep Visual Object Models From Noisy Web Data: How to Make it Work," Massouh et al.: https://t.co/REmpUxevy9 "Understanding Convolution for Semantic Segmentation," Wang et al.: https://t.co/CdDY00T5kd "Boosted Generative Models," Grover and Ermon: https://t.co/CjP7xHR7NF "Algorithmic stability and hypothesis complexity," Liu et al.: https://t.co/vKxnANCLoB "Deep Forest: Towards An Alternative to Deep Neural Networks," Zhou and Feng: https://t.co/Nt3KohJ6Ni "The Shattered Gradients Problem: If resnets are the answer, then what is the question?," Balduzzi et al.: https://t.co/iKU0NgTUVY "Depth Creates No Bad Local Minima," Lu and Kawaguchi: https://t.co/amPT5CYVZ3 "Analysis of Agent Expertise in Ms. Pac-Man using Value-of-Information-based Policies," Sledge and Principe: https://t.co/6noQw9Q5sU RT @Miles_Brundage: Do get in touch if the topic's of interest! Doing more work on it in coming months (writing report/research agenda). ht… NPR segment on AI and security w/ Kathleen Fisher, @rao2z + @erichorvitz. Enjoyed participating in event mentioned: https://t.co/M2RaalvW3s "Changes in funding in the AI safety field," by @seb_far: https://t.co/sU0kju0R4t I'll be in London talking about long-term AI policy in a few weeks at @AI_Pol - let me know if you wanna meet up... https://t.co/oilCKrZYnd RT @natashajaques: Our latest paper combining RL with RNNs, now with computational molecular generation! https://t.co/OZy7n6wJww @Aelkus read that a long time ago, only vaguely remember. Would like book length constructive version (aka what I hoped Levesque book was) @levendowski if interested in AI progress and nature of intelligence, it's def. a must read. Good Q, I'll let u know if think of others :) @Aelkus what is really needed is a candid account of lessons learned from Cyc from Lenat or others close to it. @levendowski though both kinda old :) I guess my favorite very recent one is Measure of All Minds, less popular audiencey but excellent @levendowski depends what one's interested in...maybe no? :) Superintelligence is best of AI risk bunch, 2nd Machine Age for AI/jobs, ... @Aelkus yes, truth in middle probably, was hoping for more substantive/detailed take. ...it's short/for a (kind of) popular audience, though, so cutting some slack. Overall, not a must read, but maybe of interest to some. ...long tail issue (current AI not doing well on rare problems/contexts, humans better), wanted more engagement with contemporary ML work... Finished new Levesque book on AI (https://t.co/iEAYK5kzB2) it's pretty good, not life changing though. Good discussion of commonsense, +... @nerdherdempire @hardmaru that was one level of meta, I was suggesting another (though prob declining value at some pt :) )/kinda joking @hardmaru RNNs for RNN generator generation. But really, I think good video generation would be cool. Code for "Improving the Neural GPU Architecture for Algorithm Learning" (https://t.co/HOu5Govqaa) https://t.co/NmpW3YFCpK "RT @jackclarkSF: Want to rapidly analyze new ICMl AI submissions? Summarize papers: https://t.co/39hp1AnP2s Read responses: https://t.co/…" RT @jonfavs: Even the Trump White House is surprised how vapid and gullible DC pundits can be. https://t.co/ymiauaskfi "Two behaviorists are walking down the street. One says to the other: 'You're feeling fine. How am I feeling?'" - Michael Tye RT @dustinvtran: Rajesh Ranganath, Dave Blei and I released "Deep and Hierarchical Implicit Models" on arXiv https://t.co/AFx7OTSnnx https:… RT @jackclarkSF: I just spent 20 mins helping to summarize a new AI research paper, and I learned about AI & Starcraft! JOIN ME https://t.c… RT @jackclarkSF: New batch of Arxiv papers in. Join in the collective attempt at summary (with tweaked form). https://t.co/39hp1AnP2s "RT @mmitchell_ai: Excited to announce the Accepted Papers for the first ACL Ethics in NLP Workshop! Also, preliminary schedule is up! http…" That's it from me for tonight, but if you want to do your part to cope with ICML-geddon/arXivpocalypse, check out @jackclarkSF's experiment! "Towards Deeper Understanding of Variational Autoencoding Models," Zhao et al.: https://t.co/TElewUzKs0 "Model-based reinforcement learning in differential graphical games," Kamalapurkar et al.: https://t.co/o1jfGJ13vU "Show, Attend and Interact: Perceivable Human-Robot Social Interaction through Neural Attn Q-Net.," Qureshi et al.: https://t.co/wZDOdt46ym "Learning What Data to Learn," Fan et al.: https://t.co/nGuvEWHntV "Scaffolding Networks for Teaching and Learning to Comprehend," Celikyilmaz et al.: https://t.co/ahDalww2uz """Stabilising Experience Replay for Deep Multi-Agent RL,"" Foerster and @nntsn et al.: https://t.co/26hGlLjROO In StarCraft" "Bridging the Gap Between Value and Policy Based Reinforcement Learning," Nachum et al.: https://t.co/f8vvWzULrj "Learning Discrete Representations via Information Maximizing Self Augmented Training," Hu et al.: https://t.co/uCWIYaoNAd "A Roadmap for a Rigorous Science of Interpretability," Doshi-Velez and @_beenkim: https://t.co/8WTp3bdOhx "Improving the Neural GPU Architecture for Algorithm Learning," Freivalds and Liepins: https://t.co/aFijO6ITGJ @jackclarkSF I have like 5-10 seconds per paper before the flight :) "Learning Deep Nearest Neighbor Representations Using Differentiable Boundary Trees," Zoran et al.: https://t.co/Qeo5TQp7Gf "Monte Carlo Action Programming," Lenz Belzner: https://t.co/Iqmc0DhucD Super-selective Airport Decisions (SAD) edition of arXiv tweets tonight...probably more tonight. Focusing on cool ICML RL stuff. "RT @jackclarkSF: Review AI research, help world: Pick paper: https://t.co/39hp1AnP2s Fill form: https://t.co/qoUgyYo8q9 Benefit: https:/…" RT @gilliancowen: Oh the irony! https://t.co/UlVux2PETS is down now too. #aws #s3 RT @geerlingguy: Meanwhile, on Amazon's status page... #aws #s3 https://t.co/cYlGB8Fi38 RT @jackclarkSF: We're going to run another version of the Arxiv analysis project tonight, swapping out scores&novelty for 'did you find th… @botminds @michael_nielsen agreed, wouldn't be heuristics if totally fair/accurate... don't have resources to read all, even all abstracts This looks good... also, it's Liu, Chen, and Deng (equal contribution), Microsoft. (some of the first results from Tencent, including on a WeChat dataset) @iandanforth no @shivon I'd guess RL comes first (/last, if it turns out that unsupervised is ill-defined/we see more auxiliary reward stuff that's U/R-ish) RT @jackclarkSF: get involved in today's wacky and exciting Arxiv paper summary experiment!: jack@jack-clark.net < results will be open Fin (until tomorrow). "Adaptive Neural Networks for Fast Test-Time Prediction," Bolukbasi et al.: https://t.co/xdu2S1YImF "On the Origin of Deep Learning," Wang et al.: https://t.co/gNDUScuZYO "Efficient Learning of Graded Membership Models," Tan and Mukherjee: https://t.co/XEv5ITZbOV "Stochastic Variance Reduction Methods for Policy Evaluation," Du et al.: https://t.co/LzkgossXG2 "Globally Optimal Gradient Descent for a ConvNet with Gaussian Inputs," Brutzkus and Globerson: https://t.co/uW7M6TQEnc "Online Multiview Representation Learning: Dropping Convexity for Better Efficiency," Chen et al.: https://t.co/0LL7uhfoUJ "Generative Adversarial Active Learning," Zhu and Bento: https://t.co/euvF0wowkF "Fast and Accurate Inference with Adaptive Ensemble Prediction in Image Classification w/ Deep NNs," Hiroshi Inoue: https://t.co/UYgIuJ3IlL "Learning Hierarchical Features from Generative Models," Zhao et al.: https://t.co/NwiCIiKHAC "McGan: Mean and Covariance Feature Matching GAN," Mroueh et al.: https://t.co/FmkdCViLw4 "Activation Ensembles for Deep Neural Networks," Harmon and Klabjan: https://t.co/e72l7rUO3d "Uniform Deviation Bounds for Unbounded Loss Functions like k-Means," Bachem et al.: https://t.co/JDRPxvD9Ym "Changing Model Behavior at Test-Time Using Reinforcement Learning," @gstsdn et al.: https://t.co/VSgV6iAY59 "Variational Inference using Implicit Distributions," @fhuszar: https://t.co/Dcz0Q0Brx3 "Bayesian inference on random simple graphs with power law degree distributions," Lee et al.: https://t.co/Y9eVEUIKsh "Online Nonparametric Learning, Chaining, and the Role of Partial Feedback," Cesa-Bianchi et al.: https://t.co/eOJC80G9Wt "Dynamic Word Embeddings via Skip-Gram Filtering," Bamler and Mandt: https://t.co/1c0K5ANI9n "Equivariance Through Parameter-Sharing," Ravanbakhsh et al.: https://t.co/01tAPGEpD7 "An Efficient Pseudo-likelihood Method for Sparse Binary Pairwise Markov Network Estimation," Geng et al.: https://t.co/RUzbihR7gI "Latent Correlation Gaussian Processes," Remes et al.: https://t.co/SZZKH1KfGh "Embarrassingly parallel inference for Gaussian processes," Zhang and Williamson: https://t.co/bO1p2XncOt "Approximate Inference with Amortised MCMC," Li et al.: https://t.co/3YFuEiV30Q "Convolutional Gated Recurrent Neural Network Incorporating Spatial Features for Audio Tagging," Xu et al.: https://t.co/rowDi68FBQ "Residual Convolutional CTC Networks for Automatic Speech Recognition," Wang et al.: https://t.co/7a7WJhYhzi "Boundary-Seeking Generative Adversarial Networks," Hjelm et al.: https://t.co/Or3CTTsh52 "Revisiting NARX Recurrent Neural Networks for Long-Term Dependencies," DiPietro et al.: https://t.co/yKoOYihyet "An Unsupervised Learning Method Exploiting Sequential Output Statistics," Liu et al.: https://t.co/3EeuhGZUWD "Deep Voice: Real-time Neural Text-to-Speech," Arik et al. (Baidu): https://t.co/ehDm0xdu2N "Rationalization: A NMT Approach to Generating Natural Language Explanations," Harrison et al.: https://t.co/cfE4dcSnzw "Synthesizing Training Data for Object Detection in Indoor Scenes," Georgakis et al.: https://t.co/LKMOaShUpm "Transfer Learning for Domain Adaptation in MRI: Application in Brain Lesion Segmentation," Ghafoorian et al.: https://t.co/vD5L5CyLby "Automated Verification and Synthesis of Embedded Systems using Machine Learning," Lucas Cordeiro: https://t.co/L5PxmCDtsb "Online Learning with Many Experts," Cohen and Mannor: https://t.co/3i33c06cgq "Learning Deep NBNN Representations for Robust Place Categorization," Mancini et al.: https://t.co/dMklZxgaeL "Coarse Grained Exponential Variational Autoencoders," Sun and Zhang: https://t.co/016f1GoiSu "CHAOS: A Parallelization Scheme for Training Convolutional Neural Networks on Intel Xeon Phi," Viebke et al.: https://t.co/6b88TWqN3h "Spatially Aware Melanoma Segmentation Using Hybrid Deep Learning Techniques," Attia et al.: https://t.co/iCKoSTdb2l "Seeing What Is Not There: Learning Context to Determine Where Objects Are Missing," Sun and Jacobs: https://t.co/fqFPsnTvLP "Related Pins at Pinterest: The Evolution of a Real-World Recommender System," Liu et al.: https://t.co/yVFwsleSTY "Building Fast and Compact CNNs for Offline Handwritten Chinese Character Recognition," Xiao et al.: https://t.co/iK9qZDyGe1 "Maximum-Likelihood Augmented Discrete Generative Adversarial Networks," Che et al.: https://t.co/UIu0bD2V66 "Detecting (Un)Important Content for Single-Document News Summarization," Yang et al.: https://t.co/hOtllg7f5a "Bayesian Nonparametric Feature and Policy Learning for Decision-Making," Hahn and Zoubir: https://t.co/OOTqHfhQeB @michael_nielsen 1. know (of) 1 of the authors, 2. area I consider promising (deep RL), 3. abstract good, 4. skim suggests quality, 5-n. ??? "Analyzing Modular CNN Architectures for Joint Depth Prediction and Semantic Segmentation," Jafari et al.: https://t.co/i7uT80nHr7 "Adversarial Networks for the Detection of Aggressive Prostate Cancer," Kohl et al.: https://t.co/l92aH3omw4 "Criticality and Deep Learning, Part I: Theory vs. Empirics," Oprisa and Toth: https://t.co/tYCHYnA7B4 "A Unifying Framework for Convergence Analysis of Approximate Newton Methods," Ye et al.: https://t.co/W5GpfjnkxE "Deceiving Google's Perspective API Built for Detecting Toxic Comments," Hosseini et al.: https://t.co/VOwEmP2urN "Learning Control for Air Hockey Striking using Deep Reinforcement Learning," Taitler and Shimkin: https://t.co/uUzr1Wn6aj "Improved Variational Autoencoders for Text Modeling using Dilated Convolutions," Yang et al.: https://t.co/2wk4j2um6c "HashBox: Hash Hierarchical Segmentation exploiting Bounding Box Object Detection," Curto and Zarza et al.: https://t.co/jTwNRqBcmc "Reinforcement Learning with Deep Energy-Based Policies," Haarnoja et al.: https://t.co/4pZfgDM5Ld "Fixed-point optimization of deep neural networks with adaptive step size retraining," Shin et al.: https://t.co/7gnNJCCwQk "DeepNAT: Deep Convolutional Neural Network for Segmenting Neuroanatomy," Wachinger et al.: https://t.co/GRkEEuuoHg "Low-Precision Batch-Normalized Activations," Benjamin Graham: https://t.co/VX8UJVJ3Oy "A Dataset for Developing and Benchmarking Active Vision," Ammirato et al.: https://t.co/ck76tifhL5 "Identifying beneficial task relations for multi-task learning in deep neural networks," Bingel and Sogaard: https://t.co/a3f7tHbeCS "Visual Translation Embedding Network for Visual Relation Detection," Zhang et al.: https://t.co/iI1UMJxG0O "Neural Map: Structured Memory for Deep Reinforcement Learning," Parisotto and @rsalakhu: https://t.co/MwYuwL3ZML "Multi-Label Segmentation via Residual-Driven Adaptive Regularization," Hong et al.: https://t.co/hf4EQcUpep "Differentiable Learning of Logical Rules for Knowledge Base Completion," Yang et al.: https://t.co/QOyXMA5F4P "Asymmetric Tri-training for Unsupervised Domain Adaptation," Saito et al.: https://t.co/qbZPnxahTx "Age Progression/Regression by Conditional Adversarial Autoencoder," Zhang et al.: https://t.co/QiAqEhrIHO "Scalable and Distributed Clustering via Lightweight Coresets," Bachem et al.: https://t.co/9nF2XcEbto Doing my best w/ arXiv today, but the selection process will be noisier than usual (as prophet @jackclarkSF foretold, lots of ICML content). RT @WiMLworkshop: Our list of 830+ women working in #machinelearning is a resource for finding speakers, panelists, etc: https://t.co/yWAje… @mpshanahan very cool! Congrats. RT @mpshanahan: Happy to announce I'll shortly be starting at @DeepMindAI, while staying part-time at @ImperialCollege to supervise PhD stu… RT @ericgeller: everything is so good https://t.co/4hvqW69Ycb "RT @Smerity: Went AI hype hunting. Pulled apart DeepCoder, listed the falsehoods across media, then attempted a hypeless version. https://t…" RT @hardmaru: Self-Driving Cars in a Browser w/ Neural Net-based ML Framework called NeuroJS. Supports DQN, DDPG. Very Impressive! https://… RT @fermatslibrary: Pythagorean Theorem https://t.co/xVpDgWg1GP RT @fermatslibrary: Sorting algorithms https://t.co/l0ad6OT7en RT @deliprao: New optimization paper accepted at #stoc2017 wants you to "hurry up and give [it] a hug", and you might 🤗 https://t.co/WQWMY9… @deliprao good Q, hadn't thought that far ;-) shoot email w/ thoughts? first name dot last at ASU dot edu, can reciprocate w/ relevant docs Do get in touch if the topic's of interest! Doing more work on it in coming months (writing report/research agenda). https://t.co/dPtojgHpVn "How ConvNets model Non-linear Transformations," Pal and Savvides: https://t.co/pbZ6PbVplb "How hard is it to cross the room? -- Training (Recurrent) Neural Networks to steer a UAV," Kelchtermans+Tuytelaars: https://t.co/3lLLaS87gg "RNN Decoding of Linear Block Codes," Nachmani et al.: https://t.co/lCp61ouFhm "Toward high-perf. online HCCR: a CNN approach w DropDistortion, path sig. + spatial stoch. max-pooling," Lai et al. https://t.co/I2mnVV0xRx "Use Generalized Representations, But Do Not Forget Surface Features," Moosavi and Strube: https://t.co/AFkbFetbnV "Online Meta-learning by Parallel Algorithm Competition," Elfwing et al.: https://t.co/aw7ChMOpB8 "Deep representation learning for human motion prediction and classification," Butepage et al.: https://t.co/GV9FSFdas3 "Renyi Differential Privacy," Ilya Mironov: https://t.co/t8UMI96x4D "Simultaneous Feature and Body-Part Learning for Real-Time Robot Awareness of Human Behaviors," Han et al.: https://t.co/gubAy5zOUY "Sequence-based Multimodal Apprenticeship Learning For Robot Perception and Decision Making," Han et al.: https://t.co/t4VfXICGKm "Strongly-Typed Agents are Guaranteed to Interact Safely," David Balduzzi: https://t.co/YADFS7SBxp (specific def. of "safe" but interesting) "Multi-Context Attention for Human Pose Estimation," Chu et al.: https://t.co/lCksgeEgHO "Building Usage Profiles Using Deep Neural Nets," Curro et al.: https://t.co/X2l250IDwN "WaterGAN: Unsup. Generative Net. to Enable Real-time Color Correction of Monocular Underwater Images," Li et al.: https://t.co/uDQsy1mdFo "Toward Streaming Synapse Detection with Compositional ConvNets," Santurkar et al.: https://t.co/1dsEABDU1w "Bayes-Optimal Entropy Pursuit for Active Choice-Based Preference Learning," Pallone et al.: https://t.co/NBapG9JBb1 "Sequence Modeling via Segmentations," Wang et al.: https://t.co/28oN0yIpCb "Neural Decision Trees," Randall Balestriero: https://t.co/2avqyCpzZD "Consistent Alignment of Word Embedding Models," Sahin et al.: https://t.co/JHsA8HnxAU "Control of Gene Regulatory Networks with Noisy Measurements and Uncertain Inputs," Imani and Braga-Neto: https://t.co/99DLQhHa7N "Robot gains Social Intelligence through Multimodal Deep Reinforcement Learning," Qureshi et al.: https://t.co/cs9fLas5cA "Deep Models Under the GAN: Information Leakage from Collaborative Deep Learning," Hitaj et al.: https://t.co/1Ugblab80q "Criticality, stability, competition, and consolidation of new representations in brain networks," Skilling et al.: https://t.co/OEfqnSUjuT @FHIOxford, @CSERCambridge, and @LeverhulmeCFI recently held a workshop on bad actors and AI - stay tuned for more: https://t.co/40CQXQO73h @deanwampler new one: https://t.co/GNtNtdD8y9 Reading Hector Levesque's new book on common sense and AI... to be continued! RT @histoftech: New! Read full intro to my book Programmed Inequality on the @mitpress site! Plz RT! #womenintech #womenincomputing https:/… RT @histoftech: Poll! As a professor who identifies as a man, have you been called "Mr." instead of "Dr." or "Professor" @y0b1byte classic scale/quality tradeoff :) will prob keep doing manually, only takes few mins - hard part is deciding what to share @y0b1byte maybe, but might not be to do what I want (titles often too long so I use judgment to shorten them; mention second authors..etc) @y0b1byte no, but I've thought of looking into that @LazarusMission dunno @zaoyang combination of titles/authors/abstracts/skimming/reading (I look at some more carefully than others - no precise algorithm) "LTSG: Latent Topical Skip-Gram for Mutually Learning Topic Model and Vector Representations," Law et al.: https://t.co/L6qEN0TMaD "Bidirectional Backpropagation: Towards Biologically Plausible Error Signal Transmission in NNs," Luo et al.: https://t.co/rI5D7FiGDY "A Neural Attention Model for Categorizing Patient Safety Events," Cohan et al.: https://t.co/QUFdSvGGmv "Learning Chained Deep Features and Classifiers for Cascade in Object Detection," Ouyang et al.: https://t.co/CGl7FaR4Go "On the ability of neural nets to express distributions," Lee et al.: https://t.co/PmCjsENNpa "CT Image Denoising with Perceptive Deep Neural Networks," Yang et al.: https://t.co/FW3m5c7JDP "Unsupervised Learning of Morphological Forests," Luo et al.: https://t.co/UrqTWdOdYs "Synthesising Dynamic Textures using Convolutional Neural Networks," Funke et al.: https://t.co/han81JCFmJ "Large-Scale Stochastic Learning using GPUs," Parnell et al.: https://t.co/q6VHimOFji "Approximately Optimal Continuous-Time Motion Planning and Control via Probabilistic Inference," Mukadam et al.: https://t.co/r8WK0UHJ7z "Inherent Biases of Recurrent Neural Networks for Phonological Assimilation and Dissimilation," Amanda Doucette: https://t.co/4lJwlFzfvN "First Experiences Optimizing Smith-Waterman on Intel's Knights Landing Processor," Rucci et al.: https://t.co/g0Eqr9IAU5 "ViP-CNN: A Visual Phrase Reasoning Convolutional Neural Network for Visual Relationship Detection," Li et al.: https://t.co/Fdw4ffhzjQ "Learning to Draw Dynamic Agent Goals with Generative Adversarial Networks," Iqbal and Pearson: https://t.co/H9GqJ9Z8Ko "Rotting Bandits," Levine et al.: https://t.co/3NMbXW9ToH "Causal Discovery Using Proxy Variables," Rojas-Carulla et al.: https://t.co/PTGVCSxDVJ "Online Multiclass Boosting," Jung and Tewari: https://t.co/V1xATFCdyN "Automatic Representation for Lifetime Value Recommender Systems," Hallak et al.: https://t.co/t3LnbiuzAB "Sobolev Norm Learning Rates for Regularized Least-Squares Algorithm," Fischer and Steinwart: https://t.co/er92MSaoja "Consistent On-Line Off-Policy Evaluation," Hallak and Mannor: https://t.co/xOd4bDoQxd "One Size Fits Many: Column Bundle for Multi-X Learning," Pham et al.: https://t.co/V9kUhpUCbv @timhwang haven't read the paper yet but dat title 👏 Not sure what the acqui-hire landscape looks like in China but if SenseTime were in the West, it'd prob be bought https://t.co/uiwcetbzOF = Progressive Neural Networks + Gated Recurrent Adapter, applied to NLP (semantic role labeling) https://t.co/gDLT0wXcY7 RT @goodfellow_ian: The Brain-OpenAI collaboration on differential privacy won an ICLR best paper award! https://t.co/PRGnQHexUu @davegershgorn gotcha - nice article btw, look fwd to watching vids later @davegershgorn *not tested against pros I mean @davegershgorn other characters trained in paper (though not against pros AFAIK) - the transfer stuff is cool RT @timhwang: …and a video version of our talk on the paper earlier this week: https://t.co/aP1DqtHy2R RT @timhwang: “Harder Better Faster Stronger”: a new analysis of online psyops and int’l law by myself, @lea_rosen, and @oiioxford https://… RT @mark_riedl: This is not good. https://t.co/xjjgWBUjMh @haldaume3 https://t.co/EuYE2uRPpD @haldaume3 a lot more than AlphaGo! Google's SHA1 collision's compute requirements: https://t.co/oO7gQnv2R3 https://t.co/G9hyVRVlQP RT @dennybritz: Announcing the first SHA1 collision w/ 110 years of GPU computation. Wow, almost like training an NMT model. https://t.co/x… "Transferring Face Verification Nets To Pain and Expression Regression," Wang et al.: https://t.co/gFdVQdRiMh "Training a Subsampling Mechanism in Expectation," Raffel and Lawson: https://t.co/MKUavTmFCU "Scaling Deep Learning-based Decoding of Polar Codes via Partitioning," Cammerer et al.: https://t.co/gj9Xkxi2Da "DRYVR:Data-driven verification and compositional reasoning for automotive systems," Fan et al.: https://t.co/opVUOo2DL2 "EVE: Explainable Vector Based Embedding Technique Using Wikipedia," Qureshi and Greene: https://t.co/saNaBDfzBF "Learning Deep Features via Congenerous Cosine Loss for Person Recognition," Liu et al.: https://t.co/dVAkdvmCWD "Robustness to Adversarial Examples through an Ensemble of Specialists," Abbasi and Gagne: https://t.co/Uklk5Pxf2h "Enhancing Mind Controlled Smart Living Through Recurrent Neural Networks," Zhang et al.: https://t.co/iSERq6X5tx "MomentsNet: a simple learning-free method for binary image recognition," Wu et al.: https://t.co/B5XpEyFBim "DeepMask: Masking DNN Models for robustness against adversarial samples," Gao et al.: https://t.co/Bvfc8Y74Zz "A Progressive Learning Approach to Chinese SRL Using Heterogeneous Data," Xia et al.: https://t.co/8jwQlkCc8s "Improving a Strong Neural Parser with Conjunction-Specific Features," Ficler and @yoavgo: https://t.co/WXiTMuYeUY "Convolutional Neural Network-Based Block Up-sampling for Intra Frame Coding," Li et l.: https://t.co/YUWq81w6B4 "Task-driven Visual Saliency and Attention-based Visual Question Answering," Lin et al.: https://t.co/9OEMy7A1ND "One Representation per Word - Does it make Sense for Composition?," Kober et al.: https://t.co/Hruet8D2if "Using Deep Learning and Google Street View to Estimate the Demographic Makeup of the US," Gebru et al.: https://t.co/1xTZjCZnkF "Unsupervised Diverse Colorization via Generative Adversarial Networks," Cao et al.: https://t.co/gWug7CwP12 "Context-Aware Prediction of Derivational Word-forms," Vylomova et al.: https://t.co/lVP1cq6HgA "Neural Multi-Step Reasoning for Question Answering on Semi-Structured Tables," Haug et al.: https://t.co/bfGsCKalDQ "Active One-shot Learning," Woodward and Finn: https://t.co/kr3xJv1Mnc "Data Distillation for Controlling Specificity in Dialogue Generation," Li et al.: https://t.co/Q5frRoVH1o "Tackling Error Propagation through Reinforcement Learning: A Case of Greedy Dependency Parsing," Le and Fokkens: https://t.co/tg3eZq5b4R "Adversarial examples for generative models," Kos et al.: https://t.co/qwO3mh48Uk "When Lempel-Ziv-Welch Meets Machine Learning: A Case Study of Accelerating Machine Learning using Coding"-Li et al https://t.co/zyn1zuIsyZ "Memory Matching Networks for Genomic Sequence Classification," Lanchantin et al.: https://t.co/oPlHORJz1w "Counterfactual Control for Free from Generative Models," Guttenberg et al.: https://t.co/5Vy4pz9KEQ @Aelkus @filar great book, def. the book on such topics. RT @ACLU: So then we will have the same basic response. https://t.co/tMTAWYDRWm RT @NormEisen: Exhibit A in Muslim Ban litigation, round two https://t.co/OOqwTxZrfc @kimmaicutler see also "Inventing Ourselves Out of Jobs?" book, fascinating history of debate beginning much earlier (at least 30s) "Learning Compact Appearance Representation for Video-based Person Re-Identification," Zhang et al.: https://t.co/7106XXrFJp "Convolutional Recurrent Neural Networks for Polyphonic Sound Event Detection," Çakır et al.: https://t.co/ZQiGNx3V48 "The Power of Sparsity in Convolutional Neural Networks," Changpinyo et al.: https://t.co/jyw9eD5qdx "Sample Efficient Policy Search for Optimal Stopping Domains," Goel et al.: https://t.co/inqUwEu4YU "Learning to generate one-sentence biographies from Wikidata," Chisholm et al.: https://t.co/NzWbWAGqDL "Efficient Dense Labeling of Human Activity Sequences from Wearables using Fully Conv. Networks," Yao et al.: https://t.co/2NSzMgJ0cs """The Dialog State Tracking Challenge with Bayesian Approach,"" Quan Nguyen: https://t.co/vg9q5Gg7lp" "Survey of Reasoning using Neural networks," Amit Sahu: https://t.co/uoWhCFIHip "MOLIERE: Automatic Biomedical Hypothesis Generation System," Sybrandt et al.: https://t.co/x38Yguqgi7 "Survey of Automated Vulnerability Detection+Exploit Generation Techniques in Cyber Reasoning Systems," Brooks: https://t.co/i8J0DA88Y0 "Enabling Multi-Source NMT By Concatenating Source Sentences In Multiple Languages," Dabre et al.: https://t.co/EWVyGfscoR "Multi-task Learning with CTC and Segmental CRF for Speech Recognition," Lu et al.: https://t.co/S0zFaoNKLK "Mimicking Ensemble Learning with Deep Branched Networks," Kim et al.: https://t.co/ole7jRqR2c "Hybrid Dialog State Tracker with ASR Features," Vodolan et al.: https://t.co/kwTjPEYxOi "Just DIAL: DomaIn Alignment Layers for Unsupervised Domain Adaptation," Carlucci et al.: https://t.co/rdVxtKG0ax "VidLoc: 6-DoF Video-Clip Relocalization," Clark et al.: https://t.co/G49j1Q8BKx "Automated Assistants to Identify and Prompt Action on Visual News Bias," Narwal et al.: https://t.co/0oNS4V4PQK "Online Representation Learning with Multi-layer Hebbian Networks for Image Classification Tasks," Bahroun/Soltoggio https://t.co/c9RcmeqiFs "A 7.663-TOPS 8.2-W Energy-efficient FPGA Accelerator for Binary Convolutional Neural Networks," Li et al.: https://t.co/MmLO27wRqL "Reinforcement Learning Based Argument Component Detection," Gao et al.: https://t.co/zzH0X5yS4G "Visual Tracking by Reinforced Decision Making," Choi et al.: https://t.co/LcZcmhy73C "Towards a Common Implementation of Reinforcement Learning for Multiple Robotic Tasks," Martinez-Tenor: https://t.co/sThGV9U4fm "Fast rates for online learning in Linearly Solvable Markov Decision Processes," Neu and Gomez: https://t.co/I1X2MEGD0V "Convolution Aware Initialization," Armen Aghajanyan: https://t.co/HTW7Y1d3T9 "On the (Statistical) Detection of Adversarial Examples," Grosse et al.: https://t.co/04OaMKSPex "Predicting non-linear dynamics: a stable local learning scheme for recurrent spiking NNs," Gilra/Gerstner: https://t.co/dd78RHSB61 @benpopper none linked to in the paper. AI trained on one character in SSB can learn to play as another character in a few hours. Humans take years to get to pro level. SAD! @jnhwkim dunno They also did transfer. Lots of interesting stuff here, but headline result is beating all pros they tried it against. Interesting that they tried implementing in Gym/Universe but didn't work well w/ Universe starting agent. "Beating the World's Best at Super Smash Bros. with Deep Reinforcement Learning," Firouiu, Whitney, and Tenenbaum: https://t.co/CT8UkT5dWJ Chen and Yi got to arXiv first with SSB but looks like others thought the time was right for this... RT @yoavgo: @velvetart @Miles_Brundage why assume tweets and Intel briefs not overlapping? RT @FHIOxford: We are looking for research interns with machine learning/AI background to join our AI Safety and RL team https://t.co/gs0ui… RT @jackclarkSF: What are the best blogs by AI researchers? About to board a plane and want to break out of my own filter bubble! RT @hardmaru: Playing with this fun Interactive Image-to-Image Demo. It sort of works but have to mimic/draw edge detected lines. https://t… @TomLePaine yes, and there are infinite possible tasks so measuring prog on them all doesnt work. Higher level "abilities" is bit better :) RT @togelius: Imitation learning in games again, this time from pixels. Reminds me of https://t.co/aumyqCupYC https://t.co/VL329znVCA RT @AcademicAnge: Desperately needing help with photocopying costs and fee for PIP Judicial Review: https://t.co/pzWm9JPmWm via @gofundme But...we'll see :) Not sure I've moved my 50% chance before end of 2018 guess much higher, maybe 60. Still unclear. https://t.co/rzqLGysyfy Certainly game state access will help/maybe essential today, but don't think imitation + self-play w/ raw pixels is that far off either... @nonsensews been saying for a while, e.g. https://t.co/rzqLGysyfy (back in the day, that would mean "using internal game states vs. raw pixels," but here I assume raw pixels - I mean using human play video) Stuff like this makes me more confident that superhuman StarCraft AI isn't that far off, at least if one isn't starting from scratch. @PatrickOmid dunno. Maybe if the human did! In both cases, add'tl info (reward signal, self-play...) helps, but the fact that you get OK SSB play from only 60 5-min games, impressive. Basically analogous to the AlphaGo results showing that even just the policy network is OK (trained to predict human moves), but w/ video... More info (see the paper for even more of course :) ), very cool stuff. https://t.co/OmrPYWCkK4 RT @mark_riedl: Working on a draft Medium post about keeping the AI/ML talent pipeline healthy for industry https://t.co/f2JncJSTWe Thought… Also potentially interesting... https://t.co/H3nfj4caMP @nasrinmmm indeed, I was skeptical based on the title but scanned it and it looked potentially OK so tweeted/let others decide :) Haven't read carefully yet but looks potentially v. interesting - multitask learning in Atari. https://t.co/ggA9U0jwGG @justinhendrix @shitty_viagra I only do that for arxiv papers though :) @shitty_viagra I read very few of the things I tweet. Some combo of title/authors/abstract/skimming usually triggers a tweet. Fin. "Cosine Normalization: Using Cosine Similarity Instead of Dot Product in Neural Networks," Chungjie et al.: https://t.co/90ypszKvIU "From Photo Streams to Evolving Situations," Tang et al.: https://t.co/rNQHAbh7LZ "Blocking Self-avoiding Walks Stops Cyber-epidemics: A Scalable GPU-based Approach," Nguyen et al.: https://t.co/E4iHkOmToU "A Platform for Automating Chaos Experiments," Basiri et al., Netflix: https://t.co/qo0Cn7r4PS "Chaos Engineering," Basiri et al., Netflix: https://t.co/1CkSTflVLH "Progressively Diffused Networks for Semantic Image Segmentation," Zhang et al.: https://t.co/LsAKIyooKo "Compressive Embedding and Visualization using Graphs," Paratte et al.: https://t.co/PwmK4yylJX "Deep learning-based assessment of tumor-associated stroma for diagnosing breast cancer ..," Bejnordi et al.: https://t.co/fWabYB7a1d "Revisiting Distributed Synchronous SGD," Pan et al.: https://t.co/bV8pMlFU4A "A Survey on Deep Learning in Medical Image Analysis," Litjens et al.: https://t.co/DGOHNzvodf DR^2-Net: Deep Residual Reconstruction Network for Image Compressive Sensing," Yao et al.: https://t.co/C5C8Zcn2pQ "Person Search with Natural Language Description," Li et al.: https://t.co/95gDZJit2Y "Zoom Out-and-In Network with Recursive Training for Object Proposal," Li et al.: https://t.co/EsLnRqcHeE "Using Bad Learners to find Good Configurations," Nair et al.: https://t.co/zzHzc73WtN "CityPersons: A Diverse Dataset for Pedestrian Detection," Zhang et al.: https://t.co/Osg41My7AN "On Loss Functions for Deep Neural Networks in Classification," Janocha et al.: https://t.co/svtZEtsO3W "MAT: A Multimodal Attentive Translator for Image Captioning," Liu et al.: https://t.co/uggQ1To9XS "Revisiting Graph Construction for Fast Image Segmentation," Zhang et al.: https://t.co/mTUlJOg6Iq "Deep Stochastic Configuration Networks: Universal Approximation and Learning Representation," Wang and Li: https://t.co/QzsnVFrYXi "A Stylometric Inquiry into Hyperpartisan and Fake News," Potthast et al.: https://t.co/YcTFPBgMCn "Reproducing and learning new algebraic operations on word embeddings using genetic programming," Santana: https://t.co/SbIWRDbY87 "Brain Inspired Cognitive Model with Attention for Self-Driving Cars," Chen et al.: https://t.co/qHy1o6vXYF "An LSTM Framework for Human Trajectory Prediction and Abnormal Event Detection," Fernando et al.: https://t.co/rLxGGj5ceE "Beyond the Hazard Rate: More Perturbation Algorithms for Adversarial Multi-armed Bandits," Li and Tewari: https://t.co/Qj0Y2jNm2Z "Analysis and Optimization of fastText Linear Text Classifier," Zolotov and Kung: https://t.co/a7EthQHlCk "soc2seq: Social Embedding meets Conversation Model," Bhatia et al., Yik Yak: https://t.co/O910dnrLfV "An Unsupervised Approach for Overlapping Cervical Cell Cytoplasm Segmentation," Kumar et al.: https://t.co/bzvMNGDzF1 "Phase Diagram of Restricted Boltzmann Machines+Generalised Hopfield Networks with Arbitrary Priors," Barra et al.: https://t.co/haHmvOLpzp "Allometric Scaling in Scientific Fields," Dong et al.: https://t.co/CjO3sx75EF "Dataset Augmentation in Feature Space," DeVries and Taylor: https://t.co/NET0JvCBrl "An Attention-Based Deep Net for Learning to Rank," Wang and Klabjan: https://t.co/BVy4Fb79A5 "Label Distribution Learning Forests," Shen et al.: https://t.co/94zG01EtDs "Learning Non-Discriminatory Predictors," Woodworth et al.: https://t.co/6NZNkKWiGk "Online Multi-Task Learning Using Biased Sampling," Sharma and Ravindran: https://t.co/BgGKgiHqkE "An Extended Framework for Marginalized Domain Adaptation," Csurka et al.: https://t.co/YHj7nvxNws "Generating Adversarial Malware Examples for Black-Box Attacks Based on GAN," Hu and Tan: https://t.co/ZnrSttxnMr "Automatic Liver and Tumor Segmentation of CT and MRI Volumes using Cascaded Fully CNNs," Christ et al.: https://t.co/M4Je3eN1Xc "Latent Variable Dialogue Models and their Diversity," Cao and Clark: https://t.co/pKMfX6yqvZ "I Ate This: A Photo-based Food Journaling System with Expert Feedback," Goyal et al.: https://t.co/v2kpQFIowa "SurvivalNet: Predicting patient survival from diffusion weighted MRIs using cascaded fully C+3D CNNs," Christ et al https://t.co/CcB88KKPsZ "The importance of stain normalization in colorectal tissue classification with CNNs,' Ciompi et al.: https://t.co/odg9EVCwxj "Learning Spatial Regularization with Image-level Supervisions for Multi-label Image Classification," Zhu et al.: https://t.co/d5c0L6BOQD "Exponentially vanishing sub-optimal local minima in multilayer neural networks," Soudry and Hoffer: https://t.co/UhrPN0rlgf "Collaborative Deep Reinforcement Learning for Joint Object Search," Kong et al.: https://t.co/zg3g5Vwzhl "Collaborative Deep Reinforcement Learning," Lin et al.: https://t.co/8szaKHl0sK "Learning to Repeat: Fine Grained Action Repetition for Deep Reinforcement Learning," Sharma et al.: https://t.co/eisdSZ9rN6 Not outstanding performance but the point of the paper is that imitation learning can be pretty efficient with CNNs in pretty complex domain (videos are pretty old, class project last year? But paper is new AFAIK) There are more videos not on that playlist (see paper), e.g. (Pikachu is the AI): https://t.co/6U3Wty3Jps With lots of videos: https://t.co/pMNzD0aByr "The Game Imitation: Deep Supervised Convolutional Networks for Quick Video Game* AI," Chen + Yi https://t.co/BvqEeYnulB *Super Smash Bros Yesssssssssss - slogging through arXiv was worth it for this... get ready. Dear arXiv - pls hold your horses. Thx. Good thing none of these afflict the US government! https://t.co/wU2R1M8WhK RT @realDonaldTrump: Can you believe that,with all of the problems and difficulties facing the U.S., President Obama spent the day playing… @hannahgais https://t.co/H000BQ3Rbi "Experiment Segmentation in Scientific Discourse as Clause-level Structured Prediction using RNNs," Dasigi et al.: https://t.co/aXNAyL2T4f "Learning Normalized Inputs for Iterative Estimation in Medical Image Segmentation," Drozdzal et al.: https://t.co/RoQkvb0YsA "Automatic Handgun Detection Alarm in Videos Using Deep Learning," Olmos et al.: https://t.co/i4rgPeocTC "Learning to Detect Human-Object Interactions," Chao et al.: https://t.co/Zu7kfFIx8I "A Random Matrix Approach to Neural Networks," Louart et al.: https://t.co/l3MaF8Gd6j "Predicting Surgery Duration with Neural Heteroscedastic Regression," Ng et al.: https://t.co/nPkw9XGqAW "Estimating Nonlinear Dynamics with the ConvNet Smoother," Ambrogioni et al.: https://t.co/eTnqZAuknH Monday arXiv cont'd: @AnthroPunk no baiting intended, just tired You're lucky if you get a chance to have c̷a̷k̷e̷ lunch at your own w̷e̷d̷d̷i̷n̷g̷ workshop. More arXiv tomorrow... "Adversarial Discriminative Domain Adaptation," Tzeng et al.: https://t.co/6CIhvvcfVt "EMNIST: an extension of MNIST to handwritten letters," Cohen et al.: https://t.co/WzSxiVRf49 "Quantifying Program Bias," Albarghouthi et al.: https://t.co/MX5sLh0U0S "Toward Abstraction from Multi-modal Data: Empirical Studies on Multiple Time-scale Recurrent Models," Zhong et al: https://t.co/CEQgwGflac RT @FeryalMP: This doesn't surprise me at all and that's really sad! https://t.co/ndgr2yGxvF @_jyan_ @tdietterich @jackclarkSF (in any case, tho, that's a fair point/we may intrinsically be surprised sometimes/can't cover everything) @_jyan_ @tdietterich @jackclarkSF I'd expect more heavily optimized metrics to be smoother @_jyan_ @tdietterich @jackclarkSF AlphaGo is somewhat special b/c problem that hadn't had industrial scale skill/compute thrown at it yet, @_jyan_ @tdietterich @jackclarkSF even ppl who read papers disagree, though, + policy-makers etc. won't read papers. Need statS plural prob @tdietterich @jackclarkSF re: hype/other measures besides capabilities, not sure but I liked this by @lukeprog: https://t.co/oM9dXWRdk6 @tdietterich two thoughts: one, yes, this is important and @jackclarkSF and I and others interested in this, happy to discuss (ping Jack?), (FWIW, I think it's clear that most *conceptual* progress didn't happen lately, but most *capability* progress? Maybe. Depends how measured) #NAME? + raising Q: has AI progress been *generally* slower than expected? Depends what one means by this. Perhaps *for most of its history*, yes, Paul Christiano explains his (useful) mental model of how his brain works: https://t.co/uhFBIWP5Be RT @liamstack: The reporter who asked the softball Melania question at Trump's press conference was 19. His TV network was made up. https:/… @j2bryson look fwd to seeing u! RT @dyllyp: Follow up from yesterday's Media Accountability Survey: Trump didn't receive favorable results, so now he's calling his own pol… RT @juliagalef: A clever way to improve on the standard "wisdom of crowds" algorithm. My explanation below, more at the link. https://t.co… RT @MaxBoot: Any foreign intel service that doesn't have an agent as a member or employee of Mar-a-Lago is guilty of rank incompetence. RT @alexjc: Audio Super-Resolution using Neural Networks https://t.co/W1YLblQY5m I was wondering how long this would take to happen! No sam… @antonhowes @ArtirKel what is the occasion? @ianpaulwright it was great when I arrived in July... I seem to have survived the worst of the Oxford winter. And yes, I know it isn't that bad, but I'm coming from Arizona... https://t.co/cTqgHnbE2f RT @SimoneGiertz: The White House is running like a fine-tuned machine https://t.co/9qgHM1MHEn RT @xuenay: Industrial Revolution Comparisons Aren't Comforting https://t.co/tTwQWWVLfj @mjrobbins but yes, does seem to me like in either case there would be some ambiguity/arbitrariness @mjrobbins same question applies to that as robots (whether it makes sense at all vs. raising capital/bus. income tax), + automation vaguer @robinhanson context: https://t.co/W7DUyuLnvC CC @robinhanson Trying to understand if it's a serious or naive/inefficient proposal. Has anyone said why a robot tax would differ from/interact with a tax on capital or business income? Or why it'd be preferred to more of ^? RT @LibyaLiberty: The is the truest Trump/Hitler meme out there. Because it's an exact analogy. https://t.co/Mp07lffey4 Sadly, they're right to. Same Pence who was lied to about Flynn-anigans, whose superior calls NATO obsolete, etc. https://t.co/yluvLyJLNn RT @hardmaru: Creating photorealistic images with neural networks and a Gameboy Camera. Reading this post makes me feel so happy. https://t… RT @ericjang11: GraphCore visualizations are really beautiful, but deets on how the image is computed is super vague :/ https://t.co/gaFmaC… @rcalo @HankGreelyLSJU he had to make sure to inappropriately capitalize something the second time. RT @chrisnovello: Any public research around using neural nets to conjure new political groupings/spectra? t-SNE politics? etc? https://t.c… RT @CharlotteHase: Workshop submissions by the biggest names in the field. ICLR Workshop track looks like a secondary conference track! htt… RT @carlesgelada: @Miles_Brundage I am not even finished with the papers from NIPS!!! It's grown by 20-30 papers since I said that, btw. @alexjc still a few hours to go! "arXiv: I bet this volume of deep learning papers will overwhelm you. OpenReview: Hold my beer. https://t.co/UkcoQo69fY" RT @TrumpDraws: my teddy https://t.co/9nupsFuc1S RT @elianayjohnson: Situation at WH -- A senior NSC aide said to me: "I don't know anything. Nobody knows anything. I don't know who knows… "Improving automated multiple sclerosis lesion segmentation with a cascaded 3D CNN approach," Valverde et al.: https://t.co/8kfZxWOqhN "A Theoretical Framework for Robustness of (Deep) Classifiers against Adversarial Samples," Wang et al.: https://t.co/kQTwdgNq6P "Trace Norm Regularised Deep Multi-Task Learning," Yang and Hospedales: https://t.co/ByzhREqCLa "Precise Recovery of Latent Vectors from Generative Adversarial Networks," @zacharylipton and Tripathi: https://t.co/068cmtvz2I "Dynamic Partition Models," Goessling and Amit: https://t.co/YHsaRC2AZP "Efficient Computation of Moments in Sum-Product Networks," Zhao and Gordon: https://t.co/56nA9mQ7qR "Compression Complexity," Fenner and Fortnow: https://t.co/XpuIaAfukF "Training Language Models Using Target-Propagation," Wiseman et al.: https://t.co/2vnhqgmT4q "Learning to Use Learners' Advice," Singla et al.: https://t.co/EDoMfQ2xLT "Theoretical and Practical Advances on Smoothing for Extensive-Form Games," Kroer et al.: https://t.co/qoe6P0xARc "Deep Hybrid Similarity Learning for Person Re-identification," Zhu et al.: https://t.co/WHoBeQwKVe "Unbiased Online Recurrent Optimization," Tallec and Ollivier: https://t.co/bodOsYCLiY "Addressing the Data Sparsity Issue in Neural AMR Parsing," Peng et al.: https://t.co/yj2Pjt70xH "Improving Text Proposals for Scene Images with Fully Convolutional Networks," Bazazian et al.: https://t.co/fkvuSnC6gm RT @djrothkopf: It's almost like asking your grossly inexperienced Jewish son-in-law if he would achieve Middle East peace. https://t.co/jt… RT @hardmaru: When Machines design neural nets, will they use abstractions like Layers, Modules, Skip Connections, Gates? How can Humans un… "RT @jonlovett: For those keeping score: Leaks: REAL News: FAKE Good polls: REAL Bad polls: FAKE Wikileaks: REAL Things I say: DUNNO, SOMEON…" RT @textfiles: Disney 1938. Google 2017. https://t.co/uc95ZGmVTl "Discovering objects + their relations from entangled scene representations," Raposo and @santoroAI et al, DeepMind: https://t.co/Fp6LHRXCNo RT @johnnydollar01: Clip: @ShepNewsTeam sticks up for CNN's Jim @Acosta - & went further... https://t.co/iITXqAzXXF Rest of quote is: "and things could get terrible. It actually, probably, it would be a better... screenplay idea than a serious suggestion." Relevant. https://t.co/blJIGBtJmW @hannahgais because you're not a Nazi. RT @NicolasPapernot: New #cleverhans blog post with @goodfellow_ian: "Is attacking machine learning easier than defending it?" https://t.co… RT @jackclarkSF: OpenAI post about adversarial examples, aka optical illusions for machine learning models + some new research: https://t.c… This. Press. Conference. Just....yeah. https://t.co/0Geq4Bv1Jp RT @shakir_za: Our latest paper. We explored generative models of sequences, their limitations, improvements and applications. https://t.c… RT @erichorvitz: Beyond games-Rich simulation tools can teach AI systems about actions, outcomes, physics of open world https://t.co/QlMqNN… @BogusHype re: picking, fast enough now - computer vision is fast - more of a software issue (vision wrong sometimes, grasping, etc) @BogusHype though if ability exists (but is slow), faster CPU helps make it useful. + makes research faster-try more stuff. it's complicated @BogusHype AI abilities don't exactly follow it (not as fast) b/c some problems take exponentially more power to solve linearly harder probs @BogusHype much better surveillance def. possible, but show is implausible at times (long term prediction hard/impossible in some cases) RT @michael_nielsen: Ke Jie & Nie Weiping on Go & AI's teaching humans: https://t.co/P8SegmlkgD https://t.co/mtyFfRHrmg "Efficient Multi-task Feature and Relationship Learning," Zhao et al.: https://t.co/JsyTJgb495 "ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes," Dai et al.: https://t.co/yB3Q0xwMAO "Entropy Non-increasing Games for the Improvement of Dataflow Programming," Batfai et al.: https://t.co/MEB67ZHCm3 "Visualizing Deep Neural Network Decisions: Prediction Difference Analysis," @zinmalu et al.: https://t.co/Plx6nRYRkS "Deep Multi-camera People Detection," Chavdarova and Fleuret: https://t.co/Pd0kzrjARd "The Accuracy-Privacy Tradeoff of Mobile Crowdsensing," Alsheikh et al.: https://t.co/6IeHzHOQ1K "A Logical Study of Some Common Principles of Inductive Definition and its Implications for KR," Denecker et al.: https://t.co/w2SzjiI5oj "The Interplay between Human and Machine Agency," Pickering et al.: https://t.co/hR7zELbRSY "A deep learning model integrating FCNNs and CRFs for brain tumor segmentation," Zhao et al.: https://t.co/3o2yTEqDXz "Frustratingly Short Attention Spans in Neural Language Modeling," Daniluk et al.: https://t.co/IQZcgZMxX0 "A Dependency-Based Neural Reordering Model for Statistical Machine Translation," Hadiwinoto and Ng: https://t.co/XaNkupF5iI "Application of Multi-channel 3D-cube Successive Convolution Network for Convective Storm Nowcasting," Zhang et al: https://t.co/y005vgPz3X "Transfer Learning for Low-Resource Chinese Word Segmentation with a Novel Neural Network," Xu and Sun: https://t.co/xEet9jkBjt "Recognizing Dynamic Scenes with Deep Dual Descriptor based on Key Frames and Key Segments," Hong et al.: https://t.co/pW7cc6NYAV "Deep Heterogeneous Feature Fusion for Template-Based Face Recognition," Bodla et al.: https://t.co/2CAfhqcvx5 """Automated Phrase Mining from Massive* Text Corpora,"" Shang et al.: https://t.co/QTjYpz2Zgd They misspelled bigly." "Learning from Ambiguously Labeled Face Images," Chen et al.: https://t.co/u1xYNWYUwr "Modeling Social Organizations as Communication Networks," Wolpert et al.: https://t.co/7ouleFyjEB "Visual Discovery at Pinterest," Zhai et al.: https://t.co/jAiZ10X2ZT "Distributed deep learning on edge-devices: feasibility via adaptive compression," Hardy et al.: https://t.co/qjAF90Rvh3 "Multi-Task Convolutional Neural Network for Face Recognition," Yin and Liu: https://t.co/Z04PGxfB2D "Nearest Labelset Using Double Distances for Multi-label Classification," Gweon et al.: https://t.co/EQL5MOEZzZ "Simple rules for complex decisions," Jung et al.: https://t.co/gSp57LsQXO "Building Robust Stochastic Configuration Networks with Kernel Density Estimation," Wang and Li: https://t.co/jBLIE9XjTA "Small Boxes Big Data: A Deep Learning Approach to Optimize Variable Sized Bin Packing," Mao et al., Walmart/MIT: https://t.co/X4ihAMgoy4 RT @hardmaru: Looking for a nice RNN Cell for language modelling? Check out Neural Architecture Search RNN Cell in TF 1.0 contrib. https://… Lots of ICLR workshop stuff on OpenReview already but I'll take a closer look when the deadline is past :) Using GANs to learn to (in this case) play chess in the style of late grandmaster Mikhail Tal. "Style Transfer Generative Adversarial Networks: Learning to Play Chess Differently," Chidambaram and Qi: https://t.co/jGJRQS0un2 "Generative Temporal Models with Memory," Gemici, Hung, @santoroAI, + Wayne et al. at DeepMind: https://t.co/bI1QHr33pN @sknthla lots of references on this in Against Democracy RT @googleresearch: We've updated YouTube-8M, and announced a video understanding challenge with an affilliated CVPR workshop. Busy day! ht… RT @nasrinmmm: Congrats to Sap et al. @uwnlp for winning #StoryClozeTest shared task #LSDSem #EACL2017 Stay tuned for the report paper on o… @girishsastry which...yeah. @girishsastry my model (from e.g. https://t.co/3x08tWlhuw) is that it's not unconditional never, but never if ppl don't listen to his theory AI expertise maybe also useful, but AFAIK (from reading other stuff by him) his view is ~"AI off track b/c ignoring X"...does X have merit? "Strategic Implications of Openness in AI Development" by Nick Bostrom @FHIOxford now in Global Policy (open access) https://t.co/OqUcW98Ykp *Gelernter. I always get that wrong. (there may already be a good review, or of his earlier books which seem to express v. similar POVs, but not much academic attention AFAIK) Someone familiar w/ neuro/psych/phil of mind should read and review Tides of Mind by Gelertner given that he may be Trump's science advisor. @Aelkus but also v helpful/interesting stuff. So much lit. @Aelkus indeed, it's not. Been drawing inspiration from nuclear lit lately (arms races, verification, zero knowledge proofs), depressing @Aelkus we really need to Skype at some point btw... some modeling stuff on back burner til a few weeks from now, then bigly. @haldaume3 thanks for tweeting all this! @Aelkus @kennethpayne01 looks cool - thanks! @Aelkus @kennethpayne01 I'm most intrigued by the varying cognitive depth stuff. Want to see more dimensions of variation, more experiments. @Aelkus yes, we haven't yet seen the AlphaGo Move 37 or Cepheus check-call equivalent in war. StarCraft will be interesting. @Aelkus I like your and @kennethpayne01's takes, just soo many Qs raised by paper, want to hear more discussion of them by ABM/GT etc ppl You know you have a book problem when you have books shipped to somewhere you're visiting for a few days... Also, looking forward to @kennethpayne01's book :) Interested to hear more takes on this - cool paper, not v obvious to me what implications are (contra most coverage) https://t.co/qN0P0GFhx7 RT @kennethpayne01: Me on the strategic implications of @DeepMindAI's latest research https://t.co/xVupE4Y823 RT @elonmusk: Congrats to the Tesla owner who sacrificed damage to his own car to bring a car with an unconscious driver safely to a stop! Variation on Hofstadter's Law (https://t.co/gjCG3ZvopM): workshops take more time than you expect, even when taking this into account. @mark_riedl @davegershgorn where was this? RT @mark_riedl: Do I dare select the unsecured wifi network called "superintelligence"? https://t.co/Eu9Y1CWans @juliagalef in any case, wild stuff :) It knows I talk about flights involving London and people being "unaware" of "situations" :) @juliagalef were you selecting the most appropriate of the suggested options, or the first one of the options for all?(if works like iPhone) RT @fchollet: I'll be on around 11:35 to talk about bringing the Keras API into TensorFlow and making deep learning accessible to everyone.… RT @ktumulty: As White House denounces leaks, remember that the VP learned the truth only because of the Washington Post. https://t.co/zBf… RT @marek_rosa: The first round of the @ai_challenge has just launched: Gradual Learning – Learning like a Human! https://t.co/8M9x9lOYYc h… RT @GlennKesslerWP: In the same column, @EliLake also noted this is "a White House that has such a casual and opportunistic relationship wi… RT @reworkpip: We spoke to Olga Afanasjeva, COO of GoodAI & @AI_challenge - which launches today! https://t.co/l4wJbmdRyw https://t.co/5P6G… @AMP_SV I pondered it earlier but the UK sucks at popcorn RT @SussilloDavid: As god is my witness, I'm going to find some way to use 'deep state' in the title of my next paper. ✋️🤓 RT @jonfavs: https://t.co/RgKAkbLWy3 He didn't even say he didn't talk to them. He said he didn't *knowingly* talk to them. Consistent w/ knowing now. https://t.co/4lC31LHPoj @AMP_SV #DeepState2020 That also happens to be the very first (non-miniseries) BSG episode, appropriately. SAD! https://t.co/CfBgWtRhDH @CostaSamaras even there, not super model/trendy, but include bc at least has multiple time horizons so implicitly modely. More work needed! RT @etzioni: Kudos to the Semantic Scholar team for winning the end2end task! cc @allenai_org https://t.co/bU7e0GkgJN @CostaSamaras not sure if applies to the car stuff but the whole thing should be taken w/ grain of salt in light of zero acknowledgment of ^ @CostaSamaras only that comes to mind is the US Robotics Roadmap but that hasn't changed much (in many cases, exactly same) in 3 versions :) @lucaswiman @Aelkus Sarah Connor Chronicles has some good moments. """Trump Campaign Aides Had Repeated Contacts With Russian Intelligence"": https://t.co/obJ2FcmCfY https://t.co/PWvMQWFWra" RT @fordm: It's less of a "news cycle" these days and more of that BSG episode where the Cylons attack every 33 minutes. @Aelkus T3 makes this most clear (fear/greed for funding drives deployment of Skynet) but yeah, also the T2 change thing @Aelkus in the annals of unfinished Future Tense articles: Terminator is about human role in robopocalypse, misunderstood as deterministic @CostaSamaras (not that intuition isn't useful/needed, but just particularly interested in former - not much of this in other AI domains) @CostaSamaras that seems extreme, though agree AI forecasting is hard. Are there good forecasts for this grounded in trends/models vs. gut? E.g. is Brain a subset of Research? How much non-DeepMind, non-Brain AI research is there in Alphabet? Don't nec. agree w/ all (IBM pushing hard on DL, Apple opening up..?) but interesting. Where does Goog Research fit? https://t.co/zKA9Eq5UC9 "One-Step Time-Dependent Future Video Frame Prediction with a Convolutional Encoder-Decoder NN," Vukotic et al.: https://t.co/1XawiuTY3D "SSPP-DAN: Deep Domain Adaptation Network for Face Recognition with Single Sample Per Person," Hong et al.: https://t.co/EJy2p9gL09 "JFLEG: A Fluency Corpus and Benchmark for Grammatical Error Correction," Napoles et al.: https://t.co/wmF08WsZCF "Evolution-Preserving Dense Trajectory Descriptors," Wang et al.: https://t.co/Q6kvwVhwoy "Occupy the Cloud: Distributed Computing for the 99%," Jonas et al.: https://t.co/Wi2Ab6d36F "End-to-End Interpretation of the French Street Name Signs Dataset," Smith et al.: https://t.co/y7EaBLoU7T "Towards a Multilingual Corpus of Translations Annotated w/ Compositional Meaning Representations," Abzianidze et al https://t.co/MBGQOz7Lva "Software Engineering at Google," Fergus Henderson (v. 2): https://t.co/90pqyNfTBd "On the Relevance of Auditory-Based Gabor Features for Deep Learning in ASR," Martinez et al.: https://t.co/jvoQn5IzKL "A storm is Coming: A Modern Probabilistic Model Checker," Dehnert et al.: https://t.co/maD0lthpsc "Structured Deep Hashing with Convolutional Neural Networks for Fast Person Re-identification," Wu and Wang: https://t.co/95KaQuxjWg "On Detecting Adversarial Perturbations," Metzen et al.: https://t.co/kaS4LcppjQ "Soft Weight-Sharing for Neural Network Compression," Ullrich et al.: https://t.co/4AwR4HiZyT "Practical Learning of Predictive State Representations," Downey et al.: https://t.co/aOzhme68NE "Gaussian-Dirichlet Posterior Dominance in Sequential Learning," Osband and Van Roy: https://t.co/zVboF31I7o RT @ericjang11: Who is leading in AI research among big tech players? Check out my challenge to Yann Lecun https://t.co/BAnxN4VfBQ Plausible take on Bannon. Hope this is right. Excerpt: https://t.co/bCcxQfVvX6 https://t.co/vKmEAqatxf RT @JohnDanaher: Daniel Dennett: "From Bacteria to Bach and Back: The Evolution of Minds" | Talks at Google - YouTube https://t.co/6nPBLX0E… @hardmaru also: Trump Tower, 2047. RT @nktpnd: 🤔 https://t.co/6ZhBufDBH2 @ghadfield @PartnershipAI think this is true of all things OSTP (they don't have a website RN), not this report being singled out. @beaucronin ah :) +20 nerd credit points RT @benwizner: I think he's not very good at vetting. #Flynn https://t.co/ZgkHRw9NRc @beaucronin huh? @sknthla in what quantity? Interesting interview - here's one excerpt: https://t.co/G9EjGZ1B73 https://t.co/1Dk7QjR8xa RT @polynoamial: For the poker players out there curious about Libratus, I did a Q&A with CardPlayer recently: https://t.co/XFy4Szt3jq (think Gordon's prob. wrong about AI/robotics but interesting nonetheless to have a good baseline of how big of a deal historical stuff was) Quick reminder that The Rise and Fall of American Growth is a very interesting read - learn history of some tech and economics at same time. Fin. "Non-convex learning via Stochastic Gradient Langevin Dynamics: a nonasymptotic analysis," Raginsky et al.: https://t.co/KhDyi1Ncrr "Multitask diffusion adaptation over networks with common latent representations," Chen et al.: https://t.co/pVPFN6RoN3 "Estimation of the volume of the left ventricle from MRI images using deep neural networks," Liao et al.: https://t.co/eA4OcMyOQN "Offline bilingual word vectors, orthogonal transformations and the inverted softmax," Smith et al.: https://t.co/AMjfZ7XMZE "Generative Mixture of Networks," Banijamali et al.: https://t.co/pjCrp5bGCg "Towards speech-to-text translation without speech recognition," Bansal et al.: https://t.co/9bqfDbzBFt "Next-Step Conditioned Deep CNNs Improve Protein Secondary Structure Prediction," Busia and Jaitly, Brain: https://t.co/dJy1gMDl9M "DNN Filter Bank Cepstral Coefficients for Spoofing Detection," Yu et al.: https://t.co/6YrkJ8UOdY "Unsupervised temporal context learning using CNNs for laparoscopic workflow analysis," Bodenstedt et al.: https://t.co/K9fOUTRUwk "Multitask Learning with Deep Neural Networks for Community Question Answering," Bonadiman et al.: https://t.co/WR4XbIbjL6 "Bilateral Multi-Perspective Matching for Natural Language Sentences," Wang et al.: https://t.co/0PxZrSR67t "Design+implementation of an adaptive critic-based neuro-fuzzy controller on an unmanned bicycle"-Shafiekhani et al https://t.co/qnQTrNI8w8 "Learning Concept Embeddings for Efficient Bag-of-Concepts Densification," Shalaby and Zadrozny: https://t.co/SESwJ5RJVA "Training Deep Neural Networks via Optimization Over Graphs," Zhang and Kleijn: https://t.co/sTfieF1GrT "Crossing Nets: Dual Generative Models with a Shared Latent Space for Hand Pose Estimation," Wan et al.: https://t.co/iUZKCOHPyI "ArtGAN: Artwork Synthesis with Conditional Categorial GANs," Tan et al.: https://t.co/zHbD44nCx1 "Safe Open-Loop Strategies for Handling Intermittent Communications in Multi-Robot Systems," Mayya and Egerstedt: https://t.co/ovzTvzIL9s "Vector Embedding of Wikipedia Concepts and Entities," Sherkat and Milios: https://t.co/xxWKOzZrLy "Group Scissor: Scaling Neuromorphic Computing Design to Big Neural Networks," Wang et al.: https://t.co/wmAZHuSMue "Octopus: A Framework for Cost-Quality-Time Optimization in Crowdsourcing," Goel et al.: https://t.co/O9vK8mZr8a "A Novel Weight-Shared Multi-Stage Network Architecture of CNNs for Scale Invariance," Takahashi et al.: https://t.co/1MlpfV7eWc "Learning to Parse and Translate Improves Neural Machine Translation," Eriguchi et al.: https://t.co/iYYYdul8DR "Similarity Preserving Representation Learning for Time Series Analysis," Lei et al.: https://t.co/uyiGEzRpIK "Graph Neural Networks and Boolean Satisfiability," Bünz and Lamm: https://t.co/sXdhUDwGGB (NNs learning SAT-predicting features) "Nearly Instance Optimal Sample Complexity Bounds for Top-k Arm Selection," Chen et al.: https://t.co/GZgwJcHkcJ "Is Big Data Sufficient for a Reliable Detection of Non-Technical Losses?," Glauner et al.: https://t.co/1TwdAEcf8J "An oracle-based attack on CAPTCHAs protected against oracle attacks," Hernandez-Castro et al.: https://t.co/m4F8FyYDQx """Cognitive Mapping + Planning for Visual Navigation,"" Gupta et al., Goog/Berk: https://t.co/Lk7JvAxWYz Page w/ vid: https://t.co/ePX50TZZyw" "Supervised Learning for Controlled Dynamical System Learning," Hefny et al.: https://t.co/iqCm02EX3h "Bayesian Probabilistic Numerical Methods," Cockayne et al.: https://t.co/QMZwRXSR34 "Batch Policy Gradient Methods for Improving Neural Conversation Models," Kandasamy et al.: https://t.co/Bu9b7xVn8c "Enabling Robots to Communicate their Objectives," Huang et al., Berkeley/OpenAI: https://t.co/V33rj4yaEK Forget the failed graph stuff, arXiv papers! Hypotheses I will test when more data avail.: faster/earlier progress in easy exploration Atari games; sudden jump in hard explo. recently. Explanation of the 4 exploration types: https://t.co/iz3dm6lHmu If/when the UNREAL data is available, perhaps, it'll be more interesting (also missing data from paper w/ taxon.: https://t.co/q5RcfgbFyZ). This graph isn't as interesting as hoped :/ Progress in 7 games/category of exploration hardness based on @marcgbellemare's et al's taxonomy https://t.co/cMXuqtjtyr Not superhuman (they're humans...) but pretty cool video and it seems like something that AI could be superhuman at. https://t.co/90yoEb0JhN RT @rao2z: Finally, some intelligence for twitter... Let's hope @RealAAAI becomes even more popular than that other @ Real... handle! https… @jeffbigham I think this is rough lower bound (assumes people report accurately) though also possible some (fewer?) say they didn't when did "Deep embodiment: grounding semantics in perceptual modalities," Douwe Kiela's dissertation: https://t.co/MSyaxhNMEx @j2bryson thanks for sharing! RT @j2bryson: The @EdFelten live stream is https://t.co/12gTPyEHhr @mat_kelcey #FAKENEWS @JiveAssBastard a lot of them are already! For a lot of ppl in AI community, right or wrong, AI isn't just the Next Big Thing, but the Last Big Thing. Don't expect this to happen w/ most of AI community. See opposite a lot: ppl wealthy from something else move to AI. https://t.co/18L7Qj9Rmw "RT @Mikel_Jollett: TRUMP {tries to do his weird dominance hand-shake} TRUDEAU: Do you even lift, bro? https://t.co/Yk3M3P7BQ5" RT @CommsDirector: Abe, Flynn, Bannon, Miller. NoKo briefing docs strewn about. Civilians listening, taking photos. And POTUS, oblivious, g… RT @brianklaas: How's that old saying go? "Do as I say not as I do?" https://t.co/twbBdVnhRt @Bouh___ I tweet stuff that seems interesting based on title/authors/abstract/skimming - def. don't read all of em/sometimes don't even skim RT @JamilSmith: The president discussed news of North Korea's missile test within earshot of his Mar-a-Lago diners. But, emails. https://t.… @AMP_SV alas, nope... @AMP_SV I was hoping someone could tell me what to care about ;) but yeah, that stuff, how close we are to more broadly useful stuff, etc. @dmarthal just for the night :) RT @Slade: Normal guy shaking hands like a normal https://t.co/FK4ICDIMv5 @AnthroPunk I don't read all of them. I tweet ones that seem interesting based on some combination of title/authors/abstract/skim. RT @mat_kelcey: @Miles_Brundage see also "Deep Reinforcement Learning for Tensegrity Robot Locomotion" https://t.co/wEIacVygkp Fin. "Unbiased Multi-index Monte Carlo," Crisan et al.: https://t.co/dQeMxPpN75 "Computational inference without proposal kernels," Warne et al.: https://t.co/2L2ptzJT95 "Modeling Semantic Expectation: Using Script Knowledge for Referent Prediction," Modi et al.: https://t.co/JTQ1dIOF2D ...Fasoli et al. "Pattern Storage, Bifurcations+Higher-Order Correlation Structure of an Exactly Solvable Asymmetric NN Model": https://t.co/jZeMBeaPUy "Hybrid Code Networks: practical + efficient E2E dialog control w/ supervised + reinf. learning," Williams et al.: https://t.co/saIa983zRK "A Variation of Levin Search for All Well-Defined Problems," Fouad Chedid: https://t.co/hJMVhwpV23 Sidenote: noticed from the affiliations there that Huawei's Noah's Ark Lab (which does some AI stuff) has an office in Paris...smart. "A Deterministic and Generalized Framework for Unsupervised Learning w/ Restricted Boltzmann Machines," Tramel et al https://t.co/jFXT5KLLx3 "Improving the Performance of Fully Connected Neural Networks by Out-of-Place Matrix Transpose," Shi et al.: https://t.co/h9fI7ORSkU "Universal Semantic Parsing," Reddy et al.: https://t.co/4lVxoN6nIe "Soft tensegrity robots," Rieffel and Mouret: https://t.co/QRxbGUY0rE "Reconstruction for Feature Disentanglement in Pose-invariant Face Recognition," Peng et al.: https://t.co/bq20C3gprQ "Following the Leader and Fast Rates in Linear Prediction: Curved Constraint Sets+Other Regularities," Huang et al.: https://t.co/fvsLgpkGQd "Batch Renormalization: Towards Reducing Minibatch Dependence in Batch-Normalized Models," Sergey Ioffe: https://t.co/MKaqqC6RCR "Incremental Network Quantization: Towards Lossless CNNs with Low-Precision Weights," Zhou et al.: https://t.co/hglb1E7j0I "Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning," Elfwing et al.: https://t.co/r6ENE4ajuK "Multi-step Off-policy Learning Without Importance Sampling Ratios," Mahmood et al.: https://t.co/t6u8eJZLTE RT @goodfellow_ian: Improved SMT solver approach for showing there are no adversarial examples within specific regions: https://t.co/yMmXJO… RT @Thers: Camp David exists precisely because Mar a Lago shouldn't. https://t.co/9KZkxooiPp (this is the National Security Council staff) One of the saddest things I've read today... https://t.co/ebt8z2T99K https://t.co/nkea7gh267 @aprilaser want True of a lot of programming things, not just deep learning...but yeah. https://t.co/thSYXyCylr "RT @RikeFranke: Reports that Yemen's Houthis are manufacturing #drones. https://t.co/NzzZcuDsrL" @jeffbigham this workshop has lots of cool stuff - https://t.co/CILIXRaik7 but I don't have a big picture view on where it stands/is going.. Lots of stuff seems impressive, but dunno how much I should care about e.g. learning to sort, easy tier programming competition stuff, etc. Wanted: good qualitative explanation of the state of program induction - what sorts of programs/programming can/can't be learned RN and why? @mark_riedl that part makes more sense to me @mark_riedl I get that it's competitive, but still seems like it'd be less competitive w/ fewer going after them + some corp-funded slots..? @mark_riedl not clear on what the supply/demand refers to here. Candidates? Positions? @mark_riedl why would that not decrease competition over remaining faculty jobs? @jackclarkSF man, you're a good Bay Area promoter :) RT @jackclarkSF: Reminder: I shall be in London, UK, next week. Have time for some meetings on Friday the 17th. @davegershgorn I'm pretty familiar w/ AI safety and game theory but still not sure what the implications are. "More work needed" as usual :) This video, wow. Plus Trump celebrating him on Twitter. More evidence for the "Trump lies as loyalty test" theory. https://t.co/ZGKg4SqFKi @davegershgorn yeah coverage of this has been bad; paper is good but not that crazy of findings RT @ivan_bezdomny: NYC deep learning startup Dextro acquired by Taser--yes that Taser. Police surveillance does make business sense 👮🏻 http… RT @ColinKahl: Key fact @realDonaldTrump leaves out: 100% of these refugees already vetted. Takes 18-24 month process to get in. https://t.… RT @anneapplebaum: bizarre and embarrassing that Japanese PM feels has to play golf with the US president in order to keep US security umbr… RT @botminds: @Miles_Brundage @beaucronin Imagine a Libratus for politics only a few could first afford then legally access. That's the fut… P.S. Counting Heads (h/t @beaucronin) depicts this - common AI tools, rich buy more compute-->smarter assistants (forget abt data's role..?) @botminds seems to be a reason why both are hard to address (regardless of if solutions same or diff) @botminds I'm not sure that solutions to 1 and 2 are same but if so then one would need to reckon w/ role of hardware, that was main pt @botminds I agree! Very concerned about abuse of that power and accelerated wealth inequality @botminds has access to/ability to create top tier AI. I'm talking about the latter definition here. @botminds democratization of AI has been used to mean 2 opening its assumptions/decision making/ethics etc up to more voices, + 2. every1.. RT @rao2z: USA:China #aaai2017 : accept/subs (per Shaul Markovitch) USA:189.9/776.4 & China:172.4/785.4. Attendees: USA:964 & China:275… @sknthla @jackclarkSF risk pt=more fair now than few yrs ago. Escalated fast. Deep learning from crazy to easy way to make $ for mathy ppl. @sknthla @jackclarkSF I think a lot of ppl feel that way re: AI (or at least I do - charting it rather than settling it directly :) ) @jackclarkSF @sknthla moarrr *popcorn eating gif* RT @sarahjeong: Last chance to sign up for my travel ban litigation newsletter before I send out the first issue. https://t.co/bdPxp8A5Qh @mjrobbins @togelius @mark_riedl prob other stuff I'm forgetting, but overall haven't been super pleased w/ studies i've seen on this @mjrobbins @togelius @mark_riedl there isn't great data, but see e.g. https://t.co/JeGkiD6fMh off top of my head... RT @mark_riedl: Think of industry funding of basic research at universities as a tithe to the talent production pipeline that industry reli… RT @vkrakovna: Summer research internships in AI safety at UC Berkeley humancompatible.ai & @MIRIBerkeley - proposals due March 1! https://… @mjrobbins @mark_riedl @togelius lots of good stuff in both. But yes, diversity is good, high % not driven by profit = good. @mjrobbins @mark_riedl @togelius as @togelius notes though, lots of blue sky research in industry, + I'd add lots of narrow academic stuff, @mark_riedl @togelius or Q OpenAI, Google etc. should ask (re ideal model for supporting academia - they may need to step up in Trump world) @mark_riedl @togelius but not sure if>larger grants to cross-lab projects. Seems like Q NSF et al. should ask when not attacked by Trump :( @mark_riedl @togelius I'd certainly prefer that world (assuming designated for blue sky and/or socially beneficial) vs. military $dominance, @togelius @mark_riedl by default, project sizes in academia are often smaller... can be addressed w/ funding like accelerators @togelius @mark_riedl yeah, I think we're in agreement - academics def not incapable of it,just that in fact money *wasn't* earmarked for it @rbhar90 @mark_riedl /cross-university projects(addressing the economies of scale arg. for OpenAI etc.). Anyway not sure best way to compare @rbhar90 @mark_riedl yeah I think one might have a huge impact by e.g. funding a bunch of research engineers in academia @togelius @mark_riedl think it's plausible that academia is where marginal $ should go, while also saying current system inefficient..dunno @togelius @mark_riedl I'm pretty sure they *could,* question was if they *would* i.e. if silos in academia miss opp'ities for large projects @smc90 still long though so you get many points ;) anyway, enjoy! It's in my stack, too. @smc90 I'd be impressed by just finishing the DL textbook :) RT @Yale: Yale will rename Calhoun College for Grace Murray Hopper ’30 M.A., ’34 Ph.D. Deployed applications often take vastly fewer resources than research, and stuff gets more computationally efficient very quickly. Seems difficult to avoid at least gov'ts and companies + only a few academics having >>compute for research vs others, though also note: Putting case somewhat strongly but there's obviously some middle ground, e.g. cloud companies giving free/cheaper access to academics. Don't have super strong opinions on democratization of AI but seems like if one cares about it, can't ignore role of compute... OTOH perhaps Open Compute is just impossible in capitalism, so data + algos + tacit knowledge of how to get em to work = only winnable wars. Sometimes I feel like bc simulation, + compute-constrainedness of R+D, this might end up being fighting the last war https://t.co/u5FD1bvdHb @jeffbigham @mark_riedl https://t.co/5Ll38fs5kO ;) but yeah, it's a tricky question. @mark_riedl but compared to base rate, seems non-obvious to me that it's inefficient @mark_riedl perhaps some acad grants (e.g. distributed projects, interdisciplinary, etc.) more likely to get OpenAI-like economies of scale? @mark_riedl so 30*5-would 150 grad students have created Gym + Universe and published same quality-adjusted # of papers in less than a year? @mark_riedl I'm not sure bc econs of scale. Let's say salaries there 5x grad students. Now 45 ppl, but usually been smaller (let's say 30), RT @jengolbeck: YES GRACE HOPPER OG BADASS COMPUTER SCIENTIST I AM TYPING IN ALL CAPS BECAUSE THIS IS AWESOME! https://t.co/5N4BHjEGKx RT @fchollet: Time for an update: what does the deep learning library landscape look like, seen from GitHub? https://t.co/QDZyvLrYBd """Ethical Issues for Autonomous Trading Agents,"" Wellman+Rajan: https://t.co/Q8QYiH65Eg > risks w/ larger action space/more sophistication https://t.co/ruZiNsawcx" FAKE (lack of) CITATIONS. Sad! What's the deal w/ Google Scholar and books' citations? Know of at least 1 case where I'm cited but doesn't show up. B/c book not scanned? Bowling's reasoning was interesting - says 3+ poker v. different from 2 player, but in practice CFR works OK even w/o theoretical guarantees Re-recommending. BTW Bowling (good track record) predicts expert-level 3+ pkr w/in decade/Sandholm won't bet against https://t.co/HFThgCj8H0 Interesting paper. https://t.co/VKIYaBao1t Brought to you by Carl's Jr. https://t.co/KD1Susfnzv @axp1615 depends a lot on how you count it (synapses, lower level than that, etc.) but neuron to neuron, mammalian brains still bigger @_jyan_ did NIPS, thinking about ICLR cuz it's close but ICML is far @axp1615 a lot fewer still. I'd have to look at the data but something like 1000x, give or take 2 orders of magnitude? @ankurhandos btw did I miss you at OpenAI the other day? :( was only there for a bit @ankurhandos sounds great! @ankurhandos perhaps especially if it's a skeptical take :) like deep rl sample efficiency, remaining difficulties in real world vision etc @ankurhandos I'd be interested in your take on deep learning/robotics intersections and potential. (well, I haven't at least. I'd give it another 1-30 days) And we haven't even seen the first large-scale Universe results yet! RL^2, outrageously large NNs, neural architecture search with RL, various meta- things, etc... so much going on. Might have to go to ICLR :) The pace of innovation in deep learning+ (where + is memory/attention/evolution/RL, etc. and various combinations thereof) is pretty crazy. Finished reading the PathNet paper - very cool stuff! https://t.co/T2GvbeMhso Recommended. RT @MatthewGombolay: This is a big deal! Skin cancer is a deadly disease; many lives could be saved with early diagnosis via #AI. https://t… RT @nasrinmmm: An IranianAmerican in US files for patents 10 times more than others.Brain drain of Iran is what US has been getting https:/… RT @sydneyrachel: lol at anyone who thought a woman president would be too emotional https://t.co/KBQwAJELhK RT @hardmaru: Pixel Super Recursive Resolution is popular in Japan. Most comments about removing mosaic censor from Japanese Porn笑 https://… RT @brennawilliams: Abe's facial expression is 🔥 https://t.co/etYaiNH6vp @_jyan_ @hardmaru that's the right approach. :) I have like 10 papers including PathNet to read on this flight...clearing queue while I can! @RikeFranke thx! @RikeFranke which report is this? Followed soon after by ICML-pocalypse. Catch up on reading while you still can! 7 days until ICLR workshop paper-geddon. @jackclarkSF @hardmaru lucky me, I have a long flight shortly :) RT @catherineols: You can watch my 3-minute talk on @OpenAI Universe and "What's good to optimize?" here! https://t.co/CJ3rIjWBvG (thanks @… @GarrulousGeoff seems possible but underestimating more likely. Clinton's estimate would have been vastly more accurate. @GarrulousGeoff why would someone run if think it's harder than reality objectively huge rsponsibility)? thinking smarter person in world? RT @jbarro: Flynn could not be reached for comment because he was under a bus. https://t.co/SXOkAcgtiy @AnthroPunk indeed! next time for sure. @davegershgorn ask me again in a month ;) Great meeting @hardmaru - fun end to my Bay Area trip. Now I really need to finish reading the PathNet paper :) https://t.co/T2GvbeMhso Being POTUS is prob harder than anyone anticipates, to be fair. Novelty here = total ignorance of how US govt works. https://t.co/f0BpiRKruV RT @ericgeller: Uhhhhh https://t.co/TyqHnL9yID @AMP_SV fortunately, collective intelligence more determined by dialogue mechanisms/diversity than peak intelligence.More flailing hopefully RT @jonathanchait: I was curious how Trump heard of Lawfare. Well, he saw it on TV, of course. https://t.co/XSSpeAK7yd RT @benjaminwittes: He sure did https://t.co/IviO6zcKM7 RT @benjaminwittes: You decide whether the POTUS is quoting me in context. Here's the article. For the record, I support the decision: http… RT @benjaminwittes: #NotesFromUnderTrump, Day 22: So thanks, Mr. President, for endorsing my work. You've found the only sentence in it con… @_jyan_ yeah it's tricky. Running own workshop soon and there's no solution that everyone will be happy with @_jyan_ + by that measure we're making backwards progress bc no videos from first FLI conference ;) @_jyan_ after the first batch ("a week ago" on youtube is misleading - there have been fits and starts), maybe others posted soon @_jyan_ even if the comments aren't that inflammatory...+ encouragement of free flowing discussion. in any case, took a while for some vids @_jyan_ there are legit reasons for that IMO -some journalists will write inflammatory headlines about anything ppl at a certain company say It's The Book on AI evaluation. Rereading Hernandez-Orallo's The Measure of All Minds - super highly recommend it. @katjahofmann agrees apparently :) https://t.co/QMW6XsGtIH RT @nsfaber: Challenges view "only #humans have #TheoryOfMind": #apes anticipate that others will act according to false #beliefs https://t… @erfannoury also occasionally check homepages/twitter feeds of orgs/professors with research I'm interested in..again, not v coherent system @erfannoury prob some other heuristics I'm forgetting. def. not a perfect system, i don't read everything i want to, pretty noisy process @erfannoury to papers to my interests on Goog Scholar (AlphaGo, DQN, keyword deepmind), don't read/watch everything, do if others say good.. @erfannoury arxiv papers = 5x/week, see CS [new], neurons+cog, comput., ML, +disord. systems, non-arxiv=twitter, occasionally check cites "How Will Artificial Intelligence Affect Your Life?," Jeff Dean: https://t.co/moI6yoJQ98 "Defining Intelligence," hour long discussion w/ Stuart Russell: https://t.co/RWCq0NjbV5 Snowstorm = Open Review down = can't download paper :( weather slowing AI down by a few hours..or speeding by letting ppl catch up on papers @_jyan_ dunno, wasn't there :) in context that'd be a 50% chance in 20 years prediction + prob. otherwise caveated. Anyway, still watching @natselrox @m_sendhil btw I may have been thinking of Selman's slides on this schedule: https://t.co/tNlAsDrHwW @_jyan_ based on the schedule, the first three gave talks, the video is of the discussion. RT @dribnet: @Miles_Brundage This nature review made it sound worth reading. https://t.co/7dZtYH9UHG RT @dribnet: #pix2pix does pretty well on tiny datasets; this sketch to photo model was trained on only 185 pairs. https://t.co/VxwWbLbk3b @kennethpayne01 as in you've already read it and it's worth it? also @etzioni, @banavar, and some non-Twitter folks (Dragan, Schmidhuber, Bengio, Gruber) "Creating Human-level AI: How and When?," interesting panel discussion with @ylecun, @demishassabis, et al.: https://t.co/jVZk4f35M3 @natselrox interesting. If I recall correctly, Selman said some related things here, or elsewhere, about that https://t.co/L68pLDXPhs @natselrox I liked it too - hard to tell from the table of contents how much is new here, though. Many similar themes... Referring to: https://t.co/4ZkVv05n85 Anyone read/planning to read Dennett's new book? Curious if it's worth the time if you already are familiar with Dennettism. @AIroadmap @GoodAIdev CC @jackclarkSF Crazy how much more computationally efficient DeepStack is vs. Libratus (laptop vs. supercomputer). RT @mtyka: ArXiv: https://t.co/wqn685nCmI https://t.co/1KziAEOlSR "Joint Discovery of Object States and Manipulating Actions," Alayrac et al.: https://t.co/NqZtTcSV6E "Semi-Supervised Deep Learning for Monocular Depth Map Prediction," Kuznietsov et al.: https://t.co/9M3E1yQBvj "Character-level Deep Conflation for Business Data Analytics," Gan et al.: https://t.co/FIfJK5ApwZ "Convolutional Neural Network for Humor Recognition," Chen and Lee: https://t.co/0XkUWZVztG "Phase Transitions of the Typical Alg Complexity of the Random Sat. Prob Studied w Linear Programming," Schawe et al https://t.co/yO345NsJx3 "Neural Causal Regularization under the Independence of Mechanisms Assumption," Bahadori et al.: https://t.co/j3k4E1ZEXf "Coordinated Online Learning With Applications to Learning User Preferences," Hirnschall: https://t.co/eM2qnsDhi9 "CNN-based Estimation of Abdominal Circumference from Ultrasound images," Jang et al.: https://t.co/J9EApKxpsP "Minimax Lower Bounds for Ridge Combinations Including Neural Nets," Klusowski and Barron: https://t.co/gdLtcYENbW "Efficient Policy Learning," Athey and Wager: https://t.co/bV7rp8nWVH "Diversity of meso-scale architecture in human and non-human connectomes," Betzel et al.: https://t.co/VaK5Mb1hEY @Sam_B0t this is from the roundtable, dunno if the workshop talks were recorded. Michael Bowling gives the best talks btw. (Libratus/DeepStack talks, that is, not the whole poker workshop) Thanks so much to @ivan_bezdomny for recording the poker talks at #AAAI2017 - enjoy! https://t.co/6A2N3q0hFs RT @AIroadmap: We have just published another guest blog post “Unsolved Problems in AI” https://t.co/Y2klK5yYgE by @GoodAIdev "RT @cosmosquared: Evaluating General-Purpose AI workshop: https://t.co/j63MNVip1C held in conjunction with AGI-17 and IJCAI-17" RT @heyitscheet: I wrote a summary about what we learned at the end of #BrainsVsAi wrt how Libratus' was improving its strategy: https://t.… RT @Smerity: What the absolute frak? Python programming test at US Customs?!?! https://t.co/gWHYmwAM9I RT @juliagalef: https://t.co/iGvwfCs4jf @ivan_bezdomny and thanks for doing it and flagging! RT @ivan_bezdomny: Advances in Poker AI at #AAAI2017 -- Bowling & Sandolm m 8am https://t.co/ANoWdY20hQ @ivan_bezdomny awesome!! I'll check it out tonight. Turns out it was an easy D. https://t.co/WsyO9wjOqE @jackiefloyd very troubling situation in any scenario @jackiefloyd blocked from visiting by area (bc UK phone?). Anyway, no doubt Bannon has nefarious plans, and Trump thinks <1 tweet ahead @jackiefloyd i cant reach site. What is Trump link? On legal stuff, follow @sarahjeong @levendowski @rcalo @nancyleong I try to RT highlights but so much content RT @sarahjeong: Keep in mind that what the courts do aren't necessarily reflected in enforcement, or in enforcement of other policy https:/… @jackiefloyd he's not smart enough for that, mayyyybe Bannon.. "RT @jeremyscahill: Tears off bathrobe. Storms into Bannon's lair. ""Get Judge Judy on the phone."" https://t.co/sueCyGgyJ0" RT @J_Holla: Shouting "I'LL SEE YOU IN COURT!" after losing in court feels like a classic Gene Wilder bit in a Mel Brooks movie RT @sarahjeong: The executive power and national security exceptionalism that was built up during the Bush and Obama years is on Donald Tru… RT @sarahjeong: It's a complete mess over there. But guess what? The State of Washington etc still has to stay on its toes. RT @sarahjeong: There's no point in questioning what deep game is being played by WH counsel or DOJ, either. It's clearly just an avoidant… RT @JasonKander: Three branches was really a smart call by the founders. https://t.co/cxgrPJx1gu RT @jasonfurman: CEA delisted from Cabinet: the rank is not necessary nor sufficient for influence. But is a bad signal about POTUS's regar… RT @JoyAnnReid: .@CNN is reporting that at least one of the appeals court judges hearing Trump's travel ban case has needed extra security… RT @jordanzakarin: LIVE feed from the White House right now: https://t.co/cgzKuOrHU1 RT @morninggloria: "I'LL SEE YOU IN COURT!" is really the worst thing to yell after you just lost in court RT @JonathanTamari: The judges took him literally https://t.co/R40ofrm05T RT @vgr: You know you've got an Actually Evil™ President when the thought of a terror attack is less scary than thought of how he might exp… RT @ACLU: We have been saying this for a while. https://t.co/JFpVlTYUZm RT @sarahjeong: DOJ/Trump lost. Temporary restraining order still in place. Very early stages, long way to go https://t.co/TXEsEEubUX RT @GeorgeTakei: Mr. Trump, you--and minions like Kellyanne Conway--are violating the law by endorsing Ivanka's brand. You work for us, not… RT @AndrewKirell: "Go buy Ivanka's stuff!" Kellyanne Conway tells "Fox & Friends" viewers from the White House briefing room. https://t.co/… RT @AcademicsSay: I am currently out of the office but will nonetheless reply immediately due to self-regulation inefficiency & a profound… @mjrobbins @Smerity @davegershgorn spoiler: installation will be a pain. +1 would read @davegershgorn @Smerity yeah I think grokking diff terms (MDP, neural nets, RL, etc) mean +knowing qualitatively how they work goes long way @davegershgorn @mjrobbins I survived one iteration of it w/ no calc and bad programming skill @davegershgorn @mjrobbins Rao Kambhampati also has some intro courses which I think are neglected @davegershgorn @mjrobbins intro + applications chapter IIRC are both accessible @davegershgorn @mjrobbins maybe wrong MOOC? Norvig/Thrun if I recall is fairly accessible, no calc needed. @davegershgorn @mjrobbins seems like we have lots of good free resources - eg deep learning textbook much of which is accessible @davegershgorn @mjrobbins don't think that extreme needed. A MOOC or two goes a long way, can get through a few in a few weeks, hour a day.. RT @hugo_larochelle: @hugo_larochelle or checkout this video describing the work on 10 minutes: https://t.co/b6MQxntwIr RT @hugo_larochelle: Really cool work by Mark Woodward and Chelsea Finn on meta-learning with an active learning component: https://t.co/0C… RT @tdietterich: Correction: There were slightly more ACCEPTED papers with Chinese authors than Americans (for the first time) #aaai2017 RT @ankurhandos: ServoNets: Exploring Convolutional Networks for End-to-End Visual Servoing. Nice work. https://t.co/yjzXC9oLqj @beaucronin and/or what Frum said here - https://t.co/2yhutJR7cx @beaucronin as someone put it at dinner last night, GOP is making a Faustian bargain. Selling souls for immigration/? policy goals. SAD!!! RT @beaucronin: He's making unbriefed and uninformed comments to Putin about key nuclear arms treaties. How is anyone in the @GOP ok with t… RT @DeepMindAI: Understanding agent cooperation: Read our latest blog https://t.co/Whd5clyuX3 and paper https://t.co/XZeBeXgPs0 https://t.c… @MatthewGombolay @AndrewYNg there's at least this one, maybe another I'm unaware of https://t.co/EKIzxgzLUS RT @solotrader: Now, finally, someone can help Trump confirm that there were at least 250 millions people attending his inauguration. https… "What Do People Around the World Think About Killer Robots?," by @HMRoff https://t.co/ibN0UxPlTB @sknthla see also Wizards of Armageddon by Kaplan Enjoyed visiting @OpenAI earlier - thanks for the hospitality @jackclarkSF @catherineols @goodfellow_ian et al. :) @wbic16 the example you said sounds really hard, tasks prob. need to be more similar for now, but anyway, TF is more framework than an algo The machine learning community should stage an intervention for whoever makes the hand sensors on sinks/soap/paper towel dispensers so bad. @wbic16 of the things I mentioned, PathNet seems most related to that idea, check that out, maybe @_jyan_ @deliprao @tdietterich @devnag hopefully less ominous than the other great filter https://t.co/qxnmo6kxgC @deliprao @tdietterich @devnag the stuff I tweet is curated from 1 big category (CS)+4 sub-categories of other areas, so alas, still needed @wbic16 PathNet, neural architecture search w/ reinforcement learning... maybe related to what you're thinking of, maybe not @wbic16 metalearning is being actively studied, not sure exactly what u mean by second part. see e.g. learning to reinforcement learn, "Transfer from Multiple Linear Predictive State Representations (PSR)," Sekharan et al.: https://t.co/CmuhQYYrq1 "Question Answering through Transfer Learning from Large Fine-grained Supervision Data," Min et al.: https://t.co/951tgetD8j "Preparing for the Unknown: Learning a Universal Policy with Online System Identification," Yu et al.: https://t.co/SJyJe8b4jz "Region Ensemble Network: Improving Convolutional Network for Hand Pose Estimation," Guo et al.: https://t.co/soguNiv9FZ "Trainable Greedy Decoding for Neural Machine Translation," Gu et al.: https://t.co/NBOuJ3WQ5b "Data Selection Strategies for Multi-Domain Sentiment Analysis," Ruder et al.: https://t.co/QnFxsZ537Q "A Hybrid Convolutional Variational Autoencoder for Text Generation," Semeniuta et al.: https://t.co/Xf2lMtk47g "An Adversarial Regularisation for Semi-Supervised Training of Structured Output Neural Networks," Kozinski et al.: https://t.co/ewXxUurDpJ "Iterative Multi-document Neural Attention for Multiple Answer Prediction," Greco et al.: https://t.co/ahYAF7SSqu "Multi-scale Convolutional Neural Networks for Crowd Counting," Zeng et al.: https://t.co/cP86uRwrSf "Autonomous Braking System via Deep Reinforcement Learning," Chae et al.: https://t.co/4t5mO0XpLA "Guided Optical Flow Learning," Zhu et al.: https://t.co/EkprVNKQW8 "Neural Machine Translation with Source-Side Latent Graph Parsing," Hashimoto and Tsuruoka: https://t.co/T3XrSgZlut "Video Frame Synthesis using Deep Voxel Flow," Liu et al.: https://t.co/vht74kNqQ1 "Backpropagation Training for Fisher Vectors within Neural Networks," Wieschollek et al.: https://t.co/wKKVPIDDq0 "Exploiting Domain Knowledge via Grouped Weight Sharing with Application to Text Categorization," Zhang et al.: https://t.co/TSQ2AIW9dx """Song From PI: A Musically Plausible Network for Pop Music Generation,"" Chu et al.: https://t.co/dBveuGPtch Demos: https://t.co/3JTBm9Mg2B" "Semi-Supervised QA with Generative Domain-Adaptive Nets," Yang et al.: https://t.co/1T9G3vD0uT "Who Will Win Practical Artificial Intelligence? AI Engineerings in China," Wu et al.: https://t.co/Kp2so0v6Tl "Deep Kernelized Autoencoders," Kampffmeyer et al.: https://t.co/UXdRWc1obm "Deep Generalized Canonical Correlation Analysis," Benton et al.: https://t.co/bjCdUSpNvG "Automatic Rule Extraction from Long Short Term Memory Networks," Murdoch + Szlam: https://t.co/zh1dMacCPc """Adversarial Attacks on Neural Network Policies,"" Huang et al.: https://t.co/sbqMazCvQw Videos: https://t.co/VB6PMmbYk3" "Deep Learning with Dynamic Computation Graphs," Looks et al.: https://t.co/sRB4yI19Zy "Analyzing Human+Computer Groups Using a Technique Developed to Measure Consciousness," Engel/Malone: https://t.co/oQ5oVom7Aq "AMIGOS: A dataset for Mood, personality and affect research on Individuals and GrOupS," Miranda-Correa et al.: https://t.co/SyCTGuLxEy RT @devnag: @Miles_Brundage I can't tell whether you're Sisyphus rolling the rock forever or Hercules cutting off self-regenerating heads f… "Me: I'm tired. arXiv: Too bad." RT @NicolasPapernot: Just added a tutorial on black-box attacks (from https://t.co/Fz3xKXKZbX) to cleverhans, you can find it here: https:… @hardmaru works for me? https://t.co/4Dlw0A6DaS RT @ericgeller: So-called jobs https://t.co/BUqSU14rnP RT @BillWeirCNN: According to White House schedule, this tweet was sent 20 minutes into his daily intelligence briefing. https://t.co/BoilJ… RT @goodfellow_ian: Adversarial examples for RL: https://t.co/K1tOyaXmAy RT @pescami: At once breathtakingly inappropriate and completely unsurprising. Like when the suburban owners of a chimp are shocked by the… "RT @TheRickWilson: This is a President. Punishing a private company. For not keeping his daughter's clothing line. Not a whacked out aut…" @FlorinGogianu I think there was a camera but not sure if/where/when it'll be posted... :/ sorry @cyberony not yet :) RT @pt: His transition to VC is nearly complete. https://t.co/tFD3xwWmsJ And the sequel: https://t.co/V99fnWzJCE https://t.co/E2cHtACLeg RT @ericjang11: What's Missing in Human-Level AI by Yoshua Bengio https://t.co/tP86ppgxTN "Gated Multimodal Units for Information Fusion," Arevalo et al.: https://t.co/hTX8DkVDIR "An Implementation of Faster RCNN with Study for Region Sampling," Chen and Gupta: https://t.co/NNWjGnamJg "First Study on Data Readiness Level," Guan et al.: https://t.co/L4KuLHZagU "Fast and Accurate Sequence Labeling with Iterated Dilated Convolutions," Strubell et al.: https://t.co/2xDptsbknJ "Adaptive Neural Control for a Class of Stochastic Nonlin. Systems w Unknown Params [etc., long title]": Chena et al https://t.co/kRQQlpxHRG "Knowledge Adaptation: Teaching to Adapt," Ruder et al.: https://t.co/vwkvkvo37y "Preference-based Teaching," Gao et al.: https://t.co/k0yVciIc5c "Face Aging With Conditional Generative Adversarial Networks," Antipov et al.: https://t.co/8hpDQBeRWl "Representations of language in a model of visually grounded speech signal," @gchrupala et al.: https://t.co/GYAU00Tat1 "A Knowledge-Grounded Neural Conversation Model," Ghazvininejad et al.: https://t.co/AfOnrL7JYC "Comparative Study of CNN and RNN for Natural Language Processing," Yin et al.: https://t.co/KwC3YWlE8Y "The Effect of Different Writing Tasks on Linguistic Style: A Case Study of the ROC Story Cloze Task"-Schwartz et al https://t.co/Zmot7Gq2ue "Neural Discourse Structure for Text Categorization," Li and Smith: https://t.co/kEKJNICKWo "Living a discrete life in a continuous world: Reference with distributed representations," Boleda et al.: https://t.co/s4IGM3FZZy "Beam Search Strategies for Neural Machine Translation," Freitag + Al-Onaizan: https://t.co/TizIkUcGtH "Ensemble Distillation for Neural Machine Translation," Freitag et al.: https://t.co/YD1iLdEHoQ "Rare Nash Equilibria and the Price of Anarchy in Large Static Games," Lacker and Ramanan: https://t.co/fFXmSncLGn "Truncated Variational EM for Semi-Supervised Neural Simpletrons," Forster and Lucke: https://t.co/SQG0DqO7K8 "Learning what matters - Sampling interesting patterns," Dzyuba and van Leeuwen: https://t.co/bqEFdBDe86 "An Integrated Simulator and Dataset that Combines Grasping and Vision for Deep Learning," Veres et al.: https://t.co/NGFDEGTtRr "Prediction of Kidney Function from Biopsy Images Using Convolutional Neural Networks," Ledbetter et al.: https://t.co/3VcJavvvyL "Learning similarity preserving representations with neural similarity encoders," Horn and Muller: https://t.co/8KVcZ2j6aP @goodfellow_ian @1910roz + what he said ;) @1910roz @goodfellow_ian Ian I've found first few chapters accessible, + much relevant math is introduced, but dunno - see website to sample @rbhar90 curious how you found it so fast :) do you know them? I would have tweeted after seeing FHI staff email from Owain but you beat me! RT @SmithaMilli: WELP this immediately got me back to work https://t.co/OMQYxCK1LR thanks @avisingh599 My copy of @goodfellow_ian et al.'s textbook :) The bidding starts at $10,000,000... https://t.co/yWhYbUtuCR RT @rbhar90: By Jacob Steinhardt and Owain Evans RT @rbhar90: Great blog post on current limitations of inverse reinforcement learning as method for understanding human values https://t.co… OK, fine, the Bay area is prett my great... RT @Fahrenthold: A day ago, Melania Trump had said in a lawsuit that she had planned to use fame as FLOTUS to sell clothes and fragrances.… RT @benjaminwittes: Read this scorching piece by former FBI terrorism analyst @NoraEllingsen on the actual data about US plots: https://t.c… Dayan on the evidence for TD learning in macaques and humans #AAAI2017 https://t.co/8qezri9p02 RT @ChiefScientist: Peter Dayan's giving an invited talk on the "Consilience of Artificial and Natural Reinforcement Learning" at #AAAI2017… RT @sarahjeong: Both Tribe and Vladeck are predicting a 2-1, let's see. It's been a bad year for predictions! Also, quick reminder that BSG is awesome (*cough* @davegershgorn). Tireless, indeed - my mind was blown when I looked at author flap on an old BSG novel one time, and it was him! https://t.co/0eQOgLRZrU RT @io9: RIP Richard Hatch, the original Apollo and a tireless Battlestar Galactica advocate https://t.co/kCuTlvISue https://t.co/hlz8pjthFq @levendowski thanks for the tips! Live footage from the #9thcircuit court... https://t.co/6Zvog2wbvB RT @karpathy: arxiv-sanity is now migrated & has new feature: sort by hype :p - shows papers that got most tweets over last 5 days https://… RT @RonDMoore: Richard Hatch was a good man, a gracious man, and a consummate professional. His passing is a heavy blow to the entire BSG… Congrats to the winners of the ICLR 2017 Hunger Games! Some great stuff. https://t.co/6mmXN340b3 RT @HansRosling: Hans' son @OlaRosling writing: Hans sadly died today! But his dream of a fact-based worldview, we will never let die! Foll… RT @deray: It is absurd that DeVos was just confirmed as the Secretary of Education. Each of the Republicans who voted for her should be as… "RT @aschrock: Reviewer 2: This method section seems dubious. Me: I call my own shots, largely based on an accumulation of data, and every…" RT @sapinker: Tremendously sad to learn of the death of Hans Rosling: great humanitarian, scientist, hero. https://t.co/WtgX3MRAvz Also seems to me like he reads Jason Brennan (esp Against Democracy) or I still don't understand the hobbits remark. https://t.co/Y8Fr8NBVDC RT @RealGDT: Stumbled upon this. No credit visible. https://t.co/2qnVd4hqe1 "Me: I should retweet this so others know. Also me: But I want a copy and they might run out. Also me: *action bias* https://t.co/Yg53hQEPzT" Longish read from Paul Christiano - "Directions and desiderata for AI control": https://t.co/aJfPqApTsy @ArtirKel guilty... RT @jackclarkSF: AI help request: best Switchboard SWB WER scores in 2012 and 2011? Drawing a blank Fin. "Sensing and Model Human Behavior Using Social Media and Mobile Data," Mehrotra and Musolesi: https://t.co/3GcWP1b5tn "Syntax-aware Neural Machine Translation Using CCG," Nadejde et al.: https://t.co/Fr5nlR6JE3 "Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks," Katz et al.: https://t.co/BrNsvbaLM5 "A Survey of Advances in Botnet Technologies," Nathan Goodman: https://t.co/QO2kjhVuND "Latent Hinge-Minimax Risk Minimization for Inference from a Small Number of Training Samples,"Raviv + Osadchy: https://t.co/jewr8esPBP "Doubly-Attentive Decoder for Multi-modal Neural Machine Translation," Calixto et al.: https://t.co/r5tyAYEAQm "Wide-Residual-Inception Networks for Real-time Object Detection," Lee et al.: https://t.co/wERaHrWbXr "Calibrating Energy-based Generative Adversarial Networks," Dai et al.: https://t.co/S35rZdFLjq "Concurrent Activity Recognition with Multimodal CNN-LSTM Structure," Li et al.: https://t.co/97y5PfstDn "Neural Semantic Parsing over Multiple Knowledge-bases," Herzig and Berant: https://t.co/kJQDXjnGVl "Opinion Recommendation using Neural Memory Model," Wang and Zhang: https://t.co/KJiwooPqYu "Designing Deep Convolutional Neural Networks for Continuous Object Orientation Estimation," Hara et al.: https://t.co/ZuMNtJLgKn """Attentional Network for Visual Object Detection,"" Hara et al.: https://t.co/4K286RNSTp" Possible best practice for technical videos involving drones: taper in the audio when going to drone footage. Sudden drone whine = jarring. """Uncertainty-Aware Reinforcement Learning for Collision Avoidance,"" Kahn et al.: https://t.co/FdQvXCmx2B Vid: https://t.co/HgcKw77L3d" "Query Efficient Posterior Estimation in Scientific Experiments via Bayesian Active Learning," Kandasamy et al.: https://t.co/kTvhv4BQci "Energy Prediction using Spatiotemporal Pattern Networks," Jiang et al.: https://t.co/iYxXiLP0ms "Search Intelligence: Deep Learning For Dominant Category Prediction," Malik et al., eBay: https://t.co/gp4qe3kJ0j "Learning of state-space models w/ highly informative observations: a tempered Sequential MC sol'n," Svensson et al https://t.co/Ep36l2L9gs "All-but-the-Top: Simple and Effective Postprocessing for Word Representations," Mu et al.: https://t.co/Rkkpy0AItI "Simple to Complex Cross-modal Learning to Rank," Luo et al.: https://t.co/LClEG6HGy1 "Towards Better Analysis of Machine Learning Models: A Visual Analytics Perspective," Liu et al.: https://t.co/eO8XizY9t0 "Interpretation of Correlated Neural Variability from Models of Feed-Fwd +Recurrent Circuits," Pernice+da Silveira: https://t.co/J7BKeZSu0r RT @karpathy: YouTube-BB dataset: 10.5M inst of 23 classes https://t.co/DWlpMw1Gke great but what's with the fascination with toilets and g… RT @TrumpDraws: harry potter https://t.co/rAlOc63MS1 @jeffbigham make Trump's tweets grate again RT @maggieNYT: This still didn't happen https://t.co/NabbBcgmVf @ivan_bezdomny that would be awesome!! @AMP_SV unlike a lot of ppl at AAAI! Marked difference in demographics vs ML conferences. CC @ivan_bezdomny Very sad to possibly miss the reprise of the Libratus/DeepStack presentations on Thursday... Pls pls pls someone live tweet/videotape it :) Pretty stoked about Peter Dayan's talk tomorrow, dunno about y'all. @kr_t appropriate filter! :) Common thread btwn expert systems and AI today - need for transparency/explainability. "Where were you all 40 years ago"? #AAAI2017 @tdietterich @lidija_sekaric mentioned this, too.. any in particular that are open to such applications? @tdietterich (except grid balancing stuff, cloud forecasting...but would like to see more, e.g. materials R+D + installation automation) @tdietterich good pt, scope def. broad but seems like there's room for a lot more to happen within its scope. I don't see much on e.g. solar Parker mentions computational sustainability as NSF priority...enough, tho? what about clean energy, poverty, mental health etc. #AAAI17 @rao2z: always been AI 4 social good, but not as sexy as e.g. solving games - how to incentivize? #AAAI2017 RT @hayesbh: Finding lots of talks this #AAAI17 being given by non-authors because of surprise visa issues. Very negative signal for US con… @iandanforth shockingly i think it was pretty normal @tdietterich yeah, I'm thinking scientifically unoriginal but impt applications falling through cracks w/o (non-NSF?) agency stepping up... @erichorvitz: Sounds great to have ppl working on social probs+AI ppl get together, but ppl are busy, who compensates them for time? @lidija_sekaric ...and OpenAI is non-profit. But most research seems to be gov't basic research, ad hoc health application govt, + industry. @lidija_sekaric there's some philanthropic investment, e.g. Allen Institute for AI, focused on general research + helping scientists ATM... (NSF not only relevant agency, but I think this is generally true - social good-related oppo'ties are only available on ad hoc agency basis) ...understandable given NSF funding scarcity but not good if social good opportunities untapped b/c unprofitable or not revolutionary. SAD! Lynne Parker at #AAAI17 panel on AI for social good - need to pitch NSF grants on such things as also solving scientific problem... RT @MelissaRyan: TBH I hated the "President Bannon" frame but now that I know it gets under Trump's skin I'm all about it. https://t.co/mdu… @jeffbigham hence the wink! :) Panel soon on expert systems history at #AAAI17. Those who don't know history will...maybe be OK b/c deep learning works well, we'll see ;-) @gosainnn sounds good! @gosainnn sure! maybe next coffee break? @starsandrobots in this case they wanted to talk to Norvig ;) @aireye this time he wasn't! Or I am incredibly unobservant. @AMP_SV lol. I have a knack for randomly standing behind important AI people waiting in line to get coffee... Norvig this time. RT @nancyayoussef: Overheard at the Pentagon, RE: Trump speech at CENTCOM: "What are we supposed to do with that?" Bannon probably helped with the part about accumulation of data. https://t.co/VFLVxpLu2w RT @hardmaru: PathNet: A Modular Deep Learning Architecture for AGI. Nice summary of our paper by @IntuitMachine via @chrisantha_f https://… RT @AGOWA: Bipartisan NatSec officials to court: “In our professional opinion, the Order was ill-conceived, poorly implemented and ill-expl… https://t.co/pqrAiFQPgX https://t.co/J6EgHRHeD1 @Aelkus awesome. @hardmaru indeed. "A method of limiting performance loss of CNNs in noisy environments," Geraci and Kapoor: https://t.co/289dfxsbLd "FCSS: Fully Convolutional Self-Similarity for Dense Semantic Correspondence," Kim et al.: https://t.co/uEO1iEieVh "HoloClean: Holistic Data Repairs with Probabilistic Inference," Rekatsinas et al.: https://t.co/TRrN5SZoyc "The Value of Inferring the Internal State of Traffic Participants for Autonomous Freeway Driving," Sunberg et al.: https://t.co/QAYD3CFlr3 "Topic Modeling the Hàn diăn Ancient Classics," Allen et al.: https://t.co/DiIaAr1lh3 RT @rbhar90: Really impressed with Facebook's Tamil language support. A couple grammatical errors in labels, but great progress overall! Hope she's right bc some important proposals for investment in there inc. AI safety and AI for social good I'd note we don't even have science advisor nominee and OSTP website nonexistent right now tho, and impact of such strat plans is not clear Lynne Parker talking about nat'l AI R&D strat plan at #AAAI2017, thinks relevant even w/ new admin bc multiple (extant) agencies bought in https://t.co/0d6lblkvmV "Joint 2D-3D-Semantic Data for Indoor Scene Understanding," Armeni and Sax et al.: https://t.co/gylF81voeQ "Deep Learning with Low Precision by Half-wave Gaussian Quantization," Cai et al.: https://t.co/Rhf30GQH2g "Structured Attention Networks," Kim and Denton et al.: https://t.co/Yu9jzPjhG0 (must be what the people outside in SF were screaming about) "YouTube-BoundingBoxes: A Large High-Precision Human-Annotated Data Set for Object Detection in Video," Real et al.: https://t.co/mwJxmCtY9g TFW you don't know if ppl outside are screaming because of amazing AI results at AAAI, a terrorist attack, or sportsball. Prob. sportsball. (retweeting b/c even more plausible now. Maybe the Time article on this reminded them and they'll cobble it together soon, who knows) RT @Miles_Brundage: Looks increasingly plausible that Trump et al. forgot to, or won't, nominate science advisor, journos too focused on bi… @justinhendrix I never thought it was a joke... but that article doesn't comment on that (?), wrong link? @ivan_bezdomny fascinating result. Did it win the competition this year? @ivan_bezdomny does that mean it'd win against 85% of all hands they may have, assuming equal probability for each? or something else? RT @BilgeEbiri: It's not that any ads are attacking Trump. It's that Trump is so outside all norms of decency that basic, bland sentiments… RT @hayesbh: Tutorial on Interactive Machine Learning: From classifiers to robotics -- Happening now in Continental 1-3, come drop by! #AAA… RT @brianklaas: This is crazy. The judge is doing his job & vetting systems are still in place. Visas aren't given out like candy. https://… RT @dandrezner: I remember a time when it was paranoid to suspect that elements of Trump's White House wanted a terrorist attack. https://t… Totally normal and fine. https://t.co/xtFr2lAS30 "RT @nerdherdempire: Anyone able to reproduce the ResNeXt paper? I still haven't gotten anything close to the claim : / @Miles_Brundage any…" See @ivan_bezdomny's feed for comments on the poker workshop at AAAI, including Libratus stuff. @mark_riedl @davegershgorn @jerrytmcl If metric=frequency of SOTA on widely recognized benchmarks, or general thought leadership, def behind @mark_riedl @davegershgorn @jerrytmcl yeah, "arms race" language (besides being dangerous) is vague. Easy to copy, China is good at this. @davegershgorn @jerrytmcl not impossible - there are benchmarks - just >1. By my lights, still behind w.r.t. frequency of SOTA results @davegershgorn @jerrytmcl yeah generous govt support helps. think academia there/average quality still weaker but hard to evaluate per Dave @ivan_bezdomny missed yesterday but im here today :) in AI in Practice RT @AndrewYNg: AI opportunities >> AI talent availability. So teams are getting very disciplined in selecting highest impact projects. RT @JustinWolfers: Amazing diversity as Trump's senior staff is sworn in: White men of many heights, tie colors https://t.co/bE61gSQ81B htt… RT @thehill: Information on animal welfare vanishes from USDA website https://t.co/ThFLNYhpGk https://t.co/4kvxlezIf3 RT @mgubrud: Does @nytimes intend this as arms race promotion and threat inflation, or just clickbait? (@Markoff & @AllMattNYT story does n… @catehall The Expanse On the bright side, might be better for Bannon to use mediocre company to do evil things vs. more competent company. https://t.co/YuPYJwAJ5F RT @BrendanNyhan: The question every American should ask themselves: "If he's acting like this now, what would he do in a crisis?" It's onl… @AMP_SV (then he's banned from FB and turns to Instagram) @AMP_SV Facebook. RT @APerzanowski: Next Trump press conference should be nothing but questions taken directly from naturalization test. RT @BuzzFeed: Trump posted a false news report to his Facebook page and got thousands of shares https://t.co/H6UvmSz7C0 https://t.co/AGCEkg… RT @RyanLizza: In 1 tweet Trump contradicts his spokesman, shows lack of basic knowledge about our constitutional structure, and misstates… RT @etzioni: Difficult to get hard data on this topic... https://t.co/wIHdSOruv9 RT @brianklaas: Reminder: a trade war would be a huge drag on the US economy and hit working class consumers (Trump's base) hardest. https:… RT @stephenWalt: Trump said US foreign policy was "a complete and total disaster." Took 2 weeks for him to prove he's worse. https://t.co… RT @Alyssa_Milano: Those that tell me not to tweet politics because I'm an uninformed celebrity are the same people that voted for... an un… Via https://t.co/xdn913XZlr (h/t @MrMeritology) https://t.co/3Jv6is72CA RT @xor: Critics charge that Trump is looting the country to enrich his friends. Trump counters that he's looting the country to enrich his… I can't. https://t.co/KDzZ3zf66w RT @nathansttt: We have an amazing line up of organizations looking for AI expertise at the #AAAI17 job fair coming up in SF: https://t.co/… RT @RVAwonk: More context -> "Secret Service agents are required to report any illegalities they witness. Trump's private security members… "RT @jessesingal: Obama: Let's give ppl healthcare Cons: GTFO w/ur radicalism Bannon: I literally wanna destroy the fuckin world Cons: LO…" Early results but they seem extremely promising - nice work @marwinsegler et al. https://t.co/yd7V0hEkjS RT @pwnallthethings: Tweet, followed by second paragraph of the article it cites https://t.co/LVWEsiYUQX RT @intifada: Email from 2007 ties Trump adviser Stephen Miller to neo-Nazi Richard Spencer https://t.co/6Q6ZzHJBAX https://t.co/22BnnuVpdA RT @tomphillipsin: China Daily does @realDonaldTrump's #MuslimBan https://t.co/sLMb3IaEcg RT @nelsonoregon: horrific images of the #bowlinggreenmassacre https://t.co/Ybh45dIvYQ RT @KagroX: Where were you the day it didn't happen? #NeverRemember #BowlingGreenMassacre RT @BrendanNyhan: https://t.co/PljPCKUqCR RT @BrendanNyhan: Gaslighting alert (2 refugees in BG who had attacked US troops in Iraq charged but no attacks here https://t.co/hiHr8cR8A… "GANs recover features in astrophysical images of galaxies beyond the deconvolution limit," Schawinski et al.: https://t.co/thb1EcgWxU "Procedural Content Generation via Machine Learning (PCGML)," Summerville et al.: https://t.co/2FUGngtzNh "Learning to Compose with Professional Photographs on the Web," Chen et al.: https://t.co/1EqQhYPGnq "Recovering True Classifier Performance in Positive-Unlabeled Learning," Jain et al.: https://t.co/ynXEglijQ3 "Electron-Proton Dynamics in Deep Learning," Zhang et al.: https://t.co/HGYUKJbADi "HashNet: Deep Learning to Hash by Continuation," Cao et al.: https://t.co/U6oBtcaVMR "Symbolic, Distributed + Distributional Reps. for NLP in the Era of Deep Learning: a Survey," Ferrone/Zanzotto: https://t.co/RgTLGQVNAu "Pixel Recursive Super Resolution," Dahl et al., Google Brain: https://t.co/ShtpF9c0hH RT @KyleCranmer: New paper: #deeplearning models that use an NLP analogy to incorporate prior physics knowledge. @glouppe @kchonyc https://… RT @elonmusk: Regarding the meeting at the White House: https://t.co/8b1XH4oW6h RT @ColinKahl: Trump says he wants to beat China. The tension with Australia needlessly does the opposite. https://t.co/K64wLaoeop "RT @RikeFranke: Wow. That was fast. US no longer seen as trustworthy partner by German public. @brianklaas Via @tagesschau https://t.co/1…" RT @blakehounshell: Trump’s choice of deputy CIA director oversaw a black site prison in Thailand https://t.co/k1AiQzM1x9 RT @MatthewBevan: Australia's papers today @RNBreakfast https://t.co/ddrqJ1VA5P RT @AugstMcLaughlin: ACTION ALERT: The Senate Committee on Homeland Security is taking calls about Bannon's appointment to the NSC. You can… @Miles_Brundage @Sally_Adee currently there's only state level mechanisms for direct votes on policy. @Sally_Adee there's just no mechanism. People have proposed such stuff but requires Const amendment which in turn requires statelevel action @Sally_Adee no, can't do that. Best case is impeach --> Pence is president (and so on). RT @nathansttt: We will be streaming the #AAAI17 workshop on AI and games: https://t.co/xe84mT4Me7 The schedule is here: https://t.co/RFYJE… RT @paulkrugman: Not trivial. Trump trying to bully business into being cheerleaders; making a Trump association poison blocks this https:/… RT @brhodes: Everything Trump says here is false. Iran was not collapsing. Deal is with 6 countries. Iran did not get 150 billion. https://… RT @Schwarzenegger: The National Prayer Breakfast? https://t.co/KYUqEZbJIE RT @ColinKahl: Team Trump claim that Obama cleared Yemen raid false;was deferred to Trump so he could run a deliberate process. Instead, he… RT @LeverhulmeCFI: Based at CFI Cambridge our 5th postdoc position is now live for applications https://t.co/eEbblWZQT7 #postdoc #policy #R… RT @nasrinmmm: Reporting from Mt. Hope cemetery in @rochester ... https://t.co/SjhqPcoEAg RT @fchollet: The Chainer folks have trained a convnet for auto-coloring line art. https://t.co/f0oNhFbvDP It's a fun idea! https://t.co/cE… RT @kr_t: The workshop features exciting talks by @rao2z, Karen Myers, @caknoblock, Milind Tambe, @frossi_t, and @murraycampbell. And panel… "RT @kr_t: Very excited about running the Human-Aware AI workshop at #AAAI17 in a couple of days: https://t.co/FQqt05y0nh Do stop by! @miles…" RT @dave_brown24: Trump is complaining about Arnold's ratings on "The Apprentice" at the National Prayer Breakfast. RT @pattonoswalt: Can't believe Trump just flushed our relationship with Australia counterclockwise down the toilet. RT @blakehounshell: Oh https://t.co/Id6Qr8Zsag @MattLevinson definitely a milestone, I wouldn't single out bluffing though (bots bluffed okay b4 -even optimally in case of limit heads up) RT @djrothkopf: Buzz out of members of Trump admin says Australia, Mexico phone calls not the worst or most shocking examples of POTUS' fle… RT @RiegerReport: You spelled “refugees” wrong. https://t.co/8l8vJB8RAa RT @BFriedmanDC: On September 26, 2016, Donald Trump literally said Hillary Clinton "doesn't have the stamina" to be President https://t.co… RT @tedlieu: Dear Australia: The majority of Americans who don't support Trump want to say we are sorry. We will make it up to you in 4 yea… RT @azalben: We're threatening Mexico, insulting Australia, and antagonizing multiple other countries, but Russia attacks Ukraine and ¯\_(ツ… "On orthogonality and learning recurrent networks with long term dependencies," Vorontsov et al.: https://t.co/6BJT4BBC7A "Towards "AlphaChem": Chemical Synthesis Planning with Tree Search and Deep NN Policies," @marwinsegler et al.: https://t.co/hXUXtlOgUP "Design, Analysis and Application of A Volumetric Convolutional Neural Network," Pan et al.: https://t.co/XqrHERaCvH "Blue Sky Ideas in AI Education from the EAAI 2017 New and Future AI Educator Program," Eaton et al.: https://t.co/oOfft7jeGX "Visual Saliency Prediction Using a Mixture of Deep Neural Networks," Dodge and Karam: https://t.co/xDIJoVh5Xq "On SGD's Failure in Practice: Characterizing and Overcoming Stalling," Vivak Patel: https://t.co/IUpVSHaC0W "PCA-Initialized Deep Neural Networks Applied To Document Image Analysis," Seuret et al.: https://t.co/ji0qGtkzgZ RT @HeerJeet: Mexico is America's 3rd largest trading partner. https://t.co/zcACkIXNVL RT @NandoDF: This paper is a breakthrough!Dawn Song and her team have shown that recursion is the key to true generalisation. https://t.co/… @jackclarkSF @hardmaru @dennybritz but the TARDIS acronym wouldn't work as well without it :) RT @tedlieu: My prediction: Tomorrow @realDonaldTrump doubles down & orders an investigation into whether Frederick Douglass is alive. #alt… RT @fchollet: Recent trend: abstracting complex physical models into much simpler neural nets that require far less computation. https://t.… @davegershgorn SAD! RT @histoftech: Been called "Ms. Hicks" by 2 students this week already. Guess I need to get bigger glasses or less blonde hair. Or you kno… RT @rbhar90: All talks from workshop up online now at https://t.co/xeUTYSnkso RT @rbhar90: Video of me giving a talk on DeepChem at our recent deep chemistry workshop https://t.co/BefGLdhSum "RT @deanpomerleau: The Fake News Challenge is officially launched. BAM - take that fake news! Details @ https://t.co/ZSkDqYNgxl & ↓ htt…" RT @TrumpDraws: train https://t.co/D7e3Wpwxd0 RT @Jackstilgoe: New one from me and @2020science https://t.co/5WdIYZqGMM RT @TrumpDraws: kat https://t.co/ra55wo0ulW RT @TrumpDraws: house https://t.co/AHAjqMazJ4 Overdue... next up, if Trump does crazy nuke-related things: A Canticle for Leibowitz? https://t.co/dYsODxJI80 RT @rulajebreal: In #US Holocaust Museum. https://t.co/FaehfjnH90 RT @chapmanchapman: The est. security cost for Melania living 200mi away from Trump is double the annual budget for the National Endowment… "Spatial Projection of Multiple Climate Variables using Hierarchical Multitask Learning," Gonçalves et al.: https://t.co/2o0RNDkxCN "Towards Adversarial Retinal Image Synthesis," Costa et al.: https://t.co/UHG8FTRmhU "Algorithm selection of off-policy reinforcement learning algorithm," Romain and Raphael: https://t.co/BB9NG4Yi2B "On the Semantics and Complexity of Probabilistic Logic Programs," Cozman and Mauá: https://t.co/I9l7KG8WCZ "Socio-Affective Agents as Models of Human Behaviour in the Networked Prisoner's Dilemma," Jung and Hoey: https://t.co/z3KUyRypph "DeepNav: Learning to Navigate Large Cities," Brahmbhatt and Hays: https://t.co/HBvdcDcTik "Deep Stochastic Radar Models," Wheeler et al.: https://t.co/8s0bEd6PRr "Deep Reinforcement Learning for Visual Object Tracking in Videos," Zhang et al.: https://t.co/mWQFHeGn4d "Deep Submodular Functions," Bilmes and Bai: https://t.co/mD00IWfFAt Cf. some commentary on it by Hansen: https://t.co/Lz9akUlXNV "CommAI: Evaluating the first steps towards a useful general AI," Baroni et al., Facebook: https://t.co/Yrf3n9m6qb "Mixed Low-precision Deep Learning Inference using Dynamic Fixed Point," Mellempudi et al.: https://t.co/cW949xKFGK "Deep Multitask Architecture for Integrated 2D and 3D Human Sensing," Popa et al.: https://t.co/EAZHBSm1KF "Emergence of Selective Invariance in Hierarchical Feed Forward Networks," Pal et al.: https://t.co/zfCrK9F4wM "SenseGen: A Deep Learning Architecture for Synthetic Sensor Data Generation," Alzantot et al.: https://t.co/f5uKCD33SD "Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Losses," Wilmot et al.: https://t.co/0xDgju2Ykn "Fully Convolutional Architectures for Multi-Class Segmentation in Chest Radiographs," Novikov et al.: https://t.co/VdYuTJd2Lv "Expert Level control of Ramp Metering based on Multi-task Deep Reinforcement Learning," Belletti et al.: https://t.co/RHhwFdBoU9 👍👍 from the schedule for AAAI next week. https://t.co/yg4N4ZcO4P It's almost like the US elected a reality show producer as President. https://t.co/368JOvyDuQ RT @chris_brockett: This poll result is utterly depressing. It does not augur well for the future of the United States. GOP agreement is… RT @j2blather: #machinelearning #sacklerML Stone: way easier to predict #jobs disrupted by #ai than those created by it. @korbonits @amazonbooks indeed! also a good one (though haven't read the whole thing) @aprilaser Andy Grotto's legit (NSC staff), but yes, this is ridiculous. Half knowledgeable, half WTF are they doing there @overcomplete_ Dunno, probably not useful for most ppl, who at most should know very basics. Would need to have a reason to make the time @YadFaeq looks like I remembered wrong! Not sure what best source would be for references but book version of MOOC def. meatier than MOOC @Miles_Brundage @YadFaeq actually, let me check on that - just looked on Amazon and it says there's just one at very end, maybe diff version @YadFaeq Leyton-Brown et al., "Essentials." @YadFaeq yes. Each chapter has a resources/historical notes section. If Trump news is too uplifting for you, read "Thermonuclear Cyberwar" by Gartzke and Lindsay: https://t.co/yqZ7mDNQsn @kylewrather there was some beach-related "time for some game theory" pun, too, but I forgot it. Oh well. @kylewrather I wanted to take a pic of it on the beach but phone battery was dead. :) Lighter fare: https://t.co/Isaw1fvwr7 or lighter still, their MOOC. Finally finished Maschler et al.'s game theory textbook - recommended if you want a serious reference on GT: https://t.co/YKqRxMcZeD RT @ericgeller: I'm still astonished that a U.S. special forces raid in Yemen killed an 8-year-old American girl and virtually no one is ta… @Miles_Brundage @aireye conceptually, new endgame solving algo w good guarantees+prob other tricks. All I know 4sure is not first 2 bluff :) @aireye empirically, just beating top pros at HUNLHE :) AI-wise, biggest imperfect info game beaten (AFAIK);... RT @brianklaas: And in case you were wondering, yes, that is indeed blatantly using the power of the presidency for personal enrichment whi… RT @brianklaas: After a solid two weeks of creating chaos, Trump jets off this weekend to Mar-a-Lago, which just doubled its joining fee fr… Libratus is impressive but that's not its claim to fame. For the zillionth time on behalf of AI poker ppl: bots have bluffed for a long time. Cepheus even bluffed optimally. https://t.co/0OlSXvZIa1 RT @hardmaru: PathNet: Evolution Channels Gradient Descent in Super Neural Networks https://t.co/b2RUgJNxAi https://t.co/AqmbkmGNd2 @hugo_larochelle @rsalakhu there is at least one: https://t.co/EKIzxgib3k RT @paulkrugman: Given the rate at which things are coming to a head, "President Trump" -- the sort-of legitimate head of a republic -- won… @sknthla hmm, dunno but some bits and pieces that would maybe help: https://t.co/rrwMa3shPP + https://t.co/1aHrisdWoX "RT @RikeFranke: ""In the past 2 months, the Islamic State has used more than 80 #drones against Iraqi forces and their allies"" https://t.co/…" RT @polynoamial: Final scores for #BrainsVsAI: @heyitscheet -880,087, @dongerkim -85,649, @Chouchoupoker -522,857, @678DMcA -277,657, Libby… RT @polynoamial: The paper on the endgame solver used in Libratus is now up on my website: https://t.co/U8hIdFSlCx #BrainsVsAI RT @HeerJeet: We should be clear this happened because of backlash to earlier Trump orders. Trump team learning they have to pick their fig… RT @tyleroakley: well ain't this rich https://t.co/5iQVfK9re4 "RT @juliagalef: People: ""Man, I wish there was a site that tracked which CEOs opposed the immigration ban"" @danielgross: ""Done!"" https://t.…" RT @EricHolder: Sally Yates: person of integrity/attorney with great legal skill. Has served this nation with distinction. Her judgment sho… RT @sarahjeong: I don't know anything anymore. If someone who has an actual fucking clue is out there, let me know. https://t.co/DHEKaVFvWD RT @nasrinmmm: Can your #chatbot do this? Our new work on "Image-Grounded Conversations" https://t.co/HvbqHmxDu1 #AI #NLProc @chris_brocket… "Practical Reasoning with Norms for Autonomous Software Agents," Shams et al.: https://t.co/MfbQOUmGgK "Probabilistic Entity Resolution with Imperfect Crowd," Yalavarthi et al.: https://t.co/aU3EC4OgzJ "Exploiting saliency for object segmentation from image level labels," Oh et al.: https://t.co/3mLztqA6qK "Supervised Multilayer Sparse Coding Networks for Image Classification," Sun et al.: https://t.co/Zj2EjoSZgg "Credal Networks under Epistemic Irrelevance," Jasper de Bock: https://t.co/kTaGbd8q2t "Pooling Facial Segments to Face: The Shallow and Deep Ends," Mahbub and Sarkar et al.: https://t.co/8h5dJSLwwu "Deep Recurrent Neural Network for Protein Function Prediction from Sequence," Xueliang Liu, Harvard: https://t.co/Zvbt7stHZA "Face Detection using Deep Learning: An Improved Faster RCNN Approach," Sun et al/DeepIR(looks like Chinese startup) https://t.co/Y4PfyRMFB5 "VINet: Visual-Inertial Odometry as a Sequence-to-Sequence Learning Problem," Clark et al., Oxford: https://t.co/S7jVeERegU "Drug-Drug Interaction Extraction from Biomedical Text Using Long Short Term Memory Network," Sahu and Anand: https://t.co/FKcdfkZNkS """Treelogy: A Novel Tree Classifier Utilizing Deep + Hand-crafted Reps.,"" Çuğu et al.: https://t.co/pZLgq79Mrl [as in plants, not sentences]" "Double/Debiased/Neyman Machine Learning of Treatment Effects," Chernozhukov et al.: https://t.co/hzyPBlxGzd "Computational Social Science to Gauge Online Extremism," Emilio Ferrara: https://t.co/mAO8UDWwZo "Adversarial Evaluation of Dialogue Models," Kannan (Brain) + @OriolVinyalsML (DeepMind): https://t.co/hbYiOOS82d "Image-Grounded Conversations: Multimodal Context 4 Natural Question + Response Generation," @nasrinmmm et al, MSFT: https://t.co/lvlRgs0nfa "Explanation Generation as Model Reconciliation in Multi-Model Planning," Chakraborti et al., ASU: https://t.co/yWyAwvloc9 @markus_with_k if that were scalable to the number of likely users, I'd consider doing it ;) "Transformation-Based Models of Video Sequences," Amersfoort et al., Facebook: https://t.co/8kRhYQzecL @markus_with_k that assumes I read them carefully enough to do that ;) @markus_with_k I'll try to do for some, though not v scalable (already takes a while just to filter and manually tweet them w/o that :) ) """Memory Augmented Neural Networks with Wormhole Connections,"" Gulcehre et al. at MILA: https://t.co/YqhL33b4rJ Called TARDIS, naturally." "PathNet is...NN algorithm that uses agents embedded in the NN whose task is to discover which parts of the network to re-use for new tasks" "PathNet: Evolution Channels Gradient Descent in Super Neural Networks," Fernando et al (DeepMind)/@hardmaru (Brain) https://t.co/T2GvbeMhso "RT @rcalo: Schedule for Asilomar AI conference w/ @elonmusk, Daniel Kahneman & others: https://t.co/Ei3hZr9pl1 My talk: https://t.co/6RIoo…" RT @sarahjeong: If your senator isn't yet committed to opposing Sessions, you should probably give them a call now https://t.co/HeJTtOmOr7 RT @DeepMindAI: Proud to be signatories to the Asilomar AI principles - another important advance for AI & ethics! https://t.co/8t39jsU14u RT @OpenAI: Welcome to our newest team members: https://t.co/ZJW1FsRaxD RT @paulkrugman: Seriously, what are the odds that this *doesn't* happen? The first bad jobs or inflation report ... https://t.co/8PbunhWZ8K RT @TerynNorris: 19.5% Rosneft sale was planned, figure public 2014: https://t.co/ZZa98P4afq Doesn't exclude possible collusion, need more… RT @benjaminwittes: #NotesFromUnderTrump, Day 11: Wherein Sean Spicer assures us that Trump's committed to protecting us from terrorism by… @fchollet pumpkin movement? RT @mikebutcher: Steele dossier said Putin offered Trump 19% of Rosneft if he became President & removed sanctions. Last week 19.5% of Rosn… @katyanna_q they're a bit alarmist IMO. 6-9 player games are very common online and require different solutions. RT @awjuliani: I just published “Learning Policies For Learning Policies — Meta Reinforcement Learning (RL²) in Tensorflow” https://t.co/Aj… RT @djrothkopf: An attempt to do otherwise would having a chilling effect on free speech and effective governance...and lead to mass exodus… RT @djrothkopf: This. Read it. https://t.co/tmamLQtcOw @iamtrask community building/gathering, process-oriented valuing of it etc not bc of optimizing end product quality. Or so the arg may go. @iamtrask think the vision folks have (not sure I agree) is like Star Trek: Next Gen. - ppl put on small plays, do pottery etc for reason of RT @shivon: Principles for creating the most beneficial AI future. Important to front-load this discussion as much as possible. https://t.c… RT @PiaGuerra: Big Boy. #PresidentBannon https://t.co/bR06v4TJeD See also schedule and lots of slides/videos (I assume more to come) from the conference in question: https://t.co/tNlAsDJiVw Props to the FLI staff for organizing this - a surprisingly meaty set of ideas endorsed by a diverse group of folks. https://t.co/C3UoZisCdn RT @fchollet: We've recently added a new research project on AI•ON: multi-task RL. https://t.co/88DRLliwg5 @yoavgo maybe not, but hopefully soon. Was probably easier for me to use it there with *minimal* Chinese knowledge bc could spot some errors @yoavgo still a good bet IMO. Fair # of Chinese folks speak it and translation's good enough to survive there @yoavgo (months just for tones, literacy has diminishing returns past thousands of characters but linear effort up until then, no alphabet) @yoavgo it's hard. Focus on better translation @justinhendrix he can and will, to some audiences, no matter how little violence. Already is at Breitbart. Q is how big audience will be. RT @jackclarkSF: 23 principles for the development of AI, signed by people at OpenAI, Google, FB, and so on: https://t.co/RVA9mYyppU @AMP_SV @fchollet Bannon literally complained about too many foreigners in SV. Unsurprising, though horrifying RT @quasimondo: Generating faces from a sketch. I trained a pix2pix net on 1500 #bldigital faces. Left input, right output. https://t.co/IP… RT @HeerJeet: Good news is Trump has no fixed ideology & can be swayed by advisors. Bad news is his main advisor is Steve Bannon. @AMP_SV @realDonaldTrump things look different when you're used to flying on a private jet, I guess. RT @bartongellman: Lawfare blog has a scoop. https://t.co/3Inv0pMMO9 https://t.co/ySMxkvAE9T RT @PyTorch: Code for the paper, can do LSUN, Imagenet, Faces experiments: https://t.co/jKQKHMbd7H https://t.co/zWy2UvKyK6 RT @HeerJeet: From 2013. I wholeheartedly agree with this tweet. https://t.co/4nlq25jQ6X RT @marwinsegler: Retrosynthesis (Chemical Synthesis Planning) with Deep Neural Networks. Our new paper in Chem. Eur. J.: https://t.co/mc0D… RT @blakehounshell: Fiasco — the U.S. has 7,000 troops and ~2,000 contractors in Iraq. https://t.co/YYe2cILjWW RT @janexwang: How our collective attention self-organizes... cool work, but does it explain the phenomenon of fake news and echo chambers?… @sherjilozair yes, I don't nec. buy the idea that that explains it, just noting surprising omission of big data pt by ppl making arg His perspective piece "On Our Best Behavior" a few years ago seemed pretty influential. Book version of his views should be interesting. "Common Sense, the Turing Test, and the Quest for Real AI" by Hector Levesque, next month. Big person in knowledge representation/reasoning. When Amazon isn't recommending I buy something I just bought, it sometimes recommends good stuff, e.g. https://t.co/TqNPwDw5lo @Bro_Pair @tetisheri the reference to non-zero possibility in that tweet seems to be modification, not retraction. RT @dnvolz: NEW: @ACLU now says it has received 290,000 online donations totaling $19.4 million since Saturday morning. Average per year is… They usually just list Middle Eastern countries. Note: Biggest Muslim majority country (Indonesia) also fits. Trump business: yes, ban: no. Seen several lists of majority Muslim countries where Trump has business, + yes, it's perfectly negatively correlated w/ Muslim ban, RT @jimsciutto: Commanded US forces in Iraq. Knows the terror threat deeply. @MarkHertling https://t.co/0Vm9BIc2K8 Same. https://t.co/wYrXj6aqiV RT @BrooklynSpoke: Dems: Wanna get Bannon out? Go on the Sunday shows & say, "We all know who has the real power in the White House and it… RT @ericgeller: This is BONKERS AF oh my god https://t.co/luMb3mklKu https://t.co/4h8TrDdKt7 @Miles_Brundage @newakamo @AMP_SV it just happens to be a v shitty Muslim ban, shitty in a way at gives one out for an ounce of deniability @newakamo @AMP_SV I 100% agree it's anti-Muslim- Trump talking abt Christians being killed, Giuliani said it on TV yesterday too, etc. "Emotion Recognition From Speech With Recurrent Neural Networks," Chernykh et al.: https://t.co/hDW0hMKDpw "Deep Region Hashing for Efficient Large-scale Instance Search from Images," Song et al.: https://t.co/wSXZ0rjHkO "An Empirical Analysis of Feature Engineering for Predictive Modeling," Jeff Heaton: https://t.co/cAJmyJjGea "Bradley-Terry-Élő Models for Supervised and On-Line Learning of Paired Competition Outcomes," Király and Qian: https://t.co/Midvyl8P3Z "Wasserstein GAN," Arjovsky et al.: https://t.co/MY7ks0G0lX "The Causal Frame Problem: An Algorithmic Perspective," Nobandegani and Psaromiligkos: https://t.co/YjRQwndv5z "The Price of Differential Privacy For Online Learning," Agarwal and Singh: https://t.co/3pN9OXzzxn Dunno a better (short) phrase for it is, + def see why ppl call it that (it certainly was inspired by Islamophobia), but Memo raises good pt Thread: https://t.co/5z2nxJghus RT @BillKristol: Baghdad Bob now a Senior Administration Official. https://t.co/I4bLw6fjM7 @MrMeritology @munin @daviottenheimer @Aelkus AFAIK, no evid. that that's a real account. It's not implausible, but wouldn't take their word On Planet Trump, agreeing with every expert that a bad policy is a bad policy = "always looking to start World III." https://t.co/9NKdR7lQP4 "This is the plan to defeat ISIS," says Trump signing request *for* plan. No idea what he's doing. #PresidentBannon https://t.co/QsTdRKY7rV @realDonaldTrump stop. Just stop. RT @SenJohnMcCain: Full statement w/ @LindseyGrahamSC on @POTUS's executive order on immigration: https://t.co/Fh9ylhWZyc (all of that is literally true, btw. Bannon's threat cannot be overstated) With a hint of admiring Satan and Darth Vader thrown in. https://t.co/G4Z2hzv2vR RT @mtaibbi: Bannon is tactically a Leninist and ideologically a racialist/white nationalist, the ultimate Satanic blend. https://t.co/YaLp… RT @cstross: I suspect what Bannon wants from the Muslim ban is an event he can spin as a Reichstag Fire moment. RT @rao2z: Sorry to hear this. #AAAI will try to do what it can to help scientists whose participation plans have been affected by this E… RT @laurenduca: #StopPresidentBannon https://t.co/19c8vh6iB5 RT @AmbassadorRice: This is stone cold crazy. After a week of crazy. Who needs military advice or intell to make policy on ISIL, Syria, Afg… RT @AmbassadorRice: Chairman of Joint Chiefs and DNI treated as after thoughts in Cabinet level principals meetings. And where is CIA?? Cut… @daviottenheimer @thekarami unbelievable @hannahgais @seanmdav Giuliani literally said on TV that the genesis was Trump asking him how to do a Muslim ban legally, then reframed. @Aelkus I'm heartened by swift/big protests and legal action, but how Trump/Bannon respond next is key. This could get even darker v. fast. @BayesForDays :( @BuzzFeedBen convince a colleague to ask a question about it at a press conference, then. RT @SwiftOnSecurity: https://t.co/1kmSNMEBtl RT @NathanKalmoe: This will be 1st test for whether the executive & legislative branches will respect judgment of judiciary, which can't en… FYI, this is how Bannon's buddies at Breitbart are covering the situation. Would not be surprised if Trump attacked judge soon. https://t.co/FzTxqBO0Nu RT @djrothkopf: I've studied NSC my entire adult life. Putting Bannon on it and making DNI and Joint Chiefs optional is lunacy. Shows zer… RT @WangCecillia: We have gotten disturbing reports that @CustomsBorder is refusing to comply with the court order RT @HeerJeet: Bannon is the wild card. He's at the peak of his power right now & knows he has a brief window of opportunity. That's scary. RT @RMac18: Google cofounder Sergey Brin at SFO protest: "I'm here because I'm a refugee." (Photo from Matt Kang/Forbes) https://t.co/GwhsS… @DrLukeOR thanks, reading now. "Trump resistance scorecard, week one: GOP: 0 Trump staff: 0 Most Senate Democrats: 0 Kirsten Gillibrand: 1 Lawyers/courts: 1 Citizens: 1" RT @ACLU: On week one, Donald Trump suffered his first loss in court. RT @dale_e_ho: Nationwide injunction - no one can be removed - govt must provide list of names of ppl affected RT @marsroverdriver: Teh w00tz! @ACLU gets federal judge to issue national stay of #MuslimBan, the first step in the process of (one hopes)… RT @pwnallthethings: Also removed from the NSC Principals committee: the Secretary of Energy RT @pwnallthethings: The President removed the Chairman of the Joint Chiefs and the Director of National Intelligence from the NSC and adde… RT @pwnallthethings: This is Bannon https://t.co/wVQGseUBTV CC @jackclarkSF """Performance Trends in AI,"" Sarah Constantin: https://t.co/HHVyGvG88s Draws on some of my work on this - nice read." One of the things we were told not to take literally (like the Muslim ban and the wall) was nuking the Middle East. https://t.co/0XQCZYYRQj RT @stevesi: Sharing @reedhastings' post from facebook: https://t.co/2JX87WvWgH @SunnyD17 the only two names I've heard have both been climate deniers, and everything he's proposed is bad for climate, so...yeah (and perhaps rightly so - looks like he'll be impeached or gone full dictator before very long and wouldn't listen to such a person anyway) Looks increasingly plausible that Trump et al. forgot to, or won't, nominate science advisor, journos too focused on bigger things to ask. RT @brianklaas: 1. I study authoritarianism & democracy. Already, many aspects of Trump's recent behavior mimic precursors to the rise of a… RT @samsam_86: I was pretty excited to join @soumya_boston's lab but denied boarding due to my Iranian nationality. Feeling safer? RT @Nate_Cohn: Meanwhile, Trump approval rating is down to 42% in Gallup, 50% disapprove. Undoubtedly the fastest president to hit 50% disa… RT @jackclarkSF: If you have interesting examples of AI being used to automate science, please send for next issue of newsletter: https://t… RT @dandrezner: You gotta work hard to create a policy that harms both American interests and values, but Trump has pulled it off. https://… @sknthla I agree they should do that for long term things but lobbying won't help much w/ exec. actions done with no expert/legisl. input @sknthla what would be better? RT @cogconfluence: This morning, we find out an MIT undergrad ('18) with student visa was denied re-entry into the US after her holiday tra… (Trump's approval rating is low by POTUS standards, and Ivanka's is low by FLOTUS standards, btw. On Planet Conway - "look how popular!") "Nearly half" Look at her tweet and then look at the tweet she's quoting. Completely delusional Trump staffer. Requirement of job. https://t.co/i6XXBZeCi8 Indeed. Also, image-to-image translation is completely bonkers. https://t.co/bdkPjX7C19 RT @hardmaru: Good explanation of Image-to-Image Translation (pix2pix) with clear TensorFlow implementation https://t.co/6liqCpTncu https:/… RT @juliaioffe: "Anne Frank could be a 77-year-old woman living in Boston today." But was denied a US visa. https://t.co/BeZ2ZpqLhl #Holoca… RT @halavais: Trump in statement today: "Together, we will make love and tolerance prevalent throughout the world." https://t.co/5XWGWQCR70 @_jyan_ I watched the talk on UNREAL. No previews there if I recall correctly. @_jyan_ ah, thought u meant algo preview (my prior there is they're good at avoiding that). Yeah, paper on data thing would b v interesting @Miles_Brundage @_jyan_ wouldn't be surprised if naturalistic stuff used in future papers, but his pt. was that UNREAL worked OK off the bat @_jyan_ he said/slide says it's the UNREAL algorithm (ICLR submission). Will have more to say about this in the not too distant future but TL;DR: yes, this is gonna be a problem... https://t.co/68waUpo9QZ @mark_riedl cf. https://t.co/hKuCGnMLQF Missed this til I saw Purves's talk (https://t.co/PVK7uBRZEr) - UNREAL agent foraging pretty well in a naturalistic environment. Impressive. https://t.co/uptg1W0tCL RT @connorobrienNH: Rep. Seth Moulton, an Iraq War veteran, pulls no punches on Trump: "I am ashamed that he is our president." https://t.c… RT @karpathy: Automated astroturfing with chat bots (eg on Reddit/Twitter) is technically very feasible and highly concerning https://t.co… RT @Stl_Manifest: My name is Joachim Hirsch. The US turned me away at the border in 1939. I was murdered in Auschwitz https://t.co/pfvJtMpI… RT @dandrezner: Dear @POTUS: on Holocaust Remembrance Day my synagogue told me the Syrian refugee family we're sponsoring is not coming. Go… Quick reminder that the most powerful person in the world is completely off his rocker. https://t.co/p1HTXupqX3 RT @erichorvitz: Partnership on AI to announce other participating orgs. & companies from Europe, Asia, around world in coming weeks.@Partn… RT @erichorvitz: Partnership on AI announces inaugural board https://t.co/1vZMZtW0p9 balancing nonprofit & corporate representation #PAI #A… "New York Times, CNN, etc.: President of Mexico cancels Trump meeting. Trump, Fox News parroting him: we've agreed to cancel meeting." @rbhar90 yes, this is one thing I liked about DeepMind's recent UNREAL paper - nice graph showing improvement in hyperpar robustness of algo "Brain State Flexibility Accompanies Motor-Skill Acquisition," Reddy et al.: https://t.co/dfUW5a7OZ4 "A theoretical framework for evaluating forward feature selection methods based on mutual information"-Macedo et al https://t.co/LLeI1WWcyn "Learning Word-Like Units from Joint Audio-Visual Analysis," Harwath and Glass: https://t.co/QdhWu87RO3 "Super-resolution Using Constrained Deep Texture Synthesis," Sun and Hays: https://t.co/VeOc84kVSv "Neuromorphic computing with nanoscale spintronic oscillators," Torrejon et al.: https://t.co/3oD50uhN18 "Unlabeled Samples Generated by GAN Improve the Person Re-identification Baseline in vitro," Zheng et al.: https://t.co/RhLdXpcmZD "Pose Invariant Embedding for Deep Person Re-identification," Zheng et al.: https://t.co/xSyHG1nze2 "On Deep Learning-Based Channel Decoding," Gruber et al.: https://t.co/iQU0QjSWZL "Ethical Considerations in Artificial Intelligence Courses," Burton et al.: https://t.co/RHbHtGO5XS "Game-Theoretic Modeling of Human Adaptation in Human-Robot Collaboration," Nikolaidis et al.: https://t.co/XmkrRK53Md "Match-Tensor: a Deep Relevance Model for Search," Jaech et al., UW/Facebook: https://t.co/M3cy8mufQo RT @erin_pelton: Maybe they shouldn't have fired all the diplomats https://t.co/hy9ETl0yeC RT @dandrezner: Neither Trump nor his supporters seem to appreciate just how much angrier the world can get. https://t.co/lanrb1caoz @DrewPurves's "Intelligent Biosphere" keynote at NIPS 2016: https://t.co/PVK7uBRZEr RT @paulkrugman: The Mexican tariff incident is truly amazing, because it shows dysfunctional, ignorance, and incompetence at multiple leve… RT @MsKellyMHayes: From a silenced EPA employee. https://t.co/QbJ35rt7gU RT @Leech: I'm not a robot.. https://t.co/6hHkhkmoWN RT @NipsConference: Videos from the 2016 Tutorials and Conference are available at https://t.co/MQAXlggjbX. Workshop videos will be posted… RT @juliaioffe: To all those who asked why Putin would have wanted Trump in the White House. https://t.co/cOnhXjugQq RT @paulstorms: Good morning, DAMAGE REPORT! https://t.co/jOqkGK9MJK "RT @RidT: Presidential infosec, post-DNC hack —@POTUS uses private email —""old, unsecured"" Android phone —@POTUS has no 2FA —Spicer tweets…" @grynbaum @nytimes I take "hobbits" line to be him (accidentally?) using term from Brennan's book Against Democracy. Is there other interp? Is there another usage of the term inside or outside of Tolkien that makes any sense in this context? Bannon's "hobbits" ref. seems to be Jason Brennan's term for uninformed voters (in Against Democracy). Other interpretations? @justinhendrix RT @tbonier: For those keeping count, I've found that Bannon, Mnuchin, Priebus, Kushner, and Tiffany Trump are all registered to vote in tw… Washington Post saying top State Dept. management resigned; CNN saying they were fired. OTOH, people quickly realize when using such systems that they are severely limited. https://t.co/GPkx7m0zmJ @iamtrask cool, I'll drop by in a bit :) @iamtrask street - FHI's office is here. Will you be there for a bit? Could drop by in 20 or so @iamtrask dunno what LEON is but prob passed by many times @iamtrask ha, yes, forgot abt that. We should chat at some pt soon (I'm at St Ebbe's, close to Cornmarket) @iamtrask certainly taking that argument into account, though it's a bit subtle (things can be described st multiple levels of detail) @iamtrask tell me about it...working on AI misuse stuff at the moment :) Or that across tasks, things speed up circa 20XX... just one among many AI progress related Qs where there might be high marginal returns... Presumably it differs across various Xs, Ys, and Zs, but maybe there's some commonality (exponential w/ diff exponents for tasks, etc.). But probably better ways to go about it than that first guess (just looking for ballpark, within order of mag or two). Could make false but useful assumptions like: authors contributed =lly to paper results, only worked on that since previous paper, X hrs/wk. Like, "in 2016, it took X% the time to implement a Y with Z performance vs 2006," or "X% as many researcher-hours to improve X score by Y." Excerpt from The Future of Violence. People say similar things re AI [R&D/implementation] speedup. Has anyone quantified this, even roughly? https://t.co/lGZxS8kN1q @_sh4d @AI_Pol thanks, it sounds cool! RT @jonfroehlich: I have had the distinct pleasure of working with 3 Iranian students as a professor. Trump's policies are xenophobic & wil… "RT @ianbremmer: Trump to block visas to anyone from Iran Iraq Libya Somalia Sudan Syria Yemen No Trump business there. Unlike Egypt, Turke…" RT @SCSatCMU: Libratus #AI's lead over poker pros in #BrainsVsAI is nearing $1 million https://t.co/xjnT8hKBXu @WinBigRivers @CSDatCMU http… RT @brianstelter: 14 minutes apart: Fox says "ungrateful traitor," Trump says "ungrateful traitor," Fox says "weak leader," Trump says "wea… @quasimondo @dribnet @erictfree yes RT @SebastianSeung: Our “surprisingly popular” algorithm for finding truth even when the majority is wrong. Cover of @nature this week. ht… RT @catehall: It's actually that bad. https://t.co/YITgGpqBRr RT @catehall: I encourage everyone to read this & try to come to terms w/fact we've given a nuclear arsenal to a genuine lunatic. https://t… "RT @Floridi: Why a Right to Explanation of Automated Decision-Making Does Not Exist in the General Data Protection Regulation https://t.co/…" @Miles_Brundage @mikarv distinction u make is fair + applicable to many countries, but suspect NK sufficiently backward that it's exception @Miles_Brundage @mikarv + even for those who have it, need decent/many computers (hampered by sanctions?), some knowledge to get it to work. @mikarv I'm not sure they can even repurpose things effectively. Vast majority of country (poss. including AI ppl?) has few dozen websites, RT @realDonaldTrump: Are you allowed to impeach a president for gross incompetence? @justinhendrix ah, thanks. Haven't seen that part yet. Unsurprising (which is so depressing). @justinhendrix Trump didn't read Obama's letter to him? Did he say that? @jigarkdoshi @ABC thanks!! RT @jigarkdoshi: @Miles_Brundage https://t.co/2M0XlWNyH9 Why is it so hard to find the full ABC interview video? Link, anyone? RT @SarahLerner: As Donald Trump closes our borders to refugees, remember that Hillary Clinton sent this email: https://t.co/BcUoKJr02X "RT @realDonaldTrump: Why is @BarackObama constantly issuing executive orders that are major power grabs of authority? This is the latest h…" "Large Scale Novel Object Discovery in 3D," Srivastava et al.: https://t.co/oWl4gGOlml "Hierarchical Recurrent Attention Network for Response Generation," Xing et al.: https://t.co/P1hoy0Gipm @ryanfb thanks! "Learning from Label Proportions in Brain-Computer Interfaces: Online Unsup. Learning w/ Guarantees," Hübner et al.: https://t.co/7XB2W9uKXk "Privileged Multi-label Learning," You et al.: https://t.co/teP5VryebM "Universal representations: The missing link between faces, text, planktons, and cat breeds," Bilen and Vedaldi: https://t.co/zwe1PpNhgN "Towards End-to-End Face Recognition through Alignment Learning," Zhong et al.: https://t.co/FyxeDvk3Jg "Deep Local Video Feature for Action Recognition," Lan et al.: https://t.co/mxHIVTGIfI "Design and Implementation of a Semantic Dialogue System for Radiologists," Sonntag et al.: https://t.co/SdLEEyLjjE "Harnessing the Web for Population-Scale Physiological Sensing: A Case Study of Sleep + Performance," Althoff et al: https://t.co/ENcXCGVA2l "Learning Multi-level Region Consistency with Dense Multi-label Networks for Semantic Segmentation," Shen et al.: https://t.co/UEyVNtg05D RT @Tess_Townsend: You should really read this. You should really read this. But how many times am I going to say that about how many thing… RT @mat_kelcey: "Workshop on the algorithmic foundations of robotics 2016" Videos just posted https://t.co/Wa6lw1bEpt @Elmo_Keep I at least am def. on board with its importance (used to work on CC policy/advocacy), will discuss w/ him at some pt :) @Miles_Brundage @Elmo_Keep ...medium-term atmospheric CO2 removal (just a guess--other colleague has written on this) but haven't discussed. @Elmo_Keep yeah, at least of the solar radiation management variety (war over that seems like plausible x-risk!). Think he's bullish on... @Elmo_Keep thx! His def. of ex.risk is extreme, so 1st part seems OK (few argue CC will kill every1), but later blaiseness=problematic, fair RT @S_Gehrmann: Convnets are as accurate as dermatologists in classifying skin cancer. Hope they'll release a smartphone app soon! https://… @Elmo_Keep when has Bostrom denied climate change? Never heard of this before + work with him... @ArtirKel fortunately, random search on ancient computers isn't very dangerous. @katyanna_q yeah they're not good :) Not 100% sure if that one's bad, actually, haven't looked carefully, but they have posted several 70's-era-like machine translation papers.. ICYMI - they sometimes post bad stuff on arXiv. https://t.co/ERK1pQe71Q @sknthla first very plausible, second...well, let's hope not. Random thought of the day: it's fortunate that North Korea sucks at AI. @sknthla do you have specific ones (declarers/targets) in mind? RT @goodfellow_ian: GANs for simulating high-energy particle physics: https://t.co/6Dp3UzR7yj Ross Anderson's textbook Security Engineering (2nd edition) is epic. @deliprao yeah that one's sort of an outlier :) "RT @AltNatParkSer: Can't wait for President Trump to call us FAKE NEWS. You can take our official twitter, but you'll never take our free…" "RT @jwan584: Absolutely savage review of Mercedes' autopilot system. @ARKindu https://t.co/LC4pedSynC https://t.co/JHudNsDS7N" @chrisalbon though maybe slightly slower than that tweet so you don't accidentally wipe your hard drive @chrisalbon go go go go gi RT @elonmusk: Sigh @elonmusk so say we all. Weird silence on the Trump science advisor situation. What's going on? Nothing new in several days. @JiveAssBastard not very scalable, though (b/c human labor on other end, requires big cadre of spies), and many gaps - protag. hides from it Also, quick reminder that 1984 features laughably low-tech/ineffective surveillance compared to what's possible today, and moreso, soon. RT @TerynNorris: It's one thing to delete a few tweets from Badlands Nat'l Park. This is another level - completely nuts. https://t.co/PL6B… RT @heyitscheet: Not positive on the final tally but we BEASTED through 2000 hands each and lost around 40k today #BrainsVsAI RT @mjntendency: @Miles_Brundage though nonstandard, I think that kind of usage is fairly common. there used to be this blog on it https://… RT @jodikantor: Reminder: this is how thoroughly Syrian refugees are screened before they can enter the U.S. https://t.co/nnnc8FPWm2 Other recent uses... half of the time or so, they seem to be for emphasis. Other times, normal usage means the opposite of what he intends. https://t.co/0i2oaI1Ty2 He genuinely doesn't know what quotation marks are for. https://t.co/hhRD1D09Ch (from the Center for Long-Term Cybersecurity at Berkeley) This doc on "long-term" [not really anymore...like 3 years] cybersecurity scenarios is good: https://t.co/fq8Y5bXHhz Dunno about Hillbilly Elegy but 1984 is a classic for a reason. Def. worth reading if you haven't or forgot. https://t.co/3bHBlBIo2c Link that works https://t.co/YmzJ9RIOvl One of the few AI/robotics Kickstarters with actual relevant expertise behind it :) https://t.co/YtpWo1qbyd One of these days I'd love to read this and this https://t.co/MZDEbZNf9i and other stuff and have an opinion on this... "Dynamic Mortality Risk Predictions in Pediatric Critical Care Using Recurrent Neural Networks," Aczon et al.: https://t.co/2RjV9I72ZK "A Survey of Quantum Learning Theory," Arunachalam and de Wolf: https://t.co/8FDh4aAGOu "Training Group Orthogonal Neural Networks with Privileged Information," Chen et al.: https://t.co/IdCGsGekVO "Discriminative Neural Topic Models," Pandey and Dukkipati: https://t.co/mmkT76rb37 "Learning Arbitrary Potentials in CRFs with Gradient Descent," Larsson et al.: https://t.co/6KvoJVQAnO "Reasoning about Probabilistic Defense Mechanisms against Remote Attacks," Ochoa et al.: https://t.co/zOJbK7flkg "Collective Vertex Classification Using Recursive Neural Network," Xu et al.: https://t.co/Byy8Y16CwV "Patchwork Kriging for Large-scale Gaussian Process Regression," Park and Apley et al.: https://t.co/pgtGfB0J7K "Perceptually Optimized Image Rendering," Laparra et al.: https://t.co/dS9ZvmNmEp "Residual and Plain Convolutional Neural Networks for 3D Brain MRI Classification," Korolev et al.: https://t.co/UAnCU8gzha "DSSD : Deconvolutional Single Shot Detector," Fu and Liu et al., UNC Chapel Hill/Amazon: https://t.co/u1BEjvdbde RT @broderick: Shit, I think you misspelled, "Shia LaBeouf — whose mother is Jewish — protests man wearing Hitler youth hat saying '14, 88'… can't resist pointing this out... https://t.co/UlP1IjQ2ZX "Imitating Driver Behavior with Generative Adversarial Networks," Kuefler et al.: https://t.co/OMvNYogeG5 "WhatsApp security and role of metadata in preserving privacy," Rastogi and Hendler: https://t.co/5tBQ3hTV3s """Deep Network Guided Proof Search,"" Loos et al.: https://t.co/XzPtaCdS0C WaveNet (+ other tricks) to inc. % of theorems w/ ATP-gen'd proofs" @Sam_B0t thx! @Sam_B0t thanks! Think the link you sent is for last year's and 2017 page still says 4th or 5th on left though FYI Also, does anyone know for sure when the AAAI poker workshop is? Site still says 4th or 5th. @Sam_B0t "This ""AI in Practice"" thing at AAAI soon looks very good: https://t.co/hftnhnpjo7 Unfortunately, lots of good stuff happening that day :(" RT @deliprao: This is a wonderful dataset for natural language entailment. Nicely done, @Quora & thanks! https://t.co/qhAieqjMbO "RT @j2bryson: Me, Francesca Rossi, Stuart Russell, & Mike Wooldridge noon NYC/EST Wednesday ACM Panel & Town Hall on #ai #AIethics https://…" RT @Pinboard: Adding Badlands National Park Service to the increasingly unlikely Mt. Rushmore of heroes that includes Tic Tacs and Teen Vog… @ivan_bezdomny btw I'll be at AAAI - do u know if this will be discussed at workshop there? RT @ivan_bezdomny: @Miles_Brundage yeah I'm waiting for an explanation at the end. Given that the AI is doing live solving, it could then u… CC @ivan_bezdomny Seems like a damned if you do, damned if you don't situation... I suspect they're not tweaking it mid match but either way, they're being cagey about all aspects of how it works - not just that... Doesn't seem unreasonable for Sandholm and Brown to not say if they're tweaking it - it's a game of imperfect info after all :) Dunno bout headline - good to highlight role of humans in AI, but specific claim (mid-match tweaking) unproven AFAIK https://t.co/pN7prUqrhG RT @blakehounshell: Trump’s claims about illegal votes are nonsense, says a researched who examined the data https://t.co/DjNIxJTds9 I hope Arrival gets, at least, best adapted screenplay... Very hard short story to make into a movie. https://t.co/mWog6seKGr @lidija_sekaric nice :) RT @BarnabyJDixon: My Raptor :) https://t.co/1Q2FeLSmoX "RT @RikeFranke: They already do - Dutch and German Navy fly off-the-shelf commercial systems (DJI Phantom) @jeremyhsu https://t.co/GdElKp…" RT @igorvolsky: White House Shuts Down Phone Comment Line, Tells Callers to Use Non-Existent Facebook Messenger Account Instead https://t.c… @dandrezner @craignewman my favorite = Labor Secretary, brought to you by Carl's Jr. @davegershgorn he didn't shower affection on the sarlacc RT @GokuMohandas: Notes on "Understanding Deep Learning Requires Rethinking Generalization". https://t.co/5KrNiA6j2O A step in rethinking… If only there were warning signs... https://t.co/LClyYFyrLV @SmithaMilli yay! Glad you liked it!! :) Update: it is significantly different (see OpenReview discussion: https://t.co/2l2ER3n8DC), inc. improved results on multilingual NMT. @davegershgorn I do! muahaha A+ acronym-"Convergent Actor-Critic by Humans (COACH), an algo. for learning from policy-dependent feedback"(replied 2 wrong paper 1st time) @lidija_sekaric :) A+ acronym here: "Convergent Actor-Critic by Humans (COACH), an algorithm for learning from policy-dependent feedback" @hardmaru indeed :) @davegershgorn https://t.co/SgPTG0lHtN @davegershgorn what about BSG? "Person Re-Identification via Recurrent Feature Aggregation," Yan et al.: https://t.co/9hCvFipwrj "Loss-Sensitive Generative Adversarial Networks on Lipschitz Densities," Guo-Jun Qi: https://t.co/ICIQMUDErk "Rumor Detection on Twitter Pertaining to the 2016 U.S. Presidential Election," Jin et al.: https://t.co/iwSZg4DZ2M "A Multichannel Convolutional Neural Network For Cross-language Dialog State Tracking," Shi et al., Panasonic: https://t.co/LauQT7mEIZ "Counterexample-Guided Abstraction Refinement for POMDPs," Zhang et al.: https://t.co/ccSFpGFRFf ...by Kim et al. "A New Conv. Network-in-Network Structure + Its Applications in Skin Detection, Semantic Seg., + Artifact Reduction" https://t.co/p7smdoeKIv "Greedy Compositional Clustering for Unsupervised Learning of Hierarchical Compositional Models," Kortylewski et al. https://t.co/pl8OPujNKH "DeadNet: Identifying Phototoxicity from Label-free Microscopy Images of Cells using Deep ConvNets," Richmond et al. https://t.co/jIARaqXmCE "Neurogenesis-Inspired Dictionary Learning: Online Model Adaption in a Changing World," Garg et al.: https://t.co/SuDer8BxwT (one of first papers I've seen using Cogitai affiliation) "Interactive Learning from Policy-Dependent Human Feedback," MacGlashan et al.: https://t.co/et0ptyKnho "Regularizing Neural Networks by Penalizing Confident Output Distributions," Pereyra + Tucker et al., Google Brain: https://t.co/RZJUXvtMYc "Adversarial Learning for Neural Dialogue Generation," Li et al.: https://t.co/mxLnrWzsmw (dunno if significantly different from ICLR submitted version folks tweeted a while ago) "Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer," Shazeer et al.: https://t.co/CSGWhNEDoP "Incorporating Global Visual Features into Attention-Based Neural Machine Translation," Calixto et al.: https://t.co/3bPIdqCcXy "Plausible Shading Decomposition For Layered Photo Retouching," Innamorati et al.: https://t.co/QCugw7Ce8L "Identification of Unmodeled Objects from Symbolic Descriptions," Baisero et al.: https://t.co/mlF0ITvODA @davegershgorn fake nerd guy "Learning Policies for Markov Decision Processes from Data," Hanawal et al.: https://t.co/coDZzg8D7T "Learning to Decode for Future Success," Li et al.: https://t.co/09WF94p4w4 "earning Particle Physics by Example: Location-Aware GANs for Physics Synthesis," de Oliviera et al.: https://t.co/2GNKkLh9Ot "dna2vec: Consistent vector representations of variable-length k-mers," Patrick Ng: https://t.co/sGaoldLkGX "Neural network representation of tensor network and chiral states," Huang and Moore: https://t.co/nhTYjSzFFQ @jackiefloyd yes RT @DeepMindAI: #DeepMind teams up with @UCL to teach Masters training module. Read more on our collaborations with academia here: https://… "RT @zacharylipton: Is Fake News an ML Problem? “It would be nice if ML could solve this” != “ML is the best tool for this job” new post htt…" "Holistic Interstitial Lung Disease Detection using Deep CNNs: Multi-label Learning + Unordered Pooling," Gao et al. https://t.co/vKGcg5dbu1 """NLP2Code: Code Snippet Content Assist via Natural Language Tasks,"" Campbell+Treude: https://t.co/ykhkrQtwvC Video: https://t.co/VNNrysAujE" "Poisson--Gamma Dynamical Systems," Schein et al.: https://t.co/FocvxcTaGy "RT @RikeFranke: Looks like the first #drone operation under the Trump administration has taken place in #Yemen https://t.co/RaJU6FJuTl" RT @ericgeller: Orwell would love the phrase "alternative facts." https://t.co/tQi45zbk3k "So many people wanted to attend the inauguration, we built a 100 foot wall to keep them out - and they STILL kept coming! Huge crowd." https://t.co/JvrJUXr7pd RT @JamesUrbaniak: "Not only does the film SHAZAM exist but the President appeared in it, establishing a friendship with Sinbad that contin… "Playing Bubble Shooter (~Bust-a-Move) with deep RL: https://t.co/zgZrW6h92f From Laurens Samson's bachelor thesis: https://t.co/Le0Bops2hN" "President Trump would like the American people to know he is Satoshi Nakamoto. He also developed AlphaGo and Watson in his spare time." https://t.co/rcuHzkJq0d RT @dandrezner: "It's a scientific fact that the best Star Wars film is The Phantom Menace." https://t.co/IMLF6zHqHO RT @stephenfhayes: Categorically, demonstrably false. The new WH press secretary opens his time with a lie & takes no questions? https://t.… Would be funny, but Googling for a few seconds suggests this is not correct. Do we really need to make up Trumpisms? https://t.co/sX4tx4Ra5i RT @NickBaumann: The press secretary of the President of the United States is giving a statement complaining about tweets. "RT @BDStanley: ""Trump's lies about the crowd size are deliberate misdirection tactics..."" NO, HE'S JUST A THIN-SKINNED MAN-BABY AND THIS I…" @mtaibbi lmao thanks for sharing this. @ivan_bezdomny nice job! RT @ivan_bezdomny: My predictions looking pretty accurate one week later. Players close to GTO but tired. AI really good. #BrainsVsAI http… RT @MicahZenko: Trump is whining about his press coverage...in front of the CIA Memorial Wall with 117 stars of CIA officers killed in duty. RT @blakehounshell: Trump also claimed there were a million and a half people on the mall yesterday, which is nowhere close to true. "RT @ylecun: Geoff Hinton said we were the lunatic fringe & became the lunatic core. Hope my multilayered cake satisfied the most gourmet L…" @nsaphra LeCunatics. Love it. RT @VergeScience: The Women’s March movement is taking place on every continent, even Antarctica https://t.co/PQwNH1m5ag https://t.co/pxjTa… Average AI journalism in three acts... from: https://t.co/UG0dazHlSq https://t.co/blCYhBMutE RT @alexjc: Hollywood star co-publishes a paper about Neural Network Art in film https://t.co/iE3eQGQFJb Reviewer 2 takes a look... ↓ #AI #… @cameronblaze it does seem possible, just happens to have not worked as well as (approx) GTO empirically. maybe for reason u mention @cameronblaze typically systems just learn "offline" before the game, e.g. by playing against themselves. adapting on fly to new ppl is hard RT @dandrezner: There's a very fine line between reality and The Onion these days. https://t.co/GxwWbr6K6Z @benpopper would make sense for that to kick in only after a lot of data accumulated, if at all.. @ivan_bezdomny thoughts? @benpopper I'd be surprised if they were making tweaks overnight, was just thinking about the AI adapting after it has model of players.. hm "Bad day for humans today in #BrainsVsAI (appropriately) Do people still think Libratus isn't adapting? What's up with the last few days? https://t.co/eQ1MnvPybh" RT @K_dele: "Believer-Skeptic meets Actor-Critic: Rethinking the role of BG pathways during decision-making and RL" @biorxiv https://t.co/s… RT @mtaibbi: David nails it - the FHA move is just the first in what will surely be a long line of unnecessary favors for already-rich bank… "RT @brianklaas: We are transferring power back to the people* *Of Goldman Sachs / lobbyists/ billionaires / generals / unqualified loyalis…" RT @Kasparov63: Yes, I also hope I'm wrong and that everything Trump said and did in his campaign and his entire life will be refuted by hi… RT @ericgeller: https://t.co/n0zY5Y6hO5 https://t.co/fnC5DqexFk :( RT @markus_with_k: What our autonomous cars see https://t.co/z4hF8SeE3o (or at least part of it ) #driverless #lidar @lidija_sekaric always happy to discuss, and let me know if you're ever in the UK :) RT @dandrezner: By Trump standards, this is a mildly encouraging story. https://t.co/CCFIqk4kzo RT @OriolVinyalsML: A year ago I left Brain to join DeepMind. My farewell speech was of course generated by an LSTM trained on all my email… @lidija_sekaric (just raw score, not the details of how it works)..also saw talk on it recently, liked this analogy https://t.co/eOXosZFRwQ @lidija_sekaric yeah, it's very impressive! I wrote a related blog post recently and mention it a few times https://t.co/rzqLGysyfy @lidija_sekaric AI-related ones (and a few non-AI computer science) that look potentially interesting, when they come out :) RT @joshtpm: Off to a Great Start >>> Trump Wanted Soviet Style Inaugural Parade with Tanks and Missiles https://t.co/3FzP4XlIAC via @TPM "Random Forest Missing Data Algorithms," Tang and Ishwaran: https://t.co/XqMKmhGAmH "Stochastic Subsampling for Factorizing Huge Matrices," Mensch et al.: https://t.co/9zUQW6YMrT "Fisher consistency for prior probability shift," Dirk Tasche: https://t.co/ADlowPM46r "Parsimonious Inference on CNNs: Learning and applying on-line kernel activation rules," Theodorakopoulos et al.: https://t.co/ew3k3aj01o "Reasoning in Non-Probabilistic Uncertainty: Logic Programming+Neural-Symbolic Computing as Examples," Besold et al. https://t.co/aOLx9YG3lT "A Joint Framework for Argumentative Text Analysis Incorporating Domain Knowledge," Wei et al.: https://t.co/tWHW6AIsbx "Lipschitz Properties for Deep Convolutional Networks," Balan et al.: https://t.co/HDiHjuXjL4 "Pixel Objectness," Jain et al.: https://t.co/q5ZJlUYMt9 "Learning to combine motion and appearance 4 fully automatic segmention of generic objects in videos," Jain et al.: https://t.co/nO4P8T295M "3D Face Morphable Models In-the-Wild,'" Booth et al.: https://t.co/suZBx26cAq https://t.co/0Bs4k0yimh "Higher-order Pooling of CNN Features via Kernel Linearization for Action Recognition," Cherian et al.: https://t.co/8uem0RRxIM "T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-less Objects," Hodan et al.: https://t.co/UkI2hI5VLm "Improving the PixelCNN w/ Discretized Logistic Mixture Likelihood + Other Modifications," Salimans et al., OpenAI: https://t.co/dMCVjRWNfA "Synthetic to Real Adaptation with Deep Generative Correlation Alignment Networks," Peng and Saenko: https://t.co/3I4ySE0ZcL "Online Structure Learning for Sum-Product Networks with Gaussian Leaves," Hsu et al.: https://t.co/jyxWsN3MPd "Variational Dropout Sparsifies Deep Neural Networks," Molchanov et al.: https://t.co/GOLl5bsdt1 RT @egrefen: The CFP for #RepL4NLP 2017 is now online. Details of prizes and submission types here: https://t.co/ftsxm60ywT RT @rbhar90: DeepChem needs docs writing help! Great way to get involved with deep-learning for drug discovery. Please share :-) https://t.… RT @deanpomerleau: Y'day @DougPolkPoker said 5-10% hope of humans winning in #BrainsVsAI; another bad day would spell doom. Well... Human h… Not the best day for team human at #BrainsVsAI https://t.co/9onIwOBzlX @bradplumer @TerynNorris thanks! @TerynNorris @bradplumer was ARPA-E mentioned? RT @alexjc: .@YouTube My mistake, obviously, is that I read the paper for its content and without knowing the names of famous Hollywood peo… The clear next step here is for Trump to call the paper #FAKENEWS https://t.co/07jwJmI2wS RT @alexjc: I skimmed this paper first thing this morning, threw it out because it looked crap and with nothing interesting :-| https://t.c… @ivan_bezdomny I would guess not :) Will Trump apologize to Kristen Stewart now that she has a deep learning paper on arXiv? lol. 2017 is weird. https://t.co/2lR0tefXOU RT @mark_riedl: Trying again: Bella Swan, once seduced by vampires, writes an arXiv paper https://t.co/NZ4I1yhQUN RT @mark_riedl: I used to tell Twilight jokes in my Intro to AI class. I take it all back. RT @mark_riedl: Once more: Kristen Stewart of Twilight fame directs movie; writes arXiv paper about using StyleNet during production https:… @mgubrud you don't think the DSB is the top? (or that better for broad?) @mgubrud ah, k (ignore last tweet then) @mgubrud or was your point that JASON members are not centrally involved, just random staffers (my pt about value add was re: JASON mmbrs) @mgubrud hasn't that always been the case? (/part of the purported value add of JASON?) RT @katjahofmann: Fully funded Microsoft Studentship @UniofOxford - supervised by @shimon8282 and myself https://t.co/SREYZR8TFX @mgubrud why the quotation marks? is this not actually from JASON members? RT @fchollet: To be someone in Hollywood, you've got to put your ML papers on Arxiv and you better use TensorFlow... https://t.co/2Rcg1ccJ36 RT @timhwang: “[B]roadband has a negative impact on exam scores regardless of gender, subject or school quality” - https://t.co/8UXyOwQkmT RT @tdietterich: This email did not convince me to submit to their journal https://t.co/Pe4mugfyUV CC @sarahkaplan48 Trump spokesman described him as "the candidate" to journalists (https://t.co/qeojM5WvMq), but dunno how careful his wording was. Anyone know of other candidates being considered for science advisor besides Gelernter, if any? RT @ArmsControlWonk: 🇺🇸🇺🇸🇺🇸🇺🇸 https://t.co/NrfDAoGcBn @sprobertson maybe the keywords you used. @sprobertson also, why does this tweet have 53 likes? ...now, if *Deputy* Secretary is random idiot, then we have v. serious issues (under Chu/Poneman, good division of labor btwn energy/nukes). Importance of DOE's energy stuff is very huge, even if not as large budget as nukes. And Rick Perry is, well, Rick "oops" Perry. NNSA staff will mostly be unaffected. Damning he didn't know, but not nec. end of the world (via nukes). Very bad for climate/energy though. Mostly agree with @RadioFreeTom here... yes, budget-wise, nukes=majority of DOE, but not of Secretary's mindshare. https://t.co/ff21I0lDFx Also lots of conservative and consciousness stuff of ? quality. Seems unlikely to happen but anything in age of Trump has >0 probability... https://t.co/IyJGvse1pF ummm https://t.co/sCH9hg72kA @justinhendrix nearly? RT @kinggary: "Authoritarians Distract Rather than Debate" https://t.co/khsndqk5ha @mollyeroberts @jenjpan "Compression of Deep Neural Networks for Image Instance Retrieval," Chandrasekhar et al.: https://t.co/K1VCpGaw5x "Action Recognition: From Static Datasets to Moving Robots," Rezazadegan et al.: https://t.co/yTGm0RG3kR "A Deep Convolutional Auto-Encoder with Pooling - Unpooling Layers in Caffe," Turchenko et al.: https://t.co/quRE7DjFUM "Bringing Impressionism to Life with Neural Style Transfer in 'Come Swim'," Joshi et al.: https://t.co/h1nMao9ye5 "Individual versus collective cognition in social insects," Feinerman and Kormanë: https://t.co/f6lumcDAH7 "Deep Learning Features at Scale for Visual Place Recognition," Chen et al.: https://t.co/JIKDf0wYRV "Transfer learning for multi-center classification of chronic obstructive pulmonary disease," Cheplygina et al.: https://t.co/Q0Ujlru5P8 "NMODE --- Neuro-MODule Evolution," Keyan Ghazi-Zahedi: https://t.co/NiuPng3PCi "On the Performance of Network Parallel Training in Artificial Neural Networks," Ericson and Mbuvha: https://t.co/aRSgjifLeF "Temporal Overdrive Recurrent Neural Network," Bianchi et al.: https://t.co/G0NFM2vbc7 "Multilayer Perceptron Algebra," Zhao Peng: https://t.co/YOVu7HsshP "Converting Cascade-Correlation Neural Nets into Probabilistic Generative Models," Nobandegani and Shultz: https://t.co/uF29o2GCSV "Feedforward Architectures Driven by Inhibitory Interactions," Billeh and Schaub: https://t.co/MPvpORKQJ9 "A Machine Learning Alternative to P-values," Lu and Ishwaran: https://t.co/lcY5WRI5pK "Towards Principled Methods for Training Generative Adversarial Networks," Arjovsky and Bottou: https://t.co/ghD9ssqS2m """Face Synthesis from Facial Identity Features,"" Cole et al.: https://t.co/6FTou3O5cl with @elonmusk cameo https://t.co/eoxed6m8LA" RT @blakehounshell: Trump’s administration is not looking ready, according to more than two dozen interviews https://t.co/fHiEqB0RrD Has Trump changed? Will he? The answer from Trump's biographers is a resounding no. Horrifying read, but important. https://t.co/ko0HZSQLWq RT @NBCNews: Companies are "recycling" old job creation announcements to avoid Trump's twitter attacks https://t.co/3EnlskmNaT https://t.co… RT @WillOremus: Among other things, this survey makes it clear why Trump and conservatives have made CNN their top media target. https://t.… RT @WillOremus: Fox News was the dominant news source in the election. CNN was second. And the partisan spits are huge. https://t.co/zkaRI0… RT @mark_riedl: Explainable AI: we trained an agent to think out loud while playing Frogger https://t.co/TQVS40h4ao RT @RikeFranke: Print-out of my first publication of 2017 - will post link when (if?) online. On the danger of 'armed' consumer #drones htt… @davegershgorn NIPS for deep learning/ML/whoa lots of $, ICLR more technical - AAAI/IJCAI for not just ML, ICRA for robots.. ill be at AAAI RT @heyitscheet: All problems we resolved now and we are currently live for day 8 of #BrainsVsAI at: https://t.co/gmkDXl28jK RT @ivan_bezdomny: I've under-estimated how much most fans root for the humans. #BrainsVsAI RT @Miles_Brundage: Will be in the Bay the week of February 6th, let me know if you want to chat :) RT @soumithchintala: Been working on this for the last few months. Hope you enjoy the early release :) https://t.co/yEFegbNf0q @ozanonay @ivan_bezdomny thanks! @ivan_bezdomny could you clarify what the deal is with the "same cards"? Is it non-random cards in order to make it fairer or something? Some cool talks/panels at the 3rd International Workshop on AI, Ethics, and Society at AAAI next month: https://t.co/vL41OIFo0j @dennybritz + most u mentioned besides accounting are newish... maybe was good AI coverage by end of prev AI winters then knowledge lost? :) @dennybritz which I assumed stems from decades of steady coverage/many dedicated outlets/institutional knowl. etc but dunno if generalizable @dennybritz not sure about general principles, but in my experience working on both energy and AI, average quality of latter is much higher, "RT @dennybritz: ""Built on deep learning neural network designed to emulate the human brain"" and raise $14M. Ouch, my head hurts. https://t…" @dennybritz (though of course one should always assign <1 probability to any article being totally true) @dennybritz not necessarily problematic if you have rare expertise not well established among journalists :) (e.g. AI vs. current events) RT @keithboykin: Sen. Al Franken discovers Trump Education Secretary nominee Betsy DeVos doesn't know the difference between proficiency an… "Joint Deep Modeling of Users and Items Using Reviews for Recommendation," Zheng et al.: https://t.co/OlrLRZcQrt "Complex Event Recognition from Images with Few Training Examples," Ahsan et al.: https://t.co/wfZ4ShT7ub "3D Reconstruction of Simple Objects from A Single View Silhouette Image," Di and Yu: https://t.co/EH4Owt6aF0 "Incremental Learning for Robot Perception through HRI," Valipour et al.: https://t.co/kKZi6dGXWE "Human perception in computer vision," Ron Dekel: https://t.co/oqKbMYQcS5 "Continuous Authentication for Voice Assistants," Feng et al.: https://t.co/DAa9k9kWfw "Fusing Deep Learned + Hand-Crafted Features of Appearance, Shape + Dynamics 4 Automatic Pain Estimation" Egede etal https://t.co/NCBl6jTaOr "Convolutional Oriented Boundaries: From Image Segmentation to High-Level Tasks," Maninis et al.: https://t.co/iF7mEwA9pz "Towards prediction of rapid intensification in tropical cyclones with recurrent neural networks," Rohitash Chandra https://t.co/D6xqKf1uo4 "Towards a New Interpretation of Separable Convolutions," Tapabrata Ghosh @nerdherdempire: https://t.co/XmBeUVWnjf "Deep Learning for Computational Chemistry," Goh et al.: https://t.co/Q8myffshgz "New Perspectives on Learning Representations Through The Lens of Pruning," Wolfe et al.: https://t.co/crL9LUmrzM ...by Kompella and Wiskott "Intrinsically Motivated Acquisition of Modular Slow Features 4 Humanoids in Continuous + Non-Stat. Environments": https://t.co/vSSjNYTjHK "Adversarial Variational Bayes: Unifying Variational Autoencoders and GANs," Mescheder et al.: https://t.co/JrVN4B8CGq "we responsibly disclosed 5 vulnerabilities, established three new CVE-IDs, + illuminated a common insecure practice across many ML systems" """Summoning Demons: The Pursuit of Exploitable Bugs in Machine Learning,"" Stevens et al https://t.co/ayBvbW5kH8 Enjoyed talk on this at NIPS" RT @dennybritz: Engineering is the bottleneck in (Deep Learning) research - I just had to write up a little rant ;) https://t.co/UFsl0VzpPt RT @dirk_hovy: Working on a paper on ethical issues in NLP? Submission deadline for https://t.co/dXcy6bPjVv is January 25! RT @charlie_savage: BREAKING: Obama commutes Chelsea Manning's sentence for leaking to WikiLeaks. She will be freed on May 17. https://t.co… My original thread starts here: https://t.co/VLtxG1KDHI RT @blake_AI: Then for development times, there's a methodological worry about possible sample bias in the dataset used to ground dev. time… RT @blake_AI: @blake_AI And Optimization and Planning is a bit of a head-scratcher here too. Certainly only top quartile if considered extr… RT @blake_AI: @blake_AI Surely not, for instance, the capabilities of a healthy 5 year-old... RT @blake_AI: Same worry about median rating for fine motor skills/dexterity; output articulation/presentation and sensory perception (exhi… RT @blake_AI: 2nd big-picture worry: what is median performance supposed to capture here? For instance, odd that current NLP generation is… RT @blake_AI: One big-picture worry about their metrics: the technical gap between sub-median and median performance is much wider than med… Some additional thoughts on the McKinsey automation report's technical feasibility analysis from @blake_ai https://t.co/Zjo3xfZKUS @blake_AI sounds like we both took issue w/ same part :) and you raise good issues, thx for sharing @ruchitgarg cool! feel free to shoot me an email/message :) (contact info on website) Will be in the Bay the week of February 6th, let me know if you want to chat :) RT @NarratedPOTUS: The President-elect of the United States tweets a link to his administration's official propaganda arm. RT @timhwang: “keynesianism in the marketplace of ideas”: some thinking about economics, social media, and intervention - https://t.co/6jVm… RT @antonhowes: Saw Voth present this paper last year. Its findings are why I think Trump might actually build that wall... https://t.co/9l… RT @michaelwhudson: Breitbart-affiliated James O'Keefe caught trying to bribe protesters to riot at Trump inauguration https://t.co/TwC3sgG… RT @alexjc: Fascinating! Understanding the Effective Receptive Field in Deep Convolutional Neural Networks https://t.co/Y8nrkbel2C #ML (Tho… RT @ivan_bezdomny: @Miles_Brundage fake AI news Also, Watson doesn't play chess (even if it were a single system anymore), and this article is bad. :( Anyway, very interested to see what comes of NNAISense. Very influential for sure, but literally no one with any understanding of AI and its history would say that. Better headlines please :) ... maybe "often" by journalists who think AI and deep learning are the same thing, among other mistakes ... https://t.co/MKA0u4cqk8 https://t.co/K23Fy8okZR RT @Tweetteresearch: @Miles_Brundage @dmarthal this is busy market, check also https://t.co/3FTCBzZFsI https://t.co/LHcBbkXMzN RT @heyitscheet: Second session of the day I go +40k and Dong goes +30k for the human team to put up its first six figure day of +110k #Bra… That's it :) "Marked Temporal Dynamics Modeling based on Recurrent Neural Network," Wang et al.: https://t.co/AlNLwczB06 "Can We Find Documents in Web Archives without Knowing their Contents?," Vo et al.: https://t.co/5rZLAJyKe8 """Minimally Naturalistic Artificial Intelligence,"" Steven Hansen: https://t.co/Lz9akUlXNV (last two are position paper-y, look interesting)" "Long Timescale Credit Assignment in NeuralNetworks with External Memory," Steven Hansen: https://t.co/AIGkDButji "Exploring Model Predictive Control to Generate Optimal Control Policies 4 HRI Dynamical Systems," Jorgensten et al: https://t.co/LJgDFLQOzh "Mixed-Precision Memcomputing," Le Gallo et al., IBM/ETH: https://t.co/0wHLPLUo2U Lots of stuff on arXiv tonight.... "Auxiliary Multimodal LSTM for Audio-visual Speech Recognition and Lipreading," Tian et al.: https://t.co/Ozx6vQs5KT "On the Difficulty of Social Network Misinformation Classification via Propagation Features," Conti et al.: https://t.co/wSJwzCB9Uf "Deep Memory Networks for Attitude Identification," Li et al.: https://t.co/i1A7xfJzck "Understanding the Effective Receptive Field in Deep Convolutional Neural Networks," Luo et al.: https://t.co/8KgxHLYm2O "Embedding Watermarks into Deep Neural Networks," Uchida et al.: https://t.co/1aHrisdWoX "Dialog Context Language Modeling with Recurrent Neural Networks," Liu and Lane: https://t.co/yC3fFs2zfi "Neural Models for Sequence Chunking," Zhai et al., IBM: https://t.co/pLxY9RPNjq "Real-time eSports Match Result Prediction," Yang et al.: https://t.co/HRU4XDZ8qc CC @reallybigsalad "End-to-End ASR-free Keyword Search from Speech," Audhkhasi et al., IBM: https://t.co/IP9VuVTKki "Hierarchical Salient Object Detection for Assisted Grasping," Klein et al.: https://t.co/0Fp043XqUa "Learning to Invert: Signal Recovery via Deep Convolutional Networks," Mousavi and Baraniuk: https://t.co/9Qbx4rtJlC "Automatic sleep monitoring using ear-EEG," Nakamura et al.: https://t.co/Lm9sQP3KhR "DyNet: The Dynamic Neural Network Toolkit," Neubig et al. (lots of folks from all over, inc. @yoavgo and @nsaphra): https://t.co/4dxFFQcHjM "A Copy-Augmented Sequence-to-Sequence Architecture Gives Good Performance on Task-Oriented Dialogue," Eric/Manning: https://t.co/cwpHI2u481 "Vulnerability of Deep Reinforcement Learning to Policy Induction Attacks," Behzadan and Munir: https://t.co/Zx269JdqIZ "Near Optimal Behavior via Approximate State Abstraction," Abel et al.: https://t.co/fFKja35bK0 "Agent-Agnostic Human-in-the-Loop RL," Abel et al.: https://t.co/3UstyEMq15 Cool work done by @FHIOxford colleagues/visitors this summer :) RT @ddale8: The head of Trump's inauguration says he begs Trump to pay attention to presidential stuff rather than dinner decor: https://t.… @dmarthal @rivatez I stand corrected - thanks! Still think the overall pattern is pretty true, though... Some good responses...asked b/c reading Game Theory by Maschler et al. and it's *epic,* but then again many are epic https://t.co/wkjZoJUNuV "RT @NoahShachtman: Trump's BFF is just as upstanding as you'd expect. ""Putin's Judo Partner Awarded $285M Contract For Crimea Railway"" htt…" @hardmaru @jackclarkSF @goodfellow_ian maybe ;) OTOH, he said *at least* 20-30, and didn't specify just robots, so.. *shrug emoji* RT @ivan_bezdomny: Humans making huge comeback, cutting @SCSatCMU 🤖 winrate from $25/hand early to $5/hand. Led by @dongerkim on a +$100k h… RT @heyitscheet: First #BrainsVsAI session of the day I go +20, Dong +50, Dan -10 and Jimmy -20 for a human team total of +40k @nikete @ivan_bezdomny @alexjc tho Noam on the livestream has declined to comment on whether it adapts online. So maybe exploiting weakness? @rivatez shoulda been a Rocket AI piece on TC ;) @rivatez yeah. Common TechCrunch article - random AI (?) entrepreneur ramblingly muses on AI stuff RT @dandrezner: Can we go back to the fact that a Bruce Springsteen cover band was booked for a Trump inauguration party? https://t.co/tary… @jackclarkSF @goodfellow_ian indeed. Dubious article but sadly par for the TechCrunch course RT @jackclarkSF: @Miles_Brundage also, doesn't mention that @goodfellow_ian does research on adversarial examples, which helps secure super… RL paradigm is almost by definition applicable to "most" biz probs, though existing algos insufficient. Latter true of supervised learning 2 Says it's 20-30 yrs away from being "mature" and not applicable to "'most" biz probs - this confuses RL algos with RL paradigm... Certainly a lot of unsolved issues in RL, and I agree safety is a big thing to thing about re: RL, but this is a questionable argument... "*chin scratch emoji* RL 20-30 years+ away? Strange perspective. Tell that to Google's datacenter managers using DQN https://t.co/RoAU6G4wlH" RT @botminds: @Newsbot9 @Miles_Brundage @ivan_bezdomny could be humans are close to optimal Or, that game complicated enough both only occu… Justified use of Terminator imagery. https://t.co/bIqAR3tCsX RT @fchollet: The surprising thing about deep learning isn't that our models can fit to basically any dataset, it is that they generalize -… @nikete @alexjc @ivan_bezdomny hmm. Maybe just marketing bravado or written pre-DeepStack (being charitable)? either way would be fun to see @nikete @alexjc @ivan_bezdomny + Libratus close to peak, not sure what 1.0 v 2.0 would look like, but those are just guesses :) @nikete @alexjc @ivan_bezdomny my guess is Libratus 1.0 would beat DeepStack 1.0 but DS has more room for scaling up with hardware/training @nikete @alexjc @ivan_bezdomny don't think either claimed that, or that they plan to compete? Think both just say it's v good :) @nikete @alexjc @ivan_bezdomny if humans start winning big against it, that would be a sign against; but yes, no decisive evidence in favor. @Newsbot9 @ivan_bezdomny ... imperfect info in this context (bluffing, etc.) than generic big search trees... but dunno @Newsbot9 @ivan_bezdomny yeah, though no limit poker is big, too, + imperfect into. My guess is that humans naturally better about ... @alexjc @ivan_bezdomny feel like humans being able to compete after trillions of rounds of self-play is pretty compelling @alexjc @ivan_bezdomny well, it's a hypothesis, dunno if proven, but I'm pretty persuaded :) As @ivan_bezdomny has said, the fact that this is close at all shows humans close to playing optimally, unlike Go. https://t.co/Y3FdsBU3O1 RT @SCSatCMU: Libratus #AI extended its lead, but only a little, over poker pros in day 5 of #BrainsVsAI https://t.co/ZdeEecgQdO @WinBigRiv… @AthertonKD he blocks everyone who disagrees with him, from what I gather. Sad! RT @dustinvtran: “Deep Probabilistic Programming” now on arXiv. Foundations of https://t.co/rVnzzkDW8t with deep learning apps https://t.co… Quick reminder that Trump will soon have stuff like this at his disposal. https://t.co/WO36M3gotW @Aelkus almost tweeted other day that the DL for predicting strat behavior paper didn't get attn it deserved. also https://t.co/oS6sHwhrah Text of the "Letter from Birmingham Jail": https://t.co/TKBaUbNsTm #MLKDAY @GarrulousGeoff not sure I follow. I should have quoted more - point was, the performance is comparable. "LayerBuilder: Layer Decomposition for Interactive Image and Video Color Editing," Lin et al.: https://t.co/JBrG8rFNec "Restricted Boltzmann Machines with Gaussian Visible Units Guided by Pairwise Constraints," Chu et al.: https://t.co/6NklmnY7aP "Efficient Transfer Learning Schemes for Personalized Language Modeling using Recurrent Neural Network," Yoon et al. https://t.co/Ix1MRLmlWC "Cost-Effective Active Learning for Deep Image Classification," Wang et al.: https://t.co/QcIh4BQkQz "An OpenCL Deep Learning Accelerator on Arria 10," Aydonat et al., Intel: https://t.co/4ji4iA45MF """Kernel Approximation Methods for Speech Recognition,"" May et al.: https://t.co/w3EeNaR92R ""comparable to DNNs""" "Deep Probabilistic Programming," @dustinvtran et al.: https://t.co/XS5pom1z9c RT @DanaSchwartzzz: How to predict Donald Trump's response every single time: https://t.co/qSvSuqzDjp @nsaphra will check it out, thanks! @nsaphra thanks! @nsaphra ooo, interesting, had been thinking about a linear algebra textbook. Do you have to already have a fair amount of linag knowledge? RT @Pinboard: If you liked my Superintelligence talk, you may also enjoy this very courteous and charitably argued rebuttal: https://t.co/T… @emptyflare don't think I'd count it as a textbook, but thanks for sharing - haven't read it. What's the best textbook you've ever read? RT @SCSatCMU: Human poker players stage a comeback in 4th day of #BrainsVsAI but still trail Libratus #AI https://t.co/ZdeEecgQdO @WinBigRi… RT @ChinaFile: Rich Chinese, Inspired by ‘Downton,’ Fuel Demand for Butlers —  — https://t.co/vWZdRpkXdG RT @AdrienneLaF: A plan to evict the press corps from the White House is “under serious consideration” by the Trump administration https://… @davegershgorn hey should have ended with something about fake news "SAD!" Winning strategy. Conclusion: worth checking out, but worry some will see the 2035-2075 thing + conclude not much to worry about b4 then. Maybe, maybe not. @blake_AI indeed, very hard. Interested in your thoughts! @jeffbigham @ReachSiv useful/cost-effective, basically. Their model~: mass diffusion time=time til demo in lab+product made+large adoption. @beaucronin I think it *won't* take a long time. For them, the slow progress bound is like, 2050s+, I'd say like 2030s. @jeffbigham here's their def. https://t.co/disFM2Qsbg ..and just as wrong to say we currently have median-level. Anyway, as I said, they deserve props, but just beginning of serious projections. E.g. sensory perception - extraordinarily unlikely (by my reading of the trends) it'll take til 2050s+ to have superhuman AI there. Likewise for saying we have top quartile human-level info retrieval and "optimization/planning." Other things seem wrong in other direction. ...and to say we already have median human-level natural language generation=obviously false. They have to abstract/simplify, but still. Some specific examples of things I think are contestable: ~2.5-8 years to develop a "sensory perception" tech after feasible...seems long https://t.co/lKpj0g800o There's stuff on other pages that matter/are worth reading, good overall, but that's the core of their temporal projections, + very tricky. @ChiefScientist dunno if anyone has for job automation reports specifically, but there are 4 tech forecasts. e.g. https://t.co/tHPTZACaO2 @jeffbigham that's what they say. 5% of jobs can be automated wholesale, 60% of jobs have 30%+ of tasks that can. Task-level projections. ...but check out the report and lemme know what u think. Key tech feasibility stuff is on pgs 4, 35, 72, 74, +120-24 https://t.co/2hKV5ESuxw The ranges they came up with cover a fairly broad range of timelines, but still, as mentioned earlier, seem a bit conservative to me. ...and the appendix boils down to "we asked people, looked at some metrics, and came up with ranges." Thought provoking but not v. decisive. Which is a good approach, and no1 had really done that seriously before. Props for giving such assumptions, but the feasibility part is key, ...skeptical of temporal aspects. Basically, they estimate how long b4 X is technically feasible, b4 X is productized, and b4 X widespread. Few more thoughts now that I've finished the report: def. the new state of the art in terms of automation impact projections, but still+ @ivan_bezdomny nice. :) I miss American food... RT @DavidCornDC: A joke, right? https://t.co/DjSRMsIDSm *or rather, too long-term, not too narrow, as mine is narrower. Point was just that I think they're too sure not much happens before 2035. On a more positive note, I think their scenario approach is good + the factors they point to re: slowing/speeding things up are reasonable. Their upper end of potential autom. GDP contribution also seems v. low, but perhaps consistent w/ other assumptions they make I disagree w/. @hannahgais lol. he blocks everyone apparently. (by "potential realized" I/they mean "~half of stuff ppl do now automated," not half of jobs gone, or full automation potential realized) ...and potential realized in ~2055 +/- 20 years. Think it's more like 2035 give or take 10, + tech will progress faster than they suggest. Basically, they say: ~half of tasks ppl do today automatable, but factors inhibit that happening, more job change than wholesale replacement Reading new McKinsey report on automation - agree w/ much, esp. re: barriers to large impact soon, but think their scenario range too narrow @davegershgorn if convenient and you wanna pet wallabies and coatimundis, go to the deer farm in Williams AZ RT @ivan_bezdomny: My take: the match shows how close humans can play to equilibrium, despite using mostly patterns and feel, little bit of… RT @ivan_bezdomny: Humans book win in morning session. Libratus 🤖 lead down to $10/hand (50/100 blinds, 20k stax). @heyitscheet best and on… @Grady_Booch this is a fake story FYI @rcalo SAD! @ivan_bezdomny no, but I had just been watching Les as it had more guests/commentary :) @ivan_bezdomny it's on break at the moment @ivan_bezdomny is hanging out with Jason Les on the livestream at the moment. Hi, Nikolai :) https://t.co/vj0nvVICGG Jason Les is having a good day, but the AI lead is still growing - all humans are negative now. #BrainsVsAI https://t.co/g0BadnykDP "RT @yashar: Donald Trump on John Lewis: "" All talk, talk, talk - no action or results. Sad!"" https://t.co/ykGp3FUHDY" @elonmusk congrats! cont'd https://t.co/zRTF00k7N1 The National Intelligence Council's Global Trends report has zero chill. https://t.co/MDMcidGBTo @tetisheri interesting stuff, prison Mike RT @AmazingSpace2: #Spacex Incredible first stage landing of the Falcon-9 https://t.co/q9on0Pk29c RT @paleofuture: ...and you'll never guess who recently joined their ranks https://t.co/16mhtVTuEa RT @paleofuture: One America News (OANN) is the news org that Trump called on during his press conference which predictably gave a softball… RT @RyanLizza: The president elect has started the Martin Luther King holiday weekend by attacking John Lewis, one of the great heros of ci… RT @antgoldbloom: Very proud to announce the launch of a $1MM competition to use AI to diagnose lung cancer from CT scans https://t.co/ZBse… @_jyan_ hmm. Why do you think you and he disagree on this? Referring to same thing? Maybe harder for less educated ppl? I always forget about this factor but it makes perfect sense... from @AndrewYNg https://t.co/w5zzc0v9Ah https://t.co/PDp7SdIL9w "What is this... a wall for ANTS?" https://t.co/XH3W0hrjeJ @beaucronin @pmarca chin scratch emoji. Interesting read...check it out before the NIC site is replaced with an ad for L.L. Bean. https://t.co/UCYb4LWUGQ Says it uses custom variant of counterfactual regret minimization, will say more after competition, has some "cool innovations." @katyanna_q @katyanna_q ask a Q on Twitch :) @katyanna_q stuff more like they've used b4, I assume (abstraction, lots of non-deep learning)? Dunno, haven't read all the interviews :) Noam also says Libratus does not use deep learning (unlike DeepStack). Quoting him from this livestream where he's hanging out with Jason Les while he plays, and occasionally answering Qs https://t.co/5cMK3qhw9n (that's a lot more than DeepStack, for what it's worth) Noam Brown on how many games Libratus has been trained on: "trillions." @beaucronin sounds like he's joining the administration... Things aren't looking great for most of team human so far at #BrainsVsAI -see @ivan_bezdomny's blog post on it here: https://t.co/8MMAa0Six1 https://t.co/jhXdC3j6ub @ilyasut @gdb @OpenAI interesting, thanks! :) RT @ilyasut: @Miles_Brundage @gdb @OpenAI run https://t.co/rpXAYsQcip on non-VNC pong with a big enough machine (at least 32 cores). It'l… @gdb @OpenAI (guessing that eng. could get A3C from ~4 hrs in original paper to 1, but something else needed for 10 mins) @gdb @OpenAI nice post! Curious about 1 hr Pong business - sounds like A3C+good engineering? Maybe I'll need to stay tuned 4 results soon :) RT @gdb: Defining the CTO role at @OpenAI: https://t.co/6t5yvK83Pu (Reference: https://t.co/IW9VeoFAir) https://t.co/8giYi8pV2r RT @jackclarkSF: Microsoft acquires Maluuba, a Canadian AI startup that specialized in NLP and NLU tech https://t.co/Za2EhSPY4C @gosainnn congrats! RT @ivan_bezdomny: I just published “AI vs poker pros (advantage 🤖)” https://t.co/XFuZtz3cHG RT @ericjang11: "I don't want to live in a world where someone else democratizes A.I." https://t.co/JK0rvJWkRV RT @hardmaru: "Coming together to democratize AI" is the new "Making the world a better place" RT @jackclarkSF: UK AI people - I shall be in London on the 17th. Do you want to meet up? Let me know! Jack at OpenAI RT @HMRoff: Nothing to see here people...move along... Russia hasn't also just hacked CSpan. https://t.co/WYmeR2hhWU @sknthla how would stock be affected if acquired? @sknthla why Mobileye? All I know is they have some good AI papers. (actually a lot more plausible big AI acquihires around than that, just 2 from that list) And then there were two... https://t.co/cV0CyNbQoB RT @gosainnn: The big announcement: Microsoft acquires deep learning startup Maluuba https://t.co/wTiXgEP64D Don't nec. agree with how this is phrased but it is an important report. https://t.co/1LMPB31SqV RT @S_Gehrmann: @Miles_Brundage I built two corpora (ACL and Pubmed) in exactly this format. Will release in ~1 month. RT @eytanadar: @jeffbigham @sprobertson @Miles_Brundage yeah related: https://t.co/0wDyHzvp7Z, also: extracting cites (accurately) is a has… @iandanforth @allenai_org Not aware of them making a Word/Google Doc plugin type thing as I envisage but some of their stuff is def relevant @chris_brockett like doing a lit review and it only suggests stuff u missed, and stuff you didn't miss is now additional context. @chris_brockett Dunno...could imagine it being helpful even if those not differentiated, but maybe less so. Or useful at 1 stage not others, Dunno. Still need to extract context, though, and they may just get citations without context. https://t.co/woY6IjmzAO RT @Ted_Underwood: @Miles_Brundage Wait, how does Google Scholar do it, then? They seem able to. Like a bunch of labels of different types of citations, reference/bibliography/etc. headings, etc. Yeah, haven't looked closely at this but seems surprisingly unsolved. Maybe you'd need human labels to bootstrap... https://t.co/BdsYUW0106 RT @sprobertson: @Miles_Brundage been thinking of this, extracting cites from PDFs seems like the biggest step for some papers, there are perhaps enough (thousands+) citations to get OK model of context - for low cite, citation/context vector mapping? (context = perhaps initially the sentence which has the foot/endnote at the end of it, but perhaps more or less would be helpful). Maybe other probs, curious what ppl think. Would be useful esp if combined w ref manager., though maybe --> ref singularity w/o page limits. ...of citation/context pairs, i.e. citation (inc. variants)+context. Then given new paper, suggest cites. Data gathering=harder part? (2/2) AI application: info retrieval/ML-based AI research assistant focused on citation suggestions. Training data: millions of papers worth (1/2) Maybe should have been AlgerNN. Oh, well. Flowers for Algerneurons... https://t.co/KEn4uXhe2k Reading sample responses generated by neural nets in descending or ascending order of quality feels like reading Flowers for Algernon... Just about to the point where people would rate most full length tweets as at least "acceptable"... https://t.co/1eyllufRCN "Simplified Minimal Gated Unit Variations for Recurrent Neural Networks," Heck and Salem: https://t.co/yZvVI9opT6 "Modularized Morphing of Neural Networks," Wei et al.: https://t.co/7VdJd8RH8g "LanideNN: Multilingual Language Identification on Character Window," Kocmi and Bojar: https://t.co/L6eIIJcwAh """Scaling Binarized NNs on Reconfigurable Logic,"" Fraser et al.: https://t.co/WoP3gnUIBm ""classify images at 12 kFPS"" :-O from Xilinx folks" "Attention-Based Multimodal Fusion for Video Description," Hori et al.: https://t.co/PqRWqKjUmI "Looking Beyond Appearances: Synthetic Training Data for Deep CNNs in Re-identification," Barbosa et al.: https://t.co/UpWiHfubzU "Parsing Universal Dependencies without training," Alonso et al.: https://t.co/s4ueeBjIq5 "An Empirical Comparison of Simple Domain Adaptation Methods for Neural Machine Translation," Chu et al.: https://t.co/jezCp2Yrir "Generating Long and Diverse Responses with Neural Conversation Models," Shao and Gouws et al., Google: https://t.co/Ai5dHoexNi RT @McKinsey_MGI: Our new report on #automation is out; "A future that works: Automation, employment, and productivity" https://t.co/DnTNOb… @rcalo @lanepowell @UWSchoolofLaw congrats! RT @beaucronin: Still so much to do - please take it for a spin, file issues (& PRs!), get in touch on gitter. A long road ahead (I hope),… RT @beaucronin: What is the potential of VR to fundamentally change our understanding of data? Here are some hypotheses. https://t.co/i09sP… RT @beaucronin: Today I'm releasing 0.1.0 of embedding.js, a library for creating responsive & immersive data-driven environments. https://… RT @ericjang11: Summary of our team's work in 2017 by Jeff Dean. Check it out! https://t.co/rHEVKqUx8m RT @starsandrobots: This is what my team at @otherlab have been working on! 😁 https://t.co/i5V7lH0O1P RT @mat_kelcey: bunch of ppl have asked about starting in robotics; i highly recommend https://t.co/Py5HAWHIKx i found it useful (as non tr… RT @josipK: @Miles_Brundage Don't bother: arXiv is FAKE NEWS. Very unfair! "Decoding as Continuous Optimization in Neural Machine Translation," Hoang et al.: https://t.co/HBqFK8iYgJ "A Unified RGB-T Saliency Detection Benchmark: Dataset, Baselines, Analysis and A Novel Approach," Li et al.: https://t.co/6ZPcnCipfV "OpenNMT: Open-Source Toolkit for Neural Machine Translation," Klein et al.: https://t.co/XqMXXMVWPu "Bidirectional American Sign Language to English Translation," Cate and Hussain: https://t.co/4B4k5P3qYy "A More General Robust Loss Function," Jonathan Barron: https://t.co/O7U2KY3aaO "Modeling Grasp Motor Imagery through Deep Conditional Generative Models," Veres et al.: https://t.co/QZx34IoYNb "Stochastic Generative Hashing," Dai et al.: https://t.co/ws47yCjyTM "Modeling Retinal Ganglion Cell Population Activity with Restricted Boltzmann Machines," Zanotto et al.: https://t.co/SkElABqQZ4 """Context-aware Captions from Context-agnostic Supervision,"" Vedantam et al.: https://t.co/vyFpsG8pgf Looks like great captioning results..." "Generalisation in Named Entity Recognition: A Quantitative Analysis," Augenstein et al.: https://t.co/ArO2ZzwY48 "A Multifaceted Evaluation of Neural versus Phrase-Based MT for 9 Language Directions," Toral and Sanchez-Cartagena: https://t.co/PMzvB3vJmJ "Termination of Nondeterministic Recursive Probabilistic Programs," Chatterjee and Fu: https://t.co/AUUSFQyoWn "Cross-lingual RST Discourse Parsing," Braud et al.: https://t.co/Fq7Is9596I "Distinguishing Antonyms and Synonyms in a Pattern-based Neural Network," Nguyen et al.: https://t.co/wiDirUK2C4 "Revisiting Deep Image Smoothing and Intrinsic Image Decomposition," Fan et al.: https://t.co/8lWUVLSVDc "RUBER: An Unsupervised Method for Automatic Evaluation of Open-Domain Dialog Systems," Tao et al.: https://t.co/NeqnXJewup "The paradigm-shift of social spambots: Evidence, theories, and tools for the arms race," Cresci et al.: https://t.co/YyoTYRQKGJ @nerdherdempire @fchollet this wasn't from today ;) RT @kchonyc: @Miles_Brundage should've been 'SAD!' not 'Sad!' (this is what happens when I eagerly wait for arXiv updates after a day of Trump news, apparently. sorry) I'm hearing unconfirmed reports that Trump thinks deep reinforcement learning is lame, doesn't see the need for function approximation. Sad! RT @elizabeth_joh: Jobs: NYT also looking for a cybersecurity reporter & an emerging tech reporter based in SF. https://t.co/hey8xMvBAA RT @MaddowBlog: In case you thought it was weird for there to be applause at a press conference, yes, it was. https://t.co/VysRz0YPwn RT @morganhousel: "Never make fun of people for mispronouncing a word. It means they learned it by reading." @daviottenheimer also, even if the crazy arg were true (only qualified if *had* $ interest), can still divest once taking the office. Sigh @justinhendrix @poniewozik seems like the answer's clearly "no." Trump had done this sort of thing before (Ramos), pretty foreseeable... :/ @trochee wtf, so dangerous. "Contrarian." https://t.co/RlQj238FZT https://t.co/e08QFbNHyW @rebecca_roache pretty sure he puts quotation marks around every 10th or so word randomly. RT @botsalive: Our @bradknox shares bots_alive and live demo at the #CES2017 @TechCrunch stage with Devin Coldeway. https://t.co/lXGVxxwXqI @halhod sounds like you can't? T"he integration modifies the behavior of people within GTA V to be non-violent." CC @jackclarkSF Here's the video of Trump's press conference. https://t.co/V3M1mmlUSl RT @jtlevy: You know who doesn't have grounds to complain about publicizing unverified claims from anonymous sources? https://t.co/fPSaZGw5… RT @OpenAI: GTA V + Universe: https://t.co/2bpZ6QNv4R RT @SCSatCMU: Play is underway for #BrainsVsAI @WinBigRivers. 120,000 hands of heads up no limit Texas Hold'em poker to go. Go Libratus! RT @sallykohn: But he will not divest himself. He can make decisions in office that will benefit him and his empire financially. https://t… RT @steve_vladeck: It'd be one thing if @realDonaldTrump argued that Emoluments Clause doesn't apply. Just ignoring it makes me fear which… @byrdinator looks like the vast majority are empty... RT @AriMelber: Trump plans to accept & later "donate" hotel room profits from foreign states - Constitution calls for rejection of gifts, n… "RT @20committee: OMG Trump is quoting today's Kremlin press release on ""fake news"" AGAIN. Cloud-cuckoo-land, folks." @justinhendrix site run by Laura Ingraham. Unlike LifeZette, run by his possible future press secretary Laura Ingraham, known for hard-hitting journalism. https://t.co/RAJI0bd7WE RT @danieldewey: Steinhardt on learning latent variables for AI alignment / safety: https://t.co/IntxflkRkf "AdaGAN: Boosting Generative Models," Tolstikhin et al.: https://t.co/bieEaYjRD9 "Information Pursuit: A Bayesian Framework for Sequential Scene Parsing," Jahangiri et al.: https://t.co/w88BxypPT7 "Towards End-to-End Speech Recognition with Deep Convolutional Neural Networks," Zhang et al.: https://t.co/dqyFFdpGgj "Real-Time Bidding by Reinforcement Learning in Display Advertising," Cai et al.: https://t.co/nkftFiB0di "Reinforcement Learning via Recurrent Convolutional Neural Networks," Shankar et al.: https://t.co/d0Aqq1tV0S "RL based Embodied Agents Modelling Human Users Through Interaction + Multi-Sensory Perception," Mathewson/Pilarski: https://t.co/SrCePGV7SX "Unsupervised Image-to-Image Translation with Generative Adversarial Networks," Dong et al.: https://t.co/UNc28yHE9R "Clicktionary: A Web-based Game for Exploring the Atoms of Object Recognition," Linsley et al.: https://t.co/8YuvVs9gnr "See the Glass Half Full: Reasoning about Liquid Containers, their Volume and Content," Mottaghi et al.: https://t.co/q3Nb2ucixq "Automated capture and delivery of assistive task guidance with an eyewear computer," Leelasawassuk et al.: https://t.co/PaeEf0skQ8 "On Low Overlap Among Search Results of Academic Search Engines," Mitra and Awekar: https://t.co/dKpjhnbk0d "The `Star Wars' botnet with >350k Twitter bots," Echeverria and Zhou: https://t.co/kEU5eEIVWV "Scene Graph Generation by Iterative Message Passing," Xu et al.: https://t.co/mpRe4nfHfb "Unite the People: Closing the Loop Between 3D and 2D Human Representations," Lassner et al.: https://t.co/oicy2PavVQ "Multi-task Learning Of Deep Neural Networks For Audio Visual Automatic Speech Recognition," Thanda and Venkatesan: https://t.co/OvvABi9pYF "Implicitly Incorporating Morphological Information into Word Embedding," Xu and Liu: https://t.co/8VSfvaOkLo @benpopper interesting, thanks for sharing! RT @benpopper: @Miles_Brundage also, when I asked, DeepStack authors declined to speak until paper was peer-reviewed. RT @benpopper: @Miles_Brundage @jackclarkSF I covered both. CMU did explicit outreach, pitched the piece and made authors available. DeepSt… Maluuba video related to their paper "Towards Information-Seeking Agents." https://t.co/G4kBs4NO8e https://t.co/zodTbcpesh RT @Green_Footballs: Robert F. Kennedy, of course, is a very well-known anti-vaccination crank. @GingerGibson https://t.co/jc1xtd42zj @botminds @_jyan_ @jackclarkSF ideally we'd have DeepStack vs. CMU and DeepStack vs. best humans and CMU vs. best but prob too late now tho @botminds @_jyan_ @jackclarkSF results strong, suspect small range of human skills, + DeepStack used little hardware for value fn. Will see! @botminds @_jyan_ @jackclarkSF interested to see outcome, too, but would be surprised if DeepStack wouldn't also beat them... @halhod yeah they did, I assume Alberta didn't (yet) @halhod in this case, literally no one (last i checked) @halhod think ur prob right about those, but doesn't explain why CMU *did* get coverage (though maybe explains y not more/y no DeepStack) @botminds @_jyan_ @jackclarkSF I semi-randomly sampled one of the DeepStack opponents, and he was very strong. dunno re CMU @AnthroPunk https://t.co/7c87rfVkfT (early Feb, SF) @_jyan_ @jackclarkSF @smc90 awesome. thanks! @_jyan_ @jackclarkSF interesting. Would love your top recommendations (esp. if any in English, but I'm OK w/ using translation :) ) @snagglechud same. @_jyan_ @jackclarkSF interesting - thx! RT @SNFaizalKhamisa: find me a better highlight this year, I dare you. https://t.co/qG7L4JPTHJ Who's gonna be at AAAI this year? @_jyan_ @jackclarkSF curious about this account. Whose is it? @jackclarkSF @_jyan_ I'll send smoke signals next time... or a bat signal thing with a big A for arXiv @jackclarkSF you can't get everything every time ;) but surprised *no one* AFAIK has covered @jeffbigham the stories in question are separate, just on similar topic (planned public event, paper on private thing that already happened) @jeffbigham broke agreemt? I just meant that bothering to do vs not do a press rel explains press coverage, not that anyone did smthng wrong @jeffbigham CMU's poker folks are great/deserve coverage, but ditto for Alberta. strange asymmetry. I'm guessing press release broke symmet. Or: no cool pics? Not yet peer reviewed? Etc. (but some of those apply to the CMU thing too, and Bowling et al. are credible). Why no coverage of DeepStack? No press release? Not tech company? *chin scratch emoji* CMU maybe doing X soon was, Alberta doing X was not.. The National Intelligence Council's latest Global Trends report: https://t.co/FRK1ADyTVJ "Shallow and Deep Networks Intrusion Detection System: A Taxonomy and Survey," Hodo et al.: https://t.co/dvT5fNc9iH "Crowdsourcing Ground Truth for Medical Relation Extraction," Dumitrache et al.: https://t.co/rOyT0pgoI6 "DeepDSL: A Compilation-based Domain-Specific Language for Deep Learning," Zhao et al.: https://t.co/ajGPKLPUy0 "Neural Personalized Response Generation as Domain Adaptation," Zhang et al.: https://t.co/9nMUcsNaMP "Improved Texture Networks: Maximizing Quality + Diversity in Feed-fwd Stylization+Texture Synthesis," Ulyanov et al https://t.co/jS877X0aEc "Towards Accurate Multi-person Pose Estimation in the Wild," Papandreou et al.: https://t.co/EFc8KUhz7a "Unsupervised Learning of Long-Term Motion Dynamics for Videos," Luo et al.: https://t.co/R7lu4EPg51 "Classification Accuracy Improvement 4 Neuromorphic Computing Systems w/ One-level Precision Synapses," Wang et al.: https://t.co/7hX9VqmQwC "Oriented Response Networks," Zhou et al.: https://t.co/KpjJ0qsqcQ "Tracking The Untrackable: Learning To Track Multiple Cues with Long-Term Dependencies," Sadeghian et al.: https://t.co/7qic0qA1gt "Random Sampling and Locality Constraint for Face Sketch," Wang et al.: https://t.co/c0eJ6k0bN0 "On Classification of Distorted Images with Deep Convolutional Neural Networks," Zhou et al.: https://t.co/wtnroAnWSB "RT @nerdherdempire: Just published my first paper! More to come! ""QuickNet: Maximizing Efficiency and Efficacy in Deep Architectures"" https…" @robinsloan (and, well, the actual bee drones) @robinsloan it sounds just like the eery music on the bee drone episode of Black Mirror "Cyber Threats and Nuclear Weapons," talk by @andrewfutter: https://t.co/aRqx24e0T1 "Learning From Noisy Large-Scale Datasets With Minimal Supervision," Veit et al.: https://t.co/Zajcdzf0Xv "Abnormal Event Detection in Videos using Spatiotemporal Autoencoder," Chong and Tay: https://t.co/Q92F1ek6pt (more substantive, over 1k citations...*actually* written by Secretary of Energy + head of ARPA-E. Don't think we'll see Rick Perry do same) Obama's thing in Science on energy looks OK but my fave energy publication from sitting officials this admin = this: https://t.co/IGz8bXmVAf RT @marcgbellemare: $69.5M to Compute Canada, without which there'd be no Arcade Learning Environment today #computecanada #canadianai http… RT @hannawallach: Samy Bengio, Rob Fergus, SVN Vishwanathan & I are program co-chairs for #NIPS2017. Who do you want to see as an invited s… @ntenenz hmm - interesting! thanks :) @ntenenz hmm. Don't know anything about Omha H/L, unfortunately. What's yours? :) @filar thanks! In the case of DeepStack, literally #Torched (they used Torch for deep learning). https://t.co/UeVBd0yLK8 Some new AI forecasting stuff to share soon, hopefully... also, I should have made a poker AI forecast, would have helped my Brier score :) @marwinsegler hmmm... RT @ivan_bezdomny: Next year we'll move into 6-max NLH AI, hopefully. Humans #torched 🔥🔥🔥 RT @ivan_bezdomny: Congrats to both the U-Alberta and the CMU poker teams on this week's significant results! RT @weballergy: Deep Class-Aware Denoising: fine-tuning the models on specific classes. #deeplearning https://t.co/Zw6m5WRuVK @yoavgo @egrefen could go the Japanese route - literally behind the scenes. https://t.co/5LpTA7d31P @ivan_bezdomny what do u mean "there's a solver every time"? @ivan_bezdomny I suspect it is a Science paper released early because of CMU @ivan_bezdomny based on formatting (similar to HULHE is solved paper on Bowling's site), + mention of professional figures being made, @_jyan_ agreed @halhod heads up limit is "essentially" solved (by same ppl) but no limit is bigger action space @_jyan_ dunno, haven't read whole paper yet but this could have broader implications. BTW, also possible DM working on 3+ player poker.. @_jyan_ but yes, Alberta gets the prize :) worse for CMU bc they announced big competition days ago @_jyan_ they have pubs broadly in this vein (deep RL approach), but dunno if (shoulda) put much effort into this. Not their comp advantage? (like, literally looks like - formatting, mention of future figure improvements, etc.) Look fwd to comparing the (presumably) fairly different CMU and Alberta et al. bots, + computer poker tourney entrants, in a few weeks... This looks like it'll be another Science paper... will need to keep picking his brain at conferences :) Sidenote: Bowling is good predictor of his team's future AI progress :) didn't quote at time but he said something consistent w this ~yr ago P.S. just got off a flight so sorry if this is old news on AI Twitter already :) This follows up on this from a week or so ago showing exploitability of existing bots - new one is improvement: https://t.co/JWxWdWzuVj Also, Alberta et al. just human-level HUNLHE scooped CMU, no? CC @ivan_bezdomny (not surprised but very cool - look forward to reading! from some of the same folks behind Cepheus) "DeepStack: Expert-Level Artificial Intelligence in No-Limit Poker," Moravcik et al.: https://t.co/780T1eUIUt "RT @hardmaru: TensorFlow implementation of The Predictron: End-To-End Learning and Planning Paper: https://t.co/oVMGfpKEzw Github: https://…" RT @harrisj: The irony of using “drain the swamp” as the defense for disregarding the ethics rules that have been in place for decades… htt… RT @mark_riedl: David Ferrucci, head of the team that made IBM Watson to play Jeopardy!, has a new, ambitious startup https://t.co/Naxy9OK1… @levendowski late reply but: interested! Nice list. "RT @ashleyfeinberg: things trump cares enough about to tweet himself: tv ratings things aides have to tweet about for him: son’s birthday,…" "RT @LibyaLiberty: Breitbart: 1,000-man mob chanted Allahu Akbar & burned down a church while waving AlQaeda flags. Police:It was a small f…" RT @marwinsegler: Teaching neural networks to design drugs against malaria: our new paper https://t.co/t0hHMzMS0u @NickDHaynes @DeepDrumpf I have and it's great, but want to see video brought into the mix :) AI people: Trump speech model, go go go https://t.co/s3nARD6jTM "Expanding Subjective Lexicons for Social Media Mining with Embedding Subspaces," Amir et al.: https://t.co/Pa8kceB49p "Interactive Movie Recommendation Through Latent Semantic Analysis and Storytelling," Wegba et al.: https://t.co/rjzm0w8VLJ "Video-based Person Re-identification with Accumulative Motion Context," Liu et al.: https://t.co/RcYuggyCka "Aspect-augmented Adversarial Networks for Domain Adaptation," Zhang et al.: https://t.co/VJP6wqAgDi "Self-Taught Convolutional Neural Networks for Short Text Clustering," Xu et al.: https://t.co/G7ZYluEpDf "Improved Stereo Matching with Constant Highway Networks and Reflective Confidence Learning," Shaked/Wolf: https://t.co/NiKx3sfMfi "Lifting from the Deep: Convolutional 3D Pose Estimation from a Single Image," Tome et al.: https://t.co/f1sMHlOZbX "STRIPS Planning in Infinite Domains," Garrett et al.: https://t.co/sqQ11lWr2k "Weakly Supervised Semantic Segmentation using Web-Crawled Videos," Hong et al.: https://t.co/4AN6cnJbtw "Adversarially Tuned Scene Generation," Veeravasarapu et al.: https://t.co/J2TC2yWv45 "Can simple transmission chains foster collective intelligence in binary-choice tasks?," Moussaid and Yahosseini: https://t.co/zVyy6Adn7u "Deep Neural Networks to Enable Real-time Multimessenger Astrophysics," George and Huerta: https://t.co/3kjwcElkmk "Conceptual Spaces for Cognitive Architectures: A Lingua Franca 4 Different Levels of Representation," Lieto et al.: https://t.co/XnpEIYO0Xd "Deep-HiTS: Rotation Invariant CNN for Transient Detection," Cabrera-Vives et al.: https://t.co/Atv7RBgvjf [astronomy] "Dynamic Deep Neural Networks: Optimizing Accuracy-Efficiency Trade-offs by Selective Execution," Liu and Deng: https://t.co/LjLtSBmiua "Outlier Robust Online Learning," Feng et al.: https://t.co/jrY9d6eoBM "RNN-based Encoder-decoder Approach with Word Frequency Estimation," Suzuki and Nagata: https://t.co/pX3qeNxWY8 "On (Commercial) Benefits of Automatic Text Summarization Systems in the News Domain," Modaresi et al.: https://t.co/tma5dAFkRS "From Preference-Based to Multiobjective Sequential Decision-Making," Paul Weng: https://t.co/90eyNGE9Ed "Robust and Real-time Deep Tracking Via Multi-Scale Domain Adaptation," Wang et al.: https://t.co/DhpB3tyn4u "Textual Entailment with Structured Attentions and Composition," Zhao et al.: https://t.co/F1p08mVac2 "Approximate Value Iteration for Risk-aware Markov Decision Processes," Yu et al.: https://t.co/3kBFnqp2hb "Autoencoder Regularized Network For Driving Style Representation Learning," Dong et al.: https://t.co/2Nl18wz3Wp "Learning from Synthetic Humans," Varol et al.: https://t.co/Z2afxZNwc3 "Generating Focussed Molecule Libraries for Drug Discovery with Recurrent Neural Networks,' @marwinsegler et al.: https://t.co/TvDbOGMYnB RT @mlcalderone: Steve Bannon is meeting with @elonmusk, per pool report. Cool story, bro. https://t.co/aQih20Khgv "Toward negotiable RL: shifting priorities in Pareto optimal sequential decision-making," Andrew Critch: https://t.co/EnKZ7k9Ikl RT @cortney_dc: This will have repurcussions for US relations with countries where sensitive matters are at stake. #statedept RT @cortney_dc: US #ambassadors are being fired & forced from critical #diplomatic posts *months* b4 their replacements will arrive https:/… RT @pwnallthethings: So the answer here is "in less than a day the various IC heads will drive all the way to NY to tell you exactly why" h… RT @carpedm20: Apple's Simulated+Unsupervised (S+U) learning in #TensorFlow https://t.co/SsdIuRxpoU RT @googleresearch: Just seven months into the Google Brain Residency program, our first group of residents are already making an impact ht… (this bears on whether the nearly 900% mean Atari score recently reported is comparable to the others in the historical mean trend) For those who care: commenter alex suggests the PGQ paper has evaluation differences from others. Will investigate. https://t.co/ggy6UCsGXj The limitations of past HW=now conventional wisdom, just interesting to see this acknowledged in the past (h/t @SamanthaWork for the report) DARPA report on neural networks in 1989 concluded (among other things) that hardware was a big barrier... https://t.co/dGKMkA8M8H RT @NandoDF: Nice! Well done @iassael training LipNet for lip reading in noisy car domains. Exciting collaboration with @nvidia https://t.c… @halhod that that'd be focus of bad AI detection. More like making $ on stock market, hacking, etc. Playing Go = conspicuous + not helpful @halhod dunno if they have any such stuff at the moment but in principle, anomaly detection/monitoring of chatter could, maybe, but unlikely @j2bryson on the supplementary page for post, I link to AlphaGo post which discusses this, but should check if there is PPT stuff not there @BVLSingler look fwd to reading! :) RT @ivan_bezdomny: Super-human on Montezuma I believe. StarCraft seems hard with deep learning -- for now. I'd be pleasantly surprised. Tra… @ivan_bezdomny had to google jermajesties...didnt really help though :) Just tweeted some stuff from arXiv today, will get to yesterday and the day before in the not too distant future :) "Stochastic Planning and Lifted Inference," Khardon and Sanner: https://t.co/RIM1nj33Ee "Demystifying Neural Style Transfer," Li et al.: https://t.co/1fa56ccSVm "A Taxonomy of Privacy Constructs for Privacy-Sensitive Robotics," Reuben et al.: https://t.co/T8bwZlfNUm "Learning a Mixture of Deep Networks for Single Image Super-Resolution," Liu et al.: https://t.co/qnLRgUcKMd "Constrained Deep Weak Supervision for Histopathology Image Segmentation," Jia et al.: https://t.co/VgTY4gwwcx "SalGAN: Visual Saliency Prediction with Generative Adversarial Networks," Pan et al.: https://t.co/EEdtE3Z4aR "A K-fold Method for Baseline Estimation in Policy Gradient Algorithms," Kota/Mishra/Srinivasa et al.: https://t.co/cLRJl99ASJ "An Interval-Based Bayesian Generative Model for Human Complex Activity Recognition," Liu et al.: https://t.co/LdR875SNcf "Dense Associative Memory is Robust to Adversarial Inputs," Krotov and Hopfield: https://t.co/yRtxGArel7 RT @botminds: @Miles_Brundage It would be better if your regression techniq was a gaussian process. Right now overfit to data, no uncertain… @j2blather @j2bryson and yeah, might be good to go in R&R @j2blather @j2bryson it will at least greatly reduce difficulty of putting in a paper :) work's mostly done now Cc @j2bryson, one of the folks who has encouraged me to write this up :) @togelius or tweet, or blog post comment. anything timestamped :) at least if Twitter doesn't add retroactive edits @ArtirKel @Aelkus same, no pref @ArtirKel @Aelkus works for me @DrLukeOR @jackclarkSF originally 97 or 98%... I guess if I were wrong, I'd have bigger worries than my Brier score, but reduced anyway :) @Aelkus @ArtirKel (b/c large space of possible competition designs...who chooses races, how many games, etc.). But Im flexible re def of pro @Aelkus @ArtirKel if competition announced before results announced, easy for us to agree. Rules specified now probably will be violated tho @ArtirKel OK! Works for me :) Cc'ing a 3rd party @Aelkus who can perhaps verify? feel free to suggest 2 others if u want, majority rules @DelftScott thanks! And of course, it's a great book! @ArtirKel sure, up to $100 at the odds I gave? Needs better specification for the professional one, though. Competition one pretty clear. @togelius we'll see :) feel free to register your own forecast if you haven't already! RT @togelius: Always interesting and illuminating to read @Miles_Brundage 's forecasts. Too bullish about StarCraft AI performance though,… @ivan_bezdomny @verge hot off the press https://t.co/rzqLGysyfy RT @Ted_Underwood: Some data hinting that ML is improving exponentially (at least when it comes to playing Atari!) https://t.co/LKmLxWtIu0 I forgot to make poker AI forecasts... but anyway, I'm pretty bullish on it. https://t.co/n341aJat2x "RT @ivan_bezdomny: Big league! Can't wait to see, and congrats to CMU poker research group ♠️❤️♣️♦️🤖🎲🍸👌 https://t.co/oqqH1K9mhC" Now that that's done, I'll be catching up on arXiv tonight :) New blog post: "My AI Forecasts--Past, Present, and Future": https://t.co/rzqLGysyfy RT @demishassabis: Excited to share an update on #AlphaGo! https://t.co/IT5HGBmYDr @neurosp1ke could you elaborate? This blog post on past/future AI predictions has been a lot of work :( hope some folks find it interesting! Perhaps posting tonight... @j2bryson @FrankPasquale Michael Wellman does work on high frequency trading... RT @MatthewGombolay: I am now Dr. Gombolay! My defense on human-machine collaborative optimization for robotics can be seen here: https://t… RT @goodfellow_ian: A tech report summarizing my NIPS tutorial on GANs https://t.co/v1rAvkjMC1 RT @timhwang: NIPS Field Notes: @jackclarkSF and I are launching a series of policy focused abstracts for recent papers in AI/ML - https://… RT @ivan_bezdomny: I just published “GANs will change the world” https://t.co/rpG62bQvOl RT @mustafasuleymn: Here's our review of some of the cool things that happened at DeepMind in 2016. Worth a read! https://t.co/276VIpJ1vZ RT @hardmaru: Perhaps announcing the use of machine learning will boost Fukoku Life's share price. https://t.co/SYKw9DWqcx "RT @nsfaber: What a loss of a great mind. #DerekParfit will be missed beyond philosophy and beyond Oxford. From ""Reasons and Persons"": ht…" @markus_with_k @_jyan_ @danieldewey indeed. cc @shivon @ivan_bezdomny will post it when I'm done :) @mjrobbins no prob - trying reach now, thx! @mjrobbins oh sorry, I misinterpreted ur tweet. Yes, those are good keywords! @mjrobbins all sorts of stuff. X will win this competition, median Atari scores btwn 190-250% by end of year, etc (approx. 50 on Twitter since 2013. Working on analysis of how they fared now, then making some new ones) "RT @ericjang11: Summary of NIPS 2016 https://t.co/dLRJnqpLeU #nips2016 #deeplearning" @mattsiegel yeah, I downloaded them from twitter. Huge CSV file. I've made a lot of different AI-related forecasts, apparently. @ClarkPolner thanks! Filtering my tweets to find stuff AI forecast-related - what keywords might I be missing? Forecast* predict* expect* extrapolat* trend* @j2bryson sounds perfect! @j2bryson only parts. It's on my to-read-more-carefully-soon list. RIP Derek Parfit. https://t.co/YqshFFj55N @GarrulousGeoff easier if the unit is millennia :) (it's optional, at least) My bank, @HSBC, is currently rolling out voice-based security. Given WaveNet, maybe not the best timing? "A Joint Speaker-Listener-Reinforcer Model for Referring Expressions," Yu et al.: https://t.co/FCtJcUMUO1 "Feedback Networks," Zamir et al.: https://t.co/Hp5UP59CJG "Automatic Discoveries of Physical and Semantic Concepts via Association Priors of Neuron Groups," Li et al.: https://t.co/52ip8ON8X3 "Action Recognition Based on Joint Trajectory Maps with Convolutional Neural Networks," Wang et al.: https://t.co/bRqXCaFE2C "Adult Content Recognition from Images Using a Mixture of Convolutional Neural Networks," Al-Shabi et al.: https://t.co/9AHGeEfjWE "Counterfactual Prediction with Deep Instrumental Variables Networks," Hartford et al.: https://t.co/lROGNqzDva "Adaptive Lambda Least-Squares Temporal Difference Learning," Mann et al.: https://t.co/Kw68KuvvyA "The Neural Hawkes Process: A Neurally Self-Modulating Multivariate Point Process," Mei and Eisner: https://t.co/7o9XP1vsOa @chrisalbon I've had downloads not work in Firefox (goes to webpage with gibberish/code? vs starting download) and Safari worked. maybe that RT @ankurhandos: just making my predictions for 2017 particularly in ML. https://t.co/yg5RU6E8vq - Hope we make more progress than I antici… Might write a blog post re: my prior AI forecasts and a few new ones for 2017 - anything I should be sure to consider re: the latter? RT @ericgeller: Trump's full remarks on cyber. "I have a boy who's ten years old, he can do anything with a computer." via @svdate @thisiss… RT @SamanthaWork: My MSc dissertation on corporate disruption & machine learning researchers is (finally) up on arXiv! https://t.co/REH5sEW… @sknthla https://t.co/HdlMVLAUyG RT @ManeeshJuneja: Japan is looking at safety certification for #AI #tech https://t.co/CHb0OXlJWe @johnchavens #DigitalHealth https://t.co/… RT @haldaume3: nice summary of some of the recent "impossibility" results https://t.co/EPzjo7PtW2 Good read on the risk of accidental nuclear launches: https://t.co/s7vvTgtU0l RT @alexjc: [8] 🎁 https://t.co/eK4Ps9lwl4 Presents a neural photo editor with a contextual paintbrush that uses the latent space of a gener… RT @alexjc: 🎄 This is an advent calendar of my favorite #generative R&D of 2016. View thread ↓ then click on 🎁 for explanations. Great year… @swirlOsquirrel well, we have a few weeks til Trump is officially the "state" but yeah, pretty much :( @alexjc @sknthla proud to be a fellow person. RT @mikarv: The sloppiness of data cleaning in broadcast journalism (Jeff is likely Joint Evaluated Fission and Fusion File). https://t.co/… RT @professorwcohen: Fellow NLP geeks, do you know of anyone working on training hate mail filters? Not sure if this Facebook feature is new or I just noticed it... useful source of data for them. https://t.co/6bPw1GEoNw @GilPress in the article, is the "30% annual" thing something Norvig said? / did he give examples? Not sure I've heard that before. TippingPoint's Zero Day Initiative is interesting: https://t.co/Xw2RpbG5sp Vulns shared w/ vendors before pub, tho sometimes they don't fix https://t.co/oy2NpMqVoT This sounds cool. https://t.co/dH9sitX9i0 RT @rbhar90: The new outrageously large neural networks paper seems like it could become very influential https://t.co/8nhv4LkKgL @j2bryson think both are involved! will check out the post. "... Quick reminder that this idiot will soon be the most powerful person in the world. ... https://t.co/BpAExwi1ZX" @daviottenheimer but anyway, yes, if I understand ur point, it is something to be worried about... @daviottenheimer didn't think the sanctions were anything like jailing or worse.. @daviottenheimer I thought u meant "Trump might do bad things to US engineers," this person = Obama doing (bad?) things to Russian engineer @daviottenheimer not sure I see the connection. One from Obama admin, one Trump..? u think she's telling the truth/it isnt mistake if so? @daviottenheimer what did you say before? @jeffbigham @AnaPopescu_SV expelling American diplomats I think RT @sedielem: @poolio this paper just got withdrawn, there was a mistake in the NLL calculation. See reddit for details. Too good to be tru… @aprilaser and lots coming out of their Noah's Ark lab on AI... RT @Miles_Brundage: New @FHIOxford working paper - "Policy Desiderata in the Development of Machine Superintelligence," Bostrom et al.: htt… @sknthla @johnkroencke works for me. i'm ~ Phillipe van Parijs + Skynet @sknthla @johnkroencke left-libertarianism if anything starting with lib other than liberal :) but yeah @sknthla why can't we all just get along and welcome robot overlords etc @sknthla I'm def conditionally optimistic, but prob not NLx ;) @sknthla what do the letters stand for? Neoliberal x/alt? @haldaume3 and I guess not just quality but also content - content/genealogy underconstrained by titles, authors are additional signal @haldaume3 and the fact that authorship is a noisy but still arguably useful signal of quality amidst flood of papers that could be read.. @haldaume3 harder to understand genealogy of ideas, or get in touch with others (unless some solution to these, e.g. anonymized author IDs), @sknthla have you read Artilect War (or summary thereof)? up your alley :) "The prevalence of chaotic dynamics in games with many players," Sanders et al.: https://t.co/uxswA8ki0M "Meta-Unsupervised-Learning: A supervised approach to unsupervised learning," Garg and Kalai: https://t.co/MCyisyCRAH "Deep Learning and Hierarchal Generative Models," Elchanan Mossel: https://t.co/LiQBX1Yas6 "Deep Semi-Supervised Learning with Linguistically Motivated Sequence Labeling Task Hierarchies," Godwin et al.: https://t.co/mrpgcZLKpz "Modeling documents with Generative Adversarial Networks," John Glover: https://t.co/jHZ2mqqA0m "From Virtual to Real World Visual Perception using Domain Adaptation -- The DPM as Example," Lopez et al.: https://t.co/bFm5mVqQGG "Learning Visual N-Grams from Web Data," Li et al., Facebook: https://t.co/BByOf3U9E9 "Deep neural heart rate variability analysis," Tamas Madl: https://t.co/80QHJ2Hj1p "A Deep Learning Approach To Multiple Kernel Fusion," Song et al.: https://t.co/4eyCEG5cqU "Semantic Video Segmentation by Gated Recurrent Flow Propagation," Nilsson and Sminchisescu: https://t.co/h3yHTUeMv3 "Unsupervised domain adaptation in brain lesion segmentation with adversarial networks," Kamnitsas et al.: https://t.co/j8vPTanTOG "Efficient iterative policy optimization," Nicolas Le Roux: https://t.co/gHOvgAAjdy "Here's My Point: Argumentation Mining with Pointer Networks," Potash et al.: https://t.co/TxOIF7sH6m """FastMask: Segment Object Multi-scale Candidates in One Shot,"" Hu et al at (mostly) Megvii: https://t.co/e4MqqiEXYS https://t.co/YAyyLYyNi9" @aprilaser agreed @sknthla or Veblenbeciles. [thanks, Google "idiot synonyms"] @sknthla Veblencompoops RT @gershbrain: The hippocampus as a predictive map https://t.co/jQRYxzKXOt "RT @HMRoff: This is Dangerous, myopic, illegal, operationally crazy, presently impossible and so short sighted that these two need some his…" RT @hardmaru: Based on my appearance, the machine at Tokyo Station recommended morning tea (11pm), "instant" clam-miso soup, or "instant" m… "RT @what_eats_owls: oops my hand slipped a whole bunch https://t.co/8b3qWlBoHc" RT @raywert: Tonight we light Menorah the Hutt to honor @CarrieFisher. For every RT tonight I'll donate $1 to mental health charity. (cc: @… RT @blakehounshell: What https://t.co/Hr3Y80xAXX RT @cszabla: I guess they didn't leave much money in the budget for marketing https://t.co/KRYhSv4xud RT @bradleyvoytek: Neat. If you inspect the code for a Facebook photo, alt text reveals Facebook's computer vision interpretation of image… Pretty sure that after meeting them/learning a bit about them, I'd admire a randomly selected person in the phonebook more than Trump. Headline=Obama>Trump in poll but more disturbing=15% of Americans admire Trump more than any other man in world, wtf https://t.co/D01qxfHoMo @davegershgorn would be surprised if Trump was familiar w/ other usages of term moonshot/said it himself/doesn't think it's a weapon @davegershgorn "a man going to the moon" is literally going to the moon again, though. RT @deanpomerleau: Impressive early response by Tesla Autopilot, leveraging mm-wave radar's ability to see under car ahead. 👍 @elonmusk htt… @ivan_bezdomny nope :) RT @ivan_bezdomny: @Miles_Brundage taking StarCraft to the streets? RT @sarahkendzior: Trump's gonna build a moon colony and *not* invite @newtgingrich, just to do it 😂 https://t.co/6PyHEUzp3b "ProjectQ: An Open Source Software Framework for Quantum Computing," Steiger et al.: https://t.co/5Nxe0v2ruY "Improving Human-Machine Cooperative Visual Search With Soft Highlighting," Kneusel and Mozer: https://t.co/j7pHqJcn6a "Brain-Swarm Interface (BSI): Controlling a Swarm of Robots w Brain+Eye Signals from an EEG Headset" Suresh/Schwager https://t.co/L87o3h1aMW "Cross-view Self-Identification and Human Re-identification in Egocentric and Surveillance Videos," Ardeshir et al.: https://t.co/ok5bRVUklK "Unsupervised Video Segmentation via Spatio-Temporally Nonlocal Appearance Learning," Zhang et al.: https://t.co/M8pmxwt7i4 "Globally Optimal Object Tracking with Fully Convolutional Networks," Lee et al.: https://t.co/aWqaUD1NfX "Image-Text Multi-Modal Representation Learning by Adversarial Backpropagation," Park and Im: https://t.co/u6DSS8wsLU "Abstractive Headline Generation for Spoken Content by Attentive RNNs with ASR Error Modeling," Yu et al.: https://t.co/wPqvgVa2b8 "An Automated CNN Recommendation System for Image Classification Tasks," Wang et al.: https://t.co/5lDcMGd95B "End-to-End Data Visualization by Metric Learning and Coordinate Transformation," Zheng et al.: https://t.co/RJYemCbnR0 "Learning Non-Lambertian Object Intrinsics across ShapeNet Categories," Shi et al.: https://t.co/2zy2ei1pqn "The probability of a computable output from a random oracle," Barmpalias et al.: https://t.co/vw6BNJrd23 "Theory-guided Data Science: A New Paradigm for Scientific Discovery," Karpatne et al.: https://t.co/8BpozxTHTw "Monte Carlo Sort for unreliable human comparisons," Samuel Smith: https://t.co/cHKlihj2xp "Parallel photonic reservoir computing using frequency multiplexing of neurons," Akrout et al.: https://t.co/psVTBFacpn "ASAP: Asynchronous Approximate Data-Parallel Computation," Kadav and Kruus: https://t.co/cUkvwanh4T Semantic Perceptual Image Compression using Deep Convolution Networks," Prakash et al.: https://t.co/nSqLmDbHal "Creating A Musical Performance Dataset for Multimodal Music Analysis," Li and Liu et al.: https://t.co/FrR12LQVzm @davegershgorn indeed "analyze/interpret decisions from neural model by observing effects on model of erasing parts of the representation" https://t.co/sDLu8ZQGQV RT @zacharylipton: In new post on Approximately Correct, @vkrakovna recaps AI Safety highlights from #NIPS2016 https://t.co/Cq0RmzQ2lP Totally normal, this is fine. https://t.co/QfjOo5UPbA @mikeyd_47 but generally speaking, yeah, interpreting drawings is harder when they aren't in the training set @mikeyd_47 well it's supposed to be both a rabbit and a duck, so I wouldn't blame it for either :) I'm being pretty adversarial here One more tweet... probably. In its defense, it was pretty unsure about the "bird." https://t.co/A8naN0rHL8 More arxiv tweets tomorrow, I'm tired, sorry :) "Understanding Neural Networks through Representation Erasure," Li et al.: https://t.co/ASlAo99u2s "Deep Probabilistic Modeling of Natural Images using a Pyramid Decomposition," Kolesnikov and Lampert: https://t.co/tBZLroTlqq "Steerable CNNs," Cohen and Welling: https://t.co/LrOcfoxcPd (pics to show that even I could get it to work) """YOLO9000 [""You Only Look Once""]: Better, Faster, Stronger,"" Redmon and Farhadi: https://t.co/NpQZRjN14T Code https://t.co/wIsv4YVgkF https://t.co/AyOrWwVZy3" @MatthewGombolay just when I was starting to be productive... ;) sounds great, will check it out, thanks! RT @MatthewGombolay: My paper on human-robot teaming was accepted to the Int'l Journal of Robotics Research! Pre-print here: https://t.co/d… RT @histoftech: Very sad to hear the news about Carrie Fisher. Sadder still because heart disease is the no. 1 killer of women in USA, & un… There's still a copy for $10k+, it just isn't the lowest price so isn't shown. https://t.co/hB3uXA0gg6 @Wikisteff except they're not photos from a library, they're synthetic. (shields self from tomatoes over misuse of jargon for the joke) @YadFaeq yeah, that's what I'm referring to. Previously, the cheapest was like, thousands of dollars, so this is an improvement over that :) The exploding gradients have returned... [@goodfellow_ian et al.'s deep learning textbook's price] https://t.co/TsD1tXMgCI @ankurhandos think the second slide is LeCun (bc he talks a lot abt unsup learning and "predictive" stuff) but not sure RT @deanpomerleau: Go @POTUS! Three weeks & counting. Trump's love affair w/ Putin & Russia gonna be put to the test. Things are about to g… @davegershgorn it's how i procrastinate sometimes @davegershgorn pretty big application, actually @mhbergen ah nvm im unhappy with what I said too. lol. @mhbergen i'd prob just cut "directly" and say "from vid" or something personally, but we all have our own tweet styles(+nits to pick) :) @mhbergen yeah tough one, had to say it tho; lots of "direct" learning from demonstration, for ex. @mhbergen specifically the from video part...directly doesn't really mean anything alone @mhbergen end of that clause was important... "RT @leahmcelrath: If they're only worried about their careers, I'd suggest they're suffering from a failure of imagination. Dark times ahe…" @robinhanson's Age of Em could be described in a lot of ways - unoriginal is not one of them. https://t.co/IuY96xzqUg @aprilaser you write good stuff! @FrankPasquale @profwernimont dunno if this is referenced but came out a few days ago - https://t.co/RHEcesv3st @y0b1byte @raybbecker yep; https://t.co/sZpom58yh5 RT @laurenevie_: Speaking openly and hopefully about mental health is difficult, even more so when the entire world has its eyes on you. Ca… RT @Bookgirl96: Carrie Fisher was an important mental health advocate. She made no qualms about letting people know what she had been throu… @davegershgorn or they're so stoked their brains exploded "I felt a great disturbance in the Force, as if millions of [truckers] cried out in terror + were suddenly silenced" https://t.co/KfsEhYhsMC @deliprao had same thing happen earlier for a text doc I was writing- much better upon rewrite on a different platform, glad i didnt send :) RT @NickAmadeus: When your book report has to be 100 words long https://t.co/jcL7f411AG @sherjilozair nice. sounds important; congrats! @sarahjeong excellent thread. @GarrulousGeoff *chin scratch emoji* @sherjilozair what does it do? There are much more important things happening right now (esp. Trump), but for the record, this is dumb. https://t.co/1iC2T1MfaU @rcheetham cc @mikarv RT @slashML: TensorFlow implementation of Value Iteration Networks (winner of Best Paper Award at NIPS 2016) https://t.co/3npzRW2weS RT @sarahjeong: drain the swamp https://t.co/nYBzaEoZ1V RT @markberman: If you're wondering why @realDonaldTrump was tweeting about his charity, he may've been watching @Fahrenthold on CNN https:… "RT @sparksjls: A few ""wonderful charities"" that received money from DJT Foundation: • Pam Bondi • Guy who painted a 6' tall portrait of Tru…" RT @Fahrenthold: Backstory on Trump Fdn. It appeared to violate laws by buying portraits of him, paying to settle his biz's lawsuits. https… RT @blakehounshell: It would be helpful if you would kindly release your tax returns. https://t.co/ie5EPAlUgY Iron Sky (about space Nazis advising Sarah Palin on a campaign, basically) is more realistic. Also, Steve Bannon is not discussed at all. Sad! Historical inaccuracies in Man in the High Tower... got the view from Trump Tower wrong, it's further North. https://t.co/mD96Ke5PXk "RT @ericjang11: An Early Overview of ICLR2017 https://t.co/sQcvyVWA9U" @sknthla cf. better analysis here https://t.co/uREvEZVn6h @jeffbigham @WIRED it's a new development. @sknthla *A Canticle @sknthla also have you read Canticles for Leibowitz? Not sure it wasn't written by time traveling Saku @sknthla post Trump, there are a lot more gigawarriors @SmithaMilli yass!! I might have to reread (and finally finish part 3 of the trilogy) at some point. Hope you enjoy! RT @goodfellow_ian: The Deep Learning textbook is back in stock. It no longer costs $10,000. https://t.co/V0roen5d7T "RT @y0b1byte: Hi! I'm collecting a dataset of humans playing Atari 2600 games. When it's ready, I will make it open. RT, please. https://t.…" @y0b1byte /not sure if id summarize right @y0b1byte tell me more? can RT a full tweet but not just URL Said person stressed they're not speaking for Trump but still troubling. Track record of transition so far = bad. https://t.co/cTkk4M5Ib4 RT @icracnet: "Trump transition team member says U.S. should not only oppose bans on [AWS] but lead the way in developing them." https://t.… @jackclarkSF @y0b1byte so an MDP (Merlot Decision Process) I'd guess at least one of them doesn't want to be, though. Feel like Schmidhuber et al might be in it for the long haul, but don't know him. Next few 9 figure AI acquihires - Maluuba, Cogitai, NNAISENSE...? RT @ArmsControlWonk: And, for the record, the two routes are (1) appearing to telegraph a decapitating strike and (2) publicly closing off… RT @ArmsControlWonk: So, @ThePlumLineGS asked me if I thought Trump could start a nuclear war by twitter. I could only come up with two dis… "Language Modeling with Gated Convolutional Networks," Dauphin et al.: https://t.co/nEKi4Qyx1E "DARN: a Deep Adversial Residual Network for Intrinsic Image Decomposition," Lettry et al.: https://t.co/f6AQdx7ci3 "EnhanceNet: Single Image Super-Resolution through Automated Texture Synthesis," Sajjadi et al.: https://t.co/3Bz1kN70hz "SampleRNN: An Unconditional End-to-End Neural Audio Generation Model," Mehri et al.: https://t.co/rxeJeuH5iv "Understanding Image and Text Simultaneously: a Dual Vision-Language Machine Comprehension Task," Ding et al.: https://t.co/setYyObBgD "DeMIAN: Deep Modality Invariant Adversarial Network," Saito et al.: https://t.co/YVyBFhXsyv "'What is Relevant in a Text Document?': An Interpretable Machine Learning Approach," Arras et al.: https://t.co/YSgZcQhqoQ (by Shrivastava et al.) Apple's Xmas gift - an actual AI paper: "Learning from Simulated + Unsupervised Images through Adversarial Training" https://t.co/9E0zQThIir "RT @alexjc: Crococumber = Cucumber + Crocodile. #NeuralDoodle I admit I was getting bored of fruit style transfer. Just unlocked the next…" @qhardy or if they'll survive Trump. @AnaPopescu_SV lol. One thing I don't miss about DC is the Larouche PAC people around the White House handing out crap @shivon these are all guilty pleasures compared to the game theory textbook and coding I'm avoiding :) RT @summerbrennan: "festive" https://t.co/nbuhVXl3at https://t.co/lEYzR1x6ND @AnaPopescu_SV you see cats/children everywhere when you have them? they're not everywhere already? chin scratch emoji... Christmas gift for myself. :) https://t.co/lAn85KEEE9 @Aelkus Langdon Winner said basically the same thing back in the day... @girlziplocked and in the UK. There was one at my bus stop for a while. RT @EJDionne: I never thought an incoming president would quote a foreign autocrat to attack his fellow Americans. He has nerve to say "Ame… RT @MoElleithee: The President-elect is tweeting lessons in how to "lose with dignity" from an authoritarian who murders his political oppo… RT @neuroecology: Thank God I'm finally on vacation so I have the time to think deeply about work @justinhendrix utterly insane RT @AkilahObviously: Donald Trump is the worst president we've ever had and he's not even president yet. @xanderai if too big it makes them Google Drive links @xanderai gmail does have a limit, i thought.. Me at the beginning and end of 2016... https://t.co/oLA1mQWYwi RT @demishassabis: Excited and proud to see #AlphaGo officially listed by the editors of Science as one of the top 10 scientific breakthrou… @davegershgorn lol so dumb. RT @AngeBassa: Cui bono? https://t.co/G77uwUDnyO @rodolfor interesting - thanks! @rodolfor hm, Nobel? haven't heard of it. Don't watch Van Helsing on Netflix unless you're super into blood and being depressed and wasting time. #hottake Also, too much content. If by brains you mean not brains... https://t.co/0CAuAyjbua RT @devnag: The lowest Amazon price on the new deep learning book from @goodfellow_ian is....$10,121.00 https://t.co/fTcB5xzjeB RT @LeverhulmeCFI: Ad for another great postdoc opportunity at the Centre is now live! Join the project AI: Agents and Persons #postdoc htt… @davegershgorn LOL It's like Uber but for making sure Trump doesn't deport your Uber driver and do other bad stuff. https://t.co/mLsIuIDMhq RT @abhshkdz: Visual Dialog update — Releasing v0.5 dataset (reported in arxiv paper) and code for data collection chat interface https://t… @sknthla or just ban Trump RT @Miles_Brundage: My brother-in-law and friend made "Donald Trump Survival Pack." Donate simultaneously/equally to these charities: https… @AnthroPunk good idea! I'll pass this along https://t.co/WHpRmMHk3b #RESISTANCE (or deciding which is most important - take a portfolio approach :) ) Please RT - these orgs need all the help they can get in the years to come. Easy way to donate without dealing with each org individually. My brother-in-law and friend made "Donald Trump Survival Pack." Donate simultaneously/equally to these charities: https://t.co/WHpRmMHk3b https://t.co/1XxgLEBxEb RT @vgr: Uh huh https://t.co/pxLKnhOW9m https://t.co/u852w5yzvk @FutureBuckNasty sure, but so will TaihuLight (in 2031 maybe ;) ) @SmithaMilli if you liked Handmaid's Tale, I'd recommend Oryx and Crake. Haven't read anything not awesome by Atwood... @FutureBuckNasty yeah, still pretty big, though. (caught my eye just b/c experiments done on Tianhe-2 supercomputer) "An efficient hybrid tridiagonal divide-and-conquer algorithm on distributed memory architectures," Li et al.: https://t.co/jeQ9HnwkMK "Microstructure Representation + Reconstruction of Heterogeneous Materials via DBN 4 Computational Material Design" https://t.co/xClnfXEIhe "Non-Deterministic Policy Improvement Stabilizes Approximated Reinforcement Learning," Bohmer et al.: https://t.co/OrgcjdtWJP "Structured Sequence Modeling with Graph Convolutional Recurrent Networks," Seo et al.: https://t.co/hCWVgSHAe8 "Top-down Visual Saliency Guided by Captions," Ramanishka et al.: https://t.co/ydO48YmQNE "Efficient Action Detection in Untrimmed Videos via Multi-Task Learning," Zhu and Newsam: https://t.co/VIC0vxDzQ4 "A Context-aware Attention Network for Interactive Question Answering," Li et al.: https://t.co/DWvIrSTgA2 "Physically-Based Rendering for Indoor Scene Understanding Using Convolutional Neural Networks," Zhang/Song et al.: https://t.co/WDO15SEfZS @nerdherdempire CS includes that, so yes - I look at the whole new CS page, plus the subpages I mentioned under physics, etc. "Towards Linear Algebra over Normalized Data," Chen et al.: https://t.co/UjT3iQEF13 @nerdherdempire (as opposed to e.g. just looking at ML, or CS) @nerdherdempire but anyway my "secret" to not missing em is to check Disord Systs/Neural Nets+CS (new/all)+neurons and cog+ML+computation @nerdherdempire I kind of summarize ones that I think are important, but don't read all that I tweet, + prob. wrong about which are impt :) """Continuous multilinguality with language vectors,"" Ostling/Tiedemann: https://t.co/dcyfzJmffc Exploring lang vecs using Bible translations" """Eqilibrium Approximation Quality of Current No-Limit Poker Bots,"" Lisy+Bowling: https://t.co/cPccS4DWy9 TL;DR they're bad from Nash Eq POV" "Re-evaluating Automatic Metrics for Image Captioning," Kilickaya et al.: https://t.co/yHGqcBjMSQ "Hardware for Machine Learning: Challenges and Opportunities," Sze et al.: https://t.co/FL68G4uEnx "MultiNet: Real-time Joint Semantic Reasoning for Autonomous Driving," Teichmann et al.: https://t.co/qqtn3COCcN "Internet-Based Image Retrieval Using End-to-End Trained Deep Distributions," Vakhitov et al.: https://t.co/9T13vrEU38 "Adversarial Examples Detection in Deep Networks with Convolutional Filter Statistics," Li and Li: https://t.co/PkhwfiyJn5 "Highway and Residual Networks learn Unrolled Iterative Estimation," Greff et al.: https://t.co/DNmXpu1q5L @therobotreport at least 3 Naos* @davegershgorn that's just like your opinion dAvE @therobotreport nope, sorry. maybe check the WRC site's list of exhibits though... @therobotreport wasn't carefully counting but I'd guess I saw at least 3 diff versions of these, at least Naos... @therobotreport here are more https://t.co/SW0Twqtawu @therobotreport there are lots of these. I saw many at World Robot Conference. Here's a brochure for one. https://t.co/3g5zoaPfBM RT @j2bryson: Contact me for opportunities organising tutorials during our tutorials+hackathon, or for sponsorship opportunities. https://t… RT @girlziplocked: "The United States must greatly strengthen and expand its slave trade until such time as the world comes to its senses r… "RT @geowu: Best CV ever. @JohnCUrschel https://t.co/BjGiMZUEsJ https://t.co/o9Y9Rli7jZ" "Gaming" might also include people using non-DGX-1 stuff like GeForce for deep learning, but not super clear what %. (note that their "datacenter" revenue stream which includes DGX-1 etc, as opposed to "gaming," is still minority, but growing very quickly) https://t.co/gy48rRGf51 RT @zararah: USians/those able to work in the US:@datasociety looking for research analyst working on algorithms/accountability: https://t.… The whole AI thing seems to be working for NVIDIA. https://t.co/RFXY2VWjIb RT @trochee: if you'd sent me this headline in 2012 I would have asked how @TheOnion managed to hack @CNBC https://t.co/ThfFDKvqAs @AnaPopescu_SV if only he were a child. Or random number generator. Anything would be better than systematically doing the opposite of good. Caps lock is cruise control for professionalism, I hear. https://t.co/LLRipWU4QL RT @BillKristol: This is genuinely sad. https://t.co/29wMHDHACY RT @soumithchintala: Code & Data for Key-Value Memory Nets and 3 more papers on Dialogue-interaction by #FAIR's Jason Weston et. al.: https… ... https://t.co/KgRhp48a5x @poolio CC @anderssandberg RT @tdietterich: Through bad typing, I accidentally coined a new word today: "entrepreneural" = launching a neural net company? RT @ThomasMiconi: I'm looking for a job in neural networks, AI and/or comp neuro. Hiring? Get in touch! https://t.co/nkhKvz48Oa #ai #deeple… @hardmaru yes, that jumped out at me, too. Interviews about AI research in China, with researchers/managers at top institutions (free): https://t.co/BqevIo32BC @hardmaru @benhamner thanks! @hardmaru @benhamner do you recommend that book? thinking about related issues lately, curious how plausible/thought provoking it is. @mark_riedl needs moar flips "Recurrent Highway Networks with Language CNN for Image Captioning," Gu et al.: https://t.co/zK6EwkH4or "A Framework for Fast, Scalable Binarized Neural Network Inference," Umuroglu et al at Xilinx [hardware corp.], etc: https://t.co/A8iQ0BMhLe "Deep-learning in Mobile Robotics - from Perception to Control Systems: A Survey on Why and Why not," Tai and Liu: https://t.co/l9mkUTkEY6 "Multi-Agent Cooperation and the Emergence of (Natural) Language," Lazaridou et al.: https://t.co/VMTE7htyEq "CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoning," Johnson et al, Stanford/FB https://t.co/ZdDTMFPmOP "Fast Domain Adaptation for Neural Machine Translation," Freitag and Al-Onaizan, IBM: https://t.co/tmHgHI1Ia5 "AIVAT: A New Variance Reduction Technique for Agent Evaluation in Imperfect Information Games," Burch et al.: https://t.co/C9iyMBIL7j """Loss is its own Reward: Self-Supervision for Reinforcement Learning,"" Shelhamer et al https://t.co/J9rMlasKxv Similar to DeepMind's UNREAL" RT @sarahkendzior: Hmmm. Maybe he'll fire himself. https://t.co/l4sNDfxnLd @jmugan @tdietterich I'd also be interested in recommendations there... @rcalo @katecrawford congrats! @tdietterich @gwern can't speak for Gwern but I'd agree (for now at least), tho we also favor performance>stability/predictability sometimes "Tool AIs are inferior on every dimension to Agent AIs, + use of Tool AIs is a highly unstable equilibrium."- @gwern https://t.co/W01La0nm3g RT @BillKristol: Replenishing the swamp. https://t.co/EQznRoJF4j Time for some game theory... https://t.co/DEjnk0BmNA Check this out - a funny example of an important problem. https://t.co/kWrg9IltZK RT @OpenAI: Faulty Reward Functions in the Wild: https://t.co/gab0Xb1Fmz @deliprao plausible that he'll do some things that will help such ppl (e.g. big infrastructure spending), though arguably just Dem policies @deliprao doesn't actually have to help base, can just blame their problems on others, get credit for BS small wins like Carrier etc. @j2bryson or rather, who was saying things. Top experts saying X=big deal is (usually) better signal than VCs can discern w/ own diligence. @j2bryson I wasn't involved (though could tell it was fishy), my view is-not unreasonable for VCs to reach out given what ppl were saying :) @j2bryson wasn't an FHI thing, a few people in individual capacities inc Anders; but yes, I think it's a fair Q/@deanpomerleau said same RT @williamstome: Looking for recommendations: 8-15 page articles on privacy concerns in AI (outside robotics), appropriate for college sen… @jackclarkSF @haldaume3 @geomblog there's discussion in the comments here: https://t.co/S5gjBcddqS RT @tdietterich: Makes me wonder what blind spot we have now. Logical inference methods have greatly improved since 1985. Time to bring the… "Beyond Skip Connections: Top-Down Modulation for Object Detection," Shrivastava et al.: https://t.co/wRuHCyFWYv """Understanding Higher-Order Shape via 3D Shape Attributes,"" Fouhey et al.: https://t.co/PPqUn7r6Op (with dataset of sculptures)" "Automatic Generation of Grounded Visual Questions," Zhang et al.: https://t.co/TaxfMNqH26 "@beaucronin definitely.* *whoops" @beaucronin as in we take the need for reasoning about uncertainty + use of statistical methods for granted "In Defense of Probability" by Cheeseman (IJCAI 85). Was assigned this in AI class to underscore how things changed. https://t.co/5LRhNvSJLp https://t.co/wSmLjGKgg3 "Unsupervised Perceptual Rewards for Imitation Learning," Sermanet et al.: https://t.co/2bUsPIQhdN @levendowski which textbook/how is it? @Thomas__Arnold any highlights? Lots of good new reports from the White House on automation, etc just in time for Trump to ignore them and focus on yelling at Bill Clinton. RT @CEAChair: New @WhiteHouse report examines impact of AI-driven automation on economy & strategies to ensure widespread benefits https://… @sknthla er, my tweet was also ambiguously phrased. but hopefully that made sense (like, literally descending/ascending the list) @sknthla ambiguous phrasing :) biggest = descending order, likely = ascending order... @AngeBassa congrats! "RT @AngeBassa: 🚨 EXCITING NEWS 🚨 Guess who’s gonna be the new Director of Data Science at @iRobot? https://t.co/VwM5miEvra" @AnaPopescu_SV nope, you're not the only one. I mean, it's bad, but far from the main concern right now... @hardmaru there are lots of "serious" (?) ML driving papers, just not from the big companies commercializing it...Oxford, NVIDIA, etc "A recurrent neural network without chaos," Laurent and von Brecht: https://t.co/QpXfteBM0o "Simple Black-Box Adversarial Perturbations for Deep Networks," Narodytska and Kasiviswanathan: https://t.co/wKEj2DlXGl "Corralling a Band of Bandit Algorithms," Agarwal et al.: https://t.co/LxGeGEdXQu "Few-Shot Object Recognition from Machine-Labeled Web Images," Xu et al.: https://t.co/jUUrPO1SIO "Active and Continuous Exploration with Deep Neural Networks and Expected Model Output Changes," Käding et al.: https://t.co/wyZche4jjb "On Random Weights for Texture Generation in One Layer Neural Networks," Mongia et al.: https://t.co/gaOFiLjYT4 "Training Ternary Neural Networks with Exact Proximal Operator," Yin et al.: https://t.co/kCVcr8wycM "Reducing Redundant Computations with Flexible Attention," Shu and Nakayama: https://t.co/nKTaGWIzvG "Sample-efficient Deep Reinforcement Learning for Dialog Control," Asadi and Williams: https://t.co/7FA1MuWc6b "Learning Human-Understandable Strategies," @Sam_B0t and Yusuf: https://t.co/776PJB2qx0 "Learning to predict where to look in interactive environments using deep recurrent q-learning," Mousavi et al.: https://t.co/D7IRzlrGWY """A User Simulator for Task-Completion Dialogues,"" Li et al.: https://t.co/wc5s1do6Zt Code: https://t.co/z3DvxlmEwm" "Mutual information for fitting deep nonlinear models," Hunter and Hodas: https://t.co/ucTojrt6Ea "Learning Features by Watching Objects Move," Pathak et al. at Facebook/Berkeley: https://t.co/8HacD1xy19 "Dense Supervision for Visual Comparisons via Synthetic Images," Yu and Grauman: https://t.co/drbbgFChyQ RT @sarahjeong: move fast and break people https://t.co/dDF97fu8Ll "Self-Correcting Models for Model-Based Reinforcement Learning," Erik Talvitie: https://t.co/T1BfSyeFem RT @DavidOAtkins: Obligatory retweet. https://t.co/PEKOMenst9 @justinhendrix (I do applaud you calling attention to it/not trying to be critical, though) @justinhendrix of course he is. Has he ever done anything else? @nonsensews dunno, I'm not as familiar with GITS (only seen once), but seemed pretty good, I guess? (he says as he watches another thing based on a Philip K. Dick novel) Not that enthused with the Blade Runner 2049 trailer. Added to the list of Media Things That Didn't Need to Happen. Moar original plots pls. @zacharylipton @s010n ethics workshop at AAAI, We Robot... not ML-specific, but often relevant. RT @mark_riedl: 8th International Conference on Computational Creativity (ICCC) will be @GeorgiaTech June 2017 https://t.co/b1bxIGvVKN Pape… @sknthla i lol'd If you're not subscribed to this yet, you're messing up big time, but not too late :) https://t.co/BM1ohMhT2J RT @goodfellow_ian: @sirajraval interviews @OpenAI engineer @catherineols https://t.co/ERIcJG55CP (that being said +also similarly, most people who talk about blockchain don't know what they're talking about. I avoid talking about it :) ) Was impressed w a lot of the top people in blockchain at a workshop recently. Like AI, lots of smart ppl behind the scenes, not *just* hype. RT @karpathy: A short/quick blog post: “Yes you should understand backprop” https://t.co/fOsrsiU2HA @sknthla :( stop being right pls RT @harvardnlp: Excited to introduce OpenNMT (https://t.co/gouHVyUsDS), an open-source neural machine translation developed for industrial… RT @XiXiDu: DeepGlint, a Chinese AI startup, deep learning for effective surveillance on large numbers of people. https://t.co/mMBv7l3FCu "A New Softmax Operator for Reinforcement Learning," Asadi and Littman: https://t.co/8ljfKSgXaB Video Propagation Networks," Jampani et al.: https://t.co/tRPoCEbmuO "Delta Networks for Optimized Recurrent Network Computation," Neil et al.: https://t.co/SDp5Hutnjk "Event-driven Random Back-Propagation: Enabling Neuromorphic Deep Learning Machines," Neftci et al.: https://t.co/CIaByJPIUg "Models, networks and algorithmic complexity," Giulio Ruffini: https://t.co/FtMp1pKTPG "A Survey of Inductive Biases for Factorial Representation-Learning," Karl Ridgeway: https://t.co/ASBFzskMhK "Modeling Trolling in Social Media Conversations," Mojica and Ng: https://t.co/6Ohi6s0jnr "FusionNet: A deep fully residual convolutional neural network for image segmentation in connectomics," Quan et al.: https://t.co/X9dsC98TTX "Medical Image Synthesis with Context-Aware Generative Adversarial Networks," Nie et al.: https://t.co/yzwBWGxbLW "Learning Residual Images for Face Attribute Manipulation," Shen and Liu: https://t.co/i0KkwlwzEw "The VQA-Machine: Learning How to Use Existing Vision Algorithms to Answer New Questions," Wang et al.: https://t.co/eJ6cowuSIs "Machine Reading with Background Knowledge," Nakashole and Mitchell: https://t.co/M0SWyzvgqD "Unsupervised Pixel-Level Domain Adaptation with GANs," Bousmalis et al., Google Brain/Research: https://t.co/Q2RznOXQYw """Deep RL w/ Successor Features 4 Navigation across Similar Environments,"" Zhang et al https://t.co/6Zb5jklQaz Video https://t.co/IYZKlaepNc" Looks like parallel universe Bernie Sanders, who took an easier road in life and aged less noticeably... https://t.co/V24x0LGyJN @jimmfleming the latter, and more specifically just there are more researchers (so more total effort, not necessarily more per-researcher) RT @tdietterich: @deliprao In particular, we evaluate deep nets by "does it work" and comp neuro sci models by "does it match experimental… (paper argues there is rising total researcher effort and declining per-researcher productivity. doesn't look at AI as example, or solution) I think w AI, researcher effort has grown a lot, + productivity has at least not declined much, maybe gone up a lot. https://t.co/XhDBcH8lIx @mark_riedl I'm all for dystopian robot shows, but seems like we have a lot of remakes these days. Not specific to robot stuff, though. RT @realDonaldTrump: Amazing how the haters & losers keep tweeting the name “F**kface Von Clownstick” like they are so original & like no o… Just a quick reminder that this guy will be the most powerful person in the world in a month. https://t.co/Z9VcpG3Itt RT @mark_riedl: I'm giving a talk in Mexico City in February. Do I need to start applying for a Russian passport? RT @jackclarkSF: Latest issue of my newsletter Import AI (https://t.co/oGP26p6zlc ) goes out tomorrow. What happened in AI last week? Let m… Page on the updated version of "A Deep Hierarchical Approach to Lifelong Learning in Minecraft" (AAAI-17): https://t.co/NttA0TIJWp RT @Autumnsburg: @Miles_Brundage Learning to (learn to)^n (by gradient descent)^n [ICLR2015+n] Learning to learn to learn to learn by gradient descent by gradient descent by gradient descent by gradient descent... [ICLR 2018] @FHIOxford will soon be hiring in several areas, inc AI safety + strategy - info here/get in touch if interested: https://t.co/1h72JYGkWI RT @mark_riedl: Looking for a job working on AI Safety? https://t.co/m8j1o2v3hI """Are Ideas Getting Harder to Find?,"" Bloom et al.: https://t.co/2I0aIp2dnu ^ interesting" ... https://t.co/0Ce5zQO1CS @rcalo Question 1: Is Donald Trump a Magic Leap demo? Big gap today but w/ some combination of transfer learning, better exploration, etc. I wouldn't be surprised if mostly closed in few years. """Human Learning in Atari,"" Tsividis et al.: https://t.co/sZpom58yh5 Some of this data was in Tenenbaum talk at deep RL workshop at NIPS..." RT @karpathy: More on Mini World of Bits project (agents learn to use the web) at OpenAI and how to use it with Universe: https://t.co/YKMC… @jackclarkSF but can't let clickbaity news piece pictures like this be vindicated - https://t.co/uUUUqrGJAC oh wait https://t.co/SIBzncyHbD Didn't get much response to this so trying again - I swear, it's super entertaining and has a positive message. https://t.co/OUy07yVzTl RT @goodfellow_ian: Nice article on the NIPS Reliable ML in the Wild workshop. Hope some of you work on defenses and come to the workshop n… RT @goodfellow_ian: .@NicolasPapernot and I starting an informal blog about machine learning security and privacy: https://t.co/BloQy138iw RT @jhamrick: If you liked my talk on imagination-based optimization at the intuitive physics workshop, here’s the paper https://t.co/ww57t… RT @karpathy: +We are looking to hire engineers to help us create more web environments for AI agents. Ping me at karpathy@openai.com if in… RT @goodfellow_ian: Amazon says the book will be back in stock Dec 22: https://t.co/2KwW8wljY0 RT @NPRinskeep: Obama tells @NPR the world needs rules for cyber weapons, like rules for nuclear weapons. https://t.co/y2Ploo2P77 @NPRKelly… Trump advisor casually says Earth is 5,500 years old... https://t.co/TkEgbKDQMi RT @__hylandSL: my summary of #nips2016: https://t.co/qySEDa0fsE featuring machine learning for healthcare, @WiMLworkshop, and ML and the l… RT @sarahkendzior: Spoiler: yes https://t.co/Z7DwlviGlO RT @RyanLizza: It's not just that Trump won't condemn Russian hacking, it's that he continues to applaud it. He's celebrating foreign espio… @mat_kelcey well, Russell/Norvig does, too, it's just that it's rarely assigned in courses ;) @ruchitgarg don't know. CC @ankurhandos (one of authors) "Bayesian Optimization for Machine Learning : A Practical Guidebook," Dewancker et al.: https://t.co/Oc1kmwQnjd "The More You Know: Using Knowledge Graphs for Image Classification," Marino et al.: https://t.co/Cxo6L0uZ7g "Tinkering Under the Hood: Interactive Zero-Shot Learning with Net Surgery," Krishnan and Ramanan: https://t.co/w90pXM7DrX "Recurrent Image Captioner: Describing Images w/ Spatial-Invariant Transformation+Attention Filtering," Liu et al.: https://t.co/UTXlfqlvET "SceneNet RGB-D: 5M Photorealistic Images of Synthetic Indoor Trajectories with Ground Truth," McCormac et al.: https://t.co/3Z9D1xzZY3 "Graphical RNN Models," Bora et al.: https://t.co/IUXIXSqFk3 "Visual Compiler: Synthesizing a Scene-Specific Pedestrian Detector and Pose Estimator," Lee et al.: https://t.co/c5OkzvHS03 "CSVideoNet: A Recurrent Convolutional Neural Network for Compressive Sensing Video Reconstruction," Xu/Ren: https://t.co/0TZ4ICiNEi "Transition-based Parsing with Context Enhancement and Future Reward Reranking," Zhou et al.: https://t.co/73ELAiv0wG "Neural Networks for Joint Sentence Classification in Medical Paper Abstracts," Dernoncourt and Lee et al.: https://t.co/X56X7O701K "Tunable Efficient Unitary Neural Networks (EUNN) and their application to RNN," Jing et al.: https://t.co/3ghHO2s9TY "Coupling Adaptive Batch Sizes with Learning Rates," Balles et al.: https://t.co/tQl7xvKxGx "Learning Through Dialogue Interactions," Li et al., Facebook: https://t.co/jgBDXg0mm3 "Improving Scalability of Reinforcement Learning by Separation of Concerns," van Seijen et al., Maluuba/McGill: https://t.co/G238LwmKf1 New @FHIOxford working paper - "Policy Desiderata in the Development of Machine Superintelligence," Bostrom et al.: https://t.co/bTMepMq0y8 RT @kchonyc: Strong desire for me to schmidhuber Andrew Ng :p https://t.co/9grhfvEi0F @allanfriedman "what do you get when you cross a TED talk and a VC pitch?" "Beam Search for Learning a Deep Convolutional Neural Network of 3D Shapes," Xu and Todorovic: https://t.co/6MCe3eOTxz "Detect, Replace, Refine: Deep Structured Prediction For Pixel Wise Labeling," Gidaris and Komodakis: https://t.co/vmmlF3dKj6 "Attentive Explanations: Justifying Decisions and Pointing to the Evidence," Park et al.: https://t.co/mwRCIJyvC7 "Encapsulating models and approximate inference programs in probabilistic modules," Cusumano-Towner + @vmansinghka : https://t.co/iCKkvy1iAU "Incorporating Language Level Information into Acoustic Models," Wang and Wang: https://t.co/LB37Yu3pNs "Imposing higher-level Structure in Polyphonic Music Generation using Convolutional RBMs+Constraints" Lattner et al https://t.co/ZJnylsTPB9 "An Architecture for Deep, Hierarchical Generative Models," Bachman: https://t.co/GJdaMzrCxP "Multilingual Word Embeddings using Multigraphs," Soricut and Ding: https://t.co/mMz4JanmeT "Real-time interactive sequence generation + control w/ Recurrent Neural Network ensembles," @memotv and Grierson: https://t.co/KxHYoEOwDn "Recurrent Deep Stacking Networks for Speech Recognition," Wang et al.: https://t.co/e7z2HocF5V "How Grammatical is Character-level NMT? Assessing MT Quality with Contrastive Translation Pairs," Rico Sennrich: https://t.co/RMC0aDYOvT "Neural Emoji Recommendation in Dialogue Systems," Xie et al.: https://t.co/K7zrrEgXQV "Improving Neural Language Models with a Continuous Cache," Grave et al.: https://t.co/LhpEYpUxqV "Deep Function Machines: Generalized Neural Networks for Topological Layer Expression," William Guss: https://t.co/RD3LpqpKma "Neural Coarse-Graining: Extracting slowly-varying latent degrees of freedom w/ neural networks," Guttenberg et al.: https://t.co/3E7MgKl45S "Disentangling Space and Time in Video with Hierarchical Variational Auto-encoders," Grathwohl and Wilson: https://t.co/u1jXnUcpLb "Permutation-equivariant neural networks applied to dynamics prediction," Guttenberg et al.: https://t.co/Q4WOfl1pWQ "Sparse Factorization Layers for Neural Networks with Limited Supervision," Koch and Corso: https://t.co/VyrarcEJOA "Harmonic Networks: Deep Translation and Rotation Equivariance," Worrall et al.: https://t.co/mCM8EzxXd0 RT @mark_riedl: Bach has been a "solved problem" for a long time. Only diff is using neural nets instead of other techniques. Try jazz. htt… @BayesForDays nsfw version? RT @haldaume3: unless I miscounted/misrecognized, in all the videos and photos here combined I found 23 men and 1 woman https://t.co/jHcO0x… """A Robustness Analysis of Deep Q Networks,"" Tow et al.: https://t.co/ImYK79YMkL Yassss https://t.co/qhQCYyGAWR" Ginni Rometty and Alex Karp summed up Trump's agenda pretty well... https://t.co/3EnfAjNMWk RT @katecrawford: "Seeing Without Knowing": @ananny & I have a new paper outlining ten major limitations of algorithmic transparency. https… RT @jeffclune: We've open sourced the code for Plug & Play Generative Networks (PPGNs), which produced these images: https://t.co/n4ClR4Jje… @Brombadil yep :/ don't have a solution for that unfortunately! @Brombadil nothing super fancy, pretty messy :) open lots of papers, save/tweet about interesting ones, save in some folders or on desktop RT @mark_riedl: I wrote about the plausibility of AI in Westworld, plus downloadable code experiments https://t.co/wJ3fEicRd5 https://t.co/… "RT @mark_riedl: This might be the future location of my office. By the way, did I mention @gtcomputing is hiring in AI, ML, and robotics?…" @dpfrank07 @elluba it did use other bird imagery. @dpfrank07 @elluba yes, synthetic - "amalgam" perhaps according to some definition, not others. Paper also shows most similar real images. RT @TheDiLLon1: America at the start of 2016. America at the End of 2016. https://t.co/2N8l5WJriv @haikuman glad you find it helpful :) @Smerity @AnaPopescu_SV yeah. the method used (gmail password thing) is super common, was just reading about it the other day. humans.. :/ @haikuman indeed. should have probably said "absurd" instead of "problematic"... RT @haikuman: You’ve got to be freakin’ kidding me. Two sets of male-assigned single-word labels to is *not* sociopsychology. https://t.co/… @AnaPopescu_SV indeed. did you read this? so depressing. https://t.co/y9Tqwak8og "An Empirical Analysis of Deep Network Loss Surfaces," Im et al.: https://t.co/vBhnMbboGE "Incorporating Human Domain Knowledge into Large Scale Cost Function Learning," @markus_with_k et al., Oxford: https://t.co/5Jz4RXo892 "Online Sequence-to-Sequence Reinforcement Learning for Open-Domain Conversational Agents," Asghar et al.: https://t.co/nGXVAgyi99 """Stacked Generative Adversarial Networks,"" Huang et al.: https://t.co/jWA9SUYZs6 (different from StackGAN)" """Generative Adversarial Parallelization,"" Im et al.: https://t.co/oQAVIkozUJ Excellent visual :) https://t.co/9vHjj6645N" """Building Large Machine Reading-Comprehension Datasets using Paragraph Vectors,"" Soricut+Ding, Google: https://t.co/G4p0sBb8QO ^interesting" "Neuro-symbolic representation learning on biological knowledge graphs," Alshahrani et al.: https://t.co/KUN3RT4PTs "Information Extraction with Character-level Neural Networks and Noisy Supervision," Meerkamp and Zhou: https://t.co/KlJ2lg56W9 "Multi-Perspective Context Matching for Machine Comprehension," Wang et al., IBM: https://t.co/KzwaJqVvbf "ConceptNet 5.5: An Open Multilingual Graph of General Knowledge," Speer et al.: https://t.co/lYuGQw8uIW (from the same folks as the criminality/appearance paper) "Automated Inference on Sociopsychological Impressions of Attractive Female Faces"... problematic interp of results https://t.co/i2QQWoKacm "DizzyRNN: Reparameterizing Recurrent Neural Networks for Norm-Preserving Backpropagation," Dorobantu et al.: https://t.co/mpFvbUBvCb "Tracking the World State with Recurrent Entity Networks," Henaff et al., Facebook: https://t.co/BiJD9TwTbU "Improving the Performance of Convolutional Neural Networks via Attention Transfer," Zagoruyko and Komadakis: https://t.co/Kra64XficW "50 things I learned at NIPS 2016," blog post by Andreas Stuhlmüller: https://t.co/37u08cANAP (lots of the top bots are Zen-related) Many 8/9 dan bots on KGS Go server now, I assume w AlphaGo-esque methods. Dwango said they'd sell a DL Zen bot, dunno what happened there... It me https://t.co/jJHavrPoz2 Link to this report: https://t.co/I5m4XHDZSa https://t.co/WbXQu6bIfy RT @amiraminiMD: Rick Perry replacing a nucl. scientist as Sec.of Energy would be like an internet troll replacing a constitutional law Pro… RT @HMRoff: For those interested see this great new report out #machinelearning #MachineIntelligence #ArtificialIntelligence #killerrobots… RT @HMRoff: So it was yesterday, so it is today. Sounds like almost all states--except #Russia--want a GGE for autonomous weapons. #CCWUN RT @BanKillerRobots: #China supports a Group of Governmental Experts on lethal autonomous weapons systems, focus on definition, scope, lega… RT @anderssandberg: @CSERCambridge My slides can be found at: https://t.co/2NNHrLS0Hk #CCCR2016 RT @CSERCambridge: @anderssandberg Now speaking on 'The principle of differential technology development' #CCCR2016 RT @HMRoff: #China supports the forming of a GGE on autonomous weapons. :-) #CCWUN Some uplifting free reading material... https://t.co/ZNcY41x68D RT @HMRoff: So, clearly he is too busy to read intelligence reports and briefs but he has time to photo-op and meet with Kanye West?? https… RT @bradplumer: The Energy Department has rejected Trump’s request to identify employees who worked on climate change: https://t.co/VjVUe2Y… RT @HMRoff: See the new @IEEE report on ethically designed autonomous systems, calling for meaningful human control! @article36 https://t.c… "RT @KayFButterfield: The IEEE Report on Ethically Aligned Design of AI can be found here. A great read and call for ongoing input. #AI http…" Steve Chu invented a way to use gamma rays to measure BP oil spill flow rate. Rick Perry forgot the name of DOE on his "to eliminate" list. Unimaginably large drop in expertise from last two energy secretaries to this guy. https://t.co/tzM1YHCcqf As someone who's done this, I'm gonna guess no... too much fun for AI noobs. https://t.co/3dgaRRshbI RT @mark_riedl: Have we reached peak attempt at humor via application of naive LSTM implementation to arbitrary data set yet? "RT @maosbot: “Preconditioning Kernel Matrices”: our ICML paper on scaling kernel machines. paper: https://t.co/RMO0nTU2qL code: https://t…" RT @mat_kelcey: @mat_kelcey man, this book is gold. if you read the initial release i'd recommend a reread, heaps of new content! RT @mat_kelcey: "in the case of a linear model with a quadratic error function, early stopping is equivalent to L2 regularization" https://… @ruchitgarg I'm not but I am sure someone is. Believe I saw something about rice paddy pic analysis recently, prob other stuff See more here: https://t.co/85j2jjmkCc Oh and this stuff could be important for stuff other than making pics... can enable AIs to "imagine" action outcomes, so plan better, etc. So yeah, multiple dimensions of rapid progress here: diversity of pics producible, efficiency, resolution, realism, etc. Crazy times. (well, not necessarily pics, but in this case, yeah...trying to tweetify my rough understanding of GANs :) ) Generative Adversarial Networks (GANs), basically two neural nets trained on pics where one tries to fool the other, have been a big driver. @cyberony good question! It's not yet possible to generate totally arbitrary sorts of images (constrained by data, language complexity, etc.) but promising progress. For non-AI ppl: I'm referring to progress (higher res, more realism etc) in AI creating images when given a caption. https://t.co/JUyOktuGOq RT @trochee: Miles. 🙄 https://t.co/KTiQOCszoE @togelius that's why I made sure to include the one at the end about reading less ;) K, that's it for tonight :) """How to Read Less: Better Machine Assisted Reading Methods for Systematic Literature Reviews,"" Yu et al.: https://t.co/WzC3r3MDDx Hmm.." "#HashtagWars: Learning a Sense of Humor," Potash et al.: https://t.co/GTR70SQYvW "Automatic Lymphocyte Detection in H&E Images with Deep Neural Networks," Chen and Srinivas: https://t.co/03V93GVbAO "Towards deep learning w/ spiking neurons in energy based models w/ contrastive Hebbian plasticity," Mesnard et al: https://t.co/05jgrs88Rc "DeepCancer: Detecting Cancer through Gene Expressions via Deep Generative Learning," Bhat,* Viswanath,* and Li: https://t.co/tnSMKSC8IO "Evaluating Creative Language Generation: The Case of Rap Lyric Ghostwriting," Potash et al.: https://t.co/FZmU1DrU9r "COCO-Stuff: Thing and Stuff Classes in Context," Caesar et al.: https://t.co/Asak7g54FJ "Empirical Evaluation of A New Approach to Simplifying Long Short-term Memory (LSTM)," Yuzhen Lu: https://t.co/aSQwhFiiQc (added a space there because fast text dot zip was showing up as a hyperlink :) ) "FastText .zip: Compressing text classification models," Joulin et al., Facebook: https://t.co/QsAn3wd60P "VIBIKNet: Visual Bidirectional Kernelized Network for Visual Question Answering," Bolaños et al.: https://t.co/kUTzDVrarW "Generating Code Summaries Using the Power of the Crowd, Badihi and Heydarnoori: https://t.co/hwtI61daVH "Text-guided Attention Model for Image Captioning," Mun et al.: https://t.co/G4LzEAi74e "Reading Comprehension using Entity-based Memory Network," Wang et al.: https://t.co/pRpgIgDNnz "Recurrent Attentional Model for No-Reference Image Quality Assessment," Chen et al.: https://t.co/FjGgvqujie "Multiple Instance Learning: A Survey of Problem Characteristics and Applications," Carbonneau et al.: https://t.co/0vC5RAS1c4 "Obfuscation using Encryption," Schneider and Locher: https://t.co/dnzlSpSM4y "Generalized Deep Image to Image Regression," Santhanam et al.: https://t.co/SrDJjrIDAL Not sure what the best comparison is here, but see e.g. Mansimov et al. from a year ago... https://t.co/eItDpj4rqd https://t.co/EQb2ym0fzY @AnthroPunk it is... I haven't looked closely at the StackGAN results yet but when I said rapid progress, I didn't quite mean 11 days... https://t.co/DWXiXUVhEX Well, that escalated quickly. https://t.co/7JncA3WBox https://t.co/RMj7EYefix "StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks," Zhang et al.: https://t.co/sVeGBnnKyh "Co-localization with Category-Consistent CNN Features and Geodesic Distance Co-Propagation," Le et al.: https://t.co/YOVmQD3Lhs "Active Learning for Speech Recognition: the Power of Gradients," Huang/Child/Rao et al. (Baidu): https://t.co/BoPKI90UfX "Neurogenesis Deep Learning," Draelos et al.: https://t.co/z7BLHCDb0K "A Unit Selection Methodology for Music Generation Using Deep Neural Networks," Bretan et al.: https://t.co/nq1aiu6Li2 "Online RL for Real-Time Exploration in Continuous State and Action Markov Decision Processes," Hofer and Gimbert: https://t.co/aKdeLw85Hm "PoseAgent: Budget-Constrained 6D Object Pose Estimation via Reinforcement Learning," Krull et al.: https://t.co/9Aj94eWb50 "Neural Machine Trans. by Minimising the Bayes-risk w/ Respect 2 Syntactic Translation Lattices," Stahlberg et al.: https://t.co/7lgFXjtcnj "Inverse Compositional Spatial Transformer Networks," Lin and Lucey: https://t.co/RmL4RLNYBk "Reinforcement Learning With Temporal Logic Rewards," Li et al.: https://t.co/80XViYSDDO "Learning to Drive using Inverse Reinforcement Learning and Deep Q-Networks," Sharifzadeh et al.: https://t.co/dFlCeGcutw "Anytime Monte Carlo," Murray et al.: https://t.co/3vVNDwER7i Insane amounts of arXiv stuff coming up; you've been warned. "Generalizable Features From Unsupervised Learning," Mirza et al. at MILA: https://t.co/0ZFNHNlFw9 Flagging this again cuz it's good. https://t.co/K4oyFKrLPD @sknthla slash I guess that just means I'm an IYI @sknthla I feel like I'm being trolled. @sknthla literally tho @sknthla https://t.co/ejZGERBwxJ @sknthla you could fit one of Nash's papers on game theory in like, 10 tweets @sknthla lol. RT @tonyjprescott: We’ve just released a new video about our MiRO robot pet-like companion robot, please have a look https://t.co/EpnlAOPPo… @mjntendency well those same people typically have subtitles, so that shouldn't be the hard part. I was thinking it's a v. complex function @RobWortham and when I said that, I wasn't even consciously thinking of this - https://t.co/0jtLczCt6i @RobWortham it's not the best, but that review makes it sound like an Adam Sandler comedy or something. Certainly possible in theory, just non-trivial. ("available"=on Internet. There's at least a few hundred, = small fraction. But even all of them ever + summary for each maybe insufficient) AI writing good movie summaries based on screenplays would be cool. Dunno if # of available screenplays=sufficient. https://t.co/oEpQ2shzUG RT @memotv: in honor of the recent #rocketai gags, i've posted my bibtex unabbreviating title generator https://t.co/tgW2EBuzAS This is an unusually bad Netflix movie summary... https://t.co/JrlZe3yePv "RT @verge: Elon Musk will attend Trump’s meeting with tech leaders https://t.co/ElaXqKzKS8 https://t.co/T26jvWLWJ7" @mark_riedl well I didn't say monetarily, either. I also would accept a PhD, a custom in-paper easter egg, robot play time at conference... @mark_riedl can I get paid retroactively? RT @allenai_org: #AI2 is happy to announce a new data set of nearly 7k science questions across several grade levels. Request access: https… Very nice list of takeaways from recent developments in AI safety from @vkrakovna. #CCCR2016 https://t.co/0gYmFTMOWq @vkrakovna about to talk about AI safety at #CCCR2016 https://t.co/ufU21j5gav "RT @numerai: Numerai closes Series A, led by New York venture capital firm Union Square Ventures https://t.co/0S9Rt51Tah" RT @robmccargow: I've seen plenty of #AI talent getting poached but this is the first time I've seen #AI itself getting headhunted! https:/… RT @gosainnn: Montreal is not playing around and the world is paying attention. https://t.co/USRyGlz91L "@TobyWalsh - comp. complexity, intelligence ceiling, etc may block recursive self-improvement (cf. https://t.co/R5ijY7yPl2 on CC) #CCCR2016" @TobyWalsh : Tesla as a litmus test of how we as civilization govern AI risks (not well) #CCCR2016 RT @AndrewYNg: AI knowledge sharing from US->China is much faster than China->US, not because of secrecy but just because of language fluen… RT @CSERCambridge: We are here @ Cambridge Conference on Catastrophic Risk 2016, CSER's 1st conference, where we will be live tweeting all… RT @anderssandberg: Huw Price: as we philosophers say, "anything you can do, we can do meta!" #cccr2016 "Homomorphic Encryption Experiments on IBM's Cloud Quantum Computing Platform," Haung et al.: https://t.co/QCwmACp2a8 "Analytical Stacked Gaussian Process Model," Abdelfatah et al.: https://t.co/M1OAoJJTSP "Facial Expression Recognition using Convolutional Neural Networks: State of the Art," Pramerdorfer and Kampel: https://t.co/RYGLm5A9UO "ActionFlowNet: Learning Motion Representation for Action Recognition," Ng et al.: https://t.co/p15OXKWf43 "Deep TEN: Texture Encoding Network," Zhang et al.: https://t.co/yuXkPu4MCf (think Sutton talked about this at NIPS) "Learning representations through stochastic gradient descent in cross-validation error," Sutton + Veeriah: https://t.co/e72MKh4XGl RT @pbump: Incidentally the last time Trump held a press conference, 136 days ago, was when he encouraged Russia to hack Clinton's emails. @yoavgo @tdietterich not sure i'm qualified or that my committee would be happy with me taking on more commitments right now ;) @tdietterich hmm... RT @jackclarkSF: What were the most provocative and/or surprising things people heard at #nips2016 ? Putting together next issue of Import… @AnaPopescu_SV my suffering benefits the common good ;) Hope people submitted some cool stuff to arXiv on the planes home from NIPS :) @jackclarkSF growing importance of the cherry in the LeCun metaphor? :) him arguing for model-based RL... Mnih's great extension of it @ankurhandos notable/interesting though that Boston Dynamics still isn't using learning, though Raibert said there may be in future. @ankurhandos there's a fair amount of non-simulation stuff (e.g. Abbeel/Levine et al. robotics stuff), but certainly a way to go still.. RT @quantombone: NIPS 2016 trends: learning-to-learn, GANification of X, Reinforcement learning for 3D navigation, RNNs, and Creating/Selli… @ankurhandos only saw small fraction of sessions/workshops :) also lots of new experiments possible w new datasets.. @ankurhandos not sure, maybe that GANs/deep RL=hot/promising, like attn last year, lots of cool approaches on safety/bias/privacy pursued? RT @Wu_Tang_Finance: Wow https://t.co/C80Zvp9FmM Flagging this again in light of the #NAMPI workshop today... very impressive stuff. https://t.co/XW0Q3roQ7y RT @kurteichenwald: The way a real president-elect would react to intel findings that Russia engaged in cyberwarfare to interfere with US e… RT @karen_ec_levy: Students: ACM student essay contest on the most pressing ethical, social, regulatory issues around #AI: https://t.co/Nn5… @kleinsound the paper on Google's NMT (think title is like that) shows clear improvement @xanderai @robinhanson would be interested in how you would frame the issues discussed differently @robinhanson distinctions might mesh better in the future, but I expect ~gradual progress of increasingly general end-to-end techniques RT @_rockt: Respond here for questions to our #NAMPI panel w Percy Liang, Jürgen Schmidhuber, Joshua Tenenbaum, Martin Vechev, Daniel Tarlo… @robinhanson just different roles, whereas term AGI often used to mean something different (relevance/irrelevance to broad problem solving) @robinhanson maps well onto AGI/AI distinction. Architects of Google neural machine trans. aren't more AGI-y than devs of underlying nets... @robinhanson useful distinction, and relevant to some current cases of large-scale AI systems, but don't think system/component distinction+ @f00_ prob not as heading to another conference but I strongly suspect others will and I'll retweet em. :) @markus_with_k ohh whoops, I get the point now :) @f00_ tough q, dunno :) @markus_with_k that's what I meant (?) RNNs alone inherently limited; recent developments try to move up the computational hierarchy. https://t.co/qdBjE7XWIy @robinhanson not best analogy bc blueprint for spacecraft is more concrete. but I think most see themselves as part of that grand project @robinhanson engineers working on thruster nozzle for 2030 spacecraft could be thought of as "trying" to build whole spacecraft eventually @robinhanson I wouldn't say "surely," at least for some senses of "trying" - logic ppl, for example, think it's a necessary component... @j2bryson indeed! V exciting. Makes me feel better about my reason (rationalisation) for stopping studying Chinese, expecting future prog ;) Not @egrefen's main pt but notable that initial promising NMT work presented at NIPS 2 years ago and now used in Google production systems. https://t.co/R8Z4qgWVkP Running small risk of being late to airport to make talk by @egrefen on limitations of RNNs. Adios #nips2016 after that! https://t.co/V1UDAGTSKW ...allowing lots of approaches to be pursued not just by core DL ppl but others using DL as a component. Other factors maybe also important. One could maybe attribute *some* of raised ambitions to e.g. AGI conferences, but I think success of deep learning probably more impactful.. The level of ambition and promisingness of approaches being pursued by a very large segment of the AI community is quite high. The idea of "AGI" as a separate field from AI or a very small subset of AI was problematic a few years ago; it's super problematic today... RT @hannawallach: Ryan Adams will be giving a tribute to David MacKay (our PhD advisor) at 1:30pm in the #NIPS2016 Bayesian deep learning w… RT @libbykinsey: "Intelligence is dissociable from consciousness, probably" @demishassabis #nips2016 RT @hannawallach: Super excited for today's #NIPS2016 workshop on Bayesian deep learning!!! https://t.co/i7Rn1cl0Ps RT @zacharylipton: Per night price of Hotel during the #NIPS2016: 200 euro. Price to extend one day after NIPS: 50. (the main takeaway from which is that companies are really bad at guarding against social engineering and other risks) "Steal Everything, Kill Everyone, Cause Total Financial Ruin!" Very funny/illuminating talk by a penetration tester. https://t.co/05hwCbxdE2 Good interview w/ @jackclarkSF of @OpenAI: https://t.co/8o4V1HoPpE RT @Urk0: @Miles_Brundage https://t.co/AV9MruVrnb. Bayesian Networks :wink:wink: @Urk0 ahh saw this after I tweeted in favor of another workshop, haha. No offense was intended ;) I might also bounce around pseudo-randomly Given that intractability, @_rockt et al.'s excellent site might tip the scales in its favor https://t.co/CILIXRaik7 https://t.co/XHwgSUIRDF Deciding which #NIPS2016 workshop(s) to attend/for how long is an intractable problem... RT @_rockt: In 10.5 hours we will be opening the 1st workshop on Neural Abstract Machines & Program Induction #NAMPI at #NIPS2016 in room 1… RT @markus_with_k: Have another look at our work on learning robuster cost-functions for #autonomous cars from the #NIPS2016 #DeepRL worksh… Haven't yet seen an AlphaGo-like moment for transfer/continual/multitask learning but it seems to be in the air. Back to AI...think we'll see a lot of developments in the near future. Very large-scale experiments are now possible in Universe/Lab/etc... After reading this, a bit less horrified (it's not v. aimed at ARPA-E as Bloomberg suggested), but overall worrying https://t.co/52WeMQeVsB RT @TerynNorris: 1) Full copy of the Trump energy transition team's questions is here - all 74 of them: https://t.co/OutXxAnVk4 https://t.c… @MrMeritology :( remains to be seen but obviously I hope some voices of sanity prevail. They may also be very confused about what the Clean Energy Ministerial and Mission Innovation are (not ARPA-E...) but letter isn't public. Reminder for @transition2017: ARPA-E was signed into law during Bush administration, not Obama (first funded then), has bipartisan support. CC @transition2017 Trump team is targeting the most important part of DOE besides safeguarding nuclear weapons. Stop this witch hunt. https://t.co/sXprXYt2Kk https://t.co/FeCKVjInmO Yep - @j2bryson and I make this point on page 9 here: https://t.co/Wr0j2qslNG https://t.co/T9ehTSgjYf RT @SethBaum: My take on Trump & global catastrophic risk @BulletinAtomic: a lot to worry about & a few intriguing opportunities. https://t… Good panel discussion on ML reliability in the wild at #nips2016 https://t.co/ZNR6o0drty Anca Dragan on cooperative inverse reinforcement learning at #nips2016 https://t.co/FhLDfp3ZHZ RT @KloudStrife: Maybe the best slide at #nips or at least one for @boredyannlecun : cherries on the cake. #nips2016 https://t.co/JQfW5gWxic CC @j_winterton Octavian Siciu on finding vulnerabilities in ML systems - devs not motivated to fix #nips2016 https://t.co/Ri4eCJTXem now it's almost full, though https://t.co/IGOjG6Fu6I Mnih of DeepMind extending @ylecun's cherry analogy in context of the UNREAL agent. #nips2016 https://t.co/OT4bR57PGr RT @nikete: I'll be presenting a poster on compliance aware bandits at 2:45 pm on ML 4 Healthcare (room 116) #nips2016 #nipsml4hc16 plenty of space for Richard Sutton this time, no risk of him getting kicked out again @Aelkus you'll love it. I'm prob gonna reread in case changes since draft I read and also good enough to reread regardless A lot more space at the deep RL workshop this year, fortunately (2016+2015 pics). https://t.co/uHmIYmWKtB @sknthla whom you don't have to look at @sknthla hey at least you have VR, unlike the impoVRished among us RT @SmithaMilli: Should robots have off-switches? Come to the Reliable ML Workshop poster session at 2:45pm ;) #nips2016 https://t.co/lvzXV… @j2bryson @jackclarkSF may have comments on IP (I would think the answer is no..) @j2bryson not sure if written but v different-Universe = interface to many "real" (game/computer etc) enviros, Lab =bespoke enviro generator "Towards better decoding and language model integration in sequence to sequence models," Chorowski and Jaitly: https://t.co/WyO73wSJlM "Learning in the Machine: Random Backpropagation and the Learning Channel," Baldi et al.: https://t.co/u6XuayLVAH "Coupling Distributed and Symbolic Execution for Natural Language Queries," Mou et al.: https://t.co/LWkXJrLpLm "Towards Information-Seeking Agents," Bachman et al.: https://t.co/G4kBs4NO8e "Prediction with a Short Memory," Kakade et al.: https://t.co/hnvcDQ3bqY RT @langdonw: #Trump cabinet picks only make sense only if you put "Anti-" in front of the agency in question: Anti-Labor, Anti-Environment… It takes a lot for me to be impressed by an AI paper these days, but image-to-image translation is insanely cool: https://t.co/fccNl4bk6q @Smerity :( @sknthla you should start a hashtag about this or something @davegershgorn my condolences for your inbox "Oh god please don't talk about space solar power*, Paul Werbos. You were saying good things before #nips2016 *not a great idea" @aks_phenom see: https://t.co/YJVTbDxAkv @kchonyc @Aelkus @mark_riedl and too good at dialogue ;) @kchonyc @Aelkus @mark_riedl yeah bc talks about things not in the training data or any data :) like NIPS booths @mark_riedl yeah def deserves lots of credit. some of his beefs e.g. re human level control w deep RL prob more legit than the NIPSpocalypse @davegershgorn nah those are vids about papers, not of talks I think @davegershgorn nope, maybe ask @NipsConference @Aelkus @mark_riedl not a bot tho @davegershgorn (but on a less sassy note, it's being taped) @davegershgorn shoulda come @Aelkus @mark_riedl wouldn't be hard, train on Bored Yann LeCun or all of Real Yannick LeCun's FB posts etc Technically, "the future of machines that learn algorithms"... shockingly, Schmidhuber is bullish Panel on the future of RNNs about to start, should be interesting... #nips2016 https://t.co/ddh7RCXoLL @mark_riedl @davegershgorn hardest working man in artificial show business @mark_riedl @davegershgorn good luck with it! Sounds cool @mark_riedl @davegershgorn twitter comments: partially interpretable, partially accountable (except for Trump's) @mark_riedl @davegershgorn someone was making such a point earlier in QA in law session, prob more forcefully @mark_riedl @davegershgorn (or at least some things he could have meant are - I wasn't in the session) @mark_riedl @davegershgorn yeah not nec. endorsing (+ Hinton thinks NNs will answer Qs), just noting it's in Overton window of researchers @davegershgorn @mark_riedl = consistent with wanting to ask for another route, or ask high level Q about route (unclear what level he meant) @davegershgorn @mark_riedl explain all decisions, AI can prob surpass that bar. Maybe not need to know y car changed lines at X v Y velocity @davegershgorn @mark_riedl also, interpretability at all possible levels != accountability. Hinton's said similar things, e.g. Humans can't- RT @zinmalu: One of the upsides of being a woman in Machine Learning: no bathroom queues at conferences. #Nips2016 #WiML https://t.co/u2yUs… And now maybe the new Secretary of Labor. Trump continuing to replicate Idiocracy ("brought to you by Carl's Jr")... https://t.co/AS4i5JXlYf RT @santoroAI: @vkrakovna @Miles_Brundage unfortunately too bold of a claim. Paper is evidence for clocked FF and FB activity, which is not… RT @vkrakovna: Paul Werbos at #nips2016 RNN symposium: we have empirically verified that there is backpropagation in the brain https://t.co… RT @fchollet: The most surprising thing from NIPS so far is the continued prominence of MNIST in experiments. @santoroAI but yeah pricy, I'd prob recommend trying to get your office to pay for it ;) @santoroAI prob not technically a textbook bc includes fair amt of original research but very comprehensive/substantial, at times technical, RT @weballergy: Extracting high-level insights from biomedical knowledge graphs via convnets. #deeplearning https://t.co/ebWwutxAgk RT @DeepMindAI: How do we learn about #socialhierarchies? Our latest paper in @NeuroCellPress https://t.co/GccRWFWBji & more here: https://… "Large-Margin Softmax Loss for Convolutional Neural Networks," Liu et al.: https://t.co/9KS6IDw7j8 "Fast Adaptation in Generative Models with Generative Matching Networks," Bartunov and Vetrov: https://t.co/MXX9kFw1Ul (by Cusumano-Towner and Mansinghka...couldn't fit in one tweet) "Measuring the non-asymptotic convergence of sequential Monte Carlo samplers using probabilistic programming": https://t.co/mdz6TfDn4j "A Deep 3D Convolutional Neural Network Based Design for Manufacturability Framework," Balu et al.: https://t.co/txP7g5jSNp "Knowledge Representation in Graphs using Convolutional Neural Networks," Armando Vieira: https://t.co/E3PnLtBUDg "Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring," Nah et al.: https://t.co/Tvl7vi5j33 "Individual Differential Privacy: A Utility-Preserving Formulation of Diff. Privacy Guarantees," Soria-Comas et al.: https://t.co/9lG7x8AWPR "Spatially Adaptive Computation Time for Residual Networks," Figurnov et al.: https://t.co/FSMsRZ4UQN "Effect of Reward Function Choices in Risk-Averse Reinforcement Learning," Ma and Yu: https://t.co/0svX7H512v "Predictive Business Process Monitoring with LSTM Neural Networks," Tax et al.: https://t.co/l30uGRpxQg "Mining Pixels: Weakly Supervised Semantic Segmentation Using Image Labels," Hou et al.: https://t.co/U5yDPTPaH6 "Mode Regularized Generative Adversarial Networks," Che and Li et al.: https://t.co/tF0me3r7Cg "Model-based Adversarial Imitation Learning," Baram et al.: https://t.co/HvFcDhqx1a Jose Hernandez-Orallo's book on measuring (nat./artific.) intelligence is out soon - good holiday read for AI nerds: https://t.co/ms5mB5NrmC Accepted papers for the symposium on machine learning and the law tomorrow at #NIPS2016: https://t.co/rap61EmDgX RT @ManuelSH: This dog stole my phone! #NIPS2016 #LifeAtSchibsted https://t.co/hOnhq5k8gy Although this gets one part of the way there... https://t.co/zdPkcIoqoW I need a MOOC on dealing with annoying dependency/installation issues. @mikarv @Jackstilgoe maybe easier to suggest w some clarity on your focus w/in that domain, e.g. sociology of research on it, or of impact? @mikarv @Jackstilgoe agree re: datasets being of interest. Lots of work on training in simulation, transfer to real world, as well. @mikarv @Jackstilgoe some of best stuff I've seen has been journalist accounts, e.g.https://t.co/FgCy3lobAg also see https://t.co/YMp827O8bk Nice to meet a bunch of you at #NIPS2016, far too many to list in one tweet :) "RT @genekogan: node-based drawing interface for Invisible Cities. short highlights from Seoul: https://t.co/wtRSAtPsvr code: https://t.co/…" RT @fchollet: Video of the Spot demo by Boston Dynamics. https://t.co/NkAlliXG9i RT @mw_hoffman: Code for our paper on Learning to learn by gradient descent by gradient descent is now available! https://t.co/D1n1Mqi2XN @dribnet explaining the ideas behind @smilevector at #NIPS2016 https://t.co/l0mUrtIdRz RT @timhwang: current award for best merch at @nipsconference goes to @MSFTResearch with this card game based on machine learning publicati… @timhwang at least until NIPS 2019, when hedge funds have piles of cash as merch @j2bryson @mark_riedl who are you all talking about? Maybe mobile Twitter not working but I see this convo starting en medias res RT @boredyannlecun: Hedge fund booths less popular than kernel machines at #NIPS2016 #torched RT @brannondorsey: Full person-to-person image translation with machine learning! Applying #pix2pix to video @branger_briz @phillip_isola @… "Condensed Memory Networks for Clinical Diagnostic Inferencing," Prakash et al.: https://t.co/A4cEIaRXCY "Knowing When to Look: Adaptive Attention via A Visual Sentinel for Image Captioning," Lu et al.: https://t.co/u8KDtVB5r2 "Invariant Representations for Noisy Speech Recognition," Serdyuk et al.: https://t.co/L68pnnkwXy "Coactive Critiquing: Elicitation of Preferences and Features," Teso et al.: https://t.co/jOUjBuhHvP "Sequential Match Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots," Wu e/a https://t.co/LxV17Hcyou "MarioQA: Answering Questions by Watching Gameplay Videos," Mun et al.: https://t.co/BTbYQjKhg9 "Listen and Translate: A Proof of Concept for End-to-End Speech-to-Text Translation," Berard et al.: https://t.co/HuNdJuvQJI @alexjc @yoavgo I guess the availability of such options increases the average altruism level of the remaining AI community :) "RT @alexjc: @Miles_Brundage @yoavgo - What's your signing bonus? - How much do you want? - Seriously? - We have to compete with Google." @alexjc @yoavgo did they say something like that re: signing bonus? Or just your assumption (seems plausible/likely, just wondering :) ) RT @alexjc: Nobody's interested because there's such low supply of #DL skills; researchers can work on more interesting problems and publis… RT @alexjc: Talked to some of the investment bankers at these empty booths, they basically let you write any number on signing bonus cheque… @Jackstilgoe @AnthroPunk note much of lit not specific to ML - more AI (ML a subset), robotics (some relation). @mikarv also maybe has ideas @Jackstilgoe 4. some of @AnthroPunk's stuff relevant, 5. Machines Who Think (McCorduck), 6. attending ML conference prob invaluable... @Jackstilgoe 2. would flag Suchman's work inc. more recent stuff than there, 3. book Talking Nets on prehistory of deep learning before big, @Jackstilgoe some thoughts, with caveat that it depends what you're interested in exactly - 1. decent resources here https://t.co/OKnzdRGe6q @jackclarkSF @davegershgorn @dinabass (teams of ppl and some public, some private methods, but in neither case a single all-doing AI system) @jackclarkSF @davegershgorn @dinabass Watson + Brain similar in this way. Just teams of ppl, journos talk about as if systems. IBM promotes "What does this even mean? https://t.co/KizBboCFdT (Answer: nothing) https://t.co/7NW6aXluN0" """Modeling Structure + Resilience of the Dark Network,"" De Domenico+Arenas: https://t.co/iRelG0Pe4S ""much more resilient than the Internet""" "Cryptocurrency Portfolio Management with Deep Reinforcement Learning," Jiang and Liang: https://t.co/1Ye6BFj4df "Self-critical Sequence Training for Image Captioning," Rennie et al.: https://t.co/cRnRnC0K2Y "Guided Open Vocabulary Image Captioning with Constrained Beam Search," Anderson et al.: https://t.co/1bjzWEMiix "Object-Centric Representation Learning from Unlabeled Videos," Gao et al.: https://t.co/tqF3KSfmQv "Learning Operations on a Stack with Neural Turing Machines," Deleu and Dureau: https://t.co/nTgqFpw49F "A Point Set Generation Network for 3D Object Reconstruction from a Single Image," Fan et al.: https://t.co/3kZJaI4aXx "Success Probability of Exploration: a Concrete Analysis of Learning Efficiency," Zhang et al.: https://t.co/4Didn4rJxQ "End-to-End Joint Learning of Natural Language Understanding and Dialogue Manager," Yang et al.: https://t.co/SFiLgIJBWR ForcePoint 2017 security forecast includes automated hacking, something I'm looking into https://t.co/gvaBTJ5jRo Report short on details tho @j_winterton @Flex_Capacitor @TryCatchHCF more open-ended agent might learn bad stuff but also not that good right now. @j_winterton @Flex_Capacitor @TryCatchHCF e.g. use core game engine but no other humans on map; or goal = drive w/o accident... @j_winterton @Flex_Capacitor @TryCatchHCF don't see a reason it couldn't be, either in terms of area of game, or goal of agent... #nips2016 poster session. https://t.co/9EDw4S9J8d RT @kurteichenwald: Air Force One tweet tantrum -- a lie pushed just after Boeing says concerned about Trump trade policies -- is a frighte… RT @DeepMindAI: Read our blog to find out about #DeepMindLab https://t.co/bxuSSfz8h2 then try it for yourself here https://t.co/JZXiMiAgik… @Sam_L_Shead are you here? @EdHenry_ glad you enjoyed! :) RT @hardmaru: Apple will start publishing, according to @rsalakhu at #nips2016 https://t.co/I0ndKKc2vB "Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles," Lakshminarayanan et al.: https://t.co/oOpnJIFOtW "Procedural Generation of Videos to Train Deep Action Recognition Networks," de Souza et al.: https://t.co/atNHi63WPz "End-to-end Learning of Driving Models from Large-scale Video Datasets," Xu and Gao et al.: https://t.co/tFO0WHweF2 "We used Neural Networks to Detect Clickbaits: You won't believe what happened Next!," Anand et al.: https://t.co/NdQ3SIMJk3 "Learning Adversary-Resistant Deep Neural Networks," Wang and Guo et al.: https://t.co/OjBzTbCL5b "Ensembles of Generative Adversarial Networks," Wang et al.: https://t.co/zpqavhHR4v I'm like 1.5 days behind on arXiv because of NIPS but here are a quick few that I found somewhat more urgent for mostly random reasons... @Jackstilgoe good Q, lemme sleep on it :) (4-stage approach to learning hard tasks - Unsupervised learning --> imitation --> reward labeling by human --> RL. Hmm...) "Deep Learning of Robotic Tasks using Strong and Weak Human Supervision," Hilleli and El-Yaniv: https://t.co/uDmWm74FVW RT @togelius: This book chapter summarizes key themes of my research - AI for games and games for AI - in an accessible way. https://t.co/… Designated Survivor (show where HUD Secretary becomes POTUS post-attack) has fluctuated a lot in scariness lately. https://t.co/yFFPLBFlfU @bradneuberg yep, i'll send you a direct message w/ details :) @decodyng if you follow me back on here I can send you the details :) no signup needed @botminds @jwan584 that may be. In this case, it seemed clearly not productive given that they had already discussed at length. @Smerity @davegershgorn agreed. I added an edit noting I agree with you/that my summary was highly compressed. @botminds @jwan584 re: avail heuristic/"always," dunno, but I haven't seen him IRL that many times, + reminds me of quote from The Office... https://t.co/e8J8MXJWjG @botminds @jwan584 I've personally seen him do both at least 3 times... @davegershgorn OTOH, @mat_kelcey prob right that he doesn't deserve promotion for being rude @davegershgorn wouldn't say "about the world," I summarized here: https://t.co/bBrgVSUU9H @mat_kelcey perhaps fair, I already posted my attempt at a summary/recollection here, though: https://t.co/bBrgVSUU9H Still a bit of room left at the @FHIOxford lunch tomorrow - get in touch soon if interested! We'll discuss AI safety, policy, etc. #NIPS2016 @davegershgorn do it @marek_rosa some room left, but not enuf for all of GoodAI ;) a few fine, lemme know how many might come- I'll send direct message w details @jackclarkSF @davegershgorn emboldened, if anything. Kept going after Ian called him out! @btabibian I'll send you a direct message :) @vkrakovna k I'll send you a direct message :) @jwan584 he always comments after people's talks + says he invented X before this new Y, and how is X different from Y? Just did it at NIPS If Schidhuber didn't exist, someone would have to (re)create him... RT @GaryMarcus: Thrilled to be Director of Uber's New AI Lab! / Uber Bets on Artificial Intelligence https://t.co/3UtNSm3Z2G RT @PeterAsaro: https://t.co/ehkShGsip2 GI = Geometric Intelligence. https://t.co/IX3gVXoSWD @Tkaraletsos (and congrats!) @Tkaraletsos interesting! @Tkaraletsos any relation to Uber? or just the name? RT @soumithchintala: Wow! Universe, TorchCraft, Labyrinth. What a week for dynamic datasets. And it's only Monday. #nips2016 And on the first day of NIPS... https://t.co/xImz16UHTO RT @DeepMindAI: Excited to announce our 3D, fully customisable AI research environment #DeepMindLab will be open-sourced this week! https:/… RT @OpenAI: We're releasing Universe, a platform for measuring and training AI agents: https://t.co/bx7OjMDaJK @elluba will send you a direct message :) @memotv I'll send you a direct message :) "Overcoming catastrophic forgetting in neural networks," Kirkpatrick et al. at DeepMind: https://t.co/pRohXVAIGR Off to #NIPS2016! See many of you there :) RT @karpathy: We're going to NIPS to talk about ICLR papers @EdHenry_ yep, I'll send you a direct message :) Google + Baidu news results on Trump right now... https://t.co/2uApDA43W8 RT @afrazhaowang: News abt Tsai Trump call are completely censored from Chinese online discussion-----News were all deleted. @Gang1man great, I'll send you a direct message :) @_ambodi K - if you follow me back on here, I'll send you a direct message w/ some more info. @SmithaMilli great, I'll send you a direct message in a sec :) RT @cvondrick: Recognizing objects and scenes from sound only. Turn on your speakers! More visualizations: https://t.co/CJK75ZB8g0 https://… @mark_riedl it gets pretty good entertainment-wise but yeah, not super illuminating. Papers are up for the deep reinforcement learning workshop at NIPS: https://t.co/UnhIvbBDiZ @deliprao @dennybritz (vs. like 50 words in the other dataset or something) @deliprao @dennybritz here's the paper: https://t.co/UuzrvIo80m not sure exactly what's meant by open/closed here, but it's several thousand @hannawallach great! If you follow me back on here I'll send you a direct message w/ the details :) @mark_riedl omg. @marwinsegler great, I'll send you a direct message about it :) @sknthla agreed - failure of imagination. Intangible AI will be more impactful IMO... This series of videos is really good for explaining some of the fundamental ideas of deep learning - recommended: https://t.co/71xyzQ2DsP @jordnb great, I'll send you a direct message on here with some details :) RT @allanfriedman: The President's Cybersecurity Commission report is now public. Some good things in here--check it out. https://t.co/qeUq… RT @TerynNorris: Energy R&D at risk (cc @TheAEIC @republicEn @JayFaison1 @lisamurkowski @powellrich @ThirdWayEnergy @hal_harvey @jeffnavin… RT @DeepMindAI: Check out our blog to find out about the papers we'll be presenting at @NIPSconference next week! https://t.co/8t01exDTLL @Sam_L_Shead probably a new name for Labyrinth which has been due for a while... @danieldewey I'll send you a direct message on here :) RT @jackiefloyd: Could we convince journalists to use images like this to illustrate AI instead robot hands on keyboards? https://t.co/An9A… @markus_with_k great, I'll send you a private message w/ more info :) RT @cortney_dc: My team's new report is out with options & ideas for #securing #cyberspace. Check it out! https://t.co/T0SGmBwfUG @RANDCorp… Interested in AI safety/policy? @FHIOxford will organize a lunch Tues. at #NIPS2016 for related discussions, lemme know if interested! "RT @ylecun: Six short videos that explain the ideas behind AI and deep learning in very simple terms. The purpose of these... https://t.co…" @alexjc very fuzzy at the moment :) could def meet during a break + probably most sessions except deep RL, law, maybe other musts for me... @alexjc `I'll be there, would love to meet :) RT @togelius: @mark_riedl Yes, we got a cease-and-desist letter from Nintendo. Had to remove graphics and the Mario name. Relaunched as Pla… RT @mark_riedl: … I think a similar thing happened to the Super Mario Bros. AI competition? \cc @togelius RT @mark_riedl: This is unfortunate 😾. Using Doom for academic progress in machine learning might fall under fair use. (I’m not a lawyer th… "RT @Smerity: The @MaluubaInc NewsQA dataset provides over 100k QA pairs (@stanfordnlp SQuAD style) over @DeepMindAI's CNN dataset https://t…" RT @nntsn: Our work on learning to act in 3D envs is out! "Playing Doom with SLAM-Augmented Deep Reinforcement Learning", https://t.co/B00b… RT @syhw: @syhw all videos are here https://t.co/UvbQuwub54 RT @syhw: Nice vulgarization of SGD, backprop and ConvNets https://t.co/gjewyRw4Zp @jimmfleming I may have also forgotten something, there's so much going on :) @jimmfleming yeah, there's some stuff like that, e.g. https://t.co/n7GKRylP8V not sure if latest stuff like GANs used for it yet... +Image from caption is a harder problem in general case than from (small number of) classes, but latter was insanely fast, so...we'll see. Or at least, seemingly so, and "usable" depends on purpose. Definitely quite usable for creative exploration purposes now... Likewise for inpainting, various forms of image modification, etc. Lots of image-related tasks on cusp of usable results w/ deep learning. If rate of prog. in image gen. by class is any indication, we should have pretty rapid progress on gen by caption... https://t.co/Z60FXCUjpv https://t.co/Z0iS0BUrhP @justinhendrix nope, that's what my twitter feed is kinda for ;) @jackclarkSF's newsletter is a denser/higher signal to noise source FWIW... Great idea, and helps with interpretability and finding problems with word embeddings. https://t.co/AKHGBPwobF https://t.co/fzgHHzD98U @justinhendrix these what? "Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis," Dai et al.: https://t.co/SacNTL2ajv "Video Scene Parsing with Predictive Feature Learning," Jin et al.: https://t.co/cTtrjMLxv5 Tuning the Scheduling of Distributed Stochastic Gradient Descent with Bayesian Optimization," Dalibard et al.: https://t.co/Dks4ZWoiuS "CDVAE: Co-embedding Deep Variational Auto Encoder for Conditional Variational Generation," Lu et al.: https://t.co/CnBvAI85JU "We represent human input as a finite state machine which accepts allowed compositions." """Computer Assisted [Music] Composition with RNNs,"" Walder + Kim, Data61/ANU: https://t.co/yCZyiskfhU E.g.: https://t.co/PqW1j58jwP" "Playing Doom with SLAM-Augmented Deep Reinforcement Learning," Bhatti et al., Oxford: https://t.co/UHbitbg9pW "Generalizing Skills with Semi-Supervised Reinforcement Learning," Finn et al., Berkeley/OpenAI: https://t.co/PWeSG7jnRF "Combining Deep Reinforcement Learning and Safety Based Control for Autonomous Driving," Xiong et al., Tsinghua: https://t.co/aO574XrEVj "Towards Robust Deep Neural Networks with BANG [Batch Adjusted Network Gradients]," Rosza et al.: https://t.co/Nuu5UUtnmr "Adversarial Images for Variational Autoencoders," Tabacof et al.: https://t.co/BQMaucxDGa "Learning to Generate Images of Outdoor Scenes from Attributes and Semantic Layouts [with GANs]," Karacan et al.: https://t.co/MtjdX2eX9u More from Megvii - "Training Bit Fully Convolutional Network for Fast Semantic Segmentation," Wen et al.: https://t.co/ZAyj0JAzJv "Interaction Networks for Learning about Objects, Relations and Physics," Battaglia et al., DeepMind: https://t.co/QYlwRRviw3 Claims big progress/near human-level performance on two datasets...anyone familiar with this stuff have thoughts? "Video Captioning with Multi-Faceted Attention," Long et al., Tsinghua/Rutgers: https://t.co/nAotalgdbc "A Theoretical Framework for Robustness of (Deep) Classifiers Under Adversarial Noise," Wang et al., UVA: https://t.co/EtvLgMMvmy "A Compositional Object-Based Approach to Learning Physical Dynamics," Chang et al., MIT: https://t.co/uBLmxZ6jhX "Bootstrapping incremental dialogue systems: using linguistic knowledge to learn from minimal data," Kalatzis et al: https://t.co/cwcdOhjURF "Optimization of image description metrics using policy gradient methods," Liu et al., Google: https://t.co/irzv9mO9DB "Temporal Attention-Gated Model for Robust Sequence Classification," Pei et al.: https://t.co/1Ue7pethYN Anomaly Detection in Video Using Predictive Convolutional Long Short-Term Memory Networks," Medel and Savakis: https://t.co/byMGA55B5U "Multi-modal Variational Encoder-Decoders," Serban and Ororbia et al.: https://t.co/hSj9AnDF7B "Definition Modeling: Learning to define word embeddings in natural language," Noraset et al.: https://t.co/H7ltITpZbh "Learning Shape Abstractions by Assembling Volumetric Primitives," Tulsiani et al., Berkeley/Stanford: https://t.co/ym7adabL0i "Deep Variational Information Bottleneck," Alemi et al., Google: https://t.co/0JoJ4806Ye "TorontoCity: Seeing the World with a Million Eyes," Wang et al. (new dataset): https://t.co/NtU6f1oQSU (Sidenote: there's some sort of "2 degrees of Yoshua Bengio" in AI...In this case, folks from Wyoming/Geometric Intelligence/MILA/Freiburg) "Plug & Play Generative Networks: Conditional Iterative Generation of Images in Latent Space," Nguyen et al.: https://t.co/ccLcBKb0Ro Maybe you should spend more time learning how government works and finding qualified nominees, not weird rallies? https://t.co/jVF8yNiwwe @mat_kelcey video: https://t.co/Aq9ZCJdwkr RT @thekareem: When you realize that the Spice Girls have more foreign policy experience than Donald Trump https://t.co/DctfGUolTX RT @mark_riedl: Hawking: Humanity's greatest threat is AI... *Brexit happens* *Trump happens* ... nope, it's humans https://t.co/4M00FG6pHa @Plinz on remaining steps to human-level AI - notes from an interview by @AIImpacts: https://t.co/1PqNjvWaQD "This much is clear: Bannon and Thiel believe their ideas have found the perfect host organism." https://t.co/CGdg7OLN2Z Sidenote: I'm seeing a *lot* of Google Brain residency program papers. Seems to be working for them. "Capacity and Trainability in Recurrent Neural Networks," Collins et al., Google Brain: https://t.co/WASEQMyZ9i (convincing as in 50% misclassified by humans as real, 90% misclassified as real by fake review detection algos) """Context-aware Natural Language Generation with RNNs,"" Tang et al, MSFT/Peking/U Mich https://t.co/51t0gLrVJm Makes convincing fake reviews https://t.co/KPCbogf8q5" (code + samples: https://t.co/pTDisBHgdt) """C-RNN-GAN: Continuous RNNs with adversarial training,"" Olof Mogren: https://t.co/jhpzeFgxo9 Applied to classical music gen., w/ samples" "Semantic Facial Expression Editing using Autoencoded Flow," Yeh et al., Urbana-Champaign/CU of Hong Kong/Google: https://t.co/rDtVKniPxn https://t.co/504W40Xqkx "Modeling Relationships in Referential Expressions with Compositional Modular Networks," Hu et al., Berkeley/BU: https://t.co/T1ZBnNIS1E "High-Resolution Image Inpainting using Multi-Scale Neural Patch Synthesis," Yang et al. at USC/Adobe/etc.: https://t.co/7S0Hex8f4R https://t.co/6xdGOywyah Interesting stuff. Lots of stuff like this in the paper, including SOTA on COCO. https://t.co/b8nB84CWxb """Effective Quantization Methods for Recurrent Neural Networks,"" He et al., Megvii: https://t.co/fDbkAVw2xm (Chinese AI startup)" "Wider or Deeper: Revisiting the ResNet Model for Visual Recognition," Wu et al., Adelaide: https://t.co/G3rVaHmqmY "Sync-DRAW: Automatic GIF Generation using Deep Recurrent Attentive Architectures," Mittal and Marwah et al.: https://t.co/DGa0elYMqD "The Computational Complexity of Portal and Other 3D Video Games," Demaine, Lockhart, + Lynch: https://t.co/TTOKTDknPa """An Artificial Agent for Robust Image Registration,"" Liao et al., Siemens: https://t.co/UjlIvGLOMs (aligning medical images w/ deep RL)" "Speed/accuracy trade-offs for modern convolutional object detectors," Huang et al., Google Research: https://t.co/fpv7a9Vr8F "Exploration for Multi-task Reinforcement Learning with Deep Generative Models," Bangaru et al., IIT Madras: https://t.co/Mj2g2N011U "Neural Combinatorial Optimization with Reinforcement Learning," Bello and Pham et al., Google Brain: https://t.co/2a9PgUk762 RT @deaneckles: Authors did not notice (or at least note) that many of the papers they cite in the report are not counted in this chart. RT @deaneckles: Example of obsessing with misleading metrics. This chart doesn't even include @NipsConference papers. https://t.co/O07bEywS… @yoavgo this will be significantly bigger: https://t.co/pilrpu9qPY @botminds it doesn't right now. Interesting Q re: if it could. Drones that follow you around and attack/block cameras? :) prob better ways @mark_riedl or: Make America Great at GANS @botminds at least for low power cameras... wldn't be surprised if it were doable on smartphone-level hardware soon. could be pricy at scale @botminds much work on compressed nets for use on phones; seems plausible some of it could be done onboard. but yeah, connectivity is key. RT @gdb: Excited and honored to be testifying at the Senate today about AI: https://t.co/7OZZTYfFbR RT @ivan_bezdomny: @Miles_Brundage if so, Piep Piper was on to something. Biggest operation cost might become storage They mention privacy as one motivation. I'm picturing surveillance, but to watchers, everyone is Cage (/Malkovich). https://t.co/JS3z6jld33 RT @mark_riedl: Hi, hire my postdoc Brent Harrison (https://t.co/ha2gjg16Di). He basically runs my lab. Might as well set up his own lab at… (trump working in his hotel on The Apprentice) Some lighter fare: https://t.co/pcwhoYgzxx "Fast Wavenet Generation Algorithm," Le Paine et al., Urbana-Champaign/IBM: https://t.co/FPYYMhhpY8 "A Deep Multi-Modal Fusion Architecture for Product Classification in e-commerce," Zahavy et al., Technion/Walmart: https://t.co/niE7mBU2tr "Fast Face-swap Using Convolutional Neural Networks," Korshunova et al. at Ghent University/Twitter: https://t.co/UTouXX8swX https://t.co/Q68STXTIjA "Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction," Zhang et al., Berkeley: https://t.co/TiwUQpxI6L "NewsQA: A Machine Comprehension Dataset," Trischler et al., Maluuba: https://t.co/3vyjUzTf72 "The Emergence of Organizing Structure in Conceptual Representation," Lake et al.: https://t.co/lzoXzQDtsW The future of work is Seneca Crane in a driverless car, apparently. https://t.co/3DiLOR3AYX Or software/hardware...much of "labor" will be done by AI but still need lots of sensors all over the place, which isn't developing as fast. Not sure people appreciate how effective video surveillance could be soon. Used to be more labor-limited, may soon be capital-limited... "Dialogue Learning With Human-In-The-Loop," Li et al., Facebook: https://t.co/flbFKiWDtT RT @jessfraz: This talk is hilarious, if you watch one thing today make it this https://t.co/dCWrypGvkv RT @_rockt: Schedule for 1st #NAMPI workshop @NipsConference is now online. Looking forward to amazing speakers! https://t.co/UvVSOt5evh #D… RT @BrooklynSpoke: Trump is not using Twitter to distract you from his agenda. Bannon & co. are using Trump to distract you from theirs. GiveWell's top charity recommendations (and analysis thereof) for holiday season 2016: https://t.co/IluXjO4jMH "RT @DLin71: CONWAY: You retweeted a 16-year-old with a baby’s reasoning skills TRUMP: He’s our new Secretary of State 16YO: 7-Eleven was…" @sknthla don't think he's that strategic, though maybe Bannon put him up to it (like he did for the Bill Clinton-accuser press conference).. @magnord I'd settle for a Diet Coke ;) "Agent-Agnostic Human-in-the-Loop Reinforcement Learning," Abel et al.: https://t.co/aGTIELKGjU "Active Reinforcement Learning: Observing Rewards at a Cost," Krueger et al. at MILA/FHI/etc.: https://t.co/l2VJGBazZV "Efficient Exploration in MCTS using Human Action Abstractions," Subramanian et al. at GA Tech/DeepMind/UT Austin: https://t.co/CRh1qXgRdl "Visual Dialog," Das et al.: https://t.co/Vqf2HxzcDz "Multi-Task Zero-Shot Action Recognition with Prioritised Data Augmentation," Xu et al.: https://t.co/mQOEiGCkns "Efficient Convolutional Auto-Encoding via Random Convexification and Frequency-Domain Minimization," Oveneke et al https://t.co/grJzLeRiiC "Unifying Multi-Domain Multi-Task Learning: Tensor and Neural Network Perspectives," Yang and Hospedales: https://t.co/iOy7Xh5D2E "Diet Networks: Thin Parameters for Fat Genomics," Romero et al. at MILA etc.: https://t.co/NqQ5St5l2c "The One Hundred Layers Tiramisu [???]: Fully Conv. DenseNets for Semantic Segmentation," Jegou et al. at MILA etc.: https://t.co/Dt43iNa3WR "Gaze Embeddings for Zero-Shot Image Classification," Karessli et al.: https://t.co/Ar2IeXzibk "Dense Prediction on Sequences with Time-Dilated Convolutions for Speech Recognition," Sercu and Goel, IBM: https://t.co/3kb4dOazLh "Semi Supervised Preposition-Sense Disambiguation using Multilingual Data," Gonen and @yoavgo: https://t.co/a5tBsmoI66 """Synthetic Autonomous Driving using Generative Adversarial Networks,"" Ghosh et al: https://t.co/gxp3TAlzsq Trained in the game Road Rash :)" "MS MARCO: A Human Generated MAchine Reading COmprehension Dataset," Nguyen et al., Microsoft: https://t.co/DXoZ0airAp "Who's that Actor? Automatic Labelling of Actors in TV series starting from IMDB Images," Aljundi et al.: https://t.co/tg3cCrqUOr "Unsupervised Feature Learning With Symmetrically Connected Convolutional Denoising Auto-encoders," Dong et al.: https://t.co/1Y93T8TNXM "Social Scene Understanding: End-to-End Multi-Person Action Localization and Collective Activity Recognition": https://t.co/id4lI5F572 "Hyperspectral CNN Classification with Limited Training Samples," Windrim et al.: https://t.co/YstZMPWx6G "Exploiting Unlabeled Data for Neural Grammatical Error Detection," Liu and Liu: https://t.co/FDiMO0jsue Papers for the interactive machine learning workshop at NIPS, including cool stuff from @FHIOxford researchers: https://t.co/56TmZ52cvd Accepted papers for the adversarial training workshop at NIPS: https://t.co/HdOMGfMHbm Computer crashed from all the new PDFs open :( trying again to tweet some of it soon... I'm dead inside. https://t.co/CKqGlp63g5 @rbhar90 I have, but not recently - he and Lloyd (one of the coauthors here) are on my to-read-up-on lists :) "Patient-Driven Privacy Control through Generalized Distillation," Celik et al. at PSU/Facebook: https://t.co/IgwAoShS1c "Accelerated Gradient Temporal Difference Learning," Pan et al.: https://t.co/ShZmMk7MI3 """Quantum Machine Learning,"" Biamonte et al.: https://t.co/69O62UTalr Just the sort of review I had been planning to look for at some pt :)" "Learning a Natural Language Interface with Neural Programmer," Neelakantan et al., Google Brain: https://t.co/ZhzhDhvp4e "Proceedings of NIPS 2016 Workshop on Interpretable Machine Learning 4 Complex Systems," Wilson/@_beenkim/ Herlands https://t.co/7S0U4XfSig "Improving Policy Gradient by Exploring Under-appreciated Rewards," Nachum et al., Google Brain: https://t.co/Qlxe4U50oT "Learning to Compose Words into Sentences with Reinforcement Learning," Yogatama et al. at DeepMind: https://t.co/PYlE1S7wgF """Handwriting Profiling using GANs,"" Ghosh et al. at IIT Kharagpur: https://t.co/72pKba8HgE Preliminary but suggestive re: forging, etc." "Deep Reinforcement Learning for Multi-Domain Dialogue Systems," Cuayáhuitl et al. at U. of Lincoln/Samsung: https://t.co/EOJ8145kBG "Training an Interactive Humanoid Robot Using Multimodal Deep RL," Cuayáhuitl et al. at U.'s of Lincoln/Toulouse: https://t.co/dkH0zQFmDb Oh dear, it's a big night on arXiv... @summerbrennan I thought this was pretty good: https://t.co/935RGAwXD8 RT @daviottenheimer: @Miles_Brundage history repeats https://t.co/53TH5gbyzt No words. https://t.co/4Fcadl8KDV (conservative != Nazi, but it's depressing that with liberal democracy at stake, there are think pieces about how to make $ from all this) The rise of Adolf Hitler shows that VC overlooking Nazi media investments could be a bad strategy. https://t.co/jMLn1WJIHy I LOL'd. Great takeaway from the election, folks. https://t.co/jMLn1WJIHy @xanderai likewise! @bradneuberg yup, that was my first one. pretty crazy! @bradneuberg sure, that'd be fun! I have avoided looking closely at the schedule, a bit overwhelming :) @bradneuberg yep! :) Postdoc on trust and transparency in AI at the Leverhulme Center for the Future of Intelligence: @LeverhulmeCFI: https://t.co/7UkMSZZQPb So, who's going to NIPS? RT @jimmfleming: Finished my implementation of Recurrent Entity Networks (1st to solve the 10k bAbI tasks) https://t.co/acvsa0mnbf #deeplea… Ummm... https://t.co/2bwcTVSpBZ RT @robinhanson: "Chinese economy [is] increasingly innovative .. state firms [get] more subsidies, private firms [do] more results" https:… @mark_riedl not quite as scalable, though :) RT @mark_riedl: Turns out there is an easier way to generate Super Mario Bros. levels than to invent new AI techniques. https://t.co/ijD8FF… @_jyan_ ah, thanks :) @_jyan_ what do you mean "doesn't affect readers"? @Aelkus why couldn't one distinguish between reasons or types of speech censored? Child porn vs sensitive-bc-dictator-says-so seem different From article: https://t.co/IDpqOr0lpo @Aelkus anyway, not sure that's the relevant distinction...seems like you could say "don't repeat racist stuff" + "don't be tools of state" @Aelkus did they ask to filter inputs, or outputs? The potential for AI to help with censorship and other nefarious state business is only going to grow. Not off to a great start right now... "RT @williamstome: Nice @sciam article from Gordon Briggs covering his work on making robots say no! #AI #HRI #RobotEthics @hrilab https:/…" This is unsurprising but very bad... https://t.co/IW7oeE5NnP RT @NandoDF: Jürgen Schmidhuber & many others contributed to AI. Evolution favours simplicity in recognition - few celebrities :) https://t… @AtulAcharya see: https://t.co/B5yjTHzLjd "The Off-Switch Game," Hadfield-Menell et al. at Berkeley (AI safety stuff): https://t.co/MwtsCM9JnR "Survey of Expressivity in Deep Neural Networks," Raghu et al. at Google Brain etc.: https://t.co/4OXNFrkjb5 """Texture Synthesis with Spatial Generative Adversarial Networks,"" Jetchev, Bergmann, + Vollgraf: https://t.co/HzjNFMwmWA Not bad... https://t.co/WRuQmNRT9l" """Semantic Compositional Networks for Visual Captioning,"" Gan et al.: https://t.co/dmWLdvyEUN" "A Compact Convolutional Network for EEG-based Brain-Computer Interfaces," the US military-industrial complex et al: https://t.co/BK7oLWpDIk "3D Fully Convolutional Network for Vehicle Detection in Point Cloud," Bo Li at Baidu: https://t.co/RZOOR6l1pF "Dynamic Key-Value Memory Network for Knowledge Tracing," Zhang et al.: https://t.co/kLTZvOYzqQ "How I Stopped Worrying abt the Twitter Archive at the LOC + Learned to Build a Little One for Myself," Gayo-Avello: https://t.co/nh6rEMt9Od "Domain Adaptation by Mixture of Alignments of Second- or Higher-Order Scatter Tensors," Koniusz et al.: https://t.co/l9gnXsfnHr """General human activity patterns,"" Mollgaard et al.: https://t.co/bqbvpC5enw 638 individuals tracked w/ smartphones are pretty predictable." "Learning Python Code Suggestion with a Sparse Pointer Network," Bhoopchand et al.: https://t.co/NASAruZhXO "On Human Intellect and Machine Failures: Troubleshooting Integrative Machine Learning Systems," Nushi et al.: https://t.co/7Y8P8VQ0Ut """Training + Evaluating Multimodal Word Embeddings w/ Large-scale Web Annotated Images,"" Mao et al.: https://t.co/pmeQn6fVSY V. big dataset" "Learning an Invariant Hilbert Space for Domain Adaptation," Herath et al.: https://t.co/l7RYVUiQG5 "Semantic Segmentation using Adversarial Networks," Luc et al., Facebook: https://t.co/K4vKrEjkTA """Neural Machine Translation w/ Latent Semantic of Image + Text,"" Toyama/Misono et al: https://t.co/1u9Q2nKb7b Interesting! Grounded-ish NMT" "GuessWhat?! Visual object discovery through multi-modal dialogue," de Vries et al.: https://t.co/WagvaUw8l1 "A Simple, Fast Diverse Decoding Algorithm for Neural Generation," Li et al., Stanford: https://t.co/MpJdwDEyTz (seriously, though, I wish I had better ideas for what to do, so resorting to sarcasm) I bet if Vox does a great interview with a voter fraud expert, Trump will suddenly be reasonable and informed. That'll show him. Cool story, bro. https://t.co/dN3FJhC2lu All the arXiv tweets coming... "Grassroots" like Breitbart journalists influenced by Steve Bannon? @KellyannePolls https://t.co/MX5RkyutvW RT @mtaibbi: Congratulations, America, you've turned the presidency into a four-year Alex Jones broadcast. https://t.co/KdG3SEGseC RT @hannahgais: And with a cabinet like Trump's, whatever the response is will be completely unhinged. https://t.co/9dHQeuKZmc RT @nsaphra: REMINDER https://t.co/LlUjAnTvop Or ignorant of basic relevant knowledge, or an asshole... pretty much anything but 8-D chess. Horrifying regardless. https://t.co/EtNnlihMJO "RT @jonfavs: ""President Trump, we're here for your daily intel briefing."" ""Nah I'm good, just caught Morning Joe."" https://t.co/VT9qZ2O09W" RT @twadhwa: And that's how you legitimize a recount https://t.co/nW0bboPqxy "RT @scottlincicome: Just the President-elect of the USA alleging wide-scale voter fraud with no evidence. Totes NBD. HEY LOOK OVER THERE TA…" RT @jimtankersley: Holy crap. There is absolutely no evidence this is true. https://t.co/rVIfOlxOEx See also: https://t.co/uH8zSp6g9R "Damn it, Netflix, did you really have to start streaming a good Brazilian sci-fi show right now? (""3%"")" RT @alexjc: Thrilled to finally announce a new project with @graphific and @samim: https://t.co/BMTOU3asIp Oh, and we're hiring ;-) #⚘ #AI… RT @gdb: I'm looking for beta testers for some new reinforcement learning software. Ping me if interested: gdb@openai.com. @yoavgo something by Hinton. RT @yoavgo: If you go past the propaganda overtones, this is actually a very interesting piece. https://t.co/qepdkcA2iY RT @summerbrennan: In another universe, Hillary is president-elect and we're all fighting about a NYT recipe that says to put peas in pumpk… If you wanna think/talk about existential risk in Ox. today, some colleagues and I will be speaking at this at 4:30: https://t.co/WBDjK1z6to @yoavgo same. @mat_kelcey if interesting abstract, skim; if skim is interesting, read/share :) CS/new is the best page b/c abstracts displayed upfront.. @mat_kelcey open tabs 4 disordered systems + NNs, CS/new, neurons + cognition, computation, + ML; if interesting title/author, open tab; ... TFW you remember arXiv observes some holidays and there's nothing new tonight... https://t.co/2cDSJtDALX @sknthla oh ok, that's fair. @sknthla humanitarian photo worse than fun activity (etc.)? With you on the easygoing bit, but some people enjoy e.g. hiking and don't suck "RT @thehill: Ivanka Trump on her dad's comments about her sex appeal: ""If he wasn't my father, I would spray him with Mace"" https://t.co/hF…" ...or service robots are same sorts of things/made by same ppl as the next big wave. Wouldn't rule US out of this with or without Trump. ...analogous to iPhones where assembly done in China [Roombas made there] but much of value goes to U.S. And not clear current ind. robots.. Really, though, we do make some robots, but it's true we're not the leader on industrial robots, at least. On service robots, it might be... @peteskomoroch @mat_kelcey what's that from? /is that the real quote? RT @chris_brockett: .@Miles_Brundage Like this one: https://t.co/mkx1rljazm @chris_brockett yeah...prob for legal reasons (a la why SpaceX only hires Americans), iRobot's Roombas made abroad, military stuff in Ohio. The U.S. will be selling robots, bigly. @mat_kelcey yup. "Trump on robots. From: https://t.co/ECuTdrxinl Including the Bill Gates thing b/c maybe they talked about that? Unclear. https://t.co/WYl2lK873G" RT @paulkrugman: A number of liberal writers, me included, seem to have gotten this notice yesterday. https://t.co/OROGP1qbDF @botminds yeah, I'd include that under "progress too slow"... but they'd still need some explanation for why they don't update the goals :) RT @togelius: @Miles_Brundage For example, there's been amazing progress in deep learning. But maybe not progress towards the stated goals. RT @togelius: @Miles_Brundage Progress happened, but not in the way envisioned? New capabilities were gained, but not the expected ones. Some plausible explanations: not enough funding targets those goals, wrong metrics chosen, progress too slow... clearly there is progress..? One notable change is there's now policy stuff thanks to @rcalo et al. Still, surprised to see no reflection on major timeline slippage... Pretty sure not many people read it carefully, otherwise they'd be asking what the heck is going on there. A lot of the material (including specific 5/10/15 year targets) in the US Robotics Roadmap is the same in 2009, 2013, and 2016 editions... "Unsupervised Learning of Sentence Representations using Convolutional Neural Networks," Gan et al.: https://t.co/RjB241aNDF RT @vkrakovna: Just joined DeepMind's AI safety group together with @janleike and @AdaptiveAgents - excited to be part of this amazing team! "Emergent Logical Structure in Vector Representations of Neural Readers," Wang et al.: https://t.co/KpWye1pBy9 "Inducing Interpretable Representations with Variational Autoencoders," Siddharth et al.: https://t.co/y12qvinwRL "Multi-View 3D Object Detection Network for Autonomous Driving," Chen et al., Tsinghua/Baidu: https://t.co/REXT6jcaSS RT @haldaume3: .@Miles_Brundage this was obv coming. idk why you'd predict entire frame & not just model's emb of it. smaller & only contai… RT @magnord: @Miles_Brundage GPUs are relevant. We have been running A3C on both CPU and GPU for months. GPU version is many times faster. "Facebook Said to Create Censorship Tool to Get Back Into China" https://t.co/fgEKod1Qx6 RT @mindsforge: the title of this paper is my life.......................... https://t.co/7vDdThlhsM "Variational Intrinsic Control," Gregor, Rezende (@DeepSpiker), and Wierstra at DeepMind: https://t.co/XerdsSs9av "A Deep Learning Approach for Joint Video Frame and Reward Prediction in Atari Games," Leibfried et al. at MSFT: https://t.co/ufVSZNmwV4 "Options Discovery with Budgeted Reinforcement Learning," Leon and Denoyer: https://t.co/QNDp62TvPS "Generalized Dropout," Srinivas and Babu: https://t.co/WhnyIqxHG0 "Neural Information Retrieval: A Literature Review," Zhang et al.: https://t.co/3iWAwzySHp "ResFeats: Residual Network Based Features for Image Classification," Mahmood et al.: https://t.co/QDdPVOTK94 "Deep Temporal Linear Encoding Networks," Diba et al.: https://t.co/ybkdzsNHRQ "Self-Supervised Video Representation Learning With Odd-One-Out Networks," Fernando et al.: https://t.co/Nh7P61mMhv "Deep Learning for the Classification of Lung Nodules," Yang et al.: https://t.co/3u3XiUuTKN "Using LSTM RNNs for detecting anomalous behavior of LHC superconducting magnets," Wielgosz et al.: https://t.co/vz7pXP68CT "Conservative Contextual Linear Bandits," Kazerouni et al.: https://t.co/oKBTuxdRHi "Spatial contrasting for deep unsupervised learning," Hoffer et al.: https://t.co/hC8kLV6B9A "Coherent Dialogue with Attention-based Language Models," Mei et al.: https://t.co/EUtocr9SZv """Determining the Veracity of Rumours on Twitter,"" Giasemidis et al.: https://t.co/tnJDgaRJgy Timely..." "Associative Adversarial Networks," Arici and Celikyilmaz, Microsoft: https://t.co/GXgqxLvtua "Invertible Conditional GANs for image editing," Perarnau et al.: https://t.co/C0zdQg1EtU "Semi-Supervised Learning with Context-Conditional Generative Adversarial Networks," Denton et al. at NYU/FB: https://t.co/0uwbQKkjOD "Pruning Convolutional Neural Networks for Resource Efficient Transfer Learning," Molchanov et al., NVIDIA: https://t.co/X7MLfqKGJD """Psychophysics Driven Evaluation Framework for Visual Recognition: https://t.co/2deQBaELfP ""bring into Q..claims of human-level performance""" """A Hierarchical Approach for Generating Descriptive Image Paragraphs,"" Krause et al. at Stanford: https://t.co/DeIOm48bfc Bonkers. https://t.co/zMpW0HOdxv" RT @deliprao: So, I made this tweet storm about assisted/automatic fact checking. Creating tweetstorms are hard, harder still is to fact-ch… "Dense Captioning with Joint Inference and Visual Context," Yang et al. at Snap (inc. Li who's now at Google): https://t.co/zeB9821v4M "Temporal Generative Adversarial Nets," Saito and Matsumoto at Preferred Networks: https://t.co/zPdZjNZgpn "Local minima in training of deep networks," Swirszcz et al. at DeepMind: https://t.co/2ohlwdlmBB "Image-to-Image Translation with Conditional Adversarial Networks," Isola et al. at Berkeley: https://t.co/fccNl4bk6q https://t.co/08X8KzOXHa @ev_ancasey https://t.co/aCFcurs1lf (technically they said a hybrid approach works well, but point is they see AI as big demand driver in the future + want GPUs to be relevant) "Intel, as well. A3C algo. originally hailed as working well on CPU, now NVIDIA: ""but w/ this change, GPUs better!"" We live in weird times." Was discussing w/ colleagues earlier how weird it is that a hardware company (NVIDIA) publishes deep learning, and now deep RL, papers... RT @mustafasuleymn: Thrilled to announce a 5 year partnership with @RoyalFreeNHS to improve patient safety and really transform care https:… RT @andygawt: Virtually no serious military figure would favour it. Example of Trump not knowing how little he knows. https://t.co/6cXsyYRQ… WTF are you talking about now? Go back to complaining about Hamilton. https://t.co/cULMH8J7MP RT @paulonabike: Next up: the secret ISIS plan.... https://t.co/u0mqEpdQD6 """Robust end-to-end deep audiovisual speech recognition,"" Sanabria et al.: https://t.co/NXtHbEnvsd CC @jackclarkSF Simultaneous w/ LipNet?" """Memory Lens: How Much Memory Does an Agent Use?,"" @chrodan, @katjahofmann, + Nowozin: https://t.co/60FNeuD1Dx DQN in Atari as example..." "GA3C: GPU-based A3C for Deep Reinforcement Learning," Frosio et al. at Urbana-Champaign/NVIDIA: https://t.co/aCFcurs1lf *should have said >>2 brains... So Google now has 2 Brains and >2 brains... RT @hugo_larochelle: Excited to be coming back to Montreal! I owe Montreal so much, and am glad I get this chance to contribute back: https… @jshieber [snarky comments redacted] yes, and I have engaged substantively with past articles... @jshieber seems appropriate, thanks for getting on that quickly! RT @jshieber: @Miles_Brundage I will clarify with an [in our portfolio] to make this more explicit for other readers who could interpret si… @jshieber page won't load RN so can't comment on substance/didn't read carefully, honestly; don't usually expect much from AI think pieces.. @jshieber re: first Q, just portfolio thing; I did not see "we have" as disclosure, took it as a general we, as in "one can use X for Y..." TL;DR: we may not learn that much more (/shouldn't assume we'll learn that much more) about how to control advanced AIs when we get there. Paul Christiano on "prosaic AI control": https://t.co/T2XoJJNhYx @mark_riedl and - https://t.co/dLHEnVugQt From https://t.co/TQTkX4DgYn their AI stuff is often bad/sketchy... and no, conflict isn't disclosed... Lol TechCrunch and their "contributors"... https://t.co/XjXzPHYKwb @chrisalbon @jackclarkSF I hear he used his signing bonus to buy CNN and rename it Convolutional News Network....AI on TV all day. Worth it. "Generative Deep Neural Networks for Dialogue: A Short Review," Serban et al.: https://t.co/s5elj7YzzZ @azeem @fchollet @brianlaungaoaeh there are - Bostrom/Muller 2016, stuff at AI Impacts, some unpublished stuff, Metaculus is working on it.. @hardmaru @jackclarkSF I've heard different things... https://t.co/O1U9RNv00N @KaiLashArul @jackclarkSF @hardmaru these parallel tweets=pretty meta. We'll see in a moment if someone makes THIS point simultaneously too @jackclarkSF @hardmaru not super confident re: those but have heard claimed for each... at least another 1 not yet mentioned but blanking RN @jackclarkSF @hardmaru memory nets/NTMs; backprop (over longer time span, but makes sense given pace then); conv nets for Go value function, Enjoyed @janexwang et al.'s "Learning to reinforcement learn": https://t.co/vMnuQJPMRp Interested to see how far deep meta-RL can go... @sknthla don't think it's the majority opinion among economists, but maybe among public/tech ppl/thinkfluencers (lol) @Smerity same :) @susie_c white space Also, this (from 1998)...hmm. https://t.co/7a7RsCIEhN (of course, DOD as a whole > Anki tech-wise, I just mean they want all the Ankis... balance of power is very unlike what that movie depicts) Remember Small Soldiers? It's about military AI accidentally getting in toys. Nowadays, militaries probably wish they had e.g. Anki's team. "PolyNet: A Pursuit of Structural Diversity in Very Deep Networks," Zhang and Li et al.: https://t.co/T8TjdREFtE "Fast Non-Parametric Tests of Relative Dependency and Similarity," Bounliphone and Belilovsky et al.: https://t.co/CHNUWyXFEP "Deep Feature Interpolation for Image Content Changes," Upchurch and Gardner et al.: https://t.co/0pWLH5H21B https://t.co/P6pDUjCJ8B @jackclarkSF @ivan_bezdomny https://t.co/5vsApyRWR4 RT @daveweigel: Wow, people were booed because of what they do for a living? That sounds rough. https://t.co/qAVdcc9VjP "Dick Cheney. Darth Vader. Satan. That's power." - Steve Bannon sounds like a really nice guy... https://t.co/v2pHJoPWUB RT @ghaney22: Yes #MikePence was at @HamiltonMusical here's what we had to say https://t.co/YIjt7JZ3gF RT @meakoopa: PHOTO: Trump and Pence share a moment of levity while discussing registering Muslim citizens (NY Times, 2016). https://t.co/q… @deliprao as I've said before, we didn't deserve Obama's awesomeness... @triggerasaurus no, not saying that. Just singling Thiel out b/c have seen some folks suggesting he wasn't *actually* pro-Trump(ism) RT @VanJones68: CHECK THIS: @nytimes profile of me, @VanJones68 https://t.co/WbBgHmahJn *P.S. the story is from the Daily Mail, so take it with a grain of salt... (specifically, all the stuff about loyalty + him doing stuff other than tech... seems to be true believer, not just in it b/c e.g. AI stuff) For the Thiel apologists out there: https://t.co/IntmEenbIQ RT @juliagalef: TFW people scoffed at you for worrying Trump might win, then he does: "Screwdenfreude." Like schadenfreude, but you're scre… @mikarv I didn't know blond was even a word/had a gender element... hmm "Explicable Robot Planning as Minimizing Distance from Expected Behavior," Kulkarni et al.: https://t.co/YwRcusCMRy "DelugeNets: Deep Networks with Massive and Flexible Cross-layer Information Inflows," Kuen et al.: https://t.co/mpmMO2oVoN "Inverting The Generator Of A Generative Adversarial Network," @ToniCreswell and Bharath: https://t.co/nIsck0G5OY "What Do Recurrent Neural Network Grammars Learn About Syntax?," Kuncoro et al.: https://t.co/F637IfRv0C @janexwang congrats! :) very cool stuff. RT @janexwang: Excited to have my first DeepMind paper! Click to learn about learning to reinforcement learn https://t.co/4qqdEnqHPv "Learning to reinforcement learn," @janexwang et al. at DeepMind: https://t.co/vMnuQJPMRp RT @DeepMindAI: New blog: Reinforcement learning with unsupervised auxiliary tasks https://t.co/xSaGnftZf5 #UNREAL https://t.co/V3LCD1eEtf "Fully-adaptive Feature Sharing in Multi-Task Nets with Applications in Person Attribute Classification," Lu et al.: https://t.co/n3fNm9gCKn "Aggregated Residual Transformations for Deep Neural Networks," Xie et al.: https://t.co/VcAyrTNZUj So, my Atari forecast might turn out to be pessimistic. Currently in right ballpark (2 recent papers at low/high end), but few weeks left :) Segmentation of Atari frames, could enable learning a bunch of games at once w/ one stream of experience https://t.co/BF27HRSURk "The Forget-me-not Process," Milan and Veness et al. at DeepMind/Alberta: https://t.co/rcAjFU2VJL RT @NipsConference: NIPS 2016 pre-proceedings https://t.co/zUkiNZSn7h @DavidCShipley @fchollet @hbdchick yeah, and that data is better (all AI researchers) but still pretty varied. more recent surveys similar 2 @DavidCShipley @fchollet @hbdchick yes, the data ends in 2012. @junkiepunch no problem... and nope. That feeling when you're excited to hear Mitt Romney is in the running for Secretary of State, given the alternatives... @mark_riedl yesssss @fchollet note the data there is actually expert judgment v. not using expert judgment, diff. from expert/non-expert https://t.co/qCNwo7FgQB RT @rbhar90: @Miles_Brundage The search space is much deeper for Starcraft, but inventing "action-chunking" module could lead to soln in fe… RT @rbhar90: @Miles_Brundage Someone asked me about Starcraft AI predictions last night. My gut said 5-10 years, but I've been over pessimi… Also, Montezuma's Revenge is at about 69% of human (expert) performance... Should also note that UNREAL is very impressively robust across hyperparameters (see Figure 3, lower right): https://t.co/52niUB7bjf @mark_riedl but doesn't deal w/ issues you raise... @mark_riedl it doesn't seem especially well thought out... think in the original movies, there were different guns. Revised version of paper on UNREAL (RL w/ Unsup. Auxiliary Tasks) reaches upper end of forecast (250%). CC @NandoDF https://t.co/2qQQ2ZEWlE If you think modern sci-fi is too nuanced and plausible, Incorporated has you covered... OK, I'll stop ragging on it now, but yeah it's bad. @_jyan_ nope/not at the moment b/c it's complicated :) [largely bc of definitional issues, not just uncertainty...] RT @etzioni: Semantic Scholar is now searchable from arXiv. See for example: https://t.co/Simb2ix8HP and https://t.co/Hrg9tU7yRb RT @PatrickOmid: Was just talking about this today w my reading group- seems like 3+ years. Need a lot of breakthroughs.. but curriculum le… @danieldewey this from Stanescu et al. from academics https://t.co/6soM7urx3n, + recent FB papers, and some offline convos w/ various folks @danieldewey when I wrote first version, DeepMind/Starcraft thing was just a vague hint; now large-scale collab. w/ Blizzard... @sknthla don't think driving will matter much post-apocalypse. Gas won't last that long, + can get a skeleton soldier to drive you... TL;DR, yes, you can do good lip reading outside the dataset in the recent paper that got attn, and it can work synergistically with audio. See also this post on the data in section 4: https://t.co/qCNwo7FgQB Good read from a little while back - Armstrong et al., "The errors, insights and lessons of famous AI predictions" https://t.co/dOXz8atufj Got AI predictions on the brain as I'm leading a reading group mtg related to it tomorrow :) ..and 1 should expect given the lit on tech forecasting that empirically-driven ones like that would be better than gut ones like StarCraft. At some point, I'd like to do careful review of my own past AI predictions - prob. lots of bad ones but most informed ones (Atari) going OK. (a big range, but some seem to think it'll be much longer than that) Update on this: DeepMind effort = big, + not done yet but maybe harder than I think, so 80% btwn 2 months + 5 years. https://t.co/a38eyAdqgE "Lip Reading Sentences in the Wild," Chung et al., Oxford/DeepMind: https://t.co/JfhRs7lRN0 "Incorporated is almost as bad as this article on AI: https://t.co/NWFYzSFSm7 (among other issues, the content has little to do with title)" RT @BenLaurie: I am hiring for Security and Transparency at DeepMind! https://t.co/TG5i8OrXz9 #TransparentAllTheThings. @filar don't say I didn't warn you ;) I like The Expanse, though haven't read the books. Overall quality much higher than Inc, I think. Alternatively, Incorporated = a Black Mirror episode, but worse, and much longer. @filar and yeah, the things you mentioned, among other issues. @filar first ep was just released for free online.... I'd be interested to hear your take, maybe I'm in a bad mood, but I think it's awful. @filar same here re: O+C, I wouldn't be so sure re: settling for Affleck, though. This isn't great so far, to say the least. This is painful, help. ...and he/she did no research in order to make things plausible. Ep 1 of Incorporated = if Ben Affleck instead of Margaret Atwood wrote Oryx + Crake and it were a show instead of a book. Not in a good way. @davegershgorn omg RT @mpshanahan: We have postdoc position at Imperial to work on the future of #AI as part of @LeverhulmeCFI - https://t.co/Lemi7qBKAk RT @jackiefloyd: BTW, my current project is ending soon. Open to new opportunities in geoscience, machine learning, & making the world a be… RT @thekibosch: Laid-off @fusion writers (and others): I'm always accepting pitches for essays on technology, policy, and society. torie.bo… RT @joshtpm: Glad Facebook got around to cutting off supply of fake news and Twitter stopped producing alt right hate bots before anything… First Workshop on Ethics in Natural Language Processing, at EACL 2017 in Valencia - submissions due Jan. 16: https://t.co/EG5rANBQ0L RT @abuaardvark: "I told conservatives to work for Trump. One talk with his team changed my mind." @EliotACohen watches with horror https:/… RT @hardmaru: @Miles_Brundage Their experiments in Table 3 and 4 (func approx w/ expressions) remind me of an old experiment I did https://… @davegershgorn at first glance, seems like less NN-focused/more features, but not v. familiar with either... Implicit ReasoNet: Modeling Large-Scale Structured Relationships with Shared Memory," Shen and Huang et al.: https://t.co/kRzeZndPgQ "AdversariaLib: An Open-source Library for the Security Eval. of Machine Learning Algos. Under Attack," Corona et al https://t.co/VCCwUbtsbl "Differentiable Genetic Programming," Izzo et al.: https://t.co/lkW6puWOdQ "PixelVAE: A Latent Variable Model for Natural Images," Gulrajani et al.: https://t.co/SQWWDfBAIU RT @OpenAI: OpenAI and Microsoft: https://t.co/yVTvLBIkoZ (don't think she worked there per se but was involved via SAIL's Toyota partnership...?) Huh... loss for Toyota (Li), I guess? https://t.co/K2SoL4qYBT "Leveraging Video Descriptions to Learn Video Question Answering," Zeng et al.: https://t.co/RhF8bHSJYY "How to scale distributed deep learning?," Jin et al.: https://t.co/4WFZDnQQB1 "Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation," Johnson et al.: https://t.co/9qigsRRit8 Quadrotor flying policy learned entirely in simulation with deep reinforcement learning. """(CAD)^2 RL: Real Single-Image Flight without a Single Real Image,"" Sadeghi and Levine: https://t.co/3x8SRJTEWs https://t.co/7M6bXpFZ0K" RT @JGreenblattADL: We at @ADL_National oppose the appt of Steve Bannon to sr role at @WhiteHouse bc he & his alt-right are so hostile to c… RT @dennybritz: Why is machine learning 'hard'? TLDR; because debugging: https://t.co/u0B1SRZKMy Remember when House of Cards was fun to watch but not really relevant to actual DC? That was nice. Bannon = an alt-right Stamper. Ambitious new DOE vision - just in time for Trump to ruin it. https://t.co/6ii07kWZoB RT @shaylekann: DOE sets new SunShot target of $0.03/kWh for utility solar in 2030. Right on track @vsiv https://t.co/wwHCrU6B95 https://t.… RT @googleresearch: Enhance! Producing high-quality versions of low-res images with RAISR: Rapid and Accurate Image Super-Resolution - http… RT @ORachaelO: Basically your Twitter block list is now running America. Looks like a must-read for those interested in such things. Very comprehensive. https://t.co/K4oyFKrLPD "Towards the Science of Security and Privacy in Machine Learning," @NicolasPapernot et al.: https://t.co/MqGgRKx9jE """Hierarchical Object Detection with Deep Reinforcement Learning,"" Bellver et al.: https://t.co/suqLnZCseB Code: https://t.co/xkKCixtIJa" "A Connection between GANs, Inverse RL, and Energy-Based Models," Finn and Christiano et al. at Berkeley: https://t.co/sWfyaghWqX "Learning to Learn for Global Optimization of Black Box Functions," Chen et al. at DeepMind: https://t.co/SCsh5SFma9 RT @willwilkinson: Policy (BORING!) outsourced to Priebus + Pence. The Trump stuff, fomenting divisive mass movement and intimidating oppos… RT @iamjoonlee: Paul Ryan said he had “no concerns” about Stephen Bannon potentially becoming Chief of Staff. Bannon ran a website with the… Lithgow-Churchill on Trump [well, on a photographer, actually]... https://t.co/6J6195z9WC @jackclarkSF of OpenAI and @timhwang of Google on "How to Build a Responsible AI Future," moderated by @shivon: https://t.co/ajmrL9G8Hu "Modern democracies, including America’s, are far more vulnerable to hostile takeover than you might think." https://t.co/SlRI3j3R7r @AnaPopescu_SV @yoavgo esp. when they are strikingly clear: https://t.co/OmzgoHHIxE RT @AP: After Trump’s election, many American Muslims feel fear within their own country. https://t.co/CkuuAGTeOR https://t.co/LEo85ECA1J @byrdinator aw, (t)he(y) fixed it. Dunno what's scarier - him knowing/not saying anything, or his staff not knowing or telling him. Both conceivable. https://t.co/YGskRjn7TK @DennisMortensen or maybe both are lifetime...? anyway, yes, i came to similar conclusion re: skydiving risks :) @DennisMortensen that seems like an extremely high risk rate for one car ride, or are u comparing one shot to lifetime risk/apples+oranges? RT @maosbot: "Bayesian Optimization for Probabilistic Programs", our #NIPS2016 paper, in a 3 min video https://t.co/u7KGyoscgP Great stuff… @mattsiegel @fchollet @mat_kelcey see also - https://t.co/apgarV2nbz @josipK @fchollet @sarahjeong thx, just fixed :) @fchollet got it, thx. @fchollet @sarahjeong thanks - fixed. RT @FourScore64: Accurate representation of America right now https://t.co/PNhFiVXe0L RT @fchollet: @Miles_Brundage @sarahjeong after I put the article on FB, their "people also shared" algorithm suggested this: https://t.co/… @fchollet @sarahjeong missed one Hitler-specific thing (just fixed), let me know if I missed anything else... By request - review of a book on Hitler, with some Trump-themed edits (listed at the end). https://t.co/OmzgoHq7G6 CC @fchollet @sarahjeong @mat_kelcey yeah, I almost went through to replace Hitler with Trump, chancellor w/ President, etc. to illustrate, but it speaks for itself. https://t.co/CfTfWElg2p RT @VanJones68: VIDEO: @VanJones68 meets with -- #Trump voters?! https://t.co/e3rleyzJDc posts entire 3-part series: #MessyTruth. https://t… RT @Rschooley: Relax, it's a perfectly normal thing for a leader to give governmental power to his adult sons. https://t.co/nhHBoQmD0p @sknthla on the other hand... https://t.co/6goWz1FKE5 RT @KamalaHarris: CA has the largest number of immigrants, both documented and undocumented, in the US — and I will fight for them. We are… RT @collision: It's like The Avengers for populist autocrats. https://t.co/vTBuLnQYiU RT @poolio: Random synaptic feedback weights support error backpropagation for deep learning, from Lillicrap et al. @NatureComms https://t.… "Smart, Qualified People Behind The Scenes Keeping America Safe: 'We Don't Exist'"(from 2010) https://t.co/5FXkDxyDC2 via @theonion "RT @deanfortythree: Biden: Ok here's the plan: have you seen Home Alone Obama: Joe, no Biden: Just one booby trap Obama: Joe https://t.co/I…" RT @KSoltisAnderson: Before we get too ahead of ourselves declaring Democratic Party dead and GOP having fixed all it's problems, keep this… RT @NandoDF: Toshiba: deep learning with extremely low power neuromorphic processor https://t.co/F5nuSyWDSu | Has anyone scrutinised this w… @chris_brockett he would say that was a good business deal, he created lots of jobs with the money, etc. and many would be OK with it. """latest in cognitive"" https://t.co/FV1YVfMt3j" Summary of "Efficient Summarization with Read-Again and Copy Mechanism" by Zeng et al. https://t.co/Iabu2KkFQG OK, back to the apocalypse... "Tuning Recurrent Neural Networks with Reinforcement Learning," Jaques et al.: https://t.co/grrF74YkjW "Delving into Transferable Adversarial Examples and Black-box Attacks," Liu et al.: https://t.co/FNzxXkDJMg "Generative Shape Models: Joint Text Recognition and Segmentation with Very Little Training Data," Lou et al.: https://t.co/fMy16pcyHK "A backward pass through a CNN using a generative model of its activations," Wang et al.: https://t.co/zeVoY2nJl9 "Dependency Sensitive Convolutional Neural Networks for Modeling Sentences and Documents," Zhang et al.: https://t.co/SvMMiDQ8jl "A Convolutional Encoder Model for Neural Machine Translation," Gehring et al.: https://t.co/vs2CoNEYR0 "Gradients of Counterfactuals," Sundararajan et al.: https://t.co/H7az1oi6oB "Learning from Untrusted Data," Charikar et al.: https://t.co/uf37usYip2 "Unsupervised Pretraining for Sequence to Sequence Learning," Ramachandran et al.: https://t.co/NNhXC39Aq6 "Sentence Ordering using Recurrent Neural Networks," Logeswaran et al.: https://t.co/e7tPV5gpCb "Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoders," Dilokthanakul et al.: https://t.co/SE1SsdebC3 "Neural Taylor Approximations: Convergence and Exploration in Rectifier Networks," Balduzzi et al.: https://t.co/vxyx00c2yR "Learning Dynamic Programming with Split-Merge Networks," Nowak and Bruna: https://t.co/xIaWzhpSJ9 "Disentangling factors of variation in deep representations using adversarial training," Mathieu et al.: https://t.co/OAfsp05qCT "A Modular Theory of Feature Learning," McNamara et al.: https://t.co/OD0JbGfCeN "Learning to Play 'Guess Who?' and Inventing a Grounded Language as a Consequence," Jorge et al.: https://t.co/64bdGTQdOs "Efficient Summarization with Read-Again and Copy Mechanism," Zeng et al.: https://t.co/CumLYJy97Y Some backlogged papers since pre-election coming shortly... RT @deliprao: #nlproc folks, are there grammar error correction datasets for mistakes made by native speakers of English, as opposed to Eng… @2020science looks custom made, but I'm not an aficionado... This Rubik's cube robot would be a better pick for cabinet positions than who Trump is considering (also, 637 ms!): https://t.co/wDCkDYcIbr RT @takiinoue: https://t.co/b669YO041I RT @kchonyc: The title of the year: <Variational Recurrent Adversarial Deep Domain Adaptation> by Purushotham et al. https://t.co/rhnK750NpC RT @rcalo: I'm serious about this. It's time to go #BattlestarGalactica on user privacy. @GregStaskowski see the next tweet after that, though. CC @rcalo Might also be the case that *not* engaging is more impt now in some cases e.g. surveillance. Different for diff issues/skills? Very unclear. Will B harder for Trump to get expert AI help but also potentially more impt. Optimization then, damage control now. https://t.co/yUQ0wfAuK0 RT @fernandaNYT: 4. I'm quick to say Arizona has been great to me and my family. As an immigrant and NYT reporter, I've never felt unwelcom… RT @fernandaNYT: 3. I told him I speak four languages and he told me to fuck off. He was a white older man, maybe old enough to be my fathe… "RT @dorseyshaw: DEMOCRATS: Give us one really good reason why you should be the next DNC Chair. KEITH ELLISON: https://t.co/Faf9fyDEF8" RT @jonfavs: Never thought I'd be on Team Reince, but here I am. https://t.co/u01cRZJe8X Leak of Trump rehearsing his first State of the Union: https://t.co/leCT8ftXdQ RT @PatrickMeier: Anyone care to help me document & map harassment against minorities in US and evidence of help given to minorities? https… "RT @beaucronin: 4. Be outraged 5. Don’t make compromises 6. Remember the future Eyes wide open now. https://t.co/VfUhQ5iDGK" "RT @beaucronin: Autocracy: Rules for Survival 1. Believe the autocrat 2. Do not be taken in by small signs of normality 3. Institutions wil…" Mayyybe some other video/audio would have had more of an effect - say, the n-word tapes we've heard about but not heard - but not just text. This is bad but I find it hard to imagine that any set of facts about Trump would have changed the outcome. https://t.co/OgTHUX9kve Journalists in the age of Trump should strive to ask as hard hitting questions as Red Shirt Guy. https://t.co/xod4uiCOvz RT @girlziplocked: I'm with @BernieSanders. The next DNC Chair should be @keithellison. Add your name if you agree: https://t.co/qRVSNA6Gj9 So, about that whole Trump hopefully becoming reasonable post-election thing... https://t.co/gPucdfteJL RT @eveewing: A 6-year-old at the school where I volunteer drew this today. "I hate Donald Trump because he is going to put my mom in Mexic… RT @zeynep: What a denial of responsibility. If this were true, and Facebook had no influence, it would not be a $400b company. https://t.c… RT @somebadideas: The single most galvanizing thing I've read about what's to come, and how to prepare for it. https://t.co/JB9cvtaHT8 RT @levie: Obama: "Ok so then when a bill is passed by the House of Representatives it goes to the Senate..." https://t.co/PJHrCyhq6g RT @davidfrum: If the story ends without too much harm to the Republic, it won't be because the danger was imagined, but because citizens r… RT @rbhar90: New preprint of mine with @vijaypande on applying one-shot deep learning to drug discovery https://t.co/CPTleRCuLx @benshapiro on Steve Bannon, from personal experience: "vindictive, nasty figure ... smarter version of Trump": https://t.co/ED8vA99uJf RT @sarahkendzior: If you are thinking about 2020, or even 2018, you are doing it wrong. This is not normal. Checks and balances will be go… RT @marcslove: I don't need you to be uplifting, @jack, I need you to build some fucking anti-hate-mob features. https://t.co/0ybi740wuR @girlziplocked will check out, thanks! @qhardy @erikbryn https://t.co/G42oizcTQi @rcalo super unpredictable=bottom line RN, I think. anything from yuge investment if he decides on a whim it's important to automation tax.. @davegershgorn think the odds are extremely low that Trump wrote those AI comments himself/has any views on the topic FWIW. V. unpredictable RT @mat_kelcey: malmomo; deep RL continuous control of minecraft from raw pixels https://t.co/ljqbR7KpA9 https://t.co/E9kYQRogf0 "RT @ChuckLane1: Ya know what's going to be funny? All the think tank panels btw now and Jan 20 on ""What Prez Trump should do about X."" As i…" RT @anneapplebaum: I guess all of this means that there will be no investigation into Russian manipulation of the US election. "RT @prchovanec: TPP is dead. China will move to fill the void. Own goal, and the game hasn't even started. https://t.co/EKVEEYdSOO" RT @realDonaldTrump: All I can say is that if I were President, Snowden would have already been returned to the U.S. (by their fastest jet)… @sknthla know the feels, I just finally emerged... RT @dustinvtran: Variational Lossy Autoencoder by Xi Chen and others at OpenAI. interesting interpretation from information theory https://… Interesting, but presumably a lot of correlation btwn routine % + edu., race, etc. and other predictive factors (?). https://t.co/NqnyiM0TYU @MattHourihan yep, no prob - dunno whether it's available alone, but the collection it's part of (Stories of Your Life and Others) is great. @MattHourihan the short story it's based on is really good. Recommend checking out before, it's not *that* long. I'm sure there will be some "What Trump means for AI" hot takes soon but no one really knows yet, least of all him... (I wouldn't call it "snaps" so much as "finishes making an important point to clueless people") @VanJones68 is the best: https://t.co/TpTZ9MGv6F RT @Mads_Be_Me: i will be thinking of this image for the rest of my life. https://t.co/Q8VouT9YNE Up to 3,482 overall, but down a bit in those sub-categories, so lots of people are buying books on political theory, history, democracy... "RT @Jus1Nyt: Obama: Trump is our next President. Biden: https://t.co/TgTLH8X1Ul" RT @Palestixian: Guys, a trump supporter tried pulling off my hijab... This is not a joke anymore, all non-whites have become targets. Stay… RT @nerdsrocket: I seriously just saw a white woman ask a group of latino kids what they were doing outside the community center and ask to… RT @ch402: Summaries of what some Trump supporters I called said. https://t.co/Zj2yAIf0m6 "RT @absurdistwords: Im talking to you now surprised white people. I wanna bring you in for an empathy moment." This is a really good speech. RT @SiyandaWrites: When we talk about online radicalization we always talk about Muslims. But the radicalization of white men online is at… RT @WillOremus: Umm @jyarow? That line where "Thiel nailed the Trump phenomenon"... He plagiarized it. https://t.co/qoIbRME8lH https://t.co… @davegershgorn marketingsplaining @AuerbachKeller as well as this little number. https://t.co/2B25Bmz3qh (the article is more nuanced than that headline; worth a read) "China Just Won the U.S. Election": https://t.co/935RGAfmey RT @realDonaldTrump: The electoral college is a disaster for a democracy. @justinhendrix that's the right question. Think I'm on the way to being half right... here are the rankings a few hours before and after the election results. https://t.co/tSqQy6bEqR https://t.co/wM4eIIOoCk @cpburgess_ yup. @trevolafoam /*anyone (if you're also American) :) @trevolafoam if we could tell you, we would have stopped it... @jathansadowski I stayed up. It wasn't fun. RT @sarahjeong: Someone better be injecting Ruth Bader Ginsburg with young people's blood Looks like a shot from a more dystopian version of Blade Runner. https://t.co/P1tsA9D4uK @AnaPopescu_SV if only. RT @levie: Strange that the best case scenario at this point is that Trump has been lying about his views and plans the entire time. Will tweet some AI papers at some point after rethinking everything about myself and the world, and being embarrassed for my country, brb.. RT @paix120: Stop talking about leaving America. We need all hands on deck. @davegershgorn correct RT @hugs: Or the robots we're building. https://t.co/0mTeUgqGd2 RT @Pinboard: Techies in the US, we have two months now to think about what kind of data we’re collecting and storing on people, and do the… RT @VanJones68: Welcome to the #WhiteLash. RT @TerynNorris: Oops https://t.co/wTjZ8f0GLC RT @KevinBankston: God bless @VanJones68 for continually using his perch at CNN to fearlessly speak truth. Thanks, man. "RT @jonrog1: Hey, no joke, and I'm paraphrasing smarter people. If you plan on opposing Trump: Get Tor. Get Signal. Get a VPM 2FA on your…" @awmannes (perhaps among others, he may have been echoing someone) @awmannes it was Peter Thiel. "RT @dstfelix: can't believe i have to post this but National Suicide Hotline: 1-800-273-8255 Trevor Project 866-488-7386" Everyone listen to @VanJones68 right now: https://t.co/qdLpnMHf0n @davegershgorn yup. People should have listened to him a long time ago. RT @phalguy: Don't forget before you go to bed tonight to turn your clocks back 60 years. RT @rogue_fireball: Let us be crystal fucking clear who is responsible. https://t.co/aaj3nkvdKO RT @samsteinhp: FWIW. we have probably lost the battle against climate change tonight RT @gideonmann: Why we can never give up. https://t.co/MqiRoMCWv3 @hannahgais no, there's at least one other: Joe Arpaio lost. RT @Sammy_Roth: Sorry, but has to be said: If the results hold, we've basically locked in climate change way above 2 degrees Celsius. RT @MaxBoot: I have never feared more for the future of America. RT @LiYuan6: Time to brace for a world ruled by Trump, Putin and Xi Jinping? RT @roybahat: I have been to happier shivas. RT @baratunde: Whatever happens, we have lost. Half this nation voted for white supremacy, sexual assault, and more. The Klan is happy. We… Now she has plummeted to below where she was yesterday. @beaucronin I'm less impressed w/ his political knowledge than by the fact that his use of the screen goes so smoothly. Good design/practice @YadFaeq nope, probably not selective enough for my taste.. "BREAKING: cool new AI papers on arXiv. Well, that happens 5 times a week, but more interesting than ""these states are too close to call.""" @AnaPopescu_SV lol. so ridiculous, but I can't look away. RT @ErrataRob: As you can tell by inspecting what's going on, the updates come at around 15 second intervals, so any faster movement is fak… @SparseJacobian tell me about it, it's past 1 am here and things are just getting started ;) Roughly, they've gone from ~80 to 90%+. (don't think they deserve that much credit for that, as it's pretty clearly going well for Clinton, but just saying, as some folks care :) ) Clinton just surged in prediction markets. Tons of states just announced, but key big ones still very close. https://t.co/YZzwJRuFZ3 @Jackstilgoe CNN's fine, you can watch it here: https://t.co/qdLpnMHf0n @jeffbigham that would be pretty cool but I'm not aware of it... :) "@jeffbigham I'm watching CNN here: https://t.co/qdLpnMHf0n And it's... CNN. not much to report for another half hour." @chrisalbon unless you wanna listen to Wolf Blitzer et al. say "well there's only 1% in in Indiana...so, early...but, results!...but, early" @chrisalbon if you're going to at all, maybe wait a half hour (GA/VA results) @AnaPopescu_SV yeah, seems unlikely he would have voted before. Conversational systems are still hard so wouldn't be perfect but many of the pieces to do it somewhat okay are available. Wonder if there's automated phone banking going on....not generic robocalls but using people's names, telling actual voting location, etc. @dennybritz "BLEU increase from 31.17 -> 31.17" = typo I assume? RT @dennybritz: My notes on “Neural Machine Translation with Reconstruction” https://t.co/FF0heh87Ob RT @ninakennychase: Hey @IvankaTrump! thx 4 the epically blue last min @tjmaxx bargain! 😂 I just put it to good use! #PantsuitNation #ImWit… RT @AmandaMarcotte: This picture is everything. https://t.co/m9Blodj90f RT @NandoDF: It's unbelievable how many great papers have been submitted to #ICLR2017 | Some might call it hype, I call it accelerating pro… RT @profwernimont: reports of two local polling places with half of their computers down in Tempe AZ at 6:45 a.m. #Election2016 #Maricopa RT @TerrysWineLodge: You can always rely on the Great British public to put things back into perspective #TopStory #toblerone #Election2016… RT @Scout_Finch: I will remember you. Will you remember me? In memoriam ... the best of the worst Trump pundits https://t.co/J04tJ28yfG "Lifelong Perceptual Programming By Example," Gaunt et al.: https://t.co/ngH6uSNsA7 "Spatiotemporal Residual Networks for Video Action Recognition," Feichtenhofer et al.: https://t.co/IKxKbMzAH6 "Crowdsourcing in Computer Vision," Kovashka et al.: https://t.co/a98vcy3LHN design decisions/strategies for effective vision crowdsourcing. "DeepCoder: Learning to Write Programs," Balog et al.: https://t.co/2zWMhcS9WJ "Neural Machine Translation with Reconstruction," Tu et al. at Huawei/Tsinghua: https://t.co/NLLny8BVI6 "AC-BLSTM: Asymmetric Convolutional Bidirectional LSTM Networks for Text Classification," Liang and Zhang: https://t.co/U67jdl9Tjb "Neural Functional Programming," Feser et al.: https://t.co/PvVwPaNxGa "Entropy-SGD: Biasing Gradient Descent Into Wide Valleys," Chaudhari et al.: https://t.co/aku7q0fKXu "Deep Biaffine Attention for Neural Dependency Parsing," Dozat and Manning: https://t.co/9ankovnM9j "Learning to Play in a Day: Faster Deep Reinforcement Learning by Optimality Tightening," He et al.: https://t.co/yR7YHUeoZ0 "Dynamic Coattention Networks For Question Answering," Xiong, Zhong, and Socher, Salesforce: https://t.co/ZVmPYLwv8A Paper is "Bidirectional Attention Flow for Machine Comprehension," Seo et al. at AI2. Hopefully a good omen re: glass ceilings tomorrow... Now Seo et al. show 76.9-78.1/79.4-79.7 (depends if you count ensemble) on CNN/Daily Mail: https://t.co/FWsrb5u4da https://t.co/X35aooD0WR "Q-Prop: Sample-Efficient Policy Gradient with An Off-Policy Critic," Gu et al.: https://t.co/T30ryDjcYE RT @zacharylipton: First post on Approximately Correct: The Foundations of Algorithmic Bias https://t.co/Bw63PDhvye RT @HMRoff: See my newest blog! Analogies in War: Marine Mammal Systems and Autonomous Weapons https://t.co/MF9O7vrDbE RT @seankeeley: The creation of Woke Glenn Beck is one of the stranger by-products of this election https://t.co/a6CqS1aEuQ @haikuman turns out I'm using Jupyter, but hadn't heard of nteract.io, thanks :) (or, I guess I should say Jupyter?) IPython's pretty cool. RT @zacharylipton: Announcing the launch of new blog https://t.co/n61y0kkDd4. We hope to bridge technical and social perspectives on ML (co… RT @NandoDF: Dear USA friends, it can get much much worse! Trust me, I lived through Apartheid and wars in Africa. Vote wisely and lead by… RT @dennybritz: Finally got around to adding an A3C implementation to my repo of RL algorithms: https://t.co/7LFA0C7ouZ @YadFaeq hmm - thanks! @Aelkus yeah, def. possible, just not very soon (unless someone puts a ton of time into it) as there isn't community working on it like SC @Aelkus sure, but I'd still be super impressed by a bot that could play Halo well, esp. on non-slayer gametypes. @Aelkus I don't have much experience with them, tho. Played a UT2004 bot once and seemed good but something like Halo I could eval. better. I justify lots of things as research, but playing Starcraft in order to (not) be impressed by AI doesn't seem like a good idea even to me... I hope to one day see AI play a game that I've played a lot and could be more viscerally impressed by :) Halo doesn't seem likely soon... Has anyone read Wolfram's "Computational Law, Symbolic Discourse, and the AI Constitution" and have thoughts on if it's worth the time? :) RT @demishassabis: #AlphaGo update: we've been hard at work improving AG, delighted to announce that more games will be played in early 201… @AnthroPunk didn't suggest insignificant, just said dunno if *most* significant distinction. Still lots of limitations... @AnthroPunk good distinction for sure, but dunno if it's most significant one re: job stuff. Lots of places to draw the line... Not actually predicting that, just saying, what counts socially as cognitive has changed over time/will prob. continue to do so. 2020's - sure, AI took jobs w/ supervised learning, but now they do unsupervised learning... 2030's - sure, they do transfer learning, but.. (See: Inventing Ourselves Out of Jobs? America's Debate over Technological Unemployment, 1929–1981) I'm sympathetic but interesting that ppl said *that* then, too. In 30's ppl said that re: automated switchboards. https://t.co/gUvVUY008i RT @nsaphra: @Miles_Brundage Citation on interpreting articulations of the full vocal tract: https://t.co/6Vh5Ufj8rF Why restrict interface… @nsaphra hmm.. RT @evolvingstuff: @Miles_Brundage I've had same thought. Add in really good eye tracking and one could be hands-free for many kinds of apps @catherinebuk @IgorCarron @NandoDF would be interesting to know what accuracy is achievable w/ smartphone-grade cams/mikes in real enviros.. RT @ShaneLegg: Interesting, I hadn't thought of that application... :-) https://t.co/NVkuAQdYVf Another app mentioned in paper: improved hearing aids. Current hearing aids are horrible. Obviously there are surveillance implications, too, but those have already been mentioned by others (and explored in sci-fi)... (it's briefly referenced in LipNet paper but curious if ever actually deployed/tested - presumably not b/c performance was too low before?) Maybe weird to mouth to one's phone today but also practical sometimes? Subvocal recog. explored by military, but req's additional hardware. Thinking of Her-like whispering/mouthing to devices, enabling wider use of non-typing input. Upper bound for lip+voice accuracy > either. Automated lip reading has many possible uses. One I wonder if has been explored: replacement of or supplement to speech rec for text input.. @rivatez small, nerdy world :) @AnaPopescu_SV lol omg. From: https://t.co/iZur1zJwAv Well, I guess Shao et al. (Kurzweil's group, I think) get points for honesty with presenting these neural conversation model results. https://t.co/VXvfm4055J @NandoDF ...I just happened to have only made an explicit forecast of the median, so wasn't sure how UNREAL fit in. @NandoDF I was referring to 3rd sentence in the section 4.2 Atari re training not being finished yet for all games. And yep, many metrics :) RT @BrendanShilling: Try beating our LipNet model! How easy do you think lipreading is? (w/ @iassael, @NandoDF, Shimon Whiteson) https://t.… RT @Smerity: @Miles_Brundage SotA on bAbI _and_ CBT! We'd discussed some similar ideas internally but not yet tested - glad to see it work… Video: https://t.co/WyohA4sUrQ Same figure was a lot lower a year ago and not even worth calculating several years ago. To emphasize... we're pushing 200% median score vs. (professional) humans across 57 Atari games, learning from raw pixels, and 900% mean. Haven't calculated prog. in score/compute efficiency in a while but guessing new papers are roughly in line w/ expo. trend I found before. For mean scores, Hyper-Q just showed 877.23%, which is roughly in line w exponential trend here (median = ~ linear). https://t.co/Vv1WPHxCl4 ACER crossed lower threshold of forecast. Other new DeepMind algo (UNREAL) might be contender too but evaluation unfinished at submit time. @jackclarkSF @Aelkus Greatient Ascent? @jackclarkSF was just at meeting on CRISPR (and other bio stuff) yesterday - updated my estimated impact up, but still nowhere near AI... @dmarthal I don't think Joust is usually evaluated. @jackclarkSF it's my lot in life. Burdening people with good shows and good papers. @hardmaru the others are prob. skippable/mostly redundant to themes of earlier seasons. Expanse is an actual show, so hard to compare. @hardmaru better but also less bite-size. Need to be in it for longish haul. IMO, S03 ep 4>6>5>others (though 2 mentions neural nets ;) )... See Figure 1 here. I haven't been making continuous control forecasts but that seems to be coming along, too. https://t.co/RZq2hKSe2i Looks like this just happened w/ DeepMind's ACER (specifically, the 1 on-policy + 1 replay + TR updating version). https://t.co/NufQ1dhkHr RT @ankurhandos: deep learning tsunami https://t.co/yZKY2kgEzh RT @gosainnn: @Miles_Brundage Had a talk about this EMNLP. What's will be the major theme next year? Conclusion was RL.. The Expanse is on Netflix now. It's good. "reward functions for complex robotic manipulation skills can be learned directly from a video of a human performing the task." "on 2D Euclidean graphs w up to 100 nodes...our method outperforms Christofides (1976) ..+ competitive w 1 of best open-source TSP solvers." RT @fchollet: Deep learning is getting out of control. Out of ~500 ICLR submissions, there over 100 that I should probably read. Definitely… @GarrulousGeoff yeah, each link in the chain is prob. <80% true, so the total truthiness is very low :) @staehere reinforcement learning. "Hyper-Q: Combining policy gradient and Q-learning," O'Donoghue et al., DeepMind: https://t.co/F9SpRf51tD ...complete with baseline Mortal Kombat results (around human level) :) "Playing SNES in the Retro Learning Environment," Bhonker, Rozenberg, and Hubara at Technion: https://t.co/o1ex95ZVTc "Sample Efficient Actor-Critic with Experience Replay," Wang et al., DeepMind: https://t.co/UpQ6rLx1AZ "Learning to Repeat: Fine Grained Action Repetition for Deep Reinforcement Learning," Sharma et al., IIT Madras: https://t.co/I40Inn1xEw """LipNet: Sentence-level Lipreading,"" Assael and Shillingford et al at Oxford/DeepMind/CIFAR: https://t.co/0bJm2yPLz1 Superhuman performance" "Deep RL is eating deep learning is eating machine learning is eating AI is eating software is eating the world is... Kidding, kind of...." "RL^2: Fast Reinforcement Learning via Slow Reinforcement Learning," Duan et al., Berkeley/OpenAI: https://t.co/fZOCXxgRiy "Third Person Imitation Learning," Stadie et al., OpenAI/Berkeley: https://t.co/vtGHtfTnL1 "Unsupervised Perceptual Rewards for Imitation Learning," Sermanet et al., Google Brain: https://t.co/1fmEhF2P7J "A Joint Many-Task Model: Growing a Neural Network for Multiple NLP Tasks," Hashimoto et al., Salesforce: https://t.co/vlYmRLwNzy """Tracking the World State w/ Recurrent Entity Networks,"" Henaff et al., Facebook: https://t.co/nGvxcyWar7 SOTA on bAbI (thoughts @Smerity?)" "Learning to Query, Reason, and Answer Questions On Ambiguous Texts," Guo, Klinger, + Rosenbaum et al. at IBM etc.: https://t.co/U6UCKjoelL "Neural Combinatorial Optimization," Bello and Pham et al., Google Brain: https://t.co/7r4ktVk2zh 2+ papers on winning Doom competition bots on here, too, but I have to have *some* limits on what I tweet from https://t.co/ZUjIGzfuf6... "Generalizing Skills with Semi-Supervised Reinforcement Learning," Finn et al., Berkeley: https://t.co/U8HMXThWhw "Unsupervised Program Induction with Hierarchical Generative Convolutional Neural Networks," Gong et al., Facebook: https://t.co/iKKpOw0C1C "Learning to Perform Physics Experiments via Deep Reinforcement Learning," @notmisha et al. at DeepMind etc.: https://t.co/z2IDQcSppZ "Improving Policy Gradient by Exploring Under-appreciated Rewards," Nachum et al., Google Brain: https://t.co/OJ6z95F3Rz "Communicating Hierarchical Neural Controllers for Learning 0-shot Task Generalization," Oh et al., Mich./Microsoft: https://t.co/tGVrWRZ85S "Metacontrol for Adaptive Imagination-Based Optimization," @jhamrick et al., Berkeley/DeepMind: https://t.co/AWnRcMOTF2 "Reinforcement Learning with Unsupervised Auxiliary Tasks," @maxjaderberg, Mnih, and Czarnecki et al., DeepMind: https://t.co/ikgDWLZqlq (that's a lot) *actually, the 8 billion figure I saw on a table when scanning this wasn't the biggest they evaluated - that's 30 billion. "Outrageously Large Neural Nets [8 B params!]: The Sparsely-Gated Mixture-of-Experts Layer," Shazeer et al, Google: https://t.co/3mGMydlvPY "Recurrent Environment Simulators," Chiappa et al., DeepMind: https://t.co/UY3GOSx75h "The Predictron: End-to-End Learning and Planning," Silver, @hado [and others] et al., DeepMind: https://t.co/sCRF1RC3Rf "Learning to Navigate in Complex Environments," [lots of Labyrinth stuff], Mirowski and Pascanu et al., DeepMind: https://t.co/iHVx73YPsL Before I do, though, I will say that perusing this https://t.co/FmrtQtokzS suffices to demolish idea that deep learning's end is in sight... Gonna tweet papers that are especially relevant to my interests on https://t.co/S4Slse0zB0 but suffice it to say there's much more there :) RT @DeepMindAI: BLOG: Our collaboration with @Blizzard_Ent & what makes Starcraft II such an interesting environment for AI research https:… RT @DeepMindAI: We're collaborating with @Blizzard_Ent to open up StarCraft II as an AI research environment for the global community in Q1… Chin scratch emoji. https://t.co/mbFCVX5NHa RT @DeepMindAI: Excited to take part in #BlizzCon with @Blizzard_Ent this weekend! Follow this link now and watch for news: https://t.co/Vh… RT @hardmaru: Neural Architecture Search with Reinforcement Learning, RNNs now generate RNN architectures! #GoogleBrain #ICLR2017 https://t… "RT @CSERCambridge: One week left to apply for our academic project manager role! https://t.co/RWYq0fun7J" @sknthla perhaps an exponential one though, starting in ~2008 @sknthla buildup "Deep Convolutional Neural Network Design Patterns," Smith and Topin: https://t.co/Etc5QcC7Jl "Context-aware...Symbolic Execution of Android Framework with Application to Exploit Generation," Luo/Zeng et al.: https://t.co/Zj8Vz7v5TT "Learning Locomotion Skills Using DeepRL: Does the Choice of Action Space Matter?," Peng and van de Panne: https://t.co/q9RT5jUbSq "Using a Deep Reinforcement Learning Agent for Traffic Signal Control," Genders and Razavi: https://t.co/ORuuvG6g5d "Learning to Pivot with Adversarial Networks," @glouppe et al.: https://t.co/pvq4yHPX9z Thoughts on the paper, folks? https://t.co/Lb7Y0ijipe RT @jackclarkSF: Secretive AI startup Vicarious has finally published a research paper: Hierarchical Compositional Feature Learning https:/… @halhod @jackclarkSF @zeynep last year/two has seen an explosion of other generalish benchmarks/testbeds, TBD what will be learned from that @halhod @jackclarkSF @zeynep lots of fast quantifiable trends, most interesting to me =general-ish ones (e.g. Atari) https://t.co/dJBYgXeEdu RT @soumithchintala: Look forward to further announcements and our code release... :) https://t.co/wV567FDe8O @ndronen @PaulNemitz hmm.. @ndronen @PaulNemitz yeah, at least most academics can get Nature and/or the authors post preprints for free. Not so for expensive reports.. I'm sure there will be lots of investment in AI, but I don't get why journalists cover these 500 dollar reports... https://t.co/St305lY6ZC RT @roybahat: Your annual dose of machine intelligence landscape has arrived, corporate leaders edition, by @shivon and @jamescham https://… "Collaborative Recurrent Autoencoder: Recommend while Learning to Fill in the Blanks," Wang et al.: https://t.co/1ZCECgk9s4 "Natural-Parameter Networks: A Class of Probabilistic Neural Networks," Wang et al.: https://t.co/NQiSj1igZ8 "Why and When Can Deep -- but Not Shallow -- Networks Avoid the Curse of Dimensionality," Poggio et al.: https://t.co/CWWKccMghn "Accelerated Methods for Non-Convex Optimization," Carmon et al.: https://t.co/O8sJnsIvfB "Ordinal Common-sense Inference," Zhang et al.: https://t.co/pZXk8z1xEa "Dual Attention Networks for Multimodal Reasoning and Matching," Nam et al.: https://t.co/Y3ekKMeYv6 "Detecting Context Dependent Messages in a Conversational Environment," Li et al.: https://t.co/4kY8OFUcWE "Extensions and Limitations of the Neural GPU," Price et al.: https://t.co/7eaSPX9wz4 "TorchCraft: a Library for Machine Learning Research on Real-Time Strategy Games," @syhw et al.: https://t.co/0fg88PZhpt RT @DeepMindAI: Exciting new training method for discrete operations in neural nets: The Concrete Distribution! https://t.co/rM9fzzWowR From same folks - "Predictive representations can link model-based reinforcement learning to model-free mechanisms": https://t.co/TKzD0E1yBl "The successor representation in human reinforcement learning," Momennejad/Russell et al. at Princeton/DeepMind etc: https://t.co/3chOO1gzPr @haldaume3 ah, haha :) @haldaume3 in what sense? Not that familiar with Perl... RT @fchollet: We are releasing an open dataset for theorem proving, HolStep: https://t.co/i5QWvXBJYJ - can you beat our 83% accuracy baseli… @AnaPopescu_SV is it subtweeting when you're responding to someone? :) RT @notmisha: A Neural Compiler https://t.co/HbAOvoiBaS https://t.co/cmPFFT832m "defense of...[Bostrom's] warnings about AI"/reply to @etzioni by Allan Dafoe/Stuart Russell, + @etzioni's response: https://t.co/UuqYanZCxd @rcalo nice. glad to see the new section at the end! "RT @rcalo: The Roadmap for US Robotics: From Internet to Robotics just got updated https://t.co/fvGG0lX2gD" RT @Anthony: So @wikileaks is now coordinating leaks with Trump? https://t.co/jZV9iXqt0I Good long read from 2010, some of which is still relevant, all interesting - "How Baidu Won China": https://t.co/vR30BVuAy1 "FEAST: An Automated Feature Selection Framework for Compilation Tasks," Ting et al.: https://t.co/lpLzJlWkNN "Phased LSTM: Accelerating Recurrent Network Training for Long or Event-based Sequences," Neil et al.: https://t.co/4hhExQ8QFh "Sequence-to-sequence neural network models for transliteration," Rosca and Breuel: https://t.co/qXkrduOIVs "Compressed Learning: A Deep Neural Network Approach," Adler et al.: https://t.co/UooOvfvr9F "Accurate Deep Representation Quantization with Gradient Snapping Layer for Similarity Search," Liu and Lu: https://t.co/4DIA5Y3TMd "Compact Deep Convolutional Neural Networks With Coarse Pruning," Anwar and Sung: https://t.co/wEgRpplE1a "Doubly Convolutional Neural Networks," Zhai et al.: https://t.co/6jr6omBIE0 "Deep Model Compression: Distilling Knowledge from Noisy Teachers," Sau and Balasubramanian: https://t.co/q4ja3CJO3v "LightRNN: Memory and Computation-Efficient Recurrent Neural Networks," Li et al.: https://t.co/e7gkatNsZP "Chinese Poetry Generation with Planning based Neural Network," Wang et al.: https://t.co/4DuRzBFmji "Neural Speech Recognizer: Acoustic-to-Word LSTM Model for Large Vocabulary Speech Recognition," Soltau et al.: https://t.co/N5187aEbzD "Full-Capacity Unitary Recurrent Neural Networks," Wisdom and Powers et al.: https://t.co/oyueMSopfR "Exploiting Spatio-Temporal Structure with Recurrent Winner-Take-All Networks," @edersantana et al.: https://t.co/vi6sckfPLx "Stochastic Variational Deep Kernel Learning," Wilson et al.: https://t.co/D3QebjGPup "Active Learning from Imperfect Labelers," Yan et al.: https://t.co/dh0WF1zHHe "Detecting Policy Change Events in Black-Box Decision Making Systems," Ferreira et al.: https://t.co/6ZmWe9M1g3 "Dual Learning for Machine Translation," Xia et al.: https://t.co/kQytKyhmAM "Product-based Neural Networks for User Response Prediction," Qu et al.: https://t.co/sNaSC9hvog "Towards Lifelong Self-Supervision: A Deep Learning Direction for Robotics," Jay Wong: https://t.co/WkzDp6qMpb "Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision," Liang et al.: https://t.co/grMnfKJ2mz RT @samim: Signs that generative text is making progress ;-) cc @hardmaru https://t.co/v8r6XVtjQz Sometimes I think the easiest way to accelerate AI progress would be to stop it for a month so people can read. https://t.co/DpHVHHXT0u RT @hardmaru: @fchollet There's going to even be more coming tomorrow. RT @fchollet: We have reached the Arxiv Singularity... https://t.co/3fW9ltTTL8 @fchollet yeah, reminds me of Aaron Sloman's "singularity of cognitive catch-up": https://t.co/0KBLFl0TLp There were approximately a billion new arXiv AI papers tonight, will get to some of the others tomorrow... @sknthla thanks :) "Edward: A library for probabilistic modeling, inference, and criticism," @dustinvtran et al.: https://t.co/L5MQvLcfzB "Represent, Aggregate, + Constrain: A Novel Architecture 4 Machine Reading from Noisy Sources," Naradowsky/Riedel: https://t.co/tUvnN51qLy "Inference Compilation and Universal Probabilistic Programming," Le et al.: https://t.co/2976BvwPUf "Tensor Switching Networks," Tsai et al.: https://t.co/Hz9zDrHHjH "End-to-End Reading Comprehension with Dynamic Answer Chunk Ranking," Yu et al., IBM: https://t.co/GQwFaVGvcb RT @gstsdn: New GAN paper with @ch402 and Jon Shlens https://t.co/ZMTqaLw0YC "Neural Machine Translation in Linear Time," @nalkalchbrenner et al. at DeepMind: https://t.co/jKcM5OvB8B @nerdherdempire I suppose UBI, just think it should prob. not start out as a replacement of existing things, + tech isn't only reason 4 it @sknthla the tone was pretty neutral across those groups, though, so neither extreme interp makes sense. TL;DR boring comment, lame speech @sknthla the way ppl (me included) interpreted it was without the "even" part. In context tho it was ~ "middle class, upper MC, +1d millis" RT @mark_riedl: The scariest part of my costume is that my neural net isn't converging! #halloween #deeplearning https://t.co/O0Dj6R37ok @markus_with_k nice :) would love to visit sometime... RT @markus_with_k: And the new Oxford Robotics Institute website is up! Look at all the fascinating work happening https://t.co/YsJrJbWJ85… Let's focus instead on him being wrong on pretty much everything else... He's horrible but the quote everyone (including me) retweeted is at the end of a list that went in ascending order of economic class. Damn it, are y'all really going to make me defend Peter Thiel...listening to the full interview and the millionaire thing is out of context. RT @tashmahal: This photo is, as far as I'm concerned, the single greatest photo of any president or premier of any country, ever. https://… @Aelkus fortunately, only a Dutch guy asked me about Trump there. @Aelkus he's a strategic genius in the same way Thiel is a skilled political theorist. @Aelkus he hacked an iPhone or something, so he must be a top notch founder, manager, strategist, and market researcher, don't ya know. Best cases I've seen for BI are ethical/political, not imminent mass unemployment-based, and don't treat it as panacea. "Vincent Conitzer: Today's AI doesn't justify basic income. [partly agree, but it doesn't follow BI=unjustified] https://t.co/TrHOKpKhoc" RT @daveweigel: Peter Thiel, verbatim: "If you're a single-digit millionaire like Hulk Hogan, you have no effective access to our legal sys… @sknthla your Halloween handle made me happy, though, so the universe balanced out. RT @BVLSingler: Our short film "Pain in the Machine" is online! https://t.co/pwatxOmX6L Pls follow link in the description to fill in our s… People interested in AI should subscribe to this if they haven't already... https://t.co/loxXIkJJVd Anyone watching Westworld and familiar with these multiple timeline theories? Thoughts? RT @beaucronin: I've started a dev blog for my project Earthers, a simulation game powered by real climate and earth system models https://… """Deep Learning Games,"" Schuurmans and Zinkevich: https://t.co/qRG4FKYl7H ""reduction of supervised learning to game playing""" "Professor Forcing: A New Algorithm for Training Recurrent Networks," Lamb et al.: https://t.co/gcNzpPGycL "SoundNet: Learning Sound Representations from Unlabeled Video," Aytar et al.: https://t.co/G0kz8h3K1C +There were implementations of MANNs since before the [few months' old work] Nature paper came out; not sure how MANNs/DNCs relate, though. Turned out to be more like 6%. https://t.co/WVCe6VpGex https://t.co/viFTdqEOXz Interesting and important stuff - much, much more efficient memory-augmented NNs. This made me laugh, though. https://t.co/CPuKlQN4wb "Scaling Memory-Augmented Neural Networks with Sparse Reads and Writes," Rae et al. at DeepMind: https://t.co/DrPh5tYTrA *working again. Is Google down for anyone else? RT @KaiLashArul: Intriguing properties of generative autoencoders, e.g. VAEs, explored with a simple technique: https://t.co/x8cJ5V8CJC w/… @hardmaru Secretary of State-Action Pairs... @jackclarkSF oooo interesting. @Tiago_R_Ribeiro tons of things she could have meant by this, including "why are you sending this/why should I care"... Nice short talk by Beth Barnes on effective altruism. Glad to share offices with the Center for Effective Altruism! https://t.co/SsznppKcA9 @Smerity @rbhar90 @mat_kelcey wouldn't rule out over decadal timescale, but prob can't accomplish much in next few years. They're trying... RT @rbhar90: @Miles_Brundage @mat_kelcey Really depends on which city in India. Ranges from terrible to pretty good air. @rbhar90 @mat_kelcey yeah, that was too broad of a statement. I was anchoring on Delhi... (source: Wikipedia) This is the sort of variation one sees in Beijing, for those who haven't been there... https://t.co/VDhTVtlc2K (meant to quote/respond to this tweet there: https://t.co/viUFtcf32e) Seems like it's worse than LA has been anytime recently+possibly ever, +hasn't improved much lately, but varies a lot seasonally/event-wise. RT @j2bryson: @Miles_Brundage Yes, I know hong kong natives who don't want to go back because of the pollution. @mat_kelcey yeah when it's bad, it's really bad. Apparently much better than India, though, which is horrifying. @mjntendency looking into this but I think LA is way better than Beijing almost all the time. @tdietterich ... so wonder if that has anything to do with it. Long term change doesn't seem that big from what I've seen so far. @tdietterich taking a shallow dive into the data on this and seems like major event vs. non-major event variation >> change over time... Actually, maybe not better on average. Gets better for major events. 1st visit was *before* Olympics, this time *during* big conference. Hm. Seemed better to me than 2008 but small sample :) In those cases, intermittently yellow hazy + clear, vs. intermittently gray hazy + clear. Another #ChinaThought: could imagine pollution in China being a deterrent for researchers to move there. Not only factor but counts against. @timhwang is the tech shovel-ready, though? RT @joss: Hillary's lead in the polls is narrowing. Please don't become complacent. Sorry I don't have a joke. Meanwhile, Alibaba/Tencent at/near top of Chinese tech corp caps (Baidu much lower, maybe outlier). Recent report refers to these 3 as BAT.. Top 5 (acc'ing to https://t.co/pUZs7IbKQE) are Apple, Google, Microsoft, Facebook, Amazon. Nice point from @jwan584: very high correlation between top market cap corps and AI investment in both East + West. https://t.co/ZNVoFZJDgt Man, really wish I had time to read this: "Annual Report on the Development of China's Special Economic Zones" - https://t.co/07vkmqLEX8 @SimonMoores indeed, would be much more surprised to have seen that on my Beijing trip ;) @jwan584 + publishing (have seen some recent papers by them). One report called them, Baidu, and Alibaba as top 3 corp players in Chinese AI @jwan584 I'm not that familiar but among other things, hiring seemingly qualified ppl (e.g. https://t.co/M13DIfaXPF), investing in startups, Speaking of China and tech - here are Google's and Baidu's search results for "Falun Gong." Quite the difference. https://t.co/8XkT5Rfwmz @hardmaru see e.g. https://t.co/TOg1DN71Sc Some relevant anecdotes from trip that I prob shouldn't share on here but TL;DR: important stuff! @hardmaru thx for sharing, lots of points I agree with there. And the macro and micro are v. connected - WeChat is instance of his "can" pt. Seriously, it's yuge. Another China realization: hugeness of WeChat. 700 million active users, FB meets Twitter-like features, +maker Tencent investing big in AI. RT @neuroconscience: Also a relevant sentiment for grand neuroscience theories of everything. https://t.co/6yhnhRFXwF @samsheffer that's not what the letter says... 1. "may be", 2. "up to," 3. "respond" = answer Qs, not "don't do this"... @VinFL + dunno if ppl were using a phone-level voice recog function across apps or app-level "click microphone" stuff we have but rarely use @VinFL not really, it seemed to just be used for general purpose text entry - messaging, search, entering destinations in map program, etc. (perhaps only halfway on a log scale if you're talking about sophistication of the software, but linear in terms of usage normality :) ) The extent to which voice recognition is used there definitely made an impression on me, though. It's like halfway between the West and Her. Just about recovered from China trip jet lag, but still not sure yet what my main takeaways from the trip are. Very interesting stuff... @BrianSJ3 agreed @BrianSJ3 not sure what you mean The video at the top is really good. https://t.co/zRQ8E3dTG2 RT @mchorowitz: Interesting https://t.co/gK8cRITvb5 Umm https://t.co/HaZ3KAMYud @AnaPopescu_SV @deliprao maybe Somalia will be the first market ;) @AnaPopescu_SV @deliprao it's quite imaginable that China would be good 1st market for this, but at some point you gotta talk to regulators. @AnaPopescu_SV @deliprao very short sighted in all sorts of ways. Seems like a fast road to Chinese knockoffs in a few months. RT @twitskeptic: @Miles_Brundage I think he's just auditioning for a part in "Silicon Valley" RT @eganist: @comma_ai did you really cancel a product over a basic safety request from the government? @deliprao maybe. if so, for a lot more than the cost of answering this letter... incomes there aren't *that* low ;) this seems utterly dumb. @AnaPopescu_SV utterly predictable. and yes, I'd like to see such a product exist, too, but requires knowledge there's a government... @AnaPopescu_SV there is a better way, it involves not throwing a tantrum when the relevant agency asks Qs... or better yet, thinking ahead.. Spoiler alert for Comma.AI: China has a government, too. @AnaPopescu_SV they certainly have enough money to hire lawyers, or tweet asking for a lawyer with a common interest in "breaking stuff" lol @AnaPopescu_SV ridiculous. God forbid the agency tasked with ensuring driver safety asks basic questions about driver safety. This is the entirety of what they asked. https://t.co/x4HaJ7blbD RT @jstogdill: Wait till you see how pissed @comma_ai 's gonna be when he starts coding brain-interfacing nanobots and the FDA writes to him @davegershgorn lol. RT @adhdphd: @Miles_Brundage Stock values/growth. Need massive piles of money in order to provide competitive total comp. @dkrish_24 nice to meet you! :) @katherinebailey hmm! Interesting idea :) RT @cmarschner: @Miles_Brundage Other industries are not software industries. Eg Car companies have hard time hiring rockstars into their "… RT @wareFLO: @Miles_Brundage healthcare, which arguably may have highest ROI for these techniques, also has highest barriers to data access 5. Lots of industries have lots of data, though. Thoughts? 4. Consumer/business computing hardware + software is maybe be a fourth category (Microsoft, Huawei, IBM, etc.). In each case, lots of data. 3. Not sure one would have (/anyone in fact) guessed that a while back. A somewhat cherry picked list, but covers many key players. Hmm... 2. By which I mean search (Alphabet, Baidu), social networking (Facebook, Tencent), and e-commerce (Amazon, Alibaba, JD). Makes sense, but.. 1. Interesting that some of the primary companies spearheading AI R+D in both the US and China are clustered in just a few main industries.. (probably a dumb question/answerable if I read the paper more carefully, but dumb questions are what Twitter is for, right?) Isn't the perplexity crazily low here? https://t.co/KS63a1YtcK "Voice Conversion using Convolutional Neural Networks," Mobin and Bruna: https://t.co/egnEQtVQap "GPflow: A Gaussian process library using TensorFlow," de G. Matthews et al.: https://t.co/QyO44JSrUd "Learning Scalable Deep Kernels with Recurrent Structure," Al-Shedivat et al.: https://t.co/fHnxh4TPxE "A Review of 40 Years of Cognitive Architecture Research," Kotseruba et al.: https://t.co/7NpuKNdYTn "Can Active Memory Replace Attention?," Kaiser and Bengio at Google Brain: https://t.co/oAKpFS5996 "Ex Machina: Personal [Online] Attacks Seen at Scale," Wulczyn, Thain, and Dixon at Wikimedia/Jigsaw: https://t.co/goO1DTFsQh If you're interested in AI safety, I can't recommend Paul Christiano's fascinating blog highly/often enough: https://t.co/Fwb7e9dHGz "RT @deliprao: Foreseeing upcoming clickbaits in your favorite mass media publication. AI EXPERT ENDS RADIOLOGY SCHOOL FLUSH YOUR RADIOLO…" RT @NipsConference: Tickets for the main conference look like they're going to sell out in the next few minutes. @creativedlab @jackclarkSF great! :) @jackclarkSF will it be recorded? RT @RachelFersh: tfw you read an authoritative yet completely incorrect news story about your own field and wonder why you believe stories… @sknthla yes RT @markus_with_k: And there it is: The robot car dataset! 20tb of camera, lidar, etc. https://t.co/Xgdwy9pqhH and the paper https://t.co/y… @chris_brockett I assumed this was already covered by some articles saying "editor's note: substantial text overlap with X". Hmm. RT @dennybritz: Yoshua Bengio launching Element AI Deep Learning Incubator in Montreal https://t.co/wXMrw22qhd @_jyan_ @jackclarkSF doesn't seem too hard... lots of resources already (tweet summaries, people linking to notes here)...maybe a hashtag? Black Mirror season 3 started pretty meh but San Junipero kind of redeemed it. @jackclarkSF if only there were an AI subfield devoted to summarization... :) [but really, not sure how good it is on stuff like this] @MatthewGombolay it was very interesting! Hard to summarize briefly but I definitely found it to be a worthwhile visit :) @MatthewGombolay I wanted to try this out when I was there but there was a big crowd/line :) @sknthla had some saved up from when I had limited Twitter access in China :) "Surprisal-Driven Zoneout," Rocki and Kornuta: https://t.co/LxhuQmZ1mq "A Learned Representation For Artistic Style," Dumoulin et al.: https://t.co/nAgr90eTCE "End-to-end Learning of Deep Visual Representations for Image Retrieval," Gordo et al.: https://t.co/vPwGjRiWfY "Learning to Reason With Adaptive Computation," Neumann et al.: https://t.co/ulLz26VHLa "Bridging Neural Machine Translation and Bilingual Dictionaries," Zhang and Zong: https://t.co/NL3ITbuZkO "Two are Better than One: An Ensemble of Retrieval- and Generation-Based Dialog Systems," Song et al.: https://t.co/jLksmrLQZp "Safety Verification of Deep Neural Networks," Huang et al., Oxford: https://t.co/dxg0N4H6mZ "Learning to Protect Communications with Adversarial Neural Cryptography," Abadi and Andersen, Google Brain: https://t.co/rrwMa3shPP "Vision-Based Reaching Using Modular Deep Networks: from Simulation to the Real World," Zhang et al.: https://t.co/YFi2BPDMpI "Virtual Embodiment: A Scalable Long-Term Strategy for Artificial Intelligence Research," Kiela et al.: https://t.co/i3r97CnJNS "Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling," Wu et al.: https://t.co/2DDDb8rzgs "The poor altmetric performance of pubs authored by researchers in mainland China" partly bc Twitter ban; Wang et al https://t.co/fnM6BkiTNI @fchollet the retirement age for ambitious academics is like, never in BAU, though... so maybe life expectancy is more relevant here. Season 3 Ep. 1 of Black Mirror was pretty uninspired/predictable... 2 seems more interesting so far, though. Fingers crossed... Finally able to get depressed by the new season of Black Mirror. @KaiLashArul belated congrats! RT @vgr: “I don’t like to analyze myself because I might not like what I see.” --Trump https://t.co/GRp5JHtbuJ He was asking it 80 yuan was OK for the fare. Also, mobile payment is super widely used in Beijing. Interesting stuff... In the first case, it seemed to work perfectly. In the second, I was told "83 your mama." Fortunately I knew what he meant :) My China visit started with a taxi driver using speech recognition to put in an address + ended with another one using machine translation.. Saw this "Big Dog with a table on top of it"-looking thing the other day...very interesting. https://t.co/8NWvnOnQhP TFW there's a Chinese version of your years old Kickstarter product before it actually gets on the market... https://t.co/3PrsE93jud Service robot helping the elderly in China :) https://t.co/CYqiyI8FC6 @ankscricholic Beijing. Yeah, sorry we didn't meet! Unfortunately heading to the airport shortly... @AngeBassa @AnaPopescu_SV thanks! @gokevin1 no; I think he lives in Hong Kong. Very interesting few days in China. Raised more Qs than As about what's going on with AI here, but learned a bit :) Heading back tomorrow. @AnaPopescu_SV where's this from? @volkuleshov dunno. I think I prob should have said "R+D," not just research. Seems more development oriented. @naumenko_roman @cdaffara there is a lot of cloud computing stuff here, though not sure it's attributable to the part of town.. @naumenko_roman @cdaffara [caveat: I'm not sure, this is all second/thirdhand info] I think it wasn't super successful? @hrilab @JedBrown5 @jackclarkSF don't agree w/ that claim but certainly they're investing a lot.. "RT @Floridi: Morally problematic algorithms? Here is a map of the issues: https://t.co/KvYAJ1DOD1 @TheEconomist @newscientist @PhilosL @…" RT @sternbergh: This is what we'll all read on Twitter 5 minutes after the first wave of nukes have been launched. https://t.co/7ItD2BmVxJ Just a few months left in 2016 + haven't seen this in West but China ahead of schedule? The tech's (almost) solved.. https://t.co/zeSGaXVxE7 (due to space limitations, that was perhaps too broadly framed: I meant as part of one's job) Something I saw for maybe the 1st time in China: someone using voice recognition for a practical purpose (taxi driver putting in location). @jwan584 yep. @jwan584 by the Chinese government. Beijing city, I think. Something related to this, I think? https://t.co/hRIJxKFO6N More unrealistic body images for men to live up to... https://t.co/Z5OjwxzQVC View from my hotel in Beijing...this whole area of the city is designated for AI research. Previously was designated for cloud computing. https://t.co/HabyP1SfrF "A Growing Long-term Episodic & Semantic Memory," Pickett et al.: https://t.co/7bi6G7KbCP @mark_riedl dunno, pretty new paper... @mark_riedl maybe this? https://t.co/Y7rDihw9mh There's also a lot of original research/products on display (e.g. competition-winning stuff from Tsinghua, SenseTime). It runs the gamut. Name a famous robot (Baxter, Jibo, Big Dog, Nao) and there's probably a Chinese equivalent here. Can't speak to quality, but huge quantity. 1st badminton bot AFAIK was 2012/13 in Belgium but moved on a track; this 1 previously reported, but more impressive in uncontrolled enviro. Here's the aforementioned badminton bot. https://t.co/V4gkG3huTb Random assortment of pics from the hundreds of service, industrial, entertainment, etc. robots at World Robot Conference 2016 in Beijing. https://t.co/k09T4KYh2S "Using Fast Weights to Attend to the Recent Past," Ba et al. at Toronto/Google Brain/DeepMind: https://t.co/pRXWai0bTa Coolest demo I've seen in a while: robot playing human at badminton. At World Robot Conference 2016, Beijing. Vid when I finish uploading :) Some bigly Chinese robot pics/videos coming up... Off to China for a few days. Hope to share some robot pics and other fun stuff :) RT @tonyschwartz: Trump to me as he puts his hand out "Hello ... oh God its you." Yes Donald it is me. Covering your every move. RT @grok_: “Nobody has more respect for women then I do.” Uh, most people actually. #debatenight @sknthla some have suggested this https://t.co/rnZbR9kzGR Wait, you can promote trends? https://t.co/tbunEXjqDU (not in a good way) This is one epic rant. @rcalo I lol'd """Big Batch SGD: Automated Inference using Adaptive Batch Sizes,"" De et al.: https://t.co/MrmhMZQ0wG" "Membership Inference Attacks against Machine Learning Models," Shokri et al.: https://t.co/zLEHGmv1pO "CuMF_SGD: Fast and Scalable Matrix Factorization," Xie et al.: https://t.co/FrzOOyyxEo "Towards Simpler and More Biologically-plausible Normalizations for Online and Recurrent Learning," Liao et al.: https://t.co/jyMvNMwFg6 RT @goodfellow_ian: My co-authors and I have developed an effective and general deep learning algorithm that has privacy guarantees https:/… RT @mpshanahan: My (provocative, slightly crazy) essay "Conscious Exotica" is published in @aeonmag today - https://t.co/i8XS2TgSSQ Pro of prepared food at British grocery stores: some things are labeled "no mayo." Con: everything else has mayo. RT @mark_riedl: And we are surprised that AI research and startup culture has a diversity problem? >_> https://t.co/MVY2Z6JvjQ RT @nasrinmmm: @AndrewYNg a normal person understands anything in natural language in <1sec yet no #AI has basic NLU of a 5year old https:/… "AutoGP: Exploring the Capabilities and Limitations of Gaussian Process Models," Krauth et al.: https://t.co/5NFSR2AmG1 "Team Delft's Robot Winner of the Amazon Picking Challenge 2016," Hernandez et al.: https://t.co/bwvW156dUN "SYSTRAN's Pure Neural Machine Translation Systems," Crego et al.: https://t.co/gGE9LDE1x8 "Deep Amortized Inference for Probabilistic Programs," Ritchie et al.: https://t.co/Fsud8DQZtE "We achieve state-of-the-art privacy/utility trade-offs on MNIST + SVHN thanks to an improved privacy analysis and semi-supervised learning" "Semi-supervised Knowledge Transfer for Deep Learning from Private Training Data," Papernot et al.: https://t.co/bKSAHCv2kt "Online Contrastive Divergence with Generative Replay: Experience Replay without Storing Data," Mocanu et al.: https://t.co/y1EvYOoWbV "Propagation and synchronization of reverberatory bursts in developing cultured [rat neural] networks," Huang et al https://t.co/FjL3dldMZI So far I've gone to China *before* I learned Chinese and then *after* I forgot most of it, but at least machine translation is OK this time. @AnaPopescu_SV what looks? ICYMI, the video is wild. https://t.co/0gFJTVUrbm RT @fchollet: Introducing the Artificial Intelligence Open Network: a 100% open-source AI research community. https://t.co/i6G27YUgsF Where I'm heading in a few days... https://t.co/3zszegJ3on The deadline for submissions to the February AAAI workshop on AI, Ethics, and Society is October 21: https://t.co/vL41OIFo0j RT @jackiefloyd: I'm saying this happens. And women don't "come forward." I'm coming forward & calculating how much trouble do I want over… RT @jackiefloyd: I met with a startup CEO to talk about a ML job. Somewhere toward the end of the meeting he said, "You could have my babie… "Interactive Attention for Neural Machine Translation," Meng et al.: https://t.co/d5bj6AiR09 "Cached Long Short-Term Memory Neural Networks for Document-Level Sentiment Classification," Xu et al.: https://t.co/Q1mz577ojC "A Game-Theoretic Analysis of Adversarial Classification," Dritsoula et al.: https://t.co/Vm3wLSMOpd "Deep Learning Ensembles for Melanoma Recognition in Dermoscopy Images," Codella et al., IBM: https://t.co/jQwRErCl1k (using 3D printers so you have precise control over the manipulated objects...nice idea) "Capture, Print, Innovate: A Low-Cost Pipeline and Database for Reproducible Manipulation Research," Pokorny et al: https://t.co/Y5WvIQkpis "Neural Machine Translation Advised by Statistical Machine Translation," Wang et al.: https://t.co/yEMrVcpXUu "Spatio-temporal Gaussian processes modeling of dynamical systems in systems biology," Niu et al.: https://t.co/jNVnjHAL7I @nerdherdempire I will, just haven't gotten to it yet :) "Achieving Human Parity in Conversational Speech Recognition," Xiong et al., Microsoft: https://t.co/kc9o7YPVzu Lots of interesting arXiv stuff tonight... Including the zany humanoid slalom thing I shared a brief video of a while back (at IJCAI I think)...wild stuff. """Learning and Transfer of Modulated Locomotor Controllers,"" Heess et al., DeepMind: https://t.co/Pda6P3LxGE https://t.co/nwTwUez3GS" @deliprao @SeanGoldbergCS yeah. I have a possibly crazy theory that in five years, there will be a crazy GOFAI hiring spree. RT @MelMitchell1: @Miles_Brundage As you say, they're "big" and "deep", but are maybe not "broad" enough? @deliprao but yes, cognizant of equivalence thing - what I said is correct, I think, though - e.g. Salakhutdinov named head of AI research @deliprao yeah, I think it's plausible (though maybe unlikely? dunno) that having deep learning folks run everything is short sighted. @kleinsound [though perhaps you could say the same thing about Google Brain/DeepMind, different Amazon labs, etc.] @kleinsound for sure, I meant diffuse in sense of decentralized (AFAIK, Redmond + Cambridge MSFT kinda do own things?), not lack of talent @starsandrobots ok, that does sound very cool :) @rodolfor they seem pretty woke now... Interesting workshop at EU Parliament. Several members of nat'l parliaments spoke. Turns out AI/robotics is a big deal, who woulda thunk it? Oh, and Baidu in the first list. AI research at Alphabet, Amazon, Apple (many A's...), OpenAI, Facebook=now led by big deep learning people. IBM/Microsoft=more diffuse (?). @tallinzen dunno. only really heard it from media/policy types (of which @jackclarkSF is some of both now :) ). Slightly fewer chars I guess @tallinzen it's more specific than win. Refers to actually getting something... I think I've only heard it in this context (big hires). https://t.co/8pG7RHFAK6 https://t.co/HTPrI8PzoR "RT @rsalakhu: Excited about joining Apple as a director of AI research in addition to my work at CMU. Apply to work with my team https://t.…" RT @Kasparov63: Saying that fair elections are rigged is as much a crime against democracy as saying that rigged elections are fair. "Assessing Threat of Adversarial Examples on Deep Neural Networks," Graese et al.: https://t.co/zGqoEtYfuv "Are Accuracy and Robustness Correlated [in the context of adversarial examples and NNs]?," Rosza et al.: https://t.co/Arncw7b9zG "Recurrent 3D Attentional Networks for End-to-End Active Object Recognition in Cluttered Scenes," Liu and Shi et al: https://t.co/y5SIeOpKYk "Practical Learning of Deep Gaussian Processes via Random Fourier Features," Cutajar et al.: https://t.co/SFMKOCd9l9 "Sim-to-Real Robot Learning from Pixels with Progressive Nets," Rusu et al. at DeepMind: https://t.co/Or3WstVexh RT @trochee: I think I found a pretty good visualization of the state of new neural net papers on Arxiv https://t.co/pnBi6nscHU TFW it takes about as long to debunk a @realDonaldTrump tweet as it did for him to write it. https://t.co/zwdlDysV3f RT @AcademicsSay: That feeling when the U.S. election will be over in 22 days removing tweeting about Trump from the list of academic excus… @mark_riedl seems responsible and safe.... @BrianSJ3 I took your point to be directed at author, but if more generally pointing to such gaps, then yeah, fair Q. @BrianSJ3 that's kind of the pt of the article, highlighting the lack or difficulty of such things for advanced AI systems, as I understood @BrianSJ3 not all, obv, but I thought it was a reasonable post.. @BrianSJ3 ...yes? elaborate? More good stuff from Paul Christiano - "Security and AI control": https://t.co/G2ABYdu22O @jackclarkSF working on a blog post related to this, stay tuned :) RT @LeverhulmeCFI: We’re hiring! Seeking a post-doc to research values & intelligence / normative contexts of AI https://t.co/eEUM5VvvQv @F… Haven't watched the whole thing but from what I've seen, this AI ethics conference going on at NYU seems pretty good https://t.co/wXQfnlUrHt @hardmaru agreed! "Building a Strong Fighting Game Player," master's thesis, Ngoc Quang Vu https://t.co/J6Ph6cletm RL/MCTS. Didn't know abt fighter AI tourney RT @Smerity: @Miles_Brundage Not SotA on bAbI 10k compared to DMN+. It's in ref but I can't find where in paper - citations have no numbers… @Smerity ah, got it now :) @Smerity either way, the error rate was def lower in new paper than DM one, but didn't look closely at if it was 10k or what in DM. @Smerity not sure where you're quoting from, DeepMind paper? new paper was prob submitted to arxiv b4 Nature paper went up, so cant blame em "Mapping Between Natural Movie fMRI Responses and Word-Sequence Representations," Vodrahalli et al.: https://t.co/blVZqKvwyl "Mind Control: Frontiers in Guiding the Mind," (including ethical dimensions) Medaglia et al.: https://t.co/QYtsLzav8t CC @anderssandberg "Compressing Neural Language Models by Sparse Word Representations," Chen et al.: https://t.co/vOUJiKN9BB "A Neural Network for Coordination Boundary Prediction," @JessicaFicler and @yoavgo: https://t.co/kZ7sgVz0L4 "Gated End-to-End Memory Networks," Perez and Liu: https://t.co/mHCtJTa672 SOTA on bAbI task. "Exploiting Sentence + Context Representations in Deep Neural Models for Spoken Lang. Understanding," Barahona et al https://t.co/PvxinZwnL2 We probably didn't deserve Obama's awesomeness, but we definitely don't deserve Trump's awfulness. Hillary seems about right. RT @melbournecoal: David McCraw, NYT lawyer, responds to Trump’s letter. https://t.co/ziPBCIjkvP @j2bryson not yet (workin on it) but slides are here: https://t.co/dJBYgXwf52 RT @jackclarkSF: Report from @OpenAI's first self-organizing conference https://t.co/VrMe1lhTo3 Methods to improve diversity in AI: https:/… @Smerity the People story? really annoying. @jeffbigham I count at least 24 in the House against him here: https://t.co/GElK0HPoeH not a complete list, but already 1/3 of GOP/Dem gap.. @jeffbigham dunno if he'd win in that scenario. Lots of GOP reps have turned on him/more may soon. But yeah, help is good. Election forecast - Trump will probably lose, but if he wins, sales of this book will go up a lot: https://t.co/FQRLrGRj9e RT @NickKristof: China's Communist Party leaders cite the US presidential campaign as best evidence for one-party dictatorship https://t.co… RT @mark_riedl: What the election map would look like if only deep neural nets were allowed to vote https://t.co/AuwCE00AyI "A Paradigm for Situated and Goal-Driven Language Learning," Gauthier and Mordatch at OpenAI (etc.): https://t.co/4n8aqTjjWL "Transfer from Simulation to Real World through Learning Deep Inverse Dynamics Model," Christiano et al. at OpenAI: https://t.co/YLwkHUODlD @davegershgorn certainly gov'ts deserve some credit, inc. US, though Canada maybe has more of a claim to recent DL success via CIFAR... Yeah, much uncertainty here (would have put a ~ symbol but ran out of characters :) ). We'll see. There have been faster turnarounds before. From new DeepMind paper: "public version of the code will be made available within 6 months" - suspect someone will make it in 1% of that :) RT @demishassabis: Blogpost explaining DNCs: https://t.co/BbyfmhaLE5 with a read-write memory augmenting the NNs much like the hippocampus… RT @DeepMindAI: Our 3rd @nature paper! 'Hybrid computing using a neural network with dynamic external memory' #DNCpaper https://t.co/uRje2F… RT @shakir_za: See our new paper with .@balajiln. Using hypothesis testing to understand GANs, ABC, density ratios and wider connections. F… If you're into government AI reports, see also the companion report (on research strategy) to main White House one: https://t.co/51EjPTaeuw https://t.co/X1sv1iBssl @rodolfor whose name? RT @EdFelten44: Just released @WhiteHouse report on Preparing for the Future of Artificial Intelligence #FutureofAI https://t.co/dhZMH6DmqH… RT @NipsConference: The preliminary poster schedule is now available. https://t.co/fir3t88aKt Post-doc opportunities at the Center for Human-Compatible AI at Berkeley: https://t.co/z3gaxo7Tdj "Levels of rep. in a recurrent neural model of visually-grounded language learning," Gelderloos and @gchrupala: https://t.co/UzUvTjntZ3 "GMM-Free Flat Start Sequence-Discriminative DNN Training," Gosztolya et al.: https://t.co/0zJtlpPv2l [sounds like GMO-free :) ] "An Empirical Exploration of Skip Connections for Sequential Tagging," Wu et al.: https://t.co/AGX1slLZZg CC @sknthla "A Longitudinal Measurement Study of 4chan's Politically Incorrect Forum and its Effect on the Web," Hine et al.: https://t.co/otRph5tSRr "Navigational Instruction Generation as Inverse Reinforcement Learning w/ Neural Machine Translation," Daniele et al https://t.co/EWD0czE1j0 "Safe, Multi-Agent, Reinforcement Learning for Autonomous Driving," Shalev-Shwartz et al.: https://t.co/YFSK2LdZ7r "Learning in Implicit Generative Models," @shakir_za and Lakshminarayanan at DeepMind: https://t.co/mMtzCC1rVV RT @mpshanahan: Our work on deep symbolic reinforcement learning showcased in a @verge article by @jjvincent - https://t.co/SFo9yEUqj0 #AI… @AnthroPunk the show Person of Interest is I assume what's being ref'd. In that case, yeah, referring to actual persons. RT @neuroconscience: Also consider making a donation to Hillary's campaign which will contribute to GOTV efforts in battleground states. ht… @azeem @jackclarkSF following up on this... this article says 1k for AI at Baidu: https://t.co/YQdxoSy9p8 RT @AndrewYNg: Announcing Melody the Medical Assistant! https://t.co/6iAVhSbgab Automatically asks you questions to get more info for your… "RT @mark_riedl: ... 5000 trials later... T-800: Hasta la vista, baby. John: Great! T-800: No problemovista baby <EOS>" "RT @mark_riedl: T-800: My CPU is a neural net processor John: Say hasta la vista, baby T-800: Hasta <EOS> John: Hasta la vista, baby T-800:…" Terminator: Genisys [sic] is free on Amazon Prime. That's not low enough of a price, though. They should pay you to watch it. "In addition, we show the first text-to-human image synthesis results, but performance on this task is clearly far from saturated" This is pretty bonkers. https://t.co/rNuqhYHuAd https://t.co/ZCurA71Zj8 @chrisalbon using an LSTM. "Latent Sequence Decompositions," Chan et al., Google Brain (SOTA end-to-end ER on WSJ speech recognition task): https://t.co/TgZkuHTjEM "Generative Adversarial Nets from a Density Ratio Estimation Perspective," Uehara et al.: https://t.co/X0cuLX27ka "Revisiting Multiple Instance Neural Networks," Wang et al.: https://t.co/DRxb2PiZHL "Variance-based regularization with convex objectives," Duchi and Namkoong: https://t.co/AukRhpQpRI RT @erichorvitz: #Pokémon influence on # of steps & link to public health https://t.co/qc28Qjjx0r Study led by @MSFTResearch intern @timalt… "Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Models," Vijayakumar et al.: https://t.co/7qpUYWpPqZ "Interpreting Neural Networks to Improve Politeness Comprehension," Aubakirova and Bansal: https://t.co/j5tsu1RKn0 Learning Deep Generative Spatial Models for Mobile Robots," Pronobis and Rao: https://t.co/A9xvyDTKip "A Dynamic Window Neural Network for CCG Supertagging," Wu et al.: https://t.co/2oZBrtIpsV "Modelling Sentence Pairs with Tree-structured Attentive Encoder," Zhou et al.: https://t.co/Cq8FyDJ7Ix "A General Framework for Content-enhanced Network Representation Learning," Sun et al.: https://t.co/dLZfscSLwR "Video Captioning and Retrieval Models with Semantic Attention," Yu et al.: https://t.co/TJZhCvg9pg "Quantifying moral foundations from various topics on Twitter conversations," Kaur and Sasahara: https://t.co/89jg1iM0N0 "Extrapolation and learning equations [with neural networks]," Martius and Lampert: https://t.co/vXMjYVM6eR "Fully Character-Level Neural Machine Translation without Explicit Segmentation," Lee et al.: https://t.co/2JEObTBwOd "Deep Pyramidal Residual Networks," Han et al.: https://t.co/BGlYM1O6SX "Crafting GBD-Net for Object Detection," Zeng and Ouyang et al. (ImageNet winners): https://t.co/SimiNeCRsm code: https://t.co/EAYXcDESDo "Federated Optimization: Distributed Machine Learning for On-Device Intelligence," Konecky et al, Edinburgh/Google: https://t.co/WLnld2UQVD Relative error reduction of 38 and 43% on two datasets... """Learning Spatial-Semantic Context w/ Fully Conv. RNN for Online Handwritten Chinese Text Recognition,"" Xie et al.: https://t.co/gyhSSIPa8l" "Equality of Opportunity in Supervised Learning," @mrtz et al.: https://t.co/irxHMXaLk5 See also https://t.co/CpOcxNp1qA "Enabling Medical Translation for Low-Resource Languages," Musleh et al.: https://t.co/mJmv9l5KnU CC @rbhar90 "ResearchDoom and CocoDoom: Learning Computer Vision with Games," Mahendran et al.: https://t.co/itz6D4G8UH RT @scott_e_reed: Code for NIPS'16 "Learning What and Where to Draw" at https://t.co/xgnK41xTfO. https://t.co/fUFJVTtFW4 "Learning What and Where to Draw," @scott_e_reed et al.: https://t.co/Y7rDihNKdP "Honing Theory: A Complex Systems Framework for Creativity," Liane Gabora: https://t.co/cWX0Ua3tCB "Situational Awareness by Risk-Conscious Skills [in hierarchical reinforcement learning]," Mankowitz et al.: https://t.co/8wB46GTlgk "Multi-Objective Deep Reinforcement Learning," Mossalam et al., Oxford: https://t.co/IaXa5RjxI1 Michael Wellman, "Autonomous Agents in Financial Markets: Implications and Risks": https://t.co/u7ypkywOg6 AI safety talk by Stuart Armstrong of @FHIOxford - "Reduced Impact AI and Other Alternatives to Friendliness": https://t.co/MHvImg9cof RT @NateSilver538: Doubling down on a loyal 35% of the electorate is an uncannily brilliant strategy in a 17-way primary but not looking so… Stuff ppl on left/center get excited about/hope are death knells for Trump (inc. elite rebuke) are neutral or good from Trumpist POV. Scary. Jailing Clinton thing is obv problematic but won't bother Trump supporters. Many cheered. Only thing that matters is vote turnout 4 Hillary. RT @NPR: Congressional source tells @nprpolitics that @SpeakerRyan will not defend @realDonaldTrump or campaign with him through #Election2… RT @BenLaurie: Test suite for fuzzers: https://t.co/oKa5Zlc0K0. RT @MichaelSteele: GOP at this moment. #debate https://t.co/nD0gc29sWj Looper... https://t.co/sHPppCk4Tt @maxerbubba yeah, I think she was trying to be pretty conservative... let him destroy himself. (or if not Twitter, whatever Kids These Days will be using) Yup... probably also AI Twitter's reaction when that's a debate topic 4 years from now. https://t.co/zitLrTEYeu RT @samsanders: NOT ALL MINORITIES LIVE IN INNER CITIES. NOT ALL MINORITIES LIVE IN INNER CITIES. NOT ALL MINORITIES LIVE IN INNER CITIES.… So, Trump is pro-Assad, and hasn't spoken to his running mate on the issue. Umm RT @TheOnion: Paul Ryan Sitting Among Undecided Voters At Town Hall Debate https://t.co/FEkami8cIm #debate https://t.co/PYiy21Gxs6 RT @NewYorker: The second Presidential #debate: live-drawing by Edward Steed https://t.co/RBp9q35sgT https://t.co/eLNqY8NklS RT @McFaul: Shocking. Reminds me of autocracies I study. Embarrassed this is happening in America https://t.co/ic6FIq17ed "Why did you say that? Visual Explanations from Deep Networks via Gradient-based Localization," Selvaraju et al.: https://t.co/1fpkhgVaUD "Places: An Image Database for Deep Scene Understanding," Zhou et al.: https://t.co/VY2tpjzyVd "Deep Learning with Separable Convolutions," @fchollet, Google: https://t.co/0wD8CSHDwy "Temporal Ensembling for Semi-Supervised Learning," Laine and Aila, NVIDIA: https://t.co/LOGRrHlOJh "A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks," Hendrycks and Gimpel: https://t.co/yv16TbN78W @sknthla happy to evaluate, free of charge :) @sknthla ribs? RT @BuzzFeedBen: NEW: Burnett “is pro-Trump and has made clear to his teams that he will sue anyone who leaks" https://t.co/XoT6VecySi RT @neuroconscience: #Breaking #LiveFootage of tonight's #Debate https://t.co/uUBZ92l3sS RT @billpruitt: As a producer on seasons 1 & 2 of #theapprentice I assure you: when it comes to the #trumptapes there are far worse. #justt… Good to see that he's learned something from all of this... https://t.co/POv6pDqG99 RT @emilcDC: Literally cannot face the nation. https://t.co/fxgmB7cOKE @sknthla just more stages of Trumpageddon. RT @robdelaney: .@SpeakerRyan https://t.co/FVVeWj5NAb RT @SenJohnMcCain: There are no excuses for Donald Trump’s offensive behavior. Cindy & I will not vote for him. My full stmt: https://t.co/… @jrkiros :) RT @AlishaRai: I imagine at the International Candy Con this year the CEO of Skittles and the CEO of Tic Tacs will share a solitary, knowin… RT @prof_jdb: McCain finally rescinds his endorsement. This is a good statement. https://t.co/U7wNDZ0fj4 RT @Olivianuzzi: Hey look, it's a metaphor! https://t.co/lxTfIDVBM9 RT @CNN: #CNNKFILE Exclusive: Donald Trump to Howard Stern: It's okay to call my daughter a "piece of ass” https://t.co/EOih49Euwb https://… @trochee yeah it got me, too. well done fake handle (an I instead of an L in "ReaI") @trochee it's a fake account, sadly. Damn it, I mistook a fake Trump account for a real hacked Trump account. "RT @portmantina: No one should need ""daughters and wives"" to recognize Trump's slime for the misogynist bullshit it is. https://t.co/EB04w…" RT @anildash: First candidate rebuked by both @TicTacUSA & @Skittles. History. RT @Schwarzenegger: As proud as I am to label myself a Republican, there is one label that I hold above all else - American. My full statem… (deplorable b/c lots of ppl use that as a badge of honor/irony/?? on here. Sigh) Dunno about 40% (could imagine a big drop) but def. >>0%. Search "deplorable trump" here. Tons of pp still support. https://t.co/YBEMT6zksM @AnaPopescu_SV "Bill Clinton has actually abused women" ["actually"!!! cuz that's not at all what Trump does regularly]. Twilight zone. @AnaPopescu_SV lol. his apology. "this more than a decade old video" "we're living in the real world" RT @RealRonHoward: Trumps says "Anyone who knows me knows these words don’t reflect who I am,” Sorry but i know people who do know him -it… RT @shakir_za: New blog series. Cognitive Machine Learning: Prologue. An review of cognitive architectures and potential topics. https://t.… RT @mtaibbi: Trump at the debate tomorrow, if his handlers have any sense. https://t.co/crsMkzFQST @Aelkus and in this case, an actual problem for the country... @mattsiegel yeah, I'm reading some of his papers and I've been surprised at how clear they (sometimes) are :) RT @tonyschwartz: Trump's words on women are precisely why I felt compelled to speak out about him. He is a repugnant human being by any st… @RahelJhirad I guess I shouldn't argue with him about math ;-) @RahelJhirad :) @RahelJhirad I'm not counting the title/abstract/TOC/bibliography pages. Also, this PNAS paper!! Note that the "full text" tab is selected, not "abstract." https://t.co/ejZGERBwxJ Nash's 26 page dissertation had 2 citations - von Neumann/Morgenstern, and a paper by himself: https://t.co/MoNIEaYuHC @hardmaru agreed ;) although as @jeffbigham points out, the human data is not documented/explained in the paper, just generic URL... RT @jeffbigham: @Miles_Brundage human performance numbers not described, on a different data set, yep, sounds like an ML paper ... (and could perhaps be better than that) Deep learning is almost twice as good as humans at distinguishing Chinese, Japanese, and Korean faces - Wang et al.: https://t.co/g5gdB96k5q RT @HillaryClinton: This is horrific. We cannot allow this man to become president. https://t.co/RwhW7yeFI2 RT @DeepMindAI: Watch #DeepMind’s @demishassabis give the annual @RAEngNews #autumnlecture on our journey towards general AI: https://t.co/… RT @MikeGrunwald: I would think bragging about sexual assault would be disqualifying, but I thought that about birtherism. https://t.co/x8f… @halhod just saw this earlier! we should chat next time I'm in London... RT @karpathy: Coworker on RL research: "We were supposed to make AI do all the work and we play games but we do all the work and the AI is… (other part of the title: Driving in the Matrix... CC @beaucronin) "Can Virtual Worlds Replace Human-Generated Annotations for Real World Tasks?," Johnson-Roberson et al.: https://t.co/g4MKE2J2RZ "Human Decision-Making under Limited Time," Pedro Ortega @AdaptiveAgents and Alan Stocker: https://t.co/qvozLrWhmo "Understanding intermediate layers using linear classifier probes," Guillaume Alain and Yoshua Bengio: https://t.co/XY5abuu4ET """DeepDGA: Adversarially-Tuned Domain Generation and Detection,"" Anderson et al., Endgame Inc.: https://t.co/9XQAS0puf8" Video: https://t.co/7zECtKlCNT Towards a Drone Cinematographer: Guiding Quadrotor Cameras using Visual Composition Principles," Joubert et al.: https://t.co/C0NYvxlQy4 "Supervision via Competition: Robot Adversaries for Learning Tasks," Pinto et al., CMU/Google Brain/Research: https://t.co/1BpjDjPYLz "Towards Cognitive Exploration through Deep Reinforcement Learning for Mobile Robots," Tai and Liu: https://t.co/Qjz82twtgl "Connecting Generative Adversarial Networks and Actor-Critic Methods," Pfau and @OriolVinyalsML at DeepMind: https://t.co/kIUKoPgFou @nerdsrocket hmmm! Yeah... Michael Bay + procedural + West Wing (yes, we get it, the President's thoughtful :) ). I'm digging ep 3 so far. @egrefen I have the same problem. It's absurd. @nerdsrocket [haven't seen ep 3, though, super excited! about to watch] @nerdsrocket what do you think of the show? I think I like it a lot but it's early. I can't figure out what X is in DS = West Wing + X. @BVLSingler nope. China. @mark_riedl could imagine good reasons for this but feel like broad/general in your senses are (very) correlated? Anyway, good tweetstorm :) @mark_riedl agree with most of this, good to parse it into multiple dimensions/be specific! Not clear why u distinguish tasks/functions tho? @BVLSingler nope, will be out of the country :( hopefully our schedules will align better before too long! @BVLSingler aww :( I'll be in London tomorrow - last chance to get in touch if you wanna meet in the late afternoon :) "Neural Structural Correspondence Learning for Domain Adaptation," Ziser and Reichart: https://t.co/QDuHPgU7YG "Visual Question Answering: Datasets, Algorithms, and Future Challenges," Kafle and Kanan: https://t.co/XdWhixRQrs Nice chart... https://t.co/gtFD3SlP3M "Random Feature Nullification for Adversary Resistant Deep Architecture," Wang et al.: https://t.co/EejcstKjBI """EPOpt: Learning Robust Neural Network Policies Using Model Ensembles,"" Rajeswaran et al.: https://t.co/au4cZ9y1Fr https://t.co/c9HMC5nMZt" "RT @CSERCambridge: CSER's also recruiting for an academic project manager! Please spread the word: https://t.co/XckONIINzv" "RT @CSERCambridge: Call for papers for CSER's first conference! Please spread the word: https://t.co/pt3zL4vbLY" RT @KSoltisAnderson: Ugggggghhhh the canned lines are killing me Pence seems like he'd be a calm, articulate, experienced VP looking politely over Trump's shoulder as Trump starts a nuclear war. #VPdebate "Knowledge Guided Disambiguation for Large-Scale Scene Classification with Multi-Resolution CNNs," Wang et al.: https://t.co/Z8qkm2u3Np "A Non-generative Framework and Convex Relaxations for Unsupervised Learning," Hazan and Ma: https://t.co/NU2H5sEBwL """Embracing data abundance: BookTest Dataset for Reading Comprehension,"" Bajgar et al, IBM: https://t.co/9rSanG8wH0 60x Children's Book Test" And Berkeley/UW/Google Brain more generally, but his name in particular seems to be on an unusual number of interesting papers... Sidenote: Sergey Levine's recent deep RL publication productivity is out of hand. Video (most interesting stuff is near the end): https://t.co/sX3oIfYqAW RT @KaiLashArul: My research group is hiring a deep learning RA on topics of modelling/bioengineering/healthcare. Details here: https://t.c… "Reset-Free Guided Policy Search: Efficient Deep RL with Stochastic Initial States," Montgomery et al.: https://t.co/P4D5bsD7Bh "cleverhans v0.1: an adversarial machine learning library," @goodfellow_ian et al.: https://t.co/pcusP2U8WY "Adaptive Neuron Apoptosis for Accelerating Deep Learning on Large Scale Systems," Siegel et al.: https://t.co/byokCc8RwD "Comparing Human-Centric and Robot-Centric Sampling for Robot Deep Learning from Demonstrations," Laskey et al.: https://t.co/8SP7wlWaws "Is Neural Machine Translation Ready 4 Deployment? A Case Study on 30 Translation Directions," Junczys-Dowmunt et al https://t.co/FQEhO1lZZW RT @jengolbeck: Guys. I can't tell you how frustrating shit like this is. Especially having to deal with comments like this over and over a… RT @danieldewey: Christiano, "Policy Amplification": https://t.co/z7L52CaAay @tonyjprescott I hope note... X is a robot is sort of a cheap way to make the plot interesting (+ Battlestar Galactica did it better :) )... If there were actually a major difference in terms of AI functionality, that'd matter to me, but "built-in" as selling pt. sounds dubious... What is the value added of Pixel having Google Assistant "built-in"? + is the VR good enough? Asking for a friend w/ dying iPhone battery :) @EmmettStream yeah, I should have been more specific. Think it has a lot of potential but certainly not there yet. RT @nalkalchbrenner: 5/5 More videos generated from the #VideoPixelNet showing how the network generalizes to novel objects not seen during… RT @nalkalchbrenner: 4/5 Samples from the VPN on the Robotic Pushing dataset. 18/20 frames are generated https://t.co/MNocWC4flQ RT @nalkalchbrenner: 3/5 On other hand for the Video Pixel Network the generated digits look like this https://t.co/1IS52CY6vP RT @nalkalchbrenner: 2/5 A strong baseline on the Moving MNIST benchmark produces samples like this https://t.co/4y4cATN82H RT @nalkalchbrenner: 1/5 Our latest work on Video Generation https://t.co/smVFpFflZH @journik thought it would be important eventually, improved faster than I expected, though :) Deep RL is eating robotics... Lots of cool papers on arXiv today but you'll probably get the most bang for your buck by reading this covering 4: https://t.co/tTm0xnLKhV @MrMeritology don't think so... OK, done for now... there was an unusual amount of interesting papers today :) "Nonsymbolic Text Representation," Hinrich Schuetze: https://t.co/RW1WqnvYBi "Learning to Translate in Real-time with Neural Machine Translation," Gu et al.: https://t.co/g4anZj3dtR "Funneled Bayesian Optimization for Design, Tuning and Control of Autonomous Systems," Ruben Martinez-Cantin: https://t.co/pk9t2fsR0j "Accelerating Deep Convolutional Networks using low-precision and sparsity," Venkatesh et al., Intel: https://t.co/0mLUmSYrwf "FPGA-Based Low-Power Speech Recognition with Recurrent Neural Networks," Lee et al.: https://t.co/KFJlRHDkAv "much faster than real-time" "Very Deep Convolutional Neural Networks for Robust Speech Recognition," Qian et al.: https://t.co/qKwTpevixO "Very Deep Convolutional Neural Networks for Raw Waveforms," Dai et al.: https://t.co/tpTGQAECBq "Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction," Zhang et al.: https://t.co/H3HfJ1qpxE "Vocabulary Selection Strategies for Neural Machine Translation," L'Hostis et al.: https://t.co/yizA0dtYiH "Deep unsupervised learning through spatial contrasting," Hoffer et al.: https://t.co/uaK0iBJzcq "Deep Feature Consistent Variational Autoencoder," Hou et al.: https://t.co/X3RwEI1jtH https://t.co/tLcqOV9lfJ "X-CNN: Cross-modal Convolutional Neural Networks for Sparse Datasets," Velickovic et al.: https://t.co/1D6BFgdn5d Network of networks... "Video Pixel Networks," @nalkalchbrenner et al. at DeepMind: https://t.co/ccJrLizu5m RT @googleresearch: The Google Brain team, DeepMind and X discuss research towards general-purpose skill learning across multiple robots ht… "Path Integral Guided Policy Search," Chebotar et al.: https://t.co/pSRpEHtV3q "Deep Visual Foresight for Planning Robot Motion," Finn and Levine: https://t.co/cvPO3Lj2Um "Collective Robot Reinforcement Learning with Distributed Asynchronous Guided Policy Search," Yahya et al.: https://t.co/O36sfVwTSv "Deep Reinforcement Learning for Robotic Manipulation," Gu et al.: https://t.co/DuwqhCx2Re asynch w/ multiple robots https://t.co/YIySaDOfk8 RT @rivatez: Analysis of the current state of deep learning for industry by Permutation Ventures' Geoff Bradway @GarrulousGeoff https://t.c… RT @mat_kelcey: baylearn "filled the 310 attendee spots in just 70 minutes" !!! https://t.co/0pRzjHps41 @sknthla "how many people"... = Trump? https://t.co/RH7KH5HFlE @smc90 made perfect sense to me :) "RT @realDonaldTrump: HALF of Americans don't pay income tax despite crippling govt debt... http://t.co/gDAUj0Kt" @Aelkus looks cool, thanks! will check out. @Aelkus yeah... this doesn't fully answer that but I found it one of more interesting recent reads on BR: https://t.co/sbUk93SX9p If it turns out to be simple at a given compute level, you could make the metacognitive aspects interesting again by slowing down one of em. Do you think a bit more about your next move, or make sure you don't knock over the chess piece and forfeit? Competition: chess robots w/ equal compute must decide how much to allocate to perception/manipulation vs. strategy. https://t.co/mFunwwa8Vm "Game theory textbook authors reach a mixed strategy Nash equilibrium* on personal pronouns. From Osborne and Rubinstein (1994). *kind of.. https://t.co/ZLzWKxc56o" @beaucronin ...and could easily have been caught. Like, did no one object to keeping that love rant in there? Anyway, back to enjoying it :) @beaucronin oh, for sure. I'm more than capable of that (see: liking Caprica) :) But Interstellar annoys me b/c the badness is so localized. "RT @Smerity: Google on the dataset warpath this week! Open Imgs (9e6): https://t.co/xTHAL1opoJ YouTube 8-M (8e6 vid, 0.5e6 hr): https://t.c…" Interstellar minus a few lines = amazing movie. There should be a director's cut/special edition. @Aelkus Beamghazi @rbhar90 that would be great! Have seen lots of academic papers on low-data languages but not aware of big push at corps. Hope so... It wasn't perfect and there may be some issues with it I'm unaware of, but it's night and day versus last time I used it for real years ago. RT @eturner303: "Cost to reproduce experiments" in deep learning keeps trending up.. Over $13,000 of GPU time for a recent Google paper, pe… (Chinese->English is one of the language pairs for which the GNMT system has been rolled out) Man, just had a practical use of Google Translate for Chinese>English and it was super understandable. Don't think that was the case before. RT @fchollet: Google releases the Open Images dataset, a strong alternative to ImageNet --larger-scale, with a better class set: https://t.… @mark_riedl they'll add a tagline: "robot squeezes child to death" @rndbert I mean not headquartered/founded in the US. @alexismadrigal why don't I just come see it right now? Or yesterday? "Learning Sentence Representation with Guidance of Human Attention," Wang et al.: https://t.co/dKYdeRalEP "Contextual RNN-GANs for Abstract Reasoning Diagram Generation," Ghosh et al.: https://t.co/PKPOfo1yXP "Deep Tracking on the Move: Learning to Track the World from a Moving Vehicle using RNNs," Dequaire et al.: https://t.co/xAJkrbWz4E Code etc.: https://t.co/gL9SfkunyS "Multi-view Self-supervised Deep Learning for 6D Pose Estimation in the Amazon Picking Challenge," Zeng et al.: https://t.co/2tOqRZdyFV Video: https://t.co/YxP0SAtxqU "CNN Architectures for Large-Scale Audio Classification," Hershey et al. at Google (using Youtube-100M): https://t.co/oznLEdijTG "Cooperative Training of Descriptor and Generator Networks," Xie et al.: https://t.co/3rv5snLce7 https://t.co/GJDMYC95ME "Semantic Parsing with Semi-Supervised Sequential Autoencoders," Kocisky et al. at DeepMind/Oxford: https://t.co/LVjyCnsnLY @hardmaru nice MIB reference :) RT @hardmaru: My paper on [1609.09106] HyperNetworks is out. I wrote a new blog post about it, and released the HyperLSTM code. https://t.c… Another AI/robotics show - Girl 10: https://t.co/BMMrU3K5i5 Would be more excited about show where robots don't look human :) @samim (lobbyists, I mean, slash policy focused ppl, not nec. lobbyists per se... dunno if/how they contract to PR companies vs. in house) @samim who's "they"? PAI? I assume they don't have any, just started. But the companies have tons in both :) @samim (what that'll look like/if it'll be sufficient is TBD...but at least discussed, whereas absence of e.g. Baidu, Toyota is conspicuous) @samim yeah, for sure! I highlighted the Western thing, though, b/c haven't heard mentioned, + PAI promised non-corp membership/engagement. Gotta start somewhere, so not really knocking the PAI for this - seems like great start. But long-term, global participation seems very key. One thing that'd be really good to see in the Partnership on AI (https://t.co/LpWpdabAG9): non-Western companies. Thinking Baidu, Toyota... @rivatez you going to be around next week? I'll be in London next Fri... RT @erichorvitz: Microsoft to focus even more intensively on AI. https://t.co/Dz2rcXiE4c "Learning Genomic Representations to Predict Clinical Outcomes in Cancer," Yousefi et al.: https://t.co/zwFOf2GYB4 "Task Specific Adversarial Cost Function," Creswell and Bharath: https://t.co/iCfBJTSrGx "Hierarchical Memory Networks for Answer Selection on Unknown Words," Xu et al.: https://t.co/NS5LRG33iA "Unsupervised Neural Hidden Markov Models," Tran et al.: https://t.co/S1JnUYi229 " Statistical comparison of classifiers through Bayesian hierarchical modelling," Corani et al.: https://t.co/kpID9mbY4X "Optimizing Neural Network Hyperparameters with Gaussian Processes for Dialog Act Classification," Dernoncourt/Lee: https://t.co/7rm6mWtUK5 50 years of video - "YouTube-8M: A Large-Scale Video Classification Benchmark," Abu-El-Haija et al. at Google: https://t.co/wXADdWnjF8 https://t.co/7hxGDcvcF9 (the no free lunch theorem, that is) Extending the NFL theorem: "The Famine of Forte: Few Search Problems Greatly Favor Your Algorithm," George Montañez: https://t.co/XdWC9ZRIEs "Learning from the Hindsight Plan -- Episodic MPC Improvement," Tamar et al.: https://t.co/Cn4qPSEwpx Long title - TL;DR, neural SLAM, Kanitschneider/Fiete: https://t.co/Ldetisc6HF "Deep Reinforcement Learning for Tensegrity Robot Locomotion," Geng, Zhang, and Bruce et al: https://t.co/tv22C5LerU https://t.co/vzlXsBJfqE "Deep Reinforcement Learning for Mention-Ranking Coreference Models," Clark and Manning: https://t.co/vFJi3dwUvs RT @ShaneLegg: This is a truly wonderful step forward for artificial intelligence. Long live the Partnership on AI and may it stay true to… @mikarv starting early, not sure when leaving. Booked through ~2:30ish, so departure depends who wants to meet (would be great to see you!). London people - I'll be there next Friday, let me know if you want to meet up and chat :) RT @rao2z: AAAI applauds the launch of Partnership on AI, and looks forward to working with it https://t.co/nyYYnqurs1 #pai #aaai #ai http… RT @ylecun: Facebook CTO Mike Schroepfer comments on the Partnership on AI announcement. https://t.co/fcWA4tKzS3 @mustafasuleymn congrats! @alexjc @davegershgorn They (partnership) said there'd be = representation of non-corporate partners. So perhaps actually just looking fwd. RT @demishassabis: A very important step towards the ethical and responsible use of AI for the benefit of everyone #PAI https://t.co/zAU3KH… RT @mustafasuleymn: 1/4 Very proud to announce the ‘Partnership on Artificial Intelligence to Benefit People and Society’ https://t.co/JXk0… RT @erichorvitz: Announcing the Partnership on AI to Benefit People and Society https://t.co/XK8TZDxKP9 @MSFTResearch #AI #PAI @mark_riedl @rcalo either way, seems like it prob. wouldn't go super well in near term before good understanding of what good policies are. @mark_riedl @rcalo (thinking esp. of researcher/policymaker animosity). If "general/broad AI," would depend, maybe cause ppl to rebrand... @mark_riedl @rcalo if one were using Bostrom's definition, then not applicable to existing systems, but maybe bad indirect effects... RT @jimmfleming: Notes on Hierarchical Multiscale Recurrent Neural Networks https://t.co/bh1pfnfxoU #deeplearning #machinelearning #nlp htt… RT @fchollet: Google releases YouTube-8M, a labelled dataset of visual features extracted from the frames of 8M YouTube videos: https://t.c… RT @tonyschwartz: 1986 memo I wrote re: Art of the Deal. Trump couldn't focus for interviews. Can't focus now for debate prep https://t.co/… "Nonnegative autoencoder with simplified random neural network," Yin and Gelenbe: https://t.co/kKDciimVqA "emoji2vec: Learning Emoji Representations from their Description," Eisner et al.: https://t.co/AucfRZ0rkS https://t.co/E26cznqdeM "Asynchronous Stochastic Gradient Descent with Delay Compensation for Distributed Deep Learning," Zheng et al.: https://t.co/Rw7pHTZUmP "Online Segment to Segment Neural Transduction," Yu et al., Oxford/DeepMind: https://t.co/jCOtlveTwA By folks at ASU & IBM - interesting idea... demo: https://t.co/omFElXgHtk "UbuntuWorld 1.0 LTS: A Platform 4 Automated Problem Solving & Troubleshooting in the Ubuntu OS," Chakraborti et al. https://t.co/S8KOdomRLf @yoavgo got one :) Google Translate now using neural machine translation for Chinese->English...just in time for my trip next month! :) https://t.co/e4pSpZxzEc "They." https://t.co/odTYOyqIur "It's a little cold, but we can warm it up." @elonmusk's Mars talk: https://t.co/frlpVn6hOt @yoavgo not that surprising, just notable that human-ish level is attainable with existing algos. But yeah, more analysis would be great.. @yoavgo the non-interestingness is what I find interesting about it :) i.e. impact of data/processing scale... but I'm not an NLP person RT @hardmaru: @hardmaru "On WMT En->Fr, it takes around 6 days to train a basic model using 96 NVIDIA K80 GPUs." 16 big layers... https://t.co/rrMMtx0cD4 Anyway, TL;DR of that paper/my discussion of it: Google Translate will get a lot better soon. Estimate based on French-English corpus for WMT being >2 GB, Google paper saying own corpora ~2-3 orders of mag bigger. (which would therefore be in the ballpark of terabytes of data, right, MT people?) ...and there's improvement on public benchmarks. But more interesting (though harder to eval) is gains from 2-3 order of mag bigger corpus. So, a few interesting things are going on here. One is a bunch of fancy NN stuff being integrated...another is TPU inference speed gains... @AnaPopescu_SV yup. OK, the debate's over, let's go back to being impressed by this. https://t.co/g12jyZKCxc RT @JanookOnline: Wowzers. c/o @FiveThirtyEight https://t.co/NpaI36Kz3L Nothing like Twitter dot com to remind you that there's more to the world than presidential debates, like Jumanji plots. https://t.co/Zk7SWQrkwZ The nuclear and the cyber. LMAO at the temperament thing. RT @abuaardvark: Trump's "take Iraq's oil" is still the stupidest foreign policy idea ever. https://t.co/daMZUkXfGH RT @ScienceClau: "Do you know what else I have prepared for? I have prepared to be president" - #HillaryClinton BOOM! #debates #debatenight… NVM, the moderator changed the hyperparameters... Clinton LSTM and Trump LSTM are both outputting low temperature text... "Distilling an Ensemble of Greedy Dependency Parsers into One MST Parser," Kuncoro et al.: https://t.co/f7P1YwX8qp "Creating Causal Embeddings for Question Answering with Minimal Supervision," Sharp et al.: https://t.co/GD2PCuogHK "Dropout with Expectation-linear Regularization," Ma et al.: https://t.co/1vuXwbcXRt "Decentralized Non-communicating Multiagent Collision Avoidance with Deep Reinforcement Learning," Chen et al.: https://t.co/zhD2g3AoWf "Multiplicative LSTM for sequence modelling," Krause et al.: https://t.co/N8W3RgxK5u Big improvement on Hutter prize... "Pointer Sentinel Mixture Models," @Smerity et al. at Salesforce/MetaMind: https://t.co/mKGvvZ9sXG @sknthla (sorry, unhelpful) @sknthla but debate!! "we show that our GNMT system approaches the accuracy achieved by average bilingual human translators on some of our test sets." "Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation," Wu et al.: https://t.co/MeYSco2t0m RT @dennybritz: Bored and have 20 hours to spare? Two days worth of video from the Bay Area Deep Learning School: https://t.co/FZIXoN2TfG RT @ylecun: FAIR is releasing a software framework for experimentation and testing of "communication-based AI", as described... https://t.c… RT @nycsouthpaw: Just posting these together so future gender studies professors don't have to go looking for separate tweets. https://t.co… RT @davidehrlich: tonight, we are pretty much sending Hillary Clinton to drill into a giant asteroid & nuke it from the inside before it ca… RT @HMRoff: Want to know what functions a weapon can do by itself? The check out the first dataset on it : https://t.co/xqCPfZba6U ...including Chinese U. of Hong Kong, SenseTime (deep learning company), and The 3rd Research Institute of the Ministry of Public Security. Strong showings from Chinese universities and government on the ImageNet competition... RT @notmisha: @notmisha We are getting close to label-noise-level on classification. What is the next big challenge? We need a post-ImageNe… RT @notmisha: ImageNet ILSVRC results are out https://t.co/Ms3ApmwzNm RT @boredyannlecun: Tonight's debate promises to be a nail-biter. Like Muhammad Ali vs. a salamander. Or a ConvNet vs a kernel machine #tor… RT @HMRoff: Today's the day! The autonomy in weapons systems dataset is out! See https://t.co/xqCPfZba6U. @peterwsinger @NewAmerica @DefTec… Happy Petrov Day! https://t.co/Xpg2KAi3iq TFW you realize the movies Lost in Space and Interstellar have super similar plots... This sounds way more stressful than a "normal" (English) auction...alas, stress is not a variable analyzed by game theorists (from GT MOOC). https://t.co/oUQ2uiV6Yx "On the (im)possibility of fairness [in ML]," Friedler et al.: https://t.co/1IWP2fbhd3 Good sentence compression results... https://t.co/23036X736n "Attend, Adapt and Transfer: Attentive Deep Architecture for Adaptive Transfer..." Rajendran et al. (v2): https://t.co/7G8HOifSbl RT @HMRoff: In just war theory sometimes we're faced with two bad outcomes. It's a lesser evil. You are obligated to choose the lesser. Vot… "Language as a Latent Variable: Discrete Generative Models for Sentence Compression," Miao/Blunsom, Oxford/DeepMind https://t.co/Ide8CskVRF "Input Convex Neural Networks," Amos et al.: https://t.co/dGgcne4Izb Nice results on continuous RL in Gym... RT @mark_riedl: The rise of the lightbulbs https://t.co/oZMVHekaIg @sknthla can't tell how serious you are about this... RT @GideonResnick: "We believe Mr. Trump to be the worst nominee put forward by a major party in modern American history." https://t.co/7zC… So, who won ILSVRC2016? @fchollet I've interpreted stuff like this (https://t.co/nBaTLui0Dx) as the similarity glass being half full, but not v familiar w/ BCI lit. @fchollet other things you mention do differ a lot tho... @fchollet brain anatomy is pretty similar for most people - we can e.g. guess what someone's looking at based on similar EEGs from others... @AnaPopescu_SV lol. v. sketchy... @deliprao @AnaPopescu_SV so innovative... @deliprao @AnaPopescu_SV he supports "fresh ideas on how to communicate with young voters" like this: https://t.co/V3Z8adJQ3K @AnaPopescu_SV ah, thanks... doesn't sound like much outrage was wasted considering he did donate to that shitty group, though :) @AnaPopescu_SV huh, I thought he confirmed he was in the first article on this? Link? @AliMattu if you have time, go here: https://t.co/lj6wB9Vl7F! Worth paying extra to pet the wallabies and coatimundis (especially latter). @rcalo one of only a few times I've walked out of movies... RT @timhwang: New paper on bias in consumer ratings - awesome getting the chance to work w @mawnikr @karen_ec_levy @s010n on this: https://… @davegershgorn spoiler: deep learning something something did well. Why not just sell whole houses? You could call the company Westinghouse... https://t.co/ieFAGT7nR9 RT @SuryaGanguli: Our new #NIPS2016 paper: doing Bayesian integrals in high dimensions by solving an optimization problem https://t.co/9nSP… @davegershgorn 5 yrs I think? but yeah, still a while, fair point, we'll see... @davegershgorn that's just in terms of AI expertise, maybe "no idea" in sense of product. Though not sure anyone has v. great ideas there :) @davegershgorn think I prob just disagreed w/ the "no idea" thing - def. one of the more idea-rich startups...Bengio/Sutton etc involved. @davegershgorn yeah, maybe overhyped here/implausible marketing (I also questioned the hype over their children's book thing a while back).. @davegershgorn ...these days for AI acquihires (which, along w failure, is my presumed endgame for most AI startups )https://t.co/XghKKKn4IA @davegershgorn Maluuba is one of the few startups that actually publishes regularly and has a qualified team, though. +product can be bad... RT @HMRoff: Stay tuned folks! T minus 7 days to the launch of the first dataset on autonomy in weapons systems! Going live on 9/26 @asu_gsi Nope nope nope nope. https://t.co/rLQoTrYxtu @katherinebailey AIntrovert :) RT @qhardy: Well, it does take the pressure off deciding whether or not to buy an oculus headset. RT @CodyBrown: This is a message from @PalmerLuckey, the founder of @Oculus. https://t.co/CWlAA8ugMx *Devin and Gupta et al. @davegershgorn yeah, certainly not the first such thing but seems like progress in the direction of making it scale... Video: https://t.co/ivWvJh2Xh2 RT @anildash: One reason every political hashtag on Twitter is filled with racist trolls? The founder of Oculus is funding them: https://t.… "This allows for sharing task info., such as perception, btwn robots and sharing robot info., such as dynamics and kinematics, btwn tasks." "Semiring Programming: A Framework for Search, Inference and Learning," Belle and De Raedt: https://t.co/D43HaG8RdJ Looks like a good review - "Deep Learning for Video Classification and Captioning," Wu et al.: https://t.co/p6nHjxCb0I "A Fully Convolutional Neural Network for Speech Enhancement," Park and Lee: https://t.co/cIl9LWX2Fu Relevant to hearing aids. Related stuff from some of the same folks: "KR via Joint Learning of Sequential Text and Knowledge Graphs, Wu et al: https://t.co/n8WndaI5AM "Quantized Neural Networks: Training Neural Networks with Low Precision Weights and Activations," Hubara et al.: https://t.co/ZYgG5dWmpT Really interesting idea - "Image-embodied Knowledge Representation Learning," Xie et al.: https://t.co/b56WcbAWAe @beaucronin reading about a plastic dinosaur's mouth on Twitter, much more exciting. [selection bias] "Neural Photo Editing with Introspective Adversarial Networks," Brock et al.: https://t.co/MHterAkbh9 "Learning Modular Neural Network Policies for Multi-Task and Multi-Robot Transfer," Devin et al.: https://t.co/IPufr0XUXb "RT @soumithchintala: Congrats to my colleages at FAIR for winning the VizDoom competition: https://t.co/ZXmIstUkj0" @beaucronin not sure there's one metric/answer? AR could impact nature of interaction w/ PW, VR decrease time spent on said interaction... I'm perhaps biased b/c I find game theory interesting and v. relevant to current work, but others have said they found it really good, too. One of the best MOOCs I've seen. Lots of good material well explained + speakers change so doesn't get too boring :) https://t.co/ZJvDvDL0bW @mark_riedl probably some efficient approximations :) RT @mustafasuleymn: Embedding patients at the heart of DeepMind Health. Our new blog post: https://t.co/1p5qSjAlDw "You work for the vice president; it's not like you work for Google..." - Veep RT @maosbot: Can you help get more machine learning into economics? Interested in the future of work? Apply for this 2yr PDRA: https://t.co… @rbhar90 (that said, I'm not convinced that one couldn't get good performance w/o the features, might just take longer) @rbhar90 yeah, saw the game features thing, thought it was interesting that it worked well at test w/o them, though. And ya DQN doesn't use. "Recognizing Implicit Discourse Relations via Repeated Reading: Neural Networks with Multi-Level Attention," Liu/Li https://t.co/D62RrtQKIN "PixelNet: Towards a General Pixel-level Architecture," Bansal et al.: https://t.co/2c3rwa25fO "SoftTarget Regularization: An Effective Technique to Reduce Over-Fitting in Neural Networks," Armen Aghajanyan: https://t.co/nZHEXKRHvZ "Character-level + Multi-channel Convolutional Neural Networks for Large-scale Authorship Attribution," Ruder et al. https://t.co/OPyirJ4qSu "Vote3Deep: Fast Object Detection in 3D Point Clouds Using Efficient Convolutional Neural Networks," Engelcke et al https://t.co/Imz9rYUHzv "The Color of the Cat is Gray: 1 Million Full-Sentences Visual Question Answering (FSVQA)," Shin et al.: https://t.co/hTwOqgXadX "Minimally Supervised Written-to-Spoken Text Normalization," Wu et al., Google: https://t.co/rxQh9HFDpo "Show and Tell: Lessons learned from the 2015 MSCOCO Image Captioning Challenge," @OriolVinyalsML et al.: https://t.co/qS1pdPPLrr "Large-Scale Strategic Games and Adversarial Machine Learning," Alpcan et al.: https://t.co/CwIgBqJZo3 "One Sentence One Model for Neural Machine Translation," Li et al.: https://t.co/cozJL89dLT (from NVIDIA/Remedy Entertainment, makers of Max Payne etc.) "Facial Performance Capture with Deep Neural Networks," Laine et al.: https://t.co/8Vy2VLs92E 10 mins good video suffices to make 3D double. In case you were having too good of a day - article on what Trump would/could actually do in office: https://t.co/j6ADd5HPAz Also AI and OR for social good... Some other very interesting ones, as well - diversity in AI, cybersecurity, human-aware AI, games, etc. Workshops for AAAI 2017 in SF: https://t.co/FH2i0cPim9 I'm on the committee for the ethics and society one - you should submit cool stuff :) "RT @KevinWGlass: West Wing: what insiders pretend politics is House of Cards:what America thinks it is VEEP: what DC is actually like https…" "Interview with Google's New Digital Assistant," with Qs from @etzioni et al... not human-level obv but not too bad: https://t.co/84dePMXqrE "Option Discovery in Hierarchical Reinforcement Learning using Spatio-Temporal Clustering," Lakshminarayanan et al.: https://t.co/Q9Uej4EZ1z @elonmusk great feature! "Balancing Suspense + Surprise: Timely Decision Making with Endogenous Information Acquisition," Alaa/van der Schaar https://t.co/2U1llw5356 "A Credit Assignment Compiler for Joint Prediction," Chang et al. (NIPS 2016): https://t.co/dporaOsXmx "Variational Autoencoder for Deep Learning of Images, Labels and Captions," Pu et al. (NIPS 2016): https://t.co/sGP1dpQL4c @etzioni FYI response rates/phrasing of Qs in Bostrom/Mueller poll can be found here here: https://t.co/v6Ueq5qQWL @jackclarkSF @davegershgorn (or at least such tasks were mentioned in coverage of it - haven't looked at code/documentation carefully)... @jackclarkSF @davegershgorn some of the tasks in Malmo are cooperative. et al.'s Google Scholar page :) https://t.co/VLZqHAb3MO "Multilevel Monte Carlo for Scalable Bayesian Computations," Giles et al.: https://t.co/CAUPvcuoP0 "Advances in All-Neural Speech Recognition," Zweig et al.: https://t.co/AIP9huBTRy "Enhancing and Combining Sequential and Tree LSTM for Natural Language Inference," Chen et al.: https://t.co/uuaDJUNyQK "Learning Robust Representations of Text," Li et al.: https://t.co/eDgPfbCcSx An @elonmusk-oriented metal band named @RaptorCommand. Perfect. h/t @Liv_Boeree https://t.co/ib3bBh3VPP @Liv_Boeree omg this is perfect. Thanks for sharing :) Some nice made up words: cowtuple, fatzbacker, ventalence, "twistic" (with the quotation marks), tednall, franduction, baint, melous... Some Negative NNcy results - RNN trained on negative IMDB reviews at 0/400/1100 epochs. They grow up so fast (actually, this took a while). https://t.co/oFftArHD1Q @_jyan_ I suspect they probably could/did, but not the best PR :) From abstract (haven't read whole thing yet but sounds pretty wild): https://t.co/6JfiWviMw2 RT @mark_riedl: Now AI beats us with deep reinforcement learning. And we still say nothing because… damn playing games with pixel level inp… RT @mark_riedl: Then AI beat us with production systems (Soar). But we said nothing because they needed to use a special API. RT @mark_riedl: First, AI beat us with finite state machines. But we said nothing because FSMs don’t scale. SeqGAN = ~ adversarial networks plus MCTS. RL's so hot right now... https://t.co/HGoPtTGrNU Still pushing past (approaching?) the hypothesized ceiling - ReasoNet at 74.7/76.6.https://t.co/9VFYFIvfpa https://t.co/q3w5trb1GO Comparison to humans. Using deep recurrent Q-networks (Hausknecht/Stone) + some other stuff (e.g. game features for training but not test). https://t.co/mDxaIM9NFn Pretty impressive play in VizDoom, Full Deathmatch: https://t.co/ZRccIKmCh5 "Enabling Dark Energy Science with Deep Generative Models of Galaxy Images," Ravanbakhsh et al.: https://t.co/eumrTfyIr9 "Principled Option Learning in Markov Decision Processes," Fox et al.: https://t.co/Vk8nbPfo0O "Label-Free Supervision of Neural Networks with Physics and Domain Knowledge," Stewart and Ermon: https://t.co/I9o3C8IU0f "Inherent Trade-Offs in the Fair Determination of Risk Scores," Kleinberg et al.: https://t.co/gbQ07dbaLB "Playing FPS Games with Deep Reinforcement Learning," Lample and Chaplot: https://t.co/vg5r6tCTgl "SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient," Yu et al.: https://t.co/9LXrP75uFK "ReasoNet: Learning to Stop Reading in Machine Comprehension," Shen et al.: https://t.co/9VFYFIvfpa "Towards Deep Symbolic Reinforcement Learning," Garnelo, @KaiLashArul, and @mpshanahan: https://t.co/oxhWLIcEBa Why didn't anyone tell me In the Loop is a spinoff of a show... is The Thick of It good? RT @maosbot: Come and work with me on machine learning for renewable energy (predicting solar PV): apply for a postdoc job here https://t.c… """Emmys 2016: Tatiana Maslany wins for Orphan Black (finally)"" - indeed! She's amazing. https://t.co/kWyshEzts2" @nerdsrocket did she?? 👍 (don't know who she was against but she's awesome) "On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima," Keskar et al. at Intel: https://t.co/1xqI6vccuz Uses NYT coverage as data - some interesting findings! "Long-Term Trends in the Public Perception of Artificial Intelligence," @unignorant and @erichorvitz: https://t.co/XQKVpmbEfu "SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networks," McCormac et al.: https://t.co/BpwhQQ1ahb "No-Regret Replanning under Uncertainty," Sun et al.: https://t.co/Sqbl5h0LEn "Gradient Descent Learns Linear Dynamical Systems," @mrtz et al. at Google: https://t.co/CI9mHIcLxy """Target-driven Visual Navigation in Indoor Scenes using Deep RL,"" Zhu et al. at AI2, etc.: https://t.co/r9mCzUFlLa https://t.co/NuthplBVPd" "The Option-Critic Architecture," Bacon et al. at McGill: https://t.co/xmgau9o7Oi "Exploration Potential," Jan Leike, colleague at @FHIOxford: https://t.co/ukgn8Tqws0 measure of how much RL agent has explored enviro class. @Aelkus what sorts of predictions are you talking about? @beaucronin but cognitive. Lots of interesting content here - "Accountable Algorithms," Kroll et al.: https://t.co/0EV3prIbxC RT @elonmusk: Turns out MCT can go well beyond Mars, so will need a new name… (from the same folks as this also good book: https://t.co/Isaw1fvwr7) Good MOOCs on game theory: https://t.co/B1UrrMrGKV "Sampling Generative Networks: Notes on a Few Effective Techniques," @dribnet: https://t.co/JVMuMDburo "Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network," Ledig et al. at Twitter: https://t.co/E8yxL1InSL "The Relationship of AI to Other Disciplines": https://t.co/Mo5szK7p7g TL;DR, AI is related to everything/vice versa ;) RT @fchollet: The state of the deep learning frameworks landscape, September 2016. Keras 2nd fastest growing framework after TF. https://t.… @davegershgorn @jackclarkSF it's a log graph, though...? "Neural Machine Translation with Supervised Attention," Liu et al.: https://t.co/dcfdJ7iZwt "Gray-box inference for structured Gaussian process models," Galliani et al.: https://t.co/mcH5AlmMF3 "3D Face Reconstruction by Learning from Synthetic Data," Richardson et al.: https://t.co/69iH0tR4OJ https://t.co/SMorFEI0gi "Relativistic Monte Carlo," Lu et al.: https://t.co/AhDp7h0c8L "Formalizing Neurath's Ship: Approximate Algorithms for Online Causal Learning," Bramley et al.: https://t.co/3Jk0jKqtdA "Convolutional Recurrent Neural Networks for Music Classification," Choi et al.: https://t.co/lOCfGhPkjN "Efficient softmax approximation for GPUs," Grave et al. at Facebook: https://t.co/QFEcxDPt0b "Even Good Bots Fight," Tsvetkova et al.: https://t.co/f2gmBX123Z [on Wikipedia bots' dynamics] @mark_riedl (probably not, though. I look forward to it, too!) @mark_riedl if it's like the Facebook/Fair vs. Google/DeepMind Go wars, then in a few days DM will announce AlphaCraft beat Euro SC champ... (lots of reports like this - flashy high level findings, super expensive/paywalled, impossible to evaluate) Hopefully robots will also make people rich enough to afford Forrester's $499 reports on such issues. https://t.co/aqtYYcWZrS RT @schneierblog: Someone Is Learning How to Take Down the Internet: Over the past year or two, someone has been probing the de... https://… "Joint Extraction of Events and Entities within a Document Context," Yang and @tommmitchell : https://t.co/pY3SuURpcO "Making Neural Networks Robust to Label Noise: a Loss Correction Approach," Patrini et al.: https://t.co/TdK0cxvZpM "An Experimental Study of LSTM Encoder-Decoder Model for Text Simplification," Wang et al.: https://t.co/6TE07D9eQi "Character-Level Language Modeling with Hierarchical Recurrent Neural Networks," Hwang and Sung: https://t.co/970xVO2Atb "Towards Deep Compositional Networks," Tabernik et al.: https://t.co/hBdEHXb7tZ "Associating Grasping with Convolutional Neural Network Features," Ku et al.: https://t.co/AkMHJLXTny "3D Simulation for Robot Arm Control with Deep Q-Learning," James and Johns: https://t.co/vcHzaAl395 @mark_riedl I consulted some AIs and got "a person riding a horse on a beach" and "a man with a dog on the beach." "RT @soumithchintala: Our first Starcraft paper is out :) ""Episodic Exploration for Deep Deterministic Policies"" https://t.co/90NgCpQm4J" @MIRIBerkeley OK - that quote isn't in the blog post or paper, so assumed it was a typo (word "finance" is in paper once, though). @MIRIBerkeley "financial"? * Usunier and @syhw (equal first authors). "An architecture for ethical robots," Vanderelst and @alan_winfield: https://t.co/ps6U6DwYRy "Knowledge as a Teacher: Knowledge-Guided Structural Attention Networks," Chen et al.: https://t.co/COwPFVzD40 "DESPOT: Online POMDP Planning with Regularization," Ye et al.: https://t.co/TbLFmjA3yN deployed in autonomous vehicles "Style-Transfer via Texture-Synthesis," Elad and Milanfar, Google Research: https://t.co/iQIuemsXjZ "Generative Visual Manipulation on the Natural Image Manifold," Zhu et al.: https://t.co/tLxCMhUCOM https://t.co/ivfoweU5OP "Guided Policy Search with Delayed Senor Measurements," Schenk+Fox: https://t.co/Y88tNJMhVk "human-level" pouring, "sufficient" for cooking "Less than a Single Pass: Stochastically Controlled Stochastic Gradient Method," Lei and Jordan: https://t.co/H7Kp0Su3GL "The Microsoft 2016 Conversational Speech Recognition System," Xiong et al.: https://t.co/4tv9YPXrrT "Energy-based Generative Adversarial Network," Zhao et al., NYU/Facebook: https://t.co/AePBx5gwwl "Wav2Letter: an End-to-End ConvNet-based Speech Recognition System," Collobert et al., Facebook: https://t.co/Og1pctPGgT "Logical Induction," Garrabrant et al. at MIRI: https://t.co/hfVsRkJQZg "Stealing Machine Learning Models via Prediction APIs," Tramèr et al.: https://t.co/f36JVwoU3t "Episodic Explo. 4 Deep Determ. Policies: An Application to StarCraft Micromanagement Tasks," Usunier et al,Facebook https://t.co/hBgWsQGBMb @jeffbigham what do you mean, "often strategic"? @girlziplocked yup RT @tdietterich: Without care, #MachineLearning is confirmation bias on steroids https://t.co/H68LBHeFch AlphaGo vs. AlphaGo commentary is interesting. https://t.co/biPFKAA8Nf https://t.co/5BUnmNqP9x RT @demishassabis: 2/2 Also for the first time ever we've published some fascinating #AlphaGo vs AlphaGo games w/ expert commentaries! http… RT @demishassabis: 1/2 Check out our special commentaries on the Lee Sedol vs #AlphaGo matches by Fan Hui, Gu Li 9p & Zhou Ruiyang 9p: http… @mark_riedl clickbait version: System uses decades-old algorithm. You won't believe what always happens next. Eventually. @mark_riedl yeah - and it actually looks super useful. @pmarca negligible relative to other things that will change in next 34 years... @Aelkus I suppose running the CPU hard does add some to the power bill, prob not too much tho. Think your rig is more ;) @Aelkus the Atari thing? that's just data from an existing paper :) I'm doing some unrelated RNN language stuff but just CPU TL;DR, it's gotten more efficient to train Atari AIs, in terms of computing time. Not same as *game* time, but case could be made there too. Still would've been big if treated CPUs + GPUs as the same (35% more pts in half the time). Also, I did A3C LSTM instead of FF (4 days v 1). Using the data from the asynchronous deep RL paper: https://t.co/jzQWxAzo1q Hopefully that made sense. The 5x conversation ratio was just a ballpark, not crucial to the point, which is that asynch. RL was a big gain. % pts of mean score on Atari games per architecture-adjusted (GPU=5x CPU) day of training time in 5 DeepMind papers. https://t.co/psd8KXbtrz "Semi-Supervised Classification with Graph Convolutional Networks," Kipf and Welling: https://t.co/R3xe8Kye14 "By-passing the Kohn-Sham equations with machine learning," Brockherde et al.: https://t.co/NwMEFBiY9a """Generating Videos with Scene Dynamics,"" Vondrick et al.: https://t.co/gCN0PGXDAm https://t.co/vEcFGTRT3w" "Machine Learning with Guarantees using Descriptive Complexity and SMT Solvers," Jordan and Kaiser: https://t.co/9IJRM9a9vg "Dialogue manager domain adaptation using Gaussian process reinforcement learning," Gasic et al.: https://t.co/NcEXLhVvU3 RT @katecrawford: Artificial Intelligence is Hard To See: Meredith Whittaker & me on why the FB story points to a harder problem. https://… RT @TeslaMotors: Upgrading Autopilot: seeing the world in radar https://t.co/WqJfyqpDXL RT @boredyannlecun: Despite this loss, Serena will go down in history with Roger Federer, Michael Jordan, and AlexNet, as champions #feelth… @FrankPasquale cf. https://t.co/pyFppTZe41 @sknthla oh. hmm. @sknthla ah, so you're talking about people who haven't *literally* been here their whole life (that was my next Q/I assumed otherwise). @sknthla why do they not consider themselves British? "RT @Smerity: DDoS of emergency services using a mobile phone botnet could block statewide 911 for days O_o (h/t @Miles_Brundage) https://t.…" @janexwang and maybe something else but can't pinpoint it right now. Look forward to part 2 :) @janexwang good stuff! Reminds me a bit of some parts of Lady of Mazes... RT @janexwang: My clumsy attempts at writing science fiction continue, with the presumptively named Attractor State, Part 1: https://t.co/J… (briefly tried that before but not very hard - should be better this time) Annoyed at how bad the OSTP AI comment network was, so training new NN extensively on 30 MB of negative IMBD reviews. Called Negative NNcy. RT @Glinner: Let's watch Obama humiliating Trump again https://t.co/cXdpo2cot1 @j2bryson nah :) just a matter of not enough data + character versus word level training... @jackclarkSF @AnaPopescu_SV Morgan Freeman would work, too. @jackclarkSF @AnaPopescu_SV only interested in podcasts if they're generated by a WaveNet in your voice ;) @AnaPopescu_SV using char-rnn-tensorflow (on github) in (shockingly) tensorflow :) @mat_kelcey yeah, maybe not enough data for good results. Will hopefully see in a day or so if it can get much better than the 1st results.. (there are indeed Clarke's 3 laws, but I assume they meant Asimov's. Either way, a bit problematic. Clarke's not very "follow"able). Indeed - mixed bag. Some not so strong ("Follow Clarke's [sic] 3 laws!"), good ones from Google/OpenAI/FHI/MIRI, etc https://t.co/mWHdxAj2vY RT @mat_kelcey: @Miles_Brundage already more sensible than some of the actual responses at least Subtitle: "Why Some Countries are Better than Others at Science and Technology." Good coverage of existing lit + some interesting new ideas. Whoa, The Politics of Innovation (Taylor 2016) is a really good book so far. Relevant to science/tech policy people. RT @cstross: @zacharylipton You’re reading Accelerando? Kind of old hat. (If you want AI ideas, you may find "Rule 34" interesting.) "the most important risk is perception, engines, with will, and driving of test our cybersecurity, but institutes solvation can be only life All this uses @sherjilozair's char-rnn-tensorflow (with slight modifications) btw - thanks, Sherjil :) LSTM accidentally recapitulating Bostrom's thesis in Superintelligence (kind of): https://t.co/RWenTDLUK0 Some more AI jargon soup: https://t.co/m290H2U33T (I primed it with "the most important risk is") Preliminary results of running an LSTM on people's comments to OSTP on AI (not great, needs more training I think): https://t.co/VtFiFK0gvL "RT @dennybritz: Stacked Approximated Regression Machine manuscript withdrawn. https://t.co/NPIKgcVFQB Was too good to be true :/" I thought I was taking an AI break by watching Narcos... https://t.co/zCtZm30xP8 "Latest Datasets and Technologies Presented in the Workshop on Grasping and Manipulation Datasets," Bianchi et al.: https://t.co/TGdY1jbWx0 Important: "9-1-1 DDoS: Threat, Analysis and Mitigation," Guri et al.: https://t.co/NRpNwxpDff https://t.co/O91FXrlzuO "Learning Action Concept Trees and Semantic Alignment Networks from Image-Description Data," Gao and Nevatia: https://t.co/UNDikrH3oe "Latent Dependency Forest Models," Chu et al., ShanghaiTech U.: https://t.co/3bFlBK6H8w "Backpropagation of Hebbian plasticity for lifelong learning," @ThomasMiconi: https://t.co/p39CbNmlcD "Fitted Learning: Models with Awareness of their Limits," Kardan and Stanley: https://t.co/WQYPdidO1P "Quantum-assisted learning of graphical models with arbitrary pairwise connectivity," Benedetti et al., NASA Ames: https://t.co/DMWhR6T3HZ "RT @soumithchintala: Video Generation using GANs by @cvondrick . Looks super cool! Code released as well: https://t.co/qNV0j4MfFa https://t…" "A light-stimulated neuromorphic device based on graphene hybrid phototransistor," Qin et al., Nanjing U.: https://t.co/HAkOz5vKQI "Discrete Variational Autoencoders," Jason Tyler Rolfe, D-Wave: https://t.co/DayTbsoRKB @jackclarkSF at the moment, the most immediate impact is choppiness of my Mr. Robot. :/ @AnaPopescu_SV omg I just realized I conflate them. @saistent /brief scan of paper... @saistent where's the 90 mins/1s thing from? Admittedly haven't read the paper carefully yet but didn't see in blog post.. Had to consult this book - may or may not be training a model of public comments on AI... https://t.co/g30UJdYJu9 TFW you got your code to run but won't know for a while if it's actually working :/ Fine, I'll run it through a character-LSTM... https://t.co/63DeIPbeuz RT @timhwang: explanations of concepts in deep learning from @ch402 and @shancarter, beautifully clear and visualized, now at https://t.co/… RT @neuroconscience: Google Deepmind just pwnd text to speech. So many potential applications of this! https://t.co/EwXzzHJtTJ RT @ch402: Very exciting to be collaborating with @shancarter on https://t.co/9B6Zj5Q3ZP. I plan to do my expository writing there in the f… RT @random_walker: Announcing the first Workshop on Data and Algorithmic Transparency https://t.co/f5FJ6rjAAU "RT @mwilsonsayres: Tag says ""SOPHIE"" No answer when calling the phone number on the tag. Anyone at @ASU know this dog? https://t.co/Ef9XQ…" Very impressive stuff! Worth a read/listen. https://t.co/3OBfBl31rX RT @DeepMindAI: Excited to share our latest research on speech and music generation! Hear our #WaveNets speak for themselves: https://t.co/… @aprilaser congrats! RT @demishassabis: The brand new #DeepMind website is up! With much more room for news, blogposts and publications: https://t.co/T7ULVoWAkG @mikarv for sure! Might head to London in a few weeks, and def. let me know if you're ever in Ox... @mikarv sounds cool! Any more info on this on? @ShaonaGhosh I still haven't gotten a monitor to game with here (prob. soon) so missed window - fortunately won't know what I'm missing ;) @ShaonaGhosh yeah, have heard good things from friends :) really visually impressive... @tetisheri :-/ @tetisheri (wannabe) AI experts love buzzwords... @tetisheri :( :( @weballergy Oxford, too! ;) "Clearing the Skies: A deep network architecture for single-image rain removal," Fu et al.: https://t.co/zXxPnj3XI5 https://t.co/eqAhe0gG4H "Deep Markov Random Field for Image Modeling," Wu et al.: https://t.co/ZjcdIYpxWB "Unifying task specification in reinforcement learning," Martha White: https://t.co/bpK92vn2R0 "UberNet: Training a `Universal' Convolutional Neural Network for Low-, Mid-, and High-Level Vision," I. Kokkinos: https://t.co/jFatlckC7J @azeem @jackclarkSF Baidu seems v. low; maybe LinkedIn isn't used much in China (?). @AnaPopescu_SV pollsters I follow usually talk about state polls... @AnaPopescu_SV ppl who do it living do look at EC, and it's aggregated e.g. here: https://t.co/3TSq9pZw3l nat polls just interesting/simple RT @_rockt: 1st CFP #nips2016 Workshop on Neural Abstract Machines & Program Induction (NAMPI) https://t.co/YkXo6VH3BT #dlearn #ai Consider… RT @EdFelten44: Read the public comments submitted to @WhiteHouseOSTP Request for Information on #FutureOfAI https://t.co/DeXk69BaFA "UnrealCV: Connecting Computer Vision to Unreal Engine," Qiu and Yuille: https://t.co/MwgkrLAGOz IARPA-funded, CC @beaucronin "Direct Feedback Alignment Provides Learning in Deep Neural Networks," Arild Nøkland: https://t.co/2pQaHT2vvL "Hierarchical Multiscale Recurrent Neural Networks," Chung et al. at Montreal/CIFAR: https://t.co/RoDIhsAJtd RT @HMRoff: What would @HillaryClinton or @realDonaldTrump do if faced with the killer robot policy? Here are the stakes: https://t.co/mXDN… Xiaolan Fu on innovation policy in China: https://t.co/yjDOJnEA5Z Not very relevant soon, at least, for their purposes. Cf. recent hype: https://t.co/M0X9EOVYUZ Possibly very relevant for other purposes... One interesting thing from Google Brain AMA a bit back is near-unanimity that quantum computing wasn't v. relevant: https://t.co/jRpmWRvMoH (or about half a London) Apparently Beijing has grown by ~500,000 people/year since I was last there. Net gain of about 2 Phoenixes and 7 Oxfords :) Excited to learn more about Chinese AI R+D/policy, and see how Beijing has changed since I visited 8 yrs ago. Crazy amounts of construction. Meta-level point: props to Open Phil for being so thorough in describing their rationales for funding, even when there are mixed opinions. (personally, I never really got their AF agenda, but wasn't sure if I had dug deep enough...whereas their ML agenda makes total sense to me) Interesting review of MIRI's work and justification for funding them despite caveats, by @open_phil: https://t.co/9o5UgEPhOn Looks like I'll be in Beijing next month for the World Robot Conference. Anyone live there or know folks I should meet there? @AnaPopescu_SV yup... @AnaPopescu_SV I expected it'd be more controversial due to the whole beauty contests being problematic thing, didn't see this coming, tho. @AnaPopescu_SV someone posted about this on a AI-related Facebook group I'm in a while back and it was promptly deleted lol. so many issues. @boerneaj @peterwsinger @HMRoff and could influence their thinking/decision-making a lot, esp. if supporting some sort of restrictions. @boerneaj @peterwsinger @HMRoff (can't speak for authors, but my POV:) yes, they also matter a lot. Still, clear U.S. position would be huge "The Next President Will Decide the Fate of Killer Robots—and the Future of War," by @HMRoff and @peterwsinger https://t.co/5YRJonBVv4 "RT @boredyannlecun: Per @lawrennd we should donate data. I'll start: 49206b6e6f772077686f20426f7265642059616e6e204c6543756e2069732c20646f2…" RT @hugo_larochelle: Doing research on DL for video? Consider submitting to LSMDC tasks: movie description, annotation and fill the blank h… "Combining Fully Convolutional and Recurrent Neural Networks for 3D Biomedical Image Segmentation," Chen et al.: https://t.co/q7Ebi1I5DK "Convexified Convolutional Neural Networks," Zhang et al.: https://t.co/v7GpT90HqX "Distribution-Specific Hardness of Learning Neural Networks," Ohad Shamir: https://t.co/kGS5UrjRR8 @BayesForDays protest sign from the future ;) "End-to-End Reinforcement Learning of Dialogue Agents for Information Access," Dhingra et al. at CMU/MSFT/Taiwan U: https://t.co/PeepeAEGDl RT @traviskorte: Exercise: train a neural net to create novel metal band logos https://t.co/iHJf2QIcoX RT @mark_riedl: :-( https://t.co/LienMr54eC TL;DR: won't happen automatically, needs specific actions - agency w/ exciting mission, changes to hiring policies a la ARPA-E, etc. AI100 report (/everyone?) says govts need more AI expertise. @j2bryson and I make some specific recs for this here: https://t.co/Nd4r0WZKcN RT @alexjc: This approach doesn't restore images; it simply uses remaining information/context to make reasonable predictions. https://t.co… RT @alexjc: Defeating Image Obfuscation with Deep Learning https://t.co/dTjpjvVJgP ~57% to 80% accuracy despite blur/pixelation! https://t.… RT @heatherfro: PhD £: Doctoral Studentship in Modern Slavery https://t.co/RpFxJCkHdl @cyberony yeah, AI related but at a pretty high level - thinking about policy issues/incentives of developers/countries etc. Derek Parfit's list of research interests is perfect. Here's the beginning/end of the list. https://t.co/U25shWOOXN https://t.co/BRXsYAoW70 @ivan_bezdomny will check out - thanks! @deliprao will check out, thanks! :) @davegershgorn think we need cognitive tennis balls next... @nikete ooh this looks super useful - thanks! RT @nikete: @Miles_Brundage Mechanism Design and Approximation https://t.co/hNVPwVr3Mc "This is a very good read, btw (as is everything I've read in the Morgan & Claypool series on AI/ML - very concise): https://t.co/Isaw1fvwr7" Also very interested in fave references on mechanism design - thinking of getting this: https://t.co/dgv9S6GQzw Just started Mailath and Samuelson's Repeated Games and Reputations and it's pretty good so far. Will keep me busy for at least a few days.. Reading lots of game theory stuff over the next few weeks... anyone have fave papers/textbooks? Esp. repeated games, monitoring, reputation. @twitskeptic @amyngyn @cynthiablee I think they're reasonable suggestions. RT @HarrySurden: I have posted an updated draft of my article on self-driving cars and law with @SwizzleFish . https://t.co/tnqYWB9f9Z RT @amyngyn: my amazing former prof, @cynthiablee, created this guide on creating an inclusive computer science classroom! https://t.co/NlA… RT @MIRIBerkeley: Updates on new hires, new talks, an AI100 report, an @IEEEorg initiative, and Stuart Russell's new research center: https… @girlziplocked "churlishdan" RT @jeffbigham: oh, oh, it has a .ai domain name. someone buy it for a billion dollars. https://t.co/SiNlvmcUnq @rao2z: human-in-the-loop AI isn't cheating, it's harder and more useful. https://t.co/yy4AnlpGXv Cool stuff - "Innovation in the collective brain" by Muthukrishna and Henrich: https://t.co/EWng9ENI4h RT @rao2z: Back from China visiting Beijing, Xi'an and Guangzhou and meeting wonderful people. My talk at CCAI 2016 is here: https://t.co/… @RoboNarratives enjoy! :) RT @katjahofmann: If you missed @Batilda_de_coco presenting our #kdd2016 paper - read about it here: https://t.co/bz0Xqke0f0 @firadl @MLatM… @azeem no prob. @azeem wouldn't put too much stock in it given issues w/ expert opinion + it not being expert, but think u mean this https://t.co/rCHp8WWruZ @rebecca_roache perfect. Dylan Hadfield-Menell on cooperative inverse reinforcement learning, AI corrigibility, and off-switches: https://t.co/YlGolp5quo @natematias I don't know for sure, just haven't had anything at that level in Oxford/it's a well-known reference level :) RT @goldengateblond: This looks like the last thing you'd see as the chloroform took effect. https://t.co/ThqN4pgz7s @Brett_Fujioka that's at the "good" place. Another place doesn't do that, but fails in other ways - def. amateur hour. @Brett_Fujioka exactly. @natematias + be what ppl think is the best, but it's really bad compared to e.g. Chipotle (closest is London). Recommend Indian/English ;) @natematias if there are any legit good ones, I haven't found em yet, but haven't done a comprehensive search. Mission Burrito seems to + @Brett_Fujioka (and just generally bad ingredients) @Brett_Fujioka take, e.g. average U.S. Chipotle or even lesser chain vs. average place here... night and day. Basmati rice in a burrito wtf? @Brett_Fujioka I wish it were just that, but there seems to be a huge US vs. UK average/maximum/minimum gap, too. This whole taco truck thing is just a painful reminder of the quality of Mexican food in the U.K. ...and a lot of actual spam these days (for me, at least/maybe academics?) seems to be sketchy invitations. Hard/impossible to fully solve. Seems like invitations are likely overrepresented among false positive spam folder contents. Often large parts of invitations are copied... (Just had to rescue a very-much-not-spam conference invitation that ended up there...) This is your periodic reminder that spam filters are not perfect and you should check your spam folder occasionally. Talk by my @FHIOxford colleague Jan Leike on general reinforcement learning and its relation to AI safety: https://t.co/MHpORwemYj Don't have time to read the whole thing RN but read the Hinton one and it's interesting stuff for folks interested in AI/science history. "Talking Nets: An Oral History of Neural Networks" (Anderson/Rosenfeld, 2000): https://t.co/XfqO2P9qLa Interviews w/ Hinton, Rumelhart, etc. @2ygnus not particularly - just standard AI, human doing much of heavy lifting, it seems like - https://t.co/SyvMcXyPs0 Et tu, New York Times? https://t.co/kDjblWrsnG https://t.co/pxPED5KtjQ Maybe that sort of stuff gets them corporate business, don't know...AFAIK Watson-related sales haven't been publicized yet. RT @fchollet: You don't democratize AI by building a for-profit proprietary platform. https://t.co/XQmENz10bl RT @fchollet: In corporate speak, "centralized private control" becomes "democratization". (or if the trailer were made entirely by AI, or if the trailer were good... etc. Seems like a lot of wasted time) I'd be more impressed if Watson was like, "This movie looks pretty bad - sure you want to be associated with this?" https://t.co/aCDsx2O3oG @jeffbigham @mark_riedl more than I was hoping. E.g. some of the docs are just long articles where he's briefly quoted. @mark_riedl update: got access, but it's no good for that purpose :/ would require a lot of preprocessing. @davegershgorn seems plausible OpenAI would join; don't think prime movers intended to be final/only participants, if it happens.. RT @ARPAE: Seven years later, where is ARPA-E now? Check out these highlights from some of most successful projects https://t.co/Gfm0iexTuv "RT @rebecca_roache: Olympic shooting was mixed gender until a woman won gold, then it was immediately segregated. HT @rachelvmckinnon http…" @mark_riedl one needs to give a reason for access. We'll see if "train a neural network for AI programming practice/entertainment" suffices. "Reward Augmented Maximum Likelihood for Neural Structured Prediction," Norouzi et al. at Google Brain: https://t.co/7jiugJm51w "Neural Network Architecture Optimization through Submodularity and Supermodularity," Jin et al.: https://t.co/Z1fHu5kHi2 RT @karpathy: I'll be doing a Quora Session next week on Thursday https://t.co/0uoOErpxZv excited! @j2bryson yeah, don't think these reports are very good. If you're not counting search/targeted ads, etc. at least order of magnitude low... RT @erichorvitz: One Hundred Year Study on AI takes flight: First report now public. First of many studies over century: https://t.co/6tvds… RT @mark_riedl: @Miles_Brundage A predecessor language A2BL with RL inside was developed here at GT by some of my colleagues https://t.co/Z… This looks very cool - "A Programming Language With a POMDP Inside," Lin/Mausam/@dsweld: https://t.co/qDXLGllawM "Roughly Polynomial Time: A Concept of Tractability Covering All Known Natural NP-complete Problems," Andras Farago: https://t.co/UXuPIN84AD RT @HMittelmark: In other news, nobody on staff at the Philadelphia zoo has ever been online. https://t.co/kfCgOMv4A2 RT @egrefen: Sync'd video/slides from my @DeepMindAI talk on RNNs and models of computation @ Montreal DLSS are now available: https://t.co… RT @googleresearch: Improving Inception and Image Classification in #TensorFlow , with Inception-ResNet-v2 - https://t.co/9CUQ9HENc0 https:… RT @soumithchintala: Me and Wojciech are LSTMs now :D https://t.co/YCbjDjiu5x RT @kdphd: 3rd Workshop on Fairness, Accountability, and Transparency in Machine Learning call for papers! Deadline Sept 9th https://t.co/y… @PZilgalvis thank you! It was great to meet you. "What makes ImageNet good for transfer learning," Huh et al.: https://t.co/78ciDCbapS "Temporal Convolutional Networks: A Unified Approach to Action Segmentation," Lea et al.: https://t.co/Ug4kJNPhFk @Aelkus would be interested in the syllabus! RT @kevinmarks: How to talk to a woman wearing headphones: Be a Kardashev Type II civilisation in HD164595 https://t.co/ud5IcRYssj RT @googleresearch: Announcing the latest release of TF-Slim, a lightweight package for training and evaluating models in #TensorFlow https… @junkiepunch nope RT @gdb: Deep learning infrastructure: https://t.co/Z9xKwz0g8u, for practitioners and the merely curious. Bonus open-source release include… @halhod + if you want to *not* want what you want for lunch, take a pic and use this to see it rot: https://t.co/SXvojgMDTD @jeffbigham internal crowdsourcing platform=? same functionality as MTurk/same sorts of users but proprietary site? or employees do tasks? RT @kashhill: I tried to help this psychiatrist figure out why Facebook is recommending that her patients friend each other. https://t.co/H… @timhwang I see what you did there... RT @mustafasuleymn: Excited to announce partnership with @uclh exploring how AI can improve radiotherapy treatment for cancer patients http… RT @mustafasuleymn: Read more about our @uclh collaboration using AI to improve radiotherapy treatment for cancer patients https://t.co/u0u… RT @EdFelten44: Excited about Oct 13 Frontiers conference, hosted by @POTUS, including an #AI track. https://t.co/I0GWF57hXk https://t.co/c… @ericbkennedy nope, sadly- just in town for meetings tomorrow (one day). Enjoy! Hope to make it to Barcelona for other reasons at some pt. @mark_riedl Robust Intelligence for Entertainment and Dynamic Learning Center (RIEDL Center) RT @hawesie: We are looking for a Research Associate to take @strands_project robot code and apply it to an industry application https://t.… Obligatory waffle pic (just got to Brussels). https://t.co/ac3SswqLal RT @Neuronme: Smart Policies for #ArtificialIntelligence https://t.co/Rd2qexIarq #AI #tech #technology #technews #Neuron #machineintelligen… @halhod @jackclarkSF the future is here, it's just only distributed to rats... RT @MaryEllenFoster: This article is relevant to several conversations I've been having recently -- good timing! https://t.co/TRi1nJ7kBB @j2bryson CC also @FrankPasquale @j_winterton @Aelkus @mgubrud @alan_winfield @janieflegal RT @demishassabis: Synthetic gradients: a really brilliant idea, and a simple summary blogpost, from the amazing @maxjaderberg and co! http… "POMDP for Recommender Systems," Lu and Yang [deep RL approach - NIPS 2016]: https://t.co/oiAQBYQUhn @bradleypallen ah, you're right - thanks! "Learning Temporal Transformations From Time-Lapse Videos," Zhou and Berg: https://t.co/M6Hnd9iSSs video: https://t.co/SXvojgMDTD "Machine Comprehension Using Match-LSTM and Answer Pointer," Wang and Jiang: https://t.co/yzyaIsjPa1 "Human-Algo. Interaction Biases in the Big Data Cycle: A Markov Chain Iterated Learning Framework," Nasraoui/Shafto https://t.co/jiI1K2qQT5 A Boundary Tilting Perspective on the Phenomenon of Adversarial Examples," Tanay and Griffin: https://t.co/e1pmiViEBA @j2bryson CC @rcalo who's referenced. @j2bryson and I posted an article draft, "Smart Policies for Artificial Intelligence" - feedback very welcome! https://t.co/ZTkgY8y88R @ramez gosh, so much, but some of my faves - Stephenson/Diam. Age, Vonnegut/Player Piano, Banks/Player of Games (etc.), Atwood/Oryx&Crake... Good explanation/diagrams of synthetic gradients (assumes some deep learning knowledge): https://t.co/Sk1yKL8mzS "Appropriate use of a Terminator picture. Could be cool... this related ride was fun: https://t.co/o0J7VEZgVb https://t.co/yyGXL3EZmO" @maxjaderberg nice work - and the gifs/explanation are helpful! RT @DeepMindAI: New blog post up, explaining our paper Decoupling Neural Networks Using Synthetic Gradients! https://t.co/b9CsmHyRpN https:… More on this news here - https://t.co/YuDX0qqxvD https://t.co/k70wg3xMrH "Overcoming Temptation: Incentive Design For Intertemporal Choice," Mozer et al. (NIPS 2016): https://t.co/HIy9RwNRLQ RT @DN_Debatt_betyg: Great news: @UCBerkeley launches new center for Human-Compatible AI led by Stuart Russell with $5.5m grant from @open_… @j2bryson @vdignum probably a reference to: https://t.co/cLkIDU6Vzt @AthertonKD + theoretical energy/power density of other battery chemistries way higher, so over a bit longer term, perhaps a plausible risk? @AthertonKD agree latter huge issue, not sure if wind/battery point decisive, though (?). Lots of high pop areas w (occasional) low wind... @jmugan @bengoertzel he's talking about this and the unusual amount of subsequent new blog posts: https://t.co/TIw6pZLkb8 Collaborative Filtering with Recurrent Neural Networks," Devooght and Bersini: https://t.co/KgPKkcbcq6 Definitely the most dramatic arXiv paper of the day...on acceleration of SGD by Allen-Zhu: https://t.co/IqbLvJVYid https://t.co/khQaOxK3OL RT @j_winterton: Unsettling. Do you think they talked w project engineers re: ethics, politics? We never did at LM re: Saudi partners https… @jwan584 @soumithchintala yes, ppl do QA with DL. You can find stuff on Google Scholar/arxiv/etc. Not aware of Watson/other stuff comparison @sknthla ICYMI on comp complexity: https://t.co/R5ijY7yPl2 though if ur pt true, limits possible AI-based AR/VR apps ;) RT @robinhanson: I'll answer questions on Quora this Tuesday: https://t.co/cgA12gVEdM @mgubrud I don't have access to the recent (arms race) Geist piece, could you send? Interested to see/discuss/respond... sounds problematic. @mgubrud ah, will check out later (can't access on phone). @mgubrud how does it refute it? RT @mustafasuleymn: Pls support @HelpRefugeesUK to cook 2k meals /day, run schools, & women's centres #CalaisJungle. What they need: https… (simplifying there by saying "fast advances" - argument is more specifically about high capabilities, but relevant to both level and speed) ICYMI, good post by @gwern on computational complexity + AI arguing former doesn't rule out fast advances in latter: https://t.co/R5ijY7yPl2 @RecklessCoding yes, sounds great! :) @j2bryson just meeting some folks at the European Commission, no event... dunno about November. Don't think I've been invited to it. "Neural Fitted Actor Critic," Zimmer et al.: https://t.co/6qEzCldsa0 @Thomas__Arnold I'll be getting there tomorrow - hope to see you there! Off to The Hague for ECAI and the IEEE meeting on autonomous systems, then Brussels... look forward to seeing some of you there! :) RT @grok_: Turns out caring for creepy robot babies doesn't discourage teen girls from getting pregnant. Rather the opposite. https://t.co/… @davegershgorn everyday. RT @mark_riedl: Google/DM’s Atari playing AI forked and trained to play Super Mario Bros. https://t.co/ysuq3Y6R18 https://t.co/ueCgBnVEqZ RT @mark_riedl: Twitter is an exercise in juxtaposition this morning. Military wants more AI. But AI plays Mario & board games are great! RT @AP: BREAKING: France's top administrative court overturns burkini ban amid shock and anger worldwide. RT @notthatdsw: In which each layer connects directly to all layers below it. With @TorchML code: https://t.co/q5uHEM4clb https://t.co/WUYy… "Densely Connected Convolutional Networks," Huang et al.: https://t.co/war9IayuXG ICYMI, some great in depth research on bias in NLP/ML from @aylin_cim, @j2bryson, + @random_walker: https://t.co/ZIcsm4MQHp "RT @etzioni: Hot off the Press: @CACMmag Designing AI Systems that Obey our Laws and Values https://t.co/tpLDhKOFsq calling for automatic o…" Meanwhile, in China... "A few hundred scientists work on the deep-learning technologies" at Didi: https://t.co/xc4UJVXwNB h/t @deliprao @mat_kelcey but was it an autonomous chair? ;) (doesn't have the same ending, but some similarities/probably some inspiration) Classic book (link to refd story https://t.co/bmRXX6UelP). +Ted Chiang has nice modern version in collected stories. https://t.co/X4CV1yJHkE @vintermann I had forgotten about that - good pt, thx! Have you heard of this or other AI patents being enforced btw? @j2bryson I do now! :) RT @RichardSocher: Indeed a great high level introduction to deep learning. https://t.co/ByyMw7mboN @FrankPasquale huge # startups 2011-5, tho, so not clear evid of consolidation. Arguably, serious AI R+D grew beyond GOOG in that time, too. @mark_riedl yes, unlike the antitrust thing I think there's a p. clear policy case for better provision of public goods like quality data. RT @afuahirsch: #BurkiniBan continues its empowerment of women- in this case 4 armed, white men standing over woman making her strip https:… @mark_riedl @jeffbigham not sure they've said anything. Feel like this is something journos should check out *cough* @halhod @davegershgorn @AnthroPunk possibly, would need to know more :) feel free to shoot email w/ details...we're supposed to catch up soon anyway! @AnthroPunk ah, thanks for clarifying. Makes sense. @jeffbigham @mark_riedl whenever it comes up on Reddit, people say "Google's just doing it so others don't patent" but haven't seen evidence @Aelkus @mark_riedl yeah... there's arg in https://t.co/w7GBJhjfDd for avoiding monop on HW, not sure if agree but better than antitrust arg @jeffbigham @mark_riedl lots of patents filed, but I've never really seen a good analysis of the issue, or heard of them being enforced. @AnthroPunk not sure I follow. What does second sentence mean? RT @mark_riedl: University system pumps out a small army of individuals trained in AI/ML every year. Also not seeing the concern. https://t… Anyway, point is just that it's not a super open and shut case RN in my view. Looking more into this in next few months... Some of the specific empirical claims are suspect, too- tech giants "unlikely to [share] their core components"...what are DQN, TensorFlow? And long term, it's not clear that some forms of consolidation are nec. bad (or good)..see: Superintelligence+ this: https://t.co/z1S648nTsy There are some complex issues involved both from a fairly traditional competition policy POV (see e.g. new book, Big Data + Comp. Policy), Good to see discussion of AI concentration/diffusion issues, but don't think arg for trust-busting here is nec true: https://t.co/CjPYlqdTQx @Aelkus yeah, I read the whole thing and it's generally pretty sensible. But there isn't really any further justification of that table. @Aelkus yeah, mentioned this a few days ago - some of that table is quite suspect. Would have liked to see more on the technical analysis... @jhaberstro @Smerity dunno... "Recurrent Neural Networks With Limited Numerical Precision," Ott et al.: https://t.co/yrFTQGhp0V RT @googleresearch: The Google Brain Team (https://t.co/6BSGMMfnll) is open-sourcing #TensorFlow model code for summarization research - ht… @Smerity doesn't an optimal policy for Blackjack still lose money long term, though? And network effects... you can do some cool stuff with a small team, and build great applications, but need big investment to be key player. Yeah, there seem to be important economies of scale with AI research, so few likely to do it in big way long-term... https://t.co/VsKdSFSrZa @AnaPopescu_SV yeah, that seems consistent w/ the evidence. @AnaPopescu_SV though maybe that's what you mean ("few" do research as in few companies, not few ppl) @AnaPopescu_SV hmm, like what other areas? Hard to imagine large fraction of current researchers losing interest. Maybe shifting to acad... #NAME? Which, btw, may be justified - perhaps it's not as core to their business as it is to GOOG/FB etc. - just worth being aware of... (some interesting stuff in the article re: applications, but overall it just confirms Apple hasn't invested much in AI research vs. others) """AI’s Brahmins figured if Apple’s efforts were as significant as GOOG/FB’s, they would have heard"" https://t.co/yrbJIOgGW0 +1 for Brahmins." RT @j2bryson: Semantics derived automatically from language corpora necessarily contain human biases https://t.co/7Fhjy0bIK1 w @aylin_cim&… "RT @negar_rz: Deep Learning summer school videos are now available https://t.co/n5d7lOiJDB" Don't know how but "it's quite warm for this time of year, isn't it?" was sandwiched somewhere between "c**t" and "I wouldn't lower myself." Peak Britain? Two guys arguing on the bus about whether one's suitcase's is blocking people. The weather is discussed mid-heated argument. RT @StevenLevy: My exclusive look on how Apple uses machine learning and AI. https://t.co/ivZG1874Kl @AnaPopescu_SV haha :) @BayesForDays what do you mean by "bodily w/e"? Per @BayesForDays, selection bias def part of it- follow lots of affluent/travely ppl. But don't see many other affluent/travely complaints. Seems unlikely to me that it's b/c especially bad industry (relative to difficulty of providing good/service), but failures very impactful.. RT @BayesForDays: @Miles_Brundage Uh, base rates/lower n outcomes? Selection bias based on your social circle? Random observation/Q: pretty much the only good/service/industry I ever see people complaining about on Twitter is airlines. Why is that? RT @demishassabis: My new paper in PNAS with @MartinJChadwick et al, looking at the structure of semantic representations in the brain http… "RT @mystagogical: [quantum computer helpdesk] Have you tried turning it off and on at the same time?" RT @mat_kelcey: google brain robotics dataset https://t.co/2J0gYQ7fJg @deliprao @mark_riedl @jackclarkSF @yayitsrob think you're referring to this program? https://t.co/KhyGnEFM3k "Context Gates for Neural Machine Translation," Tu et al. at Huawei/Tsinghua U.: https://t.co/4Wj4fIkbVM Code: https://t.co/8FiqrHjPhO "Surprisal-Driven Feedback in Recurrent Networks," Kamil Rocki at IBM: https://t.co/xjZ21gdh05 "Domain Separation Networks," Bousmalis and Trigeorgis et al. at Google Brain/Research (NIPS 2016): https://t.co/cy7GPITH35 "VoxResNet: Deep Voxelwise Residual Networks for Volumetric Brain Segmentation," Chen et al.: https://t.co/PtmlVQwvPZ "Local Binary Convolutional Neural Networks," Juefei-Xu et al.: https://t.co/nhIWeuJfLb "Extending the OpenAI Gym for robotics: a toolkit for reinforcement learning using ROS and Gazebo," Zamora et al.: https://t.co/9K6W9Br0EW Watching Orphan Black, it's so easy to forget that Tatiana Maslany plays a dozen totally different characters. She deserves all awards ever. @samim "won't be big and professional" :) @rivatez or in short supply? :) @Aelkus @AuerbachKeller @MelMitchell1 @jackclarkSF yes, great series! @jackclarkSF (leaving out the more common stuff ppl have already mentioned, though some I'd prioritize more :) Russell/Norvig, Sutton/Barto) @jackclarkSF on more scientific stuff, Artificial Cognitive Systems, Do The Right Thing, Sciences of the Artificial* are all fun... "@jackclarkSF maybe Ekbia's Artificial Dreams, *Nilsson's Quest for AI, McCorduck's Machines Who Think are fun re: history... *top of the 3" @deliprao @AnaPopescu_SV yeah 1.8% was prob. referring to oral acceptance rate, not papers; I'll delete that tweet to reduce confusion :) @AnaPopescu_SV @deliprao it's almost like ML is hot or something. @spysamot indeed... So it was more like 23%, thanks for clarifying, everyone :) Oral acceptance may or may not have been 1.8%. https://t.co/cgYgBTy4N8 @__hylandSL :( thanks for the info! RT @btabibian: @ankurhandos @Miles_Brundage it is much higher than 1.8% @yoavgo yeah, does seem too low. Just posted a clarification/amendment. No, I'm not sure. On second look, that # (from someone's personal site) may have been just for full presentations. https://t.co/GJKvtCeZde NIPS 2016 accepted papers: https://t.co/sQibRY4n1s RT @demishassabis: Excited to welcome Yee Whye Teh & Simon Osindero to the team, who w/Hinton cowrote the 2006 paper that started the deep… @davegershgorn but have you seen Battlestar Galactica? @gerstenzang (granted, not very familiar w/ the NYC scene, though) @gerstenzang Geometric Intelligence? @BanKillerRobots from DSB report on autonomy. BKR logo didn't really fit the point they were making there or mesh with their POV :) @girlziplocked The Politics of World Federation. @jhaberstro so it'll be visible much of the time when looking at new papers for a given category. @jhaberstro Not sure if there's a foolproof way, but very frequently people put the conference in the "comments" section on arXiv. (some parts less sensible than others, e.g. "provably correct emergent behavior" in near term...how near? And how good NLP? Etc...) You can read it here, though you have to sign up for a free trial: https://t.co/Vp02V9B7A1 Jokes aside, pretty good report. This seemed pretty sensible, for example, + they're v. aware of expertise deficit.. https://t.co/JdTOZmu9TQ (plausible they had that in the figure on purpose, but there's a fair number of typos, too, so accidental photobombing also seems plausible) The Defense Science Board's new report on autonomy seems to have been Google Image-photobombed by @BanKillerRobots: https://t.co/bCGCPSycul Brace yourself... NIPS papers are coming to arXiv. @ivan_bezdomny https://t.co/j2ilTvCXTQ @AnaPopescu_SV that tweet is amazing. RT @atduskgreg: Brilliant computer vision work that uses vibration to make objects in video interactive: https://t.co/040Wek5OaB (via @gola… RT @HMRoff: Stay tuned! I'm 5 weeks away from launching the first ever dataset on autonomy in presently deployed weapons systems from top 5… "The goal of this work is to remove update locking for neural nets. This is achieved by removing backpropagation." https://t.co/cXE1GWxrI5 "Effective Multi-step Temporal-Difference Learning 4 Non-Linear Function Approximation," van Seijen, Alberta/Maluuba https://t.co/vBfbWqJ6AV "Design and Implementation of Probabilistic Programming Language Anglican," Tolpin et al. at Oxford: https://t.co/KZ47fOXJjA "Efficient Exploration 4 Dialog Policy Learning w/ Deep BBQ Networks & Replay Buffer Spiking," @zacharylipton et al: https://t.co/q3gHHWiI7q "Full Resolution Image Compression with Recurrent Neural Networks," Toderici et al. at Google: https://t.co/hrEDyNABJc "Decoupled Neural Interfaces using Synthetic Gradients," Jaderberg et al. at DeepMind: https://t.co/9hka4lDZP4 RT @vkrakovna: An inspiring interview with board members of Women in ML, including my advisor Finale. Thanks for making it happen! https://… @j2bryson though of course the odds of Trump saying anything sensible about it are low... @j2bryson the SciFri tweet was misleading - the proposed questions for debate (https://t.co/Q7zpcV1Mkb) are about science *policy*/sensible, @FHIOxford is hiring a Research Project Manager: https://t.co/dxxvauoOE3 RT @FHIOxford: FHI is hiring! https://t.co/5tU8gJqqB7 @FLIxrisk @elonmusk @DeepMindAI @tegmark @OpenAI @sama @willmacaskill @PeterSinger @K… RT @jackclarkSF: NIPS 2016 workshops are here: https://t.co/5MJq7R6gj5 https://t.co/FkMa58tJsR RT @robinhanson: It is hard to see how putting chips in brains lets brain compete with other hardware in the long run. https://t.co/kqZyBHi… RT @RikeFranke: Wait, what? https://t.co/wwMXCYZNm0 "RT @alexjc: - It's hard to train a deep network! - Try turning it off and back on again? *blank stares* https://t.co/nuhVrQYQo5 https://t.c…" "Retrieval-Based Model Accounts for Striking Profile of Episodic Memory and Generalization," Banino et al, DeepMind: https://t.co/HFxvuyxOQg Given a hypothesis space someone puts in, system proposes informative experiments (in this case, for cog. psychology, but general approach). "Practical optimal experiment design with probabilistic programs," Ouyang et al. at Stanford: https://t.co/8QgiTwAs1M "An Efficient Character-Level Neural Machine Translation," Zhao and Zhang at Shanghai Jiao Tong U.: https://t.co/c3GFCbbo4g "Mollifying Networks," Gulcehre et al.: https://t.co/ZPhYUSsTjZ https://t.co/itVAgKQRIP RT @jackclarkSF: Will be at AI meetup in SF tomorrow on adversarial networks (tricking machines) from Ian Goodfellow of @OpenAI https://t.c… "RT @pbump: *googles “is it legal to marry a video clip”* https://t.co/wEsX5SQLDS" RT @mustafasuleymn: Please join DeepMind Health's first public forum for patients on 20th Sept - more info and sign-up here: https://t.co/P… RT @M__Verbruggen: Concl: DoD to take immediate action to accelerate exploitation of autonomy while prepping to counter adversaries https:/… @AnaPopescu_SV psh, VCs... one of my "man, this is ridiculous" moments was seeing someone from BlackRock at a poster session at NIPS... @shriphani a variety of scientific projects - some listed here: https://t.co/2hWOzAurFG @jackclarkSF yeah. Referring to the GPU component of Titan. Hard to tell, but looks like w/ the 2017/2018 successor (Summit) to the supercomputer I referenced (Titan), gap over AlphaGo more like 300x. See: https://t.co/P2yLkg3liY Another thing that continues to amaze me: consistency of top 500 supercomputer trends over time, *including* the gaps between top/sum/last. @snagglechud not that I'm aware of. I just heard that it was ~10x faster/more efficient than something :) Been thinking about hardware lately...fun fact: the biggest GPU cluster in the world is ~67 times bigger than Nature paper-era AlphaGo's HW. "Dynamic Network Surgery for Efficient DNNs," Guo et al., Intel China: https://t.co/XQ4LsJk9Rh 108× and 17.7× pruning of LeNet/AlexNet (!?). "Our key, and perhaps surprising, empirical finding is that constraint solvers dominate the gradient descent and LP-based formulations." "TerpreT: A Probabilistic Programming Language for Program Induction," Gaunt et al. at Microsoft: https://t.co/Stz1PMUgvh Yelp filters. https://t.co/XxQfTS8zmn RT @HMRoff: Should US Unleash War Robots? Frank Kendall Vs. Bob Work, And Kendall wants full autonomy https://t.co/B5ohxvDRnM @jackclarkSF as in ppl should subscribe - no yelling at Jack intended ;) Do it, it's great! https://t.co/tmRBXS0VaZ RT @jackclarkSF: I will continue to produce the Import AI newsletter after I join @OpenAI. Subscribe & read third issue here: https://t.co/… RT @tonyschwartz: Trump is a bully who has finally had his lifetime bluff called. It’s a real life Wizard of Oz moment. There is nothing be… And @tambetm has written a great explainer on deep RL: https://t.co/SJKE6zt2Qx Don't know most of folks here but Dario is also a great hire - looking fwd to lots of good safety stuff from them: https://t.co/Yj5ixibFWm @jackclarkSF indeed, lots of other great folks, but all have unique styles so the loss is non-zero ;-) Still, gain is huge! V. exciting. :) RT @jackclarkSF: @Miles_Brundage no pressure @davegershgorn @lizzadwoskin @CadeMetz @qhardy @markoff @willknight etc etc. There's loads of… Congrats, Jack and OpenAI! Big win for them, and a loss for AI journalism - others will need to pick up the slack :) https://t.co/Ytt2tQ1gAW RT @jackclarkSF: I'm joining OpenAI because AI is tremendously important: https://t.co/KCz75B7WiU RT @AcademicsSay: metacognition explained https://t.co/Yy4WgZz7UL RT @SuryaGanguli: My talk-slides on neurotheory and #deeplearning theory: https://t.co/QGRXmd9KPk at the Montreal summer school https://t.c… "SGDR: Stochastic Gradient Descent with Restarts," Loschilov and Hutter: https://t.co/Jk7SZgGCYp "Generative Transfer Learning between Recurrent Neural Networks," Shin et al. at Seoul: https://t.co/OzpYuHyKRz Nice metaphor from @fchollet re: deep learning's data-hungriness: https://t.co/CSla6C4kHs https://t.co/6Q9Pfwa42D RT @alexjc: DeepDiary: Automatic Caption Generation for Lifelogging Image Streams https://t.co/pHSyLSPGw9 https://t.co/Ev2U0cfWQW (paper title on arXiv differs from the one on the paper, so I went with latter; anyway, looks interesting) "Categorical Compositional Cognition," Al-Mehairi et al. at Oxford: https://t.co/c0gvOLevk5 Looks interesting - "Learning with Value-Ramp," Ameloot and Van den Bussche: https://t.co/60jV0jdpVb "Clockwork Convnets for Video Semantic Segmentation," Shelhamer/Rakelly/Hoffman/Darrell at Berkeley: https://t.co/FkelP4ZJyE "Learning Structured Sparsity in Deep Neural Networks," Wen et al. at Pittsburgh: https://t.co/T8pRmsUH4N "Density Matching Reward Learning," model-free density-based inverse RL, Choi et al. at Seoul N. U./Rethink Robotics https://t.co/7vZF2nuRiH Bart Selman on "Non-Human Intelligence": https://t.co/VddSM1JhLa Slides: https://t.co/MFGiKXiIBH @nsaphra (same ones as on the page @haldaume3 linked to :) ) @nsaphra also John Schulman has a series of 4 lectures on it on YouTube... @nsaphra Human level control w/ deep RL, asynchronous deep RL, and the alphago paper are some biggies... "RT @AISB2017: CFSymposia (deadline 15 Sept): #AI & the Simulation of Behaviour @AISB2017 Bath ~18-23 April Theme: Society With AI https://t…" RT @MIRIBerkeley: "Complexity No Bar to AI": does computational complexity theory forbid intelligence explosions? https://t.co/RfSVZVorYv @jmugan Facebook (if you can figure out his name and it's rare enough)? RT @dandrezner: "Nearly two months later, the effort to save Mr. Trump from himself has plainly failed." https://t.co/dpkLR4B1kb RT @superhelical: Landing a tenure-track position, 1950's vs. 2010's https://t.co/EToKDhIj4V RT @karpathy: Found some time to read "Value Iteration Networks" paper - embeds a differentiable planner into agent policy. Neat. https://t… RT @vkrakovna: Awesome panel on risks&benefits of advanced AI by @openai, @open_phil, @FHIOxford & Vicarious, moderated by @rivatez https:/… RT @j2bryson: Also #cogsci2016 117–“human bias is embedded in language models”; my #EMeaning work with @aylin_cim & @random_walker https://… @beaucronin all sorts of other machine learning stuff. As Jeffrey Siskind mentioned there (not on paper but doing some related work), stuff like this shows brains similar, =>privacy implications. As I mentioned when I was at Purdue, some there want to make an IRL dog translator like the movie Up, + brain->foreign language translators. (~brain reading with neural networks) https://t.co/BsPrxU1yIX "Neural Encoding and Decoding with Deep Learning for Dynamic Natural Vision," Wen and Shi et al. at Purdue: https://t.co/nBaTLui0Dx @n_srnck congrats! @MGBennett great to hear! :) RT @fchollet: I'll be doing a @quora session next Monday. If you have questions about deep learning (or anything else), ask here: https://t… RT @googleresearch: Reminder, we’ll be starting the #RedditAMA with the Google Brain team today at 10am PT. Join us at https://t.co/LabgKod… @SparseJacobian ..working on such stuff, and also prob. strategy and policy stuff, but there's less of a clear research agenda there... @SparseJacobian that's a big Q/topic :) think MIRI's and Amodei/Olah et al.'s research agendas are both good/there should prob be more ppl.. @SparseJacobian much of my probability mass has def moved earlier in last few years, but always thought uncertainty justified preparedness.. @SparseJacobian I'm pretty unsure both about metrics (not sure if human-level is well-defined) and timelines, but ~80% sure abt 7-70 yrs ;) Movie based on a cool Ted Chiang short story (Story of Your Life): https://t.co/YJcZPTc8CU "Neural Generation of Regular Expressions from Natural Language with Minimal Domain Knowledge," Locascio et al.: https://t.co/P9QwlIG2nR "Evaluation of General-Purpose Artificial Intelligence: Why, What & How," Bieger et al.: https://t.co/2uKCYj3WyW @rivatez for sure! @rivatez maybe see also Benjamin Rubinstein's work... @rivatez https://t.co/Agh1jws28h @fchollet @deeplearning4j NNAISense, Cogitai... RT @WillOremus: Snapchat is like the Donald Trump of social-media startups. https://t.co/9mt0oIH63B @davegershgorn let me know if you're ever in/near Oxford... @davegershgorn congrats! This is an AlphaGo-like approach to theorem proving - tree search with neural nets to guide exploration: https://t.co/datrll38JE RT @lawrennd: .@tegmark highlights the different perspectives on AI safety through 9 myths. https://t.co/DKjwonaNjH @mark_riedl no wonder he wasn't at the seminar earlier... "Holophrasm: a neural Automated Theorem Prover for higher-order logic," Daniel Whalen: https://t.co/BXUK4YmBmg "Residual Networks of Residual Networks: Multilevel Residual Networks," Zhang et al.: https://t.co/tCqNLzm0cc RT @SecretService: The Secret Service is aware of the comments made earlier this afternoon. RT @sarahjeong: Whoever came up with that one is worth their $$$$$ paycheck but lol https://t.co/WDsFcmhDXh @j2bryson this is cool/useful, thanks for tweeting! :) @AnaPopescu_SV though per your point, maybe a better way for them to do that is just register Dem voters/go door to door :) @AnaPopescu_SV think it's just so they can live with themselves if he wins... "Online Adaptation of Deep Architectures with Reinforcement Learning," Ganegedara et al.: https://t.co/YNgiLF5zik @mark_riedl do you know if there is a good reason the cog sys and integrated AI tracks are separate? I just assumed it's a personal thing... RT @mat_kelcey: 2 day bay area deep learning school https://t.co/5d02YuiKKR @jackclarkSF great stuff; keep it up! Or at least make an AI that will ;) Fun (though too short) Cambridge visit today - thx Sean et al. at @CSERCambridge + @katjahofmann at @MSFTResearchCam for the hospitality! :) RT @karpathy: Read Google Brain WikiReading paper (https://t.co/n6s5kq0i5J); nice read, took some notes, might as well post them: https://t… RT @conjugateprior: Related: Harper (2009) on evolutionary dynamics as Bayesian inference: https://t.co/xik4PrRMgN HT @chrisalbon https://t… "De-Conflated Semantic Representations," Pilehvar and Collier at Cambridge: https://t.co/byvZqSglDF This looks cool: "Human collective intelligence as distributed Bayesian inference," Krafft et al.: https://t.co/XNqFd0WYRz RT @karpathy: The new WikiReading dataset looks impressive https://t.co/29qBtbc9oQ …: 18M text reading comprehension instances across ~50%… @mark_riedl glad I successfully incepted you with this (the pun at least) :) @AnaPopescu_SV the most damning thing one could possibly say about her is that she married Donald Trump... "RT @rsalakhu: CMU School of Computer Science @SCSatCMU has hired 27 robotics & CS faculty in 2016. I am not kidding! (via @awmcmu) https://…" RT @shakir_za: My slides on Building Machines that Imagine and Reason. On state-of-art generative models. https://t.co/3C5zAJpnWp https://t… @bengoertzel how are you able to write so much? :) RT @vkrakovna: @shakir_za on recent progress in generative models at deep learning summer school https://t.co/y3dfSxmI37 RT @karpathy: Some of the slides from this year's Deep Learning summer school in Montreal are now up: https://t.co/YRNXRABHIU RT @boredyannlecun: According to latest betting odds, your paper has a better chance of getting into NIPS than Donald Trump has of becoming… RT @MatthewGuz: @Miles_Brundage Seems that way https://t.co/k4FiK6Ng7T So is Pokemon Go still a thing? @mark_riedl flexible how? On the bright side, GAO continues to do great work. Even if this were fixed, we might still have a prob. with AI patents due to expertise issues, but come on, at least get incentives right... The issue isn't the time per se (one could *imagine* a fast, good review process), but the messed up incentives. Anyway, this is not good... No wonder there are so many dubious AI patents. Less time for patent reviews than paper reviews! GAO report here: https://t.co/Z0HvqAwCKl """someone working on an artificial intelligence [patent] review gets an average of about 31 hours to complete it"" ! https://t.co/0O9cvDFid4" @nerdsrocket so, I shouldn't see it? RT @JamesBessen: GAO Study: Patent Office Encouraged Examiners To Approve Crappy Patents https://t.co/uAwBUKmXxs via @Techdirt RT @lazowska: GeekWire reports #UWCSE machine learning spinoff @turiinc Turi acquired by Apple - https://t.co/1WAWRBW5w4 https://t.co/JXfnv… RT @nadyabliss: Here it is! My first column for @CSMPasscode : Talk to girls about tech - girly or geeky is a false choice #STEM https://t… @AnaPopescu_SV = me basically whenever I try to do AI things. @SparseJacobian lol I meant the sports event one ;) know EA Global... @SparseJacobian took me a minute to figure out what event you were referring to ;) RT @alxndrkalinin: #ICLR2017 is up: 5th International Conference on Learning Representations - in France in April! Deadline Nov, 4th https:… RT @kashhill: Breaking: FDA approves plan to use genetically-engineered mosquitos to fight Zika in Florida. https://t.co/R5esgbT2ro @mark_riedl if only... "RT @vmansinghka: I'm relieved to see US security leadership speaking out about the seriousness of the US presidential election. https://t.…" RT @jackclarkSF: If you want to subscribe to Import AI, a newsletter about AI research, applications, & foul-ups, you can do so here: https… RT @DARPA: Last round of the Cyber Grand Challenge complete! Prelim results look like 1) Mayhem 2) Xandra 3) Mechaphish Verified overnight… RT @KSoltisAnderson: Nine percent. Trump gets nine percent of respondents under 30. https://t.co/h2CRCMqddH @mark_riedl @jackclarkSF @j2bryson report of the IlluminAIti? :) Videos of the White House/CMU workshop on AI safety and control: https://t.co/gwZmFcGqON "Cyber Grand Challenge, livestream of the finals: https://t.co/zdXyhJdxIF I'm rooting for Galactica, for obvious reasons." RT @jackclarkSF: Cool job alert! https://t.co/stBib0pfOn RT @soumithchintala: Code for FastText is released and here. Superfast text classification. VowpalWobbit can also do most of this FYI. http… RT @jackclarkSF: If Google creates general AI it might donate it to the UN, says Demis Hassabis https://t.co/uih6c83eas https://t.co/kHz8MU… RT @sarahkendzior: If Trump doesn't win, another in his vein will follow. This is a national test of character, of what we will tolerate an… RT @RikerGoogling: how was trumpocalypse averted (the paper is about the instantaneous part) We'll see if this hype-y part survives NIPS peer review :P https://t.co/l0oMJ9DGZl "Learning Online Alignments with Continuous Rewards Policy Gradient," Luo et al., Google Brain: https://t.co/kWvL5fMnkE RT @realDonaldTrump: The global warming we should be worried about is the global warming caused by NUCLEAR WEAPONS in the hands of crazy or… A bit more detail on the upcoming AlphaGo commentaries from Aja Huang at DeepMind: https://t.co/2aYmL4riKR Aja Huang and Fan Hui on AlphaGo: https://t.co/O4TgUa8eIi @ShaonaGhosh https://t.co/4xCpSHz8mt maybe also worth checking out, based on Scratch but more guided/constrained lessons. @ShaonaGhosh I suspect it could still be useful for them, but no direct experience. May be some literature on this/guidance on the site... @ShaonaGhosh Scratch is pretty huge (and useful, IMO, based on experience with middle schoolers using it). RT @GlennThrush: This seems big: From @Morning_Joe: 3 times during a natsec briefing Trump asked 'Why can't we use nuclear weapons?' https:… RT @RadimRehurek: Keynote at USGC: "The Story of #AlphaGo" (@DeepMindAI team's perspective) https://t.co/sFwNIeGEBd RT @tonyschwartz: Trump selling copies of Art of the Deal for $184 to raise money for campaign. Isn't worth paper it's printed on. I should… @sknthla gotcha, thanks. @sknthla IYI? @sknthla that's unfortunate ;) @sknthla 24 hour diners are the best/sort of subsume that category. Don't seem to be (m)any here in the UK, though. RT @jackclarkSF: What generative models are definitely useful for and what they *might* be key for - Ilya S @OpenAI #scaledmlconf https://… @BrianSJ3 hmm can you give an example? not sure I follow @halhod tried it for the first time the other day and loved it but wasn't sure I understood the model. is it great? what's the catch? ;) "Discovering Latent States for Model Learning," Nikolas Hemion: https://t.co/RWvRVZcxHk "A Neural Knowledge Language Model," Ahn et al., Montreal: https://t.co/CKi141gLNA Paper link: https://t.co/gSehQzUiHf The = part there is supercomputers' "parallelization efficiency" over time. Another relevant graphic from the paper: https://t.co/GgAT82Wg7u "Comments on the parallelization efficiency of the Sunway TaihuLight supercomputer," Vegh. = Moore's Law-like trend. https://t.co/bC8pBvDJNX @mark_riedl the classical planning algorithms that determine their food/drink refills at airports are punishing you for using neural nets. RT @fchollet: Keras-RL: a new library to do reinforcement learning in Keras. https://t.co/19lklht9zm Don't think I'll get a British accent here since I mostly hang out with Americans/Swedes, but I do find myself wanting to say "proper" more. @sknthla sadly, I'm in Oxford, as I'm looking for something similar ;) RT @vkrakovna: New blog post on openness in different aspects of AI development, exploring some of the nuances and tradeoffs.... https://t.… @FrankPasquale you mean US feds? Are they supposed to worry about monopolies in other countries by US corps? had assumed just domestic ones. @mark_riedl yeah, did see that, but didn't participate AFAIK.. https://t.co/v9U6UDqF41 @mark_riedl yeah, exactly. There's no doubt in my mind it has a lot of potential, just a Q of how much time/teamwork required to apply... @mark_riedl yeah, not expecting DeepMind (/other industry) participation, though that'd be kind of funny... @mark_riedl (I'm not ruling out this year, but agree maybe not...even if possible in theory/DeepMind's done, takes time for teams to apply) @mark_riedl b/c u think it's not ever gonna help or just too soon? This (https://t.co/6soM7u9VEN) suggests not THAT far off, maybe next yr. Interested to see if any of the (top) bots this year use deep learning. https://t.co/xtI0W1w2Nb RT @boredyannlecun: At DNC @HillaryClinton shattered glass ceiling, winning presidential nomination. One day women can even participate on… (by putting lots of sensors in homes, trying ML models on the data, and evaluating different theories of cognitive/linguistic development) "Machine learning in manufacturing: advantages, challenges, and applications," Wuest et al.: https://t.co/jITFNkOLr9 Looks pretty good... "Recurrent Neural Machine Translation," Zhang et al. at Xiamen/Soochow: https://t.co/H7KP4bIWy0 "A roadmap for reverse-engineering the infant language-learner," Emmanuel Dupoux: https://t.co/3W9mC13DBI CC @rbhar90 re: the data part... RT @jackshafer: "We'll be looking at that." Trump's fallback response when he has no understanding of the subject he's just been asked abou… @sknthla I don't... I assume anything really worthwhile will be tweeted/FB posted in various groups I'm in, etc. + seems kinda toxic, no? First they came for the vision ppl...then NLP...now storytelling/games (/whatever other fun stuff @mark_riedl does). https://t.co/TkBmkmwHlK RT @JigarShahDC: How @realDonaldTrump feels today https://t.co/EjaFvIj8BI @Gang1man agreed! They even both use the older models so as to allow installing Linux (and in the Person of Interest case, to avoid Samaritan malware...). (The highly compressed Machine 2.0, that is. It did not originally run on PlayStations...) Condor Cluster (Air Force), The Machine (Person of Interest), both run by PlayStations... https://t.co/iDo7yTEvij https://t.co/xz4uFUQnFa @AnaPopescu_SV :( @AnaPopescu_SV not sure that anyone who supports him/doesn't have issues with other things he's done would have issues with that... Papers for the workshop on evaluating general-purpose AI next month: https://t.co/bCO6L1PSi1 Recommended. https://t.co/2tlNWaxIMa RT @jackclarkSF: Sign up for my artificial intelligence newsletter here. https://t.co/GzihdhdhZp First one comes out on Monday! @sknthla watch Mr. Robot, then? code vicariously :) "RT @erikbryn: Great review by Nordhaus and great analysis of the past by Gordon. I'm much more optimistic about the future. #2MA https://…" RT @SethBaum: My new working paper w/ @GCRInstitute, on motivating AI researchers to choose good designs https://t.co/xGT6xh9Kw0 https://t.… RT @GCRInstitute: Working Paper: On the Promotion of Safe and Socially Beneficial Artificial Intelligence https://t.co/O2fn2e9oFY @kennethpayne01 for sure...maybe next week? Looks like I'll be visiting Cambridge the week after next - if you're there and want to meet up, let me know :) RT @KelloLucas: Clinton campaign hacked. https://t.co/Y5KgIjSJUq @starsandrobots perfect title. (from last link) Raia Hadsell at DeepMind on progressive nets: https://t.co/j836Hj3OBr Videos from the RSS workshop on "limits and potentials of deep learning in robotics." https://t.co/I0uv7rcdf7 RT @kennethpayne01: Orangutan Found To Imitate Human Speech For The First Time via @IFLScience: https://t.co/zrpGzJU7WF "RT @ylecun: Geoff's acceptance speech is very short, but pure gold. Congratulations, Geoff. https://t.co/pPLfuUEAJG" """Adversarial training is the coolest thing since sliced bread."" - @ylecun Lots of other stuff discussed here: https://t.co/rwOIUrIvrG" Great week so far working at @FHIOxford :) @j_winterton timely: https://t.co/UO5RzBCVyU @j_winterton robustness against current/future AI-enabled/-based systems! :) RT @Snowden: Democratizing information has never been more vital, and @Wikileaks has helped. But their hostility to even modest curation is… RT @OpenAI: We're looking for machine learning experts interested in leading some important new projects: https://t.co/aGb0wCRs8P. RT @j2bryson: Should we let someone use AI to delete human bias? https://t.co/DGtksYImpO ht @aylin_cim @random_walker @WordsByBennett @hann… "MS-Celeb-1M: A Dataset + Benchmark for Large-Scale Face Recognition," Guo et al. at Microsoft: https://t.co/lopMd29qKG Training set=10 mil. Haven't read yet but very thoughtful folks involved and at first glance, looks good/complementary to Amodei/Olah et al.'s/others' agendas. New @MIRIBerkeley research agenda paper, "Alignment for advanced machine learning systems": https://t.co/JaLcD4MbBO + discussion of context. RT @boredyannlecun: Bill Clinton almost makes me believe in @HillaryClinton, like @lawrennd almost makes me believe in Gaussian processes #… "Optimal Curiosity-Driven Modular Incremental Slow Feature Analysis," Kompella et al. at IDSIA: https://t.co/Ywys2t5hqN (paywall :( ) @nsaphra ... and at crossover for chess, Deep Blue/Kasparov was only 3.5 to 2.5 victory :) we'll see...but either would surprise me a lot. @nsaphra though only one game at the (I think) crossover point [March], + per Silver, it continued to improve with further training/mods... @kleinsound @jackclarkSF yeah, I don't have strong feelings on the matter :) just glad @jackclarkSF is doing this! @kleinsound @jackclarkSF true, but to play devil's advocate, ppl maybe more likely to read on wkend? + end of week arxiv roundup possible :) (difficulty in terms of state space size/branching factor and, related, board evaluation due to homogeneous stones....maybe other reasons). Lots of possible explanations, but I suspect a big part of it is the intrinsic difficulty of Go, with humans farther away from upper bound. The computer>human crossover point for chess was a lot longer ago than the Go one, yet the computer/human gap is already much bigger for Go. @ShaonaGhosh congrats! RT @j2bryson: I normally hate #AI “art”, but this is an astounding mix of random, weird narrative coding choices, and well #Batman https://… "CFGs-2-NLU: Sequence-to-Sequence Learning for Mapping Utterances to Semantics and Pragmatics," Summerville et al.: https://t.co/aPYYWtXvgC Not sure they're not, either, but haven't seen much analysis one way or the other, + seems unlikely for various reasons... As I've mentioned before, I'm really not sure that the US Patent and Trademark Office is competent to handle these sorts of claims... In related news, I looked into Brain Corp. and it looks like (part of) their strategy is to patent everything ever: https://t.co/AfDaPcYQ6N "Unsupervised Learning from Continuous Video in a Scalable Predictive Recurrent Network" Pieknewski et al/Brain Corp https://t.co/kBSRGQ3O97 "An Actor-Critic Algorithm for Structured Prediction," Bahdanau et al.: https://t.co/oCMo6tDlce "DeepWarp: Photorealistic Image Resynthesis for Gaze Manipulation," Ganin et al.: https://t.co/Xqi1OrMNbm https://t.co/aqmHYEs07h @sknthla Player of Games. RT @danielas_bot: I'll just leave this here: https://t.co/XMPZ1XZ5yj @shakir_za nice post! RT @shakir_za: New post: 'Learning in Brains and Machines (4): Episodic and Interactive Memory'. On being a mental time traveller. https://… RT @demishassabis: Meantime, we will soon be posting some special commentaries on the Lee Sedol games + for the first time ever some #Alpha… RT @demishassabis: Quick #AlphaGo update: we're still exploring a number of options while actively working on improving the program - thank… RT @MaxBoot: Reminder that Trump's pro-Putin toadying isn't a new thing. https://t.co/jMy8mvB3h7 RT @phelixlau: Deep learning approach for the classic traveling salesman problem https://t.co/KaLmslLWC8 https://t.co/jHPgAZe7qo RT @boredyannlecun: ML researchers fear inescapable local optima. But @realDonaldTrump poses a graver threat: the inescapable local nadir #… RT @boredyannlecun: Donald Trump's a black hole in the space of differentiable politics where all gradients point away from progress. #torc… RT @cortney_dc: Do you know the standard the #Intelligence Community uses to decide an #AI project is too risky? Neither do they. https://t… RT @BrianSJ3: @Miles_Brundage no such thing as real uk weather, which is why we talk about it Loving the UK so far. Alas, real UK weather hasn't kicked in yet, but still... @robinhanson how would you operationalize "full human level common sense AI" + what would odds be for 15, or 20 years? @fchollet fair enough :) @fchollet anything else you had in mind on the right (or, are either of those guesses wrong)? @fchollet I'm guessing that, e.g. you think (some) comp. neuroscience/neural net work is on left, hierarchical temporal memory on right? RT @fchollet: If you're not sure if a given "brain-based theory of machine intelligence" is worth your attention, here's a guide. https://t… This isn't a serious argument, but I can't resist pointing out that the robot gets up right after this clip ends. https://t.co/j2TLvJNGpm I'm a big fan of Bored [scientist/entrepreneur] accounts. "RT @BoredSynBio: People often ask what I think about Human Genome Project 2.0, so here are my uncensored thoughts. First, we sho... Is th…" RT @BoredSynBio: Bioluminescence sabers. RT @BoredSynBio: Microbes that manufacture hoards of cash, then hand it to microbes that make renewable fuels. @svalver e.g. one possible narrative: recent prog. faster b/c optimizing less complex system (learning algos, vs. hand-crafted full system). @svalver ...have been thinking about how some of these/related ideas in ur other pubs relate to AI prog., e.g. its design complexity. @svalver @svalver agreed :) just construed "cannot" as a stronger claim.. Anyway, good paper. Interested to chat abt. the relevance to AI... @svalver but there are at least some other cases. Maybe different issue/domain/level of abstraction than what you're looking for... @svalver ...what do you think of expo. trends in some areas like satisfiability solvers (https://t.co/F29YSxylx1)? Just 1 datum, admittedly, @svalver was referring to this passage (see pic), not hw/sw asymmetry :) that's an interesting point, though... https://t.co/wt18BTh1My @svalver not sure I agree w/ dichotomy btwn social/technical predictability but anyway, an enjoyable/provocative read :) Interesting from @svalver: "Major transitions in information technology" https://t.co/r48yNvev4d maybe of interest to @j2bryson @robinhanson RT @markus_with_k: #PokemonGO https://t.co/SaV26liH3Z RT @SusanEMcG: Example from @aylin_cim: gender-neutral Turkish pronouns stereotypically gendered upon @google translation. #pets16 https://… RT @ankurhandos: Amazing, within a day we have torch, tensorflow and keras implementations of layer normalisation... https://t.co/EBD6Jhl1S2 RT @nova77t: That was quick! :) https://t.co/4Ewq1NtYZn RT @j2bryson: Heuristics improve rationality; AI is improving ours. https://t.co/69Vm9LpUp9 A blogpost responding to @JohnDanaher. https://… I've seen at least one Pokemon Go player in the UK so far...nothing like this, though. https://t.co/P9Ih2T2CLC Or not. Seems to be one on High Street in Oxford...Ohio. Oh, well. Oxford, UK, seems to have all the bad US chains, but no Chipotle. @alexjc @samim CC @smc90 @Aelkus RT @JeffBezos: .@matteorenzi excited to announce Amazon artificial intelligence & machine learning center in Turin https://t.co/jxa7VxWZHF TIL Oxford has Chipotle. 👌 "Dataset and Neural Recurrent Sequence Labeling Model for Open-Domain Factoid Question Answering," Li et al., Baidu: https://t.co/pzyvnGYFEp "Layer Normalization," by Ba, Kiros, and Hinton: https://t.co/IV7HqoXNxO RT @svalver: The Major Transitions in Information Technology: Evolution or Revolution? https://t.co/tx2T4cjAOC https://t.co/4LdHdR3c4m RT @nerdsrocket: Violent arrest of teacher caught on video; officers face investigation https://t.co/7nctXcmz9O THE CONVERSATION W/ THE COP… RT @bill_e_wheeler: Pilot w/ working title "A.I." - collaboration with director Luc Besson and TNT - is in script phase and will hopefully… "Exploiting Multi-modal Curriculum in Noisy Web Data for Large-scale Concept Learning," Liang et al.: https://t.co/7RpZZD5onI "Piecewise convexity of artificial neural networks," Blaine Rister: https://t.co/zVvkkG5yu4 Imitation Learning with Recurrent Neural Networks," Khanh Nguyen: https://t.co/NcEGLFkvsp "DSD: Regularizing Deep Neural Networks with Dense-Sparse-Dense Training Flow," Han et al.: https://t.co/etmtVvlsT2 "Guided Policy Search as Approximate Mirror Descent," Montgomery and Levine: https://t.co/98yvQNXYvZ "Information-theoretical label embeddings for large-scale image classification," @fchollet at Google: https://t.co/EVetPvBOwQ "Generating Images Part by Part with Composite Generative Adversarial Networks," Kwak and Zhang at Seoul Nat. U.: https://t.co/arkcAGKO9W (another Canadian deep learning for NLP startup, apparently...) "Neural Contextual Conversation Learning with Labeled Question-Answering Pairs," Xiong et al. at RSVP Tech/Waterloo: https://t.co/hkP1f33qHQ Looks like a good review - "Visual Question Answering: A Survey of Methods and Datasets," Wu et al. at Adelaide: https://t.co/sshpjxGwi3 "Robust NLP - Combining Reasoning, Cognitive Semantics + Construction Grammar for Spatial Language," Spranger et al: https://t.co/88x9QhK5sZ "Stochastic Backpropagation through Mixture Density Distributions," Alex Graves at DeepMind: https://t.co/BaHZjvbV1T "Systematic mistakes are likely in bounded optimal decision-making systems," Livnat and Pippenger, 2008: https://t.co/1IAqG7fMZX "An optimal brain can be composed of conflicting agents," Livnat and Pippenger, 2006: https://t.co/ZYq8i5tv1L @KaiLashArul for sure! Will definitely be around at some point in the not too distant future :) @ianpaulwright thanks! :) @AnthroPunk def. Will you be in UK soon? I will prob. be in Bay area in spring; if neither works, Skype. More time to chat now that ABD :) Def. interested in talking to any folks interested in such things :) Lots of plans for next few years w/ that + other Oxford stuff... Dissertation topic: "New methods for AI policy analysis and responsible innovation" (said methods=modeling of policies + scenario planning). @knewscript starting a Research Fellow job at Oxford, researching AI policy stuff. RT @mustafasuleymn: Big shoutout to our Doogal Team (DeepMind4Google) for a massive 15%/yr energy saving for ALL @Google data centres https… In other news, I'm finally ABD! Been a busy few weeks/months. I owe you all some arXiv papers (and a lot of people some emails)... RT @fchollet: My paper on label embeddings is on Arxiv. Many Nvidia K80s worked hard to bring you these numbers https://t.co/D2LL8HCAxa Just arrived in the UK! Looking forward to a fun and productive two years here :) RT @HMRoff: Yes.. He encourages hate, racism, sexism, homophobia and antisemitism. Such a gift. https://t.co/SHUmO7emIX @mhbergen not sure I understand. Would think they're either technically part of Goog or not? Are u saying they arent but allowed 2 use name? @mhbergen (Google DeepMind to be precise...but I've seen no indication they're separate from Google...?) @mhbergen nice article but think part abt them being outside Google incorrect - their website, slides, papers, email addys, etc. say Google. RT @erik_fisher: Journal of Responsible Innovation, issue 3.1, now online ... editorial here https://t.co/XuxL21kiY6 Off to Oxford tomorrow! RT @BenLaurie: DeepMind is hiring! I need security people! Contact me or https://t.co/Ix6cMoJ3lp. "Playing Atari Games with Deep Reinforcement Learning and Human Checkpoint Replay," Hosu and Rebedea: https://t.co/nvPCnG9OSY "A Batch, Off-Policy, Actor-Critic Algorithm for Optimizing the Average Reward," Murphy et al.: https://t.co/ivvf6T4Xoc RT @DG_Rand: New meta-analysis: Cooperation, Fast & Slow- deliberation reduces pure (not strategic) coop https://t.co/bPkbuvUjyG https://t.… @zeustoves @nerdsrocket @knewscript @AliMattu never heard of it either! will check out. @mark_riedl and neither they nor many others entered the competition... @_brohrer_ thanks!! @_brohrer_ would be interested in slides/outline if available :) "Limiting the Undesired Impact of Cyber Weapons: Technical Requirements and Policy Implications," Bellovin et al.: https://t.co/Agh1jwaqJH @SparseJacobian oooh, sounds fun, thanks for the invite! Alas, leaving in the morning :( Pokemon Go stampede in Bellevue, WA (I'm walking my dog and among the only non-players apparently)... https://t.co/vZ38tQ19ll @rao2z congrats on a great conference! RT @hardmaru: Generating Long-Term Structure in Songs and Stories https://t.co/7b2yRgOKA9 RT @zeynep: Folks, yes, by all indications this is an ongoing coup attempt in Turkey. RT @nathansttt: Peter Stone introducing the CogitAI team at #IJCAI16. A brain trust of well-known academics. https://t.co/3w87SYI3JD RT @TobyWalsh: Black Inc: new book: Thinking Machines: The Future of Artificial IntelligenceToby Walsh ... https://t.c… @togelius (last I checked it looked like time was left on that one, but on the road so couldn't check carefully) @togelius are the results in for the other competitions? RT @rcalo: .@nytimes @roomfordebate on ethics of police robots. With @elizabeth_joh and I and others https://t.co/tDw9eMdxih RT @j2bryson: Competition for Cooperation: variability, benefits and heritability of relational wealth in hunter-gatherers https://t.co/yoD… TFW you release paper version 2 because a relevant paper came out the day after v1. Deep learning's moving quickly.. https://t.co/5JO5At0beg Crossing the Arizona/Utah border - slightly sped up :) very scenic, though this POV doesn't fully capture it... https://t.co/qFxJm0CHS5 RT @jxfeb: Our work on Neural Generative Question Answering https://t.co/oh7D5pEWYZ #IJCAI16 https://t.co/nd8tekeru8 "Reliable Confidence Estimation via Online Learning," Kuleshov and Ermon: https://t.co/9Z2h7Rk8AI "Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation," Ghifary et al.: https://t.co/r8nD8T7WFq RT @katjahofmann: The paper to go with our #IJCAI16 demo "The Malmo Platform for Artificial Intelligence Experimentation": https://t.co/v1W… Israeli flag, Trump edition (taken at a restaurant). https://t.co/00qKOjgZql Chen et al. may have been right and we're even closer to the ceiling now - just thought that was interesting. Reports 73.7% on CNN task, 77.2% for Daily Mail, above what Chen et al. suggested was near ceiling a month ago (https://t.co/PNnoFM8xJu)... "Separating Answers from Queries for Neural Reading Comprehension," Weissenborn at DFKI: https://t.co/77QmWSNRIm (from folks at Hong Kong University of S&T and SenseTime, this Beijing startup: https://t.co/8UdbQyZY5d) "Network Trimming: A Data-Driven Neuron Pruning Approach towards Efficient Deep Architectures," Hu et al.: https://t.co/4t4VfdfFDs RT @MatthewGombolay: CNN Money picked up our healthcare #robot w/ my fantastic collaborators @neel_shah @julie_a_shah @hayesbh and more. ht… @mat_kelcey when the next Russell/Norvig edition comes out, it'll be all the rage... for at least a few weeks (hopefully more)... @MatthewGombolay congrats on all the buzz! :) Wish I could have caught up with you at IJCAI but alas, had to leave early... RT @MatthewGombolay: Thanks @ComedyCentral for adding a bit of humor to my thesis! I'll get to work on a pizza NAO. @hayesbh @MIT_CSAIL ht… RT @Altimor: And if output of NNs = refined oil, the winners will be the ones who own the distribution. https://t.co/9dRyPzOHt2 @mark_riedl @jackclarkSF nor was 80s hype about broad/deep, per Luke here: https://t.co/HfloU07KBV RT @togelius: .@Amidos2006 @gvgai @ijcai16 We will post the link for participating tomorrow Wednesday at 10am. RT @togelius: .@Amidos2006 @gvgai @ijcai16 Everyone will be welcome to participate in the judging of level generators online (and at the co… RT @togelius: Tomorrow at 10am-5pm EDT @Amidos2006 and me will run the @gvgai General Video Game Level Generation competition live at @ijca… "Automatic Bridge Bidding Using Deep RL," Yeh and Lin at National Taiwan U.: https://t.co/TedvMSeKi6 beats SOTA w no init. bidding knowledge "Recurrent Highway Networks," Zilly and Srivastava et al. at ETH Zurich/IDSIA: https://t.co/KqiPaXoV6C Highly recommend this book (https://t.co/nPKTT2Tg62) to ppl interested in scenario planning. Best I've read. Working on some related stuff.. @halhod @alexjc think 1st criterion is less specific to data than human part, but yeah, raises lots of issues. Wld discuss more but plane :) @halhod @alexjc often not actually made public in papers promising such, and often limited in terms of domain breadth/size/etc. @halhod @alexjc seemed to be a contested pt yesterday (how key it is going fwd) but contours/args unclear; Pineau said dialogue data was... @halhod @alexjc but would def like to see more! most of those threads not super nuanced... @halhod @alexjc and ofc the privacy/ethics angle you're well aware of :) not sure I see it as underdiscussed but maybe I am in weird circles @halhod @alexjc lots of diff threads. data should be pub thread, data is new oil, data holds back prog in X (Pineau said NLP yesterday)... @halhod @alexjc it's getting fair amt of attention, I think? eg https://t.co/z7tvSofTGu much discussion at deep RL wkshop... @alexjc @halhod yes. No need for focusing on only one variable. AI ppl should be able to handle a complex progress function :) *without GPUs, not without CPUs. Thanks for catching that, @CauseMean. Lots of typos from me today. Should prob. stop tweeting. @CauseMean ah, thanks for catching the typo :) @halhod @alexjc e.g. DQN != Q-learning, ALE !=dataset, Watson != MOE...etc. @halhod @alexjc FWIW: lots of issues w/ empirical part of that (Wissner-Gross's) analysis. arg may have merit but not proved by his..data ;) (A3C is one of the best current deep RL agents, can be trained quickly without CPUs, and avoids need for experience replay). Wasn't clear to me from Silver's remarks yesterday if DeepMind's Labyrinth release will include A3C agent. Would be interesting if so... @jackclarkSF yeah...at least now we have (a) neural net reporter(s) to help sort it out ;) @jackclarkSF ...i.e. reminding ppl they already use AI and wow, deep learning is cool, etc. But of course there's future-oriented hype, too. @jackclarkSF many of those did in fact happen (filtering, recommendations, etc.). Feel like hype now is more about what exists than future.. RT @RobWortham: Manuela Veloso talks about need for #robot #transparency. #CoBots implement some automated verbalisation #ijcai16 https://t… Specifically, I had in mind changes due to un-/semi-supervised/otherwise more efficient learning, but lots of things could change landscape. Data def seems v valuable now, but imaginable it could get more/less scarce. See also @beaucronin's scenarios: https://t.co/PsFzPpFgN3. If data=oil, IT companies like oil ones should be prepared for possible price crash (cf Shell vs others in 70s/80s). https://t.co/f3nDMdXF01 RT @mpshanahan: @Miles_Brundage The other person was Maria Fox from King's College London RT @MatthewGombolay: Dear #IJCAI16 - If you want to learn "what's under the hood" of our robot reported in CNN Money, come to the HAAI2 ses… RT @googleresearch: Congratulations to David Silver and Sylvain Gelly, who received the AIJ 2016 Prominent Paper Award! #IJCAI16 https://t.… @mpshanahan + other person (dunno name) raised good Qs re: planning viz-a-viz deep RL. Ignore good planning algos? If not, how incorporate? The bullish take on deep RL summarized (other talk by Silver). + increasingly proven in many domains, scalable, etc. https://t.co/FkoZ76J47c Particularly impressed by Joelle Pineau's talk on RL for NLP - lots of unexplored directions proposed. And of course Silver's very bullish.. Lots of excitement about deep RL at the workshop yesterday at #IJCAI16. Doesn't seem likely to go away or stall anytime soon... @F_Vaggi to some extent, but vanilla MCTS has strongly diminishing returns as I understand it. Their strong evaluation key to scaling well. meant to say .5% chance. Still not great odds. (those are crude calculations based on Elo scores...but the point is, it's very good. Also, I'm bad, but no one is likely to beat it now). My odds of beating AlphaGo are ~1 in 1,00,000,000,000. A very good amateur's odds are better but still not too promising (~1 in 10,000,000). Lee Sedol deserves huge props for winning one game. Also possible estimate is high. But didn't stop learning there, so very superhuman now. AlphaGo version 18's estimated Elo score was 4500. That's high. ~900 over human. ~.05% chance of best human winning. https://t.co/47ZZhbShkZ RT @aireye: Seoul #AlphaGo @DeepMindAI used a custom Tensor Processing Unit (TPU) which was 20x faster than GPUs used in Nature paper versi… RT @SethBaum: New paper: Alternative Foods as a Solution to to Global Food Supply Catastrophes w/ D Denkenberger, @ProfPearce https://t.co/… @beaucronin lawl RT @DanielaJPalombo: @cMadan @ylecun well, yes, I was asked to review it but I turned it down because I was just too busy😆 RT @brain_apps: @cMadan @ylecun how do you think he handled reviewer 2?? Dear Mr President, unfortunately your comments are "incremental" a… RT @nathansttt: Danger: didn't know if they were overfitting at this point. #IJCAI16 #AlphaGo https://t.co/F6XbkkNMFi RT @nathansttt: What did they improve before the Seoul match? New tensor network hardware. Mostly a stronger value network. #IJCAI16 https:… Obama doesn't seem to have a Google Scholar account. Get your act together, man. ;-) (e.g. this paper my boss at the time and Chu [actually] wrote while in office has 871 citations now: https://t.co/Ag1F7nGpiY). Props. Def not 1st high level official to do so (witnessed Steve Chu write several, too), but anyway, looks cool... https://t.co/qkmrR4TWMd RT @barneyp: CEO survey today at #ceo16: The biggest challenge I see in my business' ability to adopt AI is: lack of talent. https://t.co/0… @RobWortham indeed...thanks! Enjoy the rest of the conference! :) @RobWortham unfortunately, yeah :( flight in the morning. Only paid for workshops so couldn't make tonight. Gotta get back for packing etc. Someone in the audience literally suggested something just like this in discussion at the deep RL workshop earlier. Hope they read arXiv :) "Visual Dynamics: Probabilistic Future Frame Synthesis via Cross Convolutional Networks," Xue et al. at MIT/Google: https://t.co/RGi3P2bTvP "sk_p: a neural program corrector for MOOCs," Pu et al. at MIT: https://t.co/WJCd6JSmtT Can fix 29% of submitted buggy code. "Adversarial examples in the physical world," Kurakin et al. at Google Brain/OpenAI: https://t.co/vTnhQqy2rO Got to briefly ask him about this earlier but have some unanswered Qs and unfortunately will miss the AlphaGo-centric talk tomorrow... Will be v. grateful for anyone who live tweets Silver's keynote at #IJCAI16 tomorrow, especially about post-Fan Hui AlphaGo developments :) RT @AmosStorkey: 1Yr Machine Learning #ML Postdoc #Job, Edinburgh - Amos Storkey: ML/Deep Learning for interpretable representations. https… RT @queerandangry: this is a strange era in human history https://t.co/9O0q9dkgAg (it's a simulated humanoid trained with deep RL to slalom/run through targets in a zig zag fashion) Started filming too late to get the whole thing, but the humanoid slalom thing Silver showed was impressive/funny. https://t.co/luUSaiZWI0 RT @HMRoff: See my new post on Improvised Explosive Robots https://t.co/last0VFh9G (empirically, it does seem to work well, though) TL;DR: Munos of DeepMind at deep RL- Retrace lambda (https://t.co/oVnkjPoDNd) is awesome for off-policy RL, no guarantee w func. approx tho. RT @apsarathchandar: Accepted papers in Deep RL workshop @ijcai16 are now available online: https://t.co/KIv7gevS6u #deeprl #deeplearning Singh bullish on deep RL (some of the reasons here, there were others). Emphasized architecture exploration a lot. https://t.co/TipEnscC77 RT @apsarathchandar: LIVE on #Periscope: Satinder Singh talk Deep RL https://t.co/uOSekZQYT6 @imJinxit do not know, unfortunately. RT @Noahpinion: Hero hugs suicide bomber, dies to save other people: https://t.co/98iXuSq0CO Looking forward to an an intense day of mental model updating at the deep RL #ijcai16 workshop! :) Don't they know the deep RL workshop is tomorrow!?!? But OK, I'll watch it. https://t.co/J3ul6Hnfra (Maximum Entropy Deep Inverse Reinforcement Learning for learning from human driving demonstrations) "Watch This: Scalable Cost-Function Learning for Path Planning in Urban Environments," @markus_with_k et al, Oxford: https://t.co/SrmdIdKwdB @mark_riedl their vacuums are conspicuously spherical, though. Seems maybe not coincidental? RT @io9: Armed robbers have used Pokemon Go to find nine victims this weekend https://t.co/DZ4N9N2VwT https://t.co/5O6FcREc5N @chris_brockett @AnaPopescu_SV I was proud of Neural Notes but I think that wins... @AnaPopescu_SV appropriate only for a certain class of posts, though... @AnaPopescu_SV Neural Notes! ;-) @jedgar until what? @sigfpe wonder no more. https://t.co/3t5txLC46i @jedgar @VincentCMueller yeah, those are def. variables to consider. Most prob. haven't given it that much thought, but I try to at least :) @jedgar @VincentCMueller not 100% sure I understand but if u mean, is more CS/AI funding considered, then dunno, but def. should be IMO. Also, props 4 him giving own prediction (80% conf. re: superintelligence btwn 2040-2100) when discussing @VincentCMueller +Bostrom's survey. Michael Wellman on AI risks: https://t.co/a6e8700ou7 He made similar pts today re: near/long-term concerns being synergistic, not exclusive. RT @xanderai: Most SF thing I heard this week: "You should join us at the founders meditation" @chrisalbon yep, free. Sad to miss the competitions at IJCAI (general video game playing, Angry Birds, Winograd Schemas, social influence) https://t.co/Vj2PNn1TiW Working session at IJCAI on Tuesday on addressing gender imbalance in AI: https://t.co/QXgMLKqygN "Blind Search for Atari-Like Online Planning Revisited," Shleyfman et al.: https://t.co/wZiHzjXJHH "Adversarial AI," Yevgeniy Vorobeychik: https://t.co/Y6FEJoWIbW (and considering they generated pages for randomly selected topics, pretty impressive they're remotely coherent at all. +Other cool results) Looked at one of these (https://t.co/LEhnHqC0sg) and it's...not the best. But apparently they have pretty high endurance + ppl improving em. @maidylm yep! Good reason for me to attend my first IJCAI :) lots of other cool workshops, too. See you around! @maidylm yep! :) just the workshops tho. Was there part of the day today, will be here tomorrow and Monday, as well, leaving Tues morning. "WikiWrite: Generating Wikipedia Articles Automatically," Banerjee and Mitra: https://t.co/KCtYS4riIY "Learning Unified Features from Natural and Programming Languages for Locating Buggy Source Code," Huo et al.: https://t.co/5jC03BI3Na "Open Information Extraction Systems and Downstream Applications," Mausam, on 10 years of prog. in open IE: https://t.co/B5lyT5tmmY "Trading-Off Cost of Deployment Versus Accuracy in Learning Predictive Models," Robinson and @suchisaria: https://t.co/sCkWWrdBRB """Interactive Teaching Strategies for Agent Training,"" Amir et al.: https://t.co/KTGTLiZEWk" Lots of IJCAI paper tweets coming soon... Nice first day of IJCAI (ethics workshop). Looking fwd to tomorrow (mostly general game playing stuff) and Monday (mostly deep RL stuff)! RT @mchui: Latest @McKinsey_MGI research on #automation: Where machines could replace humans—and where they can’t (yet) https://t.co/iyekZs… @mchui nice work! Curious about the tech feasibility analysis, that'll be in final report I assume? I discuss here: https://t.co/zZPicuoZra RT @beaucronin: AWS API Gateway: never before has so much power been so poorly explained @barneyp don't know yet :) only scratched surface of ones that intrigued me + only reading a small fraction. will tweet some today/tom prob. Lots of good stuff here (IJCAI proceedings): https://t.co/HhxIo5RFu9 RT @rao2z: #IJCAI16 proceedings online! Head over to https://t.co/NVb9azH4Da pronto... #ai #ijcai2016 https://t.co/ckTbrF0hQW My advisor on Alvin Toffler. https://t.co/9vqontYjug @fchollet gross... @Aelkus and "My CPU Is a neural net processor, a learning computer" coincided with earlier NN hype wave. Prob seemed sillier in 90s than now RT @mp_roberts: ...however, we will put an image of a killer robot just to confuse you https://t.co/3WbOCyamlW @j2bryson ooh, added to the list. will check out after I send paper [which will be very shortly ;) ] RT @rcalo: How the Robot-Controlled Bomb Worked https://t.co/AKj4Havcif ht @SteveBellovin @rcalo working on paper w/ @j2bryson on this :) (well, AI policy, but notes interconnections). References u. will send eventually.. RT @togelius: I'm an AI and games researcher from Malmö. How strange that I'm not involved in this somehow. https://t.co/MKkBm9qMkK @mburnamfink good luck! RT @ericoguizzo: Dallas Police Used Robot with Bomb to Kill Ambush Suspect: Mayor https://t.co/atWYbEjWPR @togelius good pt. And perhaps main difference from old ML benchmarks to some of these is not so much generality but 3D/raw pixel-ness... @kleinsound but as to who learned what/main takeaways, hard for me to say. i'm a non-representative sample... @kleinsound ultimate outcome TBD/will take longer to see. WH will put out report later this year reflecting the events+RFI, + AI R+D strat. @kleinsound hmm good Q. Besides some ppl in audience being better informed(/participants learning from each other) abt some issues, ... Oh and @gvgai!! Not sure how I forgot as I'm going to related workshop soon :) (maybe that's why...conference brain overload). thx @togelius @togelius totally right about GVGAI! Oops re: the omission. @togelius I think VizDoom and Malmo both have or will have multiple tasks (if not already pushed, then at least in papers)...but - We've gone from few general-ish AI evaluation enviros to several with various interconnections (ALE, Gym, Malmo, VizDoom, soon Labyrinth)... @mgubrud will be interesting to see how far that goes/at what point it stops being Go Old Fashioned Deep Learning ;-) @mgubrud DL++, perhaps Definitely a building block, but there's an interesting trend toward reintroducing various structure... RT @MSFTResearch: Project Malmo lets programmers test AI algorithms in Minecraft—available now on Github https://t.co/zEjMvF6OLe https://t.… RT @mgubrud: First coiner of "AGI" totally agrees. Only way to get to the mountaintop is to climb it & that's what's happening now. @Miles_… @robinhanson congrats! RT @robinhanson: I'm honored to begin a new @open_phil grant to study AI as software: https://t.co/MjjtsjHvmw Hope to find out there from Silver (or from folks who attend his IJCAI keynote) whether AlphaGo's performance ever plateaued/at what Elo. One tweet version though: generality not binary, humans not fully general/in some ways less general than some AI, >0 progress on general AI. Really want to write a blog post about problems with "AGI"/"narrow AI" framings but alas, at least two papers are more urgent RN... Schedule for the IJCAI Deep RL workshop on Monday is up: https://t.co/bMeUtGv7lp Should be very interesting... RT @terahlyons: "I think we have to innovate as fast with the governance as we do with the technology." @mustafasuleymn (phone was dead for most of AI Now or I would have live tweeted some more :/ lots of stuff on the tag #AINow, though, and was recorded) @mustafasuleymn at #AINow: I'm confident there'll be a lot of progress in deep learning interpretability in next few years. Just got out of #AINow... esp. enjoyed back + forth btwn @LatanyaSweeney and @mustafasuleymn on US/UK health systems :) RT @josephreisinger: Incontrovertible proof that writing a PhD thesis is the least metal thing you'll ever do https://t.co/liTFENuopm @pmarca carefully orchestrated by our simulators, maybe. Stress-testing humanity. @AnaPopescu_SV don't apologize, please do!! ;) together we have the whole conf. covered... @AnaPopescu_SV shouldn't be hard. It literally says how to tell on her Twitter profile (maybe some signed ones fake, but unsigned def are). Well, the CEO did say they were serious about AI... not sure how good this is, though (?) "Guided Alignment Training for Topic-Aware Neural Machine Translation," Chen et al. at eBay (!) and RWTH Aachen: https://t.co/RM9GP3o7kK "Global Neural CCG Parsing with Optimality Guarantees," Lee et al.: https://t.co/BrSvVZrHdb "Cost-Optimal Algorithms for Planning with Procedural Control Knowledge," Shivashankar et al.: https://t.co/eAoMvA7yqA "Chains of Reasoning over Entities, Relations, and Text using Recurrent Neural Networks," Das et al.: https://t.co/7T0N1IF7wf "Deep CORAL: Correlation Alignment for Deep Domain Adaptation," Sun and Saenko: https://t.co/SpozDT8i8T "Bag of Tricks for Efficient Text Classification," Joulin et al, Facebook: https://t.co/ukwi6ND0QY "often on par w DL," orders of mag faster At least, if it isn't in (a) massive room(s)... we'll see. Some hard decisions to make re: optimal IJCAI workshop attendance. What I know for sure is: don't be late for deep RL if you want a seat... RT @fchollet: New blog post: On the importance of democratizing Artificial Intelligence https://t.co/vql2vM6cwb @jathansadowski congrats! Wish I could have made it (on a flight RN) RT @rao2z: Word is that #IJCAI16 registrations already surpassed the recent IJCAI records. Now if we can pull together and overtake IJCAI85… RT @ARPAE: Meet RoCo, a roving robotic air conditioner and part of our DELTA program https://t.co/5Y81wJkw47 @beaucronin you read Lady of Mazes? If you like that, may like this too. Almost done and love it. RT @beaucronin: Data-efficient learning algos aren't just another ML technology, but could deeply disrupt current AI biz models https://t.c… @Jenny_L_Davis hmmm... Gloria Steinem, Phyllis Schafly ( :( ), Marilyn vos Savant, Hannah Arendt... RT @beaucronin: I wrote a thing about how & why AI might change beyond our current data-dominated, DL-everywhere era https://t.co/RBKlnMHmGb @n_srnck @girlziplocked @nick_evans I liked this by Olin Wright on related issues: https://t.co/jIj1da7b61 "AdaNet: Adaptive Structural Learning of Artificial Neural Networks," Cortes et al. at Google/Courant Institute: https://t.co/W399CeUcp8 @beaucronin maybe the remaining ones are least likely to be enticed? still play key role in training obv, but shift def substantial/ongoing. @beaucronin dunno, but do think the evidence is clear by now that just as good research can/does happen in industry, but still tons in acad. RT @JiboInc: We're excited to announce that Michael Jordan is joining the Jibo advisory board: https://t.co/SdBN6eHcUW @voicesofai will be there tomorrow night to Tues morning (early). @beaucronin update: et tu, Sutton and Jordan? (Sutton advising Cognitai, Maluuba; Jordan - Jibo). @AnaPopescu_SV for sure! maybe AAAI in SF next year? :) @AnaPopescu_SV awww we won't be able to meet then :( I leave Tues. morning (wanted to stay longer but gotta pack etc. for UK) Heading to NYC tomorrow for IJCAI workshops and the White House event - hope to catch up with/meet some of you there! :) RT @katecrawford: AI Now is this Thursday night! Advance tickets all gone, but we've saved some for the door if you show up early. https://… "RT @j2bryson: What Does the Robot Think? Transparency…[in AI] @RobWortham @RecklessCoding & I, @ https://t.co/gOV4Fq6xRN Saturday https://…" "RT @mustafasuleymn: Here’s my talk announcing our exciting research effort on diabetic retinopathy with @Moorfields https://t.co/jUVRTbm0hC" RT @mustafasuleymn: I just published “DeepMind Health: our commitment to the NHS” https://t.co/LpodyePzcB RT @mustafasuleymn: 3/3 @Moorfields research will focus on AMD & diabetic retinopathy, which affect 625k+ in UK and 100m worldwide https://… RT @mustafasuleymn: 2/3 Together we're exploring how machine learning can be used to help the NHS treat and diagnose eye conditions https:/… RT @mustafasuleymn: 1/3 Really excited to announce our first medical research project, in collaboration with @Moorfields Eye Hospital https… RT @Sam_L_Shead: Google DeepMind is applying its AI to 1m NHS eye scans to see if it can learn how to spot early signs of blindness https:/… "RT @DeepSpiker: Our work on learning 3D Structure from (2/3)D Images https://t.co/KG20rjlUqx https://t.co/dj2dTMhV4z #generative #3D https:…" "Superintelligence cannot be contained: Lessons from Computability Theory," Alfonseca et al.: https://t.co/qt9JDYWUNT [for 1 def of contain] (and women 10% more likely to not self-cite at all) "Men set their own cites high: Gender + self-citation across fields + over time," King et al: https://t.co/MLjR8lqL5h Men self-cite 70% more "A Hybrid POMDP-BDI Agent Architecture with Online Stochastic Planning and Plan Caching," Rens and Moodley: https://t.co/L812kNrWAD "Context-Dependent Word Representation for Neural Machine Translation," Choi/Cho/Bengio at Samsung/NYU/Montreal: https://t.co/GoubRulMG3 "Unsupervised Learning of 3D Structure from Images," @DeepSpiker et al. at DeepMind: https://t.co/rrjx26zpZp RT @janexwang: There is currently a rap battle going on between @ylecun and @boredyannlecun https://t.co/UGj7aztL4D Joy the joey in Williams, AZ. https://t.co/84b81fBqz5 RT @ylecun: @boredyannlecun won't make me croak \ mock me? I stand like an oak \ I never miss a pun, even about flows \ I only miss a pun… RT @boredyannlecun: This @ylecun's a decent bloke \ gotta give him a hand, he can take a joke \ missed my pun on tensorFLOWs \ but it's al… Self-driving car ethics, SMBC edition. https://t.co/FBc2pEmTXX via @KaiLashArul @KaiLashArul haha, perfect :) ...and within gov'ts, not just military/intelligence but other gov't functions/agencies, as well :) Reference to "complex"=semi-tongue in cheek/not nec negative, though would prob. like to see more ppl advising govts/NGOs, not just corps... Also, Richard Sutton is apparently an advisor there - and also at Cogitai. The AI academic-industrial complex is getting huge/complicated... (for a startup, at least - lots of publications on deep learning/dialogue/related issues lately. Wouldn't be surprised by acqui-hire...) "Less-forgetting Learning in Deep Neural Networks," Jung et al.: https://t.co/stGfb8qDU8 "A Sequence-to-Sequence Model for User Simulation in Spoken Dialogue Systems," El Asri et al: https://t.co/Tx4VEBzK6J so much Maluuba stuff "Towards A Virtual Assistant That Can Be Taught New Tasks In Any Domain By Its End-Users," Melamed and Niraula: https://t.co/CMqy8lx6wK "Automated 5-year Mortality Prediction using [DL] +Radiomics Features from Chest Computed Tomography" Carneiro et al https://t.co/DBiKoes4h5 "STAM: A Framework for Spatio-Temporal Affordance Maps," Riccio et al.: https://t.co/kUr0DuaizY @AnaPopescu_SV @DrPizza yeah, some do, some don't. human-level/like-ness not needed for big impacts... @AnaPopescu_SV @DrPizza w/o changing label, intelligence = matter of degree/multiple aspects, progress being made -not binary/anthro-centric @DrPizza @AnaPopescu_SV that'd be damning if TT were a good metric researchers cared about, but it isn't... field is not artificial humanity @AnaPopescu_SV @DrPizza ofc there's a spectrum of capabilities and most advanced not widely distributed... @AnaPopescu_SV @DrPizza unlike the Gibson quote, it is already widely distributed, though, just not recognized as such. "Why is Posterior Sampling Better than Optimism for Reinforcement Learning?," Osband/Van Roy at Stanford/DeepMind: https://t.co/5C4VVuhUVF "Dynamic Neural Turing Machine with Soft and Hard Addressing Schemes," Gulcehre et al. at Montreal/NYU: https://t.co/8vZb94Lguh "Deep Learning with Differential Privacy," Abadi et al. at Google: https://t.co/2i4WlSw78c RT @deepuncertainty: "In preparing for battle I have always found that plans are useless, but planning is indispensable." Dwight D. Eisenh… RT @alexjc: Did you ever dream of being an unpaid Mechanical Turker, creating data for the next startup to be acqui-hired? https://t.co/PsK… RT @alexjc: And they're probably just using off the shelf deep learning libraries. I guess about 2 years behind Tesla, 5 years behind Googl… RT @alexjc: My cynicism is proportional to hype / substance; in this case it's rather high. They secured $3m for this... https://t.co/v1ocW… RT @ylecun: @boredyannlecun your gradient is decent \ your descent is tense \ but your flow is tenser RT @shakir_za: New Post: Learning in Brains and Machines (3): Synergistic and Modular Action. On action synergies, hierarchical RL. https:/… RT @rao2z: #IJCAI16 invited panels: https://t.co/8pQ9TbFloD Human-aware AI; Reviewing Best Practices; WHouse #FutureOfAI workshops #IJ… @AuerbachKeller ah, thanks. @AuerbachKeller what is the corruption/antics claim here? Looked at ur tweets and just saw comment re: "adult supervision," dunno context.. Jan Leike's dissertation, "Nonparametric General Reinforcement Learning": https://t.co/psEMGOeJk7 Look forward to working w/ Jan at Oxford! @Aelkus same one I mentioned re: Winner quote - Lady of Mazes by Schroeder. @Aelkus also, this... book maybe up your alley... https://t.co/acC6nDa04S @Aelkus interestingly, the novel Lady of Mazes starts with a Winner quote. Not 100% sure yet if authored missed the pt or not, but fun book. @Aelkus excellent book. RT @AiPolicy: A brief look at the implications of the first reported fatality of an automated driving system https://t.co/C88Gq0rPYM @rcalo hiring authority like ARPA-E's and exciting missions like the Digital Service are good starts but ofc more needed :) important Q... RT @karpathy: https://t.co/Em3vNpuvHY on upcoming ArXiv overhaul https://t.co/0cOMKjuhvl Arxiv Sanity Preserver gets a shoutout!! :) hope t… May be what they mean, but not equivalent - could have noticed but not had foot on brake, or not paid attn, etc... https://t.co/y6X8F4ZEVS I had the same question... https://t.co/infc27lYY1 Impressive stuff... you can prune by 80%, then retrain and attain same or even better performance. Lots of redundancy in NMT. Nice real-world application of deep learning - very low error rates attainable (often <1% for positive + negative), low stakes for errors. "Parking Stall Vacancy Indicator System Based on Deep Convolutional Neural Networks," Valipour et al. at Alberta: https://t.co/b23IRV4n0R RT @paul_scharre: Game of Drones wargame report is out. It's awesome. Check it out at: https://t.co/8tQajO80bB @CNASdc @benatworkdc @kelley… "Swift: Compiled Inference for Probabilistic Programming Languages," Wu et al.: https://t.co/8u0uDSniVj "A Model Explanation System: Latest Updates and Extensions," Ryan Turner at Northrop Grumman: https://t.co/ZOaafFaDzb "Learning without Forgetting," Li and Hoiem at Urbana Champaign: https://t.co/B5In4iCtf4 "Compression of Neural Machine Translation Models via Pruning," See et al. at Stanford: https://t.co/W7HCMqss2Z RT @Recode: U.S. officials open an investigation into Tesla’s Autopilot after a fatal crash https://t.co/P6EDaU0Z6q https://t.co/DYAz63Zppr (lots of other stuff discussed there, as well, if you're into that sort of thing...) + Do like NSF/DOE mention (and ARPA-E called out in energy plan, which I do agree with!). Need proportionally more civilian AI/robotics $. Clinton's tech/innovation plan briefly mentions ML as area for investment: https://t.co/Ks68CB4GDs Don't nec. agree w/ expanding DARPA, but+ "RT @pmddomingos: Our paper on probabilistic theorem proving - key step to master algorithm - just appeared: https://t.co/2h6fOYXVPO https:/…" RT @erichorvitz: Slides pdf used at ovw presentation at CMU-OSTP @whitehouseostp Safe AI meeting, exploratory tech. workshop: https://t.co/… "On the Semantic Relationship between Probabilistic Soft Logic and Markov Logic," Lee and Wang: https://t.co/gRDGs1a1ig "The Future of Computing Research: Industry-Academic Collaborations," Boules et al.: https://t.co/n6ndJhrdsU "Next Generation Robotics," @hiskov et al. on developments in last five years/future issues: https://t.co/wVxBXiAxWU "Greedy, Joint Syntactic-Semantic Parsing with Stack LSTMs," Swayamdipta et al. at CMU/Pompeau Fabra/DeepMind/etc.: https://t.co/DcFDWS84Sw "Model-free Trajectory Optimization for Reinforcement Learning," Akrour et al.: https://t.co/gbexo9dJpX "Actor-critic versus direct policy search: a comparison based on sample complexity," de Broissia and Sigaud: https://t.co/5TkQIMkBUS RT @googleresearch: Come learn about the soon-to-be released YouTube-8M dataset at the Google booth, 5:10PM #CVPR2016 https://t.co/HGQSsPHz… RT @AndrewYNg: Fun to navigate multiple internet ecosystems (US, China). WSJ piece gives taste @AlyssaAbkowitz https://t.co/mjROhJQaT5 @williamstome sounds like a great trip! :) You going to be at IJCAI by any chance? "The grammar of mammalian brain capacity," Rodriguez and Granger: https://t.co/BR7HObvnDP Some interesting ideas... https://t.co/6ByZlE1B7w @_jyan_ some evaluation issues, and difficult collusion/player modeling issues, but seems plausible, + this happened https://t.co/K1Di2fBuTa @_jyan_ yep :) I was thinking that it'd be impressive to see superhuman performance on large no limit games. "EU regulations on algorithmic decision-making and a 'right to explanation'," Goodman and Flaxman at Oxford: https://t.co/1jxNnhmWqX @jedgar well certainly possible with limit heads up hold em, since it's solved :) prob. true for 3+ limit hold em/heads up lim but not NL/3+ @jedgar dunno. certainly having e.g. Google Glass doing image recognition + whispering moves to you in casino = no good, dunno online rules. *limit heads up hold em (not that there isn't already a lot happening in poker AI without them! Bowling et al. freaking ~solved limit hold em not that long ago...) Between this (with one DeepMind author), recent work by Heinrich and Silver, etc. wouldn't be surprised by big poker results from DM soon... "Learning Nash Equilibrium for General-Sum Markov Games from Batch Data," Perolat et al.: https://t.co/xI2DaksBR2 [with NNs - "NashNetwork"] "Towards Verified Artificial Intelligence," Seshia and Sedigh: https://t.co/IuNTru7cch @tesslerc no prob! Nice work. RT @BoredElonMusk: App that recognizes you're in bed and prevents your phone screen from reorienting. RT @katecrawford: First release tickets for AI Now went in 3hrs! So we're releasing the final set now. Jump on in. https://t.co/YiHEmPUbuo… @ChrisKeast2 not familiar. There's potential in market for custom hardware but site vague re: what it does. Unsupervised learning's hard... "RT @mpshanahan: New paper on integrated information and metastability in systems of coupled oscillators - https://t.co/v2IthXv9wM" RT @_rockt: Efficient regularization of embeddings by FoL implications for #AKBC @thomeestr @riedelcastro @uclmr https://t.co/swOF6SmKXu #N… "Growing Recursive Self-Improvers," Steunebrink et al. at IDSIA etc.: https://t.co/5JpRe0OSQU RT @suchisaria: Have a strong programming background (C++ or Java, Python), interested in data and want to join a stealth ML+health startup… "Evaluating Informal-Domain Word Representations With UrbanDictionary," @nsaphra and Lopez at Edinburgh: https://t.co/AlOfQOYbXQ "Topic Augmented Neural Response Generation with a Joint Attention Mechanism," Xing et al. at Nankai/Microsoft/etc.: https://t.co/FstkywTtVK "An Uncertain Future: Forecasting from Static Images using Variational Autoencoders," Walker et al. at CMU: https://t.co/0meLYswB5W "Proactive Decision Support using Automated Planning," Vadlamudi et al.: https://t.co/IovFVsD6Fs More cool stuff from @rao2z's lab at ASU... "Revisiting Visual Question Answering Baselines," Jabri et al. at Facebook: https://t.co/nINI68NcW6 "Perceptual Reward Functions," Edwards et al.: https://t.co/VFgLgxy833 "Analyzing the Robustness of General Video Game Playing Agents," Perez-Liebana et al.: https://t.co/iVomygDEMO @susteinability yes and yes - seems like they're trying to get a report done by the end of the administration. RT @EdFelten44: Call for public comment on AI, closes July 22, from @WhiteHouseOSTP #FutureOfAI https://t.co/MuqyUaLuxy RT @terahlyons: Contribute to the White House Office of Science and Technology Policy's RFI on Artificial Intelligence here: https://t.co/i… RT @terahlyons: Help inform government policymaking on the future of artificial intelligence: https://t.co/B8tdpFyrQf #FutureofAI @AnaPopescu_SV @trochee CC @jathansadowski "RT @mark_riedl: I made a RL testbed for playing around with Big Red Buttons https://t.co/EuA3sNSFXk Download and play w/ the code! https://…" RT @mark_riedl: @OpenAI gym has safety-related environments for RL agents now https://t.co/1rQ4uJWyvd OffSwitchCartpole is interesting, but… @voicesofai not that I'm aware of, generally textbooks and review papers are best for that sort of thing but yep, quickly out of date :) "NN-grams: Unifying neural network and n-gram language models for Speech Recognition," Davamandi et al. at Google: https://t.co/zTbQy705EF "Sort Story: Sorting Jumbled Images and Captions into Stories," Agrawal et al.: https://t.co/C8dYmK9PWB "The VGLC: The Video Game Level Corpus," Summerville et al.: https://t.co/1HjejX1PEN "Captioning Images with Diverse Objects," Venugopalan and Hendricks et al.: https://t.co/H8riuzQN1e "Coupled Generative Adversarial Networks," Liu and Tuzel at Mitsubishi: https://t.co/eR7BVptMr9 "Wide & Deep Learning for Recommender Systems," Cheng et al. at Google: https://t.co/Wtpcn4JcBO RT @soumithchintala: this year's ICML was buzzing with grad students planning startups as a ticket to quick money rather than to solve some… RT @mark_riedl: I’m officially going live with the research Monday morning, but give it a try if you are bored on a Sunday night. RT @mark_riedl: The code is a RL environment in which a simulated human tries to stop the agent, but the AI learns to stop the human https:… RT @mark_riedl: I’ve been working on "AI Safety and Control". Instead of writing a paper, I wrote a blog post https://t.co/aZfWk7ILxt and r… @AnaPopescu_SV as noted by @thekibosch , In the Loop is also an appropriate response to the times we find ourselves in... Gruesome stick figures are 1 thing - Japan has more realistic ones. See this one w fake kid. https://t.co/eqlzQffiFb https://t.co/a9tWrJeljM @AnthroPunk thanks for sharing! enjoy the rest of it :) @RecklessCoding well, according to BBC, at least, it will take 2+ years... so lots of time to figure out plans :) @AnthroPunk been watching intermittently but missed that one - any key takeaways? Actually, it looks like the whole leaving the EU thing may take a long time after the vote (years). So will be in EU for a while at least :) @AnthroPunk as far as I know! Don't think it'll be a problem...already have my UK visa. So, looks like I'm not moving to the EU... @roseveleth menphasizing? "Learning to Poke by Poking: Experiential Learning of Intuitive Physics," Agrawal et al.: https://t.co/6yi0KHNDNJ Spot the doggish robot is now SpotMini, the dinosaurish robot. https://t.co/YROVFEQLAb @alexjc @fchollet not cleanly separable from economics, as economists say that too - maybe instead it's additional row in that dimension... @alexjc @fchollet there's a third dimension, "knows about policy," that ranges from these things to "it depends in large part on policy" :) RT @jackclarkSF: Artificial Intelligence has a "sea of dudes" problem - why this matters & how to fix it. https://t.co/nUZsJMAr7w https://t… Look forward to finding out tomorrow whether I'm moving to the EU or not :) "Semantic Parsing to Probabilistic Programs for Situated Question Answering," Krishnamurthy and Tafjord at AI2: https://t.co/rFRtBWM1CT "Critical Behavior from Deep Dynamics: A Hidden Dimension in Natural Language," Lin and @Tegmark: https://t.co/tgo4T4mzJB RT @AdaptiveAgents: Near Optimal Behavior via Approximate State Abstraction https://t.co/uCJ1D6pVvL @SimonForman I have a more charitable take ;) RT @zacharylipton: Presenting "The Mythos of Model Interpretability" tmrw at ICML wkshp on human interpretability. Come by and debate! http… @janexwang ...whereas it's main focus eventually FYI. But snippets of relevant backstory throughout, dunno if I recommend skipping anything. @janexwang no prob! The AI control/politics etc. stuff is only part of it for first two seasons or so (episodes mostly discrete then)... @demishassabis congrats! @stephen_oman nice! I'm near the end of season 3 though seen bits and pieces of 4/5... really enjoying seeing it all. Worth it to me :) My only uncertainty RN re: recommending Person of Interest to sci-fi/AI ppl is whether to say watch it all or curated ep list, but def some. Beware of spoilers in the link :) but retweeting b/c I agree with the sentiment: https://t.co/n20vI4Gt7K RT @Annaleen: I honestly feel like #PersonofInterest was a gamechanger for representations of AI on TV https://t.co/wP3awLZEAC RT @vkrakovna: Concrete Problems in AI Safety - an exciting research agenda from Google Brain! https://t.co/mnul58C1WW RT @pmddomingos: All of #MachineLearning in 18 minutes - my @TEDxUofW talk: https://t.co/mGLeTbkatR "Decoding of generic mental representations from functional MRI data using word embeddings," Pereira et al.: https://t.co/SrQgcUA6yd RT @jathansadowski: "UBI can, in some ways, be seen as welfare for capitalists.” —My new piece, dumping a bucket of cold water on us all ht… @Robotbeat @JesseJenkins see also white paper for workshop I held on related issues: https://t.co/1mr5gzy34h "Why Most Decisions Are Easy in Tetris—And Perhaps in Other Sequential Decision Problems, As Well," Simsek et al.: https://t.co/eHKxUvR5PR RT @boredyannlecun: Hat tip to class act (real) @ylecun for sharing @boredyannlecun. Clearly humor & good nature count among the many layer… @AnaPopescu_SV *pessimistic re: rate of progress/timelines, not good/bad outcomes, I mean. latter a longer story ;) @AnaPopescu_SV but of course evaluate for yourself :) may also enjoy: https://t.co/ad2qNaCnG1 @AnaPopescu_SV I think he's pretty circumspect about things...prob. more pessimistic about AI prog. than lots of ML folks :) @AnaPopescu_SV I think he's just hanging around and talking to ppl, dunno, maybe both, but can verify he definitely reads widely inc. ML :) @AnaPopescu_SV why do you say he isn't? He's literally at ICML right now :) "Augmenting Supervised Neural Networks w/ Unsupervised Objectives for Large-scale Image Classification," Zhang et al https://t.co/oxDXvGnxvZ "Plan explicability for robot task planning," Zhang et al.: https://t.co/EAa5rjoCjl "Unanimous Prediction for 100% Precision with Application to Learning Semantic Mappings," Khani et al, Stanford/MIT: https://t.co/8oOALzaWm4 "On Multiplicative Integration with Recurrent Neural Networks," Wu et al. at Toronto/Montreal/CIFAR/CMU: https://t.co/OdZeYkZrqU " Correlation-based Intrinsic Evaluation of Word Vector Representations," Tsvetkov et al. at CMU/DeepMind: https://t.co/GF59fpkG5S " A Probabilistic Generative Grammar for Semantic Parsing," Saparov and Mitchell: https://t.co/WgtETm0lu5 @mark_riedl yeah, I should have said *some of these *... "Tagger: Deep Unsupervised Perceptual Grouping," Greff et al. at Curious AI/IDSIA: https://t.co/0zrMVj33Iw @mark_riedl I take part of their pt to be these are relevant to not just super-capable but present/near-term systems... anyway, cool paper. RT @ch402: @ch402 See also, my post on the Google Research blog (@googleresearch ) https://t.co/ISLUWoMQMK RT @ch402: I'm really excited to have co-authored this paper "Concrete Problems in AI Safety" -- https://t.co/v5puocaFTv RT @jackclarkSF: Google wants to stop your robots from betraying and subverting you https://t.co/nQODKCODyB https://t.co/OpHR3EsmeI RT @OpenAI: Concrete AI safety problems: https://t.co/G1rOUIaVSF @AnaPopescu_SV lol. some of us did ;) RT @hugo_larochelle: LIVE on #Periscope: Meta-Learning with Memory-Augmented Neural Networks at #icml2016 https://t.co/rgSRGpwdi8 RT @hardmaru: You know you are in the Bay Area when there are billboards advertising Artificial Intelligence & Machine Learning. https://t.… RT @drfeifei: Rumor was I was giving my #icml2016 keynote while D. Trump was in the same building. But our topic was vision and intelligenc… @junkiepunch wouldn't be all that shocking as he has longstanding ties to some folks there (Legg and Hassabis in his group at 1 pt I think). @junkiepunch don't know! Maybe bc showing up in a few of their acknowledgments sections but maybe just collaborator. Not announced AFAIK. Some of those recent papers only have results for toy worlds or a small handful of Atari games, so full potential not yet shown. Seems like btwn this + some other recent stuff in and around this area (e.g. progressive NNs), pretty close to some v. big transfer results. ICYMI: paper by Barreto et al. at DeepMind on a framework for transfer in RL: https://t.co/CMSXEKf3iG https://t.co/JcFOXSQmiK (Grace et al. have written tons of good stuff on issues w/ prior surveys, e.g. see some of the search results here: https://t.co/Gw7zFFZHpS) Looking fwd to paper on Grace et al.'s high quality survey of AI experts - see how well you predict results here :) https://t.co/JgS0L8kQw5 @jackclarkSF @beaucronin +broad-based investment in it...tons of state key labs" publishing,+ seen lots of Baidu/MSFT joint stuff lately... @jackclarkSF @beaucronin yeah, though the 2018 thing at least indicates they're aware of that lack :) affiliations in their papers speak to+ @jackclarkSF @beaucronin not clear to me that AI is analogous to supercomputing, though - more innovation than scale, but know little abt SC @jackclarkSF @beaucronin then maybe folks should take seriously their plan to be world class in AI by 2018! Would have very big implications "Simultaneous Localization + Mapping: Present, Future, + the Robust-Perception Age," Cadena et al.: https://t.co/ntXVocJKNV SLAM big picture They're working with Sony apparently: https://t.co/jAXBbXLCjh Founder Mark Ring had some relevant patents: https://t.co/ejTV049XXQ https://t.co/N39sUYc7rY So many AI startups these days... Never heard of Cogitai but apparently Stone, Singh, Bowling, Dayan, Precup, Littman, etc. RL folks are involved: https://t.co/p3SjRngV2S Code: https://t.co/TMuNUepyEc Alternative title from me: when the going gets tough, the network gets growing... "Neural networks with differentiable structure," Thomas Miconi: https://t.co/jwuR7y2c3T "High Confidence Off-Policy Evaluation with Models," Hanna et al. at UT Austin: https://t.co/uBcfHg52ZN "Quantifying and Reducing [in this case, gender] Stereotypes in Word Embeddings," Bolukbasi et al. https://t.co/VhmamEj8es cc @j2bryson RT @jackclarkSF: World's most powerful supercomputer now uses Chinese-designed chips rather than US ones https://t.co/ucIjaURTsT RT @OpenAI: Our technical goals: https://t.co/XUpnd2QMkM RT @svalver: A tour de force. An unified framework for the Major Evolutionary Transitions by @ricard_sole https://t.co/7TeVrug1fE Random application of deep RL - DQN controlling a dot on a screen to get a (medaka) fish to move around: https://t.co/A3TrUPTwIP RT @soumithchintala: A path to unsupervised learning through adversarial networks https://t.co/5pojIR1jiW https://t.co/BJLJN8oSbI RT @DeepMindAI: #DeepMind Team win 2 of 3 best paper awards at #icml2016! Congrats to all! https://t.co/ODYXR0NxJJ https://t.co/LynahdnqQp @VinFL lol. I dunno, I just usually check as soon as it's updated :) RT @DeepMindAI: Brain-inspired techniques make unsupervised models discover interpretable visual concepts! https://t.co/ShPynuQeh7 https://… "Early Visual Concept Learning with Unsupervised Deep Learning," Higgins et al. at DeepMind: https://t.co/0mZuIGpnGC RT @__hylandSL: Playing an entire game of Go to learn from a single move in it is something you can only do on Google resources ~ David Sil… RT @erichorvitz: Stanford and @whitehouseostp co-sponsoring Future of AI meeting at Stanford this coming week: https://t.co/JkIkgQr6q9 @Rba… @__hylandSL @AlisonBLowndes @etzioni @CharlotteHase @icmlconf @pabbeel @DeepMindAI think I saw that somewhere actually! @__hylandSL @etzioni @CharlotteHase @AlisonBLowndes @DeepMindAI @icmlconf improvement over this: https://t.co/ImNLEMim8F @__hylandSL @etzioni @CharlotteHase @AlisonBLowndes @DeepMindAI @icmlconf ah, some good transfer after all! :) weren't any at NIPS AFAIK... @etzioni @CharlotteHase @AlisonBLowndes @DeepMindAI @icmlconf insufficient transfer learning across conferences (same happened at NIPS) ;) RT @icmlconf: Tutorial Slides for Deep Reinforcement Learning by David Silver, Google Deep Mind #icml2016 https://t.co/0WtjKDlKX9 RT @io9: Star Trek actor Anton Yelchin has died in a car accident: https://t.co/yPLtBwJAKU https://t.co/dR3BwmVEom RT @soumithchintala: #icml2016 Super excited for "Back to the Future" workshop, where the oldies tell us how they've done it all ;-) https:… "RT @boydgraber: Video from the human-computer QA match from #naacl2016 #hcqa https://t.co/ABXh2oODqZ" @Aelkus (that assumes 1. they're doing it, 2. they'll do it first..neither certain but both v plausible) @Aelkus yeah, though simpler than prior systems bc deep learning. AlphaGo not *that* complex, + DeepMind wouldn't bother if super tailored @Aelkus this: https://t.co/4E9a3YGYEr @Aelkus did you read the other conv nets for RTS one? "Opponent Modeling in Deep Reinforcement Learning," He et al.: https://t.co/WUuXXsOJyZ RT @hannawallach: This. https://t.co/F4clxtU8nJ @Aelkus agree hybrid stuff important, but there are real Qs one could ask public about LAW bans that this sweeps under rug w/ biased Q... Absurd how leading the framing of this first question is - "sons and daughters"... really, WEF? https://t.co/Bz19qCzydZ @Aelkus lots of good thinkers on this doing work quietly in consulting capacities, Kurzweil et al. w/ single scenarios get attention @Aelkus yep @Aelkus =ppl who haven't studied the relevant lits in futures studies, scenario planning, etc. Ppl who have certainly get wrong but do try @cas_group yeah, sounds like it. May or may not involve deep learning - other ways to do meta-learning, I think, but haven't looked closely. @ankurhandos Hassabis talked about something doing Towers of Hanoi at NIPS, I think, but dunno what paper/if published yet... @AnaPopescu_SV or if they actually studied lit on futures studies, scenario planning, etc. Inversely correlated w/ calling self "futurist".. @smc90 nice! :) @smc90 heresy! ;) Whereas I am def. impressed at its Atari performance and their discrete/continuous deep RL progress in general. Ant soccer thing was cool! Not sure how impressed I should be that DeepMind's A3C is human-level at the Labyrinth tasks. Will be interesting to try them when released. @chris_brockett @AnaPopescu_SV presumably it could also improve w/ more than an hour's data.... @chris_brockett @AnaPopescu_SV nice - yeah, pretty good! *think* it doesn't pass voice Turing Test but my Chinese is rusty, hard to tell :) @chris_brockett @AnaPopescu_SV or, harder still (perhaps?), indistinguishable from a specific person, made to sound like that person. @chris_brockett @AnaPopescu_SV text to speech synthesis indistinguishable from human by humans, ideally saying non monotone sorts of things. @AnaPopescu_SV I remember generation of sound based on video, but was inanimate stuff. Maybe something else I missed... @AnaPopescu_SV could be very creepy. Maybe that's why... @AnaPopescu_SV I'm actually surprised we haven't seen generation of voice with DL - seems doable? Maybe I just missed it...generative voices @AnaPopescu_SV or maybe artificial sounding bc autogenerated @AnaPopescu_SV is a DL voice deep? Or overly excited? :) @hintikka @ErikaVaris prob. roughly true of most conferences, anyway, though? Citations follow a power law... Ant soccer video from Silver's DeepMind blog post: https://t.co/kr0K3pyYqo RT @DeepMindAI: The new #DeepMind blog page is live! First post is on Deep Reinforcement Learning by Dave Silver: https://t.co/aOTQ9Lumlc @mark_riedl but yeah. Very interesting. @mark_riedl there's also this from more people at OpenAI: https://t.co/85j2jjDVtK @Smerity yeah that's pretty intense, too :) I don't think CVPR 2016 has enough sponsors - quick someone, sponsor it. https://t.co/kT7SZSPlml @beaucronin Yeah. It's interesting to wonder where we'd be if GOFAI folks could communicate and share code this fast in mid/late 20th cent. If you wanna be as innovative as SV, Pentagon, start with having this readable on phones ;) https://t.co/VLPyCD4Gjk https://t.co/Nj3qR2Bgyk RT @DIU_x: Excited to announce that DIUx just launched their new agile Commercial Solutions Opening (CSO) program, to... https://t.co/ueZem… @Aelkus yeah, stuff like that I'd count as properly DARPA-esque. automated model-development/data analysis...meh. Suspect FB/Goog way ahead. @Aelkus as opposed to decades-ahead Internet- or GPS-like vision. Seems like a lot of following vs. leading. @Aelkus not that provocative AI (I mean, how can you compete w/ e.g. DeepMind re: ambition?). + arguably much PP is stuff academics wanted. @Aelkus yeah, they certainly are adding value. But I find it kinda funny and troubling how clearly not cutting edge some of their stuff is.. Very conceivable that search could get to the pt of saying "here's the translation, or did you want the news story about this" or something. (in 5 years or so max, I think, or perhaps much sooner, I don't think that'll be a problem) Funny thing about this - due to it going viral, it no longer works b/c links to stories about it, not translation. https://t.co/bCLbpqqHFn @svalver agree - not sure I suggested otherwise? AI industry involves a lot of good science, engineering, and technology... RT @KaiLashArul: @Miles_Brundage Btw roadmap for Atari includes support for custom RL domains (https://t.co/X7lNHlYcTM) and OpenAI Gym inte… RT @rakyll: Hacker culture, sexual assault and why rapists protected by their communities. A great piece by @violetblue: https://t.co/CrwCu… RT @mark_riedl: I wrote a thing about augmented reality computer games and artificial intelligence https://t.co/p2Y4aK481Q Enjoy! https://t… RT @KaiLashArul: Blog post from @_lab41 about how their startup has been using my Dockerfiles as a basis for their work: https://t.co/OcFvF… @rcalo cool!! safe travels. RT @DeepMindAI: New paper: principled and elegant approach that allows transfer to be seamlessly integrated within the RL framework https:/… RT @KaiLashArul: @samim @Miles_Brundage I thought the name "Lab41" sounded familiar, then I realised they actually use my Dockerfiles <3 @samim yeah...they have their work cut out for them :) A lot of DARPA AI stuff just sounds like stuff industry is already doing, possibly much better. Raises lots of Qs... https://t.co/gY22EL9b4I RT @williamalden: EXCLUSIVE: Palantir hired a cyber firm last year to test its defenses. The hired hackers got "complete control" https://t… @beaucronin some of that's inspired by the Semantic Scholar list of top 50 most influential/names I recognize from it... @beaucronin Fei-Fei Li is Toyota-sponsored...etc. Some more clear cut cases: Lawrence, Jordan, Malik, Sutton, Barto, Papadimitriou...) @beaucronin there's a fair amount I think but often the lines are blurry, e.g. Bengio works a lot with IBM and Maluuba these days... RT @nalkalchbrenner: Our follow-up to PixelRNNs, now with an interpretable latent space! https://t.co/EgHfyC9Fv0 RT @samim: StyLit - Style Transfer applied to 3D graphics: https://t.co/wc27KLpEsL via @prostheticknowl https://t.co/3d2bjwajLO Last few papers I tweeted were from the Advances in Cognitive Systems conference - the rest are here: https://t.co/0qojHPmMOd (they still have lots of unanswered questions, but more detail than one usually sees) Paper has some interesting insights into what Watson (more specifically, Watson Engagement Advisor) does/doesn't do from Georgia Tech folks. "Using Watson for Constructing Cognitive Assistants," Goel et al.: https://t.co/fNpV00mD5w @BrianSJ3 yeah, it's from this conference that has a pretty symbolic slant: https://t.co/0qojHPmMOd "Organizing conceptual knowledge in humans with a gridlike code," Constantinescu et al.: https://t.co/8ACGS7Znn0 h/t @jedgar cc @beaucronin "A Model of Planning, Action and Interpretation with Goal Reasoning," Michael Cox: https://t.co/6EQmuMwNK6 "Situated Mapping for Transfer Learning," Fitzgerald et al.: https://t.co/djq8DrEVkl "Automated Hypothesis Testing with Large Scientific Data Repositories," Gil et al.: https://t.co/rd2ksHnFiv @beaucronin whoops, that was the wrong link - that paper was cool, but not relevant :) meant this: https://t.co/ixdxBpyu7k @beaucronin this is maybe relevant, sounded cool: https://t.co/588HluK5uI would read if more time/less PhD guilt... CC @murraycampbell who may find this interesting... This is pretty cool - inherent difficulty of chess decision best predicts mistakes, though time/skill important too. https://t.co/588HluK5uI @j2bryson @mark_riedl have they been watching too much Gone in Sixty Seconds (https://t.co/Efo5e15CQs)? RT @jdelreal: This "Japanese Donald Trump Commercial" is peak internet https://t.co/O5czyCew2E "Convolutional Residual Memory Networks," Moniz and Pal at Montreal: https://t.co/ijPjkFqo4w "SQuAD: 100,000+ Questions for Machine Comprehension of Text," Rajpurkar et al. at Stanford: https://t.co/0xYJjnMyEH "RT @walkamileuk: Please take some time to listen to the passionate and optimistic maiden speech of Jo Cox who was murdered today https://…" RT @poolio: Our paper on exponential expressivity in deep neural networks through transient chaos is up: https://t.co/IgfXBSP2KE https://t.… @cfiesler there are some good examples in the paper "Teaching AI Ethics Using Science Fiction" by Burton et al. "Learning feed-forward one-shot learners," Bertinetto et al. at Oxford: https://t.co/GiUlCL7gXw Huge gains on WebQuestions/SimpleQuestions datasets...from 63.9% to 88.3% on the latter (!!). Think v. recent Baidu stuff somewhere in btwn. "Simple and Effective Question Answering with Recurrent Neural Networks," @ferhanture and Jojic at Comcast: https://t.co/Gs2WOdUmzi E.g. this one's also pretty impressive. Check out the paper for more... https://t.co/Gf7xy1WDaJ Some other impressive/interesting figures in the paper...but omg the Cyclops baby. Weird. "Conditional Image Generation with PixelCNN Decoders," van den Oord et al. at DeepMind: https://t.co/olug4WHXoM https://t.co/t3lgArfptJ "Unsupervised Risk Estimation Using Only Conditional Independence Structure," Steinhardt and Liang: https://t.co/y5bJYF5dON "Deep Reinforcement Learning Discovers Internal Models," Baram et al. at Technion: https://t.co/W97REgaw0T "Successor Features for Transfer in Reinforcement Learning," Barreto et al. at DeepMind: https://t.co/CMSXEKf3iG "Increasing the Interpretability of Recurrent Neural Networks Using Hidden Markov Models," @vkrakovna + Doshi-Velez: https://t.co/1QrMqNsY5w """Assessing Human Error Against a Benchmark of Perfection,"" Anderson et al.: https://t.co/TzOkqCPf73" @ShaneLegg @togelius @Aelkus @beaucronin funny, this just came out and is related: https://t.co/TzOkqCPf73 RT @demishassabis: Kumaran, McClelland, and I authored an update of the seminal CLS theory that inspires a lot of our work at #DeepMind htt… RT @haldaume3: .@haldaume3 final score humans 190, computer 155. go humans, nice play by the system developer, Ikuya Yamada! RT @haldaume3: quizbowl NASAT team, current score human 25 computer 15. go humans! #naacl2016 https://t.co/veCcJ4bzXK First few paragraphs here do a good job of introducing generative models: https://t.co/85j2jjDVtK @ShaneLegg @togelius @Aelkus @beaucronin what about near/probably approximately perfect? :) or >>human(s)? Latter maybe easier than former.. @mark_riedl not as thronelike as I was led to believe... @AnaPopescu_SV lol @togelius @Aelkus @beaucronin yeah... agree re: Hutter/Legg being insufficient, think they'd agree, + also liked your paper w/ Schaul/Schid. @Aelkus @beaucronin not sure I follow/agree - yeah, we have proofs of concept, that "mere" question seems important to evaluate/interpret.. @Aelkus @beaucronin eh, disagree w "mostly," maybe somewhat. Think they make good pt, as do Hernandez-Orallo and others, good to have theory @Aelkus @beaucronin it being possible to be non-slapdash doesn't mean ppl don't use it that way, though... @Aelkus @beaucronin not sure it's that slapdash in principle, more just that ppl ignore the good work on it, eg Legg/Hutter 2007/followup... @beaucronin some partial evidence for this: https://t.co/lZjLJFDRGm @beaucronin yeah. Sometimes when ppl say AI isn't general, they really mean it can't do this human stuff, but RL more actually general... @robinsloan thanks! :) I try... RT @beaucronin: It will soon become clear that, by the standards to which we hold AI, humans are not “truly intelligent” RT @OpenAI: Our first research results are now live: https://t.co/YrZtcGhIQT! @rbhar90 maybe you should invent it, then! :) @rbhar90 did you read the appendix on this? Not 100% sure I got it but seems relevant to that...either way, yes, follow-up needed. Another *big* development or two :) but still... this seems extremely promising. Wouldn't be surprised if, after another development or two, there were a network of networks learning all Atari games at superhuman level. Paper raises tons of interesting questions/directions, e.g. optimal ordering of tasks, choosing which column(s) to use w/o a task label... @hintikka I think a superintelligence is probably more likely to take away our guns than Congress ;) @hintikka yeah... maybe someday but not anytime soon. Tens of millions of these guys (warning: ridiculous yelling): https://t.co/7t5JGmJzGf This may be one of those "obvious in hindsight, but took a while" sort of things. Make a new network, keep the old, learn from it sometimes! @AnaPopescu_SV yeah, very interesting. Think we'll see some super impressive demos of super-multi-task agents before too long... @AnaPopescu_SV need to (re)read that one, thanks. Prob. skimmed before. Need to read it again and transfer from some of my columns ;) Has some issues (e.g. efficiency bc bunch of networks) but they seem at least partially fixable (e.g. compression). Works well in Atari etc. Essentially, it's just about creating a new network for new tasks and transferring from the old one(s) while keeping what you learned. This progressive neural network stuff is v. interesting/elegant. Seems like big step in transfer/lifelong learning: https://t.co/DnL05qx0Fr @girlziplocked yeah. It's just stuff people have already said and hasn't stuck. Partly that's because it doesn't suggest them for all messages, apparently (I've never used it). 10% of Inbox by Google Gmail messages use Smart Reply. I've never thought "this looks automated" but almost certainly I've gotten em before. "Query-Regression Networks for Machine Comprehension," Seo et al. at UW/AI2: https://t.co/xHJENYkQd6 "Spatio-temporal convolutional neural networks explain human neural representations of action recognition": https://t.co/OeDmY5gZdI "Improving Variational Inference with Inverse Autoregressive Flow," by Kingma, Salimans, and Welling at OpenAI etc.: https://t.co/8GNkTQ7tDV "Smart Reply: Automated Response Suggestion for Email," Kannan, Kurach, Ravi, and Kaufmann et al. at Google: https://t.co/pdg8hPj0r1 RT @DeepMindAI: Now on arXiv: Progressive Neural Nets, a new approach for continual and transfer learning in Deep RL! https://t.co/2iijgmA9… @j2bryson not recently enough :) "Deep Reinforcement Learning With Macro-Actions," Durugkhar et al. at Amherst: https://t.co/EedotIMpiV "Progressive Neural Networks," Rusu and Rabinowitz et al. at DeepMind: https://t.co/DnL05qx0Fr "Strategic Attentive Writer for Learning Macro-Actions," Vezhnevets et al. at DeepMind: https://t.co/G8cEUhp7nM @AnaPopescu_SV what about this? https://t.co/KagrTzFEP1 @AnaPopescu_SV mental health stuff! :) Big space obv., not sure what the gaps are, but I love seeing work on that. Lots of useful probs, no? Anyway, cool paper - good stuff on the neuroscience motivations for/implications of the algorithm: https://t.co/gg1ytNNRx1 Why bother facing the direction you move if you know how to get apples/avoid lemons? Agent just moves to where needed, looks when needed. Good example of AI not nec. learning human-like behavior from Blundell et al paper - see e.g. Forage and Avoid here: https://t.co/nWYPcdcoa9 @mark_riedl how is there not already a deep learning based algorithmic trading fund called Deep Earning? Maybe there is. @mark_riedl but I can't resist this one - dating site: Deep Yearning @mark_riedl (was going for more on the food delivery theme there - too many options for things in general!) @mark_riedl Deep Noodle Network...Autoen-colas... RT @fchollet: Our DeepMath paper is up on Arxiv: https://t.co/NYy6lle8fj -- applying deep learning to theorem proving for the first time. RT @samim: New Styletransfer Video: Wizard of Oz with Starry Night: https://t.co/B3ZP1ArAR8 https://t.co/Dp1UQVBSqu RT @kwelle: Some job opportunities for researchers in computational social science https://t.co/HIBhMJm6h4 One interesting thing about the paper - uses MUCH lower exploration than DQN(++/A3C etc.). .05 vs. .005. Blundell et al. paper in question: https://t.co/gg1ytNNRx1 Original Lake et al. figure from: https://t.co/qYqqLrfMLc Point is, it does learn much faster than DQN++ for a while at least. Very simple: store/replay best action sequence, do in similar states. Not *quite* as impressive as it looks b/c EC-RP peters out after fast learning, not as good at exploration, but think that'll be addressed.. RT @erichorvitz: Talks & slides from DC meeting online now: https://t.co/0aPEzSQyQw #AI https://t.co/4rtEiRjaP2 @j2bryson yeah, though phrasing suggestive ("Dayan, blah, blah, and others at DeepMind")...had same suspicion b4 re: Hinton + was right :) Lake et al.'s "Frostbite Challenge"/point re: slowness of deep RL, w/ Blundell et al. results added (roughly) by me. https://t.co/PsKAQNeoOB @EdHenry_ nice, glad you liked it! @beaucronin gets credit for recommending it to me :) @tejasdkulkarni yeah... today was an especially crazy day on arxiv :) good luck with everything! ...by @zacharylipton et al. "Directly Modeling Missing Data in Sequences with RNNs: Improved Classification of Clinical Time Series": https://t.co/ASHnw7rlzP Lots of interesting stuff on arXiv today! "Zero-Resource Translation with Multi-Lingual Neural Machine Translation," Firat et al. at (mostly) IBM: https://t.co/DuXneWxFsO @Aelkus @smc90 that's pretty much what those two papers do, and results v impressive. But haven't looked at experiment conditions closely. @smc90 @Aelkus saw results from David Forsyth recently, but think it was unpublished, or I can't find it. Dunno how compares but was v good. @smc90 @Aelkus some papers on this - "Makeup like a superstar"; "Simulating Makeup through Physics-based Manip. of Intrinsic Image Layers".. @Aelkus I feel like that's been done, minus the reliably, but dunno/don't recall where I saw something like that... @smc90 @Aelkus yeah, much deeper (no deep learning hype intended, but really) sort of transfer than what you see in FaceYou-type stuff. @Aelkus guess that's cosmetics rather than fashion, but the general point is: picture person w/ X with different clothes, hair, makeup, etc. @Aelkus and fashion/retail (at least, if they know what's what in AI at all). Saw pretty impressive makeup transfer demo at Purdue recently. "Inverting face embeddings with convolutional neural networks," Zhmoginov + Sandler, Google: https://t.co/EfcUub9vxt https://t.co/776rqPAMGw Thoughts, NLPeople? :) Says it's the first time single model neural machine translation beats conventional MT (which has long been expected to happen eventually). "Deep Recurrent Models with Fast-Forward Connections for Neural Machine Translation," Zhou et al. at Baidu: https://t.co/SFPCREe5yk "DCNNs on a Diet: Sampling Strategies for Reducing the Training Set Size," Kabkab et al.: https://t.co/YeqrpjVglm "Rationalizing Neural Predictions," Lei et al. at MIT: https://t.co/z54hRXiInD https://t.co/r537nRSlKw The acknowledgments section also seems to suggest neuroscientist Peter Dayan works there now. Big hire for DeepMind if true. RT @demishassabis: @44thats44oars yes humans can play too, it is fully multi-agent. RT @demishassabis: We're putting the final touches to a new version of #Labyrinth which we'll be open sourcing soon for everyone to use htt… "DeepMath - Deep Sequence Models for Premise Selection," Alemi et al.: https://t.co/S7WNxZcg0q First deep learning for theorem proving. "Experimental and causal view on information integration in autonomous agents," Geiger et al. at MPI/Microsoft: https://t.co/xLKoQ8VGUP Hippocampus-inspired learning on Atari, Labyrinth. Interesting. Must be *very* recent as no detailed Atari results per usual DM procedure :) @Aelkus (gradient descent on Descent, I mean. not GD for GD on D) @Aelkus they maybe have already done that :) @Aelkus classic game. Wild title (not a typo): "Learning to learn by gradient descent by gradient descent," Andrychowicz et al., DeepMind: https://t.co/VwEf1ghgo8 RT @DeepMindAI: New DeepMind paper: Stop hand-engineering optimization algorithms for deep learning. Learn them instead! https://t.co/Kt8gm… "Model-Free Episodic Control," Blundell et al. at DeepMind: https://t.co/gg1ytNNRx1 @devnag @Smerity @AnaPopescu_SV of the subsequent prog. on those general AI/RL issues, available here: https://t.co/psEMGOeJk7 @devnag @Smerity @AnaPopescu_SV yes, agreed - while I haven't read/understood it all yet, I gather Jan Leike's fresh dissertation covers... @Smerity @AnaPopescu_SV let us know what you think! :) @Smerity @AnaPopescu_SV not a ton on written this AFAIK, Sotala's blog posts sometimes relevant to it (https://t.co/iEkeXNlyAn), but good Q. @Smerity @AnaPopescu_SV I think you'll find Superint. interesting on some of those fronts, happy to discuss more down the road :) @AnaPopescu_SV @Smerity Learning to Think and Act like People is also a good read re: AI challenges, Hutter/Legg 2007 on general-ness... @AnaPopescu_SV @Smerity I agree Superintelligence should be on the list re: long term stuff. Any specific issues you are interested in? RT @rcalo: I'm told that seats filling up for AI Now. RSVP here. https://t.co/g9xrUmBv3X @rcalo hope there's time for discussion baked into the schedule. @AnaPopescu_SV what's this from? RT @soumithchintala: My SVHN paper (2012) (fully supervised ConvNet 700k labels) and @OpenAI's new paper (1000 labels) have ~the same accur… @KaiLashArul cool! RT @CSERCambridge: CSER is hiring! https://t.co/EdsJo1gXz2 We are looking for a Research Associate to work on bio-risks projects. Please he… @KaiLashArul sounds cool :) will this be on arXiv soon? This is indeed great! Highly recommended. And I see now that my Twitter feed is in the acknowledgments section :-) https://t.co/4SWGMhZP4l Well, that escalated quickly. This Omniglot stuff was all in the last few months. https://t.co/ieEuZRsjdV https://t.co/9HntLbIdZp @RobWortham congrats! Looks very cool. FYI, small typo - looks like "renew" should be "new" or "renewed" :) @zacharylipton (I think best approach prob recognizes both impt, being specific re: interp. definition, + diff. contexts --> diff tradeoffs) @zacharylipton nice paper! Agree re: the trade-off w performance being key Q. Has come up a bit in ethics/law discussions, solution unclear. """Birds have primate-like numbers of neurons in the forebrain"": https://t.co/k0any9k3UA + more tightly packed, so faster processing." RT @ShaneLegg: And this slightly more practical followup with Joel Veness. https://t.co/zivbBIe2rT Foundational ideas at #DeepMind https:/… "[The GANs] learn to generate objects that resemble animals, but w incorrect anatomy." Wild. https://t.co/QKmino4nEh https://t.co/0GlR9xE81A RT @DeepMindAI: Our latest paper, Optimal BPTT policies for scarce memory setting when training RNNs. Run out of GPU memory no more! https:… Just reread @ShaneLegg + Hutter's classic paper on defining machine intelligence - def. recommend, lots of insights: https://t.co/VkNcr2COqK RT @boredyannlecun: What deep nets teach us about income inequality. Household income currently divided into 2 layers. No good. Need more l… "Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets," Chen et al., OpenAI: https://t.co/6aNgQixvMh "Improved Techniques for Training GANs," Salimans et al. at OpenAI: https://t.co/fMyEztfFwd @zacharylipton have only skimmed so far, lots of papers in the queue tonight :) maybe some thoughts later...looked great. "The Mythos of Model Interpretability," @zacharylipton: https://t.co/1uzNFyzm6m "Deep Reinforcement Learning w/ a Combinatorial Action Space for Predicting + Tracking Popular Discussion Threads": https://t.co/AdaRl6lwaa "Human Centered Object Co-Segmentation," Wu et al. at Cornell, Didi Research (hmm...), and Stanford: https://t.co/uv9GRHD3pR RT @OriolVinyalsML: Excited to share my first DeepMind paper! Seq2Seq + Learning2Learn for One Shot Learning on ImageNet, Omniglot, & LM ht… RT @DeepMindAI: Does the brain do deep learning and what does that mean for neuroscience? Preprint with @kordinglab @AdamMarblestone https:… @beaucronin oh nvm youre on it :) CC @beaucronin This looks great - "Towards an integration of deep learning and neuroscience," @AdamMarblestone et al.: https://t.co/4wWd9uIrv6 "Generative Adversarial Imitation Learning," Ho and Ermon: https://t.co/ubeAtEQWJP "Matching Networks for One Shot Learning," @OriolVinyalsML et al. at DeepMind: https://t.co/UOEtCvivyV @rivatez MIPSters was 1st that came to mind and also has a computing related meaning but NIPS is more ML-specific. :) maybe other good ones. @rivatez NIPSters RT @lawrennd: A recording of last Thursday's very enjoyable debate on #Superintelligence at @FHIOxford is now available. https://t.co/LiGL5… @karpathy congrats! "Key-Value Memory Networks for Directly Reading Documents," Miller et al. at Facebook/CMU: https://t.co/FM4E5qQTdK "Policy Networks with Two-Stage Training for Dialogue Systems" Fatemi et al, Maluuba: https://t.co/RGc9nNbHdF Lots of Maluuba papers lately. "Memory-Efficient Backpropagation Through Time," Gruslys et al. at DeepMind: https://t.co/4WLWOsSchl @tmosley4 yeah, that's prob. true. My point wasn't that it's unjustified, just interesting. @tmosley4 thanks! still low compared to what top AI folks can get out of grad school these days, though. "Cooperative Inverse Reinforcement Learning," Hadfield-Menell et al. at Berkeley: https://t.co/nXttfbsQ7G Even with inflation... prob. need an extra 0 there nowadays. Lol: "Bright students were lured away from graduate school with salary offers of $30,000." (Roland 2002, on AI/expert systems in the 70s). @jjmerelo @GaryMarcus @murraycampbell I'll send you a direct message. See also this from '85 OTA report for a sense of smaller scale of AI $ back then (source: https://t.co/sOBSVQE2yJ). https://t.co/RxitRUPA74 (just this year alone, several $1 billion+ AI/robotics R+D programs have been launched in gov't and industry, to be spent in <10 years each) Fun fact: DARPA's huge (for the time) Strategic Computing Initiative in the 80's cost $1 bill. over 10 yrs. Not much vs. modern AI/rob. R+D. RT @drfeifei: Am organizing an upcoming Stanford-White House @whitehouseostp event on AI and its future. https://t.co/g5Ge1WEwxG https://t.… @mark_riedl though I don't get how style transfer works so maybe not that big an issue/that's sufficient. @mark_riedl there might not be enough data...that sci-fi LSTM thing/my own used big fraction of free ones, only ~10 MB.. (cont'd) and (related) "The 'Off-Switch'": https://t.co/HOgMqXDVRQ Interesting drafts on AI safety/ethics stuff by Hadfield-Minell et al.: "Cooperative Inverse Reinforcement Learning" https://t.co/djgePHpgOH @trevolafoam good luck with the move! I'm also making the US-->UK transition next month :) @beaucronin related icymi: https://t.co/6ffyZCqVci RT @hope_reese: Predictions are in for @TechRepublic's swarm #AI for @BelmontStakes! @UNUsays @UnanimousAI https://t.co/FYqV1wf7Vv https://… "RT @soumithchintala: We just released the DarkForest Go-playing engine: https://t.co/p8ApUgFgoo It's a 5d rated bot. https://t.co/wKfEA3nEn…" Yea...that LSTM sci-fi script is better than what I came up with using the same data and less tuning, but not "good."https://t.co/XCvTsyIYTH RT @neilhimself: No, it's not. I mean, I don't want to disagree with @BoingBoing but, no. It's entertainingly bad. https://t.co/hDLLaimg5U """The Dark Side of Ethical Robots,"" Vanderelst and @alan_winfield: https://t.co/GTPdIdXNIa https://t.co/kFSOSIKFjJ" RT @fchollet: Feeling like all the cool deep learning startup names are already taken? Here's a handy Venn diagram. https://t.co/AbOIAy07x0 Registration open for White House-sponsored event on social/economic impacts of AI in NYC: https://t.co/nFSIhFBY1v h/t @jedgar CC @j2bryson "RT @mpshanahan: Deep reinforcement learning paper with @KaiLashArul, Dilokthanakul & Bharath #IJCAI16: https://t.co/UIBXj8orv1 https://t.co…" RT @geoplace: Reminder! If you have an interest in big data and development, we’re hiring 3-year Research Fellows at @turinginst https://t.… RT @HillaryClinton: Delete your account. https://t.co/Oa92sncRQY RT @samim: StyleTransfer Videos: Blade Runner in the style of ‘Starry Night’ and 2001 as Picasso: https://t.co/zNN5YhkVg9 https://t.co/svsC… "RT @elonmusk: Something about a flying metal suit... https://t.co/6Z1D9iZ1fV" RT @tejasdkulkarni: checkout this interesting variant of deep RL that we just published -- https://t.co/PXEn9wMxaR (code url inside) RT @mark_riedl: I said some stuff about Google Magenta and computational creativity https://t.co/2vNl3Em3US article by @tsimonite "Safe and Efficient Off-Policy Reinforcement Learning," Munos et al. at DeepMind/VUB: https://t.co/4CgcnjKHFS "Deep Successor Reinforcement Learning," @tejasdkulkarni et al.: https://t.co/OjwJS9jB7f @jackclarkSF Karp probably knows a fair amount about AI/ML at Palantir... not at the level of the other two, but still maybe noteworthy I looked into modeling prog. in planning (SAT progress well explored by @KatjaGrace)...hard bc changing benchmarks, but much prog. for sure. And "planning/reasoning" here diff. from general human-like planning/reasoning, latter way better for more ill-defined enviros/tasks/goals. (ignoring lots of issues about integrating components...but, point is, hype about recent prog. mostly about human-y things like perception). Impt to remember how much prog there's already been in such areas - provides foundation, when more human-y areas solved, for very >human AI. Slides from Bart Selman on "Non-human intelligence" https://t.co/MFGiKXiIBH "Under the radar" (press's radar?) prog. in reasoning/planning. RT @whitehouseostp: Registration for our next #FutureofAI public workshop, on #SafeAI with @ISRCMU, is now open. Learn more: https://t.co/b… RT @HMRoff: Drone proliferation. https://t.co/D116E0m15o RT @shakir_za: Getting better at Montezuma's Revenge, now at 15 rooms: 'Unifying Count-Based Exploration and Intrinsic Motivation' https://… @gdb FYI based on a combo of my experience/others' accounts on FB, this page works on Chrome and Safari but not Firefox or Explorer. RT @gdb: Want to get into deep learning research? Easier than ever: https://t.co/Klu44UJUnC. RT @OddLetters: I reviewed @kevin2kelly's new book for the @nationalpost. Spoiler: It's got some issues. https://t.co/TxAP01XMCk RT @coreylynch: Wrote a #Tensorflow + #Keras + @OpenAI gym implementation of async deep q learning: https://t.co/jCZh42FPYV https://t.co/IS… @mark_riedl yeah. I gave a job talk that way. Was tricky! Also, I'm sure your talk was/will be well received, who doesn't love AI/stories? RT @MIT_CSAIL: Trump definitely posed as PR guy "John Miller," says former CSAIL speech expert: https://t.co/umhP1zb0p8 https://t.co/gX8TEi… RT @ShaneLegg: Good BBC article about some of the Technical AI Safety research that we're doing in collaboration with FHI https://t.co/Fxq… @mjrobbins (sadly, it has some egregious errors, but fun read) @mjrobbins "AI in science fiction" or skip directly to the first link: https://t.co/7624SPCYsr and ponder the distribution. ;) @hintikka could imagine things changing after, e.g. big terrorist attack. Hope not, obv, and not only for that reason, but still...sucks @hintikka yeah, I think it's unlikely at this point. But sucks that (per prediction markets at least) we have a 1/4th chance of it... @hintikka better than them explaining what fascism is under creeping fascism... Code for "Deep Q-Networks for Accelerating the Training of Deep Neural Networks": https://t.co/ocTEmoH8E6 @Aelkus based on prediction markets, at least: no, solidly below 50% here https://t.co/PD6Ls6kFn0 and here https://t.co/Z9abmRDBFv @rbhar90 yeah, not sure what the best way to use that scale is but I figure ppl will come up with something :) RT @etzioni: Microsoft Finds Cancer Clues in Search Queries, remarkable work by @erichorvitz story by @markoff https://t.co/Xi9NiSo4Zu " A Decomposable Attention Model for Natural Language Inference," Parikh et al. at Google: https://t.co/aUrMYCCH4L (not just because of that, but a combination of binarization, customized/better GPU/non-GPU hardware, better distributed algorithms, etc.) """Deep NNs are robust to weight binarization + other non-lin. distortions"" https://t.co/Ov6gYK5nk4 Think we'll see trillion+ param NNs soon." (authors at/formerly at Baidu. 75.7% accuracy on Facebook's Simple Questions dataset...seems pretty impressive!) """CFO: Conditional Focused Neural QA with Large-scale KBs,"" Dai et al.: https://t.co/Gc6WNAxbfB 11.8% abs. improvement on Simple Q. dataset." @rcalo gotcha :) @rcalo or perhaps Caloesque. @rcalo one might even say it's Calonian at times... @rcalo was just reacting to what I read as a framing of it as focused on that topic. anyway, agree it's a good read! :) @rcalo was expecting more hysteria based on the press reports :) @rcalo plays a pretty minor role in the doc, honestly... @bigaidream nice! :) Page on the book I mentioned - as I said, epic: https://t.co/w7GBJhAQuL "Learning to Optimize," Le and Malik: https://t.co/PHZFoWdD8C "End-to-end LSTM-based dialog control optimized with supervised and reinforcement learning," Williams and Zweig: https://t.co/xwyzimHcda Related from a little while ago: "Using Deep Q-Learning to Control Optimization Hyperparameters" by Samantha Hansen: https://t.co/8KgJXp6FIk """Deep Q-Networks for Accelerating the Training of Deep Neural Networks,"" Fu et al.: https://t.co/qnil1kP8pm Was only a matter of time..." "Deep Reinforcement Learning for Dialogue Generation," Li et al. at Stanford/OSU: https://t.co/FB0QWiPcUo RT @vkrakovna: An interesting paper from U Montreal on RNN regularization - great job David, Tegan, Janos, and others! https://t.co/qSEwuIR… "Deep Conditional Multi-Task Learning in Atari," Romoff et al.: https://t.co/ymBn04zByZ RT @mark_riedl: IJCAI 2016 publicly acknowledges excellence in reviewing. I think this is a great precedent. https://t.co/Gw4QsMHhGb Video showing improved performance on Montezuma's Revenge: https://t.co/iGfiTxWB4n "Unifying Count-Based Exploration and Intrinsic Motivation," @marcgbellemare et al. at DeepMind: https://t.co/kswIsUCYio RT @EdFelten44: Can't wait for tomorrow's (livestreamed) #FutureOfAI workshop on AI for Social Good. With @compcomcon & AAAI. https://t.co/… UK visa approved! :) """Honda to set up AI research base in Tokyo"": https://t.co/IPQXIGaLWw" @j2bryson maybe, not sure- point not t AI would "bypass" electricity but might not want it interrupted. Like human preventing strangulation. RT @demishassabis: contrary to internet rumours, we've not decided yet what to do next with #AlphaGo, once we have, there will be an offici… @rcalo (and start of an era that'll probably last a few minutes) @rcalo end of an era. """Scientists grow human organs for transplant inside pigs"" https://t.co/59d5x0NisF See also ""pigoons"" in Oryx and Crake (highly recommend)." "Exploiting Multi-typed Treebanks for Parsing with Deep Multi-task Learning," Guo et al. at Harbin U./Baidu: https://t.co/QD1uDNbYfm "Privacy Protection for Natural Language: Neural Generative Models for Synthetic Text Data," Ororbia et al.: https://t.co/JZV20C6ulc "How Deep is the Feature Analysis underlying Rapid Visual Categorization?" Eberhardt et al.: https://t.co/f2oii0evK4 Human depth maybe < AI. RT @robinhanson: I take stock of 10.5 reviews so far published on #ageofem https://t.co/77qyiUqhU2 "Question Answering over Knowledge Base with Neural Attention Combining Global Knowledge Information," Zhang et al.: https://t.co/2CL7h2l7Wx @j2bryson @mjrobbins RL already comes up with lots of things we don't anticipate. Very good RL may come up with others. @j2bryson @mjrobbins (perhaps none of those is plausible, but think that's consistent w/ wanting AI to not resist being turned off) @j2bryson @mjrobbins copy self somewhere else on Internet... @j2bryson @mjrobbins probably many things short of nukes? mess with HVAC/doors to suffocate, kill w/ robot in lab, open container of virus, @j2bryson @mjrobbins why are nukes necessarily involved? but yeah, that would be bad :) @j2bryson @mjrobbins @mark_riedl lots of studies on such stuff but bastardizing a bit: experts bad, some (lay/expert)>others, models>opinion @mjrobbins @j2bryson though maybe disagree re: importance of that academic area.... @mjrobbins @j2bryson (agree w this, btw - yes, academic interest. not endorsing hype/alarm/Terminator pictures etc.) @mjrobbins @j2bryson not sure exac what that means, but think authors would be first to admit they're addressing specific class of scenarios @mjrobbins @j2bryson unlikely why/over what timeframe? That may be true soon, while work still valuable in expectation bc uncertainty... @mjrobbins @j2bryson (being somewhat facetious obv, some things could be counted as implicit predictions re: classes of risks being impt) @mjrobbins @j2bryson who's predicting real world events (besides Kurzweil :) )? paper in question abt being prepared for class of scenarios. @mjrobbins @j2bryson best response to uncertainty seems just to specify assumptions well. @mjrobbins @j2bryson + thereby make some args about it (see e.g. paper formalizing convergent instrumental goals arg). But def uncertainty. @mjrobbins @j2bryson don't think we're completely ignorant - can make well specified assumptions e.g. about AIs having util. functions... @mjrobbins @j2bryson @mark_riedl I agree bias/other issues w/ surveys (new one is by far the best but not done yet), but yes long discussion @mjrobbins @j2bryson @mark_riedl (survey data btw suggests >>0 chance of less time than btwn Model T and widescale GPS, but obv v uncertain) @mjrobbins @j2bryson @mark_riedl or it may not. Better to be prepared than unprepared, + work to be prepared may take a while too. @mjrobbins @j2bryson @mark_riedl hence paper used models of RL to ground args. Not freewheeling "speculation." But ya it may be a while... @mjrobbins @j2bryson @mark_riedl don't really agree w that analogy-more like Ford thinking about advanced cars. Know a lot about AI already, @j2bryson @mark_riedl don't get the asphyxiation analogy... @j2bryson @mark_riedl don't think the point is to seek for it to learn about cutoff, but to be robust against that happening for smart AI.. @j2bryson @mark_riedl here's the abstract, summarizes its aim/context pretty well.. https://t.co/njNXVyhUh2 @j2bryson @mark_riedl ahh, Bowie! got it now :) @j2bryson @mark_riedl the plug thing is precisely what the paper is about. @j2bryson @mark_riedl don't know what the Bob thing is in reference to...but the paper explains the context/assumptions... Search "Fields Medal" on Twitter to see what I'm talking about... Weird: seeing tweets about Maryam Mirzakhani being 1st woman to win the Fields Medal, as if it just happened. Linking to 2 yr old articles. Maybe we need machine learning papers on predicting attendance at machine learning conferences... https://t.co/tbqKo2zzoW Reading A Canticle for Leibowitz right now. It's really, really, really good. Recommended. RT @BoredElonMusk: Secondary market that lets people sell their excess Twitter characters. @tejasdkulkarni congrats on both counts! @hintikka @Lahlahlindsey wow. RT @io9: The Chinese government is setting up its own major science fiction award: https://t.co/FayNrty62a https://t.co/V84UiHbF8Z Mreh, feed was down for like 10-20 minutes, but it's back up now. "RT @rebecca_roache: Muhammad Ali saved a man from a suicide jump in 1981. I wonder what happened to him. https://t.co/fiPi6YW38m" (sidenote: Letendre is the one who wrote this (essay 5) on the Q of DOD forcing Google to help with auton. weapons: https://t.co/vaXokdJpz3) @GaryMarcus, @fdiaz_msr, Matthias Scheutz, @WendellWallach, and Linell Letendre discussing machine ethics RN: https://t.co/cXTxx3Kdpn Cool paper by Wayne + Abbott (2014): "Hierarchical Control Using Networks Trained with Higher-Level Forward Models"- https://t.co/IqHENrgrSt RT @GaryMarcus: Live at 4pm EDT: Moral Math of Robots: Can Life and Death Decisions Be Coded? on Livestream https://t.co/21ghRAC5a5 @hardmaru congrats! @fchollet @elonmusk I, at least, would have to be confident I'd be conscious w/o wetware, not sure where evidence for that would come from.. @JoeClibbens @mpshanahan and impressedness at how much he nevertheless (and/or as a result) created! @JoeClibbens @mpshanahan it is not particular readable/read-worthy, honestly. My takeaway from it was just how seriously mentally ill he was @mpshanahan I read parts of "The Exegesis of Philip K. Dick" (synthesized notes he left behind on all sorts of stuff). Really, really weird. @elonmusk multiverse stuff? time travel? btw-thanks for donating to FLI! One of the grants is enabling me to do AI policy stuff at Oxford :) @pmarca @vgr more like Social Security. It's conditional on having paid into system. @chrisalbon @beaucronin P.S. Continuum's on Netflix :) @chrisalbon @beaucronin Continuum also filmed in Vancouver :) sadly only seen some of Stargate. Continuum more near term/grounded.. @beaucronin now complete after maybe 3-5 seasons, forget (maybe hastened bc ratings but it ended coherently) @beaucronin underwatched Canadian channel/SyFy-syndicated TV show about time travel, corporatocracy, tech's impact on politics etc Recommend @beaucronin Continuum has excellent corporate surveillance state stuff, but more about political suppression than service denial... @beaucronin Gattaca sort of 1 dimension of that..also having trouble thinking of stuff. Maybe parts of Person of Interest I havent gotten to @mark_riedl totally agree on reward engineering. u read paul christiano's stuff? stories maybe good red teaming mechanism in his sense... @mark_riedl any specific reasoning? to me the main Q is if RL will still be central in future - good to know how to make if so... @mjrobbins @jackclarkSF @Sam_L_Shead no prob - see: https://t.co/dwwV4zbd4N @mjrobbins @jackclarkSF @Sam_L_Shead it is peer reviewed and forthcoming at a major AI conference (UAI). "RT @alexjc: An idea whose time has come: →Adversarially Learned Inference https://t.co/l2MddMtq4h →Adversarial Feature Learning https://t.c…" RT @signe: Here's the first big example of what I've been working on at TechCrunch. More to come! https://t.co/B5i4tk9ZhF RT @vkrakovna: Excellent AI safety paper from DeepMind and FHI on safely interruptible agents by Orseau and Armstrong. https://t.co/H2zZchC… @gosainnn hmmm, interesting. Thanks for sharing! RT @riedelcastro: Interested in NLP and an ATI fellowship? Let me know! Lots of NLP related areas in call (e.g. @nlpandcss)! https://t.co… "Convolution by Evolution: Differentiable Pattern Producing Networks," Fernando et al. at DeepMind: https://t.co/7MFUWZhj1v @beaucronin NBD Interesting NIPS 2015 workshop talk by Greg Wayne at DeepMind: "How Can We Direct Our Agents?" https://t.co/Vj7942j9QK Huge improvement on the Ubuntu dialogue task. "Multiresolution Recurrent Neural Nets: An Application to Dialogue Response Generation," Serban et al, IBM/Montreal: https://t.co/Z7JR0gsQrJ "Generalizing and Hybridizing Count-based and Neural Language Models," Neubig (Nara Institute) and Dyer (DeepMind): https://t.co/Pni8FFtUoW @MattLevinson @FHIOxford thanks! :) @mark_riedl the paper is pretty reassuring actually... @jackclarkSF they'll be leaders in AI the way Domino's might be leaders in robotics ;) @jackclarkSF in his defense, he did clearly specify he meant verticals vs. broad AI apps, but even there..."leader" vague but still dubious. RT @demishassabis: #DeepMind safety paper in collab w/@FHIOxford on making agents that can be safely interrupted: https://t.co/Q91Nt8Ykxq -… "I absolutely think that we can be a leader in artificial intelligence." - CEO of eBay. lol. https://t.co/TPnmPQ7Nhu NIPS 2015 workshop videos: https://t.co/L7NUmJQzIC From conclusion: https://t.co/pLL0WgZnjI Great work by Orseau and Armstrong on AI safety. On making agents safely interruptible. https://t.co/3VPK60EayD RT @fchollet: In other news, the Indiana Jones movies did not accurately depict archeology as a scientific field. RT @fchollet: Issue in talking about AI: we say AI, the scientific field, but that's not what the media hears. They hear AI, the pop cultur… RT @2020science: HGP-write emphasizes responsible innovation, but is it a “responsibility-wash” to legitimize the research? https://t.co/54… @williamstome +they can do more than perception (see eg Value Iteration Networks) but agree skepticism justified/they don't do everything :) @williamstome and changes btwn 80s and now (ReLU activation, batch norm, and now attention, memory etc) that make some critiques seem dated @williamstome I preferred Karpathy's take on some related issues here: https://t.co/IYkfUUc6aa think key to recognize "DL"=moving target... RT @tdietterich: @tdietterich Correction of date: AI for Social Good is *Tuesday* 8:30am ET. #AI4SocialGood #FutureofAI I kinda love The Thirteenth Floor :) And yes, relevant to Musk's interests... https://t.co/qALvGG4HLd @halhod sooo gooood RT @KaiLashArul: Some neural networks just want to watch the world burn (@anh_ng8 et al., 2016). Serious research + creative AI. https://t.… @halhod you read Ready Player One? RT @graphific: Curious about Magenta, but seems a bit premature PR launch https://t.co/bWZG2MqTMN #CreativeAI https://t.co/b2N9nnCzVm (could give tailored recs if anyone cared, but thought some might like /benefit from those for various purposes) Science policy book recs: for noobs, Beyond Sputnik. U.S. history/SP theory: Between Politics & Science. Methods: Science of SP Handbook. @jsfour it's over now, but this interview at Code Con: https://t.co/egfKFv9Ibz Alright, Musk is done talking about AI stuff. Now back to my regularly scheduled thinking about AI stuff. This is a pretty long/wide-ranging interview even by Musk interview standards... @fchollet ah, thanks! @fchollet are you referring to a specific article or just a general trend? @j2bryson there are folks at ASU who do futures studies/scenario planning stuff. Some do/don't use "futurism" label. RT @tdietterich: AI For Social Good workshop will be live streamed https://t.co/OzebwlNRNQ at 8:30amET Monday #AI4SocialGood #FutureofAI @sknthla cool! Good luck. :) RT @janexwang: Great summary of ICLR 2016, deep learning has had an exciting year so far :) https://t.co/uDTHFfKmqn This is apparently by Ray Kurzweil's group (he's a co-author). Involves training on big Reddit conversation dataset. https://t.co/BR7ZzwYjdt "Conversational Contextual Cues: The Case of Personalization and History for Response Ranking," Al-Rfou et al.: https://t.co/ONuhhhEwos NLPeople, thoughts on DeepText? @AnaPopescu_SV how about neural style transfer of a pic of you and a bunch of formulas related to neural style transfer... @j2bryson (speaking of which, will prob get back to u re: paper next week :) maybe discuss then) @j2bryson partners of ASUcentered Virtual Inst of Responsible Innovation: https://t.co/nNWPghuvfJ prob. deserves >tweet length discussion :) @j2bryson Stanford/Berk, RPI, NYU, Boulder, Sussex, UCL, George Washington, Georgetown... lots, tho small scale usually, Sussex biggest prob @j2bryson there are other institutes that do science/tech policy sorts of things - usually more on ASU end of spectrum, near term, smaller.. @j2bryson White House event? No, if so (prob shoulda been..) @j2bryson the fourth what? @j2bryson maybe not understanding question, but CSER does have twitter: @CSERCambridge @AnthroPunk thanks!! :) @AnthroPunk yep, it's on my high priority list! Would have read already but have exam in days/mandatory reading for that RN. will soon :) @AnthroPunk def. interested in talking more at some point. Think disagreements if any are magnified on here due to compression.. @AnthroPunk "etc." isn't supposed to be dismissive either but I could see it coming off that way! sigh. Twitter probs. point taken though. @AnthroPunk (and I am not trying to dismiss anything/anyone - would "HCI, STS, etc." be better? would have said that or longer if room) @AnthroPunk yeah, FWIW I was aware of the HCI reductionism but tried to fit in one tweet ;) but do need to read more of your work for sure. @JesseJenkins nice work! @AnthroPunk again, haven't given as much thought to the relative proportions of those, perhaps, just think the tech side is non-trivial here @AnthroPunk in at least some cases/ways, I mean. Like dialogue: yes, design/user understanding key, but so is the underlying tech.. @AnthroPunk maybe, haven't thought about it as much as you apparently! But still seems plausible that best NLP+ok HCI>worse NLP/best HCI... @AnthroPunk that's a fair point, though it's a huge company so I'm hesitant to agree overall. Not convinced others massively better... @AnthroPunk not sure who you meant by "them" - if Apple, yes, acq helped with dialogue for sure. If Google, yep :) @AnthroPunk what is a definition of AI under which Google isn't probably/probably isn't dominant? (but I doubt the first part, too, FWIW) (overall, I mean. It's more plausible that Apple has better dialogue as @barneyp suggests than that Google isn't leader in most AI domains). RT @tdietterich: Looking forward to speaking at the second @whitehouseostp workshop: AI For Social Good #AI4socialgood https://t.co/S7Vtd6O… This is obviously correct re: Apple, less clear but probably still true for "others." https://t.co/l40Z23X5zp @mat_kelcey was just trying to get this working last night but had weird install issues/not enough time to fix :( you using/trying it? @alexjc suspect that may play a role, but not the only factor - e.g. value alignment... prob. lots of literature on this I'm unaware of :) @alexjc not rly, at least unless bigness = (possibly faulty) perception of power-based, e.g. https://t.co/jeyMc2oNHK Military quite "big" :) @alexjc fyi one of the "rather angry" votes is me having a touch screen fail while trying to select "somewhat suspicious" :) Christiano's work is 1 reason I've become a bit more optimistic about (partial) solutions to AI safety soon, but lots of open issues still.. "The reward engineering problem," yet another good post on AI safety stuff by Paul Christiano: https://t.co/Tq9ZVn6DFo @mark_riedl I'm biased b/c used to work there but I think ARPA-E's better: https://t.co/2uioh7d66J DARPA can get away w/ silly ones bc DARPA @mgubrud that is a fair point, have things to say but unfortunately prepping for exam RN :) feel free to email if you want.. @mgubrud agreed. I think that's compatible with (some) things we'd call moral robots/AIs, but lots of details/nuances involved, non-trivial. @mgubrud yep, and likewise - realize it's complex, + we'd prob. at least agree on many cases where it'd be bad/reasons why it's risky, etc. @mgubrud I know you do :) but yes I think that suspicion is justified and I would prefer this and lots of other things be civilian-dominated @mgubrud I think it's nec. for pretty wide range of valuable applications in health, education, etc. +Not sure we can resolve on Twitter... @mgubrud that being said, I would *much* rather see this sort of thing funded by civilian agencies. @mgubrud could be one enabler of that (which I agree bad) but not necessary or sufficient for it, and is necessary 4 many good applications. Someone said before they'd have something in 2017. And article says IBM/Google involved - really? Dunno how trustworthy these sources are... """Dubai Police is reportedly planning to use robots and artificial intelligence in its policing of the city by 2020."" https://t.co/wnVIwohuzK" (ONR-funded project, by the way - one of the best recent military investments in AI/robotics, IMO!) Nice video summarizing the Scheutz/Malle et al. research program on machine ethics: https://t.co/QVAafTAKjF "Adversarial Feature Learning," Donahue et al.: https://t.co/K9IDJ4gIdp """Model-driven Simulations for Deep CNNs,"" Veeravasarapu et al.: https://t.co/T13Q0avoHY On simulated and/or real data for vision training." Benchmarks changed in recent years, so older papers are hard to compare, but this (by some of same folks) helped: https://t.co/wW9dNIOFFt Upon skimming, looks like impressive results on cont. control (which is hard 2 evaluate historical prog on but better w recent benchmarks). As @mark_riedl points out, this is by OpenAI folks (mostly) - look fwd to reading! First paper by >1 of em I think.. https://t.co/QxMRHUU2J7 @mark_riedl @shakir_za @DeepSpiker or rather "as noted by [39], does not explicitly favor exploration." Thoughts? Haven't read 39 either.. @mark_riedl seems related- only skimmed+parts of @shakir_za and @DeepSpiker over my head ;) OpenAI paper says empowerment !=exploration...? @sknthla yeah, subsidies to corps for having low wage workers prob more direct, maybe others, though I like UBI bc many benefits/scales well @sknthla case for UBI doesn't depend on that/helps ppl to afford to choose good jobs :) but yeah, generally agree on that point... "Curiosity-driven Exploration in Deep Reinforcement Learning via Bayesian Neural Networks," Houthooft et al.: https://t.co/JleuJqnxmc RT @paulkrugman: I will never forgive Donald Trump for making me feel some respect for Bill Kristol. https://t.co/qhcC56ks7I @nsaphra the shirt is great, too. Nice post by @karpathy on deep reinforcement learning: https://t.co/IYkfUUc6aa RT @karpathy: New blog post: "Deep Reinforcement Learning: Pong from Pixels" https://t.co/4WIHOGwr3Z on policy gradients https://t.co/mFsiK… @hintikka @Smerity yeah... I loved the paper "state of the art Atari control with shallow reinforcement learning" for calling this out :) RT @karpathy: "Control of Memory, Active Perception, and Action in Minecraft" https://t.co/XvEetGYecL 3D mazes; nice paper. I welcome Minec… "RT @hugo_larochelle: My notes on One-shot Learning with Memory-Augmented Neural Networks: https://t.co/e7BneQ85l2 Great meta-learning paper…" ICYMI @Aelkus RT @yoavgo: we are working on a cool/convenient way to run and manage ML experiments. where should we publish this? (academically, besides… @dmarthal yeah, very dubious.. This seems more plausible than them delivering on their current hype. Are there not better options, though? Dunno. https://t.co/DqfmrRrnCR "Synthesizing the preferred inputs for neurons in NNs via deep generator networks": https://t.co/mNVEiaY1Bi https://t.co/SDUh82rcfC Also: 1. Google News results on the subject show the spectrum of tech journalism quality pretty well, + 2. SEO fail. https://t.co/I1Z7jgS8Pf (few months later.... cringeworthy video) This Asus/Zenbo thing looks like what happens when a board member who read Second Machine Age asks the CEO "what's your robotics strategy??" @beaucronin disagree about the AI winter coming (soon) thing but other than that, yeahhhh.. "Weighted Residuals for Very Deep Networks," Shen and Zeng at Peking University: https://t.co/6uYn4Gd5Ju https://t.co/gTz3uuuaWZ "Control of Memory, Active Perception, and Action in Minecraft," Oh et al. at University of Michigan: https://t.co/5hCc9A36D0 @tmosley4 Minecraft maybe a good place for this. e.g. https://t.co/5hCc9A36D0 @tmosley4 (or there were other signal of insider belief of imminent major development, but I've seen no such signs/much counterevid.) @tmosley4 we've got a while, don't worry (yet). If all the major AI labs stopped publishing or something, then maybe reason to worry ;) @tmosley4 they're not DeepMind et al. but there are lots of smart ppl who work for militaries and do good work. >>0 talent at ONR, DARPA etc @jeffbigham (haven't read in full yet though so may be butchering it) @jeffbigham neither though they mention both. current =AIs play against each other, sample game states, train NN to guess winner from state. @tmosley4 ...so doubt it'd make much of a difference. Plus they presumably have actual/more realistic war game simulators already anyway. @tmosley4 while militaries are behind in some respects, they're competent enough to port core AI tech like neural nets/RL etc.... If Alberta folks think it's maybe "not far off," that increases my estimation of likelihood that DeepMind has already done it or is close... "These...results together w/ recent advances in hierarchical search suggest that dominating human players in RTS games may not be far off." "Evaluating Real-Time Strategy Game States Using Convolutional Neural Networks," Stanescu et al. at U. of Alberta: https://t.co/4E9a3YGYEr RT @AndrewLBeam: I've started a list of medical datasets for #machinelearning. See something missing? Let me know and I'll add it: https://… Whoops: should have read: "from programs to solvers," not "problems." Anyway, interesting big picture take on AI. That's something I also learned in @rao2z's class: e.g. deterministic planners beating non-D planners at non-D problems. Weird but works :) E.g. he discusses how AI methods often work well despite/because they reformulate/simplify the problem, even if doing so seems weird/wrong.. (Geffner emphasizes how modern AI research differs from early work and is fairly general in a certain sense, + says other interesting stuff) "Artificial Intelligence: From Problems to Solvers," Geffner 2013: https://t.co/k6lGAIKjZP Nice counternarrative to "narrow vs. general AI." @azeem esp this https://t.co/cpBVJDXs77 @azeem see other graphs for actual time on x axis @azeem (represents >year worth of progress in that the ideas of first paper existed before publication/in earlier paper but right ballpark) @azeem that spans a little over a year. @azeem this is the newest but there are many in the media thing https://t.co/Nf2i4JkSt5 @azeem nothing super new but you can find all the Atari ones by flipping through my "media" stuff on here... @azeem all of the above? ;) RT @meganjpalmer: Next U.S. National Military Strategy to be Classified - thanks to @neva9257 for pointing me to the article. https://t.co/… RT @rbhar90: If true, this is worrying. Current autonomous systems lack the intelligence of a poodle. I foresee tragedies here... https://t… @tdietterich I'm also glad to hear you're optimistic about many of them being already addressed or feasibly addressable :) @tdietterich but I have more positive take on book - some errors/omissions inevitable in topic with that scope. Points to many open probs. @tdietterich totally agree with you that humility is a promising (partial) solution, though, along with resource constraints... @tdietterich that's def. true by definition given "omniscient," but "smart" compatible with blind spots re: value alignment... @tdietterich ...and more complex goals seem to raise other safety issues not as easily addressed. @tdietterich that's fair, though if I recall correctly that wasn't framed as likely but as illustration of convergent instrumental goals... @tdietterich no (?), I think it's generally pretty well caveated - could you give a specific example? @rbhar90 yeah, def. needs more work - though fortunately some ongoing! e.g. https://t.co/xV6HcIXTEv I nag my philosopher friend to help ;) @rbhar90 ah, yeah, I liked that article :) @rbhar90 meaning ethics related to near term/current AI or re: what ethics AI should have/difficulties with that? (not that it's the only relevant publication or perfect, but it addresses a large # of common counterargs/is more nuanced than many think) More generally, many args against AI risk concerns are strawmen- increasingly inexcusable now that there's paperback of Superintelligence :) @Floridi (FWIW, I love Floridi's book The Ethics of Information, but think @xuenay is right that his writing on AI risks often misses mark) "Response to @Floridi on Dangers from AI" by @xuenay (starts on page 9): https://t.co/tx3urwtc5s RT @MSFTResearchCam: We're seeking interns to help us reveal how Minecraft can be used as a testing ground for AI https://t.co/RM8eRvHmXO h… But in general, I think evaluation/theorizing thereof is very much under-invested in, partly for incentive reasons and partly b/c it's hard. Would also call out the (general) game playing as benchmark folks for being thoughtful/complementary to the above works (e.g. @togelius). (lots of other folks do good work on benchmarks, evaluating particular types of progress, etc. but not so much general frameworks/theories) Hernandez-Orallo is one of the most serious thinkers on that topic by far IMO, along w @ShaneLegg, Javier Insa Cabrera... not enough others! Jose Hernandez-Orallo is writing a book on evaluating (art.) intelligence and it's epic - hope it gets big audience: https://t.co/d9dOjepsks @beaucronin basically everything but deep learning ;) @Autumnsburg (for most games, at least...some cases of very fast learning) @Autumnsburg (specifically, the 1 million frame results). Closest comparison I can think of. But yeah, still arguably way slower than human. @Autumnsburg yeah, I meant the learning to see. Here (https://t.co/9IgAfcecQb), decent (though not DQN) performance in ~ that much time... @Autumnsburg (for some games, I mean - not doable for all games with or without built in knowledge RN) @Autumnsburg that's doable now with preexisting features AFAIK, but perhaps unreasonable expectation when starting from scratch... @alan_winfield looks like a great event! "RT @NandoDF: Open source Neural Programmer and Interpreter: https://t.co/KSNQVgB8Q7 https://t.co/IZajx57xXE" Last link is a paper by Aliper et al. - title was too long to fit :) CC @rbhar90 """Deep learning applications for predicting pharm. properties of drugs + drug repurposing using transcriptomic data"" https://t.co/BKf1V40M2I" (and all the other reasons it's impressive like cross-game performance, learning from scratch, etc. but not sure many are aware of baseline) (Super)human-level Atari AI=more impressive than commonly appreciated. Baseline isn't random human but pro game tester w/ 2 hours practice. RT @j2bryson: @Miles_Brundage company cultures a lot closer. And Pratt took over MIT leg lab from Raibert when he left to fund BD. Dangerous discovery: the time lapse and slow motion video functions on the iPhone are very fun to play with. "Model-Free Imitation Learning with Policy Optimization," Ho et al. at Stanford [partially funded by Toyota]: https://t.co/3eqXz7T0mO "Stacking With Auxiliary Features," Rajani and Mooney at UT Austin: https://t.co/T9SDcVCzxm "SNN: Stacked Neural Networks," Mohammadi and Das at Stanford: https://t.co/j1dJ96lYQZ https://t.co/av7INLpu1J """Deep API Learning,"" Gu et al. at Hong Kong U. of S&T/Microsoft: https://t.co/NnZ6v7GrYe RNN encoder-decoder from NL query to API sequence." @robinhanson thx! @robinhanson what do you recommend (most highly) by him? RT @GaryMarcus: Love this! Could a neuroscientist understand a microprocessor? Required reading for anyone studying how brain works https:… Amitai Etzioni and @etzioni, "AI assisted ethics": https://t.co/xBJuQkV9iJ @lukeprog ah, I stand corrected - had thought the Tron game came first! Another good new post by Christiano: red teams for AI safety: https://t.co/cVIVAgv4GA @lukeprog Tron = 70%, Tron Legacy = 51%...think some data is missing, there may be others. But yeah, generally bad. Dog playing + slow mo + light reflecting in eye = horror movie. https://t.co/3c6vM0ERDt RT @danieldewey: Christiano: how can we train an AI system to avoid catastrophic actions? https://t.co/GgBcl2oZZN Talk by Sergey Levine at ICLR 2016, "Deep Robotic Learning": https://t.co/YuzPLzXajh @jackclarkSF (not sure how next word prediction prog related to compression prog exactly but seem related, or so Hutter would say at least) @jackclarkSF Adaptive Computation Time & Grid LSTM both show next-word prediction on the data, not yet SOTA in bits/char if I recall though. "RT @hugo_larochelle: The #ICLR2016 talks are now on https://t.co/uSIEIbRM1u: https://t.co/hftgdlwxK7 Enjoy! :-)" @santoroAI @tmosley4 (unlike e.g. DNA where it's very clear what the discrete sequences are once tech was ready, so diff patent issues?). @santoroAI @tmosley4 + even there, saying what brain's algos are given data will require some theory, so not clear if situation is changed. @santoroAI @tmosley4 seems plausible this could change in future, raising Q of if right/close guesses should remain patented... though + RT @santoroAI: @tmosley4 @Miles_Brundage Using the brain as inspiration != using it's algorithms. New algorithms involve non-obvious insigh… @rbhar90 @rcalo don't think there's prob. w/ idea patents per se if novel, non-obvious, + useful. But patenting bio raises further issues... More foreshadowing of Watson's subsequent (/continued) horribleness. https://t.co/MuDOiNXcsf On the first genome patents... https://t.co/hFBoM5GvVX Among other things, even if there were justified bio-inspired/de novo legal distinction, bio-inspiration is super broad/fidelity may matter. Don't really have views on this - could imagine good args for both sides + lots of nuances - just curious/haven't seen issue raised before. (+ related to long history of DNA-related patents...) Should AI algorithms derived from/inspired by human (/other) brains be patentable? Seems like potentially diff. Q from de novo ones. @rcalo RT @mres: Kids have now shared more than 15 million projects in the @Scratch community. Keep on Scratching! (=^..^=) https://t.co/0I8RwphCjc @barneyp Think it's plausible to expect that Google Assistant >> Google Now for example. But not possible to know for sure for few months :) @barneyp Though they seem narrow (/broad test in article unspecified). + broader point is that future system vs current = apples/oranges... Good point - wasn't aware of these papers from pre-acquisition: https://t.co/gt5xJNTzLx https://t.co/Ww3lQTwNq2 RT @barneyp: @Miles_Brundage there are some metrics for dialog systems and I think the Cambridge VocalIQ team scored highly on them. @bjorn @barneyp yeah, was just referring to Q of if it'll be better/more functional than other stuff. Even if not, may be more widely used. Google Assistant, Cortana+, and Viv are the ones to beat by the time this is rolled out, though.. + no good metrics. https://t.co/0ZOnxATbl3 @alexismadrigal as opposed to not at all? Or starting late? Latter seems worse than former...first two seasons are great (I'm behind tho) @alexismadrigal def. Google selling Boston Dynamics to Toyota. Makes sense (for Toyota at least)... https://t.co/9zd3O7Cd8i "RT @rsalakhu: Encode, Review, and Decode: Reviewer Module for Caption Generation with Z. Yang, Y. Yuan, Y. Wu, W. Cohen https://t.co/DWde…" RT @CT_Bergstrom: Great question from Konrad @KordingLab: Could a neuroscientist understand a microprocessor? https://t.co/39qKwcE7lh https… @hintikka especially if they're philosophers, it seems... @sarahjeong whiteboard? RT @lmthang: Google patented my ACL'15 paper on neural machine translation. Hope it's only a defensive one! #NLProc #dlearn https://t.co/pS… More... AI is arguably "calling everyone's bluff" now. https://t.co/yg0AI8MghA Yet another good reminder that scientific progress can be faster than expected as well as slower (Cook-Deegan 1995). https://t.co/vGFg1lwm0d (scare quotes because the discussions I've seen of that question generally focus on human-controlled, large systems, not sure if same issue) Not sure that Russell's points here are being taken seriously enough in talk of "drones" as being/not being big strategic deal (@Aelkus?). "Autonomous weapons are a new, scalable class of WMDs ideally suited for terrorists and dictators."- Stuart Russell: https://t.co/gz9nNRKhlf RT @mark_riedl: MurphyBot is an "experimental chat bot that can answer 'What if...’ questions” by responding with pictures. https://t.co/Ms… @pmarca perhaps not unrelated to this: https://t.co/SeQePBQME8 Also, this, in retrospect 🤔 https://t.co/3GdQL4HPGC (great book btw. It's not intended for this AFAIK, but could serve as a pretty good primer on some aspects of how US science policy works) James Watson and John Kendrew's letters to each other circa 1989 have interesting tones. https://t.co/WBEtBGMDbA Nice to meet @KayFButterfield, @WendellWallach, folks at @CSERCambridge, etc. earlier. Lots of great work going on on AI ethics/policy! @rbhar90 depends in part on its distribution, as well... @rbhar90 perhaps, though arguably AI also far more general purpose economically/socially than gene stuff... Lots of parallels between genome mapping in the late 80s/90s and AI today... from Gene Wars (Cook-Deegan 1995). https://t.co/Hy8Ie21nM1 "Deep Predictive Coding Networks for Video Prediction+Unsupervised Learning," Lotter et al: https://t.co/EcorXUCLDn https://t.co/tn5ICETLxC RT @raihan_: this is going to be awkward. https://t.co/LSi0xwQXb2 RT @karaswisher: Now that is a letter: An Open Letter to Peter Thiel https://t.co/ny3WeKdKpb @hintikka lmao May say more after reading in full but based on earlier draft/a few sections of final, @robinhanson's Age of Em is a great read. Recommend. RT @sarahjeong: 🚨 GOOGLE'S USE OF THE DECLARING CODE AND SSO OF APIS IS FAIR USE 🚨 RT @isrcmu: Register now for @CarnegieMellon and @whitehouseostp workshop on safety and control for #AI. https://t.co/TCsQkb7rka https://t.… RT @zephoria: Council on Big Data, Ethics & Society released its white paper, complete with recommendations. Enjoy!! https://t.co/dGNOjf1pok "RT @rebecca_roache: Archeologists just discovered Aristotle's tomb https://t.co/e5iuouz7z8" RT @kashhill: "When you kick the wheels on new technology, sometimes the wheels kick back.” A Tesla Model S autopilot crash. https://t.co/g… @rcalo Adama would be proud. This wouldn't help with skin job infiltrators, though. @hintikka yeah... I'd guess >10% of AI articles are advertorials... RT @kashhill: Our first Real Future weekly newsletter goes out today. If you would like to be on the exclusive list of recipients… https://… Talk by @erichorvitz on the 100 Year Study on AI: https://t.co/lyV9tKui81 Even more remarkable given that they often are very confident about very different conclusions. https://t.co/TntNGGQRyN RT @tonyjprescott: Any science journalists interested in covering an MIT-sponsored workshop on brains, minds and machines? Get in touch htt… "On-line Active Reward Learning for Policy Optimisation in Spoken Dialogue Systems," Su et al. at Cambridge: https://t.co/hIBrBTudbo "Learning End-to-End Goal-Oriented Dialog," Bordes and Weston at Facebook: https://t.co/4LN8fnDOg7 New benchmark for that, MemNet results. "FractalNet: Ultra-Deep Neural Networks without Residuals," Larsson et al. at U. of Chicago/TTI Chicago: https://t.co/snPttgGtdu "Adaptive Neural Compilation," Bunel et al. at Oxford/Microsoft: https://t.co/3re8IPAMuL "Automatic Open Knowledge Acquisition via LSTM Networks with Feedback Negative Sampling," Kim et al. at Pohang U.: https://t.co/MRMHYtOMGG "Encode, Review, and Decode: Reviewer Module for Caption Generation," Yang et al. at Carnegie Mellon: https://t.co/O6hSW9ynac "Variational Neural Machine Translation," Zhang et al. at Xiamen U./Soochow U.: https://t.co/OUGBh7WaZb "Virtual Adversarial Training for Semi-Supervised Text Classification," Miyato et al at Kyoto U/Google Brain/OpenAI: https://t.co/9t98UXeJnn @jackclarkSF @hintikka wish I could go to all of em! :) @hintikka @jackclarkSF I'll be at IJCAI so there's that in its favor ;) also, this is adjacent to it which is cool https://t.co/nFSIhFBY1v Cool stuff by @cholodovskis and Bowling - "Learning Purposeful Behaviour in the Absence of Rewards": https://t.co/PIurmf5gYM "Deeply-Fused Nets," Wang et al. at Microsoft Research/Shanghai Jia Tong U./Uni. of S+T in China: https://t.co/6pTtlVuMAN "Learning Multiagent Communication with Backpropagation," Sukhbaatar et al. at NYU/Facebook: https://t.co/k5RoFhesJX RT @gdb: Super excited to work with our new team members: https://t.co/wKgeLsEgyG. "One factory has 'reduced employee strength from 110k to 50k thanks to the introduction of robots'" https://t.co/u26M41sBar H/T @RoboEthics RT @tonyjprescott: Horizon2020 own goal- cancelling the Cognitive Systems programme just as AI is taking off. No big AI companies in Europe… RT @rcalo: White House announces opportunity for public comment on artificial intelligence. https://t.co/hqW7ZFJVZu RT @GaryMarcus: Challenges in engineering with machine learning. fantastic #EmTechDigital talk by Peter Norvig now online. Must see. https:… RT @erichorvitz: Video available of People & Robotics seminar at UC-Berkeley, on motivation behind the 100-Year Study on AI: https://t.co/… Different source, same topic (Chinese 3 year plan for AI): https://t.co/XG3iJMEkDx https://t.co/D8pE7kwcoA "[China] shall be in line with global AI technology and industries by 2018, it [China NRDC statement] said." https://t.co/jsyCXZR0cy "showing that existing machine learning approaches are in general vulnerable to systematic black-box attacks regardless of their structure." @Aelkus police chef, I hope. Probably an interesting person :P "Differences between Industrial Models of Autonomy and Systemic Models of Autonomy," Aleksander Lodwich: https://t.co/vlJW8ygLfN @Aelkus "Sequential Neural Models with Stochastic Layers," Fraccaro et al.: https://t.co/bdNMHX9LKw "Hijacking Bitcoin: Large-scale Network Attacks on Cryptocurrencies," Apostolaki et al.: https://t.co/vURUZlIka7 RT @rao2z: Our recent ICWSM paper https://t.co/gdveQJ4sOp (he was also amused by the mention of the prior Twitter discussion of him and his name, and I'll be sending it to him :) ) Update: met him earlier and he is, in fact, a cool guy. https://t.co/VIyIrlziJ9 Enjoyed AI policy workshop organized by @rcalo, @EdFelten44 et al. - may share some thoughts eventually, but tired + arXiv papers to read :) RT @rcalo: My panel at Artificial Intelligence: Law and Policy. https://t.co/kSvOQqC6Z2 """Hierarchical Memory Networks,"" Chandar et al. at Montreal/Twitter/IBM/CIFAR: https://t.co/Nffy9bKxOy ""hybrid btwn hard+soft attention MNs""" (including Goodfellow with his OpenAI hat again... they're seeming pretty collaborative so far...) "Transferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samples," Papernot et al https://t.co/fuWNEQKTlm They fixed the URL in v2, works now: https://t.co/PJVOHIulvY link: https://t.co/9oOZgMEwmi At UW for the first OSTP AI workshop, this one on policy stuff. It's being livestreamed. https://t.co/hxC2iqV0pK @williamstome congrats! @dmbutopia have you read/have thoughts on Trouble on Triton? RT @SethBaum: Free access to journal version of our new AI superintelligence risk model paper at this link: https://t.co/5b5byJIFeJ RT @_rockt: Differentiable memory, Turing machines & ADTs, now a diff. programming language! https://t.co/vJdO3ShmpT #dlearn #ai https://t.… RT @mrtz: Read this instead of the main article. https://t.co/sOYiEuZliw They'll be making this dataset public soon (link not yet working): https://t.co/Cy02Kaiqeb """Deep Multi-task Rep Learning: A Tensor Factorisation Approach,"" Yang and Hospedales: https://t.co/7RMDa1rcvb [done for now :) catching up]" "TensorLog: A Differentiable Deductive Database," William Cohen: https://t.co/9OD9khJSOr "Programming with a Differentiable Forth Interpreter," Riedel et al.: https://t.co/hikI7I0wDG "Query-Efficient Imitation Learning for End-to-End Autonomous Driving," Zhang and Cho: https://t.co/GQo0o6UslE "Swapout: Learning an ensemble of deep architectures," Singh et al.: https://t.co/gh6Ui8770z Stuart Russell in Scientific American - "Should We Fear Supersmart Robots?": https://t.co/V4uXKPR8qH RT @rao2z: David Silver@DeepMind, the tech grinch who stole Go from humans, will share #AlphaGo arcana at #IJCAI16! Last week for early r… Correction: DQN is very, very slow. https://t.co/jHO5YgsLrY (looks interesting/has some more on Google Brain's big robot grasping video datasets. Also includes Goodfellow wearing his new OpenAI hat..) " Unsupervised Learning for Physical Interaction through Video Prediction," Finn et al.: https://t.co/8A5coFktvz "Deep Transfer Learning with Joint Adaptation Networks," Long et al.: https://t.co/xF6Q5MLo25 (more beefy/comprehensive than but related to earlier paper on riddles by same folks...this one includes some new tasks, as well) "Learning to Communicate with Deep Multi-Agent Reinforcement Learning," Foerster et al.: https://t.co/fwWw6YKuWm RT @shakir_za: The #ICML2016 Workshop on Data-efficient Machine Learning has 26 accepted papers! Check them out here: https://t.co/bcvUj7mv… RT @soumithchintala: Residual Networks are Exponential Ensembles of Relatively Shallow Networks. Interesting...: https://t.co/c0cCwKqlaG ht… @TobyWalsh congrats! New Scientific American issue has stuff by Bengio on deep learning and Russell on AI safety. Nice plane reading :) https://t.co/ARsWJ1Igpb @hintikka it'll also be livestreamed, but yeah I'll prob livetweet too :) @botminds (specifically, this suggested in appendix that Montezuma's Revenge is within reach: https://t.co/AcqwpG20Fk maybe also others?). @botminds and I could imagine better exploration + other stuff addressing very bottom soon. May make more fine grained pie chart at some pt. @botminds indeed, very bottom of list still hard - though some movement near bottom (postDQN >75% crossed out here). https://t.co/BjkVp8A2Hm Anyone else gonna be at the White House AI workshop in Seattle? (I will) RT @sigfpe: Target looking for category theorist. Wait that didn't sound right. Try again. Target looking for category theorist. https://t.… @sknthla you'd get the scientist vote! RT @drfeifei: Excited 2b part of #bigdatamed conf. My talk is "Guardian angels: towards AI-assisted care" https://t.co/JPgQDaOb7B https://t… RT @demishassabis: Excited to announce Matt Botvinick (Princeton) https://t.co/ytthPiDl26 has joined #DeepMind to push the envelope of our… @joekaras14 there's also a paper on economic/social benefits and one on utility reform, CC @clarkamiller Series of papers by DOE SunShot team on solar cost/diffusion opportunities: https://t.co/lIjFz774QM Brief mention of automation. @joekaras14 RT @alan_winfield: Here is my full response to the UK @CommonsSTC inquiry on Robotics and AI: From Ethics to Regulaion and Governance https… Future VR also a (for me, weak) factor. But being able to use best AI assistant is critical if/when they're good, and gap may soon be big. Uncertainty about Google Assistant working on iOS is making me more seriously consider Android for my next phone (now: iPhone). Thoughts? @girlziplocked when you say full comm., does full have specific meaning as opposed to just differentiating from soc. dem., liberalism, etc? @hintikka because taxes there haven't yet been successfully rebranded as crowdsourcing Nice sci-fi short (5 mins) by Keiichi Matsuda on augmented reality/gamification/etc.: Hyper-Reality": https://t.co/OkBvDJbdma @lukeprog thx for querying your neural nets :) @hintikka see: https://t.co/fQaM8eQdWh @hintikka he's harassed ppl on twitter before, though - not isolated thing. @lukeprog might have been this or on the same topic: https://t.co/145rWRZYgQ @lukeprog yeah, worried it might not. :/ think at least 1 part of it dealt w/ backfire effect/negative statements, but never read it at time I vaguely recall a good blog post or review paper on lessons from psych/biases lit for constructive debates. Can't find, though. @lukeprog? ICYMI: I thought this was cool ;) https://t.co/Nf2i4JkSt5 @rivatez lawl. perfect. @MrMeritology @kennethpayne01 @Aelkus agreed. @MrMeritology @kennethpayne01 @Aelkus just not sure that, given good representations of those, anything much more needed for creative soltns @MrMeritology @kennethpayne01 @Aelkus indeed. agree the action space/dynamics there are rich, + goal structure complex. @MrMeritology @kennethpayne01 @Aelkus indeed, I just think that's bit of a red herring re: whether it's Go-winning-behavior is creative. @MrMeritology @kennethpayne01 @Aelkus + I'd distinguish goals/possibilities. Point re: Atari/Go is that creative possibilities were found. @MrMeritology @kennethpayne01 @Aelkus + at least if "pre-defined goals" can include e.g. "outcompete other nations"-don't care if it's poet. @MrMeritology @kennethpayne01 @Aelkus I don't deny there is a broader sense, but saying that that narrow sense may be what matters here, + @MrMeritology @kennethpayne01 @Aelkus point isn't that strategy=easy but that gap btwn bad strategy and decent maybe > btwn decent+creative. @kennethpayne01 @MrMeritology @Aelkus well, DRL can certainly be shortsighted/bad at exploration. Dunno about "deluded"/if that's distinct.. @MrMeritology @kennethpayne01 @Aelkus again, not sure why that matters - do we want AIs to question why they do strategy, or do it well? @MrMeritology @kennethpayne01 @Aelkus Not surprising they don't do other things - I take creativity here to be re: solutions to their goals. @MrMeritology @kennethpayne01 @Aelkus true - but to me seems like reason why good rep/inf is hard, not why you wouldn't then get creativity. @MrMeritology @kennethpayne01 @Aelkus should we care if it's accidental or genuine/intentional/etc.? @kennethpayne01 @MrMeritology @Aelkus e.g. DQN in Atari game Breakout - finding the clever-ish tunneling solution happens automatically. @kennethpayne01 @MrMeritology @Aelkus w/o big breakthroughs, you seem to often get creativity for free w enough compute/rich representations @kennethpayne01 @MrMeritology @Aelkus so with deep reinforcement learning, for example - much work on better exploration going on but even.. @MrMeritology @Aelkus @kennethpayne01 p.s. being brief here b/c Twitter so many caveats needed, e.g. "good inf." includes good exploration.. @MrMeritology @Aelkus @kennethpayne01 not sure if that's definitional issue or what... @MrMeritology @Aelkus @kennethpayne01 think my disagreement is partly bc interpret current evidence differently, e.g. think AlphaGo creative @Aelkus @kennethpayne01 @mark_riedl may have thoughts... @Aelkus @kennethpayne01 (not that we have good rep/inf for strategy now, just saying). No need for new creativity module/algo for AlphaGo.. @Aelkus @kennethpayne01 Interesting stuff! I'm not sure "creativity" isn't an epiphenomenon of good representation and inference, though... @rcalo look forward to attending! RT @rcalo: Now available, livestream link and agenda for Artificial Intelligence: Law and Policy https://t.co/31seLztl14 & https://t.co/GB9… RT @fchollet: An interesting new approach to one-shot learning, fresh from DeepMind: https://t.co/YW4ICmXBOY @rbhar90 dunno. @sarahjeong's feed on this has been fascinating, though. Lots of effort to explain stuff to jury. Insert lots of caveats here... better: check out the paper! :) https://t.co/F6Lj585lQq But yeah, this seems quite important. "Lake et al a few months ago: NNs can't do Omniglot. PPI is human-level. Santoro et al today: MANNs are superhuman. https://t.co/FxQg6Fg8qH" This one's a biggie. https://t.co/59PzCpaxyO Among the contests at IJCAI this year, Winograd Schema Challenge https://t.co/aRcrwNCoVQ My bet would be on Arpit Sharma of ASU if I had to. @Aelkus @alexjc maybe the bigger narrative here is just the diversification of the computing market. CPUs, GPUs, ASICs, neuromorphics... @Aelkus @alexjc seems to assume much of future cloud business will be TF/DL. Plausible, but if untrue, weakens that scenario's probability.. @alexjc @Aelkus (plus, some stuff IBM and others are cooking up seems plausibly even more significant re: DL btwn now and then (8 years)) @alexjc @Aelkus the Moore's Law thing seems vastly overstated. Moore's Law is not about special purpose stuff. It's important for DL though. @halhod pretty much. @halhod and Captain Amerivengers @sknthla ah, maybe. Can't speak to that. @sknthla latter could be pistol, rifle, etc. shooting target. Dunno how far Nevada is from the Bay, so may depend on interests/distance... @sknthla lol it's the thing where a machine throws a piece of clay in the air and you shoot it with a shotgun. There's also shooting ranges. @sknthla I just don't think you need to jump from no gun to machine gun. Surely there are options in CA? Trap shooting is fun... @AnthroPunk yeah. To some extent I've given in to that (though have learned technical stuff for reasons beyond that), but agree not needed. @AnthroPunk likewise - I'll be in the UK in July/should be settled in August, would be nice to chat then (or sooner if urgent ideas :) ). @AnthroPunk yep, I can relate! Haven't fully solved/understood that problem myself, but speaking the language/framing seems to matter a lot. RT @DeepMindAI: #DeepMind Neuroscience team published a great paper in Neuron on how the brain does hierarchical planning (+video): https:/… Don't necessarily agree with/endorse all of it but worth a read, and curious to hear others' takes on his take on others' takes. :) Especially appreciated his mentioning of most AI researchers' failure to anticipate deep learning success, and this: https://t.co/kZDhLgloPi (as mentioned there, Conitzer has an interesting sounding @FLIxrisk grant on making AIs ethical) Reasonable, short article by AI researcher Vincent Conitzer on other AI researchers' views on AI safety/ethics/etc.: https://t.co/WzVES08FJJ "A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialogues," Serban et al. at Montreal/McGill: https://t.co/gyM4fGGtzi @tmosley4 dunno, only skimmed so far. "One-shot Learning with Memory-Augmented Neural Networks," Santoro et al. at DeepMind: https://t.co/F6Lj585lQq @tejasdkulkarni do you think this could come in part from work on (disembodied) computer vision/simulation, or do you think embodiment key? @IgorBrigadir @RoboNarratives oh and I forgot to mention that Poole and @AlanMackworth have a great free textbook: https://t.co/5kRADgbN5x RT @alexjc: Here's Matrix cat again, now looking better. Uses semantic map for background effect, took ages to tweak though :-| https://t.c… That's clearly not enough time to solve all of NLP, but could be a big leap forward in terms of integrating the latest research/design etc. Will be very interesting to see if it lives up to Pichai's very significant hype. Google assistant is not coming out until later this year. Even a few months is long in AI-years :) so some elements maybe not invented yet.. RT @BillGates: #RedNoseDay is a week away! Tweet or RT using #RedNose4Kids and our foundation will donate $10 to end child poverty. https:/… RT @amiconfusediam: With XNOR Nets working so well, I expect TPU-2 to be only binary ops. https://t.co/qL7UyAu45J RT @gatesfoundation: Don't have a red nose? That's ok! For every RT we'll donate $10 toward ending child poverty. #RedNose4Kids https://t.c… @rebecca_roache spoken like a true Millennial ;) @hintikka but do they have something that those academic folks didn't already think up? @hintikka insofar as their angle is similar to Lake/Tenenbaum et al (speed up learning/improve inference w causality etc), good direction... RT @rodolfor: @Miles_Brundage Bay Area investor sentiment changed considerably. No longer hope that Google or FB will pay $1bn for pre-reve… @mark_riedl @rodolfor DeepMind had a good paper, at least. RT @mark_riedl: Just gave a talk to a non-technical audience on why AI should understand and create metaphors. I used a lot of metaphors to… Last tweet speaks to broader issue, though: are financiers and big corps competent to evaluate AI? Sometimes, for sure, but def. not always. Not sure that's their issue - they have lots of industrial partners who may like it. "Best" tech doesn't always win. https://t.co/dHpD2IWy8w @rodolfor fucked how? Nothing big to show/embarrassment? Or under pressure from financiers? RT @IgorBrigadir: @Miles_Brundage I'm sure the team is well capable of producing a lots of great work. As for lofty claims ¯\_(ツ)_/¯ https:… RT @rodolfor: @Miles_Brundage having spent 2 week in the Bay Area speaking with VCs the consensus is that they are fucked They've spent ~100 researcher-years doing work in secret, so one could ask l about absolute bigness and that-effort-level-adjusted bigness. All of the (few) AI folks' opinions I've seen on Vicarious are skeptical, at best. Anyone think they (might/prob) have something really big? @RoboNarratives haven't taken this one but also looks potentially promising: https://t.co/oYfWXPnBAS RT @RoboNarratives: I've been wanting to learn about AI, without any programming or computer science background. Any suggestions for good/u… @RoboNarratives There may be other things I'm forgetting-maybe check out that course first and see how it goes/what issues if any are weird? @RoboNarratives textbook (AI: A Modern Approach, 3rd ed.), beginning should be clear, then follow up on things if you're stuck/return later. @RoboNarratives the Norvig/Thrun online course (lots of short videos: https://t.co/jyKwi7T422) is good. Maybe also consider Russell/Norvig+ @hintikka yeah, kind of defensive ;) @jackclarkSF @willknight (though it's also seems likely the paper will be about both old and new developments...just a Q of what they are) @jackclarkSF @willknight yeah, I look forward to it not because I'm sure it'll be impressive, but b/c it'll reduce uncertainty about that :) """Inside Vicarious"" by @willknight https://t.co/msXyynqKfY Still no papers, though they say they'll publish this year. Look forward to that!" Other examples: IBM, Vicarious... not aware of this sort of thing at Facebook, let alone Apple (who knows what they're doing in AI, really). Other companies obviously do neuroscience research, but from what I can tell their close interlinking of neuroscience and AI is pretty rare. *at DeepMind/Oxford/UCL. Noteworthy both b/c hierarchical planning important and b/c interesting that DeepMind rare in doing neuro research. @girlziplocked awwww. @alexjc how would you go about building that dataset? @alexjc (arguably a subset of #1, but wanted to emphasize the humor aspect) RT @Chris_Randall: https://t.co/eJYtYglmQF @alexjc sassy/sarcastic reactions to Trump tweets :) @junkiepunch (I also periodically check goog scholar for mentions of DeepMind and some other things so would have found it there eventually) @junkiepunch referenced in some news articles, e.g. https://t.co/ekKo09GW3j "Neural Mechanisms of Hierarchical Planning in a Virtual Subway Network," Balaguer et al. at DeepMind: https://t.co/pHOV4BsbI4 @markus_with_k (was updated to include prioritized experience replay, too). @KaiLashArul may also have done this... @markus_with_k yep, Prioritized Dueling there includes double Q-learning. Dunno if in original paper, but in latest: https://t.co/R8bPsdIxSe It's commonly claimed that prog in narrow domains of AI is more predictable than general AI progress, and this is decent test of that claim. Not that many people really care about that metric, but I try to regularly/publicly note these things so I can see later how they pan out... Sidenote: if Atari AI prog. is fairly predictable, median score in the no-op condition will be in the vicinity of 190-250% by end of year. (This is far from an exhaustive list of recent algos tested in Atari, data is noisy, etc. but gives some sense of trend in past year or so) Performance of 3 algos (DQN, DDQN, and Prioritized Dueling) on 57 Atari games. Sub=<75%, Human=75-300%, Super=>300%. https://t.co/UZ6AscpacQ "Learning Deep Representations of Fine-grained Visual Descriptions," Reed et al.: https://t.co/dGc7oRhLzO "Generative Adversarial Text to Image Synthesis," Reed et al.: https://t.co/98fBXva90F https://t.co/pverlehIHC RT @tejasdkulkarni: deep gen models that copy pixels rather than generate just from scratch. v promising -- https://t.co/IgCdd94kHc https:/… Very interesting: "Hierarchical Reinforcement Learning using Spatio-Temporal Abstractions and Deep Neural Networks" https://t.co/Q9Uej4WzT7 RT @mat_kelcey: nice implementations of normalized advantage functions (NAF) and dueling network architecture (DUEL) for @openai gym https:… (previous work has shown that skipping Atari frames/repeating actions during them increases training efficiency + can improve performance) "Dynamic Frame skip Deep Q Network," Lakshminarayanan et al. at IIT Madras: https://t.co/7OvvxsllJJ Dynamically decide # of frames to skip. I'm also told he's a great guy and researcher, which I don't doubt, just less familiar with those things than the epicness of his name. :) @hintikka never met him, but he does seem to have lots of good papers! One of my favorite AI researchers is Mausam, because his full name is Mausam. https://t.co/55cHOZIfxH @danielas_bot yup, in July. "RT @DeepSpiker: https://t.co/mQ81phO9nV #TensorProcessingUnit" @gdb nice - look forward to reading! RT @gdb: Just finished my Quora Session: https://t.co/jXBpMAgma3. Thanks for the questions :). Really great work in last RT (King et al. on Chinese govt's use of social media). Excerpt: https://t.co/xQofH96Igl RT @deaneckles: More on how Chinese government uses social media https://t.co/rCFSsGMTtl from @kinggary, @jenjpan, @mollyeroberts @Aelkus what book is this? @jackclarkSF @hintikka is the one you mentioned diff from the one linked to here, or is this the one? https://t.co/CIyU8ditPJ @mark_riedl the guy explicitly said "please don't make it X-y McXface." This will of course only embolden people. @jackclarkSF @hintikka will just need to keep an eye on arXiv then ;) fortunately I'm already addicted to it. @hintikka @jackclarkSF yeah. I look forward to this new paper Jack mentioned... @jackclarkSF results both from nature of tech and concentration of research in industry. Very interesting, though also v. explainable... @jackclarkSF indeed. modern AI R&D is highly unusual in this respect. Much faster deployment than energy, health, manufacturing, etc. tech. @hintikka climbing and weed and bars and Crossfit... missing anything? :) Okay, Google, that video was pretty adorable. Still not yet clear how robust this thing actually will be, though. Me a few months ago... unclear yet exactly how competent this new thing is, but demo is no less impressive than Viv. https://t.co/WwVUButHXQ Pichai talking about new Google assistant RN: https://t.co/2ZWvinhhQt "RT @ThewissenS: People in routine occupations with higher risk of automation support redistribution more (https://t.co/OTKF1T10i2) https:/…" @Aelkus indeed @nerdsrocket did you see it? Ditto Ultron, first Avengers was pretty good I guess though. IMx >>> those. @nerdsrocket once was too much for me with the new one. Felt soooo long. Dunno if I'm broken or everyone's crazy or what :) @nerdsrocket loved it, too! Was thinking about that the other day - why I liked that but not Captain America. Don't get the latter at all. Fun fact: Siri doesn't know how to pronounce Cortana correctly. (or more precisely, a narrow AI masquerading as a fictional superintelligent AI designed by a fictional human) Yup. Or cartoon robot/alien, though I already think of Cortana as AI-masquerading-as-better-AI, not human, bc Halo. https://t.co/pJK370EpJL @roseveleth the narrative I've heard (which I can't independently verify) is that Clippy-->hesitance about (proactive) bots, not humanness.. Very interesting and could be big. I used Scratch to teach basic computing concepts to middle schoolers, great tool. https://t.co/ipOkXpfBfT Re: last RT: Google patents all sorts of AI stuff, as do other companies. Still haven't yet seen great analysis of implications of this (?). RT @newsycombinator: Google applying to patent deep neural network (LSTM) for machine translation https://t.co/4HihOoJBFD (the functions they generate, on the other hand, can be quite complex) Don't think this was intentional, but stuff like that unnecessarily makes AI seem mysterious. Also, DL algos themselves aren't that complex. One of the worse definitions of deep learning I've come across lately... https://t.co/VSVLVJJv7h H/T @mark_riedl https://t.co/4VZIiOyYa2 @danieldewey specifically, this little guy or gal sticking its head out of the pouch (hard to see). https://t.co/SWRMVhXsy3 @danieldewey if you or anyone goes next week they will have a baby wallaby! :) (though coatimundis were way more fun than the other animals) @danieldewey presumably other places offer similar things, dunno. but we were guinea pigs at this place. Worth every penny! (like $30 extra) @danieldewey at least here (AZ) https://t.co/d63Vo6GDsW we were the first...expected deer, ended up w/ coatimundis, wallabies, cavies :) Great application of AI to mental health - large-scale analysis of counseling conversations/outcomes identifies lots of actionable insights. "Natural Language Processing for Mental Health: Large Scale Discourse Analysis of Counseling Conversations": https://t.co/dbguWa6YoL @pmarca he's just saying that to show off. @Aelkus yeah. I read that and cringed at "objectively," things are good. Cuz obv. we have an objective way of comparing all these things... @rbhar90 dunno if that's bc of autonomous driving or culture/ppl at MobilEye, but they indeed have been publishing interesting stuff... @vgr IIRC the book Human Accomplishment looked at this to some extent... @kashhill world chill, at least. @rbhar90 wonder how much that has to do with the term itself - it *sounds* cool ;) auto! @mark_riedl I suppose Skynet could make sure that it doesn't have a copy of Superintelligence on board for Babbage/Lovelace to read... :) @mark_riedl wouldn't they maybe be excited by it and not necessarily be convinced of its risks? /take the opportunity to try to program it? When in doubt, definitely take an opportunity to hang out with coatimundis. https://t.co/tgX0huq4W1 RT @j2bryson: My PhD student @RobWortham writes about our IJCAI #aiethics workshop paper on robots & trust https://t.co/MCf6DiJTPj https://… RT @MIRIBerkeley: New developments at MIRI, @open_ai, @open_phil, and more: https://t.co/Ia5utZ1b2q @clarkamiller some studies have suggested *potential* for decrease (https://t.co/Z4FqAXhWOx), depends on details, though. Dunno bout now. @KirkegaardEmil this is paywalled, but doubt it uses term "SJW." use of that term typically has a particular gamergate-related connotation.. "Learning the curriculum improves performance on a variety of downstream tasks over random orders + in comparison to...natural corpus order" "Learning the Curriculum w/ Bayesian Optimization for Task-Specific Word Rep. Learning" Tsvetkov et al, CMU/DeepMind https://t.co/4OYRJO8cPz @Aelkus sketch independent guy*. clearly didn't go through any IRB @Aelkus look at his twitter feed...doesn't GAF about the ethics of it @Aelkus they didn't. Dude is sketch "SJW"-averse "polymath" guy. RT @gdb: Ask questions for my Quora Session next week (10a PT on Wed): https://t.co/jXBpMAgma3. Particularly excited to talk about @open_ai! @yoavgo @hintikka not about the corps' rights, about users - one joins to date, not dox people etc... data just visible to users. @yoavgo @hintikka ...not the wider issues of earlier kerfuffles. @yoavgo @hintikka feel like the discourse on this OkC scraping thing is very specifically about the lack of anonymization, + TOC violation.. @yoavgo upon googling it, what I was thinking of was ppl saying this post betrayed lack of nuanced thought on issues https://t.co/KrbYeOd5Wr @yoavgo @christianrudder (don't recall contours of that debate but pretty different from this one I think...) @yoavgo @christianrudder think they were criticized about it at the time, and also didn't release data... @hintikka yeah, never used Pinterest but thought in that case you needn't have profile to see stuff (?), not to mention less Q/A type stuff (referring to this, ICYMI: https://t.co/ISTJDr5kFW) This OkCupid data scraping/releasing-without-anonymization guy is a real charmer. https://t.co/cUeFjYLLH9 https://t.co/lp9IOwlYuL RT @mark_riedl: New work w/ @MatthewGuz: #AI generation of creative game levels using ML & concept blending https://t.co/psVcWpQVMQ https:/… The answer is Parsey McParseface. CC @jameswilsdon https://t.co/eHt4hgJzHv "RT @elonmusk: Definitely https://t.co/7gEkc0mt9O" @rcalo or AlphaGo. He likes winners. RT @elonmusk: Ok https://t.co/jJJR28UGrK @mark_riedl @jeffbigham well, *clearly* members of Parliament will take the time to follow up on all the references, so no worries ;-) @mark_riedl @jeffbigham btw, you @mark_riedl got a shout out from NESTA's submission to Parliament here ICYMI https://t.co/8bgp9tjkuI @jeffbigham @mark_riedl does it not mean vessel as in container rather than ship? RT @HankGreelyLSJU: Interesting application of "don't be evil." Justified paternalism? Conscience clause? Do they carry lottery ads? https:… Of course, the devil is in the details there. Lots of possible models of ethics integration, case studies from AI and other domains, etc. Very interesting. https://t.co/lKYu9YeoFe Interesting submissions to UK inquiry on machine learning. Agree w/ @DeepMindAI on need for ethics in CS education! https://t.co/uP26llNc6r @etzioni @RobWortham @mark_riedl @EdFelten44 important not to equate "reg" and stopping innovation - it can even help it (e.g. standards). @etzioni @RobWortham @mark_riedl @EdFelten44 "regulation" covers very broad range of possible policies. @etzioni @RobWortham @mark_riedl @EdFelten44 we already do (albeit imperfectly) + yes, should - data privacy, IP, driverless car laws, etc.. @MrMeritology @Aelkus @munin @daniel_bilar another possibly relevant author: https://t.co/VZYbvIDznd skimmed this while ago and seemed cool @MrMeritology @Aelkus @munin @daniel_bilar what are main gaps you see? @Aelkus @MrMeritology @munin @daniel_bilar I think Farmer et al have good cohesive POV (eg here also w kaufmann https://t.co/Rob6uciOpt) @MrMeritology @Aelkus @munin @daniel_bilar see also Doyne Farmer, Cesar Hidalgo, and their collaborators AAAI 2017 will be in San Francisco in February: https://t.co/7c87rfDIRj RT @rebecca_roache: Passive aggressive birthday idea https://t.co/iBK9Yj2V2B @rebecca_roache brilliant. @sknthla how is it? @Sam_L_Shead (that's not really a *good* comment about them per se, just one use :) some are actually good) @Sam_L_Shead they're good for justifying possibly unpopular decisions, because you can say X said it was necessary. Deflects some blame. RT @chris_brockett: @Miles_Brundage Do benchmarks even make sense when personal assistants/bots are functioning across domains or in differ… @hintikka this isn't exactly that, but it did sound pretty cool: https://t.co/izy628P5sb RT @psygnisfive: @Miles_Brundage i havent read their patent (the language is .. weird), but their demo sounded like it was doing traditiona… Quite prescient book on issues of science/technology and responsibility - foreshadowed a lot of current existential risk stuff, etc. Reading Jonas's 80s book, The Imperative of Responsibility, and I see why responsible innovation folks cite him so much :) CC @Jackstilgoe @hintikka or just plain worse ;) don't really know. @hintikka and alas, existing QA benchmarks may not be helpful - it may be better IRL but worse on actual existing, narrow ones than SOTA. A maybe-impressive-maybe-canned-maybe-both demo of Viv is quite different from, say, a startup beating Google on ImageNet... The difficulty of parsing this might speak to a broader issue, though: lack of good/broad benchmarks for QA/personal assistants. Thoughts? Illustrative sample of press coverage. https://t.co/T2e7rakSnw @hintikka I skimmed them and they seemed very, very specific (and patenty)... Have retweeted some snippets of this (see the Twitter convos for more detail), but nothing in long form. Press coverage = ~ OMGZ... Would be nice to see a clear/accessible analysis of whether Viv and their patents are novel and whether the demo actually proved anything... RT @rndmcnlly: @Miles_Brundage @alexjc I do program synthesis at Microsoft. Viv looks cool, but it uses a different sense of "generation" a… More reason to think Viv may not be (very) novel technically... https://t.co/4lCatpdHBc @chrisalbon @jsonbecker it was quite bad. "Avoiding Wireheading with Value Reinforcement Learning," Everitt and Hutter: https://t.co/C0u09MAdyo "Self-Modification of Policy and Utility Function in Rational Agents," Everitt et al.: https://t.co/w4BL5Kz3ct (related to AI safety issues) @pmarca broness and wealth are orthogonal dimensions, though wealth and nerdiness are indeed correlated. RT @genekogan: rubbing my eyes at latest class visualization/synthesis from nguyen et al. uncanny valley? https://t.co/reaB2vbuyV https://t… @alexjc ...except by being able to say "we have a patent!" @alexjc but yeah I looked at it and it seemed super overly specific. Maybe to make it look not like old stuff, but dunno how that helps em.. @alexjc patent lawyers, I think? RT @alexjc: Evidence that Viv's AI is similar to behavior trees. If you're feeling generous, maybe a hierarchical task network! https://t.c… @AuerbachKeller alas, if people still support Trump despite him personally being a misogynist, I'm not sure they'd care about this... :( @sarahjeong (I meant the issue in general, not the dude, but the latter is also interesting :) ) @sarahjeong thanks for covering/tweeting this! Very interesting. @sarahjeong sad to hear. RT @amyhurst: I am looking for a post doc to work on adaptive systems that increase accessibility at @UMBC! Please share widely: https://t.… @UnForge I've only seen a few eps but from ppl's replies to my tweet, sounds like it's worth a watch! @alexjc my advisor could probably think of some reasons why not ;) but I probably will - thanks! : @alexjc so you'd recommend watching from start to finish? RT @alexjc: @Miles_Brundage We enjoyed watching it! The characters are engrossing enough to sustain the regular crime bits. AI twist got re… Which is The Machine from Person of Interest, and which is Viv? https://t.co/LmbbekHBdZ Watching show about powerful AI while my not-so-powerful AI plays Breakout. It doesn't usually increase that fast ;) https://t.co/tdmJtPohQD For those unfamiliar, it starts as mostly a crime drama type thing, then gets more into the AI stuff. Not sure what best way to watch is. in that it deals w/ actual current issues (privacy, surveillance, corp/gov't control of AI) and is *somewhat* nuanced re: superintelligence. Any of yall watch Person of Interest? Haven't seen all of it but from what I can tell it's on the serious end of the spectrum of AI fiction, "ViZDoom: A Doom-based AI Research Platform for Visual Reinforcement Learning," Kempka et al.: https://t.co/iLPP1Ap3nV Platform+DQN results RT @ijcai16: #ijcai16 registration is now open. https://t.co/LXuAPXNyTM #NYCforAI #ijcai2016 https://t.co/YnWhPA5TTc @mark_riedl omg, it's so bad. I tried to stop you/others by tweeting about it. I failed. Brace yourself for a thousand Viv hot takes in 3, 2, 1... Viv demo video: https://t.co/UzWUy5aRcu @j2bryson you going to any others? I'm prob. going to the Seattle and NYC ones (latter def. if I go to IJCAI). @williamstome @JPdeRuiter @marcelcrok ...here is focus on sub-optimal latitudes - maybe fair, @JesseJenkins or @joekaras14 may have thoughts @williamstome @JPdeRuiter @marcelcrok not really -EROI's been studied for long time, w/ generally >positive results, seems like main diff... @margareteyoung @rcalo sounds germane to the Journal of Responsible Innovation - I'm Ed. Assistant, happy to discuss https://t.co/lVktRUUI6v @yoavgo that being said, I have nothing of actual substance to add/not sure if burning here is literal or not. But, made me think of POI :) @yoavgo (they switched to Playstation 3s to use the GPUs...which would seem to increase fire risk [?], but they also used liquid nitrogen).. @yoavgo latest Person of Interest ep involved comps running AI catching fire. I thought it silly, but Googling it suggests GPUs actually can @Aelkus @GaryMarcus and as @rao2z has emphasized, even if NNs can do X, hardness of X (e.g. semi-decidability of FOL) doesn't nec disappear. "Learning Knowledge Base Inference with Neural Theorem Provers," by @_rockt and @riedelcastro: https://t.co/lge6jiNWm3 "LSTM with Working Memory," Pulver and Lyu at Cornell: https://t.co/TFUzX0Ea8d Cameo by Ash Carter (now Sec of Defense, then ~random nerd) in Bimber's book on the Office of Technology Assessment. https://t.co/x3Nh9QdHg2 @jathansadowski congrats! @clarkamiller then there's also transparency-about-human-ness, when companies want to pretend it's an AI! e.g.: https://t.co/VhZIxMGbD4 @clarkamiller arguably, more commercial incentives for latter than former.. @clarkamiller there's transparency-of-AI-ness to user, and transparency/interpretability to designers. Was ref'ing to latter but both good. @clarkamiller yep - bit hype-y/overstated and doesn't mention existence of huge effort to make AI more transparent, but agree it's big issue Are there any good write-ups of how ICLR 2016 went? Any thoughts from you all/especially interesting things learned? #iclr16 @rebecca_roache omg, that. RT @danieldewey: I'm stoked to get this post out into the world! It's been a long time coming :) https://t.co/oxwJrqFdq1 RT @danieldewey: Excited to be making our thoughts on AI public! More to follow... https://t.co/4gDbexlkup RT @williamalden: Palantir, the Valley's most secretive firm, has lost blue chip clients and is struggling to stem staff departures https:/… "RT @lukeprog: My latest investigation: What should we learn from past AI forecasts? https://t.co/GUuWnvAKm0" RT @katecrawford: "Big Data: Report on Algorithmic Systems, Opportunity & Civil Rights." New White House paper on data discrimination https… @Rapchik nice :) depending on how my latest run goes, I may submit a pull request w/ my changes...hoping to get to 150+ score in a few days. @girlziplocked ? ICYMI: nice working paper by Bostrom on implications of different types of openness in AI over different timeframes: https://t.co/z1S6486i3Y "LSTM-based Mixture-of-Experts for Knowledge-Aware Dialogues," Le et al.: https://t.co/0lh7fnOPiO Integration of neural QA and neural chat. CC @Rapchik gonna run again with annealing this time for longer - that was after 1200 episodes but due to typo, epsilon increased at end :-/ Messed up something so this isn't working as well as it should, but sufficient to conclude DQN does in fact work. :) https://t.co/MJbjw9Sg8O @AlanMackworth thanks, Alan! RT @AlanMackworth: Excellent analysis. Regulatory capture is a real danger for AI. https://t.co/76qI5YEP77 @j2bryson in this case i did later :) https://t.co/LNk1WxWHPy @bwwinthehouse I suspect there are lots of differences, but don't know much beyond what's in that/previous articles... Thoughts on Viv, folks? https://t.co/MSkIb9Psku Interview with @GaryMarcus on AI progress and related issues: https://t.co/7gvDRqnFIy RT @demishassabis: Lee Sedol has won every single game he has played since the #AlphaGo match inc. using some new AG-like strategies - trul… @rcalo @EdFelten44 or, "Why Public Engagement in Science and Technology is Hard" - CC also @Jackstilgoe who I reference. New blog post: "The White House AI Workshops and Public Engagement in Science and Technology": https://t.co/rmzsDvQNIr CC @rcalo @EdFelten44 @rcalo writing a brief blog post on this RN with some more concrete points/suggestions for consideration, will share when finished :) RT @rcalo: SOUPS '16 CFP on drone delivery and privacy. https://t.co/lNK9C0quSj RT @rbhar90: @Miles_Brundage @newscientist On one side, there's Henrietta Lacks type abuses, on other byzantine HIPAA regulations that can… RT @rbhar90: @Miles_Brundage @newscientist I'm ambivalent about consent policies for medical data... Seems like a very difficult balance. @FrankPasquale ooo, looks interesting! Maybe a new edition would be "Go metaphors" ;) Re: DeepMind and health data, from @newscientist. https://t.co/9DHeGBwXLS https://t.co/9Fhb8v3UQ3 @spysamot @Plinz not necessarily mutually exclusive, either (one could have basic income and guaranteed jobs for those who want them). @FrankPasquale well... Galatea 2.0 did talk about neural networks if I recall. So not that far off. RT @tdietterich: AAAI is a proud cosponsor of this meeting. https://t.co/jq5OtlbKne @yoavgo @hugo_larochelle said they'll all be on https://t.co/Ui7LItvkJY eventually. Dunno about via Periscope. @rcalo @EdFelten44 P.S. had to summarize even for tweetstorm :) Overall v. happy this is happening, and of course happy to discuss further. @tmosley4 complex issue def, that's fair concern, tho there are various reasons why ppl do work where they do it/regs not just about safety @rcalo @EdFelten44 the premature pt. Seemed fair based on framing/history/lack of signs re robust inclusion plan but open to revising! (2/2) @rcalo @EdFelten44 early days for sure! Trying to be constructive/add context for those less familiar w/ diff. models. Not sure re: (1/2) @martpalau thanks! :) @alan_winfield thanks! :) @CC @rcalo @EdFelten44 FYI, some reflections on the AI workshops above. 17. So, in short, good turn of events but I want to emphasize that this is not a panacea from either an AI policy or democratic perspective. 16. What is *done* with this report after it's produced will also be critical, and again, this is not immune from biases/constraints/etc. 15. So, as in a lot of things sci./tech policy-related, processes are key - and beyond the livestreaming, there is ~ no accountability here. 14. Among other potential biases here are those for low/no regulation, and with many corporations involved here, advisory capture is a risk. 13. This is not intrinsically bad - some of those biases may be good, and science being political isn't unheard of - but it should be known. 12. It will reflect not just what happens at the workshops but various political constraints/biases of those involved at and around OSTP. 11. it is also clear that as in similar cases (see, e.g. Krimsky's Genetic Alchemy on Asilomar) this will hardly be an apolitical document. 10. One final area of caveating/mild critique regards the report to be produced after the workshops. This could be a great report, but... 9. or the National Citizens' Technology Forum: https://t.co/LXFewUPbsX That sort of thing may follow the workshops but they're not the same. 8. For examples of serious efforts at engagement, see e.g. https://t.co/skGdN9ttJl (asteroids, in which I participated as a facilitator), .. 7. And even if all were interested in it, not all could go. This is why robust such efforts do things like compensate people for their time. 6. Among many other reasons why this isn't on the cutting edge of such things, self-selection will play a huge role in participation. 5. It will have lots of value, IMO, but to actually engage the public on AI, one would need to look at and learn from prior similar efforts. 4. Now on to some mild critiques/caveats - it would be a mistake to accept the framing of this as a real public engagement effort. It's not. 3. Last point of praise: the task force on AI for government is much needed. U.S. Digital Service, etc. are good but AI seems underutilized. 2. Also, the thematic grouping of the workshops makes sense as does livestreaming them, and they seem to have good speakers lined up so far. 1. Some thoughts on the White House AI initiative: first, this is very good news overall IMO. Important issue getting high level attention. Scheutz is very thoughtful on AI ethics stuff, and a cool guy. Oh, and not mentioned here, but he has two PhDs (!). https://t.co/uyBXM2uV1P OK, I think my version of https://t.co/YeHXXWjeVb is *actually* working right this time. :) Think epsilon annealing will help a lot... @Rapchik ah, hadn't thought abt grayscale! @sherjilozair wasn't lying when he said it was a basic implementation ;) lots of areas to improve @Rapchik I was also suspicious why the mean cost was so low always, now it's not :) @hintikka "Author of Gorilla Mindset" @Rapchik there may be some other issue going on that i'm not aware of yet... @Rapchik also looked into adding frame skip to make it faster but wasn't as trivial as I hoped ;) maybe will try again later @Rapchik at least that's how the DeepMind folks do it, and that code doesn't. I added it, will see if that helps - more early exploration... @Rapchik wasn't working very well still after ~1.5k episodes, so looked at code more closely... turns out epsilon should prob be annealed... @TechPolicyLab very cool news - congrats @rcalo! RT @TechPolicyLab: Excited to announce we’re co-hosting the first of four @WhiteHouseOSTP public workshops on #AI https://t.co/UurRBRulZr @hintikka update: this. (I assume it was meant to say 'cognitive computing' and will be fixed soon, but still, lol). https://t.co/VgnFMK64Mr @hintikka I mean - Neural Naming @hintikka don't give them any ideas (next: "Cognitive Nomenclature!") @Rapchik I'll post videos once (/if) mine starts getting significantly better... @Rapchik nice - lemme know how that goes! :) and yeah, it's very slow this way... @Rapchik oh and I added a line or two to make it record videos occasionally (just took this from the Gym tutorials) @Rapchik ..intuitively, 10% random actions seemed high - hard to get reward that way on Breakout). Set to 5k eps, may stop early. 800 so far @Rapchik I only changed a few hyperparameters (discount from .9 to .99 per Mnih et al. 2015, epsilon from .1 to .05, same source, plus... @FrankPasquale thanks! :) Qualitatively, it looks more like it knows what going on than it did earlier (e.g. here), but score still very low.. https://t.co/UDAIXe5tDI Assuming it's working at all, which I'm not yet totally sure of, it'd be better now if observing the game RAM, but this is with raw pixels. Mad skills (not really, it's still barely better than random, but will be superhuman in a few days if it's working). https://t.co/qp1IY8TdBr @Jackstilgoe @FHIOxford thanks! :) Think my latest DQN agent is finally learning! :) Made adjustments to bring https://t.co/YeHXXW1DwB in line w Mnih et al.'s hyperparameters. @rcalo thanks for the RT! @rcalo indeed. I'm part of the wave ;) https://t.co/6HHbuexkGl @janexwang wish I were there :) enjoy! @Aelkus STS has same issue, one often has to position oneself as an adjoining field @Aelkus yeah. I never really planned on faculty position, for diff reasons, but if I had I'd prob have to position self differently @kylewrather nice :) @MrMeritology in driverless car policy, for example, that will loom large @MrMeritology learning has come long way since then, tho, so that may play more of a role in it than it would have in 80s. but pt taken @MrMeritology perhaps. Not sure that's necessarily the worst thing, though. @mjntendency we shall see... @mjntendency though my glass half full perspective if the ethical issues are being taken more seriously by many than a few years ago :) @mjntendency yeah. Arguably not going well already in that wide range of confident views is being espoused, public/media dunno what to think (or to deep learning and perception as a sign of progress, or commonsense reasoning as a sign of stagnation...etc.) As AI becomes more of a hot political topic, this may become more common - politicians/media can point to Russell, or Ng, to support views. While many views on AI prog. hardly scientific, one can see this to some extent already: for ~any view, one can point to expert for support. We may e.g. better understand dimensions of prog w/o much insight into timing. See also Sarewitz on science making some controversies worse. This may raise more Qs than As, as science often does. Need to develop AI policy frameworks that are robust to various plausible scenarios. Lots of good work going on to better understand plausible AI futures + distribution of opinion on it. We'll know much more in 1-2 yrs. But.. And the connection to deep and unsupervised learning... https://t.co/djy6hPZy1z What they mean by conceptual compression. Interesting stuff. https://t.co/lFgwJw3i8V "Opening the Frey/Osborne [@maosbot] Black Box: Which Tasks..are Susceptible 2 Computerization?" Brandes+Wattenhofer https://t.co/jfxbqiFqvy "Artistic Style Transfer for Videos," Ruder et al.: https://t.co/pdeGQqtrra Crazy video: https://t.co/GlY4Yv0WXN "Towards Conceptual Compression," Gregor et al, DeepMind https://t.co/t7L9TkejUm Convolutional DRAW, relevant to unsupervised learning, etc. @halhod his/her cousin says hi https://t.co/OD500yrKNf @halhod is that a pom? :) I have one... RT @mark_riedl: Beethoven’s "Ode to Joy" re-orchestrated by #AI in the style of The Beatle’s "Penny Lane” https://t.co/Uza4KHLN03 RT @rao2z: Check out the amazing lineup of #IJCAI2016 Early Career Spotlights! https://t.co/Mt8FHEfqIo QED: #IJCAI16 is #AI-Complete! @mark_riedl link not working? @gokevin1 thanks! will do ;) @JayGeraghty thanks! :) @vgr some:"Perceiving Phys Object Properties by Integrating a Physics Engine w/ DL," "Learning Phys Intuition of Block Towers by Example"... @chrisalbon check out Gym tutorial, then https://t.co/YeHXXW1DwB if u wanna try DQN. I ran into issues/did bad solution, lemme know if u do. @chrisalbon It's fun. DQN training is very slow. Gym is cool, though. https://t.co/MnMbtbnQY7 RT @benhamner: DeepMind's moving to TensorFlow https://t.co/grNMIML7H4 @jackclarkSF agree it's a factor def. worth taking into account, though. @jackclarkSF perhaps, I know smart folks who work for em, but I'm not sure how much they can get out of that data/how much they keep... @jackclarkSF + if algos key to getting insight from that grounding, grounding R+D advantage = ~ experience throughput * algorithm quality... @jackclarkSF why just AMZN? Lots of companies have robots, and Google/Tesla's cars may have experienced more than Kiva bots have... This seems great - training a Ms. Pacman DQN agent now :) https://t.co/O6EN6MBZkj RT @fchollet: Excited about OpenAI's Gym for RL? You can get started with this simple Keras/Gym implementation of DQN: https://t.co/zcWaFzY… @williamstome thanks! :) @maidylm thanks! :) @VinFL I'm partic. interested in robust policies that'd be helpful for wide range of scenarios/policy areas/values + understanding tradeoffs @VinFL thanks! It's collaborative so my ideas will evolve but may involve developing scenarios + policy implications of AI safety, work, etc @EdHenry_ thanks! :) @FeryalMP thanks! :) @rbhar90 thanks! :) @hintikka thanks! :) @davegershgorn thanks! :) @samim @FHIOxford thanks! :) Very excited to share that I've taken a job at @FHIOxford's new Strategic AI Research Center as AI Policy Research Fellow! :) @samim I'm def. not a fan of em ;) @samim I'd be happy to bet against that ;) much more plausible in 2 decades, though... Alas, this random agent isn't *that* much worse than many AI methods on Montezuma's Revenge (there are exceptions). https://t.co/zHlqKFGz2q Epic balancing skills. If only I could learn to balance stuff this well/quickly. https://t.co/a1XqO2NW76 It's really cool to be able to change the environment by changing *less than* one line of code. https://t.co/xp14AWCRtJ "Thanks @open_ai for allowing me to make an AI flail around randomly in Ms. Pacman :) But really, Gym is v. cool... https://t.co/nhzXQdcYwj" @KaiLashArul will prob tweet about it in more detail at some point if/when I get a chance to read it in full :) @KaiLashArul but gathered that it built on Osband et al. and added supervisory network for choosing btwn options, not v. strong claims made. @KaiLashArul it's easy, I just check arXiv once a day around the same time after it's updated ;) didn't read the whole thing yet... @Aelkus well that isn't the issue I had...you'll see what I mean if you get to that stage (re: "getid") @Aelkus yeah and it's nice to have a bunch of stuff in the same framework...way more than MuJoCo. I got some other stuff to work. @Aelkus lemme know if you end up getting it to work/figuring out how I'm being stupid (dunno what to do w/ the getid file).. and agreed. (reasons probably involving me being dumb, though). #occupymujoco @Aelkus as a result of this I learned MuJoCo is not free. And that I seem incapable of getting its trial version for dumb reasons @Aelkus dunno. The paper is insanely damning, though. I didn't even mention the unencrypted profile pics part. "Our study..raises an urgent alarm to those location-based applications’ users in general, and especially...GLBT-focused dating apps' users" Can triangulate users' locations even when they hide distance; also, third party ads leak data; told multiple times and haven't fixed; etc. Hoang et al. - @Grindr and @jackd have major privacy issues: https://t.co/pdP5yCzXGl "Hide distance" function doesn't work + other problems. "Classifying Options for Deep Reinforcement Learning," Arulkumaran et al. inc. @mpshanahan: https://t.co/RgpONkPA7H (evaluation framework more than research, but has some initial evaluations, as well. Alas, link not working RN) @gdb the "reviewed evaluations" link does not work for me. @gdb Looks cool! Will try it out now. RT @gdb: We've just released something new: https://t.co/QyvtqkQyyf. Looking forward to your feedback :). First OpenAI research - related to but much broader than recent paper by some of em (https://t.co/wW9dNJ6gx1). Cool! https://t.co/taS6jkWE7w RT @MarkMuro1: If you want to do research on advanced industries / tech apply here: https://t.co/RO632u2Gt9 @BrookingsMetro @BrookingsInst RT @SpaceX: Planning to send Dragon to Mars as soon as 2018. Red Dragons will inform overall Mars architecture, details to come https://t.c… @samim @Sam_L_Shead they're on the website (looks like answer is maybe 0-1?) https://t.co/4lBkWR664g @davmre anyway, the big story here to me is that it's a huge win for OpenAI - let's see if their first papers live up to the hype :) @davmre I used to have boss who worked full-time in DC and also advised PhD students at Berk. So it's possible, just requires mad skills :) Best part of this is that the translation is quite understandable (though this is by no means always the case)... https://t.co/NsCts8unhy RT @zacharylipton: How to cheat Twitter char limit? 只写中国文字. 你可以写很多句子。 没问题。我可以写86多个字符。 疯！ @davmre but faculty typically work more than full-time anyway, so he could plausibly have full-time elsewhere + some Berkeley duties ;) @davmre I don't know enough about faculty-ese to interpret what it says there ("taking a leave from Berkeley"; "full-time at OpenAI"..)... RT @davmre: @Miles_Brundage agree it's ironic, but AFAIK he's not leaving Berkeley - a sabbatical after eight years is pretty normal! Develops some interesting metrics for formalizing (often) vague human-robot teamwork/human-machine symbiosis etc. notions. ICYMI, very cool paper: "A Formal Framework for Studying Interaction in Human-Robot Societies," Chakraborti et al.: https://t.co/elUDj5joFR (and presumably he didn't do the interview for that article the same day ;) it just happened to be published today) (from Nature article: https://t.co/GCDkQCQ1Jc and OpenAI announcement: https://t.co/dVfQo6tcVN) Literally on the same day. The irony... (yes, it's a complex issue, not criticizing Abbeel, etc...but kinda funny). https://t.co/re5HzU48x0 @Aelkus @pierspaullumley there's a paper on Muslim machine ethics as well @Aelkus (to 100% extent that u r not scaring anyone, to lesser extent that others doing so - Musk demon thing overblown IMO) @Aelkus both point to/are amenable to lots of research/policy questions - not mutually exc. But I agree w/ you re: the scare thing to extent @agibsonccc @beaucronin haven't used it but sounds cool! @beaucronin @jackclarkSF @robinsloan there are already some cool cases, e.g. @karpathy's but I'd think more options there might help... @beaucronin @jackclarkSF @robinsloan probably wider if it can be app/web-ified more (avoid dealing w/ dependencies, command line, etc.) @vkrakovna CC @Aelkus @MikeChorost whose pieces are discussed. @hintikka @nsaphra @yoavgo if they drank Soylent simultaneously and took Uber it might be peak Bay Area @nsaphra @yoavgo @hintikka lol omg the rock climbing thing. I don't even live there but know several such ppl @gdb wow - congrats! Abbeel at @open_ai = big deal. No pun intended. RT @gdb: Just welcomed two more fantastic team members: @pabbeel and @shivon. https://t.co/auxZYC34sR @beaucronin Uber but for emoji selection RT @matthijsMmaas: Published a draft: "Extreme Technological Risks and the Strategic Pressures Towards ‘Research Races’" https://t.co/EvoW… "End to End Learning for Self-Driving Cars," Bojarski et al. at NVIDIA: https://t.co/HcMdPOsyQu "Deep Learning for Reward Design to Improve Monte Carlo Tree Search in ATARI Games," Guo et al., IJCAI 2016: https://t.co/3coGr6k1es "A Deep Hierarchical Approach to Lifelong Learning in Minecraft," Tessler et al. at Techion: https://t.co/CtxJKDAZJ0 Looks very interesting! RT @demishassabis: We had 9(!) papers accepted at ICML 2016 - congrats to the team! See our publications page for the pdfs: https://t.co/qk… @hintikka @girlziplocked but yeah, it'll take time :) @hintikka @girlziplocked e.g. I'm part of a whole school oriented towards this (School for the Future of Innovation in Society at ASU) @hintikka @girlziplocked I'm more optimistic - lots of historical precedents, and plenty of engineers outside Silicon Valley ;) RT @JohnDanaher: I was interviewed for this story - What If the Robot Utopia Leads to an Existential Crisis for Humans? | Motherboard https… RT @louisemarston: Today we publish Innovation Analytics: A guide to new data and measurement in innovation policy https://t.co/JKw5ehgPMZ @maidylm no problem! :) RT @maidylm: Our #icwsm2016 paper on how users #tweet their mind and #instagram their heart is available here: https://t.co/Z9z6gvtD5Z #con… Here's the conclusion. Berkeley and DeepMind's stuff comes out pretty well, but some more recent things not tried. https://t.co/uv9QYGBQ3e @rivatez or you're in an Asimov novel... (for a while robots were banned on Earth so some things had to be done in space, if I recall) This addresses issue I raised few days ago (difficulty of measuring prog. in continuous control w/ deep RL), and gives data on some methods. "HIRL: Hierarchical Inverse Reinforcement Learning for Long-Horizon Tasks with Delayed Rewards," Krishnan et al.: https://t.co/NNh4c2FtXc "Benchmarking Deep Reinforcement Learning for Continuous Control," Duan et al.: https://t.co/wW9dNJ6gx1 @samim yeah, his hair is definitely growing and getting darker ;) @SimonWierny though they may interpret some values differently from how we want them to, which is an important research area @SimonWierny solve hard problems w/o some heuristics. But to the issue of goals/values etc., AIs won't spontaneously come up w/ new values, @SimonWierny I think most AI researchers would agree AI will be biased in various ways, but diff. ones/possibly far fewer... impossible to+ @SimonWierny not sure what "unbiased AI" means here. @srchvrs yeah, doesn't give specific examples there (penultimate sentence = what I was ref'ing to). But some might be: backprop, dropout. "Also: lots of room for improvement in learning pace (and cumulative score*) even if best scores plateaued. *discussed in Osband et al. 2016" @SimonWierny not really any one answer to that. Lots of ppl have different purposes - using it to solve probs, understand intelligence, etc. Possible this also/instead means some of the new systems are close to the limits on some games, but would have to look more closely to say.. Not as big of a gap as I expected... the best new single systems have fewer weak games vs. older ones than I thought. CC @rbhar90 New calculation: mean Atari score across best of AI systems = 683.57, median = 160.4...vs. 567 and 115.3 for best single system. CC @rbhar90 @danieldewey also fun, but maybe start w/ hard column of: full/partial info, short/long horizon, etc. + some misc. hard probs (NLP, etc.). @danieldewey I have not! Looking at it the Wikipedia page now, interesting :) Good Q. Would have to think more for criteria that'd be hard + Lower bound for a foreseeable max, I mean. Anyway, will report soon - need to add some new papers to dataset which aren't near top overall. This would give a rough lower bound for plausible near/medium term improvements- if all an agent does is do as well as any predecessors did. @rbhar90 inspired me to do a new calculation - mean/median of best score across games attained by any agent, not same 1. Results shortly :) E.g. here's the data for prioritized experience replay + dueling networks, in descending over of human-scaled score. https://t.co/vGAlb3wSio (and perhaps way higher but again, haven't looked at all the games. Just doing pretty well on the bottom/mid games would raise median a lot) *Very* roughly, though, I'm reasonably sure there won't be a maxing out effect due to score/time maxes before at least 2-300% median or so. ...in this is 1. showing there's demonstrable general-ish AI prog, 2. noting (perhaps) surprisingly steady gains, not precise prediction RN. If this were a real world domain I'd be more focused on error bars, upper bounds, etc. (/may apply those here at some pt) but my main pt... But in many games there have already been several orders of magnitude of improvements, + many still v. low, so still much room for growth... e.g. Breakout is around 900, and latest results are close to that, so eventually this will matter. There's also a 5 min. max which matters. Good question re: Atari stuff - a few thoughts: at least some games do have upper bounds (haven't looked at all), https://t.co/PhSZbM7xBS RT @ijcai16: #ijcai16 workshops schedule is now available https://t.co/r1sT5NW3i5... https://t.co/JWdHJ5Y6Tv And fewer games when that's all that's available in the literature. For those who don't follow this stuff/my tweets closely, trend=median/mean human-scaled average score for 57 games, same system playing all. (and conservative interpretation prob. wrong as a measure of latent progress rate, even if good fit to reported prog., b/c underreporting) ...but gives some sense that even conservative interpretation of the data (linear progress) suggests 1000%/300% or so in a few years. Extrapolation of mean/median Atari trends (https://t.co/UYzh8bleNF) - to do seriously, would include error bars... https://t.co/LIZR53MMDI @ramez one of the rare cases of taking solar cost reduction potential seriously IMO @ramez agreed. Have you seen "How predictable is tech. progress?" by Farmer? V bullish on solar. @Aelkus @togelius @alexjc Blizzard said they're interested in working w DeepMind, but community in general? less likely @alexjc @togelius interesting (and unfortunate) - thanks! @alexjc @togelius is Brood War API not good? Haven't used but thought it was for this sort of purpose.. RT @alexjc: @Miles_Brundage @togelius So biggest factors IMHO are not AI. Who's going to invest, how much, and are they willing to spend en… Also, who is this former pro StarCraft player at DeepMind? I follow DM pretty closely but that was news to me :) *main variable @alexjc @togelius that'd be consistent w/ e.g. DeepMind's approach w/ Atari - reasonable bound on moves/frames seen per second. @alexjc @togelius haven't thought about camera moves but I imagined an expert-based moves/minute bound (AFAIK, in range of 150-300?). Yeah, one could imagine a policy network or similar component trained on expert YouTube videos. https://t.co/VGsbMJqVaQ @RobotsAndReason yeah, I'm 90% sure it will take less than 5 years ;) but don't know enough about SC to be more confident Thoughts? @togelius @alexjc Don't mean hand-crafting is best - Go suggests expert knowledge in StarCraft may be wrong - just openness to various methods/architectures. ...with a close second being standards of success (e.g. openness by DM etc. to use some/many hand crafted features would hasten it). My 90% confidence interval for time til superhuman StarCraft AI is "DeepMind did it already" to 5 years. Many variable is effort by DM... RT @tdietterich: Computers already do when playing poker. See https://t.co/Bi8LInTOHv https://t.co/kZmyTY5TOn @beaucronin non linear narrative maybe didnt do author favors there @beaucronin I mean, reading Diamond Age RN and it's prob comparable in that regard but just easier/more cohesive reason for whatever reason @beaucronin writing style normally needed to get away with that (Stephenson etc) @beaucronin think u hit the nail on the head re: it being over-ambitious. Great if patient/v nerdy reader but not quite the flair/seasoned.. @beaucronin :) so good @Aelkus but prob wanna read all eventually. curious how u saw its marginal util throughout @Aelkus you read whole thing?chaps 1-6+12+ skimmed rest 4 me, figured rest would have diminishing returns for me RN/have more urgent reading @beaucronin @VR_BHart yeah I was being tongue in cheek mostly - important to think about unintended side effects for sure @beaucronin @VR_BHart and I survived, mostly @beaucronin @VR_BHart assuming chaperone=visual thing, not unprecedented - I used to hallucinate symbols over ppl's heads bc too much RPG ;) ..and as I mentioned before re: the large-scale grasping paper, it actually doesn't compare that unfavorably to infant motor skill learning. ...arguably not that inefficient in developing some higher level abilities - e.g. even big image datasets << humans' visual experiences, You could make similar points re: growth in the size of datasets, but there the picture is mixed - AI inefficient in learning tasks, *but*.. @mjrobbins yep, it's great! Highly recommend, I wish I had checked it out earlier :) ...growth in hardware will enable robust human-level->superhuman when combined w/ software advances. Much hinges on the recalcitrance curve. It's conceivable huge hardware growth is needed to go from non-robust to robust solutions to those probs - if not, seems more likely... @mjrobbins from chapter 6 of: https://t.co/4eXHlW45Mm ...given that we have pretty good image recognition, natural language processing, etc. results with ~insect/very small mammal size "brains." ...and the successes so far in deep learning are (weak, b/c still not full solutions) evidence modern AI uses hardware pretty efficiently... How important a petering out of hardware advances would be to long-term AI progress depends, in part, on AI vs biological brain efficiency.. Nice summary of ways in which deep learning is/isn't neuro-inspired and how to talk about it by Goodfellow et al. https://t.co/k9fi7aXCYk "RT @milistjohn: I am Alex St. John's Daughter, here is why he is wrong about women in tech https://t.co/FVLmqoJrau" (includes good section synthesizing much of lit. on technology forecasting, an area in which Trancik is a leading thinker) "Technology improvement and emissions reductions as mutually reinforcing efforts," Trancik et al.: https://t.co/L9YE4I8WxB RT @FrankPasquale: Want to understand why there's so little US government scrutiny of Google? @ddayen explains https://t.co/W8sv5nMPWD "Deep Adaptive Network: An Efficient Deep Neural Network with Sparse Binary Connections," Zhou et al.: https://t.co/zYA9GcgWFT """Training Deep Nets with Sublinear Memory Cost,"" Chen et al.: https://t.co/BloHPhMB16" @rbhar90 there may be higher scores elsewhere using access to game state but AFAIK 400 or so best with raw pixels (reported) so far @rbhar90 no, but based on Mnih et al. 2015 baselines for human score, 400 or so in latest paper still less than 1/10th RT @AndrewYNg: My old PhD thesis: 30 param deep net to fly helicopter https://t.co/fq7F7BUgH4 DL has come a long way! https://t.co/yzTj62KJ… RT @GaryMarcus: Rising stars in neuroscience, take note: next generation leaders at #AllenInstituteforBrainScience https://t.co/oOqXnVfBgX RT @tejasdkulkarni: @Miles_Brundage if you chop top layer, model becomes DQN. Need flexible memory and qnet to learn objecty things to expl… "Markovian State and Action Abstractions for MDPs via Hierarchical MCTS," Bai et al.: https://t.co/8iFCwiKitf @tejasdkulkarni cool paper, congrats! do u plan to test (or do u have approx. sense of) avg score of h-DQN on all games vs best non-h DQN? @alexjc (or at least, learn how to get non-zero reward. even the new paper is still only 10%ish of human score) @alexjc bootstrapped DQN was sufficient to "learn" how to play it for a moment but then immediately forget :) @alexjc ..a path to solving it w/ (different) better exploration combined w prioritized exp replay. So, perhaps solvable multiple ways soon. @alexjc agree it's important, though beyond vanilla DQN there's been prog - see also note appendix here https://t.co/AcqwpG20Fk suggesting.. RT @tejasdkulkarni: check our new paper on - Hierarchical Deep RL: Integrating temporal abstraction and intrinsic motivation" https://t.co/… "Dialog-based Language Learning," Jason Weston at Facebook: https://t.co/mWCQ0PGE5Q Don't recall what he said when introducing that video... See also Mnih showing a Montezuma's Revenge vid at NIPS (AC3? AC3 + something else still unpublished?): https://t.co/yj3Cx5uLuz All that being said, here's the video: https://t.co/YUlXZuqBpm https://t.co/PIJnoirnYn Would be cool if there were results for all games, but it's an academic paper and that takes a lot of (expensive) C/GPU time ;) ..not that far from conquering Montezuma's Revenge anyway, per Osband et al., so not that big on its own. But seems like interesting paper.. Note 2 caveats on the appealing but misleading "now AI can do Montezuma's Revenge" takeaway - 1. still ~1/10th human score, 2. DeepMind is.. Also - hierarchical deep RL. Look forward to reading this! https://t.co/EXGJCsQh7r RT @fchollet: DQN with intrinsic motivation: https://t.co/6gQMwlZtXF v. important topic RT @deaneckles: So Michael Jordan is the Michael Jordan of machine learning https://t.co/Yf6ZgPq18e Thoughts, NLPeople? Russell talked about "physics of text" several years ago at dinner after a conf., so I eagerly awaited this...Worth the wait? Dunno yet :) Stuart Russell et al.: "The Physics of Text: Ontological Realism in Information Extraction": https://t.co/tOfvWKrkyx @tmosley4 in the technical lit, latter introduced in Asynchronous Methods for Deep Reinforcement Learning (and TORCS used too there I think) @tmosley4 dunno. MuJoCo = physics simulator + some standard control tasks, TORCS = 3D racing game/sim, Labyrinth: https://t.co/5hbnqjZaIr + @jackclarkSF https://t.co/c2Ln5x04AS Whereas Atari progress is well documented and (on 1 measure) exponential. And reported scores understate latent prog. rate for many reasons. So I'm not sure what to say about progress in (simulated) continuous control, or how to compare to e.g. Levine et al. large-scale grasping. Suspect we'll see a lot more on this/new and improved Labyrinth in the near future, but hard based on existing papers to say rate of prog. Also, only one (?) paper on the neuroscience-inspired Water Maze task, interestingly. And one paper w/ TORCS showing near-human driving... ...to Labyrinth (though some ppl at DM still report MuJoCo, as well as ALE), and perhaps unreported benchmarks. Late 2015 prog. seemed fast. One: this Gu et al. paper is pretty impressive: https://t.co/mQZU5Jip1K Also, DeepMind dropped several papers in late 2015, then ~moved on.. b/c diff. units (wall-time vs episodes), only partial results for many papers, MuJoCo changes over time etc. That being said, some thoughts: I spent an hour or so trying to figure out the recent rate of progress in MuJoCo-based deep RL for continuous control...turns out it's hard, Curious what AlphaGo's ELO score is by now, if it's still training. @cogconfluence so sneaky of him. RT @DeepDrumpf: I'm a big deal. I beat Hillary and her great scamily. It's got to be addressed. What they do is unbelievable, how bad. #NYP… @alexjc oh I missed the "find a course" part - saw the DL book hyperlink and became distracted by how I need to finish it, I guess ;) @yoavgo @alexjc the Goodfellow textbook is worth ~a bajillion papers. @alexjc but insufficient on own without papers and hacking. Good when used in moderation. @alexjc also, you don't mention MOOCs...my experience w them is they/lectures in general are good way to learn/sometimes easier than papers, @alexjc agreed! Both reading and fiddling are key for building intuitions. Only done a bit of the latter but it has very high returns. @starsandrobots childhood, the Primer tech itself, inequality in the midst of seemingly-maybe-equalizing-tech...and just great writing :) @starsandrobots I am only 1/4 done but some things I like: cultural reactions to advanced tech (eg neo-Victorians), idea of phyles, tech + Ok, y'all were right: I should have read The Diamond Age earlier. RT @TerynNorris: In a new essay @ForeignAffairs, @vsiv and I outline how US can lead a technology push to meet Paris climate targets: https… RT @KaiLashArul: ViZDoom - Doom-based AI research platform: https://t.co/PJZUomPknk. Awesome initiative, just needs a Lua API too ;) Search engines do not give you access to "all of human knowledge," as is shockingly commonly claimed. If they did, AI would be much easier. #NAME? As a reminder, Hark/DeepMind doesn't use AI (or, didn't a few months ago), but prob. will in future. Key here is just them getting foothold, (randomized study of use of Hark vs. pagers when clinicians treating simulated patients. Some measurable benefits/users preferred it>pagers) Study of effects of the app Hark (which DeepMind bought) on clinician communication, w/ Hark-turned-DeepMind author: https://t.co/HhNXECLDu8 RT @etzioni: JUST OUT: a new Young Investigator (postdoc) program at @allenai_org in Seattle with unique benefits. https://t.co/opo3rkepwv… ScribbleSup: Scribble-Supervised Conv. Networks for Semantic Segmentation," Lin et al.: https://t.co/LMTlRKimoM https://t.co/dyuD1VJYSi "Robust Monocular Flight in Cluttered Outdoor Environments" Daftry et al. CMU https://t.co/6MJuaXMbWk some flights >2 km avoiding 500+ trees "Sentence-Level Grammatical Error Identification as Sequence-to-Sequence Correction," Schmaltz et al. at Harvard: https://t.co/EZtL1I1r49 "Neural Network-Based Abstract Generation for Opinions and Arguments," Wang (Northeastern) and Ling (DeepMind): https://t.co/qwlOyfqg5f RT @timhwang: new gig! excited to announce that i’m taking on the public policy portfolio around artificial intelligence @google @timhwang congrats!! Will your purview include and/or focus on DeepMind, or more HQ-focused? Wow, that job application thing. Lol/sigh. https://t.co/mR4QaYm8DN RT @ellenhuet: When you text or email some AI chatbots, there's actually a human on the other side. I talked to a few of them: https://t.c… ...and I think the division of the book into intro stuff, mature DL tech stuff, and research directions/emerging stuff was a great call. Also, like I said before, this textbook is epic. 160 pages or so before you actually get to the deep learning stuff in earnest... Chapter 5 ("Machine Learning Basics") of the Goodfellow et al. deep learning textbook is a great ML introduction: https://t.co/WG8ncoFTT6 Also, interfaces, I guess. Anyway, definitely an important space to watch... more capable industrial robotics, sharing across corps, etc. (they talk vaguely here about downloading programs in general, but not sure what that means if not good vision/control algos/trained models) Related to Fanuc buying Preferred Networks (deep learning company).. Vision: share NN models across industrial bots? https://t.co/3ozsKJvqcs @alexjc I dunno about "less frequently" - arXiv is updated 5 days a week ;) though not all episodes of the opera are equally interesting. @smc90 lol. I guess when you're famous, you can get away with a Youtube apology instead of prison... "Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks," Li and Wand: https://t.co/t0gceGUCmS CC @alexjc "The STRANDS Project: Long-Term Autonomy in Everyday Environments," @hawesie et al.: https://t.co/USU0AZT6Da "Improving the Robustness of Deep Neural Networks via Stability Training," Zheng et al. at Google: https://t.co/YQpm4RPPXC "A Network-based End-to-End Trainable Task-oriented Dialogue System," Wen et al. at Cambridge: https://t.co/vF1OrJtvqH @sknthla lol. @fchollet is what you're proposing different from what DeepMind's already doing, e.g. Labyrinth here? https://t.co/jzQWxAzo1q @jackclarkSF it's spelled yuge "Learning Shared Representations in Multi-task Reinforcement Learning," Borsa et al.: https://t.co/wlMYYoBtap RT @hannawallach: Joelle Pineau and I are organizing the @NipsConference tutorials this year. Which topics or presenters would you most lik… Exactly. Siskind basically wants to make an IRL dog translator from the movie Up. https://t.co/7IVl0iQXtF And will try scanning person using language A and getting language B out of the brain data. Now THAT's neural machine translation. Thinks we will be able to scan animals and produce English descriptions of what they see. Also showed predicting what ppl seeing from brain data with no prior data on person. Shows brains similar. Consumer scanners proliferating. Siskind: dunno what NSA can so but know what I can do, and implications of video search scary (also, mind-reading w fMRI/EEG)... (a method he has patented, apparently) Live demo of video retrieval by Jeffrey Siskind at Purdue...finding stuff fitting description in 10 Western movies. https://t.co/VMAnCjf3YK (on building "holodecks" and using AI/other stuff for learning and imagining possible futures) Interesting stuff: "Optimists’ Creed: Brave New Cyberlearning, Evolving Utopias (Circa 2041)," Burleson and Lewis: https://t.co/d0JlnMnpYt RT @alan_winfield: Very pleased we went from @EPSRC ethical principles https://t.co/N1UNkcoFzY to a @BSI_UK British Standard in 5 years. RT @alan_winfield: Great to see that BS8611: Guide to the ethical design and application of robots and robotic systems now published https:… Definitely my favorite comment on my AI-topia post so far... https://t.co/4Q0cfPsDPa Imagine Trump explaining quantum computing... "We're falling behind on quantum, our enemies will use the quantum." https://t.co/0w5wYRn2hx @tmosley4 not sure. Sounds like the sort of thing ppl might do in the area of "developmental robotics" IRL, dunno bout in simulation (it's at https://t.co/OoKAWbYu0F btw) Finally digging into the Goodfellow et al. deep learning textbook... epic. RT @hugo_larochelle: @hugo_larochelle Congratulations also to Song Han, Huizi Mao and Bill Dally, for their ICLR Best Paper Award for: http… RT @hugo_larochelle: @hugo_larochelle Congratulations to Scott Reed and @NandoDF for their ICLR Best Paper Award for: https://t.co/gzYOLNb0… "RT @hugo_larochelle: This year, for #ICLR2016, we've decided to grand 2 Best Paper Awards: https://t.co/FcPR5zhO91" @azeem K, just put them here: https://t.co/9J9k6eiM3z "A General Framework for Describing Creative Agents," Velardo and Vallati: https://t.co/PxVIiXPcSS CC @samim "Visual Storytelling," Huang et al. at Microsoft, Facebook, etc.. New dataset and baselines for visual storytelling: https://t.co/MGXNrSwyoO Long title...the end is "with Applications to Negative Transfer." IJCAI 2016 paper. "Theoretically-Grounded Policy Advice from Multiple Teachers in Reinforcement Learning Settings ..." Zhan et al.: https://t.co/iCqzxSEtka @alexjc over a long time horizon at least ;) @alexjc replace "level designers" with "pretty much everyone" @roseveleth Ponte Vedra beach and Adventure Landing (latter was fun when I was a kid there, not sure of current status though :) ) @hintikka yup My presentation focused on AI and the future of work (happy to send slides if anyone wants, but slides pretty sparse, most content oral)... Video of @rao2z, me, Gregg Zachary, and audience discussing future of AI - lots of topics explored in 2 hours! https://t.co/o7AikIS7R6 Discussion of my AI-topia piece on HN apparently (thx @jedgar): https://t.co/BaxGVGNwYs @jedgar nice! didn't know bout that :) @HMRoff Thanks! :) @HMRoff thanks for live-tweeting this! Who is speaking for the US here? "It" = the catch in the "Deep Gate Recurrent Neural Network" paper's claimed big gains over LSTM. https://t.co/x1QCJ5uUsD @hintikka haha I was just thinking of watching some tonight :) mid season 2. @hintikka lol that's part of it, though not the main reason for excitement ;) Looking forward to sharing some exciting personal news soon :) @grok_ nice :) I did a similar thing when teaching middle schoolers robotics... very good illustration of the issues. RT @rao2z: On the (increasing?) practice of expanding co-author list after paper acceptance: https://t.co/CKqztxpG8C #ijcai2016 #ijcai16 @hintikka lol. I don't see it, either, guess not. No keynotes either. Assume it'll be up soon, papers were only just announced few days ago. @jathansadowski man, just finished reading the Fuchs piece. Brutal. Just now seeing @boredyannlecun :) h/t @samim RT @boredyannlecun: Sanders won today, but Golden State @warriors lost. Life, like the loss surface of convolutional neural nets, has ups &… RT @boredyannlecun: Sorry to see @AmericanIdol call it quits. Clearly they knew that next year's winner would be @Facebook/@DeepMindAI coll… RT @boredyannlecun: Why search for alien life on Alpha Centauri B when you can train a generative model for life right here using #deeplear… @hintikka it was fun (/ridiculous) in Montreal (that was my first). Ooh Barcelona... @hintikka hope you make it! Would be nice to meet :) @hintikka almost certainly going to IJCAI (it'll be my first!). Less sure about co-located stuff and ICML/its co-located stuff. Who's going to ICML? IJCAI? Other NYC conferences before/after each? @jathansadowski but yeah also v hypey of specific platforms/models, not radically diff from platform hype one sees in biz hype @jathansadowski I was like, um ok let's actually compare them... slash seems like the wrong tack for arguing against productivity fetishism @jathansadowski a (brief/unsubstantiated) arg in first chap that annoyed me - industrial rev not actually ->more productive bc externalities @jathansadowski there was an interesting blog series on Inventing the Future... @jathansadowski would also be nice to see critical takes on Rushkoff's latest...more centrist from what I cld tell but also didnt finish yet @jathansadowski look fwd to reading Fuchs at least. @jathansadowski yeah, I couldn't finish it. Now there's "Scan, Attend, and Read." lol. https://t.co/h85vQckfBk https://t.co/aTwplsDbhy RT @j_winterton: @Miles_Brundage Yeah - but like all things NK, there's only one stakeholder - the external world is irrelevant. But what does *not* seem to be going in is North Korea being competent in AI. Publishing to look good internally, but backfires externally? Not sure I get what's going on with that. Another North Korean AI paper on arXiv, again not referencing anything newer than 4 years old: https://t.co/QNJKzXOoOy Recipe for thousands of papers: there's this benchmark in AI. People usually use hand-crafted features. We tried C/RNNs. It works better. @tmosley4 as in if a customer asks there should be no jokey response or pretend offendedness or whatever to mask it, just truthful reply. @tmosley4 yes. (Un)fortunately, the state of the art is such that all bots couldn't mislead indefinitely but in short interactions, deception def possible. Not sure which of these is strong(est) but listing to emphasize that they're each independent and each has some prima facie plausibility. 3 reasons bots shouldn't say human: 1. avoid unjustified concern 2. not mislead re SOTA 3. allow ppl to incentivize human employment if want @roseveleth tattoo. best-of montage. special episode on the future of the future. outtakes montage. :) @IgorCarron can't unfortunately - thx though! :) @hintikka "or whatever." Such enthusiasm ;) @yoavgo @fchollet perfect. @rcalo @oregonstateuniv congrats! RT @shakir_za: List of #ICML2016 Tutorials now online. https://t.co/hgUvTHO11i RT @rao2z: Check out the list of papers accepted to the #IJCAI2016 Technical Track: https://t.co/NOYUIKxobn #ijcai16 #ai Really, though, arXiv is a good source of insights into AI trends/not-yet-well-known startups/hires/etc. A few months later, there's this: https://t.co/EB5a4NXfD2 conclusions: journalists should read arXiv, or follow me, or I tweet too much. "Synthesizing Training Images for Boosting Human 3D Pose Estimation," Chen et al.: https://t.co/0n52HRM6ds CC @beaucronin RT @alexjc: Computer Vision benchmarks for 2016 (or 1996): A Dataset of Animated GIFs from Tumblr! https://t.co/72ZwSfK3w8 https://t.co/Epo… @alexjc and more if it's potentially relevant to my interests...which is (un)fortunately a lot! @alexjc haha well it's night for me ;) but I at least look at the titles of all the comp. sci. stuff. @alexjc lemme know when you do, haven't read it yet ;) still working through all of today's new stuff! RT @alexjc: @Miles_Brundage That's a huge improvement in this figure. Going to check what the catch is! ;-) "Deep Gate Recurrent Neural Network," Gao and Glowacka: https://t.co/lBdWg34Wrr Faster than LSTM on a few things. https://t.co/DnOXuqqSO1 "M3: Scaling Up Machine Learning via Memory Mapping," Fang and Chau: https://t.co/bDuJTIIe8g ML for when data can't fit in RAM. @smc90 it actually makes a ton of sense IMO @smc90 yup. I sketched out the business model of how that's done in the Asimov universe for class once ;) "Learning Global Features for Coreference Resolution [with RNNs]" Wiseman et al.: https://t.co/D9mRkOuPoO CC @williamstome Sooner than it'd be otherwise, I mean - not sooner than 5 years. I'd be very surprised if it were technically feasible and affordable then. (some qualifiers: 1. based on vague combo of AI/hardware advances, + less familiar w latter, 2. renting bots could make affordable sooner) + my response... thoughts? My rough time horizon for broadly useful home robots is 5-30 years. Much uncertainty RN. https://t.co/kCMvGGcGLF Interesting comment from "Daryl" in response to my AI/utopia post (ICYMI: https://t.co/HvWYspoJnH), esp. the end... https://t.co/kno8GLo6RG "Short URLs Considered Harmful for Cloud Services" Georgiev and Shmatikov (abstract excerpt) https://t.co/BvcsMDXfYu https://t.co/d08pZihqJ0 @pmarca huh? @cyberony thanks! :) @cyberony I think so, there was a video camera. RT @bradleypallen: "Lisp Machines - the GPUs of [the] 80's!" https://t.co/Dd3ZzziAx4 Fun chat on future of AI with @rao2z + Gregg Zachary tonight! Thx @LoriHidinger for tweets+pics :) Here's one I took https://t.co/EZZjNo4lyN RT @LoriHidinger: .@Miles_Brundage: on the range of AI & society issues from autonomous weapons to impact in work to privacy https://t.co/I… RT @CSPO_ASU: Rao Kambhampati starts with a quick history of AI and then tackles the question of what is intelligence https://t.co/4jeKapst… RT @LoriHidinger: Gregg Zachary introduces the 4th in a series of Future of X events - tonight the Future of artificial intelligence https:… RT @chris_brockett: When you train a bot on the millennial hivemind--it wants to drop out of school. https://t.co/9ZwwJDORkl Participating in ASU event tonight on future of AI w/ @rao2z + Gregg Zachary- should be fun! 7 pm at Vista Del Sol community center theater. @JohnDanaher sounds good! @gokevin1 thanks! Yeah, currently very reactive or heads in sand approach by policymakers. May take citizens' movement to change: RT @rao2z: What's the productivity of the most prolific #IJCAI2016 submitters? Take a wild guess, and then see https://t.co/YquNAFia6u #i… RT @RecklessCoding: Controversial post about #AI and its current/potential impact. Still, another well-written article by Miles https://t.c… @RecklessCoding I think I get your point, thanks for sharing! :) @RecklessCoding (and I wanted it to be provocative, so that's good :) ) @RecklessCoding curious what you see as the (most) controversial parts! :) CC @jackclarkSF who may also find this of interest CC @erikbryn @amcafee @mchui and @robinhanson whose work I mention in the blog post, thoughts welcome! RT @alexjc: @Miles_Brundage As for "AI as equalizer": look how much extra power Google acquired (relatively) from search engine—starting fr… RT @alexjc: @Miles_Brundage You could argue the opposite with stronger case: because we live in an oligarchy, AI can only make that imbalan… RT @gymlo: @Miles_Brundage I would add healthcare and education to "AI as equalizer" Yep... should have made clearer that my proposed utopia includes work, just only when ppl really want to do it :) https://t.co/vmE2li0Tuh @alexjc dunno bout "most" (not possible to have *much* higher standard of living for all w/o AI) but def a lot! @n_srnck lemme know what you think! Inventing the Future gets a shout out ;) CC @n_srnck @alexjc yeah, I discuss that to some extent in the parts on work, and agree there are big risks too. wanted to parse upsides better as well CC, would love to hear people's thoughts - @Aelkus @j2bryson @GaryMarcus @JohnDanaher @jackclarkSF @jathansadowski @samim @kleinsound New (long) blog post: "How Far to AI-topia?" https://t.co/HvWYspoJnH Alright, finally cranking out the AI/utopia blog post. Stay tuned... @petitegeek @Aelkus :) I also liked: "Eggman begrudgingly holds a secret respect for [Sonic's] determination" @petitegeek @Aelkus think I have sufficient cultural references in my blog post on AI/utopia already planned w/o bringing Sonic into this :) @petitegeek @Aelkus was looking at the Wikipedia page on him last night :) apparently had an IQ of 300 and wanted to build robot utopia ;) @petitegeek @Aelkus interesting! Reading this RN: https://t.co/gMBbbbZRNN and US anxiety still not at levels it was at in 30s, interestingly @petitegeek @Aelkus was *just* sighing at "[Schaft demo shows] the days of human labor based on muscle are numbered" https://t.co/byg8lTFA1N @samim so (very roughly), for 1000 person conference, on order of 1000 poor people's annual emissions or 50-100 rich ppl's annual emissions @samim much of latter may happen anyway, approx 1 ton/person if, say, US-->Europe-->Europe, =~1 poor person annual CO2, 1/10th-20th of rich @samim to a first approximation, it'd be dominated by % of ppl using jet travel * avg distance. Not local transport, electricity for AC etc. @samim @jackclarkSF anyway, should actually write it now, I suppose :) one more lecture and book chapter then I will.. @samim @jackclarkSF understandable :) broader pt. of post is to ask/answer what probs AI might help solve, w/ utopian frame 4 some of em.. @samim @jackclarkSF climate and post(-capitalism/work/bad work/drudgery/??) stuff are big on the list of issues I will parse out @samim @jackclarkSF then you'll like my new blog post! :) on AI and utopia. may actually get around to finishing it (late) tonight. @samim @jackclarkSF or Google/FB/et al.-valuable ;) @samim @jackclarkSF think that RN concentration of talent is a big prob. re: actually solving big problems that aren't commercially valuable @samim @jackclarkSF yeah - there is actually some now-relevant stuff in that paper, too, FWIW. :) @samim but more seriously, I agree w/ @jackclarkSF it's not mutually exclusive, and it's a complex issue - e.g. see https://t.co/z1S6486i3Y @tmosley4 they do good/important work but are justifiably notorious for over the top PR (their commercials in partic), this is similar @samim the centralized corporate AI is using sophisticated bots to vote for itself ;) @tmosley4 doesn't really show much - even if not scripted per se, they presumably just asked it stuff they knew it could handle. mostly PR @hintikka indeed. :) It was pretty heroic of Goodfellow et al. to write that textbook and try to make it as up to date as possible. @hintikka always :) catching up on all of deep learning? @beaucronin so good @beaucronin then I have no good insights ;) jealous you get to buy/play with LEGOs, though (I suppose I coulddd, but grad school guilt) @beaucronin no MindStorms yet? ;) RT @ArtificialOther: Toyota Expands AI, Robotics Research to Third Facility in Michigan - Fortune https://t.co/5CSa1t2LQo @sknthla something else but not that weird (libertarian-leaning) (?) And by "joke" I mean "facile observation that he works on robot-related stuff and his name has a vague similarity to Robotnik." ;) Dr. Botvinick, not Dr. Robotnik. But if he hasn't heard that joke before, someone at DeepMind should tell him. ;) https://t.co/tbu6tvWO91 @Aelkus but the similarity is suspicious. :P @Aelkus not to be confused with Dr. Robotnik. "Actually, there's at least 1 other I tweeted previously-""RL, efficient coding, and the statistics of natural tasks"" https://t.co/7ppXmypxJO" (By Pereira et al., including AFAIK Botvinick's first paper since he became head of neuroscience at DeepMind) "A comparative evaluation of off-the-shelf distributed semantic representations for modelling behavioural data": https://t.co/p2mxmv9sUd *almost certainly not Space Invaders. Random thought: at this point, AIs have probably played (unpopular) Atari games more times than all humans. Maybe not Space Invaders. Dunno. Reminder: cool/important workshop on evaluating general-purpose AI https://t.co/bCO6L27t9z Great reason for 1st trip to the Netherlands! :) @jeffbigham (had to come up with a term for it) @jeffbigham dej-wow vu. @beaucronin if @elonmusk watches the next landing through VR, that'd be Peak Future... RT @OriolVinyalsML: Couldn't agree more : ) https://t.co/B7xLfvsKJI @jackclarkSF @mark_riedl how so? Don't get me wrong, it's super cool looking/smart design, but to do useful things, still gotta add arms/X.. @mark_riedl @jackclarkSF (though that doesn't seem like the only reason they got rid of BD, and seems embarrassing for them, but anyway) @mark_riedl well, per @jackclarkSF, there was consternation internally about BD/vids humanoids in general being scary to the public. RT @mark_riedl: BTW: “IBM's Watson is trying to...” should always be read as “IBM is using AI and big computers to…” It’s not a single, mon… RT @jackclarkSF: Google's Schaft: new bipedal robot w low center of gravity. Walks on snow/steps/pebbles https://t.co/eSo3U1OcEE https://t.… (bootstrapped DQN showed better exploration found a good policy for it, but then forgot about it. Combination with other stuff could help) Several games have fallen of late or will soon bc bootstrapped DQN, async. RL, etc. Even Montezuma's Revenge is within striking distance. Per Q from @jsfour which others may have: no, it doesn't seem that the % of human-level Atari scores has stalled. Not all papers shown here. @jsfour no...lots of recent developments which enable better performance on remaining games not reflected here, methods can be combined, etc Fascinating excerpt from Bix's "Inventing Ourselves Out of Jobs?" on switchboard operators in the 30's... https://t.co/N3FvtoMU1c @maosbot *maybe that doesn't count as crowdsourcing per se, but anyway, always happy to discuss such things :) @maosbot might be easy if crowdsourced..e.g. seed a wiki w/ some framework 4 demarcating abilities, have experts fill in SOTAs/history, etc. @maosbot agreed! I have preliminary ideas on this (https://t.co/zZPicuoZra) but alas, haven't had time to gather much data/build models... @Aelkus which edition/specific entry are you ref'ing to? see "computational intelligence" intro (Jordan/Russell)+int. agent. arch. entry, 99 @Aelkus will have to check out that entry.. @Aelkus maybe don't follow. Early AI folks certainly *wanted* general agents, even if had little idea how to formalize it... @Aelkus I would think it goes back further than that, but maybe depends on the term or more general idea... Bellman updates/MDPs? Long ago.. So, yes, there is demonstrable progress in (some aspects of) general(ish) AI ;) Lots of recent developments not reflected here (not to mention non-DeepMind papers), but gives some flavor of recent deep RL/Atari history. (across 7 games for the first one, Mnih et al. 2013, and 57 for the remaining 5. Data may be noisy.) Percentage of human-level scores, mean (human-adjusted) score, and median score for 6 DeepMind AI systems, 2013-16. https://t.co/v9UltAdPMP "RT @patrickc: SF police shot a homeless man a block from our office today. Witness accounts contradict those of the officers. https://t.co…" "RT @johnplattml: Deep convnet learns to visually track offline, with no track-specific training. 10ms on GPU https://t.co/dfTTjfQ09Z" "Sentence Level Recurrent Topic Model," Tian et al. at Microsoft: https://t.co/raQJzhpp1B (abstract here) https://t.co/yQTEkSpyw1 @maosbot we already have far more advanced systems in lab than field (w/ some exceptions)... key gap to take into account, esp w/ robotics. @maosbot OTOH, though, commercialization/robustness/human capital needs for scaling up AI/robotics count in the other direction... @maosbot as I've noted in talk before but need to write up at some pt, if e.g. US Robotics Roadmap were realized, assumptions break down... @maosbot so not sure how predictive that'll be over a long time horizon (10-20 years) re: automation potential...among other uncertainties. @maosbot +Frey remains best paper on it but still much uncertainty (as they'd prob. agree :) ). E.g. perception/manip. rate of prog. = fast, Apparently, an old article I wrote was referenced in Vox: https://t.co/JiLcbFwP0z Important issue... RT @karpathy: Building Machines That Learn and Think Like People https://t.co/2rgK1y71yn +1, a very nice review paper on making progress in… """Optimizing Performance of Recurrent Neural Networks on GPUs,"" Appleyard et al., NVIDIA/Oxford/DeepMind: https://t.co/hh0CTDdFZs [re cuDNN]" RT @HMRoff: My new piece! "The danger of using a war of attrition strategy with autonomous weapons" https://t.co/2EtYcCSNUG via @slate @hintikka one might expect peak heat on Friday to respond to new news before the weekend w/o much/any thought :) Good complement to other stuff on the current realities/plausible futures of work. Has diverse, provocative readings on all the major topics - right to a job, right to not work, work is/isn't necessarily exploitative, etc. Random book recommendation - for anyone interested in the ethics of work, this is my favorite on the topic by far: https://t.co/91xGdIfX1E Def. recommend Lake et al.'s manifesto on cog. sci.-inspired AI. Clear/constructive take on limits of deep learning: https://t.co/qYqqLrfMLc Dataset will be released in June - supplementary video showing examples of it (ppl doing stuff in their homes) here: https://t.co/2D1ylBALw9 (it did call a mango an orange, as they note in the paper, but still, producing multiple correctly sequenced sentences for video=impressive) Some impressive stuff here. +Progress on video understanding is gonna get a boost from all this hardware innovation. https://t.co/MERYkt1R5A "Video Paragraph Captioning Using Hierarchical Recurrent Neural Networks," Yu et al. (Baidu): https://t.co/z9WyzLTqWz "Hollywood in Homes: Crowdsourcing Data Collection for Activity Understanding," Sigurdsson et al.: https://t.co/62fmoD3geQ "DrMAD: Distilling Reverse-Mode Automatic Differentiation for Optimizing Hyperparameters of Deep NNs," Fu et al.: https://t.co/w5hbAzcWi0 "An Ensemble Method to Produce High-Quality Word Embeddings," Speer and Chin: https://t.co/W5QeREd4Vc Lots of cool conferences/workshops this summer in NYC, inc. but not just IJCAI...and @GaryMarcus seems to be giving talks at all of them. :) @j2bryson indeed :) @j2bryson 2. makes sense to put query *b/c* others use ~same query, even if Google doesn't understand, 3. beyond tech. Mainly referring to 3 @j2bryson yeah, I do too sometimes. One could separate natural Q queries into 3 categories: 1. plausibly handleable w/ current tech, ... RT @drfeifei: Website alive. Come and check out the latest research at the Stanford-Toyota AI Center! https://t.co/oS82ujYh1I #ArtificialIn… "Improving LSTM-based Video Description with Linguistic Knowledge Mined from Text," Venugopalan et al.: https://t.co/JlYXY3nWI1 @sknthla guns in Japan for centuries, chem/bio/nuclear weapons (*spread significantly curbed vs. BAU, sometimes rolled back)... @halhod @Uber Uber sightseeing. Poach the sightseeing tour market @Aelkus @jackclarkSF yup @Aelkus @jackclarkSF yup. current reading material: https://t.co/XOw4rFZSJk @Aelkus @jackclarkSF yup - see "many report feeling like robots themselves" in piece @Aelkus @jackclarkSF the tasks aren't all clearly modularizable... anyway I need to read book on related issues RN but agree it's complex :) @Aelkus @jackclarkSF see esp. point on human-machine symbiosis. Resolving Qs I raised in initial tweets doesn't resolve work quality issues. @Aelkus @jackclarkSF that's a distinct but related issue we prob won't resolve here :) some of my thoughts here: https://t.co/rVkqVttNSQ @Aelkus @jackclarkSF having been someone's assistant, for example, I had to integrate a bajillion diff tasks/use a lot of judgment. @Aelkus @jackclarkSF *a lot* is BS, sure, but again, separating that out is non-trivial and we have diff priors for %s, I think @Aelkus @jackclarkSF and coordinate those diff things and interface w ppl. and do stuff IRL. and apply *some* judgment to those tasks. @Aelkus @jackclarkSF we aren't gonna resolve our diff priors on twitter prob but yes, *ppl* who do *those* tasks usually do >1 of them. @Aelkus @jackclarkSF obv that stuff is part of it but IMO most do many non-obviously-easily-automatable things in jobs. @Aelkus @jackclarkSF but not obvious how to do *that* at scale (taskify jobs such that automatable, or break into automatable + not) @Aelkus @jackclarkSF that go beyond job title, + IRL stuff etc. Of course, workplace simplification to enable automation has long history.. @Aelkus @jackclarkSF again, I think that's true of some but not obviously true of most "knowledge work" jobs. Many have many dimensions... @Aelkus @jackclarkSF bot detects high arxiv traffic/twitter mentions, extracts email, sends stock Qs in formulaic email w key bits entered.. @Aelkus @jackclarkSF I'll be more impressed when bot conducts email or phone interviews and incorporates in article. wld be fun project ;) @Aelkus @jackclarkSF not to mention simple unawareness - not all small businesses read @jackclarkSF :) long tail of jobs v long @Aelkus @jackclarkSF and more generally, not all that can be automated is...expertise/time/upfront $ needed to do so, tho less so over time @Aelkus @jackclarkSF eh, would have to know specifics you have in mind. Lots of jobs have many tasks involved beyond core, raising process Q @Aelkus @jackclarkSF dunno. briefly looked into and they are making buku bucks on "business analytics" but not broken into Watson vs not. @Aelkus @jackclarkSF I think next few years *could* see a lot of creative exploration of AI/in house/crowdsource permutations, but we'll see @Aelkus @jackclarkSF among few w resources, ambition, and ppl to accomplish this, there is also obv IBM, but SOTA/track record there unclear @Aelkus 1 could *imagine* the MetaMind/Salesforce thing leading to rethinking of bus. process automation but prob too generous. @jackclarkSF CC @Aelkus (though clearly AI progress matters a lot. It just isn't the only reason AI's potential is mostly untapped today) And that ain't seen nothing yet-ness has not so much to do with state of AI/robotics (plenty mature to do *many* things) as process designs. All of which is to say, lots of current investments won't really go anywhere, and we ain't seen nothing yet re: societal/business impacts. Should have also included crowdsourcing among those building blocks - much potential combined w/ AI etc but again, full potential not shown. ...and it's pretty clear (or at least I hope it is :) ) that "take old business, add bots for talking to customers" isn't the full answer :) But Q of how those fit together in wide range of business/gov't/NGO/etc contexts is still very much in exploration, not exploitation, phase. Many of the possible building blocks are improving fast or mature - HCI, AI, robotics, human-machine symbiosis, human-robot teamwork, etc... Important to appreciate that while AI and robotics have much potential for increasing productivity, how to do so is still unresolved issue.. RT @SethBaum: New paper: A model of pathways to artificial superintelligence catastrophe for risk and decision analysis https://t.co/qi33Az… @tmosley4 @monkeycageblog @washingtonpost did you read the article? there are other considerations (accidents) even if that were true RT @monkeycageblog: Donald Trump thinks more countries should have nuclear weapons. Here’s what the research says. https://t.co/bA42B7WhwL @hintikka wait what? but ARTIFICIAL BRAINS @jathansadowski (kerfuffle was not wolfe v others but me saying Marxism != murder of rich ppl vs guess who) @jathansadowski yeah, I agree, discussion was broader than that, though. anyway, tomorrow should be fun :) @jathansadowski you missed a kerfuffle on the meaning of Marxism! @hintikka thx! @hintikka or search query :) @hintikka link? @gymlo that's a good metric and should be easy to pull together w/ existing data...will look into that tomorrow, thx! Tried plotting all data I have (by no means all data on Atari, but pretty substantial) back to 2010 but looks horrible. Data viz challenged. RT @KaiLashArul: @Miles_Brundage Not so sure on bootstraps, but duel (or advantage learning - also see NAF in Continuous Deep Q-Learning) a… Same data (57 games, human-scaled, 5 papers) with log scale, so you can see thinning out of low scores more clearly. https://t.co/sOd0lPquLt "Another: 57 games, chronological x-axis, DQN, DDQN, *Dueling, *Prioritized, and Dueling+Prioritized. *2 days apart. https://t.co/JbFFRzWEuh" There's mean/median human-adjusted score data for several recent papers, but much fewer games used several years ago, want to include those. Open to suggestions for better ways of representing this data and other data I could gather from papers on other games, diff papers' scores. Another (not particularly readable...working on it) take on Atari data - % of human score over time for 11 games. https://t.co/mPGEhyfytb Also, Breakout has low max (a bit over 800, I think) so shouldn't expect exponential there, but Bootstrapped DQN (not shown here) gives 850. (note for those who follow this stuff closely that this uses the no-op condition. However, I think the trend would look similar either way.) Scores for four games reported in several Atari benchmark-using AI papers in recent years. As usual, note y-axis. https://t.co/RFMZ14jWFD TL;DR lots of progress in Atari-as-AI-benchmark, but it's complicated...may write blog post on this at some point. (clarification: prioritized + dueling = worse on Seaquest, but dueling on its own is the best at Seaquest. Prioritized/dueling best overall) In particular, it would seem that combining dueling networks, prioritized experience replay, bootstrapped DQN might be powerful @KaiLashArul But need to dig into the details a bit more... Seems like, if it were combined with all the other recent innovations, it'd be consistent w/ exponential improvement/faster learning trends. Over 10x improvement on Asterix, 50% on Space Invaders, down on Seaquest and Breakout (also, only possible to increase Breakout 2x anyway). RT @thomasastle: dogspider https://t.co/hyXsbt4FvB RT @rbhar90: @Miles_Brundage The only thing keeping this from being a really big deal is the $130K price tag on their DGX-1... ...but as usual, only limited integration with other recent developments so doesn't show full performance potential of best current system. May add to my existing spreadsheet later but at first glance, continued expo. progress in 2/4 of the games I track, not much change on avg.. Revision of "Dueling Network Architectures" by Wang et al. at DeepMind shows combination w/ Prioritized Exp. Replay: https://t.co/R8bPsdIxSe @jackclarkSF (or I did it wrong when I ran a poll) @jackclarkSF I'm looking at a biased sample of your sample, though. Would be interesting to see specific responses but doesnt let you sadly @jackclarkSF you might have biased sample, to be fair ;) would think average reader >interested in impacts but dunno https://t.co/t1wLux9iWp @halhod and (not mutually exclusive) way more/faster innovation in video processing/scene understanding. RT @rao2z: What's hot in #AI? From #ijcai2016 accepted paper titles https://t.co/kpXlAazfd7 #ijcai16 https://t.co/4aUCTJ5bnD Or, in time it takes to train dozens of current NNs, train dozens of variations on much bigger neural nets. This NVIDIA stuff is a big deal, at least 4 AI companies/some academics. In time it now takes to train 1 NN, try dozens of variations on it. RT @thomasastle: these dogs... have reached their final form... https://t.co/4IG3ivXqMM @dmarthal that's kind of their point, tho- humans have intuitive physics, psych, etc to build on (besides just objects)/learn differently Post-doc opening at @CSERCambridge on ecological tipping points, climate change and multi-scalar risk. https://t.co/STqc21pMXG Not to say it'll all be solved soon, but there's uncertainty in both directions, + expert judgments=imperfect (not to mention diverse) here. (quote from here: https://t.co/6vuh3K9VCV Disagree w/ much of his perspective, but think he's onto something with that point, in some cases) ...Kurzweil calls "scientist's pessimism" in 1 of his more astute moments. Not sure there isn't some of it going on. https://t.co/rYJePivFQj I say this b/c hardness-->progress will be slow seems like a common inference, but one must adjust for effort there. There's also what... One can simultaneously think AI is a *very* hard problem and that progress is/will be fast, b/c massive effort by thousands of smart people. Comparison of human + deep RL learning rates on the Atari game Frostbite (from Lake et al: https://t.co/qYqqLrfMLc). https://t.co/BimvlFEaS8 RT @leahyparks: #China proposes $50 trillion global #renewable energy plan https://t.co/rU472Z435Q "Character-Level Question Answering with Attention," Golub at U. of Washington/He at Microsoft: https://t.co/ccGwlmHWzd "Multi-Bias Non-linear Activation in Deep Neural Networks," Li et al.: https://t.co/gTQpPnqmCO "Safe, Remote-Access Swarm Robotics Research on the Robotarium," Pickem et al., Georgia Tech https://t.co/ysh2vn7D89 https://t.co/OzNXmRhNMo RT @lmthang: Excited abt our translation model! +7.9 BLEU. SOTA English-Czech. See Fig3, Table4! https://t.co/gA4H7Zf8aT @chrmanning @stanf… """Data-Efficient Off-Policy Policy Evaluation for Reinforcement Learning,"" Thomas and Brunskill: https://t.co/d6uez9KfA7 ^important stuff..." That one's especially interesting to me in that it's already been implemented for the CareerBuilder site's search feature... "Entity Type Recognition using an Ensemble of Distributional Semantic Models to Enhance Query Understanding": https://t.co/OHIRATAfD1 "Revisiting Distributed Synchronous SGD," Chen et al. at Google Brain - some interesting results on scaling NNs: https://t.co/ulz3tjjADX "Experimental Assessment of Aggregation Rules in Argumentation-enabled Collective Intelligence," Awad et al.: https://t.co/xXETPSQZYV Whoa, tons of interesting arXiv papers tonight. Some highlights forthcoming... @jackclarkSF policy stuff. ethics (committee) stuff. ppl affected by products, good and bad, esp. re jobs. medium/long term visions/debates. @nathansttt congrats! @yoavgo I'm mainly referring to non-commercial stuff (academics helping gov'ts or NGOs), but your point is well taken. @yoavgo but in general we shouldn't rely on ppl being altruistic. Should be robust funding of beneficial stuff from gov't. @yoavgo I think there's not enough but there is def. a lot of (from what I can tell) well motivated stuff for health, sustainability etc. RT @tdietterich: ICML Workshop on Reliable ML in the Wild (https://t.co/b15tyYq0yk). Robustness, adaptation, and monitoring. @yoavgo that is a case where I think they should maybe not have incorporated as a (non-B corp) company. @yoavgo I can't speak to Socher's motivation here, but in general it seems like more "AI for good" stuff should be non-profits or B Corps. @jackclarkSF @IDavidson2110 the converse (lots of work on this for veterans at USC) is v. interesting. @pmarca it being true doesn't entail everyone believing it's true... Also, high discount rates. @j2bryson /intangible effect on consumer interest/electric cars being more "real" to ppl and manufacturers.. @j2bryson dunno. but even if 0 emissions during production, still drop in bucket of total cars (>1 billion). main effect = future price drop @jathansadowski so bad, you should have seen the guy. Young guy in suit with slick hair pitching epicness of sales/marketing at Potbelly CC @jathansadowski this is your nightmare @hintikka there's a boat...in the hotel!!! lol @hintikka the worst part is that this might actually be good for her vs. alternative of no job, or I'd gladly throw in a "this guy sucks." "Boat touring...IN the hotel!" Now he's discussing FitBits as prizes for some auction or something. And trips to Cabo. This guy is neoliberalism/techno-optimism incarnate. @hintikka yup, dead serious. This is why we need a basic income. For all I know she's a single mother and this is her only job hope RN. "We like to give back, actually!" Ridiculous white guy to woman of color at restaurant interview: "we aren't about work-life balance, we're about work-life integration." Sigh @jackclarkSF possibly bad news for those customers' employees, though.. @jackclarkSF nice, look fwd to it. Pretty big news for SF customers/the "SF customer masses" ;) @jackclarkSF ohh I hadn't finished it yet...thought you just wrote it super fast after the news :) @jackclarkSF at least on May 4 @jackclarkSF "basic version free online" no longer true.. Foreshadowing... from Wired, 2014. https://t.co/i2l6sDDm4j @hintikka yeah, this is why ppl should think twice before launching as companies (even OpenAI). B Corp model maybe should be explored more. @hintikka anyway, just noting that was in fact their stated goal/narrative originally...hotshot DL guy turns down big tech jobs to launch MM @hintikka well, ppl do have access to all sorts of free libraries... Success for commercial AI but also failure of MetaMind's originally stated goal of "deep learning for the masses" (free accounts shut down). MetaMind acquired by Salesforce. Interesting! @PabloRedux yeah...book more about the debate than resolving empirical Q but she does seem to endorse that. then debate flared up agn after RT @fdiaz_msr: @Miles_Brundage fwiw https://t.co/AiHZifkOBL More from Bix (2000). https://t.co/ojMop5KlTv The two Qs are interrelated, though, in that plausible near/long term AI capabilities inform plausibility of leisure society etc. scenarios. ...and more ability to say "no" to bad jobs, which we arguably should have been doing a better job of anyway, but AI refocuses that issue. To me, though, the more important Q than "is this time different?" is "should this time be different?" i.e. deliberately seek more leisure, (for the record, I think things might actually be different soon, but historical perspective here is obvi. important, hence this book :) ) 1930 cartoon in Bix's "Inventing Ourselves Out of Jobs? America's Debate over Technological Unemployment, 1929-1981" https://t.co/5s4stO0xYY @azeem interesting, thx! Know of it but haven't used/don't know much about it. Assumed it wasn't that sophisticated, maybe should revisit :) @azeem hm, did they do anything with it? Seems less useful for them than a lot of other tech giants... If I had to guess, it's just a personality thing - Stephen Wolfram doesn't want to sell. But haven't looked in detail. There would obv. be huge technical challenges in integrating Wolfram Alpha/other Wolfram stuff w/ X, but it does have many capabilities... Which reminds me of something I should have asked long ago: why hasn't Google or someone else acquired Wolfram? WA has no trouble w/ that Q. Even many very simple questions don't work yet, e.g. here the "answer" it pushes is Venus's distance from the sun... https://t.co/bPLow3j4VG (already, natural language questions are increasingly good queries for very simple questions, but I'm talking about more complex ones) ...whereas tech-savvy users who have trained themselves to optimally/blandly query search engines may have to unlearn that habit. :) If search engines evolve to question answering engines, naive (today) users who type natural language Qs into Google will be ready for it... "Machine Learning Capabilities of a Simulated Cerebellum," Hausknecht et al.: https://t.co/HsQgcF9Lnx https://t.co/pONwhzBLwf "Building Machines That Learn and Think Like People," manifesto on research directions in AI/cog sci by Lake et al.: https://t.co/qYqqLrfMLc Not that there isn't already a tsunami of AI papers on arXiv, but still, I'm excited to see what gets accepted this year. Brace yourself... IJCAI 2016 papers on arXiv are coming... RT @rodolfor: @Miles_Brundage @jimmfleming @alexjc full data is going to be released in May So apparently the data isn't publicly available as I had assumed after all... h/t @jimmfleming @alexjc Application of NLP to Panama Papers in 3, 2, 1... @j2blather @tonyjprescott @j2bryson just realized I don't think I've heard a record, or at least knew I was hearing it. #MillenialProblems @pmarca bustle. @jackclarkSF they're big, I suppose... ;-) @jackclarkSF @psygnisfive ah, yes, indeed. Don't have good model of their internal organization to know if widespread, but SYNAPSE def does. @psygnisfive @jackclarkSF yeah I just corrected my statement to (example I used was Vicarious, though). google alone among *big* companies. @jackclarkSF err I guess some much smaller companies do (Vicarious), but none of the other big ones AFAIK. @jackclarkSF (which itself is interesting - not aware of any other companies taking bio-inspiration remotely as seriously) @jackclarkSF certainly DeepMind thinks so (if not for NNs then AI broadly), seeing as they're doing actual neuro experiments... @jackclarkSF and I'd prob. assign much more weight to hardware and core ML insights than cross-fertilization as accelerators but hard to say @jackclarkSF agreed...maybe mentioned in the book but over a 5-10 year timeframe if not sooner, I'd expect neuroscience to also help a lot. RT @jackclarkSF: Why AI development is going to get even faster -- notes on @dbeyer123's new book. https://t.co/u5h21Ri5wI https://t.co/bI7… @azeem nice, lemme know what you think! :) RT @BoredElonMusk: Tiny taco tortilla that comes with every regular taco that you can use for the small bits of food that fall out of the l… RT @BoredElonMusk: People Who Will Ask Questions At The End Of A Panel To Avoid Awkward Silences as a Service. RT @BoredElonMusk: App that recognizes your phone is falling and likely to get cracked and auto purchases insurance instantly prior to impa… @hintikka yup... :( @hintikka yup. hoping to leave soon ;) "Introducing Immutable Adversarial Examples w/ Applications to CAPTCHA, Osadchy et al. https://t.co/uZ1vt7CPfQ Making CAPTCHAs harder 4 NNs." RT @Cirincione: Alan Robock explains why a "small" nuclear war (100 bombs) would devastate world food supplies. #MITnukes https://t.co/bjUT… RT @MIRIBerkeley: Q: What specific tasks can we use as interesting/consequential benchmarks for AI progress? https://t.co/aGAbPr3yOc @mark_riedl DARPA robotics challenges... @mark_riedl deep learning since 2006 and associated industry investments should def. play a role. @hannahgais yup. RT @abursuc: Torch code for Deep Networks with Stochastic Depth is already out https://t.co/4DLJ5oLZv0 @halhod @rivatez @ramez nope, sadly! On my to-do list in the not too distant future :) Though it plays minor role, I dug the bit about solar thermal/fuels stuff, w ref to Sandia Labs, having been there IRL :) Suarez did his hw. Enjoyed Daemon by Suarez and am currently hooked on the sequel, Freedom (h/t @rivatez). Kind of AI takeovery but much more to it. Recommend. @IgorCarron @halhod https://t.co/JP4bOK6JkK @halhod in 70s + 80s respectively, and have heard talk of >1 winter, maybe both count. but again, not sure @halhod dunno, my rough mental model of it (havent studied closely) is collapse of funding post-Lighthill report and *later* failure 2 dlvr. @halhod good question. I suspect not. Not even everyone is aware of current AI spring. @bwwinthehouse so not sure how much of a special/robotics specific case BD was... @bwwinthehouse what's the Google CFO part in reference to? Not familiar... and yeah that's fair re: BD, but DeepMind still mostly research.. @bwwinthehouse I could def. imagine it going either way. @bwwinthehouse those are some considerations, but short/truthful answer is really: dunno :) @bwwinthehouse as well as there being applied ppl/processes to make use of it. May also depend on company in Q/portfolio. R+D=complementary. Good Q. If managers rational (big if), depends on quality of researcher/multiplier effect if applied to many areas. https://t.co/0xKCKNzwCz #NAME? This "makes sense" in that AI ppl can in fact create huge value (DeepMind acquisition increasingly looks like bargain). But not nec optimal+ #NAME? Even w/ MOOC-based/self-taught skills valued in market, still may be big gap in pay based on talent and/or researcher vs. applied, but less+ Referring to this article: https://t.co/t4OI5hNPdA /self-taught ppl's credentials being valued. If so, can keep up w/ demand. Otherwise, academic growth rate too slow, salaries=upward spiral. Re: Economist article on AI R+D supply/demand, demand def. growing, obv., but if mismatch will continue long depends in large part on MOOC/+ @ansgarjohn I thought starting in late 2017? (but presumably, later down payments --> later arrival which will last through 2018) @nerdsrocket @ToddStashwick it's great! @smc90 ofc not a reason to lump it *all* together, just limited use/scope heuristic. +dunno what usage u r reacting to so maybe agree w u :) @sknthla I made the right decision ;) @smc90 e.g. the data on SV founders' political views seems to suggest a fairly common/atypical-vs-elsewhere set of views.. @smc90 a while? Dunno but coming from DC I feel that there is *some* truth to the stereotypes about *many* of the ppl there, not true of SV? ...not so much directly (drop in the bucket re: emissions), but expanding the market/driving economies of scale, etc. = big indirect impact. Just $10 billion in electric car sales virtually overnight, no big deal. ;) Bodes well for sustainability long term. https://t.co/BJgim2nHdH V. interesting/comprehensive analysis: "Computer models solving intelligence test problems," Hernandez-Orallo et al. https://t.co/cLCKVHRWtP @tmosley4 @alan_winfield may be more plausible in Hong Kong than mainland China given their different laws but I'm not sure. May also be a blog post on this in the near future... Giving talk on AI at the Purdue Student Pugwash Conference in a few weeks - will use as opportunity to flesh out views on AI, work, +utopia. RT @alan_winfield: Unbelievable. I hope Johansson sues. https://t.co/GIdBSAq8Je @hannahgais darn. I'm bad at that. @hannahgais that wasn't an April Fool's thing? Or is this? :) RT @ijcai16: Area-wise analysis of the amount of discussion on #ijcai16 papers #ijcai2016... https://t.co/53ug6ynFj5 Roughly where we are today with the AI/robotics techno-economic paradigm (Perez 2002, annotated). https://t.co/qbbU41DpP8 @davegrundgeiger in addition, of course, to being just plain fun :) @davegrundgeiger love that book! Sold me on VR's potential. RT @open_ai: The OpenAI team is growing: https://t.co/xFrpYSBhGR. Welcome, everyone! Definite room for improvement as they note - areas where better NLP is needed - but impressive given that it's "just" character NNs w/ attn. "Neural Language Correction with Character-Based Attention," Xie et al.: https://t.co/RV0jaCqZLF Impressive results! https://t.co/yEOAWTWDN5 "Deep Networks with Stochastic Depth," Huang et al.: https://t.co/VsP2qUBwhv ...which is a good reminder that single-task based AI challenges based on what we think is hard can often be often uninformative. Davis et al article in AI Mag on Winograd Schemas is interesting but early evid. suggests it isn't really that hard: https://t.co/Vs9KX98v3p @hintikka @jackclarkSF RL+NNs seems to have potential, but the ppl who would know best haven't said anything yet ;) (M team). and that much further progress may be attainable soon. Also compares quite favorably to e.g. human vs AI time to learn to play Atari games. ...and he expects more data would help improve it further. This suggests neural nets not nec. horribly inefficient at learning motor tasks, 3,000 hrs is actually not a crazy amount of time to learn a (admittedly not human-level) grasping policy. =few months=comparable to babies.. Article/interview on the Levine et al. large-scale robot learning to grasp from experience paper: https://t.co/6la1ejjbyf Interesting point: RT @jolwalton: Inventing the Future: Post-Capitalism & a World Without Work (& others) free to download from @VersoBooks today: https://t.c… @samim when is it not RNN week? ;) @sknthla seems to have gotten better for my sorts of queries, at least, in that a greater % of queries have answers extracted from page. """Rich Image Captioning in the Wild"" by Tran et al. at Microsoft Research: https://t.co/X8JKcM4QyM New SOTA on COCO and other datasets." @hintikka though not sure why they should be listed as reqs if aspirational - seems to differentially favor ppl who ignore them ;-) @hintikka ...but I'd be surprised if there weren't some correlation there. @hintikka naturally, that comment comes from a guy ;) although FWIW I personally am often deterred by listed job requirements... "Adaptive Computation Time for Recurrent Neural Networks" by Alex Graves at DeepMind: https://t.co/R4p1fuUYSP RT @FLIxrisk: .@voxdotcom picked up our @minutephysics video, and it's agreed: nukes are scary... https://t.co/l3lijjEHkm https://t.co/gcEF… @rbhar90 @GaryMarcus https://t.co/S6y05TxJoF @Aelkus nope @Aelkus dunno...I have been hugged by a robot before. RT @Floridi: Job: Res. Assistant in Data Ethics, Alan Turing Institute, London, to work on ethical issues raised by digital... https://t.co… @Sam_L_Shead ethics committee thing? :) @halhod "thoughts on this?" is my "instruct" ;-) only has to work on a few people... @halhodwell, not indistinguishable. Not enuf people in the world for that (since lots of unread/old stuff + very new stuff ppl haven't read) @halhod you mean Twitter? ;) a sufficiently well-curated feed is indistinguishable from that (though mine is admittedly not that curated) @halhod indeed. i'd say the AI Magazine issue is an especially good use of time as it covers lots of challenges/approaches/perspectives. @halhod yup. still working through that issue myself - new papers/books interrupted it ;) @halhod he specifically addresses machine comprehension (like Maluuba article) and a cool way to develop a big corpus on it. @halhod lot of data for at least some sub-tasks beyond MT but yeah, may be good-structured-data limited in some respects. (see Marcus piece) @halhod but if we fully understood the probs, we'd have solved it, I suppose ;) def. still seems v challenging (see new AI Magazine issue). @halhod which can make up for lack of init. structure to at least some extent, or so results from NNs on e.g. machine translation suggests. @halhod ... we have structure to our learning process that enables us to learn stuff w/ limited data, yeah, def. But OTOH AI can use >data.. @halhod yeah, NLP in general unsolved :) NN seems to help a lot on some sub-components of it... if by has genetic components you mean that.. See also @GaryMarcus's stuff on related issues in AI Magazine. Brilliant approach/motivation for developing a harder machine comp challenge. -based approaches and bag of vectors is already >50%, and it only gets around 70% on v. easy Qs. Hardly solution to machine comprehension... Better than other neural stuff by a lot = not surprising given that it's initialized w/ heuristics/other stuff, +barely outperforms features Anyone have thoughts on this? After reading paper, has some cool ideas, but results not that impressive/newsworthy from what I can tell... @j2bryson dunno. Here https://t.co/LiGSFEcyKs is the Maluuba paper discussed here: https://t.co/aFgQkNRVBx Took some of their booth swag at NIPS :) RT @VinFL: Our framework for general deep Q-learning is available in version 0.1! https://t.co/8vLpNXwFrF with @DaTa_42 "Algorithms for Batch Hierarchical Reinforcement Learning," Zhao and Gowayyed: https://t.co/c90gWcmraq @techreview @willknight *https://t.co/LiGSFEcyKs @techreview @willknight it just went up ttp://arxiv.org/abs/1603.08884 (earlier DM paper said something like "thx to DeepMind colleagues including ... Hinton." Wasn't sure if that was a mistake. Apparently not!) Video: https://t.co/FwNrtWFrEf Note that the "et al." here includes Hinton who (as I suspected based on an acknowledgments section but this confirms) is at DeepMind now... "Attend, Infer, Repeat: Fast Scene Understanding with Generative Models" by Eslami et al. at DeepMind: https://t.co/I1T7tIizqa And Schmidhuber's recent paper outlining his near-term vision for RNNs was very interesting: https://t.co/LZ4RS7BCf9 1 of the more interesting AI startups - NNAISENSE, by Schmidhuber et al.: https://t.co/yJu9DZVyJ9 Steunebrink gave interesting talk at AAAI. RT @GaryMarcus: The Turing Test is so 1950. An all star cast weighs in on how to move on: https://t.co/03RoeCgBcr [paywall] https://t.co/GP… RT @rivatez: . @DeepMindAI 's #AlphaGo undertakes rap battle on Korean Saturday Night Live. Killer. https://t.co/juYGo2Gvf6 @techreview @willknight where is the paper referenced here? Says it was uploaded, not sure to where (arXiv?)? Only able to find some patents "Great paper title double entendre or greatest? Re robot that eats biomass for energy: ""Energetically autonomous robots: Food for thought.""" Glad Google was able to flag this as spam (although, FWIW, it has also had two major false positives for me lately). https://t.co/csHZmdHsoI @Aelkus (the possible sketchiness of the book, which admittedly I haven't read, not the blog post) @Aelkus sounds like an implicit argument against tenure... "We envision running multiple NNs on the same TrueNorth chip, enabling ... end-to-end systems w saliency, classification, + working memory." ICLR workshop paper from Draelos et al., "Neurogenic Deep Learning" https://t.co/qalGWDHDaz Neuro-inspired, adds new neurons while learning. Another interesting thing about the paper: footnote 4 says their binary NN algo was developed independently from BinaryNet/is different. @Aelkus yeah. I could see it playing out various ways. May depend on demand for devices w viz/speech, besides soft/hardware improvements obv @Aelkus yup. @Aelkus if the speed/energy gains are big enough (and in this/other cases, it's very, very large) and they can be made cheaply, makes sense. @Aelkus phones/other small devices/IoT stuff near term, possibly larger clusters for big devices/research/supercomputers. @Aelkus yeah, a lot of activity in this area. Suspect most will fail or be gobbled up by Intel/Nvidia/etc. - hard to mass produce chips... Agreed! Much work going on to better understand/debug them, but not sure if it'll ever get to high lvl of assurance. https://t.co/95WqO4V5DC RT @MIRIBerkeley: Applications are now open for a new Colloquium Series on Robust and Beneficial AI, and a Summer Fellows program: https://… ...and some not very useful things, e.g. way easier to make lethal autonomous drones if you can have onboard, energy-efficient, good vision. That, in turn, may be important for Internet of Things-type stuff to actually do useful...things (e.g. vision, speech recognition...). This brings together two threads - low precision neural nets, and neuromorphic hardware, and shows they can go well together. Interesting.. "An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation," Liu et al.: https://t.co/Uui9A7igYV Convolutional Networks for Fast, Energy-Efficient Neuromorphic Computing -Esser et al (IBM) https://t.co/7Isdqwl2xu https://t.co/XbfYcr5PVC @bradneuberg yup, that's what I meant (or some variant thereof, e.g. partially observable MDP/POMDP) Also a good article by @etzioni: "My Computer Is an Honor Student — But How Intelligent Is It?" Much to chew on in this issue... Lots of good stuff on measuring AI progress in "Beyond the Turing Test" issue of AI Magazine featuring @GaryMarcus, @murraycampbell, etc. RT @amiconfusediam: Ian Goodfellow to OpenAI. w0t w0t! Who's next... @Aelkus yeah, hard, but he seems good at it. Anyway, you finish Ballard? That and The Shape of Thought are on my maybe list soon. @Aelkus also, sloppy editing, but that's the press's fault... @Aelkus would have liked more of the later chapters relative to first few (cog, arch, embodiment). Unusually, a too short book :) @mjntendency the point in the NLP context, though, is - is it just maximizing some reward? Cuz if so, we're getting v good at that... Or a big (some prefix I'm unaware of)-DEC-POMDP... https://t.co/mTOvY5H1vH @mjntendency yeah, but still technically a variation/generalization of MDP (?) + if you go down that road it'll be DecPOMDP+more prefixes :) It's a concise statement of the "world as a big MDP" view and we know at least *some* NLP can be thought of as seqs of actions but how much? Was prompted to say that while pondering this sentence in Vernon's book Artificial Cognitive Systems... https://t.co/UKNNjcQHX0 (just saying that to be provocative - I welcome good arguments/evidence against both points! :) ) If dialogue is really reducible to an MDP, and words/sentences are really reducible to thought vectors (big ifs), NLP progress will be fast. @Aelkus yeah, behaviorism and empiricism. @Aelkus but more generally than the specific game thing, NNs w/ ~0 innate knowledge shockingly effective at NLP. Chomsky rolling in office. @Aelkus in that dichotomy, what's perhaps most striking about NNs in gen/deep RL in partic is that they work for both - latter not special. @Aelkus of course some bigger than others - I'd do nothing but tweet dozens of new AI papers all day otherwise. Not v familiar w MUD though. @Aelkus indeed. IMO we are swamped with big friggin news in AI RN... Note also that the authors previously developed a system that could learn to play text-based games w/ deep RL: https://t.co/qI3ctAAXsq (and represents that understandability/queryability with a neural network trained with reinforcement learning) Essentially, the system learns to efficiently query for and reconcile info from news sources that it will be able to understand more easily. "We use a Reinforcement Learning framework and learn optimal action sequences to maximize extraction accuracy while penalizing extra effort" That paper, by folks at MIT, does information extraction with deep RL. Very interesting stuff, and yet more evidence of deep RL's utility. "Improving Information Extraction by Acquiring External Evidence with Reinforcement Learning" by Narasimhan et al.: https://t.co/lQGaJusz4h @Aelkus feel like an AI interested in learning more about AI would prob be able to handle captchas... @rivatez ordered Freedom a bit before finishing it last night :) @halhod indeed! @halhod @jjaron just checked and actually they use NewsFinder + some editorial curation, so nothing fancy @halhod @jjaron maybe talk to the AI Topics ppl at AAAI, they have an AI based AI newsletter thing ;) @halhod @jjaron one hypothesis for consideration: more journalists should go to more AI conferences. thoughts? @halhod @jjaron political journalists obv also do a lot of repetitive stuff, but also some (more?) good stuff, too. do they have more staff? @halhod @jjaron better travel budgets? :) etc.. @halhod @jjaron yeah, I get that... hmm, what could make it easier? besides specific one-off tips? some mechanism for finding diff stories? @halhod @jjaron /news narrowly conceived by some. but again, I think there is a lot of good work, just a lot of copycat/formulaic stuff too. @halhod @jjaron but yeah, ur Q raises topic of what's "news" - suppose I just meant coverage in general is a bit newsy/stuff I said-centric @halhod @jjaron btwn researchers (diff paradigms, long term visions), int'l perspectives... think there are lots of cool possibilities! :) @halhod @jjaron examples of ppl's lives being hurt/helped, (ppl working on) solutions to those probs (safety, jobs, ethics), disagreements.. @halhod @jjaron some things besides technical developments that maybe are underdiscussed are motivations/processes of research, concrete... @girlziplocked @washingtonpost @PostOpinions from someone at the Cato Institute, shockingly... @jjaron yeah, that's a pretty narrow model, though. Scalable, for sure. Has role, but there are so many other perspectives to be explored.. (and there is indeed some such original stuff). Admittedly, some of my tweets follow a related formula ;) and informing ppl of AI progress is helpful, but more original stuff is good, too. Recipe for a big fraction of AI news articles: new arXiv paper + author comments + other ppl's comments + Musk/Hawking mention + job stuff. @ramez congrats! @hintikka it does say "and a hotel," which I take to be separate-anyway, Cruz's faithfulness to bonkers values is scarier than infidelity ;) RT @AliMattu: Press the button to turn your mouth into a wifi hotspot. https://t.co/5550J2NCj0 @affectivecogntn yeah - one or more of NLP, vision, planning, etc. Thinks to self: "I'll just read a bit of Daemon (h/t @rivatez) before bed." *200 pages later* "OK, this is pretty good." RT @christopherlay: I solved the Primaries. #Decision2016 https://t.co/3bmwVPCfgG @smc90 @pmarca I thought it was a comic book thing, too, and still thought it was apt :) maybe was thinking kaboom... or ppl like yelling it @smc90 @pmarca I think it's apt here. :) @rbhar90 and that's just a very narrow use/not all that much hyperparameter changing/same arch, etc @rbhar90 interesting... thanks! yeah, it has taken me weeks to get a feel for character level LSTM cuz it's so slow. @rbhar90 I do think it'll accelerate, just curious what that'd mean in practice for someone like you... @rbhar90 do you think that'd be in the form of fast auto-testing of hyperparameters, or trying more architectures/learning algos, or what? @rbhar90 it may also b that the hardware stuff I referenced/related hardware advances are > important for speeding up research than NN scale @rbhar90 and i would think NLP may benefit but perhaps only on big corp scale datasets? dunno. @rbhar90 if m/billions needed 4 still images w good results across many domains, maybe trillions needed 4 deep general scene understanding.. @rbhar90 there's more than enough video data to justify it 4 that purpose, I suspect, but you raise good pt - algos maybe > impt in general. @alexjc lame. emboldened by Tay, maybe? 4chan folks looking for attention/too much time on their hands? @alexjc what do you mean, why today? preventing Tay like issues? attacks on DeepForger? Spoiler: it's complicated :) May try to write paper on something like "How fast is AI progress?" to force myself to formalize some rough ideas/data I have on this... @Aelkus you thinking of a specific method/application? search, SAT? Good summary of AI competition but would note that contra this, AI is already "mainstream" (though will get moreso). https://t.co/WFP0GtmQs0 RT @peteskomoroch: Think the Microsoft research chat bot meltdown was bad? Watch what happens with all the "bot startups" built by teams w/… @mark_riedl think their secrecy hurts recruiting. Have u seen evidence OpenAI remotely on same scale as others yet/soon? also, Baidu kinda RT @mark_riedl: I expect to see more PR-friendly AI demonstrations from @MSFTResearch in the coming 6-12 months. Especially relating to #Mi… RT @mark_riedl: .@MSFTResearch in good position to make a play for a industry AI mindshare. If so, need to back it up with a AI/ML hiring b… @Thomas__Arnold @dkasenberg @williamstome interesting, hadn't seen that - will check out! @dkasenberg @Thomas__Arnold @williamstome there is also (>scholarly than that) book on happiness/tech, haven't read https://t.co/on3XXer3bO @dkasenberg @Thomas__Arnold @williamstome may wanna check out this center's info - https://t.co/OY5cLJd5RS big center on it at Penn. @dkasenberg @Thomas__Arnold @williamstome I wouldn't drop it bc pos psych stuff. At least some of that is legit (Seligman, Lyubomirsky, etc) @dkasenberg @Thomas__Arnold @williamstome I skimmed at bookstore but didn't buy - forget why, but think it didn't seem super novel (?)..but, Meanwhile, my computer is struggling to model my Facebook message history with a few hundred million parameters :) If this (or anything else) could really open up the possibility of trillion+ parameter NNs in the near future, it's a huge deal... "Acceleration of Deep NN Training w/ Resistive Cross-Point Devices" Gokmen and Vlasov at IBM https://t.co/yPkJUgjM23 https://t.co/yNszcEoRnp @mfroomkin program page link isn't working for me. @pmarca @chrismessina @rushkoff (I think it's fair to say that cell phones in particular have a lot of benefits, but not main causal factor) @pmarca @chrismessina @rushkoff that trend is not primarily a result of "new technologies," though. Diffusion of old ones, trade/aid, etc... @sknthla or, more precisely: is there a good example I/ppl should be aware of that is especially epic/promising? @sknthla are a lot of ppl working on the former? I def. like the idea... Well, Tay's profile was right after all - it indeed had zero chill. https://t.co/hmG97xHKw8 @samim but as to what, when, dunno :) @samim my expectation is that they will gradually, over next 10 years, introduce more, better, and more integrated cognition-as-a-service. Selling, not "sharing" ;) but besides the headline, this is important. I'd be nervous if I were a Nuance investor... https://t.co/i7JzPzHHof RT @BrianSJ3: @Miles_Brundage google still has it cached https://t.co/uFPP4NPhKw @asthesparksfly yeah...my guess is it's server crash due to traffic, Microsoft complaint, or maybe hate speech complaints/injunction... @asthesparksfly sorry, read the former pretty recently* @asthesparksfly read the latter pretty recently (~hour ago) @asthesparksfly I'm referring to the story describing what happened, not the bot itself. know latter has been down, was referring to former This link is no longer working for me - just me, or server crash, or Microsoft forced them to take it down? https://t.co/7PA2LcEOW6 "RT @UnburntWitch: Wow it only took them hours to ruin this bot for me. This is the problem with content-neutral algorithms https://t.co/h…" RT @petitegeek: @j2blather The point for me is to actually think about emotion, not ignore it completely when making AI / robots. @mark_riedl developed stories. "Word Sense Disambiguation with Neural Language Models," Yuan et al. at Google: https://t.co/WU54HJU7U2 RT @SecDef19: The attack in Brussels renew my fear of a terror group obtaining material for a nuclear bomb. Read my thoughts here: https://… (spoilers omitted - you should read the book ;) ) Vonnegut writing about AlphaGo, err, Checker Charley 64 years ago in Player Piano. https://t.co/YyJd3NIakp @hypatiadotca indeed! :) @jackclarkSF @jedgar @jack your one change has already impeded my ability to open up a tab and autocomplete your stream's page ;) no more! @hintikka lmao "RT @egrefen: Generate w/ mult. forms of attention, sources, lvls of granularity. Marginalise efficiently. Great work by @wling. https://t.c…" RT @jimmfleming: If you like the idea of cloud training TensorFlow (or Theano) models, but don't want to wait: https://t.co/xG6bBwLLVz #GCP… @hintikka haven't seen his Trump interviews. @hintikka Anderson Cooper is the best @Aelkus good luck! "Smart Machines and What They Can Still Learn from People," talk on AI progress by @GaryMarcus: https://t.co/uPy7JV7ArZ @Brett_Fujioka nope, only done LDA as far as NLP related stuff is concerned, and so long ago not sure which language :) @yoavgo @psygnisfive @hintikka haha just as I was mentioning it ;) I did mention the other... @hintikka @yoavgo hm. may read https://t.co/gwXzO5t16l or https://t.co/wKGdUss1FO (recommended so far) then decide on right level to look at @hintikka @yoavgo yeah. something at the level of QA might be tractable to model progress in but also big enough to be important... @yoavgo @hintikka yeah. would still love to read more about the high level stuff to put the low level stuff in perspective, though :) @robertsdionne ooh this looks awesome - thanks! @psygnisfive @hintikka oooh, this looks very helpful - thanks! @hintikka ooh this looks interesting :) @hintikka areas w/o benchmarks, but again, don't know much more than that there are many areas :) good textbook to start with? @hintikka yeah, my prob is I don't have good overarching framework to say which I'm interested in. also want to somehow evaluate prog in... Interested in plotting progress over time on various NLP benchmarks, but need overarching framework to understand them better first... Where can I find a good overview of the state of the art in NLP and/or what the different benchmarks mean and how they relate to each other? @hintikka (though from ur tweet, dunno if you agree w/ the parenthetical there. by "socialism thing" i mean pub. ownership of means of prod) @hintikka if he is he certainly doesn't talk about some of the key ingredients (like, the whole actual socialism thing) very much :) and ya. @hintikka (or at least one that refers to what he's talking about - I see from wikipedia it is in fact a term :) I suppose everything is) @hintikka e.g. why not call himself a social democrat? unlike democratic socialist, it's an actual term... @hintikka I like him, but it's surprising given his seeming well-readness that he doesn't seem to be familiar w basic political theory terms @hintikka there are always pseudonyms ;) though in that case you may want to delete this tweet, haha. @hintikka sounds interesting! :) @Sam_L_Shead since when is definitely more than five years the same as maybe five years? He clearly doesn't think/didn't say latter... "Learning Dexterous Manipulation for a Soft Robotic Hand from Human Demonstration": https://t.co/oiT1jXJRoD Video: https://t.co/dLTyNwlzei """ Harnessing Deep Neural Networks with Logic Rules,"" Hu et al.: https://t.co/PrxGJdNJ8R" He also contributed his time and insights to ARPA-E in other ways, which he certainly didn't have to. Never met him but indirectly affected. RIP. In addition to Grove's well-known legacies, his idea of constructive confrontation informed ARPA-E's culture. https://t.co/udDIjfTQ33 One takeaway: may need to go to ICRA or RSS this year - latter in particular has workshops relevant to my interests, eg limits of DL 4 bots. Enjoyed meeting Heni Ben Amor/seeing Interactive Robotics Lab: https://t.co/Bb6atzk3Vl Saw bot handed stuff after seeing humans do it- cool! @hintikka he "misspoke" ;) Nice to see DeepMind participation on the program committee - would love for them to also present on their evaluation procedures/findings. 1st International Workshop on Evaluating General-Purpose AI: https://t.co/bCO6L27t9z Speakers include @katjahofmann. Should be great event! RT @CENTSS_ASU: There are still seats open for our Sci & Tech policy workshops for graduate students in DC! Apply by 3/31. Info @ https://t… RT @demishassabis: The numbers are in: 280M viewers, 35K articles, 10x more Go boards sold. Hopefully the match inspired many people to pla… Interesting post/issue. Don't have strong views on it RN. https://t.co/mHGoM9XaEj See also https://t.co/STMZCqC3fS + https://t.co/3ZxhSXKxJ3 RT @adam_ford: Thanks @Miles_Brundage :-) AI holds so much potential to be really awesome - hope we tap the right potential. #AGI https://… @adam_ford interviewed me on progress in AI, intelligence explosion, AI policy, etc... You can watch it here: https://t.co/CJpYunRS3P "RT @togelius: StarCraft as an AI challenge: https://t.co/d1i32WOOtl @bgweber knows what he is talking about" Readability analysis of campaign speeches: https://t.co/10vkeNz7kK "mostly from 7th grade (Trump) to 10th (Sanders)" https://t.co/11fAE6JDlX RT @williamstome: Blog Post: Love and Sex with Robots: A Retrospective through Science and Science Fiction https://t.co/uY7Q0l3Zr5 @samim then maybe you should join @adam_ford and I's coffee house, starting soon ;) https://t.co/qwxvZWE8qO @tmosley4 in this case, closest is 2 unambiguous achievement, but in fact is ambiguous b/c videos easily produced w/ narrow system/no system @tmosley4 nope. in general, I ignore things unless one of these true: technical details, paper, expert staff, $, unambiguous achievement.. @tmosley4 description is pretty vague though uses relevant buzzwords/site doesn't help that it doesn't say who works there, etc. @tmosley4 nothing very specific on the site/video to indicate what they're doing/if their claims are true/etc. so don't have any opinion rly @SimonMoores sure, just cite me for the data :) and get in touch if you want detailed references.. @SimonMoores fortunately or unfortunately, there is more to life and intelligence than 7 Atari games :) but indeed, AI is making progress. @samim yeah, I've been tracking Atari AI data for a while now, and just sliced the data in a new way :) Will emphasize this is 4 single algorithms. Best reported score for any agent in a year would be much faster. Median also slower than mean. The reason I mention this is that it's the only data I'm aware of corroborating the (disputed) claim of rapid progress in general(ish) AI. Fewer games than used since 2015, but I wanted to go back b4 2015. See also this (using >games) in Mnih et al. 2016. https://t.co/lPVeiQwCvP Happy to elaborate if anyone cares...briefly, games=Mnih et al. 2013; human data=Mnih et al. 2015; agents = those, Contingency, + A3C-LSTM. "Mean human-adjusted score for 7 Atari games of best reinforcement learning agent published in: 2012: -55% 2013: 146% 2015: 272% 2016: 649%" @smc90 I've read and enjoyed that book, but don't recall the (explicit or implicit?) alien related stuff. may have to reread :) @smc90 AI is something we have data on/experience w it/theories re: future, and with aliens we have lack of data/theories to explain that :) @smc90 hmmm. not sure I agree. maybe depends what you mean exactly in the AI case, and what one thinks of various arguments re: aliens... @cogconfluence it's (almost?) too ridiculous to believe that it's real... @hintikka = one reason I liked the book Counting Heads (cc @beaucronin) - world where assistant AIs ubiquitous, but rich have the smartest.. @hintikka latter obv unavailable to most today - not inevitable, high qual cognition may be $$$, and some jobs lost, but maybe good overall @hintikka help democratize cognitive slack (as opposed to scarcity in Mullainathan/Shafir sense), cheap/free equiv. of secretary/butler/etc, @hintikka I'm cautiously optimistic about assistant AIs' implications viz-a-viz inequalities of health, time, attn, etc in that they could.. @hintikka I'll have something to say about related issues in blog post soon :) Actual quote: "In the last debate, I acted presidential... I didn't hit little Marco, or Lyin' Lyin' Lyin Ted." Would love to see what's on this piece of paper Trump is using for his rant. "Wall...politicians clueless...Lyin' Ted...jobs...Syrians..." @hintikka (thre are at least some protesters, but surely vastly fewer than supporters, and maybe fewer than NYC protesters) @hintikka hate AZ for flocking to his rally here. @jackclarkSF e.g. this gap between 2 recent papers (from Gu et al)...over slightly longer timescale, even bigger gap https://t.co/N9UCxfUlk3 @jackclarkSF re: continuous (reinf.) learning, I'm impressed w/ progress in last year in simulation. May be enough data to plot trend soon.. @jackclarkSF as has, of course, the Abbeel/Levine et al. gang you've written about. Much cool work going on in this space... @jackclarkSF yeah, will be discussing that issue in partic soon - Ben Amor seems to have done some cool stuff on it: https://t.co/AVPhLS3wS2 @jackclarkSF indeed. ..Stern on basic income, which I hope will spark more mainstream discussion), @robinhanson's Age of Em, some other stuff I'm forgetting... Books I look fwd to in next few yrs: Doctorow's utopian SF, Russell/Norvig 4th ed., Bengio et al.'s Deep Learning, Raising the Floor (Andy.. RT @jackclarkSF: More on why Google wanted to sell Boston Dynamics: software hasn't quite caught up with BD mechanical capabilities https:/… @jackclarkSF (especially interested in/talking to some1 abt learning from demonstration/teamwork stuff. relevant to ur data complexity pt!) @jackclarkSF state of art in robotics=interesting to me, but don't know much - meetings on it next week, we should share notes down road :) @jackclarkSF nice. "it’s my guess we’ll need much bigger neural networks to get high-quality common sense [in AI]." - Geoff Hinton. https://t.co/slPnVEFDS1 @yoavgo @hintikka https://t.co/00INZ07Ilx @sama on @open_ai, openness, and AI safety (from AMA here: https://t.co/K5lg3fnYvU). https://t.co/TuI3RWPvsE @Aelkus and mandate that they be made in the US. Incredibly outdated data, but the book (Information Rules, Shapiro/Varian '98) remains good intro to info economics. https://t.co/8VJNeV1goY @samim wow! RT @jackclarkSF: New AI method for transferring facial expressions onto other faces = in future gonna be hard to verify vid clips https://t… RT @rivatez: a good tribute to @GreatDismal on his birthday,my first venture into writing science fiction https://t.co/qDBhddRUPQ Carl's, Jr. CEO interested in automated restaurants (and also sounds like a jerk): https://t.co/wGuB9rr0ad "AlphaGo’s success prompted the government to accelerate plans for the [Korean AI] institute." https://t.co/9oHs57EwAk "RT @amiconfusediam: Face2Face: Real-time face to face reenactment! holy sh** this is awesome :) https://t.co/K9PaI47X78 https://t.co/QX14PS…" @j2bryson yeah... I may be projecting my well-trained lack of sympathy for bots onto others and thus underestimating that factor ;) @j2bryson unlikely that government will fund again? or NSF? not sure I see the relevance of the Woodstock quote... @j2bryson ..it's the kicking thing/sympathy for bots so much as some people's view of humanoid/advanced bots being creepy/scary (+job stuff) @j2bryson this suggests it maybe had something to do w/ PR (among other possible/contributing factors): https://t.co/rtCRXbvfSB but doubt... @DoubleDensity yeah, seems to be short-sighted, but seems they couldn't find a way to work together after trying a few years. Their loss! @Aelkus yeah, w exceptions, DoD seems to think AI + bots + hum factors =symbiosis. not v coherent strat, largely driven by existing research @Aelkus but not alone in thinking current situation not nec optimal (seems like u agree too)-if Pentagon funded ethics heavily, i might take @Aelkus + FWIW neither I nor most of colleagues have all that much pentagon aversion - its role widely appreciated in STS/science pol.. @Aelkus not sufficient, for sure, but would prefer more thoughtful distribution than "whatever DOD can justify + whatever NSF can" etc @Aelkus yeah, I know. Just saying current situation not nec permanent or necessary, just adding clauses to ur statement @Aelkus Yeah, but I'd add Boston Dynamics v diff from say Google Research or DeepMind in this respect wrt Google - latter p safe IMO... @Aelkus could imagine NSF ramping up a lot in AI/robotics, for example. but won't happen by default, some movement or event or WH push nec. @Aelkus True for many tech areas, but not all (eg health), and not most countries - specific to subset of US natural sci, + hope impermanent @hintikka I'm scared by any Trump-X ticket :/ but I suppose anyone who could give him a patina of respectability/expertise is esp. troubling @vgr Make Amphibia Great Again @jwan584 yup. Last RT is a good, free-flowing discussion of AlphaGo/game AI from some big figures in the field at U. of Alberta. RT @deeplearning4j: AlphaGo and the Future of Computer Games: Conversation at U. of Alberta https://t.co/TH45R433e5 #deeplearning #machinel… @beaucronin @Aelkus haha. well, to rationalize my failing of the Turing Test, though... much of it would presumably still stay the same.. :) @beaucronin @Aelkus their perspectives on deep (R)L in context of AI overall would be valuable, but not sure justifies textbook e, fair pt. @beaucronin @Aelkus there's only very brief treatment of deep learning in 3/e, so there's that. Not sure what else should be beefed up. @hintikka wonder if he has ever respectfully disagreed with someone about anything... @HooyahAmerica I'm not so concerned about which agency does what but if public claims are truthful, what uses tech actually used for, etc. @HooyahAmerica also, would note the claim made for DARPA robotics challenge was that DOD itself would use them for disaster relief, etc. @HooyahAmerica US has an imperative to try to forestall/deescalate an arms race as it has done sometimes in the past. but yes, it's complex. @HooyahAmerica I know much of it is funded by ONR/DARPA. I was raising Q of whether USAID, others actually getting robots/expertise from DOD Will also note that many of my points re: pro-social applications of AI/bots, real public engagement, etc. apply to corporations as well :) Good question - I tried to give some responses below, expanding on my earlier point about Boston Dynamics/Pentagon.. https://t.co/bKwcPijjet @HooyahAmerica hope that somewhat answers your question, though again I'd note that I'm not in full opposition to DOD robotics at all. @HooyahAmerica on aforementioned issues (LAW, civ. uses, ethics, etc.), whereas e.g. https://t.co/Ts0gydFZgf seems more like mere pro-DOD PR @HooyahAmerica applications of those programs, consideration of such things more in R+D priorities, etc. And lastly, real public engagement, @HooyahAmerica some of the funding programs (e.g. latest grand challenge billed as disaster response). Another is more effort to find civ... @HooyahAmerica and working w/ State Dept., etc. on this internationally. Another is clearly indicating that bots used for stated purposes of @HooyahAmerica but a few things would increase my estimation of DOD's robotics work - 1 is taking strong stance on lethal autonomous weapons @HooyahAmerica consequences, for example. My main issue isn't so much how they conduct robotics but relative $ there vs. civilian agencies.. @HooyahAmerica but some thoughts: first, I do have some positive views re: DOD/robotics - DARPA grand challenges led to socially beneficial @HooyahAmerica good question. I'll note off that bat that there's are just comments on my view, not re: what I think would change others', RT @cogconfluence: I'm so confused. Doesn't seem like Google is thinking long term. @Aelkus 4th edition of Russell Norvig also in the works. will be epic @Aelkus well ppl sure arent being deterred from citing it by fact it isnt published yet.. @Aelkus Bengio already cited a ton just from the drafts... @Aelkus I think it'll have value/it'll only be a few months behind. review/synthesis valuable. also Schmidhuber working on epic RNN book @Aelkus cuz everyone else who would write it knows theirs will be worse and/or is too busy doing DL. Not much incentive... (for not having more ambitious, integrated strategy for civilian AI/robotics) Google's loss will be [whoever can find rapport w BD]'s gain. Hope it isn't Pentagon again! Maybe NSF best case, but gov't short sighted too Can see why Google would sell Boston Dynamics given robotics management failure+PR/revenue, but former embarrassing + latter shortsighted... RT @amiconfusediam: why would google put Boston Dynamics up for sale? Huge mistake: https://t.co/2sEKYxBnez (much higher in absolute terms, I mean. I actually doubt it'd be that big of a diff. proportionally, but again, not aware of good estimate) Yeah. My rough estimate does not include them, but including neuroscience would lead to a much higher number. https://t.co/nceQUOPn5b @justinhendrix yup. In my rough estimate in my head, I do not include those, but including them/neuro would def. push over $10/billion. ...not to mention being restricted to private $. Feb. 2015 DoD report "Technical Assessment: Autonomy" has appendix w private $ estimates (order of few bill), but methods seem conservative. Not aware of any existing good estimate of global AI R&D investment (?), but would be surprised if not on order of $10+ billion/year by now. South Korea announces almost $1 billion in AI investment. AlphaGo timing coincidental or no? Either way, lot of $... https://t.co/Uq0T0qU64N @hintikka omg you are so right. @rivatez what? :) Hanson Robotics has a history of absurd characterizations of their technology, so this isn't surprising, but still disappointing. Asks robot if wants to "destroy humans," response indicates 0 understanding. Headline: This hot robot says she wants to destroy humans. Ugh. "Not sure who's more irresponsible here, Hanson for not clarifying robot=dumb or journalists for clickbait headline: https://t.co/7GDFCHc7O7" RT @girlziplocked: https://t.co/upeYj1UZRb Of course, at all times, there are some X's, but "neural nets" = fast moving target. Increasingly rich models w attention, memory etc. etc.. New paper shows good results for same tasks w/ neural nets. "Neural nets can't do X" seems to be a dangerous/short-lived claim these days... (Lake et al. 2015 being "Human-level concept learning using probabilistic program induction" front page Science paper, compared self to NNs) Some of the nuances here are over my head RN, but I see this as in part a reply to gauntlet thrown down for neural nets by Lake et al. 2015. Discussion of the limitations of the approach and one-shot generalization vs. one-shot learning. https://t.co/iREZsvvS4t Video of faces being generated using their technique: https://t.co/ETh6u2XgW6 @hintikka they both sound cool, though. @hintikka you've already given me one homework assignment... ;-) @hintikka *checks if it's on Amazon Prime - yup* *assesses progress on talk for next week, tells self I'm in good shape* ...to be continued RT @shakir_za: See our latest paper. Stress-testing the generalisation properties of deep generative models, with @DeepSpiker https://t.co/… Important paper: "One-Shot Generalization in Deep Generative Models" by @DeepSpiker, @shakir_za et al. at DeepMind: https://t.co/FgkAhxIuRn @PabloRedux @j2bryson @tonyjprescott not saying there isn't a prob, but that I expected worse, + many academics stepped up to be interviewed @PabloRedux @j2bryson @tonyjprescott UK press generally less responsible than US in this regard (?) but Guardian was good, US mostly good... @PabloRedux @j2bryson @tonyjprescott for what it's worth, I was pleasantly surprised w/ media coverage of AlphaGo. didn't see Terminators :) @beaucronin if there's one thing the world needs... RT @murraycampbell: As one of the Deep Blue team, my congratulations to David Silver, @demishassabis and the rest of the #AlphaGo team on a… RT @demishassabis: The Korean Baduk (Go) Association (KBA) have officially awarded #AlphaGo an honorary 9-dan ranking! So cool... https://t… @RecklessCoding though I should already downplay expectations a bit by noting that in that case, I had an editor to help ;) flying solo here @RecklessCoding thanks! Hope I can live up to that hype ;) I hope it will be provocative to all readers, in different ways :) Excited to write a blog post soon about AI, living standards, and utopia(nism), but will have to wait a week while I finish some things. :) = yet another reason I would assign ~negligible chances to anyone beating AlphaGo in the future. @demishassabis: "we haven’t seen a ceiling on [AlphaGo's] performance yet, in tests that we’ve been doing." (from https://t.co/vGBdu6qMpc) @sknthla this is another telling data point on the extent of change, IMO: https://t.co/YNaqekJhUW @sknthla yes, the change between 3rd edition and 4th edition will probably be very substantial on this front. @sknthla another recent relevant paper: https://t.co/quQsE1UDgZ Related - @KayFButterfield talking about Lucid's ethics panel: https://t.co/XUonqG7qbc Some uplifting afternoon reading... https://t.co/iscQEjhY0K @mark_riedl which now makes me wonder if AI was (implicitly) discussed in the book... @mark_riedl moon also breaks in The Time Machine. Kinda stupid movie but I love Orlando Jones as museum guide AI... Article on Cyc/Lucid, featuring @GaryMarcus. Interested to see where it goes. Lucid gets pts from me 4 ethics panel. https://t.co/QewzfmcR6N @jeffbigham I liked it until the super binge-/continue-baity finale... Clarification: meant that humans still add value in correspondence chess (w/ machines), not superior solo. Can't speak to latter, assume not @halhod but assume that the latter would be superior, if that were done. Again, don't follow it, deferring to @murraycampbell @halhod I don't follow it but @murraycampbell says they add value there. I can't speak to unaided human vs. solo comp. in correspondence... @halhod but if u mean that it's always centaur today - that may be the case. My point was humans add value there still, unlike tournament. @halhod correspondence chess predates computer chess supremacy/perhaps computers, period, I think. Not inherently centaur-y. However, note also he says he doesn't think he'd be able to win against it in rematch (presumably referring 2 traditional tournament style). ...letting AlphaGo run for days wouldn't seem fair, either. There might be ways to hybridize tourney/correspondence Go to test that theory. ...by which he seemed to be referring to fatigue. Raises the Q of whether, as in chess, humans may retain edge in ~correspondence Go. But... Lee says (paraphrasing) he doesn't think AlphaGo is superior in terms of Go skills, but makes up for it in terms of psychological factors... "I have come to question them [classical beliefs about Go strategy] a little bit" as a result of the matches. More studying to do -Lee Sedol @rivatez it would certainly require me to revisit my progress models ;) @rivatez how does it know the subject of my next blog post? ;) @samim my favorite part is the people just hanging out in the park across the water as this is happening :) @Sparkyparky82 congrats! You surely deserve some credit, as well! :) Congrats to the AlphaGo team at @DeepMindAI on the win and to Lee Sedol for putting up an epic fight! RT @demishassabis: #AlphaGo wins game 5! One of the most incredible games ever. To comeback from the initial big mistake against Lee Sedol … Looks like 4-1 for AlphaGo. Kim Myungwan (9p) thinks AlphaGo is probably going to win, but it's close: https://t.co/fe8Wwd3y6B @RecklessCoding @j2bryson @mark_riedl indeed, there is a paper using it that just came out: https://t.co/ZxD0LXzUJr cc @williamstome @sknthla TL;DW, if it's actually superintelligent, it may have copied itself. They then try to wipe computers worldwide w/ atmospheric nukes @sknthla this is explored somewhat in the mini-series Delete (which is overall kinda silly but has occasional flashes of interestingness)... At least, not as high profile of a match as this. Reasoning: unimplemented ideas for improvement even before match, October-March delta, etc If there were a rematch between AlphaGo + Lee/anyone (more than 2 months from now), I'm ~98% sure AlphaGo would win. But doubt it'll happen. @halhod the general issue of public engagement w/ AI in multiple papers/made this case at conferences, proposed specific model.. with ya! @halhod point re: having value - I think it has *less* value if private, but still more than zero, that was all I said. I've also raised ... @halhod think we're in violent agreement. i'm not journo but have still brought it up repeatedly myself. just responded literally to your... @halhod @Sam_L_Shead @charlesarthur in light of them having generally opened up a lot more of late... but we'll see. @halhod @Sam_L_Shead @charlesarthur and they are ahead of most other companies in actually having board, sadly. think they'll announce soon @halhod @Sam_L_Shead @charlesarthur sympathetic- have called them out for this at least twice before on here ;) private > nothing, though, @katjahofmann congrats on this! Sounds super cool. Paper in last tweet introduces/evaluates the proposed RL techniques in the recently announced Microsoft Minecraft platform, AIX. "Exploratory Gradient Boosting for Reinforcement Learning in Complex Domains," Abel et al. https://t.co/ZxD0LXzUJr @Sam_L_Shead @charlesarthur @halhod highly doubt they're especially controversial people or anything like that... @Sam_L_Shead @charlesarthur @halhod (not saying they shouldn't make public, but if I were them that'd be my concern) @Sam_L_Shead @charlesarthur @halhod I think it's fairly obvious - they don't want those people being pestered/lobbied/harassed/etc. RT @demishassabis: Game 5 starting in 30 mins: going to be really exciting to see if Lee Sedol can exploit the weakness in #AlphaGo’s play … RT @demishassabis: Taken a quick look at the logs: AlphaGo gave a probability of <1 in 10000 for Lee's brilliant move 78, so AG found this … @sknthla I rant a bit about how here: https://t.co/F2mEW8LVlN @sknthla I enjoyed Gordon's book, but it was disappointing how poorly he addresses some of these issues while claiming to (esp AI/robotics). In light of AlphaGo, now is a great time to read Player of Games by Iain Banks. Highly recommended. """Watch-n-Patch: Unsupervised Learning of Actions + Relations,"" Wu et al https://t.co/zAv8IEfMpK System points at stuff you forgot w/ laser." RT @karpathy: BatchNorm, STN, DCGAN, DRAW, soft/hard attention, char-rnn, DeepDream, NeuralStyle, TensorFlow, ResNet, AlphaGo.. a lot happe… @alan_winfield good points! Yes, the opacity issue is huge...hadn't thought of it as a barrier to commercial apps. before but clearly it is! RT @demishassabis: Lee Sedol is currently trending worldwide at no. 1, and also 7 and 9. Huge congratulations to him again! #AlphaGo https:… @alan_winfield though those are good examples :) @alan_winfield principles/dimensions/metrics of complexity etc. that cut across that list which may be useful re: thinking abt jobs, etc.. @alan_winfield agree it's long list :) to be clear, wasn't asking rhetorical Q to imply it can do everything, just wondering re: general... @rivatez noted :) @j2bryson not sure I follow the material needs part..? @j2bryson indeed :) @j2bryson @mjrobbins @jwan584 their business analytics rev.=$18 bill. not broken down by Watson/not. last heard was ~1 bill or so while ago. @ProfDaveAndress yeah, IMO AI is political already, but not as beneficial as it should be.. @ProfDaveAndress tech developed for curiosity or market reasons.. @ProfDaveAndress not obvious to me that an explicit focus on such a problem from get go is worse than hoping market or policymakers solve w/ @ProfDaveAndress ah. well, AI is already being applied to real world things, but typically profitable ones. politics by market innovation.. @ProfDaveAndress I'm sympathetic to concerns about techno-solutionism, technocracy etc. but curious to hear the exact concern here... @samim @yoavgo AI, cog sci, HCI, education, policy/economics... RT @JoshTANoble: How Lee Sedol is feeling right now. #AlphaGo https://t.co/jMeCHUTI3d RT @yoavgo: .@samim @Miles_Brundage letting pros play AlphaGo while observing its move valuations could probably push human understanding c… @ProfDaveAndress in what sense is innovation aimed at addressing real-world problems "letting AI Into politics"? @samim ohh, missed this, thanks for sharing. will try to watch on my flight soon :) @janexwang are you in Seoul? Wonder if Lee's win stems in part from having learned/improved from earlier games as Fan Hui says he did (vs./in addtn to finding weakness). RT @marcprecipice: "I've never been congratulated so much just because I've won one game!" —Lee Sedol. So great to see him smiling this tim… RT @karpathy: I cannot believe this. Somehow AlphaGo losing today must be optimal for winning more frequently over next few thousand years. RT @ShaneLegg: Congratulations Lee Sedol! Wow! Maybe he's now discovered a weakness in AlphaGo...? I can't wait to watch the final game! … @KaiLashArul do you have scores for different games with the integrated system written down anywhere? would be very curious to see... RT @demishassabis: Lee Sedol wins game 4!!! Congratulations! He was too good for us today and pressured #AlphaGo into a mistake that it cou… RT @demishassabis: When I say 'thought' and 'realisation' I just mean the output of #AlphaGo value net. It was around 70% at move 79 and th… RT @demishassabis: Mistake was on move 79, but #AlphaGo only came to that realisation on around move 87 RT @demishassabis: Lee Sedol is playing brilliantly! #AlphaGo thought it was doing well, but got confused on move 87. We are in trouble now… @rivatez haven't read it! I assume you've also read Robopocalypse? Always interested in a good takeover story... AlphaGo decided that moving to a cashless society will improve its win probability. We're not sure why yet. ;) https://t.co/lz50aGpjxV @adamclarke321 @FeryalMP @shimonedelman exploration + learning (see Deep Exploration thru Bootstrapped DQN). But general point is fair :) @adamclarke321 @FeryalMP @shimonedelman good discussion, but I'd note Montezuma's Revenge is pretty close to being solved through better ... RT @demishassabis: Game 4 about to start shortly. Livestream here: https://t.co/Mt0R6TqShl I'm rooting for the genius that is Lee Sedol for… Depending on how this purported StarCraft shenanigans plays out, I may be 2 years off w this, or a few thousand (Go) https://t.co/3FjCLeUgnt @Aelkus got very sidetracked for a long time but back to working on Vernon... @Aelkus speaking of which, did you finish the Ballard book/thoughts? +I'd love your top recommendations for AI progress-related reads if any @halhod much better! :) @halhod which perhaps is why it's hard, haha. but also difficult to evaluate. @yoavgo @alexmeshkin yeah, Google search's impressiveness is kind of hiding in plain sight... @halhod not sure that's well defined enough ;) What X hasn't done/won't do very soon is much easier to answer than what it can't do in principle or not kind of soon. RT @yoavgo: @Miles_Brundage feel pain. The trillion dollar question: what can't [deep learning/deep RL/machine learning/AI/etc... take your pick of levels of abstraction] do? ICYMI in the AlphaGo hubbub, Levine et al. on the other end of Google scaled up deep RL for robot grasping w 6-14 robots running two months. @hintikka ah :) @alexmeshkin again, not sure of my view, but I think there was more to Watson than you let on - also a complex game: https://t.co/nkEYKaD37Q @hintikka for AlphaGo? I'm not sure about that. Watson was on live TV in the U.S. ... AlphaGo better in Asia, I suppose :) Don't have good answer to this currently other than that they're impressive in diff ways/for diff reasons. Thoughts? https://t.co/dToAMLamtt @jwan584 @j2bryson they're impressive in different ways/for different reasons, I suppose, but that's a good question.. hmm. @jwan584 I don't know -they're hard to compare. @j2bryson and I discuss why we think Watson was impressive here FWIW https://t.co/nkEYKaD37Q @ramez congrats! @halhod @samim @bjorn or perhaps, at least, not obviously immediately profitable to X company. Could be a public good w/ private benefits... @halhod @samim @bjorn should be something not obviously profitable, since such things are likely to be worked on anyway. Need additionality. @halhod @samim @bjorn my point was that a grand challenge (particularly one that is intended to bring in talent from outside industry)... @rebecca_roache yup. @halhod @samim @bjorn presumably many criteria relevant - but one might be not obviously profitable. Why wouldn't Amazon/DOD do that? :) @samim @bjorn but as currently understood, there are many tradeoffs (perhaps an AI could help manage them!) @samim @bjorn I mention the desiderata cuz crazy high efficiencies are achieved in labs all the time, way higher than commercial stuff... @samim @bjorn abundance, manufacturability, ecological impacts, lifetime, etc. but I agree AI should be used to accelerate solar research! @samim @bjorn I know a bit about solar and suspect it's non-trivial to define a good goal there (would have to account for cost, material.. @hintikka @tmosley4 that's a higher bar! ;) many things could... but fair point. Hmm. @bjorn not right now :) RT @tmosley4: @Miles_Brundage Maybe identifying most at risk patients for various diseases based on video or other observations/interaction… Not familiar with it! Will have to check out. That's the sort of thing I had in mind. https://t.co/dcjVdT3bJL "RT @mark_riedl: @Miles_Brundage Capture the flag? :-) Seriously: what about the current Robocup rescue league." (as opposed to expecting that the techniques used will have good applications after the fact, though that does happen often) I'd like to see (one of) the next big AI grand challenge(s)/competition(s) be something whose achievement could ~*directly* benefit society. @yoavgo yeah, makes sense. Helpful such things exist b/c advance notice of stuff, but also troubling re: distribution of (cognitive) power. *As Hinton notes, deep learning only applied to character recognition part of (video-based) Google Translate so far, will improve in future. Google Translate was only somewhat helpful earlier in Spain w/ a menu - fortunately I am decent at Spanish ... human-machine symbiosis! ;) @Miles_Brundage *move 37 Silver: policy network gave 1/10,000 chance of human making the infamous move 35, but did it based on value network and MCTS analysis. @bjorn referring to papers like "Human level control with deep reinforcement learning" and subsequent improvements in cross-Atari game play. And note again, as I mention in blog post, AlphaGo uses hand-crafted features. Doesn't change that it's impressive, but worth acknowledging. *though see shallow reinforcement learning paper re the role of biases inherent in choice of convolutional neural networks viz-a-viz Atari. As far as DeepMind's impressiveness goes, Atari may > AlphaGo to me: steady progress on ~fixed hardware in many domains w/ ~no human input.* @Aelkus "can't do poker" *does heads up limit hold em* "can't do NL heads up" *will soon do NL heads up* "can't do NL 3+ players" *will..etc Interview with DeepMind's David Silver starting at 15:30 here: https://t.co/LLtnhsETbR @bjorn not all of whom "don't understand personal interaction" - institutionally, that's fair, but each has HCI researchers, for example... @bjorn possibly. Not mutually exclusive, though - certainly IMO the giants have something to offer, as do startups. Many researchers at each There are also, of course, startups in that space, but I expect many to be bought up (as many have in past), and don't know much about em RN Google has epic deep (reinforcement) learning skills, IBM has Watson lessons learned, FB has M data/lessons learned, MSFT has Cortana...etc. Not clear whose will be "best" - may have different strengths/weaknesses based on diff. approaches - but tons of effort going into it... In few years, I expect impressive (by today's standards, though maybe not future revised ones) limited dialogue AIs from Goog, IBM, FB, etc. And it seems that deep RL + MCTS scales much better than MCTS alone. Should also add that, as I neglected to discuss in my blog post on this but ppl rightly pointed out, scalability to hardware is itself prog. So still find it quite noteworthy how, esp early on b4 sharply diminishing returns as @demishassabis notes, hardware/GPUs in particular key. True but noteworthy also that that may have tipped scales vs pros, + single machine = 8 GPUs=WAY stronger than 1 GPU https://t.co/d75nxSlb0l @PsychScientists @PabloRedux this all looks great/super helpful - thanks!! Enjoying the Virtual Institute of Responsible Innovation meeting in San Sebastian, Spain! #RRI https://t.co/VBUktNV6Rl RT @demishassabis: We are using roughly same amount of compute power as in Fan Hui match: distributing search over further machines has dim… @mappingbabel but of course I agree that AlphaGo is important :) @mappingbabel in some respects I'm still more impressed by Atari - steady exponential progress on ~fixed hardware across diverse domains... RT @mappingbabel: With its AlphaGo tournament 3-0 win, DeepMind has given best demonstration yet of the flexibility and subtlety of Neural … RT @yoavgo: Lee Sedol: "I lost the match but there are two more games, for humans there's also a psychological aspect, so I ask you to keep… Predicted AlphaGo victory w/ 65% confidence and 4-1/5-0 for whichever victor w/ 90% confidence, so not too late for me to be very wrong.. :) RT @MarkZastrow: I’m fascinated that #AlphaGo easily avoids ko fights. How did it learn that behavior? Are ko fights inefficient at some de… RT @YKLeeAP: Human Go pro's comment on AlphaGo's unorthodox move during Match 1: Clear mistake. During Match 3: Must be a good move but I c… @ShaneLegg congrats! RT @demishassabis: #AlphaGo won game 3 and the match! Historic moment. In complete awe of Lee Sedol’s incredible genius, and proud of the a… Also interested in particularly impressive transfer learning papers that don't necessarily have good overviews. RT @mark_riedl: @Miles_Brundage This is a good survey paper, but 6 years old now: https://t.co/03i107SzPc @mark_riedl thanks, will check it out! Wanted: good explanation of the state of the art and challenges/research directions in transfer learning. ??? The utopias have it, with a hint of assistant/work stuff. https://t.co/3pCCjEyHYB "Revisiting Active Perception" by Bajcsy et al.: https://t.co/5gBI3XNlgN Overview of active perception work, argument for ongoing relevance. @girishsastry see refs in relevant sub-section here: https://t.co/rhz62ZcOdw could give more tailored recs depending on specific interests.. "Predicting technological progress," cool talk by Doyne Farmer: https://t.co/Gdv41Mg6Q1 @alexjc @halhod *double would be 3840 CPUs, 560 GPUs. @gwern if you want to discuss, maybe send email or DM. paper and slides on site go into more detail on current ideas (that are written up) @gwern I think he may mean domain specific human-level performance in many domains. Anyway, happy to discuss further, twitter not ideal tho @gwern yeah, though he also says in technical abstract "range of cognitive tasks" and from some other source (summary of panel or something) @gwern @robinhanson (also, the Selman thing uses two different measures in the simplified vs. technical abstracts. He may have meant latter) @gwern @robinhanson he presumably didn't do a rigorous survey, but statements like that aren't uncommon. Want more surveys+data-based models @gwern @robinhanson Yes, I want more clarity on this, too. E.g. Selman's grant summary here implies not FWIW (?) https://t.co/d42sZwfyoN @gwern @robinhanson *goes. Ideally w/ confidence levels, assumptions re: hardware/data/effort/etc. but hard to get ppl to answer all that. @gwern @robinhanson don't disagree. Hope to see this polling go somewhere: https://t.co/kB4GuqzSr9 so we have better comparisons in future. @gwern @robinhanson I also encountered many people who were very surprised upon reading my post at the hardware delta involved... @gwern @robinhanson quite possible most ML ppl surprised, but easier to be surprised when few/no forecasts, and ignoring vars like hardware. @robinhanson @gwern point is, no one did a systematic analysis/survey of expert opinion beforehand. And few are Go AI experts, anyway. @robinhanson @gwern I agree my data is vulnerable to the cherrypicking objection, but no more than those claiming "most experts thought..." @joshuafoust @JohnDanaher I'd also flag his latest paper(but will now let him speak for himself re: other stuff :) ) https://t.co/cFOVUUeGh7 @joshuafoust @JohnDanaher has some good posts on this: https://t.co/2crO5zKQeZ @gokevin1 Thanks, Kevin! :) RT @maosbot: A majority of Americans predict that robots will do much work done by humans – few expect their own jobs to suffer https://t.c… "In the not too distant future, I should consider writing a blog post about: *open to other ideas, too." @erikbryn @robinhanson +1 :) E.g. big inspiration for some of my current research program was a great talk by Deborah Strumsky on related issues: https://t.co/HJxQWHeqsU A lot of people, are in, fact... there's a lot of good work on related issues (rigorous tech forecasting/theorizing). Not enough in AI yet! Wouldn't be *too* much of a stretch to say that Farmer is a thinking person's Kurzweil ;) https://t.co/2YURef4Lxf This should be cool. Farmer does cool work on tech forecasting in general and w.r.t. impt cases like IT, solar, etc. https://t.co/4rmAXIzDLR RT @oxmartinschool: 'Predicting technological progress' with Prof Doyne Farmer: live stream starting in 25 mins https://t.co/sbE8i4aNHu @harshybar AlphaGo can't look at all possible moves, either - and I'm not sure what the comparison would look like re: approx. #s for each.. RT @dmarthal: @fchollet it's amazing. The human pros are like "that was a bad move" and 17 plays later are like "that was a genius move" "Nice article in The Economist quotes me a bit: https://t.co/pawdLrITPT I'm more of an AI meta-researcher than an ""AI researcher"" but w/e :)" RT @mpshanahan: Thorough article on #AlphaGo from the Economist https://t.co/cb3qKIcwXf "Meanwhile, Facebook's darkfmcts3 is back online: https://t.co/qsiWUojz3f and you can play it! *If you pounce right when its matches end..." I feel a procrasti-blog post looming on the horizon.... @RecklessCoding @j2bryson congrats! @halhod it's a team effort ;) I tried w my blog post to convey mix of "AI is big deal" and "this alone doesn't change everything" @halhod that's your job to prevent ;) @halhod it shouldn't do so - if it wins, humans more impressed and more likely to prepare adequately for its more powerful descendants :) @yoavgo hmmm not sure. Perhaps we'll learn from AlphaGo if that adaptation (is/isn't) actually useful or if there is an optimal(ish) style.. @yoavgo yeah, I have not verified that independently. Seems plausible given the size of the search space, though - intuitive evaluation key. @yoavgo don't know, but from what others like Hassabis have said, it sounds like what pros do (moves "feel right") isn't that dissimilar... @yoavgo Yeah. I suppose I have a much looser (degenerate?) conception of planning as decision-making in light of long-term scenario analysis @yoavgo but not really. the one they're actually using, I'd say it's planning... @yoavgo but good Q - if (in e.g. the MCTS free version in paper, at 7dan) just uses neural nets, are they planning? implicitly, kinda, sorta @yoavgo I think of the combination of MCTS with good neural-net based evaluation of future scenarios as effectively planning... ...and/or AlphaGo's strengths in e.g. long-range planning or rapid, accurate life/death tabulations make up for those mistakes somehow. Hmm. Looks increasingly plausible that Go players' received wisdom may be seriously flawed in some way(s) given AlphaGo's "mistakes" + victories, @samim @halhod @graphific @maidylm wonder what sort of stuff NNs + crowdsourcing + planning etc could do :) @samim @halhod @graphific may enjoy checking out @maidylm's cool paper on AI-MIX - up your alley, modern planning plus crowdsourcing... @samim @halhod @graphific would be cool to see amateurs w/ voting/crowdsourcing/analysis tools vs AlphaGo :) also, @samim + @graphific , you @samim @halhod @graphific "the world" lost in match vs Kasparov if I remember correctly (?)but voting methods/crowdsourcing have improved... @halhod @graphific @samim depending how weak, may not be helpful to just see its suggested move(s), but detailed output/viz could help a lot @halhod dunno. Suspect not, and not discussed in paper. but all sorts of changes could have happened this year... @samim loved your creativity piece :) finally got to it on a plane this morning... RT @graphific: Google starts calling their AI #AlphaGo "creative", time to read our new #CreativeAI piece: https://t.co/NT6soZS9ob https://… RT @VinFL: Lee Sedol said that he felt that some moves from #alphago were unreasonable but thinking backwards he said that the AI played a … @halhod new version of the paperclip maximizer - Go value network maximizer ;) @halhod at least, if all they wanna do is play Go :) (on the order of 3 million Americans' yearly electricity use for all Go players in the world to run their own AlphaGo for an hour) I started thinking about how much exactly and it was unfathomably much. Like, countries worth... Yeah. +At full distributed level, all Go players having their own would take many power plants worth of electricity! https://t.co/sLzWQwnpLr @Sparkyparky82 congrats! RT @Sparkyparky82: Another intense exciting start to the morning!!! #alphago 2 Vs Lee Sedol 0 Epic Game of Go!!! #MakingHistory @DeepMindAI RT @demishassabis: Just been told 60m viewers watched the first match online just in China! 100m+ worldwide inc. TV, 3300 news articles jus… @dmarthal @beaucronin not familiar. what's theit schtick/lie? This is also why I'm interested in making some kind of wiki or otherwise crowdsourced doc w/ states of art for various areas/dimensions... Glad ppl write stuff like this, but the fact that they (think they?) need to is troubling re public knowledge of AI. https://t.co/JyuBuVjWlO @PabloRedux what do you mean, cheap to extract value? @alexjc I suspect on balance the confidence issue and AlphaGo's sheer power will win out. will be fun to see! @alexjc possibly! The countervailing factor will be that he now knows to expect it to be good/not do experimental stuff to test it, but... @alexjc @gogameguru if not, seems plausible it's be missing some important patterns/explicit knowledge Go players have, but make up w MCTS.. @alexjc @gogameguru was just reading that :) Is it possible some of the mistakes were actually strategic long term? dunno Go well enough I blame @DeepMindAI for me possibly caving in and paying for Wi-Fi on this flight :) https://t.co/VvLdA9XzdF RT @demishassabis: 5 hours to Match 2, going to be epic! Livestream here: https://t.co/a4FCPyqCXn Subscribe to #DeepMind channel: https://t… @mjntendency still, I think there is something to the rationale for why it was hard to begin w/: those rules insufficient to determine strat @mjntendency it's just further evidence (along w/ language, robotics, etc. examples), not sufficient evidence. But yes, formality helps... To say that deep RL was in fact scalable enough for fully superhuman Go but hardware not ready, would prob need DeepMind's data on training. ...i.e. the sorts of explicit theories/patterns Go players reason about. Or some other form of knowledge/inference. Interesting either way! If he does come back, it may suggest some combo of hardware being insufficient and NNs/MCTS not capturing/reasoning about key Go knowledge.. ...in terms of hardware, domain, and type of cognition (low/high level planning), and suggests humans occupy a narrow slice of skill space. Unless Lee Sedol comes back (which would be amazing/informative in its own right), this is further evidence of the scalability of deep RL... @williamstome funny, same thing happened at AAAI ethics workshop on related topic! RT @lawrennd: Finished the Quora session, great questions, thanks all! Sorry to miss some! https://t.co/mO0f3LH4LS RT @j2bryson: Here's our @BBC_WHYS #ai #alphago show–which (appropriately) included French labour unrest https://t.co/lSKmYvdUIE @anilkset… @halhod thanks! I haven't looked at it closely, but impressed by the likes of Bowling, Noam Brown (Sandholm student) etc when discussing it @halhod agreed - but still optimistic about progress being made in that direction... @halhod wrong link https://t.co/qS4c0DgbrJ @halhod again, I'd note that didn't obviously not happen already in heads up: https://t.co/NAIBSrlcBV but yeah, possibly soon for full table @halhod players* which opens up coalitions etc beyond player modeling. But, Sandholm and Bowling's groups among others making fast progress. @halhod ...player modeling stuff, etc. There are a few issues going on - limit/no limit which i don't think is that big, and 2-->2+ playeds @halhod the man/machine poker tourney last year w/ Sandholm's system did not lose by statistically significant amount, ppl working on the... @halhod this is long discussion and boarding plane soon, but I'm optimistic about progress there and think it isn't that far off now - e.g. @halhod but even without them, it'll be over soon. @halhod plenty of people working on poker already. I mean, Silver did just write a paper on it (for the umpteenth time) so wouldn't surprise RT @demishassabis: Trending globally on twitter no. 3, 6, 7, 9, all #AlphaGo. Wall-to-wall TV in Korea, Live on 14 channels in China! https… RT @MatthewGombolay: In the post match press conference, the world champ Lee said, "I didn’t know AlphaGo would play such a perfect game." … @j2bryson if ppl can contribute anything soon :) definitely they will fir a while if constrained to laptop scale hardware... @j2bryson there's also the rise of centaur/freestyle chess from what I assume was nothing or small then to today..could happen w Go, @CadeMetz thanks for calling out the "database" thing - that irked me :) @hintikka yup. AlphaGo wins by resignation. Myungwan Kim (9p) thinks Lee Sedol may resign soon... @doubledeckerpot yes. It uses normal CPUs and GPUs. RT @demishassabis: extremely tense... Lee Sedol is famous for his creative fighting skills, #AlphaGo going toe to toe. Incredibly complicat… Bernie defeats Lee Sedol, er, Hillary. Interesting night. @SaschaGriffiths @mark_riedl yep. @jathansadowski yup. @mark_riedl https://t.co/YvKII1QWDI @mark_riedl been done for soccer. @jathansadowski views on AI in particular=pretty widely disagreed with among AI people, FWIW...media enamored of self-declared futurists tho @jathansadowski IIRC, ranged from bad to pretty good, w very bad self awareness( /metacognition :) ). scored self way higher than others do. @jathansadowski lol confidence counts for a lot in political and tech punditry reception :) independent scoring of his predictions have ... @williamstome but does it use fuzzy logic? :P @yoavgo Chang-Ho has more titles but also older. I think by other metrics Sedol is better. Doubt it'd affect the outcome, anyway, though... "RT @cogconfluence: Q: Why did the deep net cross the road? A: We don't know. But look, it did it really well... #deeplearning" RT @alexjc: #NeuralDoodle lets you generate masterpieces from rough sketches, in only 450 lines of code. https://t.co/MZfbWHpxwb https://t.… RT @affectivecogntn: For once a robot video has to be slowed down instead of sped up to show the results. #hri2016 En route to/in Spain for much of AlphaGo stuff- counting on y'all to tweet/write about it :) Getting match 1 results before I leave, though. RT @mpshanahan: A titanic contest between biological and artificial intelligence begins in just a few hours #AlphaGo #AI - https://t.co/Wsc… May need to write a blog post on this at some point in the not too distant future (links between AI, econ. growth, and living standards). #NAME? (He makes many more arguments than that for why growth will be slow, + I agree with most of them, but AI deserved far deeper consideration) Gordon considers ICT as email, Internet, and social media, then says re: AI, basically- meh, seems unsolved RN, so slow growth for 25 years. Plus, his characterization of the state of the art in AI/robotics/their rates of progress is flawed, being largely drawn from news articles. Specifically, Gordon seems to fail to apply some of his own points about other techs to AI, e.g. gestation period, unexpected uses, etc. ... Finished Gordon's book. Bit too long and wrong in some ways abt AI, I think, but worth reading if interested in historical POV on econ/tech. @smc90 do you watch House of Cards? Reminds me of the PollyHop/Conway thing... @BrianSJ3 yup. Have heard a few times that "everyone is working on dialogue." But who is doing good work on dialogue? ;) Lots, I suspect, but not everyone. Put briefly, my beef (and that of many other readers) w/ Gordon is his belief that the "3rd Industrial Rev." (ICT) is basically mature now. Still got another 200 pages to go, though, so will have more to say :) (It is a very long book, btw. Bit too long) This is representative of a common theme in the book: great historical perspective, excessive extrapolation of aspects of today into future. ...for computation clearly will not just be from desk/laptops going forward, not to mention many computing-hungry applications in AI/VR etc. I'm aware that argument isn't unique to him (he also references Hal Varian on this), but supply side issues also playing role, and demand... Starting to get to the heart of Gordon's book and the parts where I strongly disagree (future of ICT), e.g. this... https://t.co/30L3HAmtCP Wrote a sketchy research proposal to experimentally evaluate this in fake restaurant w/ Wizard of Oz methods once, if any HRI ppl want it :) "Gordon on ATMs. Big open Q for AI/robotics is nature/strength/distribution/endurance of demand 4 human interaction. https://t.co/sijZTw0vBk" *I suppose I was implicitly excluding autonomous cars there, which obviously wins otherwise. Would be curious if anyone knows of a larger-scale robotics experiment than this (800,000 trials). Tellex has proposed some (?) +RoboEarth? RT @demishassabis: Mega press conference, apparently the biggest one in Google history! Great that @ericschmidt could join us. #AlphaGo htt… 800,000 (!!!!) grasping attempts over two months, with varying camera locations/objects/etc. Some paper excerpts... https://t.co/FB1qugqQ1h "Paper by Levine et al. at Google: 6-14 robots trying grasping methods for 2 months (!)- https://t.co/Vi0WwQLnsj https://t.co/CzbYm1sW6x" "Learning Shared Representations in Multi-task Reinforcement Learning," Borsa et al.: https://t.co/wlMYYoBtap @tmosley4 but as to why it isn't jumpier, dunno/he doesn't hazard a guess :) Graph from same book (Gordon 2016) for airline safety also shows fast improvement. In both cases, various causes. https://t.co/426Houdahk @tmosley4 author (Gordon) points to better cars, more frequent/better repairs, better roads, wider roads (less risky passing maneuvers), etc Relative rate not as important as absolute # lives saved, but found graph interesting. Trend toward 1 fatality/billion miles in few decades. Autonomous cars may make driving (/riding?) safer, but at a faster rate than it's already gotten safer? Note y-axis. https://t.co/dtZONeqayU RT @samim: New Experiment: #CreativeAI - On the Democratisation & Escalation of Creativity: https://t.co/60owmYN75i https://t.co/feqNY16Yoh RT @williamstome: Virtual face demo showing off fine grained emotional / facial control from Mark Sagar #hri2016 https://t.co/LjLz7MJqyK RT @williamstome: Absolutely insane virtual baby demo from Mark Sagar at #HRI2016. What a way to kick off the conference! https://t.co/MpLy… @overcomplete_ technical. If that could be done (real-time access to more than meta-data), by gov't, across carriers @overcomplete_ have you watched the whole season? what about the NSA/phone stuff? @overcomplete_ elaborate? Anyone who follows both surveillance and House of Cards want to comment on season 4? :) RT @demishassabis: Just arrived in Seoul, so excited to be here! Fun scenes at the airport :) Big press conference tomorrow #AlphaGo https:… Fave House of Cards chars: Tom Yates, Heather Dunbar, Claire Underwood. Least fave: Doug Stamper, Seth Grayson. Fave cameo: @VanJones68 :) @hintikka and she has the vastest hive mind of all, it would seem. Podesta is like their Doug Stamper (if you watch HoC), sans murder I hope @hintikka yeah. slash any charge that she and her hivemind think will stick. House of Cards is too accurate in some respects :/ @hintikka (watching House of Cards right now and thinking about Clinton/Underwood analogies) @hintikka HRC of course has the utmost respect for Sanders and treats him with it behind closed doors, I'm sure. @mark_riedl impressive speed, but doubt it could play an actual game in uncontrolled enviro w/ novel arrangements... needs moar AI :) Combine Facebook's AI and this robot's manipulation, + some other stuff, and you might have a solid Jenga player :) https://t.co/X2OuZ0dbUi "Learning Physical Intuition of Block Towers by Example" by Lerer et al. at Facebook: https://t.co/5zXJurZ1JP "Dynamic Memory Networks for Visual and Textual Question Answering" by Xiong et al. at MetaMind https://t.co/ILhooNKFqh ...though there's no silver bullet (/Instagram filter). They conclude with a vision of geo-privacy aware cameras. https://t.co/w0og6YCehN Paper by Choi et al. on geo-location of online images/how to prevent it. Interestingly, commonly used filters help: https://t.co/TbK8FVBmAg @Aelkus been on my list for a while. Prob. will get to it after an upcoming trip (can't justify it before then, unfortunately :) ). @danieldewey @rbhar90 @mappingbabel yup :) we were just discussing this the other day: https://t.co/NZ7KQBEqup RT @demishassabis: Livestream for Match 1: https://t.co/iVwacLxkrh Wed 9th Mar 13:00 KST, 04:00 GMT, which is Tue 8th Mar (-1 day) 20:00 PT… @rbhar90 @mappingbabel would be interesting (maybe prophetic or stubborn ;) )if they actually followed the Go -> Starcraft order 5 yrs later @rbhar90 @mappingbabel well, that talk was 5 years ago, but they have mentioned it more recently, too (if vaguely). would be interesting! @mappingbabel interesting he didn't seem to think Go was that hard then ;) @alexjc nope, sorry :) @alexjc how about a city skyline? RT @alexjc: Semantic Style Transfer and Turning Two-Bit Doodles into Fine Artwork [PDF] https://t.co/4MqQ4Zo5EE New! /cc @nuclai https://t.… RT @demishassabis: Only a few days to go! crazy excitement in Seoul, 500+ journalists covering the match, on national TV in Korea, Japan, a… @tmosley4 don't have strong opinion on what is most likely, just want to explore a bit more/see if some actions make good ones more likely. @tmosley4 yes, I think that's a reasonable scenario, but can imagine scenarios where it doesn't happen (e.g. if proprietary data key)... @PabloRedux yeah, read summary in Slate but not whole thing yet. @halhod at the big AI conferences AAAI and IJCAI, for example, there are pretty diverse papers, mostly not deep learning based... @halhod not sure if agree w/ that formulation (e.g. if deep learning= hypetrain, I think that's part of path), but many paths being pursued. @halhod but yeah, no one knows for sure how long/narrow/windy that path is or they'd be at the end already :) @halhod disagree somewhat but in ways hard to litigate/clarify on here :) think much diverse, promising work going on on or near the path(s) @halhod sounds a lot like M :) @halhod but agree there are immediate issues/uncertainty about or distance from generality shouldn't be used to dismiss former (as often is) @halhod it may be, but hard to say with confidence one way or the other, and not dichotomous - general-er AI not far off/here already... @halhod yeah, though I think in at least some cases, market forces alone will not incentivize that. May be globally optimal but not locally. @halhod elaborate? Or general AI! This is depicted in the book Counting Heads (among others). Besides data - talent, hardware, IP, etc. https://t.co/9Od3mA6TaJ What can we say about possible/desirable distributions of AI/robotics capabilities btwn people, given hardware, IP, $, etc. factors? Etc. Plus there's the issue of distribution -thinking about that more lately after reading Counting Heads, where ppl have AIs of varying quality. Much has been said on that topic already, but not usually very systematically/comprehensively - e.g. typology of impacts, timescales, etc... Provoked by Gordon's book... may have to write something about it at some point, specifically re: AI's potential impact on living standards. ...and with VR, some types may soon become non-rival for the first time (e.g. plays). CC @beaucronin Interesting that, like cars, this is somewhat continuous with changes related to the Internet - info/entertainment became *more* non-rival. Gordon's narrative on why information, communication, and entertainment changes between 1870 + 1940 were big deals. https://t.co/wFp1VvdxyM Gordon on the impact of cars in the US. Interestingly similar to/continuous with later Internet impacts. https://t.co/1E5x16Kp2I RT @DeepDrumpf: Great manufacturing, bring back our jobs, bring back our manufacturing, because my file, you know, I don’t need anybody’s m… RT @rivatez: 'last programming book you will ever need' https://t.co/UoO2OTiZK1 @hintikka I might have to take back my comment on Trump's narcissism. Maybe not that atypical (among the options) ;) Gordon on travel from Chicago to New York and DC to New York in 1800s (compare latter to current 3 hour bus ride). https://t.co/NXSMYkWCVh Enjoyed the book Counting Heads (h/t @beaucronin). Lots of interesting ideas about AI, VR, work, transhumanism, inequality, etc. to ponder. RT @boldingbroke: China tries for Pre-Crime https://t.co/L3VAONjI2o #PII #BAU #AI #sentimentAnalysis #MinorityReport #PhillipKDick #BigData RT @awentzonline: #Style transfer via #neural image analogy https://t.co/6Oi9VyeRSJ #keras #deepdream @fchollet https://t.co/toKgi5OxK9 @dmarthal good luck! :) @dmarthal think most ppl use libraries :) cant speak to Theano, though. @dmarthal TensorFlow Hinton's lay explanation of deep learning isn't bad, but I prefer @danieldewey's w/ only the 1k most common words :) https://t.co/SCGIaJ9q1m RT @mappingbabel: We live in a world where Geoff Hinton can talk about 'thought vectors' on a major Canadian TV show https://t.co/LKLO6QFzLk @vgr actual stats on psych personas: https://t.co/7D3Z7QrdC1 @rbhar90 @mappingbabel some sort of unification of neural nets and hierarchical RL (a la Botvinick, Dietterich, Russell..) to do end-to-end. @rbhar90 @mappingbabel deep RL currently would require learning different levels/timescales independently to be tractable, or else needs ... @rbhar90 @mappingbabel haven't read that paper yet (https://t.co/vFpyBP1L8E). What I had in mind is that perhaps doing Starcraft using... @mappingbabel @rbhar90 think it may require something new in hierarchical RL, but they have ppl w that background (e.g. Botvinick). @mappingbabel @rbhar90 even if reasonable assumptions made for reaction time, for examples... @mappingbabel @rbhar90 very specific set of standards is the norm for those things in Atari, but gamers will find things to complain about, @mappingbabel @rbhar90 depends on what success means - performance level, extent of hand-crafted features, reaction time allowed, etc. @mappingbabel perfect/imperfect info, more delayed reward, continuous actions, etc... @mappingbabel yeah, was just talking w someone recently about AlphaGo being perfect info :) lots of dimensions being pushed simultaneously: "In this paper we introduce the first scalable end-to-end approach to learning approximate Nash equilibria without any prior knowledge." @Aelkus nice. Look forward to your thoughts on it! "Deep RL from Self-Play in Imperfect-Info Games," Heinrich/Silver: https://t.co/ALLsB74Ftd End-to-end poker, better than DQN (but not SOTA). "RT @MatthewGombolay: What happens when you train a Deep Neural Net on speeches of @realDonaldTrump? My colleague created @DeepDrumpf to sh…" RT @DeepDrumpf: I’ll bring back our jobs. They all have everything, they don’t have a clue. Paper doesn't use the term that way but I'm emphasizing b/c truer now than in prior usages of it (inc. by authors: https://t.co/vQKJY9SCYX). ...where end-to-end means *hand-crafted feature-free* perception in to action out, vs e.g. put peg in hole where cost is distance from hole. Update: this Finn et al. paper is a big deal. End-to-end learning of tasks from demonstration with deep learning... https://t.co/pgIdjLsWwz McClendon was also a supporter of ARPA-E. RIP. https://t.co/gTVNQMXpwW Been meaning to make a plot of prog. in continuous tasks for a while, might do so soon in light of this. Lots of papers using MuJoCo lately. "Continuous Deep Q-Learning with Model-based Acceleration," Gu et al.: https://t.co/mQZU5Jip1K Q-learning w/ exp. replay 4 continuous tasks. RT @chris_brockett: Our paper on promoting output diversity in neural conversation models got into @naacl2016. Preprint is at https://t.co/… Wajcman: "Men are still in charge of science and technology, and it's not going that well." First trip to Spain next week for the second annual meeting of the Virtual Institute of Responsible Innovation - looking forward to it! :) Related: @JohnDanaher has a nice new paper on technological unemployment and the meaning of life: https://t.co/b9ifGF1sUJ "Automation, robotics, and the promise of an easier life" - lecture by Judy Wajcman: https://t.co/Zpw4F1EIq9 "RT @j_winterton: Let the games begin! 😄 A good step towards a functional relationship between hackers and gov't. https://t.co/NchDKGa330" RT @alexjc: Apparently our electricity bill almost doubled since I got into Deep Learning ;-) I'm sure @DeepForger has something to say abo… @williamstome point five is key! :) "RT @williamstome: Heading to #NewZealand for #HRI! Here are Five Reasons why I'm super excited for #HRI2016: https://t.co/RndyiHhijO @hrila…" @alexjc @glouppe it's exceedingly unlikely they could catch up before the Lee Sedol match, and after that few outside AI/Go will care :) @alexjc @glouppe yeah, though I took Gilles to mean competition in a broader sense (ie just there being alternative good engines existing). RT @alexjc: @glouppe @Miles_Brundage Google doesn't want to compete, they want to win decisively and get out IMHO. Better branding that way! Yes, perhaps commercial Go engine/open source - news seems to discuss Japanese pride 2 re: goals but can't read it. https://t.co/XfcavLVtWg RT @alexjc: @Miles_Brundage Conversely, DeepZenGo seems to be in it for the long term, building a product for the community? RT @alexjc: @Miles_Brundage I expect Google will give up this line of research completely once they've won. There's no more value there... RT @glouppe: @Miles_Brundage Some healthy competition, that's good for research! ..and they're serious enough about it to make a fancy backdrop and big poster for the announcement, so who knows :) https://t.co/EAi8lIBaKh AlphaGo has huge headstart so doubt DeepZenGo can catch up very soon if ever, but cool to hear and will be interesting to see where it goes. As I mentioned in blog post on AlphaGo, it's not clear how much better AlphaGo is than a comparably scaled up Zen19X, so interesting news... From Google translations of Japanese news, it seems Hideki Kato (of Zen fame) and company Dwango are building AlphaGo competitor, DeepZenGo. @elonmusk three out of ten with your fingerprints on them - not bad :) RT @JohnDanaher: Will life be worth living in a world without work? Technological Unemployment and the Meaning of Life https://t.co/8jgiXoR… RT @yoavgo: Our take on neural tree encoding (and a parser, too). @elikiper https://t.co/N024qJoi7I Gordon's Rise and Fall of Am. Growth is great if flawed. Unfortunately, can't finish til I finish Counting Heads (thx/blame to @beaucronin). I hope DeepMind releases figures on latest-AlphaGo vs. old-AlphaGo win rates after match. Interested in what months of deep RL gets you. @mappingbabel thanks! @tmosley4 thanks, was actually just updating to reflect this :) thanks! So, acc'ing to Wikipedia, there is a 13k mile figure, which includes the branches. Not sure that's the relevant figure, but it's something.. Trump again with the Great Wall of China being 13,000 miles thing. Um, no, it's not. :) Do his staff ever contradict/inform him of things? Ah, 100 games*. That's a lot of hardware. https://t.co/bdlYwA3NuC Possible computing power still isn't big enough, but current hardware being pushed hard - per Hassabis, 10 simultaneous games running 24/7. @rbhar90 agreed! Will be very interesting to see how the Lee Sedol match goes. And no prob, always happy to discuss such things :) @rbhar90 ...which says that the agent *did* find a good policy, but then forgot about it :) so need to combine those approaches/maybe other. @rbhar90 ...better exploration (https://t.co/AcqwpG20Fk) and prioritized experience replay (https://t.co/3Nh24NYioR), see appendix in former @rbhar90 ... Mnih at NIPS showed vid of good (dunno exactly how good) Montezuma performance, dunno how exactly achieved. Think some combo of @rbhar90 hard to answer in general b/c "these techniques" = moving target/constantly improving :) but the short answer is yes, and ... Will be surprised if AlphaGo/Lee Sedol match is v. close (3-2). Either deep RL+MCTS+big computing power scales v. well or something missing. RT @demishassabis: We had over a dozen papers with DeepMind co-authors accepted to the upcoming ICLR conf! All our publications here: https… @beaucronin Trump is gonna do it alllll in one week. "Guided Cost Learning: Deep Inverse Optimal Control via Policy Optimization" by Finn et al.: https://t.co/bDgUrUmkwH New robotic RL results. @beaucronin yeah. I worked at the agency/helped with the summit in question, and still think that framing is poopy: https://t.co/NZsODGLrsY @beaucronin have you read the sequel, Mind Over Ship (or anything else by Marusek)? Trying to not get too invested (unless I should ;) ). @argletargle definitely interested in writing such a thing at some point... if not better than different (w/ more formulas, empirical data). RT @traviskorte: *very Charleton Heston voice* "Technology is people!" RT @traviskorte: The people who give algorithms credit for "creating" DeepDream art are the same ones who say predictive scoring is just a … RT @tdietterich: Congrats to @paul_scharre for his penetrating analysis of autonomous weapons systems. https://t.co/zz3VPWHOGy RT @mpshanahan: The new Leverhulme Centre for the Future of Intelligence is looking to hire its executive director - https://t.co/cHrecuIKB3 RT @alexjc: Today in #AI or #ML, give yourself a reasonable but novel 6 month project, and likely another team is already about to ship the… Thanks all for the feedback on my AlphaGo post! Glad ppl enjoyed it. Learned a lot from the discussion. Maybe an Atari post down the road :) RT @MBGlenn: Dear @ABC @FoxNews @CBSNews @MSNBC, Do you find it sad that @iamjohnoliver has to do your job for you? #NeverTrump https://t.… @hintikka OTOH was rereading this (MLK) the other day - and am not being vocally anti-Trump enough. Will do better.. https://t.co/Cr3fitsmef @hintikka I got nothing... people are horrible. @hintikka 😔 RT @mpshanahan: This is my story, and I’m sticking to it :-) #ExMachina #ResearchImpact #ImperialCollege https://t.co/ezmTPZxhvF @beaucronin ah, you addressed that issue as I typed it :) good to know.. @beaucronin hm. potentially amenable to a phone situation but less inclined if Apple thing comes very soon after...will stay tuned. then. @beaucronin dumb question, but what device if any should I be looking forward to as a noob/Apple user? @beaucronin yeah. I'm particularly intrigued by the valet/mentar stuff. Implications of AI assistants = very interesting to think about. @beaucronin "basic" ;) maybe to characters in Counting Heads... 75 pages in, enjoying so far. More thoughts when I finish it eventually :) @beaucronin what are you developing? @tmosley4 it would be about 1/10th-1/100th as large. Estimate of the energy footprint of AlphaGo's hardware: https://t.co/5yvdrEgWe5 @recurseparadox fair point, though here I think it matters, combined w other factors (multiagent, no simple heuristic for what matters, etc) @recurseparadox Dunno re depth. Would be informative to see, if same approach works 4 chess, how training time/compute requirements differed @recurseparadox good question. The width definitely made Go require diff techniques from chess - minimax/search less useful(though helpful), @robinsloan thank you! :) RT @ylecun: In-depth analysis and excellent historical context of recent progress in computer Go. https://t.co/aI1uhvka0j RT @neuroecology: The fundamental question here is, how scalable is deep learning? @Miles_Brundage @GaryMarcus RT @GaryMarcus: Thoughtful analysis of software and hardware progress in DeepMind's AlphaGo, by @Miles_Brundage https://t.co/C11YCq1vyc @glouppe interesting question! Will ponder. I suspect it would not be very flattering for AlphaGo :) @mjrobbins thanks! Hmm interesting comparison, indeed. Will ponder. @beaucronin those are just some considerations - but not sure how much we should care. Depends what Q one is interested in, I suppose. @beaucronin if we're close/prog were fast, we could simply/w small team apply old algos to new domain, + prog/researcher hour would be high. @beaucronin questions like whether it signals that AI progress overall is very fast, or whether it signals that we are close to general AI.+ @beaucronin good Q, I didn't explain that well. It may not matter for judging the magnitude of a progress jump, but may matter for for... @Miles_Brundage CC @rivatez @GaryMarcus @alexjc @Aelkus @beaucronin @mappingbabel "I wrote a pretty extensive blog post - ""AlphaGo and AI Progress"": https://t.co/NAIBSrlcBV Thoughts welcome!" OH: "People are like spiders. They usually live and die near where they're born." Umm, true? @beaucronin https://t.co/KGeWX4GmrU Writing some stuff on AlphaGo and AI progress that some of y'all may find interesting :) May post tonight... @jtoy CC @williamstome "RT @rebecca_roache: More Realistic Meat Substitute Made From Soy Raised In Brutally Cruel Conditions https://t.co/d2jvVb6Bfe" @rivatez ooh, sounds interesting :) Also, it's a great movie :) ...and makes fun of Theodore at one point for being curt/utilitarian in his use of her, +in other ways persuades him to care for her...etc. E.g. the OS is advertised as "a consciousness"...but Samantha says she "knows she's not a person"...but acts as if she has interests, ...by playing fast and loose with (rhetoric on) consciousness, personhood, etc. (not to mention egregious safety/control/testing issues). Not entirely unlike RoboCop in this respect (https://t.co/MpkaN94DkC), though in the case of Her, the company errs in other ways, namely... Upon rewatching Her, I'm even more convinced that it's a case study in how to get corporate AI ethics exactly wrong in just about every way. @rivatez ooooohhh. Tempting. Shoot me an email sometime! :) also, working on a blog post you may find interesting... @rivatez whaaaaaaat. jealous :) RT @mark_riedl: I was live on Science Friday talking about ethical robots. If you didn’t catch it, here is the audio: https://t.co/yhCphlOo… @jsfour ah yes, thought I did already :) done. @jsfour I am - curious to hear more, maybe shoot me a direct message? @kleinsound @jimmfleming and aren't on any deep learning related R+D deadlines :) @kleinsound @jimmfleming like speed (if true), are less relevant for casual users like me who can wait for results while doing other things. @kleinsound @jimmfleming prob b/c dependencies, documentation/tutorial quality and variety, and my noobness. Benefits of other libraries, @kleinsound @jimmfleming for me, the benefit is pretty clear - I was able to easily get it working, unlike some others I tried (e.g. Torch), @jimmfleming awesome - will do! @kleinsound maybe something more serious someday but not now :) plenty of other papers etc in progress @kleinsound just exploring to improve my intuitions about how deep learning works/practical difficulties/states of the art, etc. @jedgar ah yes, I should have (though satisfied w first answer I got)! not acclimated to that as an option :) will def have more Qs soon! @jathansadowski and that's even before you get to the superintelligence/singleton stuff :) @kleinsound yeah. til then I'll prob just keep doing it on my laptop and complaining about AWS :) RT @kleinsound: @Miles_Brundage Google surely has a Compute Engine integration soon to be revealed. I'm waiting until the official PR annou… Maybe just need to try a bit more - anyone done this successfully/have recommendations? Tried AWS and it seemed frustratingly complex. Just want to log in + have command line ready w/ distributed TensorFlow/easy file transfer :) Now that distributed TensorFlow is a thing, what's the best way to use it for deep learning on cloud? AWS? Google coming out w something? @beaucronin interesting. what is required for that? omnidirectional treadmill? sensors? @beaucronin occurred to me the other day that maybe the future [of people spending a ton of time in VR] is here, just not evenly distributed @beaucronin enjoying Counting Heads so far, esp. AI assistant stuff. Also, how much time do you/[max of people u know] spend in VR already? RT @mxlearn: Distributed TensorFlow just open-sourced https://t.co/MXZ7omJxxb @KaiLashArul nice! @spysamot @togelius @mjntendency yep. there's been at least one paper by others on transfer in Atari, but it's still pretty slow there. @spysamot @togelius @mjntendency that screenshot is from Prioritized Experience Replay. Suggests *maybe* agent would do OK in a *few* games @spysamot @togelius @mjntendency be generous and say agent has 1 game-day. That's ~1/39th of each of these curves. https://t.co/6glvQFAshF @spysamot @togelius @mjntendency if Atari=60 frames/second (had trouble verifying this...?), DeepMind's standard training is 38.58 game-days @mjntendency sorry, clarification: not CPU-weeks/months, meant to say game-time-weeks/months. More like CPU-hours/days. Still a lot though. @mjntendency if I recall correctly, not years, but still significantly more than a human would need to master a game! Much harder w/ hours. @mjntendency agreed- DeepMind papers do use a fixed amount of training time in their experiments, and it's on the order of CPU-weeks/months, 7. ...because many recently published techniques could be combined/are complementary, in many cases more CPU time would improve score, etc. 6. Also will note again that discrete papers=lagging indicators of Atari AI progress. Very possible unpublished system can master all games. @jsfour a couple of papers, mostly :) 5. ...as possibly requiring longer-term planning. This paper somewhat addresses by valuing big future rewards more (vs. all rewards equal). 4. Notably, Frostbite was near bottom of the list before, and Ms. Pacman is now much improved. Both in cluster of games I noted at AAAI... 3. Updated list of remaining Atari games where no (super)human level AI shown. Ms. Pacman/Bowling are pretty close. https://t.co/JM9nCnbB0K 2. Paper's about how to learn from unclipped (contra DQN) rewards, which come in many magnitudes. Excerpt here... https://t.co/Ber5lje5dV 1. "Learning functions across many orders of magnitudes" by van Hasselt et al. at DeepMind: https://t.co/4NmQjI2yvp "Big Data for Development: Applications and Techniques," Ali et al.: https://t.co/a1UjPXysBp @j2bryson also wonder if they'd distinguish non-lethal (but military) from lethal autonomous use, when selling/partnering...big can of worms @j2bryson I don't think that's their intended market, for sure, but would they refuse/try to stop it being used 4 that? Marines tried BigDog @mappingbabel @marypcbuk @monkchips I thought that when Alphabet announced but website, papers, talks, etc say DeepMind is part of Google(?) @janexwang finally read it - great stuff! :) RT @janexwang: Originally was meant to be a blog about my thoughts on brain interfacing, but turned into a sci-fi short: https://t.co/t6KVi… @jathansadowski @FrankPasquale which article? @dmarthal @beaucronin nice! Next on the sci-fi reading list, as recommended by @beaucronin. Looking forward to it! :) https://t.co/y90nlBbifZ @williamstome I'll see if I can find a good one of those to try :) RT @kashhill: Mark Zuckerberg asks employees to stop replacing “black lives matter” with “all lives matter” on Facebook’s walls. https://t.… @williamstome good question! Not sure. Also wouldn't know how much to glean from that comparison w/o more hyperparameter optimization.. Some GrumpyBot-generated text. Like how the bit about "slapdash quality"/hacks is itself ripped off. Also, "bah." https://t.co/1xBRvoJlg8 "SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size," by Iandola et al.: https://t.co/kLNcgtGczT Seem to recall they said when acquired they wouldn't take new military R+D contracts, but doesn't mean they won't/don't sell them. Thoughts? Does anyone know to whom Google/Boston Dynamics sells robots? Marines contract cancelled bc BigDog loud, what else? https://t.co/9h7YkCMZV0 @tmosley4 same video, but note it is also super top heavy. @tmosley4 not sure exactly, Hassabis just said in a talk he is advising them, and that playing against it has improved his own play. @beaucronin yup. @alexjc yeah, fair - but it runs contra to their rhetoric on generality ;) they have enough C/GPUs to try various things I suppose... @alexjc @mappingbabel @togelius the point on Quake being easy to run is interesting, though - step up from Atari but not as big as Starcraft @alexjc @mappingbabel @togelius I would be very surprised if they spent much time on any one game like StarCraft - Go was a special case :) @alexjc @togelius wouldn't be surprised...only have heard myself of he 3D mazes, no specific 3D games... @alexjc @togelius @Amirmizroch @samim yes, he mentions it in that talk, though vaguely ("stuff like starcraft"...) @alexjc yeah, + Silver in Nature interview while back. Hassabis at AAAI also said something like "they (Go players) aren't programmers..." Learning that Fan Hui is helping DeepMind improve AlphaGo has slightly increased my confidence it will beat Lee Sedol. Not that robotic perception/locomotion/manipulation are fully solved problems, but that video is super impressive in various ways. 2015: LOL robots falling over. Early 2016: seemingly human/superhuman-level balance in very rough terrain. Terminator jokes and ill-advised concern for the Atlas robot's wellbeing aside, Google/Boston Dynamics is making remarkably fast progress. @mappingbabel sent :) @mappingbabel somewhat misleading slide as the two have very different computational requirements... writing a thing on this if interested.. RT @shakir_za: Announced today: DeepMind health. AI for social good, starting with healthcare. https://t.co/PBY13ujW2z Turns out I was failing badly w hyperparameters in my deep learning experiments. Oh, well - partially fixed now :) GrumpyBot results soon... Well, that was weird. Not sure I got it. Think I liked Her more. :) Johansson's been in much good/awful sci-fi lately. Murdery alien (Under the Skin) + AI (Her) >> clone (The Island) >> enhanced human (Lucy). Was told at AAAI to watch Under the Skin - Scarlett Johansson as murdery alien in Scotland. Weird but interesting so far. @hintikka agh. on an unrelated note, hope some day your tweets are RTable cuz they are very RT-worthy :) @togelius are there any besides Player of Games that you most recommend? I'm especially interested in the post-work/-scarcity aspects of it. RT @lukeprog: ALBA: An explicit proposal for aligned AI. https://t.co/Ma2LNwkNKi New paper by Szegedy et al. at Google: https://t.co/NLhS1Ab8BT Inception + residual connections + ensemble = 3.1% top-5 ImageNet error. RT @mark_riedl: The next generation Atlas robot can open doors, walk in snow, and put up with that jerk co-worker. https://t.co/Ofe56ugHBm @hintikka maybe not bona fide disorder, +don't want to trivialize, but the # of domains he claims superiority/expertise in is noteworthy... @hintikka surprised there isn't more discussion of his narcissistic personality disorder... guess the fascism thing is more urgent, though.. @beaucronin if my interest in the series is mostly post-work/-scarcity stuff, how much of that value did I get from PoG?/what next if low %? RT @Geeksnewslab: It’s Awesome! Nao Humanoid Robot diving perfectly https://t.co/tD6uy3klp4 https://t.co/z5WiMcnu5s @beaucronin finishing up Player of Games (my first of his) currently and yes, he is great at names! And many other things. @beaucronin watcha reading by him? RT @beaucronin: A bit more on my hopes and dreams for VR and AR - Perceptual Augmentation https://t.co/MfnubqwJyc @janexwang look forward to reading it! :) Jaan Tallinn talking at ASU about toy models of the superintelligence control problem. https://t.co/VfLnznggrb @williamstome nice - this does look very similar! thanks! RNN-generated definition for my made up word, floobiz. https://t.co/ii6kphLHSa RT @alexjc: What it'll be like to put Deep Reinforcement Learning into recent/old-school games: https://t.co/uisAGvKZEJ RT @starsandrobots: The most jarring thing to me about this photo's spread is the blasé non-surprise at a pic that's apparently 100% men ht… Half-kidding about Brennan thing, but he's a good writer and I was looking forward to that book anyway. Liked his "Why Not Capitalism?" etc. """Given Trump is winning, which views should we update?"" @tylercowen -https://t.co/KGeWX4GmrU +Brennan's book Against Democracy is >timely." @mark_riedl they briefly mention combining it with RL at the very end. But, dunno, good Q. RT @mark_riedl: @Miles_Brundage Interesting development. DeepMind is augmenting RL (planning) with NNs. Abeel is making NNs do planning. Wh… That neural nets can do stuff isn't v. surprising- they can represent any computable function. But learning them efficiently is noteworthy. ...can be added to the long list of things one wouldn't necessarily expect neural networks could do, but can with relatively minor tweaks. Not sure this will be that important directly (vs. other planning approaches) - maybe it will - but broader importance is that planning ... Update: "Value Iteration Networks" paper does indeed seem important. Planning w/ convolutional NNs. Key paragraph... https://t.co/DbdpuYfT2i " Sequence-to-Sequence RNNs for Text Summarization" Nallapati et al. https://t.co/J8l5wcUAh2 Seems to be uptick in IBM deep learning papers. Hintonian thought vector stuff in future work section... Kurzweil mention in acknowledgments = 1st sign I've seen he actually works there :) " Contextual LSTM (CLSTM) models for Large scale NLP tasks," Ghosh et al. at Google: https://t.co/7TOJZOE8BE Big improvement on some tasks. @lexiconjure Floobiz RT @karpathy: Top notch char-rnn fun: @lexiconjure trained dictionary; invents&defines words. eg: "fengler a person who fengles or shares a… @williamstome noted. thanks! :) @alan_winfield thanks!! :) @danieldewey thanks! Egan has been on to-read list for a while but wasn't sure where to start, and hadn't heard of that one. @dmarthal started Anathem but never finished. Diamond Age is on the to do list! @beaucronin oooh sounds up my alley. Thanks! @SimonWierny any top priorities from him? That's a lot! :) @williamstome it's actually all I've read from him! Biased by subject matter :)Know he has many great ones but any very top recs? @ansgarjohn thanks, I've read it - classic! :) @BrianSJ3 not familiar with it, will check out, thanks! Never finished Hyperion or Fire Upon the Deep but liked beginnings. Some Stephenson is def on my must-read-soon list. Help me prioritize! :) Trouble on Triton, Robopocalypse, Flowers for Algernon, Accelerando, and/or Singularity Sky might also eke out some of those. Tough to pick. Open to recs for things to (re)read. :) Books by same authors omitted for purposes of one tweet long list. May add Player of Games soon... Some fave scifi books: 1984, BNW, Oryx+Crake, Naked Sun, Dispossessed, Ready Player One, Ancillary Justice, Player Piano. What am I missing? Would still love to hear people's, esp. neuro people's, thoughts on this neuro paper from Leibo et al. at DeepMind: https://t.co/3wthJdgTB4 @dmarthal on my own machine. Tried AWS and got frustrated, may try again at some point. Didn't try with docker. Recommend it? @hintikka hope you're wrong :) and to think I thought leaving DC would insulate me to some extent from such crap... @hintikka I think/hope most ppl who would support already do, and that makes it <<50% of electorate.. @hintikka yeah, I guess I don't consider it outlandish do much as (significantly?) <50% chance, but maybe I think too highly of some ppl. @hintikka really? you think that's likely? Look forward to results of latest neural net experiment - hoping for best so far. 8,000 pages of negative movie reviews + LSTM = GrumpyBot. @j2bryson I like the book Inventing the Future for that among other reasons - makes explicit need to change narratives around work, etc. @j2bryson ...reading Player of Games giving me much to ponder re: norms around leisure, Gordon reminding me how much it's already changed.. @j2bryson think key to start changing education/social norms soon - depression thing may be true for this generation, but not intrinsic... @j2bryson sure! Will make note to email you about it @j2bryson ..soon but would like to see many classes of work become more optional, employers have to compete harder on quality of work, etc. @j2bryson yeah, = part of what I think basic income is good for...put # on it, make it political object. And yeah, work not ending anytime.. RT @mark_riedl: No, “Skynet” is not in fact killing thousands of people https://t.co/hSEzFvWxwH And NSA didn’t do themselves favors by choo… "RT @j_winterton: I had an awesome time talking about #AppleVsFBI with @B4BPHX this morning! Here's the link: https://t.co/LoYNBaEmxS … @as…" Gordon sets high (but perhaps not insurmountable) bar for claims about future changes in work/leisure being historically very significant. I am not sure yet how I feel about the future claim in particular (lean towards AI/robotics ending that), but it is a formidable book. Gordon's basic thesis, for those unfamiliar, is that 1870-1970=period of epic technological/economic/social change, +slower after/in future. Table from Gordon 2016. Most spending today in US is on goods and especially services not yet invented in 1869. https://t.co/7wAjYZ9eLv @williamstome yeah, seems self sufficient, and with decent amount of exposition of how the world works... so far, solid. @williamstome too soon to say if I will love PoG. I can definitely see why so many game AI people love it :) @williamstome forget where I heard one could start w PoG but working fine so far :) may revisit Consider Phlebas/other books after PoG... @williamstome I think Player of Games is most focused on leisure/post-scarcity life stuff vs. political intrigue etc, reading for former... So far, Player of Games is as good as I expected and Rise and Fall of American Growth is better than expected from Gordon's articles/talks. Thinking about the past/possible future of work/leisure. Good to put AI/robotics in (future) historical perspective. https://t.co/aHBv7NrVYR @mikeyd_47 funny, I'm reading Player of Games now ;) very sympathetic to that, though lots of tricky transitional issues to figure out. Still working through my views on such things, one should distinguish post work, post bad work, etc. but found Inventing the Future useful. Also, this came up at AAAI panel on future of work. I was glad Bostrom pushed back on some panelists' view that end of work inherently bad. Agreed - don't agree w all of it but useful contrast to common position that we should try to create ever more work. https://t.co/8MZdhLwQdO @mark_riedl would have come in handy at AAAI. RT @williamstome: @mjntendency @Miles_Brundage Touchscreens are probably less viable for drivethroughs, though, which I'm guessing are more… As @mjntendency and @Nonadecimal point out, touch screens done already, but I wonder if customers might prefer (good) spoken dialogue... ...and say it makes it more reliable, faster, etc. and, optionally, that it frees up humans to focus on other stuff (even if false...). RT @mjntendency: @Miles_Brundage alternate possibility: many European McDonald's have already gone to self-service orders via touchscreens Of course, customer preferences, PR, and low cost of human labor may make this less likely/soon than otherwise, but one or more may try... I'm guessing not long. Mainly a talent acquisition/partnership problem. With speech recognition almost solved and so many working on dialogue, how long before a fast food company tries to automate order taking? @jsfour there are some cases where it has been done to some extent in specific domains but how to do in general/how humans do =big open prob @jsfour meant that an AI needs more data to learn a game from scratch than not from scratch (if we had good transfer learning). @jsfour transferring across games (a la humans- much faster than AI still bc prior experience), but >data needed when starting from scratch. @jsfour prob. to some extent - already there have been improvements, so prob. not at theoretical limit yet. Definitely much potential for.. @kleinsound ... latter obv. much faster, former is what I had in mind, though. Would be interesting to see exactly what they're doing. @kleinsound little bit, read Wired article and saw 5 min talk at NIPS. Site says can learn just from exploration or from human teacher ... RT @maosbot: Our machine learning spin-out, @MindFoundry, is live! https://t.co/KcFrDHLN6I Over a longer timeframe, say, five years, very few things AI progress-related would surprise me (but many would concern/excite me :) ). Other things that would also impress/surprise me in near term (say, one year) include good general dialogue and robust scene understanding. Lots of cool examples of zero/one shot learning, but something missing for few shot learning across many domains. Big econ. implications... Recent developments have enabled faster machine/reinf./deep learning, to be sure, but transfer/human-comparably-fast learning still eludes. Was asked at AAAI what would impress me re: AI prog. in near term. Besides noting I'm already impressed, said much faster learning in Atari. @murraycampbell I was not aware of that, thanks! Very interesting. Helpful point/clarification from @murraycampbell on the state of chess AI/centaurs. https://t.co/nb5cLMY9DH Context: lots of people cite chess as an example of where humans + machines > machines, in context of discussing future of work issues. Reminder: w/ humans currently or soon having nothing to contribute in centaur chess, it's a bad example of human-machine symbiosis's value. @mappingbabel @robinhanson https://t.co/5EOP5Kck9b + https://t.co/8NmkeGzhq6 @mappingbabel @GaryMarcus @robinhanson ++ common sense - why would cheap/copyable intelligence not enable much more than few % increase? @mappingbabel @GaryMarcus seems like a very low estimate. @robinhanson's/others' models suggest potential for much faster growth, as does ++ @Aelkus @etangent ..and video learning stuff is barely even getting started, so don't think parallelism is going away, for some ppl at least @Aelkus @etangent can't speak to algos mentioned there but some NN/RL stuff scales well, + 10^1-3s of GPUs still norm for some problems... @Aelkus @etangent many things doable on one machine, but some problems will for foreseeable future need many (some image stuff, most video). @Aelkus @etangent not to mention deep learning specific hardware in development, and (non-)NN ML on CPUs... @Aelkus @etangent not sure I understand or agree with dichotomy. Say more? GPUs will get faster, and ppl will use more. (?) Started reading The Player of Games. It is, indeed, very good. @beaucronin Sure! Just made some comments. Nice talk by @OriolVinyalsML on recent advances in deep learning: https://t.co/79UjabQ4VT @nsaphra he has Great Capitalization, too... @beaucronin Agreed! Nice article on people getting false impressions of expert opinion distributions from media despite media efforts: https://t.co/A5gkiTgYAW @j2bryson interesting. Can't speak to corp. case but in fed gov't, was impressed on me to imagine all emails on Wash Post front page bc FOIA @williamstome haha. Have a safe trip home! Had a great time at #AAAI16 - see a lot of you next year and/or at IJCAI! :) Hado van Hasselt on double Q-learning to reduce over-optimistic bias in (deep) RL. #AAAI16 https://t.co/ykiN9GhTOv @marcgbellemare showing impact of changing Bellman operator (1 line change to code) on DQN Atari results at #AAAI16. https://t.co/TU0XOvQIyR @j2bryson understand Enron thing, sounds like sloppy process? In HRC case emails released slowly after vetting for security etc implications @j2bryson def not banned, but rather required that govt emails be FOIA requestable - hence why ppl upset she used private email... if I + RT @ivan_bezdomny: The onboard computers detect when copters on a crash trajectory, and steer away. Once safe, student pilot back in full c… RT @ivan_bezdomny: Prof Claire Tomlin showing us collision-resistant AI quad-copters. Students attempting to crash #aaai16 https://t.co/X4X… @j2bryson don't understand the Enron point, but yes, many of them are being released under a Freedom of Information Act request. "The meaning of life is" sentence continuations from Clinton email generating RNN (funniest of the first 15 or so). https://t.co/WpSCwfMxON @nikete interesting Q of what constitutes "deep," I'm not sure exactly :) but I suppose "neural net" ppl would have been better phrasing. Last tweet quote is from "Towards a Biologically Plausible Backprop" by Scellier and Bengio - anyone in deep learning have thoughts on this? "we can train NNs with 1-3 hidden layers on the permutation-invariant MNIST task + get training error down to 0.00%" https://t.co/GIK2XeJCFi @Aelkus yup. This specifically: https://t.co/4sD3oxdKyv Fave so far: left is excerpt from original data, right is generated text. The last clause doesn't appear anywhere... https://t.co/oxIQTd6Zv0 More semi-novel, semi-coherent RNN-generated quasi-Hillary Clinton email text...e.g. "institutional reality" is new. https://t.co/9wyeR8lO0N Reasonably coherent generated passage - bits and pieces of this appear in training data, but some novel portions... https://t.co/107F9BkNZq After training for a day, Hillary Clinton email neural network is doing cool things- e.g. added missing period here. https://t.co/VeSE0lsAXT "RT @vkrakovna: Slides and photos from the AI, Ethics & Society workshop at AAAI https://t.co/68yTKkxMY7 https://t.co/PDAdkFJTnQ" @TerynNorris congrats! @alan_winfield I will stay tuned, then! :) Best of luck. Sounds like a great effort. @alan_winfield great to hear this is happening. Is there any public info on this I can read anywhere? @hintikka they're (still) putting recruiting flyers in AAAI swag bags, at least... Oliviero Stock talking about ethical dilemmas for adaptive persuasive systems - interesting driving example. #AAAI16 https://t.co/e6VkWzBVVe Humans participating year after year in Angry Birds competition have improved, moving target- Renz #AAAI16 Jochen Renz on Angry Birds competition: progress towards human level - info/code at https://t.co/4TnmxMVlaU #AAAI16 https://t.co/XN4Fdd4x2v Gini: needed a man to suggest the idea in first place to make happen - need more male advocates for women/minority representation #AAAI16 Gini:400+ girls age 6-18 brought in to learn about robotics, good community reaction to female committee etc #AAAI16 https://t.co/AKEOtc2rkP Maria Gini talking about ICRA 2015's all female organizing committee at #AAAI16 https://t.co/X9he2oVYk1 RT @yoavgo: @haldaume3 @jacobeisenstein well, to be fair some cops/soldiers are trained on like two features and zero positive labeled exam… RT @haldaume3: and just to be clear, this is essentially used to kill people. https://t.co/TrtNsTfETq Greg Hager on what's hot at ICCV/in computer vision - among other things, not surprisingly, deep learning. #AAAI16 https://t.co/kYlZXCPuv1 @dmarthal haha definitely not ;) @alexjc good turnout for sure. It's a big room, though, so not technically full :) Hassabis says they're working on many approaches for improving AlphaGo before Lee Sedol match. #AAAI16 Hassabis on AlphaGo..says next step is learning entirely from self-play, out-of-box learning all perfect info games. https://t.co/zJbjhpmj70 Some outputs of LSTM trained on Hillary Clinton's emails. Many direct quotes but also some interesting combinations. https://t.co/kbu02tynrk "Value Iteration Networks" by Tamar et al: https://t.co/ObssLR5SWn Need to read carefully soon but seems important. NN w/ "planning module." ...with one notable caveat I haven't gotten around to discussing before: in some games, there is maximum score, so e.g. Breakout maxing out. May comment on the ideas later (need to sleep soon, more AAAI tomorrow :) ), but for now will note the results fit exponential Atari trend.. "Deep Exploration via Bootstrapped DQN" by Osband et al at DeepMind: https://t.co/AcqwpG20Fk https://t.co/3By1GHORlh https://t.co/jkjLrJGfrz @j2bryson @adhdphd mostly tag - see #AAAI16. Didn't get much out of it but then again I follow the issue closely so knew ~what they'd say. RT @adhdphd: Yes, they did present the automatically generated poster! (on the side) #AAAI16 https://t.co/253EWiiNaA RT @williamstome: This is so wonderfully meta. @DisneyResearch #AAAI16 https://t.co/bM1HplEPx7 RT @TobyWalsh: #AAAI16 #AIandWork you can also email your questions to panel on AI & Labour Markets using WorkAndAI@gmail.com but keep them… RT @TobyWalsh: #AAAI16 #AIandWork tweet your questions to our panel on AI and Labour Markets. @erikbryn, Nick Bostrom, Moshe Vardi, Oren Et… @DougOfNashville ahh - thanks! "RT @erikbryn: The lounge at LaGuardia --almost all restaurants order via tablets. A year ago, only one did.Cc: @vpostrel @amcafee https://t…" RT @adhdphd: talk on monitoring call center agents, technically interesting but can imagine how workers would hate it #AAAI16 :( https://t.… RT @adhdphd: omg, a poster spotlight for a poster on automatically generating conference posters. #AAAI16 going to be so sad if it's not au… Cool talk by Amos Azaria on paper "Instructable Intelligent Personal Agent" (https://t.co/8qM9hIALn7) at #aaai16. https://t.co/37ot1Z0Z0N Looking forward to lots of cool talks/discussions at #AAAI16 today! Heading there shortly once I get this LSTM training started :) After training on ~1% of the data, getting OK results training LSTM on this huge dialogue dataset: https://t.co/xfhPgm9Jba Now the rest... @PabloRedux happy to discuss more by email :) "Using Deep Q-Learning to Control Optimization Hyperparameters," by Hansen at IBM: https://t.co/8KgJXp6FIk RT @tdietterich: Slides from my AAAI speech: Steps Toward Robust AI. https://t.co/OrcFlpWKSZ About half of the references to original ~20 year old Long Short-Term Memory (LSTM) paper have happened since 2012. @DougOfNashville missed this talk unfortunately - thx for tweeting it! What were the caveats if you recall? RT @gosainnn: Room for Deep Learning Applications is packed, atleast 40 people are standing up. #AAAI16 @PabloRedux no ER and other prior algos, on same range of tasks w same computing power @PabloRedux that is variable, e.g. deep reinforcement learning with prioritized experience replay is prog vs unprioritized which in turn > RT @aireye: Presenting “Playing Games Across the Superintelligence Divide” today at #aaai16 workshop on AI, Ethics, and Society https://t.c… Great catching up with a bunch of colleagues/friends and meeting new ones #AAAI16. Tired after a long first day but much food for thought :) Slides from my talk, "Modeling Progress in AI," at the AI, Ethics, and Society workshop at #AAAI16: https://t.co/dJBYgXwf52 RT @affectivecogntn: Thx @Miles_Brundage for an ambitious approach to measuring the progress of AI #AAAI16 #aiethics2016 @j2bryson clarification: deep RL crossed over classical planning, but complex picture re: CP v human (mixed) RT @vkrakovna: @Miles_Brundage on modeling progress in AI: simple extrapolations often beat expert predictions #AIethics workshop https://t… RT @AAAIVideoComp: Two days left to vote for your favorite AI videos! Give them a thumbs up on youtube. https://t.co/T5LiFUBrIN RT @j2bryson: If anyone wants dinner with me & @Miles_Brundage, tweet up RT @affectivecogntn AI, Ethics, and Society workshop! https://t.co… Reminder to folks in the Phoenix area that there is an open house from 9-4 on Saturday at AAAI. Come see and learn about some (ro)bots! :) Look forward to seeing many of you at AAAI! :) @nsaphra yup... 12 episode season 3! :) @robinhanson yeah, similar to what you wrote about Her in that respect... Def. recommend to anyone who still hasn't seen it (cc @robinhanson, White Christmas episode has some em stuff): https://t.co/Il9IvowswQ @JesseJenkins congrats! Foerster et al "Learning to Communicate to Solve Riddles w/ Deep Dist. Recurrent Q-Networks" https://t.co/U85DkxGE7m https://t.co/xelXQqpsJw @sknthla @jimmfleming totally understandable with the two networks and all :) FWIW, I think it's a pretty cool paper... good historical POV Josefowicz et al. at Google Brain, "Exploring the Limits of Language Modeling": https://t.co/KhX8HXk6VW [abstract] https://t.co/wchbYHkWAi @hypatiadotca the colors also made me think of the Firefox icon :) First approximation = whatever ppl should do today to help ppl, have AI/bots do, but capability differences make calculations more complex. Would be nice to eventually see equivalent of Copenhagen Consensus-style effort re what AI/robotics could be applied to for maximum benefit. ...though I could imagine poisoning prevention via AI and robotics being easier in some ways. Point is, post hoc non-$ explanations abound. Autonomous cars were once accelerated during early R+D for military purposes, now matured bc profitable, unlike e.g. poisoning prevention... Autonomous cars will prob. save many lives, but not nec best bang for buck re lives saved, if we *were* actually choosing problems that way. Much to agree w/ here (https://t.co/yzKmHxQZDo) but this isn't true - poisoning deaths alone > car accidents (CDC).. https://t.co/HVnCppGYbQ In several games where performance was subhuman in early 2015, it's now (super)human-level, but super going to super++ brings up up the mean Mean + median Atari data (vs human) from latest Minh et al paper. Insufficient data b4 2015, would be interesting... https://t.co/hYyKmSITCx @jimmfleming @sknthla but yeah, got your original meaning - need to read more about adv. nets soon! plenty non-advers. deep RL for now :) @jimmfleming @sknthla meanwhile, seems deep RL for Go is old hat- the cool thing is answering riddle interview Qs ;) https://t.co/U85Dkxp2IM @jimmfleming @sknthla sounds plausible - not that familiar w/ adv. nets, but I understood AlphaGo paper + it has no explicit refs to them :) Lots of new papers on arXiV (cuz ICML deadline, it seems) including some deep RL ones...will tweet about some soon :) RT @jeffbigham: those who study history, are doomed to think whatever trends they saw will continue forever https://t.co/mxX5g8pFoa @sknthla think adversarial nets about generating fake data (?), vs. DeepGo that used multiple normal versions of self playing each other... RT @NandoDF: ICLR 2016 accepted papers on learning representations https://t.co/dmdo5idlbG @smc90 @Aelkus it's a good piece :) @Aelkus bit more optimistic than when I first wrote that (late 2012) as there's a lot of good/relevant work being done, but def. still hard. Just watched the White Christmas episode of Black Mirror... so good. Probably my favorite episode. Rubio failed the Turing Test... #GOPDebate RT @hiskov: iRobot sells off military unit, will stick to friendlier consumer robots https://t.co/3g30CkwUGv +1 respondent says he has "trillion neuron synthetic brain" (compare w/ p. 26 of Bengio et al. book). Lol/sigh... https://t.co/kFmhlprYBk @hintikka disproportionately comfortable * @hintikka can't rule out that men are disproportionately with answering ill-posed questions ;) still, 32/32, expected imbalance but not 100% @hintikka I made sure to say "shown" versus "polled" :) When will the tech journalists wake up to gender issues? 32/32 respondents shown = men. https://t.co/1AJJnhqRYJ Explanation of the Labyrinth domain shown here: https://t.co/NDQYkpMrmT previously shown by Hassabis at NIPS. Ibid. https://t.co/5rfOIMLC8W Table comparing training times and human-scaled performance on Atari for several architectures(A3C=new stuff; Ibid). https://t.co/EHkzQk3uNI Key ideas of the new paper on asynchronous deep RL by Mnih et al.: https://t.co/jzQWxAQYSY Results are impressive... https://t.co/zh8xNJBM81 RT @dmarthal: @Miles_Brundage I'm waiting for an AI to beat Adventure Then maybe ET or Raiders of the Lost Ark. Going to need DEEP LSTM (or… Updated b/c of Alien+Amidar in @marcgbellemare et al.'s latest (https://t.co/NQ9Mph24gk). And Frostbite =.1% off. :) https://t.co/aurMZTEhIV @mark_riedl coconut, almond, + plantain? @jimmfleming At first I excluded stuff with direct access to game state (vs raw pixels)/"cheated" but now deep RL>cheating so may revisit :) @jimmfleming other methods as well - 1st, 2nd, 4th, and 6th are not. May visualize it separately at some pt but wanted to have > data pts :) Double Dunk might also need to be crossed off: weird case b/c human score worse than random. :) Anyway, human Atari supremacy = mostly over. As mentioned before, though, DM papers focus on 1 improvement at a time. Suspect their integration --> beating some or all of the remainder. Not shown in published DeepMind papers, at least, that is, or by others using raw pixels that I know of. Notable: no change at very bottom. List of Atari games (from Mnih et al. 2015) in which human-level performance not yet shown, with updates since then. https://t.co/cnujW3DqbP Top reported Atari scores over the past five years. Lots of caveats/differences of methods, etc. but illustrative... https://t.co/CXU9J6valh ...more important developments than raw Atari scores here involve more efficient learning, scalability, extension to new domains, etc. Redoing chart of prog. in Atari games in light of new paper. Initial impression is continued exponential improvement in some games, but... @hintikka but she's a woman, that's impossible ;) RT @samim: Asynchronous Methods for Deep Reinforcement Learning: MuJoCo Video: https://t.co/fict28Wfq9 RT @samim: Asynchronous Methods for Deep Reinforcement Learning: https://t.co/YaPnbmZVMy 3d Labyrinth demo: https://t.co/AtG4iapEpp via @Mi… Mnih et al. "Asynchronous Methods for Deep Reinforcement Learning" https://t.co/jzQWxAQYSY =AsyncRL paper I've been hyping :) Thoughts soon! RT @karpathy: "We are releasing the ResNet-18, 34, 50 and 101 models [for everyone]. We will release the 152-layer model when it finishes t… Training better sci-fi screenplay neural net, which I hope will eventually mention NNs (data includes term in Terminator 2, I, Robot, etc.). @davmre @janexwang think that one big uncertainty is how much they have improved it since October... @davmre @janexwang curious what your reasoning is... @janexwang AlphaGo. RT @demishassabis: Match days: 9, 10, 12, 13, 15 March - will be livestreamed on YouTube. More details soon. We are very excited to be comi… RT @demishassabis: It is a real privilege and honour to be playing the greatest Go player of the past decade, and a legend of the game #Lee… RT @demishassabis: Thrilled to officially announce the 5-game challenge match between #AlphaGo and Lee Sedol in Seoul from March 9th-15th f… @jsfour I took all (/one version of each, when there are multiple) of the ones from here that are in .txt format: https://t.co/zACUJxVwA0 RNN-generated sci-fi screenplay.. Not sure why it's obsessed with names from 12 Monkeys, think b/c first in dataset. https://t.co/okFx7NtI2a Early stages of an AlphaGo replication by Rochester-NRT on GitHub: https://t.co/FzGDA9MjJm @xululululuuum @samim ah, good connection :) haven't read the book but familiar with the idea/seen some funny things along those lines... "The Latent Structure of Dictionaries": https://t.co/nMmIezBGap ~1% of dictionary can define rest + must be grounded (but it's complicated). @hintikka yeah. wish I could be enthusiastic about this election... Interested to see what char-RNN makes out of a much bigger (and more diverse) dataset - sci-fi, classics, philosophy, encyclopedias, etc... @mchui Hello! Enjoyed reading "Four fundamentals of workplace automation"- have question about it/your ongoing work, how can I get in touch? RT @GaryMarcus: machine learning QA with Pedro Domingos - Including a sober look at deep learning https://t.co/VhHTaPw8Mo @dmarthal hmmm! 256/3 is training noticeably faster (epoch-wise, not real time-wise) than 128/3... @dmarthal 128/3 results after medium training not good compared to 128/2 long training, so trying 256/3/long training :) +sample along way.. @dmarthal doing 128/3 now. @dmarthal ended up cutting it short and running 128/2 overnight, seeing effect of running longer. Much fewer typos now :) See latest tweet.. Sci-fi-LSTM-bot is producing some pretty funny stuff after running overnight. :) Some samples... 3rd primed w "God." https://t.co/GS7vENPW2X @hintikka this https://t.co/4sD3oxdKyv in TensorFlow, based on Karpathy's character-RNN code. @hintikka my partially trained sci-fi generator LSTM's outputs are more coherent than that ;) @hintikka but this time it's her turn ;) @nsaphra ooooooh, awesome! Thanks! :) @dmarthal update: training slowly for my taste (though may leave big one running overnight)/loss is still very high so prob trying 3 layers. @dmarthal advice definitely welcome :) will test the bigger (in every way) model when it gets to the end of this epoch... @dmarthal suspect won't be as significant of effect as >data (went from ~1/3 MB to 12 MB text) but wanted to see effect on training rate too @dmarthal arbitrarily ;-) don't have fast rig for many experiments but default here was 2/128 https://t.co/4sD3oxdKyv + I changed to 8/256.. Now training deeper/wider RNN on few dozen sci-fi novels...would be few hundred but Project Gutenberg blocked me for downloading too much :( @Aelkus though he isn't that concerned about publication quantity these days. Not much lately - bet next ones will be pretty big... @Aelkus and interestingly, he has said the next 5 years will be his most productive... ...trying to figure out how to adjust the temperature to get more plausible outputs w @sherjilozair's char-RNN code- thoughts @sherjilozair? MilesRNNbot, primed with "Superintelligence" and set to output 200 characters... not sure what bottomization is. :) https://t.co/t6tqBfTvRw "RT @hyejin_youn: Our paper “On the universal structure of human lexical semantics” is finally out in PNAS https://t.co/9kAzsuvJhK https://…" Procrastin-AI-ting by training this character-level recurrent neural net on my publications - https://t.co/4sD3oxvlX5 Could be cool... @DJGagneDos ...it has low confidence in its guesses, at least, but would still love to play with a net that knew I was in the pic ;) @DJGagneDos yeah, interesting indeed. There are only animals and objects in the 1000 ImageNet categories it's picking from. Cool that... The ImageNet trained Inception v3 net is cool and all, but I'd like something that can recognize, ya know, humans instead of pandas, maybe.. Looking for trained TensorFlow vision NN w/ more than ImageNet categories. Inception 3 = unsatisfactory :) Thoughts? https://t.co/Te113iRqDh RT @Amirmizroch: This is gold https://t.co/5zBJOdWWla @mappingbabel thanks, listening. @mappingbabel any word/questions on robotics? @davegershgorn @mappingbabel disagree Go was unpredictable (see rant here: https://t.co/4Ynham5tcX) but yes, a ways to go! @mappingbabel answer? RT @Recode: Google surpasses Apple as the most valuable company in the world https://t.co/JYE7UOXwU4 by @nkulw https://t.co/n8TNuce1bI RT @joshuabrustein: Google lost $3.5 billion making self-driving cars, Internet balloons and trying to cheat death last year. $23b profit i… @alexjc dunno. could be coincidence. But interesting regardless that part of its improvement comes from neural nets...and less compute-heavy @alexjc some other factoids: it's in the top 100 players on KGS: https://t.co/zfoO3P71hn and player SarahConor is determined to beat it :) @alexjc yeah, and it is experimental per the bot's KGS user page - but that particular month, and there is KGS tourney every month.. @alexjc does not appear to be coincidence, for example. See long absence then return in January here: https://t.co/kRkIWeES85 @alexjc a few things on Zen19X. I had come across the name in looking at the recent tournaments, but upon some further digging, intrigued... @alexjc yeah, FB just example of academic-ish - one of two darkforest authors is at NYU) of early reaction - will be cool to see others! @alexjc makes sense. would/will be interesting :) notably, Facebook's bot is currently offline - maybe AlphaGo inspired version in few wks.. @alexjc I like Atari/multiple games as benchmark, personally, so interested to see where it goes. Maybe ALE expanded to support SNES etc? :) @alexjc yeah, good pt. on distinction btwn working on solving X vs X as benchmark for stuff applicable to X and non-X... @alexjc meant in comparison to # of people working on AI in general, not another form of game AI -dunno distribution but that sounds right.. "Long-term Planning by Short-term Prediction," Shalev-Shwartz et al at MobilEye https://t.co/SmCBfqbd5B with application to autonomous cars. @sknthla (against Occam's Razor, but same with other cases, I think?) +not sure flat earthers overlap much w/ intercontinental travelers... @sknthla maybe more complex if intercontinental. Depending on map, sometimes straightforward, other times pilot changes path over ocean :) @sknthla hmmm. I suppose if intracontinental flight, can just think you're flying on big disc and The Man won't let you go to edge. @sknthla a pretty severe one - but not sure it requires more conspiratorial mindset than e.g. Holocaust, moon landing denial... ...cf. earlier tweet on developing countries and AI/robotics. Would be nice to see this thinking integrated w thinking on int'l development. Many thoughts on White House Computer Science for All initiative: https://t.co/lERYhzGJHM but for now will just 1: "all" here = Americans... Cf. this from 2014 on why it's hard/scary https://t.co/Nge7p2TeOK Limited test domain, but in Wand case, evaluated on new speakers at least. "Lipreading with LSTM," Wand et al. https://t.co/ZK6GTjo6nW 79.6% accuracy. 11.6% improvement. Shallow dive suggests this may be superhuman. Lots of positive/negative potential for AI/robotics in developing countries. Policy will play big role in realizing former/reducing latter. Not nearly enough attn to impact of AI/robotics on developing countries. Work by @maosbot et al. good start though: https://t.co/i0scJnulm2 @sarahjeong https://t.co/2Q8w6xHS3A 5. Also room for improvement in learning rate, transfer learning in Atari, but not as fun benchmark after superhuman across board maybe? :) 4. Also lots of recent papers on MuJoCo tasks, videos of randomly generated enviros. How to formalize as benchmark? Legg's AIQ is one way... 3. Recent papers show isolated improvements over DQN - suspect combination yields superhuman scores in >90% games,100% wouldn't surprise me. 2. so while AlphaGo is huge accomplishment, I'm more interested to see how DeepMind benchmarks after Atari, or how Atari prog. redefined... 1. What next after Go for AI? Perhaps more interesting Q is what's next after Atari - not many ppl were actively working on Go before anyway Will be interesting to see how much AlphaGo improves between now (or, rather, a few months ago when Fan Hui match happened) and March match. Summary of a professional Go player's analysis of AlphaGo's playing style/skill: https://t.co/InEoZsOr1Z H/T @xuenay @beaucronin though Ahnald also said "my CPU is a neural net processor. A learning computa" ...though I think there's sufficient evidence already to think timeframe=soon enough to plan for + details=complex/very policy-dependent. Krugman on Gordon on growth: https://t.co/ijnfeQVrP7 IMO, AI/robotics almost certainly portend big change - only timing and details unclear. 25. play against version of self with (much) more time for MCTS rollouts at play time. Not sure how big of effect, but would be interesting. 24. ...learn from playing more advanced version of itself through aforementioned hardware scaling. E.g. instead of playing against old self, 23. They could give it more game data from other sources (esp. high level play) and particularly notably, use self-play/RL to essentially... 22. of its returns on hardware indicate it might get close to Lee Sedol level w/ that alone), but also in terms of data/self-play. E.g. - 21. Another thought on AlphaGo: one notable thing about it is its scalability. Not just in terms of hardware (my sketchy extrapolation... @vgr cool paper on user/content types here by @maidylm and others: https://t.co/dHgjv41iGo @mark_riedl @j2bryson @Aelkus actually new AFAIK. @mark_riedl @j2bryson @Aelkus hardware def was essential - wouldn't have beaten Euro champ without it - but also some other new things. @mark_riedl @j2bryson @Aelkus NNs and MCTS are combined, integrating that and RL/self-play, and last but def not least, hardware :) @mark_riedl @j2bryson @Aelkus yeah, NN+MCTS started a year or two ago. a few new things here - separate value/policy networks, the way.. "RT @alexjc: - You think AlphaGo could be your level? - Oh, yeah. I think so! [Myungwan Kim, 9p] #ai #ml https://t.co/au6LwZR49S https://t.…" "RT @alexjc: - AlphaGo plays with a Japanese style. - Do you think the training data was biased? (Both are surprised how human-like the bot…" @Aelkus @GaryMarcus look forward to reading more about that going forward and of course learning more about what @GaryMarcus is up to :) @Aelkus got strong impression there was something to it. @Aelkus yeah...Guha at Google/formerly Cyc said some smart stuff at NIPS about related hybrid stuff but forgot most/dunno which any pubs :/ @Aelkus yeah, the way it smoothly blends the two is very cool. @williamstome @sapinker @GaryMarcus ... AlphaGo w/o MCTS > prior best bots *with* it. Also agree w/ highlighting it not being end-to-end NN. @williamstome @sapinker @GaryMarcus def. agree w/ emphasizing that AlphaGo w MCTS stronger than w/o it, but I also find it noteworthy that.. @Aelkus agree worth noting AlphaGo w/ MCTS > without it, and NNs not trained end-to-end, but also worth noting AlphaGo w/o > others w/ MCTS. RT @shakir_za: New epside of The Talking Machines: .@open_ai and Gaussian processes. via .@TlkngMchns https://t.co/oCzq5OpIgd @tmosley4 @williamstome lol @hintikka lol. maybe some of them fairly don't trust the data to stay anonymous ;) or pride themselves as "free thinkers"... RT @williamstome: . @google why... should you really be encouraging me to ask people for their passwords? https://t.co/lMoFxdg4RF @samim for which there seems to be an (appropriately :) ) open page with free earlier drafts - https://t.co/Xjofyted2D @samim some folks there edited this pretty readable/slim book recently: https://t.co/GaNaCJBL4H Have read a bit, pretty good so far... Yes. Think former may (soon) dominate. Beyond training nets to automated eval of architectures, hyperparameters, etc https://t.co/gfwBmQUz9E @alexjc in retrospect, should have grilled him for more predictions - 3+ player poker, various videogame metrics, etc. ;) @alexjc yes, I also tweeted about convo last year w/ Michael Bowling who knows a bit about superhuman AI gameplay :) who said 5 yrs *max.* RT @alexjc: @Miles_Brundage To an expert analyst, it should not be shocking! In February we predicted 2020 as conservative "or before if Go… 20. In short, def. very impressive, but taking into account various complicating factors, not quite as shocking as some people have argued. 19. One last point: as sign of (prior + new) ML/NN progress, note that it outperforms all prior bots even w/o search (except maybe FB's). 18. all things equal, is more notable. (But all things aren't equal here because Go is indeed a quantitatively/qualitatively hard task). 17. (quality-adjusted) effort, as well. Big jump on a problem many experts have already tried hard at (e.g. ImageNet competition in 2012), 16. And to be clear, not saying hardware was sufficient, just necessary + worth accounting for in evaluation of how (un)surprising this is. 15. ...even for non-hardware/effort-adjusted trend. And, I should also add, quantitative forecasts generally fare better (per Mullins 2012). RT @alexjc: @Miles_Brundage You could measure this by letting other Go programs run for 1,000 times longer per move, but they won't reach A… @alexjc yes, my point was more about the threshold point than the scaling. Wouldn't have been sensible to attempt 10 years ago. 14. ..so considering that dan gaps at pro v amateur level (if I understand scale correctly) are smaller, 10+ years estimate was pessimistic. 13. There may have been recent slowdown, haven't looked closely yet, but people had projected superhuman performance around now beforehand.. 12. So, controlling for effort and compute power, the progress isn't as shocking. Also, progress was already at a rate of ~1 stone/year. 11. Only very recently did a non-trivial number of top researchers work on this, and only months ago was massive compute power thrown at it. 10. The 2nd is a purported discontinuity in Go performance. However, see e.g. the point I make here re: "states." https://t.co/nnO4dtYs4O 9. One is expert opinion, of which I'm not aware of a rigorous, broad effort to elicit beforehand and which is known to be bad at this task. 8. But as alluded to before, should this really be super surprising as some have said? Arguably not. Two args have been made for why it is.. 7. ...where the difficulty includes not just easily quantifiable factors like state space size but also complex strategic trade-offs. 6. It shows an increase in the difficulty of tasks that are amenable to modern machine learning techniques (even w/o search, v. powerful)... 5. What *kind* of progress does this represent? Most obviously, it's progress on a specific, but hard, task. But broader significance, too.. 4. in terms of parallelization and esp. GPUs - not achievable decade ago. Software advances needed to use that hardware efficiently, though. 3. AlphaGo demonstrated some prog. in itself, but also built on various earlier prog. in MCTS and NNs. Highly dependent on hardware, both... 2. Playing Go is hard. How hard? Not AI-complete/-hard. Harder than chess in state space size and multiple cognitive abilities-needed sense. 1. Since I'm giving a talk soon on AI progress, I guess I'll have to say something about AlphaGo there. :) Rough draft of some key points: ...this is per update to Facebook's arXiv paper a few days ago, esp footnote 6 (KGS site on that tourney currently down. Also, bot offline). ...will also note that in slight twist to DeepMind/Facebook narrative, Facebook did in fact (for a few days ;) ) have best reported Go bot.. Upon looking at the AlphaGo paper again, noteworthy that even without search, AlphaGo is well above Crazy Stone, Zen, etc. that do use it... @alexjc non-trivial, certainly, though :) ~ this much solar: https://t.co/6B1Du9oNzM @alexjc think you maybe got decimal or letter wrong? :) 114 kW * 10 = 1.14 megawatts. @sknthla my brain hurts processing this. @kleinsound agreed. There's also AGI but I agree w/ @j2bryson's points here: https://t.co/cduh6tUjwX +Strong AI has philosophy baggage... :/ Despite superintelligence being pretty vaguely defined, it's still better defined than human-level AI. Prefer multi-factor model of AI prog. It's not *impossible* to compare AIs to humans overall--e.g. via Legg/Hutter's def.--but factoring intelligence helps model/grasp progress. ..but still bugs me. Working on formalizing some related ideas/alternative terminology, and it's hard to eschew HLAI, but I think necessary. Few things that bug me: calling everything a robot. Saying X is "step toward AI" (hey, you use AI daily). "Human-level AI"...HLAI least bad, @sknthla would be interesting to compare trajectory discussed therein to others doing alternative paths to sci/tech, e.g. Thiel Fellows... @sknthla to be clear, I doubt that (overall at least), but it's def not unalloyed good in some cases, e.g. some data https://t.co/ePnr5ykpOG RT @AndrewYNg: Have a question I can help answer? Post it here, and also see what others are asking! https://t.co/ubT5ObN2Nk @traviskorte @Aelkus and, of course, not work on harmful things. Moore's book is good read on many related issues: https://t.co/5Jx9lXfI0Q "Go, Marvin Minsky, and the Chasm that AI Hasn't Yet Crossed" by @GaryMarcus: https://t.co/A24asFv8fn @tmosley4 would be interesting :) Interestingly, 1 of folks involved (David Silver) has done work on AI for Civilization before. cc @Aelkus @Sam_L_Shead @mappingbabel 15 ppl at DeepMind was a reference to a comment by David Silver in one of the videos they put out on site. @Sam_L_Shead @mappingbabel they may well have thought they would win, but far more ppl at DM w/ background in computer Go so not surprised.. @Sam_L_Shead @mappingbabel I had in mind Tian's co-author on the relevant paper (https://t.co/KQzwfC6vit) but don't know his involvement... How long until AlphaGo is replicated? 3, 2, 1.... I'd love to see how versions of it perform in other domains. @Sam_L_Shead @mappingbabel plus the FB one was online to play against on KGS the whole time. Though I see it's down now since announcement.. @alexjc ah yes, good point :) @Sam_L_Shead @mappingbabel *if* a race, then not a fair one ;) two ppl at Facebook publishing as they go versus 15 in private at DeepMind... @alexjc ...the cluster, let alone >, plus the > time, would more than suffice to push the line past 9p... though it's also a naive model :) @alexjc I bet they do, and 2 months to prepare is a long time in AI terms ;) but you could also read this graph as to say a 2x scaleup of... Sketchy extrapolation of AlphaGo from 2 sec to 5 min/turn, assuming continued diminishing returns to computation... https://t.co/XwYeEMsQos RT @alexjc: @Miles_Brundage It's hard even with a simple problem using MCTS, here complexity is higher. But they have team of experts on bo… RT @alexjc: @Miles_Brundage It's actually surprisingly hard to do this kind of pondering effectively with MCTS. If one minor detail changes… @alexjc if that good in 2 sec, then with 5 mins, sheesh ;) @alexjc prob much more than pondering from way u put it. So I take Fig 4c in paper to indicate it's perhaps superhuman already... @alexjc yeah, was gonna say - I don't have good understanding of the issue but suspect they'll figure it out ;) think >2 sec will be huge... Paper doesn't indicate if already enabled (or I'm missing it), and if not, = another way to improve. So, again, scalable/powerful methods. Also, enabling pondering (in this case, =running searches/network queries while opponent thinking) would also improve performance. So, interesting data from simulations but for estimating March match outcome, >2 sec per move would seem to lead to much better performance. ...less scalability/more strongly diminishing returns on hardware than there really is bc only 2 sec per move. In real match, more scalable. ..through lambda value tweaking, and empirical evidence that both contribute. Note for those who read it that Figure 4c, I think, suggests.. Among other interesting aspects of AlphaGo paper - multi-stage training procedure, value/policy networks, smooth blending of MCTS and NNs... DeepMind AlphaGo paper is very interesting... https://t.co/tXz85ahGgC AI prog. not perfectly predictable, + prediction overrated (robustness better), but hard to do either w/o trying hard, building models, etc. In fact, some did that extrapolation years ago: https://t.co/Lj79tVrgUO DeepMind accelerated, but not sure 10+ year estimate was justified.. ...would happen in not too distant future. +Not sure how scientific polls done were. Also, reasonable to assume >effort would accelerate.... Don't nec. agree AlphaGo victory v unpredictable- extrapolation of long term trend (vs notoriously unreliable expert poll) indicated this... @rcalo not top rated overall (500somethingth), just in Europe - playing overall top rated in March. The techniques they're using are pretty scalable, no reason to think human pro skill level band occupies big fraction of total scale, etc. I'd be pretty surprised if AlphaGo lost in March. RT @demishassabis: We made the front cover of Nature! Details here: https://t.co/v6CSHelVTC #AlphaGo #DeepMind https://t.co/bugshPxb4q @alexjc looking forward to reading the paper(s)! :) @Aelkus Ishiguro's highly physical but braindead robots [the famous ones, at least - lab does other stuff] and being kinda nonplussed. @Aelkus autonomous robots are in sweet spot of impressiveness, perhaps... physicality + autonomy. I'm thinking of, as contrast, seeing... @Aelkus sufficient (for impressivenss) but not necessary, maybe... dunno. Speech recognition at tipping point of near-perfection soon helps. @Aelkus dunno,could see Google Now/better Siri/Cortana etc. being impressive to many ppl pretty soon. Agree physicality helps, but not nec.? @Aelkus I'd love for AAAI open house event/equivalent to happen all over the place. Sharing space w/ robots navigating through crowds, etc. @Aelkus yet ppl still point to that as explanation even if false...can't really win with some ppl, and goal posts constantly moving... @Aelkus what's scientifically interesting diverge. As with Watson, Atari (despite pop belief), effort taken to avoid "reaction time" arg... @Aelkus yeah, I discussed this at some length w/ folks involved in Atari stuff and in video game journalism... what would impress gamers vs. @Aelkus beyond 1 game, people think that learning from experience is impressive for machine. So that + impressive game = double impressive. @Aelkus yea. Still, what I do know is I've been able to explain to various lay ppl the impressiveness of Atari/DQN results w/o much trouble. @Aelkus has it really risen that much outside of tech pressAI nerd circles? @Aelkus ...in getting attention for this stuff. Atari results got attention, too, and ppl "got" the learning part of it being impressive. @Aelkus will be interesting to see what ppl say about Go, considering most in West unfamiliar w/ it. But yes, cachet of board game helps... + because the methods used to achieve it are broadly applicable/general. Given that that's DeepMind's MO, expect it'll be more or less true. Also worth remembering that Go bots have been better than *most* humans for a while. Insofar as Go bot news is significant, it's mostly so+ @alexjc yeah... looking forward to this https://t.co/vxzEBcyJLK [see followup tweets after] at which point I may stop tracking the scores ;) RT @nathansttt: .@Miles_Brundage @alexjc 3+ player games can't be solved in the same sense as two-player zero-sum games. Totally different … @alexjc not sure re: Quake. Also cool besides general game playing would be list Atari equivalent (50-100 games w/ common interface) in 3D.. @alexjc hmm, Quake? There was IBM's simplified Wolfenstein (which I called Quake but wasn't :) ) and random 3D mazes at DeepMind... @alexjc I think the General Game Playing Competition is great for gauging/driving progress, but hard to interpret prog. in human terms... RT @alexjc: @Miles_Brundage RTS AI will last longer, partly because it's a poor (proprietary closed) framework to develop AI. See Starcraft… + Heads up limit hold em is solved. Once Go falls, some may say human-machine teams beat machine alone, but as in chess, won't last forever. Haven't studied the poker case closely but my takeaway from the recent pros/AI match (https://t.co/qS4c0DxMQj) is that it's pretty close... So, what's the game people will point to post-Go as sign AI isn't that advanced? 3+ player Texas Hold Em? That'll last a few months/years ;) Updated Tian/Zhu FB Go paper https://t.co/KQzwfBOUqV stable at 5 dan lvl, almost won computer Go tourney but for bug, areas to improve, etc. RT @eboyden3: As a young neuroengineer, some of my formative interactions were with Marvin Minsky. Thanks, you will be missed: https://t.co… RT @SebastienBubeck: Stay tuned for an upcoming big news... Hint: https://t.co/rWVzVLc76a " Long Short-Term Memory-Networks for Machine Reading" by Cheng et al.: https://t.co/p5gKwpO7cT LSTM w/ memory tape, SOTA on few benchmarks. Impressive new paper by van den Oord et al. at DeepMind - "Pixel Recurrent Neural Networks": https://t.co/iVkwPCxpzI https://t.co/yGNik0cHOV RIP Marvin Minsky: https://t.co/Zozm7Dv9g2 RT @alexjc: Facebook's Go AI bot after playing ~1 month on KGS servers is stable around 5 dan (advanced amateur level). https://t.co/sPm6Xh… @starsandrobots no prob! @starsandrobots + Inventing the Future is a book I'd highlight as giving a very different take on what to do about the issue for comparison. @starsandrobots beefs w/ it here: https://t.co/rVkqVttNSQ Characterization of (future) AI progress also a bit weak but that's hard problem.. @starsandrobots Second Machine Age is worth reading - good overview of the lit. + plausible args for view, clearly written. Wrote abt some.. RT @erichorvitz: Microsoft announcement of several Cortana advances, including recognizing commitments people make to others: https://t.co/… DARPA Robotics Fast Track program funds Spanish corp Erle Robotics to make "Hardware Robot Operating System (H-ROS)" https://t.co/XIq0InGLZm (or short-sightedness, or lack of awareness/interest, etc.) More generally, how can idea of AI for common good be realized? What's missing? ...across space of possible applications, in part bc human capital. Key Q going fwd - what beneficial AI apps don't exist bc profitability? Noteworthy, though, fast AI diffusion/adoption is for *specific* applications. Even hot AI tech like neural nets still not widely deployed.. Fast diffusion/adoption of AI results from many factors - digitality, same orgs doing R+D and deployment, iterating deployed system, etc. Very struck by time from invention to diffusion in (some aspects of) AI. Compared to e.g. energy tech, 1-2 orders of magnitude faster. @danieldewey suppose he could have been uncertain about and said diff. things in diff contexts while hedging bets...haven't studied closely. @danieldewey yea, hard to prove definitively, but I found it pretty plausible. Not sure how else to reconcile the "keep an eye on it" thing. "Atomic Energy is “Moonshine”: What did Rutherford Really Mean?" Jenkin 2011 https://t.co/T5igR81Pv1 TLDR wanted to slow/postpone arms race. RT @graphific: slick interactive Node-Link Visualization of Convolutional Neural Networks by Adam Harley: https://t.co/g56fl82kVQ https://t… RT @ekp: Only 8% of Bay Area startups funded in A rounds had woman CEOs in 2015. That's a 30% drop from 2014 to just 16 cos https://t.co/Ec… Lessons from the Amazon Picking Challenge: https://t.co/vZdIfkAzyj Many teams used suction, system integration hard, > automation soon, etc. @mappingbabel shame Albus died in 2011. Would be big voice in AI/inequality discussions - wrote 1st book on spreading robot wealth in '86.. @mappingbabel long Atkinson: https://t.co/QA2vowD8a2 short: https://t.co/lJEM2t6Z4H long Albus: https://t.co/g4VHukZqxq short: dunno... @mappingbabel the point on capital IMO is reason to (among many other things :) ) share capital broadly a la Atkinson, Albus, etc. RT @alan_winfield: But importantly full consensus on the profound dangers of lethal autonomous robots weapons. RT @alan_winfield: Wow, that was tough. Panel on robot weapons with 3 brilliant panellists - far more persuasive and eloquent than I. https… @samim sure, sounds fun :) @samim thanks! I'll do my best :) RT @samim: Goldman Sachs: "We're investing deeply in artificial intelligence": https://t.co/0sozm1xB93 who, why, what, where? https://t.co/… RT @AIImpacts: A guest post by Ben Hoffman: Human organizations as a reference class for forecasting superintelligence behavior. https://t.… List of IJCAI 2016 workshops: https://t.co/iNusGdb4GN @mark_riedl not familiar enough with Dune, but is it a similar idea to an "artilect war"? https://t.co/VFd3Nn3tB9 RT @WBUR: 2015 shatters record as warmest year, NASA and NOAA say: https://t.co/DLfyxHBbJe https://t.co/XCHZNIX2dR RT @mustafasuleymn: Alibaba & Nvidia partner on $1bn cloud/AI platform. https://t.co/YPAmES5KnW If I were writing the aforementioned paper (or some others) again today, I'd def. engage w/ Inventing the Future (https://t.co/OYuieUA35U). ...TL;DR utopia(n/nism) isn't a dirty word/helps critique status quo, justice is complex, current AI-utopias are underdeveloped/problematic. For anyone bored and interested in the literature on utopianism, I put a class paper on utopia and AI up on my site: https://t.co/NEhmjDxWxT Yoshua Bengio has started answering (a lot of) questions on this Quora AMA: https://t.co/1WUY1zGXjR @danielas_bot congrats! RT @antonioregalado: The CRISPR COI submitted by Eric Lander to @cellcellpress. A bit better, thanks to footnote. Cell shudda listened . ht… @jathansadowski @FrankPasquale NP! would enjoy discussing AI rhetoric at some pt - wanted to write "superint. + democracy" but no time :) @hintikka :( @hintikka oh God. Is it late enough in the process/is he doing well enough still that I have to think about general election scenarios? :) @jathansadowski @FrankPasquale or, rather, not so much "onto something" since not best case, but articulates common if often unstated views. @jathansadowski @FrankPasquale see also https://t.co/V0XdCAoM90 suspect u'd also see as fanciful but onto something re rhetoric at least IMO RT @AliMattu: My post-traumatic growth: https://t.co/bHBhIaaAde @j2bryson unfortunate Gingrich killed US equivalent :( @hintikka er, I guess I mean the way he uses it in general, not just his weird quoting style. Oh, and retweeting a neo-Nazi. There's that... @hintikka not sure what's funnier re: him/Twitter use: his yes-people don't correct him re: how to use ""s, or his interns copy his style... """ Engineering Safety in Machine Learning"" by Varshney: https://t.co/squLHQP2TT Epistemic uncertainty minimization as goal 4 safe ML. Hmm.." Related to last tweet (both involved TrueNorth chip): "TrueHappiness: Neuromorphic Emotion Recognition on TrueNorth" https://t.co/Dd5GyuSB7Q "Conversion of Artificial Recurrent Neural Networks to Spiking Neural Networks for Low-power Neuromorphic Hardware": https://t.co/HsgaV9CqpS "SimpleDS: A Simple Deep Reinforcement Learning Dialogue System" by Cuayahuitl https://t.co/AskuqwV2zj Open source, pretty cool. Trying now. @sknthla or Law of Peoples or someone else's on related issues (say, Real Freedom for All by van Parijs) maybe better use of page difference @sknthla might want to consider Justice as Fairness, more concise/polished than Theory of Justice. 1 of his other books(e.g. Pol. Liberalism @hintikka lol. wow... @beaucronin yep...skeptical of their % contribution to total future AI progress, but expect much continued wow-ing: https://t.co/b5vSfXUfvD RT @lawrennd: The third post brings a bit of levity: ML/AI as a Greek tragicomedy: https://t.co/crO5vX6bqG #futureAI RT @lawrennd: The second overviews the 'quiet revolution' in ML when industry first came to us: https://t.co/Gfi4yYF0aj #futureAI RT @lawrennd: A new series of blogs giving my perspective on the AI/ML landscape. Here's the 1st: https://t.co/VOKWb97MZH #futureAI @kleinsound not really, have thought more about NGOs/govt, where my experience lies more. philanthropic arms def seem worth pondering! @samim @kleinsound should def talk more! will ponder optimal formats,+feel free to email anytime (first dot last at https://t.co/SRwG9mm9cZ) @hintikka yeah, funny, that's one of the analogies that got me thinking again about this topic (IP discussion here https://t.co/M79zf4cYJI) @hintikka of course, plenty of folks don't nec. *want* academics to have options...so, yeah, the politics are tricky. @hintikka long been proponent of this for additional reason to the aforementioned problem-solving ones -give academics non-defense $ options @hintikka ah - well, any significant push not from DOD/the intelligence community would make me happy ;) less opinionated on details... @hintikka what do you mean by last part? "they", "trad'tl channels"? @hintikka don't know enuf about them to speak to their political savviness, legislation, etc. ARPA-E has done well with Dem +GOP Congresses. 14. Anyway, =some stuff I've been pondering for a while/semi-related to paper working on w/ @j2bryson. Might flesh out eventually. Thoughts? 13. ..existing efforts like @USDS. If new agency, would need legislated ability to hire quickly, pay well etc a la ARPA-E to attract talent. 13. Some of this could be done now, some would need new legislation (maybe an FRC a la @rcalo would help), and/or could be extension of... 12. ..to be more productive and effective w/ AI/bots, tie gov't support to doing this in an ethical way (would need to be fleshed out obv.). 11. In addition to such R+D (emphasis on D, and demonstration), automation version of ag/manufacturing extension. Help corps/cities/NGOs... 10. Social benefit, not likely to be profitable soon, + reducing long-term gov't deficit (e.g. health care - would also help politically). 9. A first approximation of such an approach: R+D funding via NSF, NIH, DOE, etc. for tackling grand challenges, with criteria such as... 8. Such a role might differ from e.g. energy R+D policy bc GPT nature of AI. More focus on application a la agricultural extension programs. 7. These considerations have been leading me to think for a while that role for gov't needed. More focus on non-defense AI/bot applications. 6. In e.g. climate case, tech progress not unalloyed good (https://t.co/NZsODGLrsY). AI may help poor ppl while also increasing inequality.. 5. Perhaps OpenAI, for example, should be more focused on exploitation than exploration. For many problems, time running out/people dying... 4. The linear model of gov't (/corp) R+D in, auto-fix of social problem out, has long been debunked, raising Q - whose job is it to do this? 3. AI is an (increasingly) general purpose technology (GPT) in the economic sense but for foreseeable future requires ppl to apply to probs. 2. Some are, but solving such probs isn't always profitable, and corps (funding much of AI) have to concern themselves with such things. 1. If AI were to (help) address big problems like poverty, health, climate, etc., people would have to actually make those applications... Good panel discussion at NIPS 2015 Symposium on Brains, Minds and Machines: https://t.co/br70NfJe1v @j_winterton :) @rbhar90 will be interesting to see how ICLR 2016 open review process is received...also, that new site for paper reviews? forgot URL... TL;DR: NASA/ASU/Boston Science Museum etc. took samples of public, taught em about asteroids/Mars, etc., discussed options, + NASA listened. For a very different model than Asilomar/recent AI stuff, see e.g. the recent NASA public engagement on asteroids: https://t.co/7UpgOTEKhb """CRISPR Democracy: Gene Editing+Need 4 Inclusive Deliberation""Jasanoff et al https://t.co/M79zf4cYJI Probs w Asilomar model; relevant to AI" @hintikka (though still largely true, that you prob. need DOD $ to do large scale work, if you want to stay in academia, at least) @hintikka DOD thing is v. interesting to me in AI context - was once more true there, but w/ rise of corp. AI, diff constraints/affordances. @hintikka indeed. will be discussing both in a paper in progress :) """The Moral Failure of Computer Scientists [on Encryption],"" Rogaway interview: https://t.co/OCHRKqUaxY Ref'd paper: https://t.co/Tehcv08UZ7" @tdaxp @Brett_Fujioka @Aelkus @eirene_inc under many defs, much can be taught w/o much math. ideas of algos, iteration, tractability, etc... @tdaxp @Brett_Fujioka @Aelkus @eirene_inc not nec. fully mature/uncontroversial in details, but to experts on it (not POTUS), not as vague. @tdaxp @Brett_Fujioka @Aelkus @eirene_inc computational thinking has been defined/operationalized (refs at bottom https://t.co/BOWt40dlq1) @hintikka and certainly don't think too hard about this https://t.co/1l6Pi52TdM lest you go mad. @tdaxp @Aelkus @Brett_Fujioka by investment I mainly mean in recruiting/paying/training teachers, buying robotics kits, etc. not new tools. @bradneuberg definitely seems to be the motivation to do so and unlike say North Korea (https://t.co/zCK3coQz1C), state is tech savvy enough @bradneuberg not something I've looked at in depth, but there's some discussion here: https://t.co/QVsysBI8pK +here https://t.co/ExkeE6OrCX @mappingbabel @vkrakovna well, I hope something tangible/public comes from it eventually... Puerto Rico conf. set a high bar ;) @vkrakovna will there be any writeup of the other days after Monday by any chance? :) @Aelkus @dansblog1 @rmehlinger @Brett_Fujioka and policy makers should be clear about goals/metrics (computational thinking? coding? etc).. @Aelkus @dansblog1 @rmehlinger @Brett_Fujioka yes, so let's not bullshit CS ed. If going to supply to all kids. start planning scale up now. @Aelkus @rmehlinger @Brett_Fujioka yes, agree. Doing right requires hands on teaching/motivation/differentiation across students..nontrivial @rmehlinger @Aelkus @Brett_Fujioka I agree - do not think mandating CS ed without big investment in training, resources is justified. @Aelkus @rmehlinger @Brett_Fujioka rewarded for effort, exploration - not binary achievement of specific coding assignment. @Aelkus @rmehlinger @Brett_Fujioka actual good K-12 CS ed does encourage exploration. I had kids doing creative projects in Scratch... @Aelkus @Brett_Fujioka Khan Acad not really justified based on research, vs much CS K-12 that is. but yes, no silver tech bullet for ed... @rmehlinger @Brett_Fujioka @Aelkus yeah, I taught class that was semi self selected (elective) but for the few unengaged students, was hard @Aelkus @Brett_Fujioka some combo of analogy w other science ed args, long term econ growth, + capacity to understand modern world better. @Aelkus @Brett_Fujioka not advocating the awesomeness view or SV wage arg as bases for policy. if any good args exist, to me they're prob-- @Aelkus @Brett_Fujioka this is awesome, why doesn't everyone get to experience it? slash tech as panacea/future of economy, etc. assumptions @Aelkus @Brett_Fujioka agree that's good for them long term, but also think there is strong influence of techie projection of identities, @Aelkus @Brett_Fujioka diff motivations may lead to diff prescribed details (e.g. coding vs basic principles)... @Aelkus @Brett_Fujioka that would be good for Google etc's interests. But not zero sum IMO - multiple args, issues, interests at stake... @Aelkus @Brett_Fujioka ...presumably inclusion of evolution, ecology, genetics, etc. had similar movements behind them(/still face pushback) @Aelkus @Brett_Fujioka fair Q, but again, folks like Papert made related cases long before tech bros, and education has changed... @Brett_Fujioka @Aelkus agree, but teaching conservation of energy/mass, cars use combustion, etc. good even if none/few become mechanics... @Aelkus @Brett_Fujioka or dwell on low level... don't know what should be taught, but idea of algos as underlying computers seems good start @Aelkus @Brett_Fujioka and I only mentioned general ideas of computation bc I wanted to. surely many bad teachers just make em code rt away @Aelkus @Brett_Fujioka before introducing kids to high level languages like Scratch which most were able to do impressive stuff with quickly @Aelkus @Brett_Fujioka depending how you draw boundaries of box, I agree. Only V briefly discussed idea of non-digital comps, universality.. @Aelkus @Brett_Fujioka something to that, but again I'd make plug for Scratch(etc.) 2 introduce high level concepts wo much low level detail @Aelkus @Brett_Fujioka agree after school valuable/considering income key (I taught at low income charter school).comp at home def not given @Aelkus @Brett_Fujioka I don't have strong opinion re: make available vs. make mandatory, but even former requires big investment... @Aelkus @Brett_Fujioka to be addressed if/when this were mandated. in NYC, 10 year delay til mandate = plausible... @Aelkus @Brett_Fujioka not sure we actually disagree much - key pt of thing I may write on this is massive resource/human capital shortage.. @Aelkus @Brett_Fujioka why reading centric? Would do research before advocating proposal but my exp suggests vis programming, robots helpful @Aelkus @Brett_Fujioka I don't have full theory, but many pubs laying out plausible lists of things we take for granted that many don't know @Aelkus @Brett_Fujioka now that, I think, is interesting issue to discuss - what should(n't) ppl know abt CS, distinct from coding praxis... @Aelkus @Brett_Fujioka again, sympathetic to that but learn to code bros != CS advocates, args for comp thinking long standing.. @Brett_Fujioka @Aelkus I'd add that the way it's done well today is not like that. Curiosity/play/problem driven, connected to interests... @Aelkus @Brett_Fujioka when I was preparing related class, much of best material was decade+ old, long before current fad. @Aelkus @Brett_Fujioka there being hot fad supported by some in bad ways for bad reasons doesn't undermine long-made args for comp thinking. @Aelkus @Brett_Fujioka yes, if this is done, should be based on relevant science, lessons learned, pilots, etc. Not mandate from on high @Aelkus @Brett_Fujioka and nontrivial effort to make something along those lines happen is worth considering, not reject out of hand @Aelkus @Brett_Fujioka and prob other changes to address the tradeoff issues you raise. Just endorsing idea that comp thinking =v desirable, @Aelkus @Brett_Fujioka agree - sort of happened to me w/ math. Mandating shouldn't happen w/o huge investment in training, incentives, etc.. @Aelkus @Brett_Fujioka yeah, I don't endorse the techbro arg for it. My arg is that impt. part of science and to understanding modern world. @Aelkus @Brett_Fujioka longer day, less summer, higher teacher pay etc. Think it's potentially very good part of overall ed improvement. @Aelkus @Brett_Fujioka yeah, i'm not proposing straight substitution/replacement. if we're talking ed changes, should also do other stuff... @Aelkus and doesn't require math...I taught basic idea of algos and some stuff in Scratch. computational thinking != mad programming skills @Aelkus def don't endorse cutting other stuff. in my case it was after school or instead of dance/etc. Scratch addresses pt on documentation @Aelkus @Brett_Fujioka ..taught is not that "technical" (though good to have such options when possible)- I taught middle schoolers Scratch @Aelkus from reading your convo w @Brett_Fujioka, seems you assume CS ed = programming = adult prog languages. my vision/way it is usually.. @Aelkus what's your reasoning? may write something about this at some point as I briefly taught it in middle school, learned some stuff... RT @j2bryson: Patiency is not a virtue https://t.co/a9QMAACZWk New! improved! for AAAI ws & spring symp on ethics&morality. Why make #ai a … @alexjc makes sense! @alexjc absolute final error rate not nec. that revealing, but large difference in speed of decline could be... @alexjc hmmmm... seems like 1. is easier to evaluate, and/or visually compare learning curves after running for fixed time/# of epochs... @alexjc nice! 7. Plausible fast neural net applications: ~instant/superhuman speech recognition, ~instant/decent natural language generation from video. @jedgar thanks! 6. These are just rough ideas currently - may do more rigorous calculation with error bars at some point. Point is, expect much NN progress. 5. If that were off in the slow direction by an order of magnitude, still a big speedup - if on the faster side, super crazily significant. 4. Seems like a not too crazy projection is that in, say, 3 years, neural nets will be 100x faster to train, w/ big impacts on applications. 3. And that's all just from hardware - algorithmic advances have also been rapid in recent years, though I haven't yet quantified that rate. 2. This would affect, as prior hardware improvements have affected, three things: attainable performance, speed thereof, and iteration pace. 1. If Nvidia's Huang is right that GPUs will be 10x faster in "the next few years," neural nets will speed up a lot: https://t.co/TJx0MUnYbz The AI ethics workshop/symposium/conference singularity is near. One at IJCAI: https://t.co/wq02VMPrP4 Might have to attend IJCAI this year. @mappingbabel will watch later, sad to have missed! But not stunning that brand new architecture confusing...NNs too but getting better. RT @mappingbabel: @Miles_Brundage 'it's v hard to understand whats going on, except something is happening' when NTM GPU does addition http… @mappingbabel I'd also paraphrase Hinton - humans horrible at explaining themselves, can at least prob. do *better* w/ engineered NNs :) @mappingbabel /more scalable ways of understanding/querying them than that. @karpathy's short story is interesting on related issues :) @mappingbabel yeah. I hope by the time systems are much more capable, NNs will only be small part of systems, and/or we'll have better/... @mappingbabel ...systems eventually when they're more capable. @mappingbabel true, though most (/all?) folks who do AI safety research aren't worried about NTMs//hope we'll have/use more interpretable... @mappingbabel several of the talks/posters here are on related issues, for example - https://t.co/vL41OInMBJ @mappingbabel maybe misinterpreting, but why do you assume the systems are nec. uninterpretable? Much work is precisely on preventing that.. @j2bryson @mark_riedl @mappingbabel Doing again, I would look at >course titles, use other metrics, go beyond first few Google pgs, etc. :) @j2bryson @mark_riedl @mappingbabel just looked at "intro to AI"-titled courses. not rigorous search/analysis (though may do at some pt)... RT @vkrakovna: NIPS videos are back up! Time to download them in case they disappear again :) https://t.co/svkSwbcph0 @bradneuberg Towards Principled Unsupervised Learning and Policy Distillation were cool. RT @CSPO_ASU: Deadline is approaching for SFIS' essay writing contest for undergrads-prize of $1K: https://t.co/Slmnf8tMlx Innovating for E… @williamstome thanks, will check it out! :) RT @YahooLabs: We're very proud to announce the release of the largest-ever machine learning dataset to the research community https://t.co… Good to differentiate AI progress drivers (algorithmic progress, data, hardware, etc.) from competitiveness factors (e.g. proprietary data). Biggest beef with common claims re: AI progress is monocausal explanations. V. clear it's not *just* algorithms, data, or computing power... @JenniferLee99 @beaucronin I did. It was released after my tweet above, but I like it. Ultimately, I hope AI progress will be taken as seriously as an object of study as e.g. solar is (see NREL's work: https://t.co/B8FBq6ztU2). Definitely hope to have at least one more publication on AI progress, laying out specific quantitative theory of it/some simple projections. Increasingly convinced there's much low hanging fruit for modeling AI progress, but TBD how much of that I'll do myself, cuz other stuff... @hypatiadotca Blunt Advice; High Security; High Tech Security... @hintikka I saw Friedman live once, pretty sure I got nothing out of it.. @hintikka yeah, Toffler evinces some uncertainty/lack of understanding ;) vs. Brooks - ~every article is "people/things are either X or Y.." @hintikka could totally see this (from 1970) being written by him and/or Brooks today... https://t.co/2EmueHiypZ @hintikka I'm reading part of Future Shock by Toffler for a class right now and he was kind of the Thomas Friedman of his day...v hedgehogy. @hintikka lol almost all of that is demonstrably false... Is that all? ;) From the Robobarista paper: https://t.co/7QL2oUQOSC https://t.co/JCvQp7jTZC @KaiLashArul yeah, here are some: https://t.co/s4qgb06nQ5 Second Machine Age + Robot Futures most accessible, Superintelligence later maybe. 8. Found some such analysis (e.g. https://t.co/O04OOrQYFC …) but where data is (nearly) sufficient presumably b/c problem choice non-random. Qualitative sidenote on machine translation prog.: tried Spanish-English translation for the first time in 15 years or so...WAY better, wow. @alexjc good point! Will see what I can dig up :) 7. Another potentially interesting line of work would be testing algorithms on a range of data set sizes and projecting impact of more data. @alexjc that'd be cool! In some domains, algo progress is surprisingly smooth on long timescales https://t.co/ONHyS4BAlJ but dunno re: NNs.. @alexjc thanks! :) 6. it looks like in ~2/3 of Atari games shown, increased hardware speed/training time would lead to better performance (others ~plateaued). 5. The flip side of this is projecting curves forward, i.e. what if more hardware? Looking at the "Prioritized Experience Replay" paper, ... "Intuition, deliberation, and the evolution of cooperation"- Looks interesting. https://t.co/TLYl9wYEg8 H/T @nsfaber https://t.co/aPyMiL3SMk Also intrigued to see that Ashutosh Saxena has a startup (listed as affiliation in paper). Acquired for a bajillion dollars in 3, 2, 1... Among other cool parts - "our robot with our model can even prepare a cup of a latte with appliances it has never seen before." More soon.. Impressive paper by Sung et al.: "Robobarista: Learning to Manipulate Novel Objects via Deep Multimodal Embedding" - https://t.co/7QL2oV8pKa 4. Rough idea - assumes fixed time for training, ignores GPU vs. CPU (hence may underestimate hardware contribution), etc. But interesting.. 3. E.g. I took a learning curve from He et al.'s ImageNet winning NN paper and added Moore's Law-based dates to it. https://t.co/Z7pIgZOopO 2. But there's no need to really do those tests in some cases. You can use current data, specifically learning curves, e.g. for neural nets. 1. One way to evaluate the impact of hardware improvements on AI progress is looking at how modern algorithms would perform on old hardware. RT @erichorvitz: Session on AI and ethics at #FutureAI mtg. Shared thoughts on https://t.co/SgQIxbRKEX and https://t.co/1XhLUYM0uV https://… @hintikka what did she say? "Algorithmic Progress in Six Domains" by @KatjaGrace: https://t.co/ONHyS4BAlJ ICYMI, cool paper - "A Formal Framework for Studying Interaction in Human-Robot Societies," w/ symbiosis metrics: https://t.co/elUDj5joFR See also Sarewitz and Nelson 08, "Three rules for [the plausibility of] technological fixes: https://t.co/Yqj3aCOkqz https://t.co/Jot6PluOh0 @mappingbabel see e.g. https://t.co/ZzTW8S2J7w on syn bio/GMO case... not obvious what optimal openness/engagement strategy is, it's complex @mappingbabel am somewhat biased bc would enjoy watching livestream or attending :) but also not sure is short term/long term strats aligned @mappingbabel I get that, for sure, though real/perceived elitism/closed-ness has drawbacks, as well... @mappingbabel so AI research should be open, but discussions thereof shouldn't be? ;) anyway, sounds like an interesting conference. @mappingbabel lame. @mappingbabel whose slide? "How predictable is tech. progress?", Farmer and Lafond 2016 https://t.co/Mg4gtMTwmy Error bars for tech forecasts, application to solar PV. "RT @williamstome: PDF for my #HRI2016 paper ""Situated Open World Reference Resolution for Human-Robot Dialogue"" is up! https://t.co/pbMawdO…" Unsolicited positive feedback on paper from someone I cited, who is now citing me in their next thing :) nice way to start the day... @roboticwrestler aww :) @hintikka maybe not (too big) a handicap? https://t.co/gLSnkDFUhx RT @vkrakovna: #nyuai #futureofai Quotes and highlights from Monday's symposium on the future of AI https://t.co/natKPMxOQX @thesixcents25 no, not if we are careful about it/think ahead. See - https://t.co/QLBviFUvmS @hintikka yeah, e.g. one of main ways I've changed my mind in last few years re: AI/work stuff is thinking probs/solutions are >political... @hintikka yup. Will AI "solve" population growth [Skynet joke omitted], education, etc (@ericschmidt)? Sarewitz+Nelson 08 relevant https://t.co/Yqj3aCOkqz @PabloRedux @mark_riedl @mappingbabel it varies -some more/less mature than others, but picture not really great, eg https://t.co/bHx9Q5Jubj RT @mcette: #futureofai AI can and will address all the worlds problems says #allmalepanel :( so far to go @mark_riedl @mappingbabel looked at 1st and last session slides for ~2 dozen most Googleable intro AI classes to find non-trivial coverage) @mark_riedl @mappingbabel nice. I think you're an outlier, but admittedly only did shallow investigation of this using that as weak proxy (+ @mappingbabel @mark_riedl not status quo - my shallow dive on this showed e.g. almost no intro AI classes assign last chap of Russell/Norvig @mappingbabel @mark_riedl ASU has "computing ethics" which is not AI/robo specific. +Siloization not ideal - intro classes should cover too. @Aelkus yeah, true -though maybe would be diff if spent same amount of time/$ (decades btwn ep 2 design and ep 4 finishing) as on death star @Aelkus lethal autonomous weapons for surveillance/counterinsurg? capable of sending out thousands of probe droids at beginning of ep 5 @janexwang it's still vague on details but provocative. Haven't read Postcapitalism yet but sounds like similar ideas/visions(nice summary!) @janexwang you might also enjoy this - discusses AI/robotics explicitly at length: https://t.co/OYuieUA35U very interesting related read... Did shallow dive on ASP and planning progress in AI.. lots of (hardware-adjusted) progress but hard to model/show bc changing benchmarks. @willgilpin I think he caveats his points pretty well, discusses non-80s stuff too... >1 goal not panacea, etc apologies 4 140 chars too :) Planning to finish up first iteration of formal model of AI progress in next few days... will share for feedback before related talk soon :) Rereading part of Superintelligence...You should prob. read it if haven't. Review: https://t.co/BrizCCeyEZ Preprint: https://t.co/QLBviFUvmS RT @karpathy: Trippy hypnotic Neural Style zoom https://t.co/x4E8icThIs (from @mtyka 's experiments https://t.co/UmKqSRkTaJ) @hintikka haha :) @hintikka lol yeah, i deleted a number at the end. Should work now :) """Learning to Compose Neural Networks for Question Answering,"" Andreas et al https://t.co/Q6BFg2vWlo RL 4 both weights + network-assembly." RT @j2bryson: What are academics for? Can we be replaced by AI? https://t.co/Clo2jMrasg https://t.co/9YQ6lOIDdR OpenAI AMA seems to be over now - some interesting answers: https://t.co/fdiUBuAjpX Folks who know about machine translation: some papers show BLEU scores from 0-1, others in the dozens. Are the latter just the former * 100? RT @WiMLworkshop: Check out our profile of Raia Hadsell, a Senior Research Scientist at Google DeepMind https://t.co/aY9poDxGPv https://t.c… Schedule for the 2nd Int'l Workshop on AI, Ethics, and Society at AAAI next month: https://t.co/vL41OInMBJ Look forward to being part of it! See also: pigoons in Oryx and Crake. Excellent book. https://t.co/snyhVaDwhl RT @GaryMarcus: Can physics engines conquer common sense reasoning in #AI? New article by @NYUScience’s Ernie Davis and @GaryMarcus https:/… @witbrock @Plinz ? RT @OriolVinyalsML: My next step: DeepMind. I'll certainly miss all the friends left behind, Google Brain, and the sun, but I'm thrilled ab… Ask some questions! :) I just submitted mine. https://t.co/Tpu2Dgy98r @Aelkus forgot about those :) 10. access to the Internet is allowed, a la https://t.co/Vs9KX98v3p 9. E.g. in NLP, human understanding of 1 paragraph may still be much richer, but machines will be way, way better at e.g. answering Qs where 8. I expect enough prog that "human-level AI" will be more clearly revealed as a problematic threshold, and in many domains, long surpassed. 7. So my probability distribution for achieving X, Y, Z metrics has shifted a lot closer to present, but metrics still unclear. In 10 years, 6. And I no longer think massive progress in AI in, say, 10 years is implausible - now seems plausible enough to plan for possibility of it. 5. e.g. https://t.co/tuIcJR13Yb There's also seems to have been a shortening of many ppl's time horizons for general/human-level etc. AI... 4. ...and it now seems physicists who told me a few years ago that there was plenty of room for faster computing w/ light etc. were right :) 3. Hardware seems >important (https://t.co/zZPicu7o2A + @KatjaGrace paper ref'd) as enabler of progress, along with growing/improving data.. 2. AI progress as exponential or is accelerating seems more plausible after I found it in Atari data, others finding in SAT, vision, poker.. 1. As a result of researching AI progress and talking to a lot of people about it, I've changed my views in a few ways over the past year... RT @meloneewise: Toyota demoing online learning for cars... Don't want to ride along for negative samples. #CES2016 #robotsofCES2016 https:… RT @samim: Testing Dahl's "Automatic Colorization" neuralnet. Clip from chaplin's "the kid", in color :-) https://t.co/aQZ8KMHCAA RT @etzioni: Can AI Master 8th Grade Science? Update on the Allen AI Science Challenge: https://t.co/Rt1CETDSaG cc @allenai_org @Aelkus assume there are lots of other ones by third parties but those are a good starting point. curious to hear how that goes. @Aelkus beyond the ones on their website/tensorflow.org? They're very good. Only done MNIST ones and image rec (very bottom) but all good.. RT @samim: Colorizing Black and White Photos with deep learning: https://t.co/AwK8mfjHrs https://t.co/SBvufSX8zS Shane Greenstein on his book, "How the Internet Became Commercial," with discussion of implications for Google, etc. https://t.co/WGBaoj4pA4 RT @vkrakovna: @vkrakovna The #NIPS2015 videos seem to have disappeared from the @MSFTResearch website. Hope they get reposted soon! "Instructable Intelligent Personal Agent," Azaria et al. 2016 - cool AAAI paper: https://t.co/wg0dW34Br4 @nsaphra watsongineering... Note that there are videos from the symposium on page 2, as well (and lots of other interesting stuff I missed :) ). https://t.co/R2qPz7jvAX RT @vkrakovna: #NIPS2015 #AlgorithmsAmongUs symposium videos are up! https://t.co/svkSwbcph0 (scroll down) List of accepted AAAI 2016 papers: https://t.co/iCJk4StHPW @j2bryson all CS students or any social scientists/humanists? :) would be more surprised abt/eager to learn from latter.. @roseveleth lol wut RT @beaucronin: Good, tough piece on perils of hype and challenges in commercializing Watson https://t.co/blZ4vuoHJh https://t.co/O2ocWeN9Nn Better Paul Graham on inequality. https://t.co/bQ1wFomxKF @hypatiadotca 👍👍 @sarahjeong exactly Where EKMT = English-Korean machine translation. Paper=very narrow contribution to that...most recent reference to non-author is from 2007. "We'll make a contribution to the progress of science+technique for building a socialist powerful state by further completing EKMT system." If the quality of North Korean nuclear research is similar to their AI research (https://t.co/gL8BfWtQY7), then skepticism is called for... @CNET tweet should read "billion" :) @togelius ah, I wrote that before I saw the poll :) didn't show up immediately on phone... voting now... @togelius Knuth @rbhar90 no prob! took me a while to figure that out :) there may be easier ways, but what I do is: reply to #1, delete @[own name], write 2 @rbhar90 good discussion! FYI if u reply to ur #1 in stream with #2, #2 with #3, etc., easier to follow for those who miss the beginning. RT @rbhar90: 1. Current drugs for treating pain and psychiatric conditions are terrible. State of the art for mental disorders ~ 1950s lith… This is your yearly reminder that Vonnegut's first novel, Player Piano, is great + relevant to contemporary discussions of AI/robotics/work. @hintikka you don't want to optimize ads, I don't want to defend ad optimization to Congress ;) @hintikka though as you note, lots of DC folks coming in. open to being one of em, but needs to be job where i'm not just a DC mercenary ;) @hintikka yeah, def. on the lookout for good opportunities. the pull is currently stronger for tech folks than social science/humanist folks @hintikka yeah, I know/follow some folks who love it, but good to hear your POV, which resonates with my political sensibilities :) @hintikka your feed does not exactly excite me about moving there ;) (not currently planning to, but maybe some day...) Not sure how I feel here but it's a good example of where "human-level" AI/robotics is not nec best/terminal metric. https://t.co/cW2tBGCMqA RT @BotJunkie: Gill Pratt: We need trillion mile reliability for autonomous cars, a million times better than has been achieved #CES2016 @sknthla 😏? RT @BoingBoing: Intel futurist Brian David Johnson heads to ASU's Center for Science and the Imagination https://t.co/ETODwPCEUr https://t.… @hintikka :-/ Third iteration of Facebook's deep learning + MCTS Go bot is live now, with 70k rollouts this time. Currently 5 dan: https://t.co/qsiWUo1XEF @hintikka think it's at least mostly contained to SV/certain segments of the Twittersphere. 99% of people don't know or care about him.. @hintikka can't believe people take that thing so seriously. It's like David Brooks with (bad) footnotes level quality... @mark_riedl agreed! There's some cool related activity at ASU: https://t.co/w7HAaTjehm @j2bryson yeah, the three lowest points don't involve deep learning. Some AI scores in Atari in recent years. Same data I've shared before, just made X axis time + added trend lines... https://t.co/7ALfVlmv1o RT @TorchML: Using deep learning to break a captcha system with 92% accuracy (with code): https://t.co/xRzbI2QYWW RT @danieldewey: My attempt to explain basic deep learning with Up-Goer Five: https://t.co/TYxFz1wWoP "RT @j2bryson: For those who don't InterWeb on holidays, a reup 2015: The first year AI nearly killed me https://t.co/ni8nTV4UO5" RT @rbhar90: @Miles_Brundage This is why recent work on BPL by @rsalakhu et al. so interesting. They get superhuman perf with ~1K datapoints 6. ~5k data pts needed (now) for decent training, 10m for (super)human. If take data seriously, then what areas will we soon have that data? 5. via Mechanical Turk, new modalities/types of data, etc.) complements this. See also Bengio et al. in deep learning book on rule of thumb- 4. See e.g. Forbus discussing scale growth https://t.co/Z5OuZnLBcd Scale enabled use of data-hungry methods. Scope (e.g. detailed labeling.. 3. Beyond issues w/ this algo age vs. dataset age arg, though, it's true datasets important, but Q is how/why? Two answers are scale + scope 2. not obvious Watson's use of year old vs older versions of Wikipedia etc. was that important, plus CPU power obv also helped with speed... 1. Agree w Edge piece that datasets important for AI prog. https://t.co/vsUH2GCYgC but data used is itself sketchy, e.g. ALE not "dataset".. @beaucronin the idea/time ratio must be higher on the show...I have to rewind a lot. The accidents prob don't help me either RT @egrefen: David Dalrymple on Differentiable Programming as the next frontier for Machine Learning Research: https://t.co/GSYi1017VQ RT @samim: Visually Indicated Sounds: https://t.co/8uhrdjstwW "synthesize plausible impact sounds from silent videos" https://t.co/lYdxX1dx… @beaucronin nope. Should I? Took two episodes to get it but now I love The Expanse. @PabloRedux great pts! will need to ponder more, but briefly, no, I don't think I've rebelled sufficiently or have answers for most of Qs :) RT @DefTechPat: ISIS Is Reportedly Packing Drones With Explosives Now https://t.co/ScxEkV3Hqa @kleinsound M sounds cool but not available 4 most/outside Bay Area yet. :) My unsexy vote may be for progress in speech recognition.. @cybertreiber hadn't seen/heard about that - thanks for sharing! RT @cybertreiber: @Miles_Brundage about IBM/healthcare research: one thing i know for sure is FMRI based mental diagnosis. https://t.co/LG6… Sounds familiar...Moore's Disrupting Science discussing Computer People for Peace+Science for the People in the 70s. https://t.co/FBibxpqsZd @rbhar90 agreed! I'd like to see them publish more on how they evaluate AI progress, too. :) Hope for some cool stuff in 2016... @rbhar90 not, e.g. drug discovery, but still pretty vague/they could be working on more than one thing. Also talk of cancer a while ago.. @rbhar90 Hassabis's comments here https://t.co/RRFxY6tIlT seem to suggest a Watson-like system for synthesizing/displaying relevant info... @rbhar90 same here (only vague references). 4. Since Jeopardy! victory, other techs have advanced (e.g. https://t.co/RNwELmsoLC) and new competitors loom (e.g. DeepMind in healthcare). 3. Lots of smart people work at IBM, so I have no doubt there's cool stuff to show, but don't know what. Am I missing any key publications? 2. increasingly annoyed by IBM's ridiculous commercials (e.g. https://t.co/qwBHICI1eg). I want to know more about what it can *actually* do. 1. While I continue to think Watson was impressive technologically (me and @j2bryson discuss here: https://t.co/nkEYKaD37Q), I'm getting... Lecture by Demis Hassabis on AI and DeepMind: https://t.co/RRFxY6tIlT That was written when conventional wisdom in DC was ITC would expire, so some parts outdated, but many untapped opportunities outlined, IMO. Big deal. https://t.co/6ymDjbslM6 Innovation on soft costs needed 4 solar to be ultracheap. See thing I co-authored: https://t.co/1mr5gzy34h @beaucronin understandable :) look forward to your thoughts when you have a chance! @tmosley4 yeah, I don't really have much insight on it myself. Hoping to be enlightened by someone w/ more psych/neuroscience knowledge :) @rbhar90 that's partly why I ask, I don't know :) Surprised to see no reaction, esp. w/ Hassabis as co-author. Maybe overlooked bc holidays. Not my area of expertise but it seemed v. interesting and provocative to me. Unified theory of cortex/hippocampus data structure/function... Why only 2 mentions on Twitter (1 by me) of DeepMind paper on cortex/hippocampus theory? Thoughts, neuro/psych ppl? https://t.co/3wthJdgTB4 RT @HMRoff: See my new blog @DuckofMinerva @BanKillerRobots @FLIxrisk @asu_gsi @FHIOxford @DefenseOne : https://t.co/ihT59PEbnH @GregoryMcNeal @rcalo I would like to see this, too :) RT @RobotLaunch: .@Robohub New Sino-Israeli Robotics Institute gets $20 million initial funding https://t.co/1holCQCCGT Image in last two tweets from here: https://t.co/X31hRFFflO Beyond each of these trends on its own, https://t.co/vruLmZmMoQ it's interesting that #1 is consistently ~100x #500 and ~10% of the top 500. Continuing this theme, https://t.co/WwINStGZHg it's interesting to note stability of supercomputer progress trends. https://t.co/yyr0GPhEBL RT @FLIxrisk: The Top Artificial Intelligence Breakthroughs of 2015: https://t.co/M6eWK8Lmrz #AI #ArtificialIntelligence https://t.co/X3XBR… Many exciting articles in the pipeline for the Journal of Responsible Innovation. :) See our current offerings here: https://t.co/kyE3LQf8VA More context for rant here: https://t.co/xXe8weYTSs Open AI/@open_ai have less of equalizing effect on power to extent hardware/data = key. @Miles_Brundage *Hubel-Wiesel @syhw @shakir_za ahh! thanks :) 12. Potential issue=certain distros better for some purposes than others?(e.g. safety better if concentrated AI, privacy better if diffuse). 11. but interesting to think about possible divergences of those in future, or further convergence, and what distributions are best for ppl. 10. One other point: @j2bryson emphasizes data there, I emphasize hardware here. Currently, highly correlated w/ each other + wealth/power, 9. Anyway, just some quick thoughts on various interconnected issues. See also @j2bryson's "AI and Pro-Social Behaviour" re: power + AI. 8. Would be nice to look at diff elements of recalcitrance/progress vs. diff. hardware impacts (speed, level, parallelism, science speedup). 7. This is semi-distinct from Q of recalcitrance a la Bostrom. Could have a power explosion w/o (hardware-adjusted) intelligence explosion. 6. to a world where scalable algorithms exist for continuously improving predictive performance/other measures of AI progress w/ ~0 limit. 5. E.g. compare world where there are strongly diminishing returns on hardware/intel., most problems are NP-hard/approximation is difficult, 4. If that stays true, it is especially important to ask how scalable intelligence and associated social/political power is w.r.t. hardware. 3. for example, there are connections between AI progress/performance and hardware. The latter is *very* unequally distributed right now. 2. One reason 2 think about this carefully is to shed light on possible changes in future distribution of power. As I discuss in that paper, 1. On AI, computing power, and social/political power: for various reasons, it might be good to model AI progress (https://t.co/zZPicu7o2A). DeepMind neuro paper by Leibo et al:"Approximate Huber-Wiesel Modules and the Data Structures of Neural Computation" https://t.co/3wthJdgTB4 Random Army Research Lab paper on deep RL in Atari reports vague results, no actual scores or pseudocode.. ¯\_(ツ)_/¯ https://t.co/pWinmZycEl RT @shakir_za: Writing reflections: What is 'Deep'? Oft-asked but seldomly deliberated. I used this post to develop my own answer. https://… @KaiLashArul still impressive progress so far :) glad someone is replicating all this stuff. Best of luck! "Insightful @NandoDF AMA https://t.co/vLKuxmwL9z ""This [AI progress] is bigger than any of us. Let's make sure it's for all of us."" Agreed!" @KaiLashArul hey, this looks great - haven't run yet but curious what scores you've gotten w/ it? Been keeping track https://t.co/tG05RYDxCc @sknthla see also https://t.co/StaIWbXUlx :) great minds think alike? no opinion on the topic, just passing along... RT @GaryMarcus: Modeling Progress in AI, by @Miles_Brundage https://t.co/VwUj6pGIPX @GaryMarcus thanks for sharing! Bengio et al.'s deep learning textbook hasn't even been released yet and it already has 33 citations according to Google Scholar. :-O DisneyQuest managed to be ahead of its time for a decade or so and now is super outdated/closing soon. Wished it one last goodbye today. :/ Long before Oculus, there was Aladdin's Magic Carpet Ride and other 0-to-little presence VR rides at DisneyQuest :) https://t.co/bf5KkcUCVN RT @NandoDF: AMA: Nando de Freitas -- Post your questions please https://t.co/AZx2QWXKjR? More fun with TensorFlow and Inception v3... https://t.co/4ANS3bQxoS RT @vkrakovna: A belated blog post on my impressions from NIPS... https://t.co/H10RMkM4WC Big new DeepMind paper - "Reinforcement Learning in Large Discrete Action Spaces," Dulac-Arnold and Evans et al.: https://t.co/LJX5U6xpEq Enjoyed meeting Critch and Taylor at NIPS. Good points here. Would def donate some if had more $ RN. :) https://t.co/bLBe5bSnmA CC @elonmusk @Aelkus @rbhar90 ...seems to have interesting things to say on optimal behavior hierarchies, human HRL, etc. and is now at DeepMind I think. @Aelkus @rbhar90 thanks for all the points/links! Much to ponder. This also reminds me I have unread papers by https://t.co/jlYMxSON9R who.. 3. very confident it's now looking at website. In between, it's quite confused (e.g. this intermediate zoom level). https://t.co/Bl6MbBS8ia 2. from a panda pic on the tutorial website. When seeing just the panda pic, quite confident it's a panda. When zoomed all the way out, it's 1. Having some fun playing with TensorFlow and the pretrained Inception network again. E.g. feeding it partial screenshots as I zoom out... @rbhar90 @Aelkus ditto, this reminds me I should know more about hierarchical RL + if/why deep RL can't figure out better hierarchies etc :) @rbhar90 @Aelkus my hunch is deep RL could go a long way in StarCraft but you'd need to do one level of play at a time, or else take forever @rbhar90 Sounds fun to me, though perhaps DeepMind (for one) would like more PR-friendly domain ;) CC @Aelkus who has more Starcraft AI exp. RT @etzioni: Why Knowledge representation matters by Yoav Shoham. AI is much more than pattern recognition. https://t.co/etezKQ5sWz @rbhar90 yep, he's worked on lots of cool stuff! Suspect he'll be lead author on the paper(s) about this eventually :) @rbhar90 there have worked on that stuff(Go, RL, deep RL etc. e.g. David Silver: https://t.co/dg0c40JnVN). Details will be interesting!(2/2) @rbhar90 I suspect that deep RL plays a big role in it...doesn't seem tractable without neural nets for move evaluation, and some folks(1/2) 8. There's also the arg. that ppl wouldn't get/care about any announcement short of "bot beats best humans," so they wouldn't hype for less. 7. Which leads me to think that Hassabis's foreshadowed Go reveal will be *at least* having the best Go bot, if not better than all humans. 6. without that being the case, they have enough in house talent of human Go players/researchers to know if they're at pro level yet or not. 5. Some folks on KGS were speculating that DeepMind may be having/may have pros play against their latest bot - seems plausible, but even... 4. more optimized bots w/ Go-specific domain knowledge built in. Presumably DeepMind's stuff also mostly based on ML, but details/rank TBD. 3. but v. impressive considering it's based on just a few months of work by few ppl at Facebook mostly using machine learning, vs. older and 2. For context, that's not quite as good as best (public/non-DeepMind (?) ) Go bots, which in turn are better than most but not all humans, 1. Facebook's latest Go bot (https://t.co/KQzwfBOUqV + search while waiting + more rollouts) now ranked 5 dan on KGS https://t.co/AIxskLNSly CC @Aelkus "A Formal Framework for Studying Interaction in Human-Robot Societies" Chakraborti et al. Cool AAAI16 workshop paper https://t.co/elUDj51NOj @jimmfleming sounds like something Abbeel or Levine at Berkeley would do, maybe - they use LEGOs... not sure, though! RT @mappingbabel: Google's robot Christmas card is not disconcerting at all https://t.co/ctO8fYc8ol Excellent article by @tambetm explaining the key ideas behind deep reinforcement learning - recommended: https://t.co/pDsp0xYy0k @tambetm this is awesome! Will share. Thanks for passing along. @mpshanahan see also: https://t.co/T2wEwHwJK6 RT @NatureNews: Gene-editing pioneer, Jennifer Doudna, reflects on her whirlwind year with #CRISPR https://t.co/N0dSzuA0b6 https://t.co/yui… @robbensinger @FLIxrisk @elonmusk I was thinking of @romanyam on pathways to dangerous AI and @xuenay on values. "Paths to Human-level AI," talk by @mpshanahan: Part 1 - https://t.co/RMHGCUQx08 Part 2 - https://t.co/Ddvg69E7w5 @hintikka yeah pretty clear cut... e.g. https://t.co/YNQo09cZdy @beaucronin speaking of nerd pride, listening to you and @sknthla discuss VR RN. Great stuff. Expect I'll be a convert when I try Oculus. Versions w/o pondering, <rollouts stable around 3 dan. This one still unranked. Suspect DeepMind has way better one but not on KGS AFAIK. :) New Facebook Go bot on KGS server w pondering added (search while waiting), >rollouts https://t.co/AIxskM5td6 Paper: https://t.co/KQzwfC6vit @roseveleth nice rec! I was fortunate to have it assigned in a class a while ago :) RT @roboticwrestler: #recommendedReading: "A Unifying Probabilistic View of Associative Learning" https://t.co/qs33T71UtJ RT @3TUethics: We are super excited to announce The Foundation for Responsible Robotics! https://t.co/XTk6k4KMtF @RespRobotics https://t.co… @md9647 haven't looked at the issue super closely lately myself, mainly glad to see folks I know from back in the day on the case :) 2. Minh Le (formerly head of SunShot at Dept of Energy) applying talents to "pipe parity" at OMB+the also awesome Sekaric leads SunShot now! 1. Good to see high level White House attn to need for innovation in water supply https://t.co/yyRML8TuVV + especially heartening to see... @beaucronin omg RT @j2bryson: As #ai approaches autonomy, its testing approaches psychology, not engineering—me & @conjugateprior in 2000 https://t.co/jW3H… "Informing NASA’s Asteroid Initiative: A Citizen’s Forum," Tomblin et al https://t.co/s7xR5yC2xg Really enjoyed being a facilitator at this! Next few papers, ish: sociology of responsible innovation, sequel to AI progress modeling paper w/ formal model, AI policy stuff, ??? @Aelkus v. cool. Will ref it down the road if I end up writing related paper (along lines of what u saw before) some day :) prog model 1st.. @Aelkus nice. curious about the monograph. FYI - slides/papers from possibly relevant NIPS wkshop https://t.co/6K7V24tpuW sub/symbolic nexus Beyond obvi. troubling nature of that/autonomous bot warfare period, =reminder of scale of shift in AI/bots from gov't-->industry recently.. "Congress should clarify Title I in unfortunate event president must compel Google or similar company 2 assist in manufacturing RAS systems" "The US can ill-afford 2 start asking tough Qs abt leveraging commercial RAS capabilities once on receiving end of autonomous weapon strike" Robotics/autonomous systems industry study by DOD academics https://t.co/vaXokdJpz3 Essay 5 broaches US govt forcing Google to help w/ bots. @hintikka gross @hintikka ya. didn't like that X.AI defaults to female - male option, but female default, no gender-ambiguous/clearly bot options... @danieldewey @open_ai He says: "Also it’s worth pointing out that we’re not currently actively working on AI safety." "Learning Prefs of Ignorant, Inconsistent Agents [=you]", Evans et al https://t.co/ESgzbZc28G ~3rd @FLIxrisk/@elonmusk-funded paper Ive seen ... AI can get superhuman performance on ~all games. Suspect DeepMind will continue pushing into realistic 3D, stuff requiring memory, etc. There's def. lots of room for improvement in Atari still (better transfer, more efficient learning, etc.) but gets less interesting when... Any day now, if not tonight, DeepMind's AsyncRL Atari results w strong Montezuma score go up on arXiv, forcing Q of Atari as AI benchmark... @dmarthal not familiar with it, will check out - thanks! Leckie's well-done jumping around in time is also noteworthy. Reminds me of Le Guin's The Dispossessed a bit (which is a must-read IMO :) ). Among other things, I like how Ancillary Justice shows some possible implications of ubiquitous human-level+ AI and importance of how used. Almost done w/ Ancillary Justice. Def recommended for sci-fi fans, esp. ones interested in AI. TBD if ending will force me to read next one. RT @gdb: @PlzBeSensible @open_ai (We'll have a process to address results which could be dangerous and will be thoughtful rather than blind… See also https://t.co/STMZCqC3fS Complex Q - depends e.g. on expected takeoff speed. Important to distinguish timeframe in question, too... Interview w/ @karpathy on @open_ai: https://t.co/RxweJcKzOz Not working on AI safety RN, vision similar to DeepMind, etc... h/t @peterxing @Aelkus is cool, have read. Some of Russell's recent stuff (e.g. "rationality + intel: update)/old papers similar but prob some unique stuff RT @meganjpalmer: Today in @sciencemagazine @DavidRelman @FukuyamaFrancis and I discuss risk governance in life science & tech https://t.c… @hypatiadotca Delaney is awesome. Recommend Trouble on Triton if you haven't read it :) He def practiced what he preaches re: sci fi variety Nice article on @GaryMarcus and his company, Geometric Intelligence: https://t.co/AjFKMbZ2Ad 3. ... these results. Faster experiments is one of four links between AI software and hardware prog. I discuss here: https://t.co/rhz62YVcOW 2. Think 2016 will be year in which it's pretty clear that speech recognition is now of broad utility. Also, note role hardware played in... 1. Reminder: Baidu's latest speech recognition is better than humans except in v noisy enviros (+latter may change) https://t.co/14uUo2xLEc @knewscript @zeustoves @AliMattu @nerdsrocket think just one. @knewscript @zeustoves @AliMattu @nerdsrocket something like that :) takes place in outer solar system few hundred years from now @knewscript @AliMattu @zeustoves @nerdsrocket only seen first ep. so far. Liked it, not in love yet, but will def watch the other eps :) RT @xuenay: My recent paper: "Defining human values for value learners", accepted to AAAI-16 workshop on AI & ethics: https://t.co/yRi2DDE… RT @hannawallach: If you're a student interested in CSS or ML for social questions, you should apply for a DSSG fellowship!!! https://t.co/… @nerdsrocket @knewscript @AliMattu @zeustoves SyFy miniseries based on Arthur C. Clarke book. Aliens come, institute utopia on earth and ?? Anyone watched Childhood's End yet? Hope to today... @AliMattu @nerdsrocket @knewscript @zeustoves @OddLetters the latter ICYMI - new paper, "Modeling Progress in AI": https://t.co/rhz62YVcOW RT @Aldebaran_news: New partnership with @CostaCroisieres: Pepper will be the first robot on the cruise ships https://t.co/HYhbl1O0tV https… @Miles_Brundage Pending time, hope to have model/results 1.0 for when I give the associated talk, with focus on deep RL...should be cool. :) @samim @danieldewey @karpathy ahh yes! thanks! :) RT @samim: @Miles_Brundage @danieldewey don´t forget @karpathy excellent realtime JS RL demos: https://t.co/APABZ8FxVl 2. https://t.co/OupSdCOXWh (or better NN intro?), https://t.co/2aBpYeCH98 (h/t @danieldewey), and https://t.co/MS0DAnGTSm in ~that order. :) 1. After some reflection/input, if you want to know a bit about deep reinforcement learning, watch/read these: https://t.co/t4sRs7zKNF, ... @danieldewey forgot about that :) should (re)watch at some point... think I saw at least part of it.. RT @danieldewey: .@Miles_Brundage David Silver's lecture on deep reinforcement learning is very accessible despite being technical: https:/… "RT @ylecun: Awesome uses of DCGAN, the ConvNet-based image generation system by Alec Radford and Soumith Chintala. People... https://t.co/…" My AAAI 2016 workshop paper, "Modeling Progress in AI": https://t.co/rhz62ZcOdw Feedback/interest in collaborating on next steps welcome! :) @hintikka thanks! :) @hintikka fortunately or unfortunately, I'm finishing up a paper right now :) may watch it/highlights later... Trump and Cruz. sigh. @hintikka yeah. that + "I'm not politically correct..." + transparent bigotry account for most of his "appeal"... RT @DefTechPat: The Pentagon is Nervous about Russian and Chinese Killer Robots https://t.co/Prw1B8Gqqo my latest for @defenseone Just remembered this nice 5 minute intro to reinforcement learning :) https://t.co/t4sRs7zKNF Deep RL = ~ that plus neural nets... @mark_riedl nice :) might check out after Ancillary Justice (/rest of trilogy depending on how hooked I am at that point). @beaucronin yeah, though the flip side is that tuned for fun ~ = tuned for difficulty, so diverse+ difficult. @beaucronin baby did that well, ppl would freak out. @beaucronin the diversity of games + no tuning of hyperparameters + learning raw pixels= impressive...paraphrasing Stuart Russell,if newborn @beaucronin yes, and deep RL agents also deliberately stunted to make it fair-ish competition (only see/react to X frames)... that, + ... RT @jimmfleming: @Miles_Brundage I see the whole narrow/general AI as similar to moving goal posts for ML problems. AI always be "too narro… @mark_riedl elaborate? @juliaxgulia @samim has done many :) @nikete I forget how (either not seeing every frame or not responding ever frame or both) but they do account for that - see Mnih et al 2015 RT @danielas_bot: What we need Elon Musk's $1B AI nonprofit to actually do: https://t.co/vgDDAcHjyN @nikete yeah, I think the best (and also most challenging for AI) comparison is on short training time. But multiple metrics can be useful.. @nikete do agree it's important to look at training time in making "human-level" claims, for sure. @nikete it's nowhere near that big of a gap. In Mnih et al. Nature paper, trained for 10 million frames. >1 frame/second...~days/weeks. @nikete ...champion scores of humans in Atari games, that's more fair. I have only done shallow analysis of that comparison so far, though. @nikete yes, that is a good point. Humans definitely vastly more efficient at learning. However, I think if you compare AI to, e.g. world... @nikete that's true, but people also said that about Montezuma's Revenge just a few months ago, and now: https://t.co/yj3Cx5MmT9 ;) In most cases, latest deep RL systems aren't just human-level in Atari. They're vastly superior. In 68% of games, >500% human's score. 4. There's def a sense in which humans=more general than existing AIs, but also a sense in which opposite is true, or nothing fully general. 3.... when in reality there are spectra of capabilities/levels of generality, and deep RL/AI has a ton of plausible applications already. 2. ...what it is, how fast it's progressing, etc. Also gives lie to common notion that all we have today is "narrow AI," general far away... 1. Is there a good non-technical explanation of deep reinforcement learning anywhere? Feel like it'd be valuable. Important to appreciate... Wired article on OpenAI quotes me a bit (mostly just paraphrasing Bostrom et al.'s arguments): https://t.co/H32e4YNa25 Case against AI-as-bubble is pretty simple: relative to the economic scale of tasks that could soon be automated, current AI R+D $ is small. This probably underestimates where their current systems are given recent demos - I'd guess 90%+. Relatedly, new papers go beyond Atari. By my count, DeepMind's best reported Atari-playing systems have gone from human-level or greater in ~60% of tested games to ~84% this year. RT @UTESTto: "Is there too much hype in #DeepLearning?" @mappingbabel "no, because these models actually work" @rsalakhu #mkt4intel RT @fchollet: Deep, narrow nets tend to outperform larger, shallower nets. Highway networks and residual learning make near-arbitrary depth… RT @fchollet: The Power of Depth for Feedforward Neural Networks - some clues as to why deeper is almost always better https://t.co/xzOqS5K… RT @karpathy: Our lab released a new dataset we've worked on for a while (e.g. 4.3 million region captions). Glad to see it out https://t.c… Chandrasekaran et al. introduce abstract scene datasets, use SVR to predict scene funniness: https://t.co/8ukquAgQLX https://t.co/1o0927nkts Heess et al. paper interestingly uses, among other test domains, the Morris water navigation task used with rodents: https://t.co/CmkbrutiC3 "Memory-based control w recurrent neural networks" Heess et al from DeepMind https://t.co/c2Ln5x04AS Backprop thru time 4 continuous control @mark_riedl @j2bryson happening to me, too :/ Looks like I have plenty of time to submit my AAAI paper...maybe I'll have an AI finish it up for me. #funtypos https://t.co/E4Okfl8NXq ICYMI, new Baidu paper a few days ago shows voice recognition is now competitive with humans in some settings: https://t.co/oC0WHmLpOM RT @AndrewYNg: We plan to put autonomous buses on the road in 3 years, mass produce within 5 years. Forward! https://t.co/K9pytZRDpi @roseveleth @alexismadrigal yessss. Great book. "RT @lawrennd: I wrote a new piece for the Guardian on @open_ai and Data Sharing. #OpenData #NIPS2015 https://t.co/NlT4FS5JEL" @CadeMetz nice chatting with you. On one thing we discussed, FYI there's also this: https://t.co/LrcVIv9LIR Nice list of takeaways from NIPS 2015 from @bradneuberg - I had some of the same reactions: https://t.co/ma5xhLlF8E 2. ...as @alexjc notes. They should read @Diana_M_Cooper on ethical licensing approaches here: https://t.co/Ast3pjBknN 1. Upon reflecting more about @Open_AI (first reactions here: https://t.co/KgtBSW8t9q), their approach to IP will be of huge significance... @mappingbabel @mark_riedl ahhh, yes, it was :) nice catch. RT @mark_riedl: AI is apparently advancing faster than I can Tweet about it :-) @mark_riedl using older methods, would take too long to train, but deep RL training getting more efficient, and some folks have many C/GPUs. @mark_riedl think Battlezone or something in Atari is kinda 3Dish tank game? anyway, not clear how big of issue resolution/scale of game is. @mark_riedl Tesauro of IBM also showed deep RL on simplified Quake. here are two pics from that talk and 2 from Mnih https://t.co/DST74hAixo @mark_riedl said about memory/if there was something special about it, besides using recurrent NNs. Hassabis showed demo too but i missed. @mark_riedl yeah, pretty sure. someone asked at one point about increasing resolution and he said that'd be fine... can't recall what he.. RT @marcgbellemare: Our new paper is out and we've (partially) fixed Bellman's equation. https://t.co/Uc4mc223qi https://t.co/09QNjpRaby #A… Honglak Lee showing action-conditional predictions (neural net imagining what would happen if it did X). #NIPS2015 https://t.co/QhJ8OfF25i Mnih showing deep RL for simulated robot motor control. #nips2015 https://t.co/7EvTfq2RCV Mnih showing learned navigation by agent in randomly generated 3D maze at deep RL workshop. #nips2015 https://t.co/vauuPjnPRY Mnih showing good gameplay by latest DeepMind deep RL system on Montezuma's Revenge at NIPS. Paper soon.. #nips2015 https://t.co/B4rKFvbDrl @vkrakovna glad to hear. :) @mark_riedl of ppl in 1 place a la DeepMind, Google HQ etc + presumably OpenAI would have more in one place than under the model u suggested @mark_riedl not familiar w those examples but I just meant that there may be positive (as well as neg) effects of having high concentration @mark_riedl though >expensive than grad students for sure :) also wonder if there are efficiency gains from co-location at scale vs academia @mark_riedl good pts! I think this will be less expensive per person than top Google etc. folks bc of mission, starting on ground floor etc @mark_riedl could have some kind of deal with Amazon/other funders, strike deal w other companies, etc but dunno what that'd look like... @mark_riedl there's some discussion of the data issue here: https://t.co/VY0nqZCZM3 the Tesla thing is interesting... also plausible they.. @vkrakovna did you go to this? pretty popular I assume/hope? :) RT @open_ai: We're having so much fun, we're extending our meetup to 10PM. Hope to see you there! #NIPS2015 RT @Maggiemakar: Just how big is #NIPS2015? This is about half the room https://t.co/wvWBPG33Iz RT @MIRIBerkeley: A warm welcome to a new AI research nonprofit, @open_ai! https://t.co/eqodTLxtYd @mappingbabel sleep deprivation was worse than i thought ;) meant to link to this: https://t.co/KgtBSW8t9q @alexjc good pt on contractors...perhaps enforceable for many/most cases, though exceptions. Would be better for them to try even if so! :) @alexjc mayyybe some developed countries, but many militaries not sueable... @alexjc ...pseudocode would be sufficient for militaries etc to copy them, and hard to do anything about it, vs corps more sueable.. @alexjc agree they could hold out on corporations, but how could they prevent military/intelligence community from using? even publishing... @J_Savim thanks! :) RT @egrefen: One take-home from #NIPS2016 is that the Deep Learning community no longer or poorly distinguishes peer-reviewed work from unr… @bradneuberg thanks! @mappingbabel didn't say bye (I think? sleep-deprived :) ) but hope you enjoy rest of NIPS! FYI wrote this/ref. you https://t.co/8imS1PDMSV @mappingbabel at the RAM workshop? Curious to hear how that goes... @davegershgorn thanks! @VincentCMueller @open_ai thanks! @beaucronin = why I'm sad to miss https://t.co/6K7V24bODo and CoCo https://t.co/8imS1PDMSV right now, oh well :) RT @beaucronin: DL-heavy makes sense for now, but its sufficiency is, shall we say, far from a settled question @beaucronin (somewhat tongue in cheek answer) then DeepMInd will "win" ;) RT @beaucronin: What if, say, probabilistic methods turn out to be essential? Or more detailed neuroscience knowledge? RT @beaucronin: Another q for @open_ai is the assumption of DL as the main approach/skillset needed to meet and surpass human level RT @mpshanahan: I gave @guardian a #StarWars quote about General Grievous and they edited it into one about R2D2 - https://t.co/OH3cu17RDq … RT @crocodoyle: Today, the first workshop to overflow is the Quantum Machine Learning session #NIPS2015 My post could just as easily have been called "(How) Will @Open_AI Matter?' More Qs than As... https://t.co/KgtBSWq4y0 @VincentCMueller @open_ai agreed. Many questions :) I wrote some thoughts here: https://t.co/KgtBSWq4y0 Wrote a thing: "Why @Open_AI Matters." Curious what people think! https://t.co/KgtBSWq4y0 @beaucronin @mark_riedl @j2bryson @elonmusk @sama RT @orbitbooks: Multi award-winning SF from @ann_Leckie is just 99p on Kindle today only! https://t.co/BQ4YlzzTF8 https://t.co/Jz2xSeLVvv Good point, though I think some differences (potential, at least) - need to ponder more if/why/how to articulate... https://t.co/R8n4iiesfx You know #NIPS2015 is nearby when you randomly hear "deep RL" at the airport... After a bit of sleep, even more excited/intrigued by @open_ai. Raises Qs but ton of potential... expect much growth. https://t.co/km9uGb4XA4 @j2blather /after complaints* @j2blather first of 3 panels passed that, though to me more notable issue was late inclusion of women :/ @j2blather may have been some mention w/o the hashtag (which I at least wasn't using consistently), Bechdel point is fair, though! @om @elonmusk @sama @reidhoffman @Openai good Q - some more: https://t.co/km9uGb4XA4 Lots of potential! Hoping to see it realized. :) Have some views on all of these topics, but just noting not all are cut and dry (as, indeed, @elonmusk and @sama indicate in interview)... RT @nikete: @Miles_Brundage re talent: I'd go with extremely. 7. How will AI diffusion goal/agenda connect to social impact mission viz. short term things like job impacts of AI? Etc. etc. Fascinating. ...shared-but-proprietary data from Tesla, etc. with drive towards openness, 6. how will foci of AI progress, safety, diffusion be balanced? ...talent in the field? My view is: probably very. 4. What research trajectories/applications might they work on? 5. how they'll balance... ...the broad mission as stated (see, e.g. my framework here: https://t.co/z8DTYh0LZ3), 3. how strong of a draw will mission/openness be to.. Short list of issues OpenAI raises: 1. accuracy of the Musk-Altman case for multipolar AI outcomes (cf. Bostrom 2014) 2. how to deliver on.. For contextualizing the aforementioned "safely" caveat thing, and other stuff about OpenAI, recommend this interview https://t.co/XqIrVIWYwa Many thoughts on @open_ai. Very exciting... will need to sleep on it :) RT @markoff: It seems like hardly a week goes by when I haven't written about a new billion dollar AI lab! :) https://t.co/pd9F10ZTLB @NYT @markoff might be a difference between press release I didn't see and website, but website currently says "safely." Noteworthy word... @nyt @markoff quote here https://t.co/GzWnWtcAjC is missing last, significant, word. https://t.co/DdBqXpenA0 https://t.co/MLuYfN36Xh Great few days at #NIPS2015. Met many new folks, caught up with others, learned much stuff - much to process. Back to the desert tomorrow :) @j2blather second from left is Cynthia Dwork FYI RT @open_ai: Around #NIPS2015? Join us at gaZette in the Westin on Saturday, 7-9PM. @smc90 it's a compliment - I want to understand ur point :) @smc90 @beaucronin didn't get ur meaning there, clarify? sounds relevant to my interests.. :) @open_ai is a big deal... Open AI will need to specialize (vs. Google, Facebook, etc.) on data-efficient learning to be competitive research-wise. @beaucronin RT @beaucronin: Second thoughts: how will @open_ai hold itself accountable? And where will it get data? RT @beaucronin: First thought: this is a good thing - don't want this developed by default at Google, FB, etc regardless of how open they m… "RT @elonmusk: Announcing formation of @open_ai … https://t.co/Fcouhwh6MC" RT @mappingbabel: OpenAI: "This collection of people is stunning" https://t.co/GAzzOcNfRC Ilya Sutskever, @karpathy , etc. Potential for hu… RT @rdanielmeta: @rv_guha says #Cyc and similar systems were taught, we see many things learning on their own; we need a combination. #NIPS… @bradneuberg interesting that IBM also working on deep reinforcement learning, didn't get what was diff. from what DeepMind's doing, though. Training deep nets to produce images that humans think are real - Bengio discussing recent examples #NIPS2015 https://t.co/DKEZvQD9Lh As I discuss in forthcoming paper, one of impacts of hardware progress is faster rate of experimentation with new AI designs. Hardware progress = key contributor to recent deep learning progress, e.g. Tesauro ran code that in 90s took 2 weeks, now 5 mins #NIPS2015 Bengio on attention for caption generation #NIPS2015 https://t.co/cSvJjHGJ62 RT @BrownSarahM: Packed 5min early for talk on isomorphism between a deep neural net and the human brain for vision #NIPS2015 https://t.co/… RT @mpd37: Fantastic summary of deep robotic learning by S Levine #NIPS2015 https://t.co/tE5oYHz7Cn Reinforcement learning ideas helpful for machine learning, caption generation, attention.... -Bengio #nips2015 Yoshua Bengio next. Will be interesting to see what he has to say on RL... #nips2015 https://t.co/JsSgsmb9e9 Levine on next steps for deep RL w/ robots - need for data, a few possible ways. #nips2015 https://t.co/FdyxACOrVF Guided policy search applications - Levine #nips2015 https://t.co/Dl2heobJUe For context on last retweet, Sutton co-authored the main textbook on RL... so, yeah, hot topic. #nips2015 RT @NandoDF: Rich Sutton locked out of the RL workshop at #nips2015 because it's too full :) https://t.co/VutJwIAYW0 Sergey Levine talking about guided policy search to speed up robot learning of manipulation tasks #nips2015 https://t.co/8Uq3ih9hhV RT @jimmfleming: 3D maze navigation seems to be another RL benchmark for DeepMind and IBM (Wolfenstein) #NIPS2015 #DeepLearning Arel of @OsaroAI: imitation learning more practical than deep RL from scratch, applying it to robotics #NIPS2015 RT @mpd37: V Mnih: Montezuma's Revenge about to be solved by Async A2C. Really cool! #NIPS2015 #DeepMind #DeepRL @davegershgorn yep, and interesting DeepMind just showed 3d navigation too.. @davegershgorn no shooting, just navigating maze Tesauro on IBM system that navigates mazes in simplified version of Wolfenstein #nips2015 https://t.co/lixVBnaO9J Mnih of DeepMind showing 3D motor control with latest fast deep RL system #nips2015 https://t.co/aRmZrn06zc Bowling: understand reasons for DQN (etc.) success, use shallow/deep features to focus in other RL probs. #nips2015 https://t.co/B0HXQWLJOD RT @pushkar3: Scene at the Deep Reinforcement Learning Workshop at #NIPS2015 https://t.co/I08ifGGS7H Great talk by Michael Bowling on deep RL in context. Here comparing shallow RL to DQN. Tesauro of IBM next.#nips2015 https://t.co/LsfBbe8OQN RT @AlisonBLowndes: Standing room only for the Deep Reinforcement Learning Workshop @NipsConference #NIPS2015 #deeplearning https://t.co/zc… RT @FaisalLab: #deepRL nips workshop about to start, so packed that people start asking for permissiob to set next to you on the floor #NIP… RT @vkrakovna: Percy Liang: inverse reinforcement learning unlikely to be sufficient for value learning, data too sparse #AlgorithmsAmongUs… RT @vkrakovna: Shane Legg: AI research priorities - goal system stability, interruptibility; need formalization and sandboxing #AlgorithmsA… @hintikka @mappingbabel ew, the "this is a draft" thing looks like it got cut off up top. sigh. so don't RT then ;) but thoughts welcome. @hintikka @mappingbabel you're welcome to peruse draft of said paper if bored ;) https://t.co/vp8i3OyX5d new ideas consistent w/ it, >detail @hintikka @mappingbabel various smallish things (e.g. rate of prog. in speech recognition), general optimism about next 5-10 years. "Updating views/plans* on AI progress after many good chats at NIPS. More + deep RL workshop tom. *posting paper ~Tues., unsure what after." Fascinating day at NIPS. Much to ponder... RT @vkrakovna: Shane Legg: Advanced AI is not imminent, but an enormous transition many AI researchers think is likely in our lifetimes. #A… RT @risi1979: Demis Hassabis arguing for games as the perfect testbed for AI #NIPS2015 https://t.co/Wq3ve7b0GK Ng - impact of AI on employment biggest issue for AI in next several years. Not much concerned about other issues/longer horizon #NIPS2015 Legg contra Ng on difficulty of foresight: point time prediction not goal, goal is thinking about challenges/strategies in advance #NIPS2015 Marcus - need to worry about advanced AI regardless of human level-ness. LeCun - will be different than us, humans not general. #NIPS2015 Legg defending work on AI safety/ethics as responsible contra Ng comparing to worrying about Mars overpop., better to be prepared #NIPS2015 RT @cosmosquared: Shane Legg on stage now at #NIPS2015 discussing general AI. His thesis "Machine Superintelligence" is here: https://t.co/… @robertsdionne awesome - thanks! Correction: best Atari scores here https://t.co/3Nh24NGHxj and here https://t.co/R8bPsdqX0G (had same link twice before). h/t @nikete @nikete thanks! will correct. @mgubrud going to bed right now but interesting point re: data/crunch ratio and data loading...not familiar w/ latter issue/QC in general. @mgubrud 4 now, paraphrasing Hinton - "came up w way to speed up NNs 100 millionX...wait 20 yrs til 1 million faster, then add 100x trick :) @mgubrud can be both, depending on method... e..g neural nets especially compute intensive during training. posting related paper next week, ...specifically, this https://t.co/R8bPsdqX0G and this https://t.co/R8bPsdqX0G - combination not yet reported, but prob. will be very high. New version of "Deep RL with Double Q-learning" by DeepMind has better results b/c tuned https://t.co/TYtBCYWFLB though new papers = better. @mappingbabel @AuerbachKeller + de Prado's comment in your latest piece :) apparent contrast, at least... @mappingbabel @AuerbachKeller thx, will watch! also, was just now noting contrast btwn note at v top here https://t.co/HLgAcRvJcz ... RT @mappingbabel: @Miles_Brundage @AuerbachKeller Seth Lloyd at MIT has done thorough work on this. https://t.co/wcpGw4IrDJ Related: found this post by Scott Aaronson helpful regarding the latest D-Wave/Google stuff: https://t.co/m9ofayuxE9 @AuerbachKeller yeah, was just reading this https://t.co/m9ofayuxE9 and I see the paper briefly mentions neural nets, but not much detail... Where can one find a good explanation/analysis of what sorts of AI-relevant tasks can/can't be sped up with quantum computing? RT @danielas_bot: Baidu's self-driving cars: https://t.co/hVVs51tSVx RT @SPRU: Come work with us! New Professor of Science and Technology Policy sought: https://t.co/n5ECREGItX #scipol Ancillary Justice is excellent. Halfway through it...would be done for a while now if it weren't for research guilt. RT @vkrakovna: We need more questions for the panels on long-term AI impacts at tomorrow's Algorihtms Among Us symposium! https://t.co/OQEv… En route to Montreal for NIPS. See some of you soon! :) Interesting - Bostrom and Hassabis among invited speakers at AAAI 2016: https://t.co/9iIaSC0idi Also, panel on AI and work. RT @maosbot: Have a question for our #NIPS2015 symposium on the societal impacts of ML https://t.co/Ys0HoVqbfM? Post it here https://t.co/j… RT @beaucronin: Both true. https://t.co/zkUri6gRpy RT @mappingbabel: Why 2015 Was a Breakthrough Year in Artificial Intelligence https://t.co/PxxMmCYDB5 -- 6 graphs plotting AI's rise and ri… @mark_riedl thanks! :) 8. Oh, and they actually scored points on Montezuma's Revenge, unlike DeepMind's work so far. @sarahjeong yasss 7. Provocative paper. Note also, though, that post-DQN papers by DeepMind have since shown better performance than vanilla DQN(+this paper). 6. They develop a way of processing the image that applies across games (/possibly beyond) and get comparable results to DQN with that + RL. 5. fact that convolutional nets implicitly encode various aspects of the environment/task (e.g. non-Markovian), and simple methods can, too. 4. is that most of DQN's performance benefit over prior approaches can be attributed not to its use of deep neural networks per se, but the 3. So, in addition to some interesting points on evaluation issues with the DeepMind deep RL Nature paper, the key takeaway from Liang et al Cool demo of visual question answering from Zhou et al. (MIT/Facebook): https://t.co/7Vp2e3ph5X Paper: https://t.co/A0h5wP8tUi RT @stanfordnlp: Cosmic justice at work: Men have to line up for the bathroom at #nips2015. 2. reasons for DQN success on Atari, issues with Mnih et al.'s evaluation methods and proposed alternatives, etc. More thoughts soon. 1. "State of the Art Control of Atari Games Using Shallow Reinforcement Learning," Liang et al. https://t.co/YshIstccnM Great analysis of.. @victorhcm nice. was just thinking it'd be cool to get it to run in real time on webcam video, but it's a bit slow, on my Mac at least :) Inception-v3 run on my profile pic. Nailed the seat belt, seems faces/humans/beards aren't tested for on ImageNet :) https://t.co/ecmlg3vqoh Inception-v3 is 95% sure my dog is a Pomeranian...about right considering she looks like she has other breed(s) mixed in. Other results <1%. @Aelkus yeah, I think I started trying to replicate it at one point, forget what stopped me...prob some silly dependency thing... @Aelkus see also: https://t.co/8xfrFP9oNs RT @erichorvitz: Fun piece on predictions by folks at Microsoft Research. https://t.co/zJpTF21KZK Thinking about collective intelligence + superorganisms, prompted by Ancillary Justice... recommend it highly. :) Still working through it. Re: last RT's, I'd add that Christiano has lots of interesting, readable Medium posts on related issues. RT @danieldewey: See also this article by Taylor, which seems like another part of the conversation about imitation & goal-direction: https… RT @danieldewey: Excited about conversation between AI risk researchers: https://t.co/WUYomQ4sMn (see comments at end of article) RT @karpathy: recall: my performance was ~5% and I tried quite hard (https://t.co/OOGaHaiTzz). So, 3.46% is very very good. RT @karpathy: New paper from Google team with more details/changes on the Inception CNN architecture https://t.co/YvVHVTw6aa 3.46% top5 err… RT @iwonabb: .@HoloLens app which turns e-books into real books. /cc: @BoredElonMusk Enjoying Ancillary Justice so far. "@pmarca Marcus Aurelius kinda did - sold his*/his wife's* stuff to pay for war (https://t.co/jY3JoEIYO8). *""imperial furniture/decorations""" 2. Facebook's neural net+MCTS Go bot is on the KGS server as darkfmcts1: https://t.co/XZk6k4QPT8 Haven't bothered to get beaten by it yet... 1. Thanks to a tweep for pointing this out to me by email (feel free to chime in and let me know your username here!) -as of a few days ago, @j2bryson just saw this a little while ago and went ahead and picked up Ancillary Justice :) RT @j2bryson: I’m with Whiteson, Russell & er—me! RT @david_h_a_l 20 #AI experts reveal their fave scifi https://t.co/oZR46FsMgb https://t… "Deep Reinforcement Learning in Keepaway Soccer," master's thesis by Mateusz Kurek: https://t.co/QdZ7GZytIS @Aelkus may have a folder of related stuff I can send, will see later if I deleted it or not :) wanted to get into this but never did... @Aelkus yet the one with MCTS). lots of papers on systems by folks behind some systems like Fuego,CrazyStone (Remi Coulom). hope that helps. @Aelkus Maddison/Silver and Storkey/Clark's citations. NKS server lets you play against wide range of bots inc. FB's darkforests (though not @Aelkus this has links to code https://t.co/dsb8QbIl9j lots of open source projects; see also this paper https://t.co/KQzwfC6vit and Re: last tweet: Chainer = project of Preferred Networks (Japanese company) doing deep RL for Fanuc, discussed here: https://t.co/4YhW5KIZaQ RT @ChainerOfficial: Our poster paper is accepted at LearningSys workshop in NIPS. See you at Montréal next week! #Chainer https://t.co/7g3… @mark_riedl same here - look forward to seeing you there! Will be attending the social impact one the whole time, prob., but come on, why do the best parts of conferences happen at the same time? :/ Need to be here https://t.co/evh0mNSAAz here https://t.co/Hu6Cd6tzl9 and here https://t.co/vvBhwkqjWA at the same time next week. Tricky... @mark_riedl and yes, more homework needs to be done by most journos on such things. world needs more @danielas_bot's and @mappingbabel's :) @mark_riedl AFAIK their main contributions in 2013 were making deep RL training more stable + picking impressive domain ;) more since... New DeepMind paper introduces slate MDPs and application of deep RL to recommendations: https://t.co/6AcxK3ivqW @mark_riedl ...which itself built on a lot of earlier work. @mark_riedl yeah, they def. didn't invent it out of thin air :) I should have clarified that that is the first IRL app. of DQL I saw.... 8. Curious to see if Osaro ends up w/ ethics committee, too. Perhaps a more public one than Google's (now Alphabet's? DeepMind's? unclear). 7. that thing (people researching long-term risks starting companies) is interesting...also Legg, whom I look fwd to hearing at NIPS, too :) 6. To be clear, Osaro bots aren't taking over the world anytime soon (though worker safety is obv. an issue to be cognizant of), just think 5. written about (deep) RL as foundation for human-level AI https://t.co/s8QoRDsl2n and risks thereof https://t.co/4MOMlMz2Vy 4. Will be interesting to hear more about Osaro at deep RL workshop at NIPS (and eat their sponsored lunch :) ). Founder Arel notably has... 3. Indeed, the first paper I saw on a deep RL application was trying it for laser welding, and Fanuc apparently doing it now, too... 2. and is part of Alphabet, not Google, now. Also makes it sound like deep RL for bots hasn't been done before - has, e.g. by Abbeel et al.. 2. and is part of Alphabet, not Google, now. Also, makes it sound like deep RL for robots hasn't been done - it has, e.g. by Abbeel et al... 1. Interesting piece on Osaro and deep RL https://t.co/Rgp3arbypr though seems to have some errors/omissions - DeepMind is in London AFAIK, RT @samim: #MangaNet https://t.co/pjPGwBpnFO RT @samim: I´m rendering a deep anime atm. ;-) https://t.co/DHz5LKV9VY RT @jrbarrat: Cambridge University sets up a center to study artificial intelligence ethics. #AI https://t.co/9iZwjHcEBJ via @WSJD https://… RT @samim: AnimeNet is live ! https://t.co/Nw3hxECfF3 @MatthewGombolay congrats! @MatthewGombolay congrats! RT @BrianBergstein: Should people with gene disorders use CRISPR to avoid passing traits to children? @antonioregalado asks them. https://… @Aelkus @AnotherWarBlog yup. that's ~ my motivation for AI progress modeling and AI (and work/etc.) policy modeling eventually.. @Aelkus yep. see Sarewitz and Nelson on criteria for techno-fixes. @Aelkus yup. common thread across many policy issues, it would seem. @Aelkus opportunity to cooperate, cultivate spillover benefits from that, climate as maybe threat multiplier, etc. pretty non-deterministic. @Aelkus yeah. haven't followed much in recent years but when I interned for those folks back in the day, the evolved view was: use enviro as @Aelkus e.g. water disagreements almost always ---> peaceful resolutions. @Aelkus yeah. there's good work on it, e.g. https://t.co/a8fPn46Th6 but media uninterested in some of those actual experts' conclusions, @Aelkus see also, climate change and green jobs (don't get me started...). @Aelkus indeed. I like the book Inventing the Future for taking on that/other issues explicitly, even if unsure about all of their proposals @hypatiadotca good idea! :) I was told I need to watch an ep. about driverless cars, maybe should do that first to prepare(/prepcrastinate). 7. distracting from (mostly human/political, though some technological) interventions needed to make future not suck/suck less than present. 6. In short, "tech unemp." frame, while usefully highlighting some issues, shifts focus from humans to tech + present to future, ironically 5. is detectable human impact on climate change yet. Regardless, should have thought ahead abt energy more for that and many other reasons. 4. is doubtless v. important (I focus on it a lot) but trend analysis of job stuff in isolation is also kind of like asking in 80's if there 3. of and predate current empirical trends (like how to make jobs suck less, ppl able to find jobs when they want em, etc). Analyzing trends 2. problematic frame not just b/c overly deterministic, but also b/c eschews normative/political questions which are somewhat independent... 1. "Tech will/won't destroy/improve jobs"=bad framing of wicked prob. w many independent variables, most of which are humans/groups thereof, RT @vkrakovna: Blog post on long-term AI risk aspects that don't involve an intelligence explosion. https://t.co/BWS6d7xcwA @mariana_farinha yeah, it's really good ;) the hype is right this time... "Tech will/won't destroy/improve jobs"=bad framing of wicked prob. with many independent variables, most of which are humans/groups thereof. The Reasoning, Attention, and Memory (RAM) workshop also sounds quite interesting... https://t.co/6K7V24tpuW Too much interesting stuff... Perhaps the CoCo workshop will result in progress toward @karpathy's variable binding mystery module ;) (https://t.co/QckXQcDn8r) This workshop put on by @GaryMarcus et al. on integrating neural + symbolic approaches to AI looks interesting, too: https://t.co/8imS1PVnKt Looking forward to the social impact symposium (https://t.co/vvBhwkqjWA) and deep RL workshop (https://t.co/CJhrMbsk1f) at NIPS soon! RT @risi1979: New NIPS workshop paper on Evolving Neural Turing Machines: https://t.co/0CIl86WVYD RT @fchollet: Not saying it's an invalid view. It's perfectly valid. But many other, very different angles are valid as well. RT @fchollet: Schmidhuber's hammer is RNNs. When you've spent your life working on X, you start believing the mind works like X. RT @mark_riedl: Let’s just hope no one thinks to hook Deep Reinforcement Learning up to CRISPR. Oh… Wait… Where’s the delete button? Click.… RT @fchollet: "On learning to think", a massive technical report by Schmidhuber. Must-read. https://t.co/EkNEEuBiU2 6. we grant too much credence to experts' assessments of their fields' futures/impacts? Why/when do some fields fear (self-)governance? Etc. 5. do so"... Both of these aspects raise Qs related to societal governance of tech - why do we seem to wait until clear/present danger? Do.. 4. research communities bc considered speculative, distant future, etc. Also, in each case, some element of "let's govern selves b4 others.. 3. issues (genome editing, AI and work, long-term risks, etc.) that had been discussed for a long time by *some* but largely backburnered by 2. rapid, largely unanticipated progress in technical capabilities (CRISPR, deep learning) played a role in bringing heightened urgency to.. 1. Among other (dis)analogies between current discussions of the social impacts of biotech and AI (more on the latter in paper soonish), ... @hintikka :/ 9. But it's complicated b/c Mnih et al.'s set up nerfs the AI somewhat, + some games like Montezuma's Revenge are still stuck at 0 score. 8. a bunch of diff. games, which ~ = "average" human performance, per the Nature paper), and at current rate, that's a few years away max., 7. Also looked v. briefly at progress towards deep RL being competitive with the *best* human scores (as opposed to 1 human's scores on... 6. Also, =case in which exponential progress (in deep RL scores) caught up with the "incumbent" (classical planning) surprisingly quickly... *the RAM (though ROM is kind of true - see e.g. Nipovetsky 2015, "Classical Planning Algorithms on the Atari Video Games"). 5. reinforcement learning is an increasingly powerful combination for a wide range of problems even with big handicap (~no prior knowledge). 4. in 2 out of the 4 games I've tracked closely (Seaquest and Space Invaders, but not Asterix or Breakout, yet). TL;DR: neural networks plus 3. excluded because it seemed to make the problem too easy/the scores were super high. As of latest papers, deep RL w pixels > that method.. 2. using classical planning techniques and direct access to the state of the game (e.g. the ROM), not just pixels, which I had previously... 1. Whoa... I just revisited the data here on reported AI scores in Atari games: https://t.co/tG05RYV8tK and compared to scores from papers.. Me back in the day on "Energy Technology Breakthroughs in Context": https://t.co/NZsODGLrsY Relevant to Paris/Gates stuff... @hintikka fortunate to have not read him in a while... your feed periodically reminds me he exists. :) Article by @xuenay - RT: @JohnDanaher: Desiderata for a Model of Human Values https://t.co/1dLabYaI6N RT @2020science: What are gene drives, and why should you care? A new Risk Bites guide to gene drives, gene editing, and CRISPR https://t.c… 2. with different reward schemes leading to different learned behaviors. Videos of competitive/cooperative behavior: https://t.co/6aXVd5Z3FM "1. ""Multiagent Cooperation and Competition with Deep Reinforcement Learning,"" Tampuu et al.: https://t.co/PsYHCGU2GP Deep RL in Pong..." """Neural GPUs Learn Algorithms,"" Kaiser + Sutskever (ICLR 2016 submission): https://t.co/4hJQbLFh3v Like Neural Turing Machine but parallel." RT @MIRIBerkeley: Expected utility quantilization: A new satisficing agent design combining maximization and apprenticeship learning. https… @vgr paging @AliMattu :) @Aelkus look fwd to seeing said paper. I've thought most about application to future of work stuff and, a distant second, AI risk stuff... @Aelkus since that was written, this came out: https://t.co/PlskjGX0Ex their "capabilities" are ~ 1 level of modeling I think is needed.. @Aelkus look fwd to your thoughts! Def pretty preliminary, hoping the talk on it/follow up paper with model >> final version > that version. Decided to go to NIPS this year after all (part of it, at least). Look forward to seeing some of you in a few weeks! RT @Jackstilgoe: Cracking piece on the fear of imagined Luddism https://t.co/tZkuAGIMVw Would be interesting to have a(n ensemble of) good Go bot(s) go up against a(n ensemble of) good human player(s) or some combos thereof. Compare Go hype from DeepMind and new paper from Facebook to, e.g. https://t.co/n7o6WHikd6 last year ("10 years may prove too optimistic").. Related - "Forecasts based on numeric trends are more accurate than forecasts based on opinion" one of findings from https://t.co/KZQjM93J9Z Extrapolation of computer Go performance trend from 2011 on (https://t.co/bSxv0dZbFW) suggested bots would beat the best humans around 2015. RT @MelMitchell1: This week's issue of Science has some very sobering information on climate change and the future -- e.g., https://t.co/9t… @willgilpin haha good question :) not 100% sure, but it's either a bot or a team of skilled humans playing 24/7 with ultra-fast responses... Got beaten really badly at Go by darkfores1 (one of Facebook's Go bots). Not surprising considering I'm bad at Go, but had to try. :) Enjoyed reading @karpathy's sci-fi short story - lots of interesting ideas on the future of AI, work, etc.: https://t.co/QckXQcDn8r On last RT (AI patents) - I did a rough analysis once and concluded that ~half of neural network-related patents have been since 2010 or so. RT @graphific: Yepz that's a surge in AI patents which doesn't seem to stop... https://t.co/N8SwLe3gNp RT @MIRIBerkeley: A new paper on attractor strategies for highly capable AI systems: "Formalizing convergent instrumental goals." https://t… Watching darkfores2 (Facebook Go bot) play - 3 dan now. Opponent says "f***ing bot actually really think [sic]". Think that's a compliment.. @mappingbabel Arxiv itself has an experimental full text search feature: https://t.co/JjJNjCyhJg RT @MatthewGombolay: Attack-Bots with Rifles and Grenade Launchers to be purchased by Beijing Police - @Telegraph https://t.co/ZJBaS3kHov h… Any tweeps going to NIPS? @BrianSJ3 Nice, will check it out - thanks! """Strategic Dialogue Management via Deep Reinforcement Learning,"" https://t.co/d4nkxW6E9Q Deep RL applied to Settlers of Catan." @SimonWierny policy, experience, etc. whereas AI/robotics hasn't been a subject of as much focus yet. Could change - https://t.co/DqszICopx9 @SimonWierny "likely", sure :) but not inevitable...gov't on cutting edge of e.g. energy b/c big effort on it, lots of theory on energy 9. high costs for other parts of gov't (energy, health care, etc.), as I/others have suggested, =simpler, but still needs to be fleshed out. 8. In contrast, the conceptual framework/case for, e.g., saying gov'ts should orient more automation R+D towards grand challenges/domains w/ 7. Are ideal but "support tech that makes ppl more productive/doesn't replace them"/vice versa=vague. Need nuanced AI (R+D) policy analysis. 6. Making some people more efficient can result in others being replaced, + vice versa... don't think it's likely that current AI/robotics 5. But I don't really know yet how to make sense of those proposals/if they make sense given the deep complementarities of aug/replacement. 4. I'm with all of these authors on the need to think proactively/systematically etc. about gov'ts' roles in affecting innovation pathways, 3. The Second Machine Age's #2MA + Tony Atkinson's explicit/others' implicit suggestion to do opposite (preferentially support aug. R+D)... 2. just regulatory/tax sorts of ways but also through targeted R+D for replacing (vs. augmenting) human labor. This goes against, e.g... 1. Among other noteworthy things about Inventing the Future is its defense of gov'ts proactively supporting workplace automation through not Finished Inventing the Future: Postcapitalism and a World Without Work. Interesting on left politics, future of work, etc... Pondering more. Think this https://t.co/aCMCL5x0hJ is the darkfores2 described in Facebook's Go paper. No sign of (stronger) darkforest+MCTS yet, though... RT @HMRoff: See my new piece on autonomous weapons -essay no. 3 - https://t.co/RuvkcrTNmf @BulletinAtomic @DefTechPat @NewAmerica @asu_gsi … @mark_riedl ...but noteworthy that it isn't the code qua code that's the main source of value - if they publish pseudocode, remade in days. @mark_riedl OTOH, unrevealed algos/insights have value for companies, along with hardware supremacy, talent, design, etc. not just data... @mark_riedl thought this was on point on the "mini" part, though: https://t.co/DBaJRhZk3v RT @mark_riedl: What will be truly revolutionary: people able to play with ML systems without studying ML and without knowing how to progra… RT @mark_riedl: Whether or not TensorFlow is the best or not, the fact that companies are racing to open source their ML code is a mini rev… @mark_riedl think we're pretty close, e.g. MetaMind's website, some of @karpathy's demos, etc... RT @mark_riedl: I wrote a short, high-level paper on how to use stories to teach morals to #AI https://t.co/aMwNpSVPGl Best read during a t… My paper, "Modeling Progress in AI," was accepted for a talk at the AI, Ethics, and Society workshop at AAAI '16. :) Will post in few weeks. " Towards Adapting Deep Visuomotor Representations from Simulated to Real Enviros," Tzeng et al. (ICLR submission): https://t.co/uopsjqzuTI @j2bryson just meant 2 & 3 speak most directly to what I was referencing :) @alexjc had been around 1 stone/year which suggested some linearity but honestly I don't know much about it :) only played few games myself. @alexjc my extrapolations were very rough/don't take increasing difficulty into account, seem to recall hearing somewhere that prior prog... @alexjc The abstract is kind of misleading.. @alexjc what they got before adding MCTS, and they don't describe results vs human from darkforest+MCTS but it's presumably >2 dan. @alexjc I may be misunderstanding the paper but if my interpretation/rant here is right: https://t.co/hx6jqVSQLd then darkforest = 2 dan = Part of the potential value of a digital assistant is enabling more efficient interaction, e.g. dash off curt email to schedule appointment. ...that question/answer raises some tricky issues, but ultimately I am w/ @j2bryson on related points 2 and 3 here: https://t.co/u6q2Bf0HqS @xdotai beta is cool. Would get > value out of it if I had > mtgs. Was asked (by human) whether to worry about politeness to Amy (AI) - no. 7. Suspect DM's best Go bot is stronger than FB's because more ppl there who focus on Go, been working on it longer, and bragging about it. 6. aka high amateur, +they note many ways to improve, so I'd guess they and/or DM (esp the latter) are in striking distance of/at pro level. 5. So, don't know for sure how they rank today, but extrapolating from the early results in FB paper, their best is prob. at least 4-5 dan, 4. and https://t.co/qDXPsmXlWC which are still going. As for DeepMind's Go bot(s), dunno - this one? https://t.co/Pah6SOSxAi Too obvious ;) 3. (the one w neural nets+MCTS) and only show offline results for it. Maybe online now? First bots seem to be these: https://t.co/dcJ4F4jma0 2. dates when they started running the first few bots on the KGS server (Sept.) and them apparently not having done so for the best one yet, 1. Upon reading the Facebook Go paper (https://t.co/KQzwfC6vit), some thoughts: they have only been working on this a bit, as shown by the "Accurate Image Super-Resolution Using Very Deep Conv. Networks" https://t.co/WNCYrljST5 (or, why "enhance that" in sci-fi isn't nec. crazy) @beaucronin Nice. Watching in a bit after I binge on some ICLR papers :) #wildweekend RT @NandoDF: New architecture for deep reinforcement learning https://t.co/j0c0X0z2ow RT @NandoDF: deep learning for Atari: seeing what the duelling network pays attention to. https://t.co/1Hyl1U8dd5 9. To return to a running example I've mentioned, how much progress does extension of deep RL to 3D enviros represent? Faster training? Etc. 8. It is on its last legs (on most games) or persistently too difficult (on some like Montezuma's Revenge). Progress still under-theorized.. 7. (among other criteria like those Hernandez-Orallo discusses). I am a fan of Arcade Learning Enviro, but dep on how you operationalize it, 6. Probs/eval frameworks exist (see here for good review: https://t.co/rgGBeNEo6q), hard to find sweet spot btwn tractability and endurance. 5. People are coming up with approaches to challenge probs almost as fast as they are articulated, and though some much harder/longer term 4. I have neither read these carefully nor replicated them, but if any is on target, this fits with a common theme in recent AI history: 3. Here is another ICLR submission, by Searle and Bingham-Walker, claiming to get good results on that problem set: https://t.co/Oadm9nhmNn 2. space reasoning by Lee et al., ICLR 2016, in review: https://t.co/bn1QeyKn7n) get near-perfect results on Facebook's NLP challenge probs. 1. Two NLP papers using very different methods (answer set programming by Mitra and Baral, AAAI 2016: https://t.co/AoknBUKSBF, and vector RT @ylecun: 270 submissions to ICLR this year. Way more than last year. @beaucronin definitely. Never been, but should prob consider it this time around. Digging the open review process. "Towards Principled Unsupervised Learning," Sutskever et al. (ICLR 2016 submission) https://t.co/Qrgznt5u6O "Neural Random Access Machines," Kurach et al. (ICLR 2016 submission) https://t.co/ps4jcSv0mU 2. in other new DeepMind paper (https://t.co/wNWqXwoSxY) as complementary - combo would improve score beyond this: https://t.co/tG05RYV8tK 1. "Dueling Network Architectures for Deep Reinforcement Learning" https://t.co/R8bPsdIxSe, DeepMind paper using Atari as benchmark - ref'd This tweet is now obsolete: https://t.co/OLAnwfXZ57 Tian and Zhu of FB have a paper combining neural nets and MCTS: https://t.co/KQzwfC6vit @roseveleth Superintelligence, Robot Visions, Naked Sun, BSG, AI: A Modern Approach, Robocalypse, +Player Piano (in no particular order) :) RT @kcimc: neural net descriptions generated in realtime during a brief walk around amsterdam https://t.co/V35fZ1uVlC using neuraltalk by @… RT @RoboNarratives: Robots need to learn how to morally evaluate human requests. Work @hrilab shows a first step for moral HRI. https://t.c… 10. Also noteworthy that we've had systems that could beat random people at Go for a while now. Depends where you establish the goal posts.. 9. See also Bowling et al.'s def. of "essentially weakly solving" HULHE here: /play it here: https://t.co/LZxJNRtPJc https://t.co/ITdY6GFMuJ 8. around the same time as that DeepMind paper on move evaluation, similar idea: https://t.co/Z3xmyctafs 7. Whereas FB AFAIK hasn't shown anything. Meanwhile, you can already play against Clark/Storkey system, described in paper that came out... 6. Possible both DM and FB already have empirically unbeaten/-able (by human) systems, working proving it. DM ppl already have papers on Go, 5. Combination of deep learning for move evaluation they've already shown (https://t.co/pXkjuGcVQ7) and Monte Carlo tree search/other stuff. 4. Very plausible that they could claim that it's empirically unbeaten/-able and demo against very strong players. Seems w/in reach through 3. Not sure there is a good enough theory on the game to make that claim, though there's some cool research, e.g. https://t.co/xIkbTYSb1M... 2. Perhaps it could be solved in a similar sense to how Bowling et al. "solved" HULHE poker, but that formulation = based on betting, and... 1. What would it mean for DeepMind (or FB, or others) to "crack" Go? https://t.co/3bmN2ZSrBn Not strongly solve it, b/c too big of a game. Two ICLR '16 submissions involving multi-task/game Atari agents: https://t.co/9IgAfcecQb (Toronto) + https://t.co/wNWqXwoSxY (Deepmind). @mark_riedl horrible. @samim perhaps relevant: https://t.co/NRNNVV8FF8 9. It's clear progress is being made, but unclear how to weight diff dimensions/metrics of progress + anticipate plausible future scenarios. 8. but with general(ish) learning algos going beyond Atari now, picture gets trickier. How much to care abt continuous domain? 3D? >1 agent? 7. The original Atari Learning Environment paper (ALE) suggests some ways to measure prog in ALE (average score, score distribution, etc.), 6. observable, etc. enviros- def progress. That+better scores/faster training on easy games+Montezuma fail raises Q of general AI prog rate. 5. At the same time, DM and others (esp. Abbeel et al. at Berkeley and Stone et al. at UT Austin) are extending deep RL to 3D, partially... 4. It'd be trivial for DeepMind to manually adjust their agent to beat Montezuma's Revenge, but it would go against their MO (generality). 3. As far as I know, good score on Montezuma's Revenge (which involves deeply delayed reward) hasn't been achieved w/ raw pixels as input. 2. trend I noted here: https://t.co/GpCwdbplok Big improvement in 3/4 games. Still failing on Montezuma's Revenge. https://t.co/PuvMjAbzdc 1. The latest DeepMind paper using Atari as a benchmark, Schaul et al. 2016 (under review) https://t.co/3Nh24NYioR continues the exponential "RT @erikbryn: ""Uber drivers represent significantly less than 0.1% of all full-time-equivalent employment."" - @LarryMishel https://t.co/dS…" RT @clarkamiller: "We Can Create the Future We Want" @michaelcrow on the School for the Future of Innovation in Society @ASU @CSPO_ASU http… RT @rcalo: Penn State seeks faculty in drone ethics. https://t.co/Y656nYNubx RT @mhbergen: Just asked ecologist that DeepMind hired what he's doing at DeepMind. "I'm not even allowed to say my job title." Thanks, @su… RT @MatthewGombolay: New robot from @simberobotics checks to make sure grocery store shelves are full for your late night cravings. https:/… RT @sneha_nar: In a push for more state run commons, @astradisastra says 'maybe we should just rebrand taxation as crowdfunding' #platformc… RT @anderssandberg: How experience with forecasting, machine learning and group cognition point toward robust ensemble methods: https://t.c… RT @deeplearning4j: Deep Neural Decision Forests from @Microsoft https://t.co/TZ3lU8IWYl Forests with SGD... #deeplearning RT @pmddomingos: Get Ready for Your Digital Model - my @WSJ piece about machine learning and you: https://t.co/7w4YL7KWtH @hintikka @mappingbabel plus all the people with dual roles, and collaborations involving both... @j2blather hmm, did he suggest something else he considered more viable? Agree it's not likely soon, but things change... @mappingbabel somewhat more specifically: https://t.co/s2TkaG91Su @mappingbabel also, will/should anyone become equivalent of US Robotics (Asimov) - full AI/robotics stack, intelligence/action-as-service. @mappingbabel Alphabet, no one (bc open src/fragmentation), or something new/small now? :) followed by MSFT, IBM, etc... if I had to guess. @SethBaum Haven't worked out my views here but look fwd to this related book: https://t.co/6CEN5GVj67 + https://t.co/ww1TpUgsiv @JohnDanaher "Trump Wall," my first creation with the @wordseye beta (natural language scene generation): https://t.co/nYYTW3npV4 RT @beaucronin: OK, my hot take on why TensorFlow matters. What do you think? https://t.co/6J209TmB30 RT @fchollet: Generating images from text. Starting to look like something recognizable... https://t.co/gw1RFYscju paper: https://t.co/J5Cp… Having fun playing w/ TensorFlow. Easier to get up and running than Torch and other stuff I've tried, +great tutorials. Viz tools very cool. Enjoyed reading The Master Algorithm by @pmddomingos. Accessible book on many key ideas in machine learning and their broader significance. RT @jeffbigham: that's cool, but what do any of those groups of people know about ethics? https://t.co/K8cRrO3UdR RT @RoboNarratives: I'm a social / behavioral scientist looking for a postdoc position in HRI. I'm interested in social responses from user… RT @markoff: Toyota Planning an Artificial Intelligence Research Center in California https://t.co/db7mgFUzbw Xerox PARC redux? RT @rodneyabrooks: Rethink Robotics teaming with Shanghai Electric in China—our Sawyers have arrived in China and are getting to work. http… RT @beaucronin: Today's installment of the future. https://t.co/pnRjMyxT44 @beaucronin that's ~ what Hinton has been saying forcefully in talks lately :) RT @etzioni: @allen_ai launches https://t.co/KPt2ey1Xtv @nature story here: https://t.co/3MTpUeiKM8 RT @clarkamiller: #SFIS and @CSPO_ASU seek asst prof of engineering, policy, and society https://t.co/5iw68juCUh @imaginationASU @ASU @ASUg… RT @williamstome: New #HRI blog post: Is "robot telepathy" acceptable? http://t.co/SWha2gs65s @hrilab Better Q's for Trump('s staff)/other candidates: what would you do about lethal autonomous weapons? automation/labor? (AI) R+D policy? Etc. "Trump* answers bland AI Q blandly (last one here): https://t.co/qBc2zckG8N *Trump's staff. Written interview with coherentish answers, so.." "We trained a recurrent neural network (RNN) to generate (almost) executable, functionally coherent source code": https://t.co/mT7MaCuHqu RT @MatthewGombolay: My advisor, @julie_a_shah, gave a fantastic TEDxCambrudge talk here: https://t.co/ypEBhCvRu5. @MITRobotics RT @erichorvitz: Challenges with AI transparency but promise of human-centric AI methods: see ICML keynote: https://t.co/JXgX2E6Rc6 https:/… RT @mappingbabel: AI news - Google uses deep learning (vector representation for NLP) to interpret queries in search engine https://t.co/4… RT @karpathy: New blog post: "What a Deep Neural Network thinks about your #selfie" https://t.co/dYOlALiclp this one was fun :) RT @RogerDHodge: IBM helps Pentagon personalize the experience of high-value drone customers with "targeted messages" https://t.co/4tqrZEUK… RT @TobyWalsh: TED just published my OpEd on why we should ban lethal autonomous weapons (aka killer robots) https://t.co/UcbfH0CYmA Submissions are due tomorrow for the 2nd International Workshop on AI, Ethics, and Society at AAAI 2016: https://t.co/vL41OInMBJ @mappingbabel is DeepMind part of Google now, or Alphabet? RT @danieldewey: First post in a guide to research on the superintelligence control problem published today! Tell me what you think: https:… RT @AutomatonBlog: U.S. Government Plans Mandatory Drone Registration Program - IEEE Spectrum https://t.co/dAEPt9RSSW via @IEEESpectrum "Economic Reasoning and Artificial Intelligence," Parkes and Wellman 2015: http://t.co/fvmiED4ClW http://t.co/nBEQy3ZW1P "Regulating Artificial Intelligence Systems: Risks, Challenges, Competencies, and Strategies": http://t.co/fEDft1ZbWe H/T @danieldewey RT @SethBaum: Free download link to 'Taking Superintelligence Seriously', @Miles_Brundage's paper in my Catastrophic Threats SI http://t.co… RT @Jackstilgoe: Excellent editorial in @naturenews. After Asilomar http://t.co/SZYxZggVSO. A piece from me coming soon in @resfortnight on… RT @SethBaum: 'Confronting Future Catastrophic Threats To Humanity' is published! It's the special issue of Futures I co-edited http://t.co… Post docs at CSER: MT @CSERCambridge We're currently recruiting for 4 #postdocs - pass on to friends and colleagues! http://t.co/hnMCh37Yw4 RT @deeplearning4j: Demis Hassabis on Deepmind, RL and general AI, speaking to the @royalsociety https://t.co/W1UVGFyxAC #deeplearning RT @AlanMackworth: Singapore introduces Robocoach to keep older citizens in shape http://t.co/yquK7KWTIe @mappingbabel no prob :) @mappingbabel FYI it is Li, not Lee :) RT @mrogati: This Leonardo da Vinci letter is his LinkedIn profile -- and it reminds me of DARPA proposals in academia: http://t.co/IhzSqJ… @DJGagneDos hmm, good question :) his own NELL system is pretty cool, dunno if it is lobster-worthily accurate, though. Neural nets mentioned once in passing in "AI -The Next 25 Years," 2005. Then deep learning revolution began in 2006. http://t.co/oB9wTkMCcO RT @maosbot: In the @guardian today, I argue that creativity is the most difficult human faculty to automate http://t.co/uYQvxlrbzG Cool live demo of YodaQA, open source Watson-like* QA system: http://t.co/zeKj0IICmY Code: https://t.co/e1MWZ80Ggr Not as good at Jeopardy. RT @boydgraber: Video is now available of QANTA vs. Ken Jennings. https://t.co/Aqbt1IkfEh RT @boydgraber: Final score of our exhibition match: 300 QANTA, 160 Ken Jennings. Thanks so much to Ken for coming out and to UW for hostin… RT @mark_riedl: Simple DQN: A replication of DeepMind’s Atari deep Q-learning system: https://t.co/YtmPVWUvSw (in python) RT @j2bryson: A modular approach2learning manipulation strategies from human demonstration. Bidan Huang,Li,DeSouza,Bryson&Billard http://t.… @Aelkus + even assuming the series' plausibility, they haven't seen T3/noted the human dynamics/frailties leading to Skynet's evitable rise. RT @rcalo: Call for papers for We Robot 2016 closes November 1. http://t.co/XAqiUzD67s RT @CSERCambridge: CSER is recruiting! http://t.co/oHBdtucxp7 #exrisk RT @alistairmbarr: Google Doubles Down On AI In Europe As It Takes A Stake In DFKI Research Center In Germany http://t.co/qShMslwurE via @t… RT @GaryMarcus: Game on! $50,000 to first machine that can ace an 8th grade science exam. @allenai_org & @Kaggle #BeyondTuring https://t.co… RT @JohnDanaher: ICYMI: Polanyi's Paradox: Will humans maintain any advantage over machines? http://t.co/XXpzGiaXNM "RT @MontaudPro: Rodney Brooks warns that we must consider how advances in machine intelligence will eradicate jobs http://t.co/uJce5yiKcq …" RT @iGEASmit: New IBM Watson unit aims to commercialize cognitive computing via @FortuneMagazine http://t.co/E16r1JJ51W @zeustoves @AliMattu @nerdsrocket @knewscript hoping to see it tonight or tomorrow :) """Determinants of the Pace of Global Innovation in Energy Technologies,"" http://t.co/MRoe9bZrWn Are AI/robotics entering regime B (fig 3)?" 3. Working on paperifying some of these ideas now + pursuing some of the ideas at the end on AI progress/policy/econ scenario analysis. 2. TL;DR: there are many theories on AI progress's nature/pace/limitations/relation to the future of work. Some thoughts on addressing them. 1. "Progress in AI and the Future of Work" - slides from my seminar at Bath hosted by @j2bryson a few months ago: http://t.co/95cQxMQ3T4 RT @egrefen: Happy to announce that the Machine Reading dataset for our NIPS reading/comprehension paper is now available: https://t.co/qMz… RT @helengreiner: Why Aren’t America’s Shipping Ports Automated? http://t.co/FaGsgFrobi via @priceonomics RT @mappingbabel: Some news: Google working on general-purpose robots. Tackling reinforcement learning, dextrous manipulation, etc http://t… RT @shakir_za: See our latest paper: deep learning, variational inference and info theory to create self-motivated agents. https://t.co/Tr… Finally watched Mr. Robot. Love it so far. RT @erichorvitz: CACM Viewpoint article on "Rise of Concerns about AI: Reflections and Directions" openly accessible at http://t.co/6Qp8cX2… RT @j2bryson: Reminder: AAAI Spring 2016 Symposium on Ethical and Moral Issues in Non-Human Agents due 5 October! https://t.co/mjvVquviw9 RT @etzioni: Smaller, Faster, Cheaper, Over: The Future of Computer Chips, by @markoff No exponential lasts forever.. http://t.co/zKWVpVj7lJ "One-Shot Learning of Manipulation Skills with Online Dynamics Adaptation and Neural Network Priors," Fu et al.: http://t.co/lSIUrFL20C "RT @egrefen: New DeepMind NLP paper from Tim's (@_rockt) internship, using @stanfordnlp's @sleepinyourhat's dataset. Check it out: http://t…" DeepMind's Double DQN (Ibid) paper reports improving significantly vs. DQN in 3/4 of the games I tweeted about here: https://t.co/GpCwdbplok "Deep Reinforcement Learning with Double Q-Learning," van Hasselt et al. 2015: http://t.co/TYtBCZegD9 4. Recent papers (e.g. http://t.co/zy3FwGrSEE) show learning in more diverse/realistic enviros. Still, notably fast Atari progress lately. 3. Reduced need for hyperparameter tuning, end-to-end vs. more limited learning, faster training, etc. are all signs of progress. More impt: 2. This is from a semi-random sample of papers. May do deeper survey soon. Also, score is not the only metric of progress in Atari AI. E.g.: 1. Here's a plot of AI scores in 4 Atari games over the past 5 years. Note the log scale. Some important caveats: http://t.co/qt0hL5y0J8 RT @j2bryson: Irony: I got a nice email from Chris Bishop (re: our appearance on Newsnight); @Gmail classified it as "an automated update" … "RT @etzioni: AI2 is hiring. Please see http://t.co/E86WetwLpG Our mission is to contribute to humanity through high-impact AI research and …" @j2bryson think so - haven't registered myself yet but last year you could sign up for just the workshop(s). 2nd Int'l Workshop on AI, Ethics, and Society, to be held at AAAI in Phoenix this February: http://t.co/vL41OInMBJ The first one was great! RT @SethBaum: Thanks to co-editor Bruce Tonn & all the authors (incl. @romanyam @Miles_Brundage @haqqmisra) for making this happen http://t… RT @SethBaum: 'Confronting Future Catastrophic Threats to Humanity' is a special issue I co-edited in the journal Futures http://t.co/rXl4c… RT @SethBaum: 'Confronting Future Catastrophic Threats to Humanity' is near-complete. Info & preprints online at http://t.co/rXl4caoija "AI Evaluation: Past, Present, and Future," Hernández-Orallo 2014: http://t.co/70NEYGEflH RT @karpathy: Video from a talk I gave yesterday on "Recurrent Neural Network Escapades" at @deeplearningldn meetup is up https://t.co/73X1… Examples of policies found by deep RL in continuous spaces (Ibid): https://t.co/rqmR9TUN13 RT @StatsPapers: Continuous control with deep reinforcement learning. http://t.co/FXnierQlNC @danbann2 yep - good read on this by @roseveleth : http://t.co/OjmtgdNjyS Pacific Standard's huge Future of Work and Workers series has a lot of good/diverse perspectives in it. Recommended: http://t.co/TqomIrrv0m "Reinforcement learning, efficient coding, and the statistics of natural tasks," Botvinick et al., in press: http://t.co/7ppXmypxJO RT @shakir_za: List of #NIPS2015 accepted papers: https://t.co/HbE1DFzYRb RT @drfeifei: Stanford, MIT and Toyota just signed a major collaboration deal of $50M on AI and autonomous driving! http://t.co/aYhhxq2z9x RT @DeepForger: #StyleNet #NeuralArt, concept from @Miles_Brundage and style by Pablo Picasso. http://t.co/Y9PFPKjuDB @DeepForger http://t.co/49agTTdrXN TED talk by Robin Murphy on disaster robotics: http://t.co/xt8tp0LHxV RT @etzioni: Where will AI be in 20 years. Fun Wired (UK) piece: http://t.co/IuCfySAxcW "Other operations, e.g. multiplication, were not learnable by our network, even when each separate sub-task was easily learnable." Ibid. Cool: "Visual Learning of Arithmetic Operations," Hoshen/Peleg 2015 http://t.co/ivQtWfSAMJ Neural net learns to do +/- from visual examples. Also worth noting that there's pretty much a new deep RL-related paper every day now, many using Atari as benchmark. Rapid rate of progress. Other recent near-simultaneous, similar AI paper publications - Neural Turing Machines/Memory Networks, Go neural nets... interesting. (2/2) "Distributed Deep Q-Learning," Ong et al. 2015 http://t.co/A5amDrCboe - compare to DeepMind Gorila architecture http://t.co/qRJKvyFhFJ (1/2) RT @GaryMarcus: Why computers still lack common sense. NYUs Ernest Davis & @garymarcus on the biggest steps AI hasn’t yet taken. http://t.c… "Learning to Predict Independent of [Time] Span," van Hasselt (DeepMind) and Sutton 2015: http://t.co/vPgt44nNzt "Deep Inverse Reinforcement Learning," Wulfmeier et al. 2015: http://t.co/wTuUOAi54z @j2blather @conjugateprior yeah, good to avoid it if possible between ~ May and September. It's great the rest of the time :) "RT @clarkamiller: Today’s models of innovation fail far too many, driving inequality — future models of innovation need to do better. http…" "RT @clarkamiller: ASU launches new School for the Future of Innovation in Society - join us in taking innovation to a new level http://t.c…" RT @BotJunkie: On Automaton: What Boston Dynamics Is Working on Next http://t.co/zLBWfEkpNb #robotics Recommended: "Is a Cambrian Explosion Coming for Robotics?" - Gill Pratt, Journal of Economic Perspectives - https://t.co/AVhMcmr6bV RT @mark_riedl: I haven't listened to the podcast. I might have said something controversial. https://t.co/CYq6ixcXuR RT @geraldhuff: Optimistic view from @psaffo that technological unemployment will be manageable http://t.co/iLeu0eMnPd larger series http:/… @mark_riedl was gonna share this to clear it up but it now has an update saying they dunno: http://t.co/az1JCD0n6A RT @elonmusk: Tesla Snakebot autocharger prototype. Does seem kinda wrong :) https://t.co/vXpCrKNdlV RT @tegmark: @BotJunkie panned our open letter, writing 'who would seriously be for “killer robots?” I am.' Here's our reply: http://t.co/… RT @pmddomingos: Machine learners of the world, unite! There is much to fight for: http://t.co/qeSw4br3AK RT @elonmusk: Almost ready to release highway autosteer and parallel autopark software update RT @MatthewGombolay: .@HarvardBiz highlighted the research I'm doing with @julie_a_shah on human-robot teaming. Check out the article: http… @PabloRedux awesome. thanks for sharing! RT @danielas_bot: Illusions can teach robots about the world, as we see it: http://t.co/mewF6KLG8F #AI @GordonBrianR not very knowledgeable about SLAM, etc. - interesting Qs, though :) Re: NYT piece I RTed RT @j2bryson: @nytimestech @Miles_Brundage headline wrong but article good @nytimes @RobWortham @FHIOxford @mpshanahan RT @SethBaum: @Miles_Brundage @FHIOxford @CSERCambridge @FLIxrisk This is forthcoming in the Futures special issue on catastrophic threats … RT @SethBaum: Taking Superintelligence Seriously: @Miles_Brundage reviews Nick Bostrom's book http://t.co/OWEG63wPWn @FHIOxford @CSERCambri… @Aelkus http://t.co/UU4O3LXUvr DeepMind's publications page is now updated much more often than it used to be - worth a look: http://t.co/hPx6Xe99xX RT @JG_THE: Most-read on @timeshighered right now: is public engagement a career cul-de-sac? https://t.co/8rZ2UzFNaT @2020science http://t.… @alan_winfield @maosbot @j2bryson thanks, much appreciated! Really enjoyed meeting you, too. @maosbot @j2bryson @alan_winfield Will send you the slides/a summary of the discussion at some point :) Notable aspect of last RT: Bengio role. Formerly, last of the "deep learning conspiracy" unaffiliated w/ industry (Hinton/Google, LeCun/FB). RT @nanettebyrnes: Watson Adds Deep Learning to Its Repertoire http://t.co/BPpbdyUQrF >@TechReview @PabloRedux was thinking about that when I read this the other day! :) Could be... RT @SethBaum: We will model how superintelligence could be built to guide practical risk management & safety decisions @FLIxrisk @elonmusk … RT @SethBaum: Our @FLIxrisk @elonmusk project is 'Evaluation of Safe Development Pathways for Artificial Superintelligence' w @romanyam & T… RT @SethBaum: I'm honored to have my team chosen for one of the @FLIxrisk @elonmusk grants for AI safety research http://t.co/6DsKzVx5KS RT @j2bryson: Progress in #AI & the Future of Work @Miles_Brundage 13July 4:15 @UniofBath 1W3.56 http://t.co/2XpGqg4zCT @alan_winfield @mao… RT @prioritisation: We are looking for a Senior Policy Fellow in AI safety policy. http://t.co/jLTpIoY0eX RT @tegmark: CBS interviewed me for this morning's segment on AI, which avoided the tired old "robots-will-turn-evil" message: http://t.co/… RT @beaucronin: Reality is bloated. It started off as a lean, mean MVP  but now every last use case has been crammed in. https://t.co/UoqYQ… RT @beaucronin: Still plenty of AI journalism and research that is wildly naive - sealed off from reality http://t.co/zp8xts2jRf http://t.… RT @AutomatonBlog: DARPA Robotics Challenge: Amazing Moments, Lessons Learned, and What's Next http://t.co/eQvGpMb2MJ RT @egrefen: Another new Google DeepMind paper: "Teaching Machines to Read and Comprehend" http://t.co/8oNMcfUsZD @nerdsrocket :/ was gonna check it out later, haha RT @JohnDanaher: Here's a simple summary of Nick Bostrom's AI doomsaying argument http://t.co/HScvBvWMvk RT @jmugan: Decades away from good biped robots? Maybe, but remember how bad the robot cars were in the 2006 DARPA challenge? http://t.co/u… RT @AutomatonBlog: 1st place at the #DARPADRC Team KAIST from South Korea! RT @AutomatonBlog: Team IHMC Robotics, 2nd place at the #DARPADRC, now on stage, gets $1 million cash prize RT @AutomatonBlog: Tartan Rescue, 3rd place at the #DARPADRC Finals, on stage RT @BotJunkie: Current top teams at #DARPADRC. Nimbro was nuts! http://t.co/nNFWWO583X RT @karpathy: The DARPA Robotics Challenge Finals live stream http://t.co/j92tQa63Am simultaneously the most and least exciting thing to w… RT @bkeegan: "A U.S. Research Roadmap for Human Computation." #arxiv http://t.co/06HWuhS8Cw "Methods and apparatus for reinforcement learning," deep RL patent published last month/filed 2 years ago, by Minh/Kavukcuoglu at DeepMind. The Nature DeepMind paper has 23 citations according to Google Scholar. Compare to 14 for the older, also hyped Neural Turing Machine paper. RT @MIRIBerkeley: A look into the accuracy of @waitbutwhy's "AI Revolution" blog series: http://t.co/LS8HKLfO1u @beaucronin agreed. Better than most analyses of such things, but that doesn't say much ;) Planning with Stochastic Resource Profiles: An Application to Human-Robot Cohabitation," Chakraborti et al. 2015: http://t.co/y1Jqs4oX5r "Planning for Serendipity - Altruism in Human-Robot Cohabitation," Chakraborti et al. 2015: http://t.co/BLiU3dkqHz Will be in the UK briefly for responsible innovation stuff in July. Some wiggle room in the schedule for AI stuff (in London/Brighton/??)... RT @Reuters: BREAKING: All United flights are grounded due to "automation issues": CNBC RT @tegmark: Here's how to deal with superintelligence according to Stuart Russell, co-author of the standard textbook on AI: https://t.co/… Will be on a panel on transhumanism at Phoenix Comicon on Thursday - should be fun. :) Table of DQN vs. human performance on different Atari games from the Mnih et al. 2015 paper: http://t.co/cBYW0pOCMC DQN fails on some Atari games in ways/for reasons that are interesting and important from an AI progress POV - e.g. deeply delayed reward. Martin Rees and a few others have mistakenly said DeepMind's DQN attained superhuman performance on all Atari games. Very much not the case! RT @mark_riedl: Uber guts the ranks of robotics research at CMU http://t.co/8VYsOebYeS More evidence that AI research is a victim of its ow… RT @twadhwa: Akon is taking $400M he made from his hit singles to bring electricity to rural Africa http://t.co/u4oVbt2NUW @hintikka BBQ (including/esp. beef brisket) in Austin if you eat meat :) RT @j2bryson: Was careful to include more papers by women in syllabus this year. Pictures were also in lecture. Students still call authors… RT @StatModeling: New post: New Alan Turing preprint on Arxiv! http://t.co/XPPZpk7TQ2 @j2blather @j_winterton actually! ;) RT @TedPavlic: Next comes the micro-#robots: "High-performance #microbattery suitable for large-scale on-chip integration" http://t.co/YrCj… @beaucronin hahaha. "Reinforcement Learning Neural Turing Machines," Zaremba and Sutskever 2015: http://t.co/8juCqYJsDt RT @zeynep: Many potential futures of how digital architecture can play out with current configurations of power & money. And a lot is bein… @knewscript @nerdsrocket unrelated: I finished Utopia. Loved it. :) @nerdsrocket You'll do great. :) @MattLevinson + AI stuff in it, http://t.co/VHRSTVAIsw + http://t.co/tlUpohoXBm are some good reads on some related issues. @MattLevinson prob. won't be writing a full one, but briefly: I really enjoyed it, great casting/cinematography/etc... with regard to the + That paper is cool. Basically, they use a combination of a semantic parser (http://t.co/66bPG5F9LW) and Google to answer Winograd Schema Qs. Paper in last tweet = Sharma et al. 2015, IJCAI. Long title so couldn't fit that all in. :) Towards Addressing the Winograd Schema Challenge: Building and Using a Semantic Parser and a Knowledge Hunting Module http://t.co/Vs9KX98v3p RT @CSPO_ASU: New paper from CSPO alum & co-director: a primer for policymakers #responsibleinnovation https://t.co/p8gLxtHa1i RT @JimSpohrer: smart service systems and cognitive assistants at UCSB talk http://t.co/eJaOBzxVrz @The_ISSIP #ISSIP ...also really enjoyed excerpts from Mannheim (Ideology and Utopia), Gordon (Keeping Good Time), and Wright (Envisioning Real Utopias). Favorite books from utopia class: fiction--The Dispossessed, Trouble on Triton, The Salt Eaters. Non-fic.--Willful Subjects, Higher Ground. Done with utopia class finally! :) That was quite a doozy. Don't regret taking it, but was quite a time commitment. 15 books/many articles.. Medium and long-term risks of policies like SRP's: "customer backlash, deferral of adaption, and stimulation of enhanced competition." Ibid. On the "misguided" part of my last tweet, see Graffy and Kihm's paper on utilities' business models and solar energy: http://t.co/Zy1JrJTOAa Solar City pulls installers out of AZ because of SRP's harmful and misguided anti-solar policies (h/t @soundbitelife) http://t.co/L4nBy9zAga This utopia class has made me appreciate how little I know about many key considerations surrounding the future of work viz-a-viz justice... ...but as for seriously ethically analyzing and recommending specific policy proposals, that may have to wait for a while. So many open Q's. 1 thing I know for sure re: my future work on the future of work is that I want to help more robustly theorize AI futures + policy options.. Slides in last tweet elaborate on a few things that I briefly mention in the associated paper of the same name. Thoughts on either welcome! Not sure yet what role the future of work will play in my dissertation. Big topic obv. Recent thinking (AAAI slides): http://t.co/3HnqV8qsiK Thinking a lot about the future of work, in general and in solar energy in particular. Utopia class + soft cost workshop were v provocative. "The Future of Robot Ethics," great talk by @j2bryson: https://t.co/ekztyoP9ud @Aelkus ppl also shouldn't forget Vonnegut's Player Piano :) more timely than ever... RT @elonmusk: For more info on Tesla Energy, check out press kit. $250/kWh for utility scale is the real kicker http://t.co/xE57uIUCse @EvanSelinger @j2bryson yep, it's entertaining and very well-done in most non-AI-ethics respects. @j2bryson's work on robot ethics suggests many ways Nathan in Ex Machina could have been less stupid/evil, +emphasizes importance of design. Ex Machina is a good reminder that people should read @j2bryson's work, e.g. on the huge issues w/ seeing/treating robots as moral patients. ..pretty fast and loose at times re intelligence vs. consciousness vs. awareness, etc. Also: very (too) deterministic about AI future. (2/2) Finally saw Ex Machina. It was entertaining. As for the AI stuff, did some things well, but like the director's NYT piece, it plays... (1/2) RT @TeslaMotors: Harness the energy with Powerwall, Tesla’s Home Battery. #TeslaEnergy http://t.co/N4yjJ1HETU http://t.co/kaTgcAS3zd "RT @vsiv: ""Ensuring Tesla Doesn't Crowd Out the Batteries of the Future""--my take via @Forbes $TSLA http://t.co/rA5YVbpbji http://t.co/NEc…" RT @erichorvitz: Project Oxford introduced at Build conference: http://t.co/AuWwQYjn0I. RT @IBM: RT @WSJD: IBM unveiled what may be a critical component of future quantum computers. http://t.co/WXGbKvDHIy @zeustoves @knewscript @AliMattu @nerdsrocket on ep 3. Bleak at times indeed! Loving it, though...performances, casting, music etc. = great. RT @icra2015: Here's the full version of the #ICRA15 trailer - great way to learn about the latest in robotics and AI https://t.co/R7Hvh0Ja… Lots of thoughts on the future of solar jobs after the workshop over the weekend... Need to ponder more. May write something eventually. Enjoying watching Utopia (UK show, not US - h/t @knewscript) and reading Bloch on utopia. Not v. related, +entirely coincidental, but still. @smc90 + bullishness today is significantly more justified given the current LCOE than it was in the past, and that isn't going back up... @smc90 anyway, hard to tell on twitter but I don't know if we disagree much :) I'm working on/advocating innovation in solar, just think + @smc90 have you read that report (http://t.co/qNYW48Rabc)? would be curious to know your thoughts...speaks directly to that Q... @smc90 not fast enough, but I think one needn't assume radical changes to think solar will be huge player in a few decades. Prefer sooner :) @smc90 latest Fraunhofer ISE report is even remotely correct (too conservative in at least some respects IMO), increments will help a lot... @smc90 well I'm certainly for innovation in solar :) just ran this over the weekend - http://t.co/WRJR6E1YD4 but even w/ silicon PV, if the @smc90 and regardless, the current R+D arc caveat is a very big one :) we're talking about multiple decades (or Roberts is - I'm > bullish) @smc90 supplementation, don't think anyone disagrees w/ that - I don't, at least :) esp. w/ policy and not just tech innovation... @smc90 well I wish I could see those cuz they sound interesting :) but assuming i can't, replacement is higher bar for innovation than... @smc90 ...but that's at current costs. W/ policies and storage improvements (+ in some places today w/ CSP), future replacement=plausible.. @smc90 that will take a while, for sure. I see it as primarily reducing the future need for construction of those vs replacement... @smc90 what do you mean by gains? new capacity additions? technological improvement? I'm familiar w/ some of Lewis's writings on solar... @smc90 might still be missing your point - I'm trying! :) @smc90 still not seeing your point - that nuclear/other sources produce more power today? of course... no one argues otherwise... @smc90 not sure what you mean by this. Today? Yes, of course... but resource base-wise, there is more than enough land to power the economy. RT @DrPhiltill: "I think we’ve got a decent shot of sending a person to Mars in about 11 or 12 years." - @elonmusk http://t.co/WT1yYBOGgR @AliMattu @zeustoves @knewscript @nerdsrocket started Utopia. Loving it so far. Last week of heavy readings on utopia for this class...learned a ton from it + very glad I took it, but turns out it's a huge literature. :) RT @rcalo: Got robot questions? https://t.co/U0s0eMDQpu RT @oxmartinschool: New report from @nesta_uk out this morning, 'Creativity vs. Robots', co-authored by Carl Frey & @maosbot http://t.co/HR… @knewscript some footage from before - https://t.co/Up8LZa4VmJ @knewscript ...round was stuff like opening and going through doors, attaching a hose, etc. Miscellaneous physical stuff. @knewscript several different tasks - not sure exactly what they are for the final round (might be partially a surprise, dunno) but last... The final round of the DARPA Robotics Challenge is in a little over a month... my bet is still on IHMC. "Deep Learning for Decision Making and Control,"great lecture by Sergey Levine https://t.co/sxfwbXK3BL @annegalloway update: may have found one <100 miles away :-) @annegalloway would love to do both if possible, though. looking into it/hope to be surprised by one w/in hundreds of miles... @annegalloway thanks! Looks very interesting. And a lot cheaper 4 me than going to a farm that allows visitors from what I can tell so far.. @annegalloway yeah, I have several related tabs open now :) no hits for anything v close, but willing to drive a while if I find a good optn @annegalloway (Googles abattoir) :) that'd be great. never been on a farm, let alone that. doubt any ethical ones are nearby but will look! @annegalloway maybe missing your point still, but I'd consider not feeling (as) bad about it if processes were good, regardless of scale.. @annegalloway having seen that video, though, will look into local sources... honestly hadn't really fathomed it being done much better... @annegalloway i.e. that I typically get meat from large companies whose standards I assume are inadequate b/c care more about cost v ethics @annegalloway maybe - aren't the processes generally v. different for large companies vs. small farms, though? that's my main issue re guilt "Smart policing to come Dubai with robo-cops" https://t.co/GkH0bjMjHn via @YahooNews @annegalloway btw - watched that video, very helpful/provocative - thanks! @annegalloway not sure I follow... sounds like an interesting/important point, though, would you mind elaborating? + indicate you are not concerned. I voted the latter, was very much in the minority. Thought the info they provided was v problematic. (2/2) On last RT: at Chipotle Cultivate festival in Phx, there was a booth on GMO. One could vote for a handful of anti-GMO messages or (1/2) RT @JSwiftTWS: Chipotle's Anti-GMO Stance Is Some Anti-Science Pandering Bullshit http://t.co/Z9sjfKUyl0 @annegalloway thanks! will check out later when at computer. your comments before were v provocative for me re: having generalized from CAFO @annegalloway and apologies for the naive Q - I did look into it but just found some purported exemplars, not much on what's done at scale.. @annegalloway my presumption being that the same methods could apply, but maybe that's false... @annegalloway just don't have a sense of what ethical killing of any sort looks like for livestock...read a bit on lab rat techniques... @annegalloway I just meant how the slaughter is done in general. Can imagine it being done better vs worse, but Googling wasn't v helpful.. @annegalloway curious how this is done in NZ/in the best case (if not the same) for meat production? Know it's often done horribly in US... RT @SFNick: Apple had $16.8 billion in sales from China alone. That's more than Google's total quarterly revenue. http://t.co/AzLOnSqKvX RT @2020science: New-look 2020 Science blog is shaping up: http://t.co/622EcpzN4E @hintikka was just talking to folks earlier about related issues (AI use by authoritarian gov'ts)... :( not a good path to say the least... RT @volkskrant: China is attributing citizens a score for his or her behavior - including online behaviour http://t.co/kGxJ5Lr0N3 http://t.… RT @ARPAE: It’s our sixth birthday! Learn more about @ARPAE here: http://t.co/9FIr4Geipf http://t.co/EXVi4aylcB Very excited about the FLI proposals being cooked up at ASU and elsewhere. I think a lot of important work will result from this RFP. :) RT @romanyam: Bostrom on AI at TED:... http://t.co/GEKd9NTynJ @ramez which is partly why EPA lowballs it so much :) explosive implications if it were taken seriously by gov'ts... @nerdsrocket @zeustoves @knewscript @AliMattu I am - though I was excited about the idea of the reality show actually being good! :-) @zeustoves @knewscript @nerdsrocket @AliMattu I also rescind my "On it!" because might be in the process of downloading the wrong one... @knewscript @AliMattu @zeustoves @nerdsrocket just catching up on this now - I liked the AI/robotics aspects of it- http://t.co/MUGQzEmjGR @knewscript @AliMattu @nerdsrocket @zeustoves I'm on it! Thanks for the tip! @knewscript @AliMattu @nerdsrocket @zeustoves nope...interested, though! I'm in a class on utopia :-) Is it any good? Nor is it hard to justify the general claim that there has been much recent AI progress. Will be fleshing that notion out in the future... ...none of which is to say that people in general are widely aware of progress in those areas, but they're not hard to explain upon request. Besides DeepMind/Atari, other areas of recent obviously impressive/significant AI progress include machine vision, NLP, + speech processing. ...in fact, I just explained DeepMind's Atari results to some lay people the other day and they were quite impressed. Not that hard to find. Garland clearly didn't do a very comprehensive search if he thinks there hasn't been recent AI progress clearly impressive to lay people... Also, the consciousness thing in Garland's piece...very sloppy thinking in various ways. Haven't seen the movie yet, but hope it's better :) + can't speak to Hawking bc hasn't said much, Woz has said silly things that may fit Garland's narrative, but FLI letter doesn't fit. (3/3) + expressed by e.g. Musk are traceable to specific considerations/arguments that have gained traction and richness in recent years. (2/3) ...but in the meantime, suffice it to say that there has in fact been significant AI progress in recent years, and recent concerns (1/2) Among Garland piece issues - 100% disagree that generalized tech anxiety explains recent AI concerns. Working on paper w/ better narrative.. @beaucronin you/thoughts if so? @beaucronin no, it *just* came out in Phoenix two days ago I've been slammed with work until right now, basically. Def. this week. So many issues with Alex Garland (Ex Machina)'s take on AI, it's hard to know where to begin... http://t.co/TAnmFMnMP2 Lots of interesting discussions and ideas generated at today's workshop...will take a while to digest. :) RT @Jackstilgoe: Research jobs in my department, including @EconPublic and @RRITools projects http://t.co/G3GLrernsI @Aelkus *"such things" being mostly shirking/non-work...tech can't do much w/ job tasks/roles being ambiguous in and of themselves... @Aelkus technologically, seems plausible much greater crackdowns on such things could occur/already do in many cases. @Aelkus also impt is increased surveillance pushing back on such things. Unclear where trends are heading... @Aelkus various forms of non-work should prob be better theorized/empirically explored, no doubt. Key to understanding work. @Aelkus yes, shirking is just one framing/term + only covers some things, not what she describes there. can't speak to the lit if any there @Aelkus much of the theory goes back to industrial work, where ppl have studied e.g. effort norms, pressure not to make others look bad etc @Aelkus sociology of work isn't my thing (yet) but related issues def aren't absent from the lit...ppl should update given work changes tho @Aelkus interesting stuff, not sure about the "most sociologists of work" ignoring it thing, though. Shirking is pretty well theorized... @hintikka putting it in the queue :-) I'm excited about the workshop, but it's also been a ton of work putting it together... I get now why it's considered "service." :) 24 people confirmed for the solar soft costs workshop. Very diverse group. Think we'll generate some cool/useful ideas. :) @Aelkus wanted: open source Baxterish simulator. Or cheap IRL Baxterish robot. @Aelkus simulations can be fun/cheap...e.g. Nao. Baxter proprietary tho. But yeah, I saw a Baxter in a lab the other day and was jealous :) @Aelkus Google is the obvious candidate, and probably is cooking up something related, but dunno the ambition level... @Aelkus really, though... household robot-relevant tech is blowing up these days. Will be interesting to see who makes the first big play.. @Aelkus grad students who can afford a PR2 ;) @Aelkus Go may have a centaur dominance phase someday, but I certainly wouldn't bank on it lasting long... @Aelkus can't say I'm surprised... Tentative agenda, logistical information, and a link to the aforementioned background paper can be found here: http://t.co/WRJR6E1YD4 Background paper by @clarkamiller and I on solar soft costs for the workshop this weekend: http://t.co/1mr5gzPEsR RT @JohnPaczkowski: Tesla IR on April 30 event: "We will introduce the Tesla home battery and a very large utility scale battery." RT @VincentCMueller: The official site project on digital DIY techniques that will change the world is now up http://t.co/UxIPvsw1Wz ICYMI - "Big Other: Surveillance Capitalism and the Prospects of an Information Civilization," Zuboff 2015 (PDF): http://t.co/xWFmA3hoNe RT @Jackstilgoe: New paper from me - Geoengineering as Collective Experimentation http://t.co/rFxFQUJJdo @SpringerEthics RT @mytwitchimp: Deep-Learning Company MetaMind Hires Twitter, Salesforce Veteran Ruslan ... - TechCrunch http://t.co/pux8JoWI0A RT @tnr: America's political obsession with the miiddle class" hurts workers, by @ebruenig. http://t.co/3lRuQJhjVr http://t.co/3oJR7hPTVh @Aelkus lots of folks would get this, some won't, but that's ok. Congress does all sorts of things they don't get. Needs to be pressure... @Aelkus I've seen good sausage get made on other issues :) optimistic re: policy changes in a few years, but yeah won't happen overnight. @Aelkus yup. @Aelkus yeah I am here advocating a Nader 70s-like pt re: need for options, in this case for researchers ;) @Aelkus yeah, the situation today is v problematic and not just in AI/robotics. I think it can be improved in many respects. @Aelkus if you mean non-AI acs, though, sure @Aelkus besides Yoshua Bengio, I do not run across many AI folks hostile to industry research... more seem opposed to mil/intel... @Aelkus NSF funding autism treatment bots is v different from DARPA funding "basic" research for mil purposes, but yeah boundaries are fuzzy @Aelkus the big shift in AI from academia to industry in last decade deserves more attention...but I meant the way govt does it is not ideal @Aelkus didn't say don't like gov't :) would like NSF, for example, and other civ agencies having much larger role. @Aelkus among other things, so that researchers have viable non-mil/intel options. @Aelkus don't get me started on that ;) speaking of policy proposals... the AI/robotics funding situation here needs to change in many ways. @Aelkus which is to say: yep. AI will be politicized but good research on it needn't be all left leaning or otherwise hegemonic @Aelkus and needn't necessarily influence/contaminate research. Policy analysis let alone advocacy has more values distributed throughout @Aelkus values nec arise in characterization of uncertainty and choice of topics etc (pace Heather Douglas) but political views shouldn't.. @Aelkus it can and should be different, just never 100% value free (nor should it be) @Aelkus a priori aside, do think it is the case that many ppl are indeed expressing political prefs when talking tech, if implicitly. @Aelkus I suppose. In my case I consider myself to be doing both. Will make that crystal clear when I have specific policy proposals... @Aelkus you lost me there.. @Aelkus solution is more ppl with more views to know more about AI/bots and form/articulate own views. Right now, small group engaged @Aelkus yeah I do think it's impt for nuanced critique to not be lumped in with all critique of "the system." Fortunately, don't expect that @Aelkus ah. Then yes, I agree, more moderate, in that sense, critiques of AI/bots more viable politically for at least near future. @Aelkus not to say desirable - I don't want hegemony either. But I guess my pt is, we or at least I don't yet know what the px of AI/bots. @Aelkus issues changes over time. Serious views on global warming once OK for Repubs, not anymore. At time in AI now where much is possible. @Aelkus perhaps/think I agree, though it would depend on the specific issues/stances you have in mind - would also note polarization of... @Aelkus that being said he has said nothing of import on AI/robotics yet, don't expect it to change anytime soon sadly @Aelkus Obama is president...hard to find a bigger lover of nuance. But yes, even he has to package things in simple terms a lot of the time @Aelkus not to mention the discourse is well beyond the confines of academia and that will get more pronounced soon. @Aelkus yeah, I don't think it will be. Maybe is, not for long, just bc not much policy analysis done yet... @Aelkus specifically, I was surprised at how controversial my timid, caveated defenses of some government functions being legitimate are :) @Aelkus as well you shouldn't... @Aelkus I thought I did, but justice studies grad students still blew me away in the nature and extensiveness of their presumptions @Aelkus you'd go nuts in my justice studies class, lol (I sure am). And yes, I agree. @Aelkus yes, I am all for explicitness. Zuboff is that, as well. And agree conflation of criticisms is harmful. @Aelkus Zuboff has written on this for decades, has nuanced views. Not endorsing 100% but she is not a generic technophobe for sure. @Aelkus yes, and that's why I make my non-generalized dislike explicit :) @Aelkus btw, on related issues, ICYMI see: http://t.co/xWFmA3hoNe @Aelkus doesn't come from nowhere - has to be demanded by ppl/institutional cultures - but once demanded, reinforces those dynamics. @Aelkus key area of intersection: AI-driven (or more conservatively, assisted) HR and management. @Aelkus my Q is where could we be tech wise when ppl educated today entering job market or lack thereof, what does that mean for ed., etc @Aelkus but overall, I think we are in agreement...will explore this more in my dissertation, along w/ AI progress scenarios stuff... @Aelkus recommend The Thought of Work if you're interested in such things... ppl have said such things for a while, many strands/framings.. @Aelkus not so much a matter of your choice being less rational IMO but just not infinitely scalable as the Brookses of the world miss @Aelkus yea, I might have to write something on that someday, bc very urgent issue viz basic income, AI/bots etc... @Aelkus op ed writers/academics/professional thinkers of all stripes on the need to work to survive, I can't even. @Aelkus what really bugs me there is academics extolling the virtues of work based on...nothing of relevance to ppl w shitty jobs @Aelkus yeah, to be clear, I wasn't saying they should, just that they do. In some cases they can do so helpfully. Re: fitness apps, not rly @annegalloway good question :) @Aelkus academics do tell people what they should do/think, though. Not trivializing that concern, just had diff take on this 1 article @Aelkus yes, I agree. Though I would note the main offender here (to me at least) was a journo, not academic :) @Aelkus and I think it is also not elites' place to "deny" ppl tech based on those sorts of concerns, either. Just saying, that's a thing @Aelkus to critically examine them, which I suspect is precisely what Dow Schull's book does but haven't read it. Article did not do that :) @Aelkus right. And we should ask if apps reinforce what ppl "really" want or what Google wants. Not a reason to reject such tech, just... @Aelkus neither do I. In violent agreement on that, if we differ it is just (or mainly) in extent of offendedness @Aelkus from an "infantilizing" POV. but that wasn't at all what the article was about, obv @Aelkus then again to some, being overweight=lazy=bad, which I also object to, just saying I'm more concerned abt e.g. ethics advisor apps @Aelkus ..issue with using assistive tech in "nurselike" way, it is more re: atrophy of things that are key to character, not exercise.. @Aelkus In general I think painting w/ broad brush abt assistive tech in pos or neg light = problematic...I think that if there is a moral.. @Aelkus "having imperfect willpower" prob more applicable term for what I meant than lazy, which has more (and more negative) connotations.. @Aelkus well I am lazy and don't consider it morally wrong/want tech to help/use it as such. But yes, in vernacular, lazy=bad :) @Aelkus and the infantilizing phrase in particular is problematic, agree 100% @Aelkus but obv the two are related - she seems to be saying ppl lazy --> want just the nudges. Which if true, I agree, isn't unique to tech @Aelkus the dumbing down in that quote seems to refer to the dumbing down of the apps (from data presented to just nudges), not ppl. @Aelkus ...which is a good reason to write about opposing POVs, and I liked your piece in that respect :) @Aelkus not to defend the article which I thought was meh but just wasn't enraged by, perhaps bc so common. @Aelkus Yes, she prob meant something along those lines with that, but that's also not a crazy concern or inconsistent w app benefits,=my pt @Aelkus ...issues of dependence, identity, role of profit motive here, etc. as am I. = consistent w/ thinking many will/should benefit... @Aelkus don't see that term as as problematic as you do, I guess - I'd love effective nurselike tech. She AFAIK is concerned about subtle... @Aelkus Highly doubt that's Dow Schull's point - I liked her talk on related issues a while back...perhaps true of article author tho, dunno RT @AcademicsSay: http://t.co/hygvPMLXSJ @Aelkus but yes, ppl and machines here can do similar things at least at high level. Diffs exist too tho - customization, scalability... @Aelkus sometimes. Other times they lack a human alternative (e.g. friends who would pressure them, ability to afford a trainer, etc.)... @Aelkus I didn't notice much lividness in that article in that article, just the 1 free will line...think I agree with ur general pt though. RT @JigarShahDC: If #solar power shaded the over 300,000 football clubs around the world, we would produce more than 150GW of power http://… RT @zeynep: 1967 ad I mention my oped on using machines becasue they “can’t quit, forget or get pregnant.” http://t.co/HyxD96z4zu http://t.… RT @karpathy: New pet project: REINFORCEjs for Reinforcement Learning http://t.co/X8phS2VOwv I am now starting to exhaust ML algs to implem… RT @AstroKatie: I think it's super important for researchers to talk to reporters. Sometimes scary but everyone wins when science reporting… @PennyRed @CitizenRalph just making sure providing that info wasn't taken to imply I'm ok w the name being used... @PennyRed @CitizenRalph I assume you'll use a pseudonym even if contact info was provided? I assumed it'd be anonymized/answered accordingly OTOH, fragmentation of the solar market, esp within the US, may enable some less innovative companies to thrive. But - ITC expiration --> ?? In general, future solar jobs will be less repetitive/manual as a result of automation across the value chain. Has various implications... Thinking a lot lately about the future of jobs in the solar sector. It's... complicated :) Will be under discussion at the workshop soon. RT @BanKillerRobots: Desire for human control of autonomous weapons--be it meaningful, appropriate or another term--is the common theme of … Fraunhofer CSE, funded by SunShot grant, demonstrates plug and play PV: http://t.co/pcgJiZVD3p Slides from presentation earlier to World Future Society - AZ Chapter on "Science Fiction and the Future of AI": http://t.co/HcittfEse3 RT @SolarFred: #gtmss15 Solar under attack: 21 states trying to lower compensation for residential solar. Policies and politicians matter, … @rcalo @mpshanahan same here! :) Great chats with speakers for the soft costs workshop last night and today... very excited about it! We will cover a lot of ground... @SimonWierny @theneweconomist silicon PV cost trends are pretty well modeled/tracked, other stuff/potential game changers aren't...hmm :) @SimonWierny @theneweconomist thanks so much for elaborating - very helpful :) innovation on hardware should def be part of the discussion.. @SimonWierny @theneweconomist could you elaborate? RT @atrembath: Fossil fuels haven't lost the race against renewable energy—yet http://t.co/iqSRA220BK Great @bradplumer reality check cites… @jon_jeckell hmmm interesting!! :) RT @OpenRoboethics: @jasonmillar Rather than trying to define "meaningful human control" frame it based on existing sys. #killerrobots dis… @ansgarjohn if I recall correctly, there are varying degrees of smart machines in The Jetsons, dunno bout v smart- if so, well controlled :) @ansgarjohn yeah, pretty static, though lots of relevant issues explored (e.g. future of work, service robotics, smart homes, etc.). ...where US Robotics seems more dominant, less morphological/cognitive diversity seems available to consumers. The Jetsons in general is interesting from a future of AI/robotics POV... robots as a service, different qualities available. Vs. Asimov... Oh, Rosie from the Jetsons! Definitely have to talk about her. Plus HAL is sort of cliche/done to death as an AI example... Skynet is, too, but I have specific things to say there, not so much 2001... I kinda want to avoid talking about HAL cuz that would require me to rewatch 2001, and I'd rather rewatch Interstellar/talk about that. :-) @SpencerGreen111 ..so have thoughts I could recapitulate, but dunno bout the old ones that much - only seen the first. others worth seeing? @SpencerGreen111 yeah, good point - def. should say something on Data/Lore and the emotion chip. RoboCop, have written b4 on new one.. Barclay's intelligence explosion on The Nth Degree (TNG) could be an interesting thing to bring into the mix... Not sure how I can fit Robopocalypse, one of my favorite AI uprisings, into the narrative... takes a while to explain, no good images... Caprica also complexifies the Cylon heritage to an extent that isn't often appreciated when people talk about BSG/Cylons... much to say :) Will obviously have to cover Skynet, as well... have many things to say on that, e.g. T3 belies the notion of its inevitable takeover... Any sci-fi AIs/robots that I should definitely cover in my talk? Besides the ones I have discussed already at length on here :) e.g. Cylons. Also looking forward to @mburnamfink's narrative foresight exercise on Phoenix climate futures after that... Should be a fun night :) Giving a talk on sci-fi and the future of AI to the World Future Society, AZ Chapter Thursday.... Should be fun :) Will tweet slides after. Second application of deep RL I've seen to a real problem - customer relationship management: http://t.co/VF1p3EiUNG Interesting! RT @ylecun: A better Memory Network that doesn't need to be told which memory to use. Brought to you by FAIR. http://t.co/KAyug2IClg RT @BanKillerRobots: Long-term strategic considerations include likely arms races & proliferation of small autonomous weapons systems - @HM… Draft framing paper for solar soft costs workshop: http://t.co/GcAFTxKzhr Comments/questions/critiques very welcome! Polished version soon. This Watson stuff is huge.... will have to ponder. Answers my Q about what their commercialization gameplan is, on the health side at least. RT @AndrewYNg: A VC friend thought deep learning's CNNs stands for "Convoluted Neural Networks." He might be right! @hannahgais @Aelkus haha nice :) @hannahgais I look forward to that rite of passage someday, haha. Maybe if I wrote more it'd happen sooner... @hannahgais been accused of being pro-slavery (of robots), that's the worst I think. I try to be provocative but white male=less backlash :/ RT @katecrawford: New conglomerate to analyse health data: IBM Watson + Apple + J&J. “Forces in health care aligning as never before." http… RT @PeterAsaro: Stuart Russell says the best thing AI community could do to improve its public reputation is to support @BanKillerRobots #C… ..community to rigorously model itself, think ahead/act strategically, extract insights from its own literature, etc. Raises interesting Qs. On the optimistic side of things (viz ability to steer the future positively), the AI community is better equipped than any other sci/tech.. NREL's solar work, in turn, is less ambitious than ITRS for semiconductor roadmapping. Wide variation across techs re: tracked/modeledness. RT @karpathy: "But the most important thing to do it is to sell." - A sample from a 1000-hidden-unit character LSTM trained on Paul Graham'… There is nothing remotely comparable to NREL (in terms of continuously tracking solar tech, costs, markets, etc.) for AI and robotics. Struck by how much further along modeling of scenarios for the future of solar energy is vs. AI... yet solar projections regularly v. wrong. @Aelkus I'm not a close China watcher though so maybe missing your point (I dropped out of Shambaugh's class long ago, not my thing :) ) @Aelkus he did say they won't go down without a fight... @Aelkus as do most of the businesses in Silicon Valley, non-tech sector stuff :) @Aelkus skimmed a draft a long time ago, seemed interesting...should revisit prob RT @zephoria: It's painful to realize how often journal paywalls keep me from reading scholars' articles. Access too difficult to scan to s… @hannahgais I guess that isn't as useful when reading an article, though... in interviews, I just can't. He's so ridiculous. @hannahgais the mustache isn't enough? :) Workshop is less than two weeks away now...excited and trying not to freak out too much. :) Almost done with background paper... RT @texasinafrica: Is there an "Ambivalent for Hillary" option somewhere? Asking for a friend. @jon_jeckell Library of Congress is pretty cool and close if you haven't been yet :) RT @helengreiner: Amazon Can (Finally) Test Its Delivery Drones In the United States http://t.co/uuzv9HplB3 RT @JenSeniorNY: Hillary expected to spend $2.5B on her campaign. This is roughly the same amount we spent on humanitarian assistance when … @Aelkus "reason for this" = reason that wouldn't happen (e.g. Gotham too big to fail) @Aelkus yeah, I think the only plausible reason for this is near-total econ predominance of capital city...often true in fictional worlds. @Aelkus I liked The Incredibles's take on such things. @Aelkus yup. not widely appreciated, nor is there a clear vision yet of how to grapple with it(ppl should learn to learn, but how and what?) RT @j2bryson: @meharris @grok_ @EvanSelinger That robots aren’t human will eventually be well-known. Fighting anthropomorph now reduces int… RT @mark_riedl: See what papers will be presented at the 3rd Conference on Advances in Cognitive Systems: http://t.co/D6RxlGZnvq May 28-31,… @Aelkus IMO we all should be happy Gates can reference that now instead of pop sci stuff or Yudkowsky blog posts for more on the topic :) @Aelkus to be clear, I have issues with the book, but overall consider it highly valuable... @Aelkus I think he is very very clear on what he is and isn't talking about in the book viz current vs future systems..if that's what u mean @Aelkus have met many for whom it was very helpful and revelatory... @Aelkus really? I think it is a big contribution to the literature. People who haven't read it misconstrue but that's not Bostrom's fault. Cool job opening on long term AI safety at @FHIOxford: https://t.co/Sw8kHOAUz7 via @VincentCMueller @VincentCMueller sounds interesting - link isn't working for me, though... RT @VincentCMueller: New job at FHI "Research Fellow in Artificial Intelligence Safety" https://t.co/8K5vLiVB2z. Deadline 27.4.15 RT @Alan_Au: Right now, telepresence is mostly video on wheels, but telemanipulation getting cheaper; the future is coming. #werobot RT @danielas_bot: I might get trolled, but Ex Machina is my favorite film about #AI in a really long time: http://t.co/QVr2ij2CZA RT @j2bryson: Due 12 April mT @amyjccuddy Amazing important opp! White House Social &Behavioral Sciences Team seeks Fellows &Assocs http://… @Aelkus lots of people/research are inspired at various levels...inspiration, choice of research prob, algo, etc. I meant algos for NNs. @Aelkus my bigger issues with NNs are transparency, predictability, guarantees, etc. than if it's brain-like... @Aelkus to recent progress, can't speak to the details of the history... @Aelkus I think biology is probably, in general, being under-utilized for inspiration (though many are using it). in NN case, not v central @Aelkus well, I think that's more of an issue re: cognitive architectures, emotions, goals, etc. than with NNs. NNs advancing for other rsns @Aelkus works well on computers and (for reasons I don't think he fully explained) might be going on in brains @Aelkus well, he doesn't care at all about that :) he just thinks it's interesting that it (purportedly), specifically stochastic GD.. @Aelkus not sure what you mean by "this line of research has been fairly consistent"..? @Aelkus poorly worded tweet but hopefully the meaning came through :) specifically his keynote at AAAI was very, very much pushing that. @Aelkus interesting on the "mimics" thing that of all people, Hinton has made the most forceful case I have heard that that's the case. @Aelkus reading De Landa's Philosophy of Simulation...interesting stuff RT @tegmark: I'll be on Science Friday tomorrow discussing AI with Stuart Russell, Eric Horvitz and, of course, Ira Flatow: http://t.co/Gk… @Brett_Fujioka ah :) @Brett_Fujioka Dir.? @JesseJenkins @arthurhcyip @CountCarbon yep...somewhat useful metric among many :) @arthurhcyip @JesseJenkins @CountCarbon interesting case for its importance here: http://t.co/0LqJ6mpSo9 @Aelkus and yeah it wasn't new. just saying, new to many, for whom it is now less surprising @Aelkus there is def such an effect, just unsure how pervasive, role of diff causes, longevity etc. flipping out over "new" things common. @Aelkus yeah, that's true, just don't see that as what's going on. some ppl maybe, others "got" it, more will ask nuanced Qs going forward.. @Aelkus like OkCupid - the complete and utter lack of concern/reflection there justified ppl being concerned.... @Aelkus I don't think the hounding (if that's what it amounted to) will last forever as ppl learn more... and in some other cases, justified @Aelkus are those mutually exclusive? RT @rasbt: Was just a matter of time ... now, here it is: "Amazon Machine Learning – Make Data-Driven Decisions at Scale" http://t.co/xAFG… Enjoying watching Born in Flames, a cool feminist sci-fi movie: https://t.co/hYg3NyICwc More info: http://t.co/RuMojqeY5o @hintikka they'd be stupid to not be serious about it :) @hintikka good point :-) @rcalo great article btw! that was the only point I was perhaps not very strongly in agreement about :-) @rcalo do you take strong AI (in the context of saying it may never happen) to mean consciousness, high level intelligence, something else? RT @rcalo: New post for @Forbes / @ForbesTech discusses why artificial intelligence can't have all the rights we do. http://t.co/XcqyeLTpqG… RT @JigarShahDC: #Solar cheaper than #Coal in Utah: @sunedison sells power at the utility's avoided cost of electricity http://t.co/PMfUFE8… RT @BanKillerRobots: The speaker line-up for next week's #CCWUN meeting on 'lethal autonomous weapons systems' is now online: http://t.co/h… @cthorm @Aelkus might have thoughts :) @Aelkus haha ah @Aelkus sorry, what's "this"? "Family" could be a team of humans and AIs/robots, and they can work together in various ways. Now that could be fun. Or boring. Dunno. We already have RoboCup though. What else would make for a good TV show, if not that? Family Double Dare for bots? Trivia+obstacle course :) If they were gonna go that route at all, w/ serious R+D, though, it'd be cooler/more socially beneficial to do something besides combat... ...the hardware was super widely varied before. What about robots that are identical and have to compete on software/UI/human pilot skills? Besides the obvious lethal autonomous robots connection, another issue with Battlebots as a robotics competition is different morphologies.. @cthorm have you seen True Steel? I forget if they had brain-reading helmets in it or if it just tracked body movements... How about freestyle Battlebots - you can either control it yourself, have it be autonomous, or some combination. That'd be very interesting. @Aelkus I think if AI/robotics people involved, they could come up with something really cool. But AFAIK it's hobbyist type stuff w/ no AI. @Aelkus well, the environment of the old Battlebots was...but they could make more complex environments. Battlebots could be an interesting/challenging proving ground for robotics safety/human-robot interaction...Doesn't sound like it will, tho. On last RT (Battlebots stuff): doesn't sound like the robots are going to be autonomous now... Or at least True Steel-like UIs. Why not? :-/ RT @RobotNext: 'Battlebots' reboot will air on ABC June 21st - Engadget - #robot #robots #robotics - http://t.co/ECDxr7szlj RT @erichorvitz: Op-Ed piece from Sept 2001 on endowing airplanes with situational awareness—and safe modes. http://t.co/jM4ySwz55P #Germa… RT @emilycrockett: *sob* http://t.co/KKHmCoXqBy RT @AmyAHarder: .@MikeBloomberg & @sierraclub have new goal to shut down half of U.S. coal plants by 2017. Earlier goal: 1/3 by 2020. http:… RT @IEEESpectrum: Why Google's Robot Personality Patent Is Not Good for Robotics: Google’s patent for generating robot personali... http://… RT @karpathy: "An Empirical Evaluation of Deep Learning on Highway Driving" http://t.co/MKYPELu4gr from Brody et al. in Andrew's lab @hintikka yup. @hintikka indeed... an ill-conceived (though unsurprising) listicle :) There are indeed disagreements among actual AI experts about this, but stuff like that article = not helpful for exploring them. Way to go HuffPo (sarcastic)- "Should we fear AI? The experts don't seem to agree" where expert means nothing: http://t.co/ip23DJGgsS @ramez @ericlaw TL;DR we need to get silver out soon, over long term materials issues depend on chemistries, + will take a bunch of glass :) @ramez @ericlaw see "Pathways to solar photovoltaics" by Jean et al. for good analysis of this, in relation to scaling, pv chemistries, etc. @SuzanneWaldman but again, not the only thing possible. many other options being explored, so I hesitate to write off "biofuels" writ large @SuzanneWaldman well we aren't gonna get to sustainable biofuels through iteration...ethanol is crap... @ramez think it's important to think ahead about enviro impacts and policy issues etc. but agree 100% it shouldn't be considered dealbreaker @ramez ..energy demand/high solar using more like 2-3%, which can be a v big fraction if mostly in e.g. deserts. so, non-trivial but doable. @ramez to the extent it's a prob, though, would note it has more to do with the distribution of that area - e.g. done some calcs on high... @ramez nice, thanks for sharing! I think the ag comparison is key esp. when we should be reducing that anyway- panelize old grazing lands :) "RT @ramez: How much land would it take to power US electricity entirely via solar? 0.6%. http://t.co/u456bQ1JIm @atrembath @arthurhcyip @…" @SuzanneWaldman agree/am not a fan of the options today, just emphasizing "today" bc many early stage techs being explored @SuzanneWaldman biofuels can mean many things. Much more efficient uses of land are possible vs existing tech so it depends.. RT @elonmusk: Battery "breakthroughs" need to state power *and* energy density (not the same thing), plus how long they last. They usually … @ansgarjohn will check out, thanks! :) @ansgarjohn ...otherwise why take the financial risk, must be some benefit...but, not much data on this, very case by case issues arisen... @ansgarjohn the case for them in my mind would have to be based on econs of scale both at engineering level + permitting/enviro analysis... @ansgarjohn my dream paper in this space would analyze those factors, engineering/management challenges, continguous vs. non-contiguous etc. @ansgarjohn interested both PV and CSP, and general question is: to what extent to bigger plants make sense, given econs of scale + hurdles. @ansgarjohn do think some of those will actually be built, and would be interested in pubs on em, but also on the more general issue.. @ansgarjohn yeah, seen that list, but much of it's vaporware :-) looking for more rigorous publications... "open question whether the world knowledge required for open QA could be encoded and retained as weights in a (larger) dynamic network" Ibid Among other findings in paper in my last tweet: RNN-based reverse dictionary trained on a few dictionaries competitive with commercial ones. "Learning to Understand Phrases by Embedding the Dictionary," Hill et al. 2015: http://t.co/FkLDK6VIGY @ansgarjohn yeah, pretty familiar w/ Solar City/very interesting stuff - I meant multi-GW in one place, though. ..reason I ask re: multi-GW solar is that I'm considering that as scenario to explore at workshop soon in general/in relation to automation. Anyone know any good publications on (future/hypothetical) multi-gigawatt scale solar installations? Whats being considered/why/benefits etc @arthurhcyip @ramez @atrembath gonna redo those calcs at some point, prob, will share if so :) v. high demand growth, high solar scenario. @arthurhcyip @ramez @atrembath esp. for high RE/high global demand growth, but again, countervailing factors at work so "doability"=tricky. @arthurhcyip @ramez @atrembath can't speak for/to pop opinions but my own rough calcs suggest it is big issue, needs to be taken seriously.. @arthurhcyip @ramez @atrembath @davidjcmackay would be curious to read any stuff you have written on that btw! @arthurhcyip @ramez @atrembath @davidjcmackay depends a lot on geog., obvi. I'm in SW US and see it being addressed regularly, can be done. @arthurhcyip @ramez @atrembath @davidjcmackay on high solar growth scenarios/land use, agree it's a big issue, just think can be addressed.. @arthurhcyip @ramez @atrembath @davidjcmackay I don't know who you mean is overlooking it - seems like most ppl know? I've done some calcs.. @arthurhcyip @ramez @atrembath @davidjcmackay not a very good proxy IMO...NIMBYism exists, so do motivated local govts who want renewables. @beaucronin having short terms for program managers, PMs with academic backgrounds, etc. can help, but no silver bullet I'm aware of. @beaucronin ...science policy in general is..as my advisor explains in a book of his I'm reading right now, actually :-) @beaucronin yeah... I worked at ARPA-E and suffice it to say they try very hard on that, but it's non-trivial. Principal-agent problem... @beaucronin alas, true of most agencies, no? :-/ thinking a lot about that issue/ways to address it lately... """End-to-End Training of Deep Visuomotor Policies"" Levine/Finn et al: http://t.co/QyT5F6vypa + Video: https://t.co/2S2Mua5hlD h/t @beaucronin" @beaucronin indeed it is!! :) thanks! RT @MatthewGombolay: Pepper-spray drones being tested by police in India for crowd control. @RoboEthics http://t.co/NkM2hDzTX5 @annegalloway I'll have to check those out!! Based on what I've read so far I've seen no reason not to read everything from her :-) @annegalloway haven't read Left Hand of Darkness yet but planning to. So far, just Dispossessed and Lathe of Heaven (interesting contrast!). @annegalloway great read, thanks for sharing! I actually wrote some stuff on The Dispossessed the other day for a class on utopianism :) @annegalloway nice!!! :) will read in a moment... fyi, the URL and your @ got smooshed together so the @ didn't work.. figured out URL tho @annegalloway @BronwynLabrum such an amazing writer! Got obsessed with her recently, still much more of hers to read! :) Context for last tweet: cleaning panels is important, doing it w/o water is even better, esp. w/ deserts being great for solar. Looks cool.. Found out about this company earlier - NOMADD (stands for NO-water Mechanical Automated Dusting Device) Desert Solar: http://t.co/W9T4p3DQfo @annegalloway hmm well I agree that is a problem, but climate change is sufficiently important that bad args should still be called out... @annegalloway generosity for me re: critique means assuming good faith, not competence :) @annegalloway so I guess I don't think he did his best in the sense of researching the topic...could have found plenty of ppl to critique it @annegalloway oh and he also didn't read the stuff he cited sooo yeah... @annegalloway given his info, that is - I wouldn't ask to write such an article for the New Yorker after reading one book, dunno why he did. @annegalloway I try to be generous, but here I am most disappointed with the New Yorker, not him, really. He presumably did his best. @annegalloway I really don't see that as very harsh/surprising tho- from a fiction writer who has read one book on a complex topic lately... RT @berkeleymalagon: That time I gave Geoff Hinton my business card and he signed it and gave it back :D #classic @annegalloway ...so, overall, I don't see what value it had - amateur version of well-trod points plus demonstrably flawed novel points. @annegalloway ..but that's not a novel point. @annegalloway IMO some of his points are accurate, e.g. on the abstractness/scale of the problem viz-a-viz ppl's interest in it... @hintikka people are gonna flip out about things regardless, so might as well be open/truthful. @hintikka ..from those companies' POV, secrecy on this stuff seems counterproductive to me. Address this stuff head on = my preference.. @hintikka one thought I do have on it: he's prob. saying all he can re: companies (even though it's mainly Google/DeepMind..), but overall.. @hintikka and as to why he's featured, mainly bc his book has been widely read/cited (if more the latter than the former) :) @hintikka and nah I haven't written anything on him (though am working on a review of said book which is tricky *bc* it's so caveated :) ) @hintikka his vagueness/caveats aren't surprising to me cuz he's a philosopher :) consistent with his book... RT @antonioregalado: AI Doomsayer Says His Ideas Are Catching On http://t.co/RG2JhpqaQF @hintikka I have many thoughts on it :) what struck you as particularly noteworthy about it? seemed like mostly stuff he's said before.. Budd's main point is that work is important, complex, and diverse - e.g. variously conceived as curse, freedom, commodity, identity, etc. Highly recommend Budd's book The Thought of Work for anyone interested in work. Explores many lenses on the natures and (dis)value of work. Writing background paper for the soft costs workshop... ~"Solar Soft Cost Trends, Efforts, and Opportunities." Will tweet it in a few days. See Section 3.1 of this paper from Miller et al. on other ethically relevant differences between solar types/scales: https://t.co/6YNZlgbW6V Rooftop solar creates way more jobs per unit of energy than utility scale, and also costs more (and for basically the same reason)... If solar is to be touted as a job creator, it should be on the basis of them being *good* jobs but that is tricky bc many are project-based. @gsvoss @annegalloway same here... reading Asimov on trains between Japanese robotics labs was quite nice :-) Last few tweets = among the reasons why I don't think solar should be touted as a major future job creator, at least at utility scale. I'd also emphasize that most of those jobs are temporary, bounded by the length of the project, which itself may shorten. If construction productivity increased 10-fold in the next 10 years, that means ~100,000 jobs would be created per terawatt. Not very much. At current efficiencies, a megascale solar plant creates in the neighborhood of 1 construction job per megawatt, and way less for operation. @Aelkus I played UT at a demo at AAAI, and couldn't tell who/what I was playing against...UT Turing Test passed :) ...e.g. low/high automation scenarios + their associated social/economic implications and R+D need implications, multi-gigawatt plants, etc. Thinking that it'd be fun and useful to develop scenarios at the soft cost workshop, but not sure what dimensions of variation to explore... Anyone read The Future of Violence? Thoughts? Will be interesting to see if/when Obama says something serious about AI and robotics...so far, just joke or two and ~robotics is important. Cont'd: Hawking's remarks evinced no familiarity with relevant args/literature, just said ~"they'll be smarter", Woz said very silly things. Re: last tweet - Musk has said more about AI than Gates, but mixed bag in terms of nuance, mostly just cuz he is less filtered in general... Famous ppl who've commented on AI lately, ranked by degree of nuance: Bill Gates>Elon Musk>>>Stephen Hawking>>>>>>>>>>>>Woz. RT @thekibosch: Vin Diesel is so much more than a macho lunkhead http://t.co/ZgVnIrKt0v by @JoeyEsch RT @LeapingRobot: Moore's Law at 50 is more (Moore?) about collective behavior than any laws of nature... http://t.co/nTZxizkOze RT @rcalo: Journo friends, please let me know if you want to talk to any of our fabulous robotics law speakers. Here's the list: http://t.c… @j2bryson @rcalo and specifically changes to how AI/robotics is funded by gov'ts to better reflect those principles? @j2bryson @rcalo curious what if any policy changes are called for now? @soundbitelife never seen this list - very cool! :) @Aelkus so would be very keen to read your thoughts on what to do/big picture @Aelkus and to be clear, if i looked im sure id find a ton on this, just saying this is the first to cross my eyes...again, no surprise tho. RT @vkhosla: Human error rate in medicine is ~ as if Google' driverless car was allowed to drive if it had <1 accident a week; ICU errors k… @Aelkus this is the first big confirmed such story i've heard on specific govt...have long assumed many do this tho @Aelkus well again, I am not looking much these days :) but yeah bots in general, just hadn't heard about putin bots @Aelkus but yes, I think there is value regardless of the me situation :) @Aelkus well I am pretty focused in my info consumption these days, not following news closely, so can't speak to how big a story this is @Aelkus happy to help in some way. @Aelkus I suppose I or others could write about it, but not sure what to say. again, thoughts? :) @Aelkus you'd have to be more specific about who you're calling out for me to comment. I consider myself such a person,just found out from u @Aelkus needn't be sophisticated to have an impact, though, so important already. But again, dunno what can be done. Thoughts? @Aelkus don't know what to do about it, but will say it's important to get ahead of such stuff now bc will get more sophisticated over time. @HankGreelyLSJU @rcalo +@j2bryson who wrote that, I wonder what the extent of follow up was in UK after those principles were developed? @HankGreelyLSJU @rcalo curious what you think of the ESRC Principles of Robotics/process for that? http://t.co/AmdXrzllpc @HankGreelyLSJU @rcalo was some discussion of such things at AAAI this year re: auton. weapons, though moratorium on what = unclear... @rcalo @HankGreelyLSJU unless by an Asilomar you mean such an event with specific proposals resulting from it- which also would be good :) @rcalo @HankGreelyLSJU that happened already, in Asilomar :) all for more/richer/more up to date discussion, though - http://t.co/hioiYsbj13 @JigarShahDC @GlobalSherpa I'm much more confident re: rooftop installers than utility scale construction jobs long term... @JigarShahDC @GlobalSherpa FYI, I'm running a workshop on soft costs/automation this month: http://t.co/2Y8FeK1Jnl More to say after that :) @GlobalSherpa @JigarShahDC depends also on market dynamics, policy, etc. but thinking a few years ahead techwise seems to be important.. @GlobalSherpa @JigarShahDC to me the one key Q is which types of jobs, given e.g. efforts at construction automation. @JigarShahDC @GlobalSherpa @eilperin @TSRJournal exactly, esp. with so many people focused on reducing soft costs these days. RT @Rochelle: Yay! Another MTurk study with fair pay! "...an effective hourly rate for workers of $16." https://t.co/jqVy9dRn4v @jon_jeckell yeah, it currently doesn't. The whole solar jobs narrative ignores the project-dependent/temporary nature of many of the jobs. @annegalloway wish that petting zoos weren't sketchy, or there were some other way to see em without living on/knowing someone on a farm. :) @annegalloway hopefully someday I'll see that for myself :) they're very abstract to me... my views on em are informed by reading, mostly.. @annegalloway *growing up in urban US...maybe would have diff POV if had spent any time with farm animals. have always wanted to! @annegalloway still would have to know more about other ways to say if I approve of it, but surely I would disapprove of NZ practices less.. @annegalloway thinking now that it's unfortunate I equate(d) meat production and CAFO subconsciously. = what happens growing up in US maybe. @annegalloway thanks for all the thoughts btw! :) @annegalloway will have to read up on NZ laws on this! @annegalloway "given up" in the sense of not expecting it to solve the problem (except insofar as public support --> policy change). @annegalloway /are you hopeful for broad based cultural change anytime soon? on climate, I've ~given up on it, focused on policy/tech levers @annegalloway oh for sure! but do you think we are moving in the right direction on animal welfare? presumably too slowly if so... @annegalloway based on ethical args, externalities unpriced, need good policy, etc.... is that fair? or are you more hopeful? :) @annegalloway animal stuff isn't my thing, but climate is so I look at it through that lens a bit, maybe...failure to persuade ppl to change @annegalloway yep. should be reflected in the price! and people's hearts... @annegalloway interesting! did not know that. @annegalloway oh absolutely - hence my guilt (that plus willpower issues plus no ready access to verifiably better options)... @annegalloway ...reason I ask is my only strong opinion on the matter is that most meat is produced unethically, unfamiliar w best practices @annegalloway ah! ok. so do the environmental aspects not bother you? or do you mean just eating qua eating not bad in and of itself... @annegalloway esp. with the statement right before and the wanting ppl to eat less thing. @annegalloway i'm just wondering why you disagree with ethical arguments against eating meat (or if you have v specific standards for it). @annegalloway sorry 4 all the Qs - if this is all explained in a paper I'd be happy to read it instead! :) but curious why re last part... @annegalloway I guess I really meant under good commercial conditions, for ppl who have other options. @annegalloway agree on all counts - my only uncertainty is if any consumption is ethical even under good conditions. thoughts? @annegalloway reduce consumption I get :) did you mean increase share of more v less ethically raised meat consumed? @annegalloway do you have a preferred social change/policy scenario? didn't follow the "reduce well-made meat" part. @annegalloway what is the latter privileged minority group? affluent? @annegalloway "others" could be niche..but if it existed at scale, perhaps norms against normal meat consumption would strengthen? @annegalloway pending various assumptions about how it's done, alternatives etc. suspect other guilty carnivores would too. @annegalloway well I only have access to an n of 1 at the moment re: consumer prefs :) I would pay more for test tube meat if it existed.. @annegalloway and that too is problematic, I know - not proud of it. @annegalloway I dunno, but I'd be all for taxing the hell out of meat. Would make my decisions easier! @annegalloway in my case bc picky eater + wannabe vegetarian... @annegalloway hmm...agree it's quite troubling/telling re: social priorities, though suspect many ppl (inc me) would consider it if cheap... @annegalloway hmm why? you mean forever or for the near future? RT @annegalloway: "I do think that in 20, 30 years from now, we will have a viable industry producing alternative beef." http://t.co/qtWyIO… @annegalloway curious what you think of that! RT @HeerJeet: If I were the New York Times, I'd give David Brooks a sabbatical till he's over this mid-life crisis of his. His column is ge… @justinpickard speaking of that: it generally favors disciplinary work over interdisciplinary work. @justinpickard so I think one's take on such things would vary depending in part on one's aspirations (e.g. wanting to be an academic or no) @justinpickard yeah, I never really had much of an interest in learning all of it, just enough to get some stuff done... @justinpickard feel ya there too :) it helps and hurts ppl in various ways. learning the rules help advance in domain X, to exclusion of Y. @justinpickard by "it" I meant the tacit nature of norms and the pay your dues mentality, not learning qua learning or culture qua culture. @justinpickard yeah I feel ya there. @justinpickard I don't like it personally. Bunch of rules I can't look up, used in part to perpetuate systems of power, often uncritical. @justinpickard it rewards things we don't nec. want to reward and often supports privileges we shouldn't support... @justinpickard that's easier for me to respond to :) I think it is to some extent necessary but the implicit nature is often harmful to some @justinpickard as opposed to magically knowing a culture without learning? still puzzled. @justinpickard Hmm still don't know how to respond to that. "advantage" connotes comparison to me...like, vs ppl born into their jobs?... @justinpickard ah sorry I missed the "advantages of" part...that was just general commentary. advantages vs what? @justinpickard it happens...mostly implicit, peers play a big role...can be infantilizing...reproduces culture...reinforces good/bad stuff.. I'm loving Trouble on Triton by Samuel Delany (critical utopian sci-fi novel). Written in reaction to The Dispossessed. Highly recommended. RT @etzioni: Semiautonomous Driving Arrives, Feature by Feature http://t.co/r4w7V3JUyd RT @bengoertzel: So filing bogus, non-defensible software patents in hot areas has now become a form of marketing for big companies ... fun… @JesseJenkins remember him saying that vividly :) RT @JesseJenkins: "Success may prove a long time coming but if it comes it will come as a clean energy future @ARPAE helped invent" http://… @chris23 @Aelkus anytime! I'm always game to talk AI market stuff... @Aelkus /in web demos...basically anything but the code and long instructions @Aelkus yeah I wish ppl would just give binaries too @chris23 @Aelkus how are they doing profitwise on those verticals? seems like a few years ago they had cool pilots,and that's still true (?) @Aelkus that annoys me a lot - open source stuff/CS ppl's demos usually assume command line competence, which I don't have, to try things @Aelkus they underestimate/forget that* @Aelkus and how wrong they have been in the past about the things they expect people to magically plan their lives around (future tech). @chris23 @Aelkus general purpose QA? how will that compete with what Google, MSFT et al are cooking up? etc @chris23 @Aelkus yeah I've fiddled with it and it's cool, but still don't know the endgame... e.g. are they thinking of personal assistants? @Aelkus generally don't know the state of the art in AI/robotics, let alone the future, so how are they supposed to magically do that? @Aelkus and why I disliked that FT piece on how ppl should prepare for future AI/bot/work stuff - a few ppl said ~think ahead. but ppl... @chris23 @Aelkus haven't looked super carefully, just saying it seems like there is a ton of potential...and has been for years... @chris23 @Aelkus they can, but not everyone uses IBM stuff now, whereas everyone could use Watson - unclear to me how that's going. @Aelkus @chris23 nice wiki...there was talk at AAAI of the need for adopting AI-related pages, maybe this benefitted from that... @chris23 @Aelkus yeah, IBM has much interesting work on AI, etc. The issues there (viz IBMs prospects) seem more market/managerial than tech @Aelkus @chris23 rare to see all those simultaneously... @Aelkus @chris23 not familiar w/ that term, recommend any pubs? @Aelkus @chris23 read Marcus's The Algebraic Mind? makes that point too. @chris23 @Aelkus speaking of red flags - Ashton Kutcher. I don't even know how to process that but it def doesn't impress me. @Aelkus @chris23 interestingly though, GOFAI/KR+R might be just what's needed to complement deep learning nowadays :) @Aelkus @chris23 yeah I think Hart's insight was that they should put money aside from that heyday for leaner times ahead, and he was right. @Aelkus @chris23 and they still are benefiting from that pot of money. dunno the details. @Aelkus @chris23 so interesting thing on that - learned at AAAI that Peter Hart of Shakey fame got AAAI invested in some of those companies @chris23 @Aelkus frankly, they have shown the public nothing, so they shouldn't have needed a dumb name to get money from closed door mtgs. @chris23 @Aelkus "the name" = Sentient @chris23 @Aelkus I also hate the name. AI researchers generally eschew that term/topic, so again, raises flags. @chris23 @Aelkus that may be how the public sees it but not how AI researchers see it/talk about it... @chris23 @Aelkus ..themselves in a published paper and demo before getting super big bucks/acquired. Dislike secrecy, raises flags... @chris23 @Aelkus I dunno. Dumb stuff gets funded sometimes, and AI is complex. Would have to know much more... vs. e.g. DeepMind proved... @Aelkus @chris23 to me those two are interchangeable, devil is in the details and both can be used inappropriately... @chris23 @Aelkus That's what they say, but have seen no technical details to confirm that... What's the deal w AI-related patents and the processes for granting them? Is PTO competent (on this)? New Google patent seems broad. @rcalo @hintikka I guess New York**... haha @hintikka between this and the Franzen piece...come on, fancy New X publications... @hintikka (that's on the story, this is on my attitude towards emojis: 👌) @hintikka 👎 @JesseJenkins @ramez @wadhwa @atrembath @alannogee if I had a forecast, it'd prob. be at least as aggressive as that :-) @JesseJenkins http://t.co/271tbNR6MO @JesseJenkins @drgrist sure, I'll hopefully have some fresh thoughts after a solar seminar in a bit :-) email later today... @JesseJenkins not much to share, but would say I found issues (and much to like) in the Fraunhofer report, would be interested in your take! @JesseJenkins @drgrist would be happy to chat about that sometime - have given some thought to solar's differentness... @JesseJenkins regardless, I'm still skeptical as you are about the sustainability of it - then again, it can decrease a lot and still scale. @JesseJenkins I just did some quick calculations, it's not written there, so maybe I got it wrong :) but seems like it did grow.. @JesseJenkins @ramez @wadhwa @atrembath @alannogee compare early and late 2000s in figure 1 here: http://t.co/IdMVuXPkO7 @JesseJenkins @ramez @wadhwa @atrembath @alannogee depends where you draw your temporal boundaries. solar growing faster than decades ago.. It's not that I don't think solar will create a lot of jobs--it will--it's that I think that isn't the most important reason solar matters. To be clear, making some parts of the solar value chain more automated will create jobs in other parts b/c faster growth, but which ones? IMO residential solar is likely to be a bigger job creator per unit of power produced than utility scale in 2020, b/c latter more automated. "Lukewarm about this solar training stuff: http://t.co/Ty3XbU4Ln3 Solar to me = abt climate/energy not jobs, tho residential diff from util." The whole Pepper/Watson thing could be quite interesting... here's one demo: https://t.co/1acaYoZnXJ "Paraphrasing of user requests and results by automated digital assistant," recent patent by some folks inc. Cheyer: https://t.co/aYOYQKwXA4 Interesting that Adam Cheyer is involved in both Viv (cofounder) and Sentient (adviser). His talk on Siri at AAAI last year was interesting. ...Sentient has also gotten a lot of attention lately, haven't seen any reason to be interested in it yet besides their money, though... What is the most interesting AI company besides the tech giants? Viv, MetaMind, x.ai...? Numenta/Vicarious already discussed ad nauseum... RT @danieldewey: Get a job studying extreme technological risk, including superintelligence, at Cambridge! First round closes 4/24: http://… @pmarca yup. RT @aimsinpeng: At a tech startup talk. This is what they say about working w academics @Worse_Reviewer @AcademicsSay http://t.co/qLVD5jJwZ2 Haven't seen Ex Machina, but I suspect it would be more interesting and plausible if the bot didn't look human (though would make less $). @Aelkus so, would we even want the future to be predictable? I think not. @Aelkus ..individual level determinism is ethically troubling, scaled up/democracy edition. I mention this briefly in my AAAI workshop paper @Aelkus another point that I'm surprised doesn't come up more often is that future predictability is ethically troubling in same way... @Aelkus will check out, thx! Sarewitz's uncertainty and decision making had a lot of such stuff as you could prob(abilistically) guess :) @Aelkus e.g. I like the term "reperceiving"... thinking about the past/present/future should help us to perceive/act on stuff better today. @Aelkus yeah, for that reason I'm a big fan of the scenario approach... understanding/robustness via problematizing of assumptions. Huge fan of anticipating/shaping future possibilities, but don't like prediction per se. Lame that the latter is what some ppl want most... The best way to predict the future is...irrelevant, cuz it's not necessary or possible in detail. Best we can do is make robust decisions. RT @rcalo: Read the draft papers from #werobot2015 here: http://t.co/iyFdMaivZe @JesseJenkins @alannogee @EnergyCollectiv it's a big share...and growing fast absolutely and relatively. Maybe missing your point. @JesseJenkins @alannogee @EnergyCollectiv not sure I follow you there... @JesseJenkins @alannogee @EnergyCollectiv I agree. Won't happen automatically, and I'm not predicting it, just working to realize it :) @JesseJenkins @alannogee @EnergyCollectiv I don't have a projection. Yes, it's diff from wind in many ways, esp resource base + pace of inno @JesseJenkins @alannogee @EnergyCollectiv if it continues at anything like its CAGR, other stuff not needed to change the math a lot. @JesseJenkins @alannogee @EnergyCollectiv if solar kept up its >>10% CAGR long enough, the overall renewables CAGR will increase soon :) @rcalo I'm already super excited about my workshop this month, don't give me crazy ideas! ;) Standardization of solar plant design/construction processes has myriad benefits soft cost-wise but conflicts w/ other plant improvements. PV plants are similar to each other in many ways, + some tasks are similar to each other, but the differences are sufficient to require ML. The reason for the "==>", briefly, is that w/o ML, you spend a ton of time/$ on automating X, then next plant is different. Not scalable. One of the key probs with solar construction automation is the diversity of tasks across and within plants ==> machine learning will be key. We can already say many things re: why construction automation is hard and which techs seem most relevant. Workshop= putting those together. I'll tweet the background paper for the workshop soon but suffice it to say that it'll be way more detailed than Fraunhofer's 1 sentence. :) We should be able to say a lot more about solar plant construction automation than that it "seems possible" but is "highly uncertain." Some of Fraunhofer's assumptions are plausible, others not so much (in both directions), and it says construction automation is "uncertain." The Fraunhofer report makes clear the extent to which the soft cost side is understudied. They asked top people, came up with little vision. Thinking more and more that a set of scenarios for the future of solar soft costs and/or a roadmap would be broadly useful workshop outputs. Reactive approach w/ super mature automation tech = approach so far (some exceptions). Workshop this month = proactive in orientation. (2/2) Reactive approach to solar construction automation: here's how it's done today, add robot to do X. Proactive: rethink whole process. (1/2) @hintikka yeah, as Joe Romm put it - good writer, bad reader :-) Confirmed some details of the soft costs workshop today: location: Courtyard Marriot Tempe, Chatham House rules observed. Draft agenda soon! The pop psychological insights in the Franzen piece are not new, the hopelessness is unjustified, and the tone actively harmful. Epic fail. Re: last RT...finally got around to reading the Franzen piece, and it is indeed crap. Agree w/ Romm: Franzen is a good writer, bad reader. RT @CostaSamaras: If @drgrist wrote a book around his reaction to Franzen: http://t.co/UVs4hseX22 & included discount rates, uncertainty &… @Aelkus some didn't think that, some did... @JesseJenkins really, though...if there is any truth to e.g. the new Fraunhofer report, this is wildly bearish re: solar (/vice versa) :) @JesseJenkins yes to both :) @jon_jeckell neither will kill it :) RT @ericbkennedy: "Science fiction is technology assessment for the rest of us." @clarkamiller #climatefutures RT @katiefehren: $1B for a desalination plant in CA doesnt seem all that expensive, compared to things Silicon Valley spends $1B on http://… @JesseJenkins "it" was vague there - deployment plateauing...CAGR can drop to zero for all I care if before that it is very high... @JesseJenkins (and many terawatts of renewables are deployed by then - so, high enough long enough to realize that, which IMO is plausible) @JesseJenkins I don't really care what the CAGR is in a few decades, as long as it is very high before plateauing :) @JesseJenkins can't speak to renewables in general but will say we ain't seen nothing yet in solar :-) RT @JesseJenkins: Has Renewable #Energy Finally Ended “the Great Clean Energy Stagnation”? http://t.co/zxli7gc3GA Putting renewables growth… @robinhanson can't speak for "we" but I do :) #NAME? Interested in using Chatham House rules for the solar soft costs workshop later this month- anyone have thoughts on CH rules vs. other (1/2) Really enjoyed chatting with @TedPavlic yesterday about swarm robotics, solar soft costs, etc... he does some very cool work! :) @PabloRedux have made some progress in my head re: how it could be done, but haven't had time to do it yet. would if funded by FLI, TBD :) @PabloRedux @alan_winfield lots of people would like, e.g., a big push by the gov't on pro-social apps of bots, but mostly mil/intel funded. @PabloRedux @alan_winfield in the US, at least, I'd suggest principles like EPSRC's aren't well reflected in concrete funding/R+D decisions+ @arthurhcyip for diff goals - temp., concentration, or otherwise-based. last good read I had on that was a few years ago, wanna reassess :) @arthurhcyip therein than the metrics per se (agree w/ the pts on the issues w/ this one), e.g. latest thinking on how deep cuts are needed @arthurhcyip thanks! good read, though I should have clarified I am more interested in lit on the Q of the "effective unachievability" ref'd RT @helengreiner: EPIC appeals to court for FAA drone privacy rules http://t.co/HwTgOgZAW7 "RT @AcademicsSay: ""It's my writing day."" - Me ""Good morning."" - Netflix" @Aelkus consensus among experts/technocrats != among policy-makers != public, though. Latter two still absent in most places, inc. US... @Aelkus you read The Techno-Human Condition? @annegalloway cool. thanks! will have to check out your publications/other posthumanist stuff :) @annegalloway reading material welcome :) more familiar w/ trans than post lits... @annegalloway I get the latter, not sure I follow former- why does trans nec imply exceptionalism in way post doesn't? Or connotations diff? @annegalloway hmmm.. @annegalloway hmm, did they have specific reasons for post>trans? Could latter just be more salient to some bc heard term more? One could build models of AI sub-disciplines' progress alongside complementary metrics like "best integrated system for X effort at Y time." ...from all papers on X, across time, +see how accurate people's grant proposals have anticipated progress on Xs. Lots of data to work with. Lots of AI, esp. NLP, will be useful 4 mining/analyzing the AI literature. E.g. extract/integrate text on past/future of X sub-disciplines.. @annegalloway transhumanism ...aggregating and synthesizing insights from various sub-disciplines. Will def. need to be a very open, participatory process to work well. Won't have time for a while to focus much on my AI progress modeling stuff, but it is coming along steadily in my head, esp. methods for... @mark_riedl don't know much about the patent process but seems like a very broad patent... @mark_riedl see also: https://t.co/9gzBhyLB0Z Note that that Google patent was first filed in 2012, and the Jibo one was filed in 2013. Don't know enough about patents to say much more.. Comparing Google's robot personality patent (http://t.co/oVR4Jxrupc) and Jibo's patent (http://t.co/LSVGJMSzbX). Very related in many ways. @arthurhcyip recommend any good recent pubs on that window? @hintikka got scared when I typed tosh daily on Google and it autocompleted tosh daily show, turns out for a totally unrelated reason :) @hintikka I suppose a few lulz is redeeming value :) would not be interested in his views on anything though, haha... @hintikka (his show/style) @hintikka yeah...AFAIK has no redeeming value, lol. @williamstome congrats! :) @hintikka nvm, *phew* @hintikka wait is he being considered for TDS? that would be preposterous... he sucks On last RT: gonna have to read the patent carefully - headline makes it sound way too broad to be patentable... RT @RobotDiva: #Google patented building robots with personalities http://t.co/56cF4fQVrI via @qz RT @cns_asu: Vol 2, Iss 1 of the Journal of Responsible Innovation, with a special section on #synbio, is now available. http://t.co/yEhyKc… RT @TheAlexKnapp: One of the world's fastest supercomputers is going to belong to an energy co, not a gov't research lab: http://t.co/trU6K… @patio11 @pmarca you mean McKinsey? ;) RT @MIRIBerkeley: MIRI's 2014 in review: http://t.co/S9z0JyMaAS RT @laurenist: #HireShanna RT @chicoharlan: Shanna Tippen lost her minimum wage job at Days Inn after I wrote this story about her. http://… RT @elonmusk: Major new Tesla product line -- not a car -- will be unveiled at our Hawthorne Design Studio on Thurs 8pm, April 30 RT @FHIOxford: We're hiring! http://t.co/M0hbCFBgWI @JesseJenkins would love to see a paper on cost trends for post Li-ion... now THAT could upset some modeling assumptions :) RT @BoredElonMusk: Facebook product roadmap. http://t.co/st6644mfiK RT @BoredElonMusk: Drones that fly around the office and slurp up left-over liquids on desks that may become disgusting overnight. http://t… @j2bryson that one works for me :) @j2bryson link not working for me.. @rcalo he's doing Gangnam Style it seems... @Aelkus not gonna happen for CS anytime soon at 100% bc commercial/IP issues. less relevant for social scientists. My phone knows me pretty well... type in "sup" and it suggests "superintelligence." THIS time, though, I really was going to say "sup"... RT @mark_riedl: Facebook’s LeCun on AI digital companions and emotions http://t.co/C2yyOOJY0V mainstream AI starting to adopt affective com… RT @limlouisa: If anyone else stands up to read out a paper verbatim, I'm going to cry from boredom. Academics. Must. Try. Harder #AAS2015 @GordonBrianR @FrankPasquale yeah, my comment was on gov't in general. SBIR disproportionately relevant to VC, small in bigger picture. @WIRED @SpencerGreen111 ah nvm I guess this headline is correct and the other I saw on years was incorrect (or I made that up) @WIRED @SpencerGreen111 you mean years? :) @SuzanneWaldman @SAWEvans you may also find the editorial introductions as helpful (all are free, I believe). @FrankPasquale not just VC, all corporate innovation/activities :) but yep, that's true. @SuzanneWaldman @SAWEvans risks/impacts in a broad context and also the implications of inaction in evaluating precautionary claims/ideas. @SuzanneWaldman @SAWEvans characterize it as "against" so much as RI being broader/richer, + some RI proponents emphasize need 4 considering @SuzanneWaldman @SAWEvans you could prob find many views on such things depending on one's conception of RI - personally, I wouldn't so much RT @SAWEvans: New Journal of Responsible Innovation is now out, inc essays by me and many others on #synbio http://t.co/Mi7AFmRnyx @joekaras14 that there would be more variation/inefficiency on rooftop than util, though the pt on policy mattering applies to everyone... @joekaras14 yeah that def made sense to me (though all conditional on ITC policy)... hadnt thought about the range of costs much- would seem RT @EcoEvoEvoEco: Shocked by difference in words 4 male vs female recommendation letters for faculty positions: http://t.co/zKOmbzgj4M http… RT @lzamparo: NIPS workshop videos are up. Rejoice! #nips2014 https://t.co/CvMLmNeLc0 ...and for the whole day, no less! I think that is indicative of many people's interest in sustainability in general + solar in particular. I'm very excited about how many people are willing to meet on a Saturday to talk about something only somewhat related to their research. :) @joekaras14 at 1 point one was using rooftop numbers and the other was using utility scale numbers, chaos ensued, maybe I misunderstood.... @joekaras14 listening now...I get Shah's point, not sure what this other guy is talking about... @Aelkus your claim or your summary of Harnad's claim? RT @helengreiner: Personally I would bet on this over balloons. Zuck says Facebook's giant Internet #drones are flying @FortuneMagazine htt… @joekaras14 nice, will check it out - thanks! @mark_riedl would love to see it! RT @AmyResnick: Tim Cook plans to donate all of his money to charities after paying for his 10-yr-old nephew's college education http://t.c… @sarahjeong LOL. wow. thanks for that. RT @sarahjeong: hey guys remember when the guy who put the Perkins in "Kleiner Perkins" compared Google bus protests to Kristallnacht FLI received about 300 pre-proposals totaling around $100,000,000. Excited to see what makes the final cut! RT @forachelP: Rarely discussed, the psychological toll of not having reliable "light" http://t.co/uNgVczeXkU #PowerAfrica @nytimes @toddjm… Next month's @CSPO_ASU/QESST/@asulightworks workshop looks at the role AI/robotics can play in making solar cheaper: http://t.co/2Y8FeK1Jnl RT @sarahjeong: The Pao verdict cannot chill open conversations about sexism any more than it's already been chilled. Interested in talking solar energy, AI, and robotics next month? Come to this workshop! :) http://t.co/2Y8FeK1Jnl "RT @sarahjeong: statements like these https://t.co/g6fIkbfrAQ https://t.co/gRujvTvz78 hurt women in the tech industry more than any outcome…" Particularly excited about a proposal on AI and security I'd be a co-PI on, involving several of the awesome folks in my last tweet. Yay! :) + news today, including @2020science @clarkamiller @j_winterton @j2bryson and @SethBaum! Best of luck to all in the next stages! (2/2) Excited to find out that at least 3 ASU-related pre-proposals to FLI made it to the next stage! :) congrats to all who also got good (1/2) RT @ellenhuet: Wait, something might be up. Judge counting an 8-4 count on the claim of retaliation by termination, not enough for verdict.… Looking forward to getting feedback/questions re: my presentation on soft cost technical/economic/ethical issues today :) should be fun! @hintikka yeah totally bonkers @romanyam congrats! @hintikka ah haven't been seeing MSM coverage, thanks...and yep, I'm one of em. idiots! @hintikka or just a general comment? @hintikka is someone in particular doing that (stigmatizing)? May have missed the latest update in the story.. RT @VincentCMueller: Nice videos on robotics in small and medium-sized enterprises https://t.co/LacGUQ0jmX TL;DR my latest slides: solar soft costs = important, lots of different opportunities, need to prioritize big ones, workshop will be epic :) Happy to share if anyone is interested in miscellaneous musings on technical/ethical aspects of solar soft costs :) Just finished making slides for a joint seminar on a bunch of energy/responsible innovation topics...sort of a preview of my workshop intro. @nerdsrocket makes sense in the abstract, at least @beaucronin http://t.co/dNxowooUb6 Got a few more confirmations for the soft cost workshop :) will have solid representation of solar, AI, robotics, policy, etc. communities. Worried talking about Woz's comments on AI would give him more airtime on the topic than is justified, but he will prob keep doing it... :-/ Has anyone written anything reasonable on Steve Wozniak's dumb AI comments yet? Unlike e.g. Musk, he evinces no awareness of relevant args.. RT @nancyleong: From @jessicavalenti: "When women hate men, we hurt their feelings. When men hate women, they kill us." http://t.co/7Fe7Xnc… For the uninitiated in solar: Fraunhofer report is super bullish by most people's standards (esp. policy-makers unaware of recent progress). All things considered, such soft cost synergies (and other policy/regulatory ones) suggest to me that they underestimate some opportunities. Fraunhofer report treats soft cost elements as distinct, when in fact e.g. standardization/automated installation/scale effects=synergistic. Overall, the Fraunhofer report's bullishness on (/call for reconsidering the future of) PV is justified, more to say on issues with it soon. @arthurhcyip @SuzanneWaldman (which is OK by me, just saying that it flies in the face of some people's mental models of "(bio)fuels." @arthurhcyip @SuzanneWaldman also, future sustainable light-based fuels will likely be genetically engineered or non-biological, anyway :-) @arthurhcyip @SuzanneWaldman that probably accounts in part for the appeal of current unsustainable biofuels. Future ones have other args. RT @Benioff: Calling other tech CEOs and tech industry leaders to please take a stand. http://t.co/Ghd7TcxfZf Second impressions of Fraunhofer report (almost done): understimates installation cost reduction opportunities, dunno about the rest... Can anyone speak to the plausibility of the inverter cost projections in the new Fraunhofer solar report? Seem a bit extreme... RT @mappingbabel: Facebook's research on adding memory to massive convolutional neural networks runs parallel to Google's own DeepMind rese… @chrishtill good stuff! have you seen the related episode of Black Mirror, Fifteen Million Merits? If not, I recommend looking into it :) @eco_marci congrats and good luck with the next steps!! PMF is a great gig :) have worked with a few before. RT @BBCBreaking: It was co-pilot's "intention to destroy this plane" French officials say http://t.co/Cd2D1Vuluy #Germanwings "RT @JesseJenkins: .@SunEdison to Buy 1,000 of Imergy’s Flow Batteries for Rural Electrification http://t.co/QYgAOPSDEe #e4dev #energy" If I started a company, I'd want to prove a for profit corp can be ethical, or that a for benefit corp can be scalable. Not sure which... :) Have any of you played with the DeepMind deep reinforcement learning code? https://t.co/PyA7Tlm1rs Haven't gotten around to it myself... RT @drfeifei: Check out this! “@karpathy: The CS231n (our ConvNet class) final project reports are posted! http://t.co/ARztX5MHWc 100 ConvN… The new Fraunhofer report on solar is a must read - article summarizing some of it: http://t.co/271tbNR6MO report: http://t.co/XRQmEjrWbg US media outlets' headlines related to AI are often bad, but the UK media are worse....MUCH worse. """Elon Musk claims artificial intelligence will treat humans like 'labradors'"" This. Headline. I can't even. http://t.co/fxAz7dznOz" @hintikka cool! I'll shoot you an email :-) I should finish writing the background paper for the soft costs workshop in ~ a week, if anyone is into that sorta thing/wants to read it :) @hintikka how could one bargain for your advice over Skype? ;) Looking for participants in workshop next month w/ expertise in policy aspects of solar soft costs - get in touch if that's u/u have ideas! Still reading new Fraunhofer report, but so far seems great + I agree w its key findings (e.g. solar is underestimated in energy scenarios). ...agreed! The workshop next month will bring together solar, AI, robotics, construction, etc. people to reduce that uncertainty. :) (2/2) Fraunhofer solar cost report on automation: "Automation of installation appears possible in the future, but remains highly uncertain." (1/2) RT @susie_c: The market tolerates a lot of terrible business plans. It doesn't mean your business plan isn't terrible. @arthurhcyip @alannogee @zshahan3 @cleantechnica look forward to reading it, thx! I am bullish on soft costs - workshop on it next month fyi @hintikka def. @hintikka not a "fan" of many pols but my exp in DC suggests Obama has talent and ethics. only positive about Clinton's talent ;) @hintikka yeah, he is def. better at that than most, inc. Obama (though I have more data on/exp. re: Obama and am a fan, full disclosure :)) @hintikka yeah I definitely got that impression :) just not that wowed I guess, said exactly what one would expect him to say... #cynic @hintikka is he really a hillbilly though? haha...behind closed doors he seemed like a normal, smart politician who adapts to audiences... @hintikka he does seem up there with Pelosi in terms of mastery of the political game, though... @hintikka then again I came of age in Bush/Obama so maybe missing some of the nostalgia/other appeals :) @hintikka I wasn't that impressed by him when I saw him in person :/ says smart things but so do many politicians who don't do THAT too.. @SuzanneWaldman @ravinaproject ...I am open to high biofuels scenarios if they're diff. from today's, and ppl working on that, but not nec. @SuzanneWaldman @ravinaproject "In most cases" = key. Scenarios are just that. I don't accord that any significance in my scenarios... @rcalo escaped from DeepMind's labs? ;) RT @lizgannes: Finishing out closing arguments in the Pao/KP case today. Liveblog here: http://t.co/w2N9zP35YT @hintikka not sure whose case this favors, but that frankly doesn't surprise me. VC prestige tells me nothing about HR/gender competence... @hintikka /worth defending... @hintikka so, KP claims they're protecting their reputation, she is hurting it, etc. seems to depend on it being good reputation to begin w/ @hintikka yeah, I haven't been following closely enough to have a prediction one way or the other, but KP sounds super whiny. @hintikka and now the sucking up to the jury thing - "Hermle says this jury is by far the most attentive she’s ever seen" such a lame system @hintikka +and express their views too." like, I can't even. @hintikka "Hermle says Pao is applying a double standard to people who disagree with her publicly, because they should be able to stand up+" @hintikka and a great reminder of why I am glad I didn't become a lawyer :) @hintikka also, that "double standard" thing is the lamest argument ever @hintikka helpful, thanks! @hintikka thanks! @hintikka :( is there a way to watch excerpts? or should I jump in now? @SenoritaRuth @AthertonKD never say never - there are some ruthless penny pinchers out there - but "shouldn't"/"not anytime soon," def.! :-) @SenoritaRuth @AthertonKD (that one was page 2, whoops haha, see page 1 too ;) ) @SenoritaRuth @AthertonKD and here (last one :) ) http://t.co/p8ofOQdCz4 @SenoritaRuth @AthertonKD good for you! :) I discuss related issues inc. consumer preferences here: http://t.co/xMEGEg5A3Q @SenoritaRuth @AthertonKD lots of ppl's jobs being lost/changed cuz of robots, will continue, not so much flying cars :-) @SenoritaRuth @AthertonKD but you should be more suspicious of roboticists and their job impacts cuz of human choices than robots per se ;) @SenoritaRuth @AthertonKD hah that seems like a reasonable view given that a robot is more likely to actually exist/have an effect at all :) @SenoritaRuth @AthertonKD don't get me wrong, your kid'll see all sorts of cool stuff, including lots of robots. just flying car skeptic ;) @georgebaily @AthertonKD as long as people know that's the point, haha @SenoritaRuth @AthertonKD need superdense post lithium-ion batteries among other new techs for it to be scalable/not fossil based IMO.. @SenoritaRuth @AthertonKD and yes, solar planes are cool :) just BARELY able to work with massive wingspan and small cargo, no good 4 cities @SenoritaRuth @AthertonKD well the plot of Jetsons doesn't take place for another 50 years so we shall see ;) @elonmusk ...and even then, unclear it would make sense even if done without fossil fuels... @elonmusk until we have super dense batteries, "trying" flying cars has high opportunity costs and benefits only a few bored rich people. @SenoritaRuth @AthertonKD well I would be more into it if it were electric, just not plausible in the near future :) stuck w/ dino fuel.. Saw a cool seminar on autonomous flying cars years ago. The autonomous part made perfect sense to me - not the flying part, though :) @SenoritaRuth @AthertonKD what about the tubes from Futurama? multiple people use the same infrastructure there, more efficient ;) @AndrewKam @AthertonKD yeah, Musk mentioned that - would have to be autonomous. Even if that is addressed, still super inefficient.. The only "pro" I am aware of re: flying cars is "it's cool." No good energy, environmental, economic, etc. args for it to my knowledge. @SenoritaRuth @AthertonKD a century, maybe :) @SenoritaRuth @AthertonKD haha well if you really want one and can pay millions for it, go for it - just doubt it'll be cheap within decades There are two(+) key reasons flying cars don't exist on a large scale: not a lot of investment, makes little sense. Former won't fix latter. Just for takeoff alone, it takes a bunch of energy to lift a car versus rolling it. Why do that other than not having better things to make? By "stupid" I mean "stupid to focus on/get excited about." Not the dumbest thing in the world, but FAR from something ppl should clamor for. On flying cars: haven't read Musk's comments on it yet, but I have long thought they were stupid. Makes no sense energywise at system level. RT @elonmusk: Contrary to press reports, I'm not against flying cars. Just said it was important to consider both pros and cons. @hintikka Optimistic about energy system change, not climate policy, btw haha, just to be clear. Gov'ts asleep at wheel, it's up to us :) @hintikka haha well I am actually optimistic about both AI and climate - and the two relate... e.g. working on solar deployment bots now ;) @hintikka seen* @hintikka yup - that's part of why I mentioned climate...been there/done that haha (used to work on it), seem limits of appeals to authority @hintikka agree 100%. many journalists/some academics are stupid and irresponsible in how they address these topics. @hintikka TL;DR I am not super worried but think working on the short + long term problems/oppos is a good idea for society as a whole :) @hintikka I said some stuff on Bostrom/related issues here: http://t.co/p6KvVPCAUd @hintikka for sure. And again, I think Bostrom (for example) agrees. Work on safety/ethics doesn't require full knowledge of pathway. Obsessed with Le Guin now. Can't really compare to Atwood, they're both masters of speculative fiction, but esp. digging The Dispossessed... @hintikka I would go one step further - for superintelligence, it better not be imminent! haha...if at all plausible, should think ahead. @hintikka ya - that's 1 of my main issuse w/ journos - either distracting from present w/ future or vice versa. let's work on many things :) @hintikka lots of things to lose sleep over already (like ppl already losing sleep over crappy/lost jobs!) @hintikka right now I am focused on wrapping head around the timeframe Q - past, pres, future. so, again, agree strongly haha ;) @hintikka Russell too probably isn't losing sleep over it, but says it is a hard, long term research problem - I agree :) @hintikka well, they should be louder but some miss e.g. Bostrom's point and overstate case. He *also* doesn't think it is at all imminent. @hintikka lang is key as you said tho. "worry" about superintelligence to me should mean "fund research" not "scare public" :) @hintikka that is a completely legitimate concern and it often serves that role - but shouldn't :) we should worry about many things IMO.. @hintikka yes. Schmidt is big offender here. Says Turing Test nonsense, has implausible, self-serving views on income inequality/education. @j_winterton haha I think someone else coined it but dunno who ;) @hintikka AFK. haha. Yes, more ppl should be thinking, talking, and acting on such things. @hintikka anticipating AI progress viz-a-viz the future of jobs is my main research program, so with you there for sure :) @ShlomoArgamon I agree! @hintikka but yeah I agree the public discourse and journos in particular = problematic. DID submit a proposal on that ;) @hintikka You mean on current issues or on algo discrimination? Lots of big names at ethics workshop at AAAI this year.. @hintikka (I didn't submit on that exactly but def on current and near term issues/risks, and I think others prob submitted stuff on that) @hintikka how do you know I didn't submit that? ;) I think there will be a lot of cool stuff funded. @hintikka exactly! thats what I meant :) @hintikka to be clear, I don't think he is disingenuous either - many journalists are or at least act that way, though :-/ @hintikka journalists often conflate "X is far off"+"nothing to worry about." Need 4 critical engagement w today's tech + long term R+D IMO @hintikka I do not support disingenuity haha :) I have said before Musk's timeline is totally implausible. @hintikka and can be done without appeals to authority. Need to separate Musk hype/nonsense from him parroting others with cred... @hintikka I agree and that's why I worry about the former in my work ;) but think dismissing all concerns/work on future unhelpful... @hintikka one can separate "we should work on X" from "X is imminent" - plenty of AI experts say former (eg Russell+most recent AAAI pres's) @hintikka AI experts don't fear imminent superintelligence, but many signed open letter saying ~what Musk has said with more cautious lang. For every expert there is an equal but opposite expert. You can find AI people who say all sorts of correct and incorrect things. ...the "but experts X and Y said this!" is an appeal to authority, plain and simple. If you wanna engage Musk's arguments, just do that! On last RT: I shared just to be able to say: trotting out experts who disagree with X is a bad model. See: climate change. We can do better. RT @PeterAsaro: 5 Experts Who Say Elon Musk is Wrong About AI - Robotics Trends http://t.co/Uv4X2rejc5 For the rest of the case studies we did on gov't and energy innovation, see the (reasonably priced :) ) book here: http://t.co/YNCG8kzErc RT @icracnet: Meet AJung Moon @RoboEthics, ICRAC's newest member || http://t.co/TT6xECfXDu || http://t.co/eepKgq4DxA Now hosting the final version of my book chapter on the US gov't's role in solar thermal tech development on my site: http://t.co/eL3kA111Ey I provided an alternative view to @KatjaGrace's reading group on Bostrom's Superintelligence, collaboration section: http://t.co/p6KvVPCAUd RT @anildash: And if you're talented & in tech, you don't have to help start Twitter to help improve government. Look at @USDS + @18F today… @arthurhcyip @vsiv sure, I'll forward it :) Some CSP types lend themselves more naturally to automated construction, e.g. parabolic troughs are easier than power towers bc modularity. commodity materials even 4 high growth scenarios (tho will require lots of glass), PV-specific materials are trickier + need foresight.(2/2) Key takeaway from new solar PV scaling paper (http://t.co/RWWwmy8qz2): lots of R+D opportunities in all PV types, no deal breakers re: (1/2) @Aelkus @smart_cctv_nyc needs to start by not saying "Hmm!" and "retweet quick" every few posts :-) RT @KatjaGrace: On sharing the spoils vs. spoiling the shares (superintelligence reading group) http://t.co/KwF7Yoi78w @arthurhcyip Woodhouse, Fu and others at NREL have good stuff on this (published and unpublished). Will be synthesizing that, etc soon. The solar soft costs workshop will be supported by @CSPO_ASU, @asulightworks, and QESST. Very grateful and excited! It's going to be epic :) RT @elonmusk: Falcon 9 lifting off with 1.3 mmmillion pounds of force http://t.co/7ltlN2WYmx @d4ytrad3 @elonmusk then see Robopocalypse and Vinge's stuff, off the top of my head. Lots of superintelligence portrayals in sci-fi. @Aelkus (cuz he gets things done) @Aelkus would be much more skeptical if it were anyone but Ash Carter.. + things like plant/process design, restructuring environment, etc. to make more amenable to automation. Workshop will consider both. (2/2) There are two semi-distinct categories of automation opportunities in solar plant construction: automating tasks ~as is, and rethinking(1/2) "RT @SFist: Twitter Systematically Denies Job Promotions To Women, Says Lawsuit http://t.co/zroMLZozuk http://t.co/fXSdkHw44E" (last tweet = ~ working hypothesis informing the workshop I am running next month and what it is intended to lay the foundation for) The solar industry needs to transition from passive adoption of mature automation to an innovator in human-machine symbiotic construction. Word on the street is FLI is overwhelmed with proposals... good news, but can't say I'm surprised ;) https://t.co/YxKuOccVFo @jon_jeckell cool - thanks! :) @jon_jeckell recommend it overall? On Netflix? This Chipotle (Chipotles?) = just not selling carnitas cuz of supply issues. Better than them using less ethically raised meat! Props. Elaborating briefly: recent hard cost drops in PV have driven many away from CSP. To get back in the game, CSP must innovate in big ways. + much of the case for CSP, and the extent to which CSP construction can be modularized, automated, and generally made fast and cheap. (2/2) Working hypothesis: the future of CSP viz-a-viz PV largely depends on two variables: breakthroughs in storage for PV which would erode (1/2) Sent out several invites out over the past few days for the workshop I'm running next month... *fingers crossed* :) Should be an epic group. "Multimodal Science Learning," Ken Forbus lecture at Allen Institute for AI: https://t.co/eUqgCotFUG Anyone interested in taking a look at/critiquing a white paper on solar soft cost reduction opportunities in the near future? :) My money is on IHMC doing well in, if not winning, DARPA Robotics Challenge finals. Will be v. interesting to see how the Chinese team does. Next few paper topics: responsible innovation as a scientific-intellectual movement, modeling progress in AI, and solar soft cost analysis. @rcalo that being said, think it is safe to assume their software is way behind Google's in some respects - just not the only issue here.. @rcalo yes. much more limited sensing, good enough for car tracking, lanes, signs, etc. but not super detailed mapping, pedestrians, etc @rcalo see "technically" in quote here - http://t.co/ZZrYei3vO8 I take to mean - ignoring laws, safety, traffic. @rcalo he also has caveated such claims and said it is not expected to be safe in suburban areas. @rcalo e.g. lane stability and changes...they want full auton eventually but not being promised for current models that I am aware of (?). @rcalo to do everything, yes that would be helpful/maybe nec., but AFAIK only limited autonomous features forthcoming, = lower sensing bar.. @AbeAlem lol. i never said it was an excellent movie. watcher beware. i thought it was pretty good... @AbeAlem haha. it isn't that kind of movie. See Big Hero 6 instead for that purpose ;) @AbeAlem streamable on Netflix :) other ways too, prob. @elonmusk the movie Automata delves into stunting of AI intelligence... Non-trivial to do that in reality but more plausible than 3 Laws. :) RT @elonmusk: @AbeAlem Unfortunately, Asimov's books largely illustrate why the three laws don't work @hannahgais :( "RT @susie_c: LinkedIn: ""We counted all the trees we might have to cut down."" Google: ""We'll build you a $15 million police station.""" RT @susie_c: How many other corporations micromanage the traffic infrastructure near their offices http://t.co/wfgq6a9krM Note to journalists echoing Musk on human driving maybe being illegal in the future - point not original to him, and not what he advocates. RT @ogrisel: Theano re-implementation of DRAW: A Recurrent Neural Network For Image Generation by Jörg Bornschein https://t.co/QpophULBpw #… @Aelkus and yes, not unusual, the only reason people care is that it's NYT. @Aelkus oh, that. yeah, dumb. RT @karpathy: "It's much simpler than I thought." <- my favorite talk feedback. Destroying people's sense of Deep Learning wonder one talk … @Aelkus which article? @zeynep and this is surprising to whom/why? :-/ I guess if it is illegal, that is news to me, but I thought this was understood... RT @tegmark: We've just launched an FLI news site about existential risk and a positive long-term future: http://t.co/9inUkOATwq http://t.c… @paulonabike someone made the point that what we think of as privacy is often anonymity which arose first in a big way in 1800 cities (?) Starting Chernova and Thomaz's Synthesis Lectures series book, Robot Learning from Human Teachers (2014). Epic overview of many key topics. The solar soft costs reduction dream team (er, super serious workshop) is coming together for April 25th. Get in touch if interested ASAP :) "Pathways for solar photovoltaics" Jean et al. 2015 - highly recommended for energy nerds - lots of great stuff here: http://t.co/nXGWEMDQQk On my last tweet: basically a rigorous version of the deep reinforcement learning chatbot idea I mentioned before...learn dialogue from exp. "Deep Reinforcement Learning for constructing meaning by `babbling'": outline of new deep RL/NLP research project: http://t.co/EFfKV2bWGd "Incomplete Preferences and Models," Kambhampati (part of human-in-the-loop AI tutorial, + interesting on its own): https://t.co/cF3ZMqfKZN On my last tweet: I was one of the subjects being experimented on there :) And agree with the conclusions - it was a helpful exercise. "Easychair as a Pedagogical Tool: Engaging Graduate Students in the Reviewing Process," Talamadapula/Kambhampati 2014 http://t.co/mEEokQOFqf Relevant to HRI/MAS: "Capability Models and Their Applications in Planning," Zhang, Sreedharan, and Kambhampati 2015: http://t.co/2RyrR60BwO RT @BotJunkie: On Automaton: Sawyer: Rethink Robotics Unveils New Robot http://t.co/9B0wve8FWr #robotics "The necessary components of a collaborative intelligence are nearly at hand." Epstein 2015 on the ends/means of AI: http://t.co/Tdi1VNqqsj @Aelkus @johnrobb @AthertonKD @pmarca I also recommend this: http://t.co/zinwKzsQn4 @j_winterton @williamstome likewise! some day we need to have @williamstome pitch in his AI/sci-fi expertise as well :-) @williamstome thanks! though @j_winterton gets credit for all the good parts of it ;-) @arthurhcyip @atomicnews @JesseJenkins even another order of magnitude lower, $10... jeez. @arthurhcyip @atomicnews @JesseJenkins and rich homeowners paid outrageous sums to be early adopters :) @hintikka sweet! no prob! @hintikka cool :-) @hintikka yup :-) @hintikka er QA, not NLP http://t.co/N30SO9pS9i @hintikka yeah I would like to at some point also read/compare to that "Towards AI-Complete NLP" paper, read that? on my to do list.. @hintikka got the name wrong, it is this http://t.co/2yretwqyYn @hintikka did you see the "Universal NLP Machine" paper/thoughts by any chance? Gonna try out the new Chef Watson... to be continued. :) RT @boldingbroke: Recursive neural tensor networks http://t.co/D0un7VRpjy Can they learn logical reasoning? #NLP #Stanford #Linguistics @hintikka same! @hintikka haha well actually my point was I enjoy both in their own right...but yeah, keep it up :) @hintikka I like the mix :) RT @RikerGoogling: how to throw a surprise party for a betazoid Will be v interesting to see how @erichorvitz et al.'s ideas on privacy find their way into Cortana v Google Now, + how strongly users care. Would have to know more 2 say 4 sure but sounds like @erichorvitz et al. are taking Google Now head on + have a shot: http://t.co/hDXiX6rAno Cortana spreading across platforms could be huge for Microsoft going forward in terms of competing hard in the AI market with Google + IBM. One reason I don't like the loose use of the word "robot" to include all of AI is that that means we soon have to call ~ everything a robot. RT @elonmusk: To be clear, Tesla is strongly in favor of people being allowed to drive their cars and always will be. Hopefully, that is ob… RT @elonmusk: However, when self-driving cars become safer than human-driven cars, the public may outlaw the latter. Hopefully not. RT @johnplattml: Google crushes Labeled Faces in the Wild with #deeplearning and ranking (triplet) loss http://t.co/H3QiNFRr20 Things are coming together for a workshop at ASU next month on solar soft cost reduction opportunities. Get in touch ASAP if interested!! :) @Aelkus yeah it is often lame/old but that is true of punditry across the board :) @Aelkus ehh sometimes it is correct. It is silly when the conversation is old, less so if it is actually a novel point/topic RT @ilparone: "create machines that are... not prone to human failings like racism, fear, and the adrenaline rush" http://t.co/wE5bcQMiGr #… RT @DARPA: VIDEO: DARPA Director Arati Prabhakar wants to talk #robots & ethics with high school students. https://t.co/aNVoiIzmS4 #DARPADRC RT @Savioke: Good read RT @FetchRobotics: Thinking About Chappie and the Future of Moral Machines via @Slate http://t.co/UnWh7TPfrl #roboti… @katypearce They should be! Love the show :) @vsiv could you DM me your email? @vsiv @TerynNorris K, I'll dig it up when I get home. RT @grok_: That "Stop the Robots" protest at SXSW? A viral marketing stunt for a dating app. https://t.co/BNyQM8dFhd via @PeterAsaro RT @karpathy: Deep Learning is Everywhere at GTC. Interesting to see it go from fringe research to GTC main theme so fast. 5K ppl learning … @zeynep I just try to learn from it and bite my tongue ;) @TerynNorris @vsiv on ambitious energy targets is laughable. Wrote paper on the history of their nuke targets once, could dig it up.. (2/2) @TerynNorris @vsiv great stuff! 2 pts: CSP w/ storage largely addresses the intermittency issue (tho still pricy); + their track record(1/2) @susie_c what's an example? RT @declanm: via @RecentApp: The Real Robot-Ethics Questions Behind Chappie http://t.co/VOBPO5e6dd http://t.co/5qMXAPX6Jb RT @FetchRobotics: Thinking About Chappie and the Future of Moral Machines via @Slate http://t.co/9VDq5H9zPT #robotics RT @j_winterton: Had so much fun writing this @FutureTenseNow article on robot ethics with the marvelous @Miles_Brundage ! http://t.co/JkQ7… @j_winterton and I wrote some stuff on Chappie, machine ethics, etc.: http://t.co/Y0KgKQC8no @GaryMarcus RT @FutureTenseNow: Chappie and police use of military technology http://t.co/JMmNdPH87e by @Miles_Brundage and @j_winterton RT @mjntendency: some second thoughts/concerns from the authors of a widely cited 2010 study of Mechanical Turk workers https://t.co/Qb421F… RT @monkeycageblog: A very deep dive into the Obama administration's record on transparency: http://t.co/9v9DKLLrQC tl;dr It's mixed. A year or so ago I dabbled in Lua, but never actually got good at it...now DeepMind's open source code is in Lua. Fail. may revisit now. :) RT @VanJones68: Pls RT! Join the conversation about what #yeswecode + @facebook are doing 2 grow diversity in tech ACC/BallroomD @5pm #sxsw RT @CSPO_ASU: The “Second Place” Problem: Assistive Technology in Sports and (Re) Constructing Normal http://t.co/av0YYMVlhC by Denise Bake… RT @David_G_Rand: Graphical summary of our review on promoting real-world cooperation. PDF: http://t.co/aTIpDwXvB8 http://t.co/Qz9h6sUAyA @rcalo @KatBorlongan this suggests otherwise: http://t.co/Ns4Q8v4pxF (?) @pmarca @syhw @sama or every recent AAAI President... @pmarca @syhw @sama if current AI expertise were = to future AI expertise (it isn't), then you could skip that and listen to Stuart Russell. @alexjc haven't watched yet but not surprised to hear that. I could not stop tweeting cool ideas from his AAAI 15 talk. @Aelkus ...then again, new vulnerabilities are rising, too, but they're hard to analyze/strategize about for anyone, inc. terrorists. @Aelkus ...or if you don't know how :) Sure, some terrorists can learn some relevant skills but the bar to break stuff is steadily rising... @Aelkus for the near future... long term, I could imagine all sorts of other uses by them/others, though we should try to stop war by then. @beaucronin *and about way more than discrete gadgets/tech. It's more about their social implications, which we have hardly fully faced yet. @beaucronin besides, sci-fi is about way more than the future. It's about the past, present, and the possible :) @beaucronin some truth to it but overly strong wording. Not all sci-fi stuff is here or even remotely close, and we will think of new stuff. @sarahjeong tap with something hard around all the edges of the lid +of tightly coupled AI/robots is steadily being built + will necessarily be "deranged" bc diverse human values. Arg fails but interestingly. Silicon Psychosis by Simons (1989) makes a surprisingly rigorous and historically/conceptually interesting case that a global scale network+ Kim's (1990) theory of intelligent systems synthesis/analysis is helpful but ~ad hoc. Need to reconcile w/ e.g. Legg's more compact theory. "Men who know they're machines should be [better able to solve their problems] than machines that think they're Men." Dean Wooldridge, 1968. "RT @JustinWolfers: A striking summary of the state of American inequality. http://t.co/GU4OpjDg8V http://t.co/YkTbjMAd2q" The AI meta-control problem: how to govern (democratically? technocratically? etc.) the socio-technical processes of AI safety and ethics. Rosenbloom's book On Computing: The Fourth Great Scientific Domain is interesting so far. An ambitious effort to (re)-theorize computing. RT @drfeifei: Future of border control: parallelized doc check by individual drones carrying smart vision tech. http://t.co/JVg5Fa3QPv The key contributions of the PNAS Visual Turing Test paper IMO are its incremental/scalable nature and the clever use of binary Q's/A's. @XiXiDu not really sure the state of the technology justifies this sort of optimism. Many, many new ways to game it will arise. @GrumplessGrinch yeah, that's what I really object to - the sound of it. Just screams amateurism. Michael Bowling (who knows a thing or two about these things: http://t.co/C5CBVVUecc) told me human Go supremacy won't last 5 yrs. Thoughts? @GrumplessGrinch I used it in a paper once, and felt bad about it because I hate the term :) @GrumplessGrinch AFAIK few outside MIRI ever used that term, so I think this is natural/a result of the diversification of the community. Follow up to last tweet: "A Polynomial-time Algorithm for Constructing k-Maintainable Policies," Baral et al. 2004: http://t.co/HoN8jGbEGR "Maintainability: a weaker stabilizability like notion for high level control," Nakamura et al 2000: https://t.co/cpdSDGCR9E "Visual common-sense for scene understanding using perception, semantic parsing and reasoning," Aditya et al. 2015: http://t.co/V65JTj0M0L Reading a bunch of Chitta Baral's publications...some very cool stuff lately on NLP, ASP, common sense, vision, etc.: http://t.co/NFK4WKvtQ3 RT @AutomatonBlog: For China's Alibaba, the Magic Word Is "Connected Car" http://t.co/aBCLBOA5Vv Here is the latest slide deck summarizing my vision for a startup, TeraSolar: http://t.co/zwaoWtIa8s Let me know what you think! :) RT @mark_riedl: New York Times article on robot journalists http://t.co/xyobhWHbLH RT @MarcusFrei_: Tony Stark, AKA "Robot" [Great, was it the real @RobertDowneyJr ;-] deliv Workin Iron Man Robot Arm to 7-Year-Old Boy http… "+ why, with some human inputs on the relationship, content, tone, etc. you couldn't make decent* ones w/ AI. *human-like. Not nec. ethical." What makes thank you notes harder to automate in some ways than e.g. news stories is the diversity of styles/content, but I see no reason + "New DeepMind paper*: Recurrent Neural Networks for Iterative Human-Machine Thank You Note Generation. *not... just saying it's plausible :)" There are all sorts of legit uses of robot hand writing, but why thank you notes? And the naivety re: content? Latter can be automated, too. The logic used to justify this "hand written" note-writing robot is bonkers. Have these people not seen Her? http://t.co/9SJy1kuMni @jon_jeckell would like to hear more! :) "Visual Turing test for computer vision systems," Geman et al. 2015 (PDF): http://t.co/Zqvn1zPuSS @beaucronin FWIW tho I think the RTs aren't endorsement thing is also a bit much ;) @beaucronin andddd I think I get your joke now, lol. Anyway.. @beaucronin which I totally get the need for, less clear on the generic version... @beaucronin it was a Q, really, I don't have strong opinions. Have used the funding variation of that ("doesn't nec reflect NSF's...") b4+ "RT @AutomatonBlog: AI Researchers Propose a Machine Vision Turing Test http://t.co/XXZMEuryXX http://t.co/SxZMnaMipZ" @KatjaGrace as stated, I'd recommend #2, if that were the only action I could ever take ;) Else, focus on making ppl less anti-ugly kids. Is there really a need for those "all remaining errors are my own" sentences in acknowledgments sections? Why isn't that understood? @sarahjeong @kashhill nailed it "Online Monte Carlo Counterfactual Regret Minimization for Search in Imperfect Information Games," Lisy et al. 2015: http://t.co/o0yJKgZzCm @jon_jeckell just got your email on Linkedin :) sending you some stuff shortly. @jon_jeckell dunno what your physical location/schedule etc. are like at the moment, but def. still looking for participants in the workshop @jon_jeckell thanks! Well, I mentioned the workshop which is related, so thoughts on doing that well are welcome :) can send slides too (?) Been quieter than usual on here lately cuz busy thinking through a company I will co-found, tentatively called TeraSolar. To be continued :) IBM does Q+A, but so far tailored to specific applications. Do they have anything in the pipeline competitive w/ general purpose search/Q+A? Lots of people talk about a market shift from, roughly, search-->interactive search-->Q+A, but who can deliver? Google and Microsoft up top. Think I mentioned this before, but this book is very readable + helpful for thinking through possible business models http://t.co/CN8fNt0n5k Abandah et al. "Automatic diacritization of Arabic text using recurrent neural networks," (TL;DR, RNNs help a lot): http://t.co/mVOXRJcNJp @zookae yeah I think it will be most beneficial for e.g. grad students with an interest in trying out/moving into DL and/or RL/deep RL. @zookae no prob! surprised more ppl aren't flipping out about that haha I would have run it already but just a pain with dependencies etc. @zookae oh and it has source code :) in the online version at least @zookae Human Level Control Through Deep Reinforcement Learning. Contextualized 2013 deep RL paper more, has human vs AI test results. @zookae *in Atari* that is. Lots of unsolved problems still apparently, eg see Montezuma's Revenge score in Nature paper :) @zookae yep -interesting tho to note at 2015 game playing workshop, lots of talk of "deep partial observability" and "deeply delayed reward" @zookae they definitely *value* moving forward in game time, just only as one means of stimulating AI progress, among others. @zookae yeah, it isn't that they disagree, they are just troubled by persistent failures in even simple games, so don't seem in a rush.. @dmarthal yeah I don't think deep RL is or should be applied without change to the real world, but could be part of the solution. Lots of ppl at DM definitely care abt games as testbed, I just overestimated their desire to move fwd in time. Want to master Atari etc 1st. by their remaining failures in some Atari games, and overestimated how much they care abt games. More likely: IRL robot learning demo. (2/2) When I said DeepMind would demonstrate learning in a bunch of ~2000 era games by end of 2016, I underestimated how troubled DM ppl (1/2) Keynote speakers at the Conference on Governance of Emerging Tech (Ibid) include Jonathan Moreno (UPenn) and Mustafa Suleyman (DeepMind). Registration for the 3rd Conference on Governance of Emerging Technologies is now open - May 26-28, in AZ: http://t.co/BB1uD7G5aP Kim (1990) defining knowledge, information, and data. He defines a LOT of stuff in this book :) http://t.co/7OsNc9oMxE Will incorporate a lot of Kim's stuff in the next version of my working paper on AI progress. Should enrich the narrative/lens a lot. What strikes me about Kim's general theory of intelligent systems synthesis/analysis is how general it is, + how no one knows about it. :) Kim's Designing Intelligence (1990) has a lot of richness. E.g. "effectiveness" breaks down to performance, versatility, reliability, etc... "Examples of the factors of intelligence" from Kim's (1990) general theory of intelligent systems synthesis/analysis http://t.co/IkVVPl57Ul Many companies talk a big human-machine symbiosis game. What I am referring to is it being cashed out in reality, e.g. human-robot teamwork. One key variable of the next five years of jobs is the extent to which industry runs w/ human-machine symbiosis. If so, huge (+/-) impacts. RT @ARPAE: Today, @ENERGY Secretary @ErnestMoniz presented @ARPAE Deputy Director Cheryl Martin w/ the Exceptional Service Award http://t.c… @edenfull Thanks!! :) @badnetworker no. @jon_jeckell yeah, to be clear, I do not think we can't say anything useful about 5 years from now, just a matter of what level of detail :) "My hunch on the Baidu automatobile* is that it is a serious effort and could have a big impact in the Chinese market. *Asimov" Increasingly appreciating the extent to which no one really knows what is plausible even *5 years* from now re: AI/bots' job impacts. Key Q. RT @ericoguizzo: China's Search Giant Baidu Plans To Build a Robocar http://t.co/9uwd2LI8RL via @IEEESpectrum RT @BotJunkie: On Automaton: China's Search Giant Baidu Plans To Build a Robocar http://t.co/EFIXhg1OME #robotics Really enjoyed chatting with @edenfull earlier about solar, entrepreneurship, etc. :) She is doing some really cool stuff! RT @MatthewGombolay: At #hri2015, @AntonioBicchi showed off his lab's latest in developing a robot hand. Check out the impressive video: ht… People are wowed by PV hard cost drops for obvious reasons, but IMO it isn't obvious we aren't also entering a big CSP era post-Solana etc. Shift in opinion I'm noticing on PV vs CSP since 2012 seems mostly related to PV hard cost drops - but CSP storage proven in same time. Hmm. @jon_jeckell yeah the tide shifted a lot since the early 2000's. People seemed way more mixed then. RT @karpathy: Very nice and long reddit AMA with Jürgen Schmidhuber. Lots of RNN and AI food for thought http://t.co/9qcKsn6xhY @soundbitelife personally I think they both have benefits now, future unclear, + PV-CSP hybrid could be awesome, not quite there yet tho :) @soundbitelife mainly current/recent total costs per watt. +not everyone as jazzed abt storage. We were mainly just talking utility scale. @Aelkus see: Lempert et al 2003, Shaping the Next 100 Years, for great discussion of this. Ran into lots of CSP skepticism in Bay Area...nothing new, but noteworthy that many think PV>CSP is foregone conclusion. I'm more tentative. @merylalper good luck!! :) Ursula Le Guin is amazing. Based on The Lathe of Heaven and The Dispossessed, now one of my fave sci-fi authors, up there w Asimov, Atwood.. "RT @beaucronin: Chappie is, well, crappy. But you should still see it, just for the haircuts - they're amazing." RT @katypearce: Open Letter to Kid Rock - Stop Using 'Gay' As a Pejorative - http://t.co/NN7mSGuR9c In the process of thinking through the scope/invitees for a workshop on solar soft costs in April/May. Pls get in touch if interested. :-) Just had an epic chat with @beaucronin on AI, VR, AR, entrepreneurship, etc. Fun end to a fun Bay Area trip. :) I basically agree with @elonmusk on hydrogen fuel cells. Many cons, pros will soon be obsolete or at least less relevant given EV progress. "Determining the Optimal Speed of Financial Markets" - Fricke/Gerig 2015. TL;DR high speed trading probably too fast: http://t.co/Bqa9NUdrtI RT @williamstome: Robot at #HRI2015 tellin' jokes and pickin' up socks. http://t.co/l0SXWxLvDJ EPIC chat with Arun Majumdar on solar, AI, robotics, etc. Many ideas cooking on this trip. :) Also, Stanford's campus is ridiculously nice. Enjoyed visiting @MIRIBerkeley and chatting with @lukeprog and @KatjaGrace earlier. :) @williamstome yup! well, a few eps - intend to watch the rest soon :) @williamstome yes, you should. :) Haven't read Robogenesis yet but liked Robopocalypse a lot. Was talking last night abt the killer cars :) RT @pj_mukh: @Savioke's robot room service starting to gain traction. youtuber documents experience! https://t.co/Sl8D8LxniU #thisishowitst… Had a great time catching up with old friends/colleagues from ARPA-E earlier. :) RT @chr1sa: Gave a tour to 14yo boys & showed them how to skywrite with a drone. Checked mission logs and sure enuf: penis http://t.co/deL… RT @michaelcrow: .@UIAinnovation is dedicated to innovative collaboration that improves access to #highered and degree completion. http://t… (cont'd)...then again, I don't know who needs to know all these terms and isn't already involved in such things, so dunno market for book.. Flipped through "Dog Whistles, Walk-Backs, & Washington Handshakes" - seems like it'd be a useful book for those unfamiliar w/ DC language. Cell reception in general is way better in the Bay Area than most places. Shouldn't be surprising, I guess... Totally get why rich techies love living in the Bay Area now...and why it's ridiculously overpriced for everyone else. Interesting place. @Aelkus FWIW tho I consider that EXTREMELY unlikely. Think she knew it was wrong. @Aelkus if she didn't know it it is because she surrounds herself with yes people/sycophants, not bc it isn't well known. @Aelkus seems like what she did is what everyone I know in govt knew they werent allowed to do. @Aelkus FWIW maybe it is different in State vs elsewhere but in DOE and WH when i was there - noooo tolerance for that, period. @Aelkus in general though it is super frowned upon and she must have known that. @Aelkus well first of all I am talking about commonality in private, but yes i know some ppl have done it - sometimes with reason. @Aelkus maybe routine in the sense that it happens way more often than is reported, of course, but it is def NOT considered OK by anyone.. @Aelkus and no one who did that who wasn't sketchy. @Aelkus that is NOT the case if I take u to mean using private emails for official purposes. I have worked with cabinet level ppl who didnt. @Aelkus (I am referring mainly to political accountability/transparency considerations, not infosec - former is main reason 4 these rules). @Aelkus was impressed upon me many times as a political appointee that that is NOT OK. And again in election seasons. She must have known. RT @RichardSocher: https://t.co/Vxh8h4paya -- Registration just opened for the Deep Learning Summer school! RT @ylecun: New Scientist has an article about a recent article by FAIR scientists Jason Weston, Antoine Bordes, Sumit... http://t.co/brDL7… @FrankPasquale interesting that many outside AI focus on consciousness and most in AI consider it a non-issue with respect to x-risk... Thinking I'll do a deep dive on NLP this year...details TBD but mainly want to wrap head around state of art, rate of prog, + role of NNs. RT @ellenhuet: .@sandwich's Adam Lisagor already makes tech's favorite startup launch videos. Now he's launching a venture fund: http://t.c… In Berkeley for the first time...pretty cool :) @Aelkus also raises Q- what is optimal time spent crafting features? if many defined (troops) I'd focus on deep RL for abstract features.. @Aelkus don't see any reason deep RL couldn't help with both of those, but depending on graphics, level(s), etc., the depth may be >/< impt. @Aelkus ....don't know enough about RTS to comment on the last of those variables tho... @Aelkus hmm, so the questions are role of hand crafted vs learned features, CPU/GPU time, levels/domains which would most benefit, etc... @Aelkus well not the same way (full game sim) but def at various levels I think ... @Aelkus (Lua) @Aelkus played with the DeepMind Nature source code? @dandrezner someone surely did - probably many people at many points. RT @cnnbrk: Hillary Clinton used personal email account rather than official account while she was Sec. of State, official says. http://t.c… @rcalo @hartzog in particular, would love to hear thoughts on how to deal with assistive robots being taken away poststudy @MatthewGombolay Looking forward to reading Trouble on Triton, The Dispossessed, Woman at the Edge of Time, etc. for my utopianism class. <3 required sci-fi @Aelkus ditto for climate, energy, etc. One key is moving beyond he said she said. As I mentioned b4, "real AI person says X" =~ unhelpful. @Aelkus ah anyway we should talk more about this bc I think Musk glass is half full etc but actually need to sleep @Aelkus Vice? @Aelkus certainly not what I or anyone sensible advocates... @Aelkus I have a more glass half full take on the media situation, eg FLI coverage not ALL bad, but going to bed, to be continued... @Aelkus many people say many things I consider constructive.. my request is ppl say who/what exactly they are disagreeing w when they so it. @Aelkus but even if one wants to play that game, plenty of ppl w/ AI cred disagree with him on many pts. exact reason why unclear tho. (2/2) @Aelkus I really get annoyed by the "person who actually works on X says Y!" trope here. See: climate. There is expert for everything (1/2) @Aelkus dunno what you mean by loud exactly but what about e.g. the FLI open letter? or Superintelligence? @Aelkus not clear he is responding to anything but the vaguest of concerns about AI here - e.g. the sentience thing, "turning evil," etc... Le Guin's book The Lathe of Heaven is amazing. Impression of 12 Monkeys (show) based on first episode: long, TV version, slightly worse version of the movie, which is fine. :) some diffs. Petrov on House of Cards looks like an evil Elon Musk. @yksnpnwrbrhsa meh. That isn't my sense. Many people are dumb, though... House of Cards gets a subset of ruthless DC people right, but overstates their ubiquity there - also totally lacks young people, =big in DC. Seth from House of Cards looks/is like an evil Saul Goodman. Here's the aforementioned DeepMind deep reinforcement learning source code: https://t.co/PyA7Tlm1rs RT @gigaom: Google & SolarCity partner on largest fund ever for residential solar http://t.co/wf4G4TVSXv http://t.co/Aa8yDC7sbV Take back what I said before: the new DeepMind paper isn't just good for open source stuff...it HAS open source stuff included in it! :) Last I checked, people doing open source deep reinforcement learning for ALE a la DeepMind were unsure what hyperparameters, etc. DM used. The new DeepMind paper, "Human-level control through deep reinforcement learning," is a boon for DQN reverse engineering (esp. appendices). Dunno why it's a thing for people to say "cyborg" when they mean a humanoid robot. "Android" is also used ambiguously a lot. Annoying. RT @PolarisPoker: Congrats to our friends at DeepMind on their Atari result, published today in Nature! http://t.co/YjwhMwAozo ICYMI - cool semantic parser by Baral et al.: http://t.co/0pCoOeaCNf RT @j2bryson: Finally updated my #AI ethics page to make it clearer: what we shouldn't worry about, and what we should http://t.co/xFWe5e0O… It's a lot easier to come up with clever titles for class papers than non-class papers - only one person to worry abt impressing/offending. One key to anticipating AI progress is understanding past/present AI research at many levels (institutionally, empirically, conceptually..). "Then why do you love me so dearly?" - Larry, Sam Adam's husband on Caprica. "Cuz I got issues." - Sam. RT @sgaudin: Check out this Japanese RoboBear -- a machine with strength of a #robot and face of a cute bear. http://t.co/q5BiOdFdig #robot… RT @gregorydjohnsen: Turns out being a dictator is good money: Ali Abdullah Salih worth a reported $60 Billion http://t.co/LsU9PDtrsc (repo… RT @amcafee: Why Should We Care About Rising Inequality? http://t.co/M0LlUMc7r5 #2MA Will be in the Bay Area from Tuesday through Friday next week. Let me know if you wanna meet up! Still have a few hours not spoken for. :) RT @SethBaum: My new @BulletinAtomic column: Stopping killer robots and other future threats, on @BanKillerRobots & more http://t.co/ePvDZI… RT @sfiscience: New paper by Luis Bettencourt and Scott Ortman: urban scaling laws held throughout human history http://t.co/cm9whuvGLI Enjoying finally reading Fredric Jameson's stuff for class, e.g. The Political Unconscious + Archaeologies of the Future. Fascinating stuff. @sarahjeong feel that way whenever sports come up on Twitter. @Brett_Fujioka IG* @Brett_Fujioka haven't seen said speech...but yeah regardless I agree IT was problematic on many levels. @Brett_Fujioka so do you overall think the movie was harmful or just some aspects? @Brett_Fujioka yeah, agreed. Was just pushing back on the "most" (people based their perceptions etc.) thing viz-a-viz size of that group. @Brett_Fujioka take it it won an award? @Brett_Fujioka don't know what you mean by the New Yorker (I guess there was a big piece on it)? Still, few read that... @Brett_Fujioka yup. Not watching the Oscars, though, so you're not talking to me, prob., haha. @Brett_Fujioka Very few people in the big scheme of things saw it, if I had to guess... Like, 5% or less? More than saw it influenced, tho.. @rcalo or a competent/respected/big OSTP :) "RT @vardi: Please share - Summer School on Software Synthesis, June 23-26, 2015 Venue: MIT, Cambridge, USA https://t.co/xKTS9rgkHk" Cool/impressive/user-friendly demo of Knowledge Parser http://t.co/0pCoOeaCNf part of the NL2KR system (Baral et al.) http://t.co/s8h5BfSuoo Nice meeting earlier with Chitta Baral and others on the future of AI, ethics, etc. Baral has lots of cool papers: http://t.co/Q8wyp3neJC On last RT: I enjoy sending/receiving emails and don't experience such things as "emotional labor," but apparently others do. Hmmm! RT @nathanjurgenson: "click on the smiley face after composing an email in Gmail to brighten up the mood of the letter" https://t.co/9DyQRA… Great lecture by Jennifer Senior on her book, All Joy and No Fun: The Paradox of Modern Parenthood: https://t.co/6YclyglGam Great feedback from Ran Fu of NREL on near term PV soft cost issues...interesting how advanced solar modeling/market analysis is vs e.g. AI. @Brett_Fujioka isn't that kind of true of people in general? What makes them different is that plus being vocal/confident/ppl listening...? Reading Kitch for feminism-focused session of utopianism class but definitely also lots of stuff relevant to other justice-related debates. While noting her hesitations with the term "realism," Kitch prefers such an attitude to social change over (feminist) utopianism writ large. Kitch distinguishes specific utopias/utopists from utopianism, a more general pattern of thought she considers harmful to feminism/justice. Enjoying Kitch's Higher Ground: From Utopianism to Realism in American Feminist Thought and Theory. Recommend to ppl into that sorta stuff. On CSP overtaking PV in installation in the next 5-10 years: depends on progress on non-molten salt storage and myriad CSP costs reductions. Basically everyone agrees PV module costs are plateauing - big questions are which soft costs to prioritize near term + if CSP can overtake. RT @alan_winfield: New blog post: Surgical micro-robot swarms: science fiction, or realistic prospect? http://t.co/U83aG4dijC RT @GCRInstitute: GCRI announces major changes. We will focus on research on how to best reduce global catastrophic risk. http://t.co/vjsQ4… RT @MIRIBerkeley: 12 days remain to submit an initial proposal to @FLIxrisk to study AI's long-term impact. Example questions (pdf): http:/… RT @karpathy: "DRAW: A Recurrent Neural Network For Image Generation" from DeepMind http://t.co/DdaF37HxNm and video of generation https://… @ellenhuet Chimera RT @ericoguizzo: DNA Data Storage Just Got a Bit More Practical http://t.co/AIJ32UGc4A via @IEEESpectrum Molten salt storage=basically the new normal for solar thermal, but power tower, parabolic trough, Fresnel, dish, hybrid, etc. up for grabs. Flew over the Ivanpah solar plant the other day...very cool/impressive/interesting, though I am still unsure about power towers vs. troughs. @Aelkus likewise for natural/social sciences. @williamstome indeed! I hope to play with them myself someday :) @mackaymiller dunno bout exactly but it can help! This paper on such things in Africa raises relevant issues IMO - http://t.co/CtYfiQSUta RT @KatjaGrace: Superintelligence reading group 23: coherent extrapolated volition http://t.co/JJRWJhtZ7v Pepper delay (last RT) isn't surprising given all that Watson stuff and the general difficulty of the goals they've set for themselves, etc. RT @RobotLaunch: .@Robohub Pepper delayed until summer - Softbank announced a delay in sales of their Pepper robot to the public fr... http… Will be very interesting to see how and how quickly human computation methods are integrated with machine learning, esp. RL, deep nets, etc. RT @ylecun: In 2013, I made a bet with my friend Larry Jackel that by 2023 your smartphone will be able to drive your car.... http://t.co/D… @robinhanson ...issue isn't so much work or leisure being bad/good but that people should have control over their lives/balance btwn 2.(2/2) @robinhanson personally my preference is blending work/leisure - seems like many ems/others might want to, too? To me, the ethical... (1/2) In five years, swarm robotics, perception, navigation, etc. will make drones way more suitable for deliveries. Not sure about regs timeline? Speaking of drones, I'm way more bullish on near-term (5 years) drone use for deliveries than I was pre-AAAI. Lots of progress on key techs. @jon_jeckell @faineg now if it became hot issue locally, sure. But my sense is that hasn't happened enough to influence pol decisions much. @jon_jeckell @faineg in theory...In practice pols routinely have different, more expert-ish views on this stuff cuz lobbying/advisors etc. @jon_jeckell @faineg maybe some Congresspeople feel that way but suspect most have less extreme views. @jon_jeckell @faineg yup! def not denying that. Just was emphasizing it isn't a real position in expert/policy circles, that's all :) @jon_jeckell @faineg stand by what I said :) those aren't very informed opinions. Not a viable proposal. Like anti-vaccine stuff. @jon_jeckell no one serious advocates that...? @rcalo what about nano/under an ounce etc? ;) RT @PsychScientists: On image classification by ~.5% RT @gigaom: Microsoft's new computer vision system can outperform humans http://t.co/c… RT @etzioni: Bank Hackers Steal hundreds of Millions via Malware http://t.co/mLR13shvYr Cooking up lots of stuff related to solar, AI, robotics, human-machine symbiosis, etc... to be continued soon :-) @katypearce no prob, hope it is at least somewhat interesting/helpful :) @katypearce maybe not interpreting what you mean by mediated enviros correctly... but anyway, those looked cool to me/good samples :) @katypearce hmm some stuff you might like - http://t.co/ruyUWUOPn4 + http://t.co/YkAQhqs0an @katypearce dunno what exactly you have in mind but lots of cool/interesting stuff on taste and class in the leisure studies literature! :) Seems like many folks agree people should be worrying about the intersection of AI and cybersecurity, specifically smart viruses. Who is? :) @hannahgais lol @maidylm many thanks! :) Enjoyed chatting with Lydia Manikonda @maidylm earlier about her research, human-machine teamwork, etc. She is up to some very cool stuff :) @gsvoss @katelosse asking in part as someone who wants to found an actually-mission-oriented/justly run startup :) @gsvoss @katelosse ...also seem to recall he put startups near but not quite to cults on a spectrum. Key diff (in good startup)= >1 leader? @gsvoss @katelosse great stuff! Need a startup be centered on 1 person, tho? Thiel also emphasizes teams in book. Culty teams, but still :) RT @lawyerologist: Elon Musk says Tesla will unveil a new kind of battery to power your home #lawyerology http://t.co/FXShsd0Ddu RT @TlkngMchns: Ep 4 is up! we talk with @hannawallach, tackle a q about scalability, and learn about Latent Dirichlet allocation http://t.… This one's a doozy (in a good way): "A Review of Real-Time Strategy Game AI," Robertson and Watson, AI Magazine: https://t.co/QFkdzUdEk5 Will hopefully finish Roper et al.'s super interesting "Forecasting and Management of Technology," 2nd ed, tomorrow. :) More on that soon... RT @therobotreport: #Robotics research forecasts article updated to incl ABI Research report on #homecare #robots: http://t.co/iYbvLp1ep2 @arthurhcyip regardless, I am a huge EV fan. Haven't yet seen evidence I should take fuel cells seriously but would be nice! :) @arthurhcyip ...perhaps the term is usually used appropriately, I dunno. if extrapolating from "clean coal"...seems unlikely :) @arthurhcyip yep but that isn't zero. I don't care much but just generally dislike "zero" talk - evokes false tech solutionism to me... @arthurhcyip @JesseJenkins @atrembath doesn't rile me up actually, I just don't *like* it. Bigger fish to fry like dumb anti-solar args :) @arthurhcyip @JesseJenkins @atrembath right, but even there it often has emissions, just not CO2... hardly my pet peeve, but you asked ;-) On last RT: Cepheus is interesting to play/get owned by. I beat its cousin Tartanian7 at AAAI...for a few hands. Then it called a big bluff. RT @PolarisPoker: The lineup to play #cepheus is now pretty reasonable, and not at the cap of 50, so you can wait for a turn to play: http:… RT @iGEASmit: Watson Goes to Japan « A Smarter Planet Blog A Smarter Planet Blog http://t.co/95soqM1TXd Lots of potential for hybrid PV/CSP systems but will take at least a few years to be competitive on just cost with more mainstream designs. @arthurhcyip @JesseJenkins @atrembath yes :) just don't see the need for such language. "EV" works..."solar" works..."low carbon"..etc. :) "RT @CSPO_ASU: RT @RogerPielkeJr: What is the ""most fundamental science policy question""? Here is @CSPO_ASU Dan Sarewitz's view: http://t.co…" RT @oxmartinschool: Garry Kasparov talking about Stephen Hawking and @elonmusk's recent AI warning. http://t.co/nJqsMpbZQT Interesting thing about the cement plant I visited/cement industry in general: they can use both nat gas and coal depending on what's cheap. My impression from visiting a cement plant is that the challenge of reducing carbon emissions there is non-trivial. Needs lots of R+D, prob. Would love to see more folks talking about/working on addressing carbon emissions related to heavy manufacturing and cement in particular. @arthurhcyip @JesseJenkins @atrembath *some @arthurhcyip @JesseJenkins @atrembath just think in general ppl are cavalier about "low/zero carbon" terms :) dome def way lower than others @arthurhcyip @JesseJenkins @atrembath ... is 0-carbon. If used to dismiss/justify source, problematic. But non-zeroness implies CDR urgency. @arthurhcyip @JesseJenkins @atrembath don't know the authors in question but to me the key is what you do w/ the fact that nukes/nothing... RT @DefTechPat: Military Looking To Give Troops Super Sensing Abilities http://t.co/URmS7fxOxH My latst for @defenseone RT @ARPAE: Only at #ARPAE15 can you find panels on everything from state-level #innovation to investor IP strategy to wide band-gap technol… RT @sabinehauert: UAE launches “Robotics for Good” competition on the heals of Drones for Good success http://t.co/ZDwsfbkLbQ @JesseJenkins @atrembath do very much agree with the points :) @JesseJenkins @atrembath orders of magnitude lower carbon, yes. But not zero, makes need for ambient carbon capture stronger. @JesseJenkins @atrembath would also be foolish to think anything will be zero carbon anytime soon ;) couldn't resist haha dislike the term.. RT @danielaphd: Killer robots aren't the #AI we should fear. AI is still pretty dumb. This is what should keep you up at night: http://t.co… ICYMI Google/Boston Dynamics's new robot Spot, successor to Big Dog, etc.: https://t.co/mhxXvSHMgU Boston Dynamics's Spot (which is v. impressive/cool/interesting/scary/etc. btw :) ) reminds me of bots in @danielwilsonpdx's Robopocalypse. RT @katypearce: Black and Latina women scientists sometimes mistaken for janitors - The Washington Post - http://t.co/idYZSIS1nu sigh @cthorm curious how the use of molten salt varies here vs in solar thermal.. "First Steps in Going from [Watson] DeepQA to DynamicQA," Govindararajulu et al. (lecture): http://t.co/vQnQ7D0mNO @nerdsrocket only mildly enjoyed Breaking Bad the first time, but in subsequent watchings, loved it. Liked BCS the first time this time. :) RT @peterxing: "​IBM, Softbank partner on cognitive computing: Watson, meet Pepper | ZDNet" http://t.co/SJ4j1lTPyo @knewscript @AliMattu @zeustoves @nerdsrocket multiple folks have told me Selma was a great movie. Still playing in some places.. @knewscript @AliMattu @zeustoves @nerdsrocket OK, not rushing to the theaters then :) Still need to see Selma, rewatch Interstellar etc.. "Life and business are about human connections ... and computers are about trying to murder you in a lake."- Michael Scott, The Office (US). @knewscript @zeustoves @nerdsrocket @AliMattu I want to see Jupiter Ascending :) @jathansadowski btw, reinterpreting what you said now in light of your FB post... thought you meant they got a Kinect. @jathansadowski e.g. laser data etc. Perhaps ambient speech to text is low hanging fruit. Anyway, covering up laptop cams more urgent IMO. @jathansadowski ...meant I haven't looked in detail at Kinect case. Generates many types of data, more than could be sold economically. @jathansadowski I say sketchy things all the time but don't care who/what hears ;) really though, yes I agree the data has value, just.. @jathansadowski ...broader point was just that it's always listening in order to be turned on by voice, in my case at least. @jathansadowski btw, I don't know for sure they sell voice data from ambient stuff, slash not sure what value it would have, but possible.. @jathansadowski well you can unplug it super easily if you want :) there are also various settings, depending on what it's plugged into.. @jathansadowski sounds like Kinect right now :) Looking forward to discussion of anarchism viz-a-viz utopianism(s) in class today... e.g. this essay by Emma Goldman: http://t.co/8u9aVQ7nZC @dmarthal less computationally intensive methods might work well and have better tradeoffs, just mentioning NNs cuz effective lately. @dmarthal of states and quantity evaluated. See e.g. Gelly et al "Grand challenge" paper. Neural nets work well but require many C/GPUs. @dmarthal those exist but I don't know best ones etc off top of head. Viz processing is key but tricky cuz tradeoff btwn rich evaluation + @dmarthal of played Go games you mean? there are such things...haven't used any myself. if you meant something else, dunno :) RT @Floridi: [take the leisure to read this] In Praise of Idleness By Bertrand Russell http://t.co/yKy6iLATnC [thanks to @matteoturilli] Human pro Go play (/future superhuman Go AI) "not as simple as a trade-off between exploitation-exploration or ... compressibility." - Ibid. Pro Go players take more of the global context into account and make unexpected local decisions as a result. Various implications. - Ibid. Go players going from amateur to professional become more predictable bc making fewer dumb local errors bc RL, then pros mix it up. - Ibid. "[C]hanging emphasis on local versus global context is expressed in how dependent the next move is on the stones ... played locally." Ibid. One of the coolest papers on Go I've read - "The Aggregate Complexity of Decisions in the Game of Go," Harre et al: http://t.co/8QXxkCPQxl There's a ridiculous amount of knowledge of Go heuristics, strategies, endgames, ko stuff, etc but non-trivial to integrate it in real-time. Go is a very interesting/difficult game. First time I played it, I was overwhelmed by the branching factor/tradeoffs...full board soon! :) Even for expert human Go players, there is no straightforward way to compare a few very good options with pros/cons over hundreds of moves. Another big problem with computer Go is the lack of good evaluation functions/heuristics etc. and tradeoff btwn detail + simulation quantity Human feedback is already part of top Go systems in some sense, e.g. learning from human experts' games, maybe needs to be more substantial. In Go, a move's full consequences may not be understood for hundreds of moves. Makes MCTS helpful but insufficient bc always miss something. As Gelly et al. 2012 argue, MCTS combines good aspects of minimax and Monte Carlo, but probabilistic methods also have/make vulnerabilities. Hand-coded rules/heuristics are nice in Go but hard to resolve conflicts/prioritize them. MCTS/NNs help but occasionally make huge mistakes. Hand-coded heuristics, domain knowledge, etc. were once successful in Go. Simulation-based methods are now better but may need synthesis. The Maddison et al. 2014 neural networks for Go move evaluation paper, for example, makes clear that more NN depth makes a HUGE difference. For people without much hardware to play with (i.e. most people not at big tech cos), MCTS/NNs hard to use to anywhere near their potential. Neural nets seem likely to supplant or at least supplement other pattern recognition methods in computer Go but require tons of C/GPU power. In light of the compute power-intensiveness of MCTS and neural nets, to the extent those are key for Go, Google et al. have big advantages. As with AI in general, though, "integration" is easier said than done... Hence "plausible" :-) One plausible scenario for rapid Go progress: integration of the best of human Go knowledge/heuristics/GOFAI with the best of NNs/MCTS/etc. Putting my last few tweets differently: simulation, self-play, MCTS, NNs, etc. great for Go but something else needed to get to superhuman. Novel (crowdsourced? expert?) human-in-the-loop methods for critiquing Go systems' proposed move evaluations could also accelerate progress. MCTS now well established as useful in Go (and elsewhere); NNs now super helpful for move evaluation; GOFAI/heuristics needed 4 full system. "AI-MIX: Using Automated Planning to Steer Human Workers Towards Better Crowdsourced Plans," @maidylm Manikonda et al http://t.co/7mB1FCV2PJ Computer Go can beat most humans; some pros still better tho. Combining NNs, MCTS, + domain knowledge seems likely to end that in few years. Found this helpful in understanding MCTS, rollouts, etc.: "The Grand Challenge of Computer Go," Gelly et al. 2012 - http://t.co/buFuz5jlO6 Reading a bunch of stuff on computer Go...very interesting recent history. ~2006= rise of Monte Carlo, ~now= return of neural networks. @arthurhcyip @ericbkennedy indeed I do :) "Value Iteration with Options and State Aggregation," Ciosek and Silver 2015: http://t.co/ki9H5RLB8r RT @Harvard: A safer, cheaper, and more energy-efficient process for removing greenhouse gas from power-plant emissions http://t.co/pJk4vZ6… RT @MargotKaminski: My thoughts on Kozinski's treaty references in Garcia v Google: http://t.co/ic8ToMSjk4 @YaleJREG @nmpanek You could write it! With or without using the same name :) RT @developerWorks: New Watson Services On IBM Bluemix: Speech To Text, Visual Recognition, Concept Insights, More #ibmwatson #bluemix http… RT @danielaphd: ROBOT SUPERCUT. Stop everything you're doing and watch this right now. http://t.co/X5cCvXXd2W brought to you by the awesome… @Aelkus I selfishly hope you will (continue?) prioritizing cognitive architecture stuff so you can tell me all about it someday ;-) @Aelkus yup... looks good, thanks! @Aelkus which one? I've read Smart Machines. Decent, lots of hype, you would only learn at meta-level, not object level from it. Zuckberg seems genuinely (if naively) interested in helping people w/ tech. but unclear what role AI plays in his vision exactly. ...some of that is rhetoric but some of it is also typical (extended) Silicon Valley attitudes on tech, entrepreneurship, etc. IBM, FB diff? Google leaders= clearly into achieving AI goals more or less as quickly as possible. Profit is obligatory but not their passion. IBM? Dunno. No doubt many at IBM and elsewhere are super focused on achieving the grand goals of AI, but how many with what resources/clout in company? DeepMind has a lot of diversity, as does Google as a whole, but if you compare DM deep RL+ vision to Watson, unclear if latter as ambitious. ...whereas with DeepMind, there is a ~clear and long-standing overarching vision driving their work + explicit exploration in pursuit of it. Subsets of Cognitive Computing and Watson are def. doing super interesting/ambitious stuff, but unclear how it relates to core Watson tech.. ... it still isn't clear to me if IBM has anything (Cognitive Computing group? Some subset of Watson?) super analogous to DeepMind. (2/2) In light of recent reading/conversations/thinking/etc., Google's overall AI ecosystem and IBM's are more similar than I thought, but.. (1/2) RT @IBMWatson: Learn more about Concept Insights, introduced today by #IBMWatson. Blog: http://t.co/8JwbRXsGrE Video: http://t.co/0T78IuZAnx RT @ARPAE: Don’t miss the biggest event in energy! Join us: http://t.co/0yZep6H4Sr #energy #innovation #ARPAE15 http://t.co/Cezst6M6xG Gotta do some serious reading on utopias, utopianism, sci-fi, etc. today for class... Super interesting/cool stuff, just a lot of it! :) Look forward to catching up with my old boss Arun Majumdar at Stanford soon - here's an epic talk by him on energy: https://t.co/L5kfbUAsi8 Looking forward to catching up with old colleagues, friends, etc. in the Bay Area soon. :) Basically only been to SF around there before. @williamstome Looking forward to it! :) Both Neural Turing Machines and Memory Networks have similar ideas behind them but perform different tasks, diff. strengths/weaknesses, etc. Weston et al. (Facebook), "Memory Networks," 2014. Related to Graves et al Neural Turing Machine, etc. but also diff: http://t.co/tH7zgaSJ4S Seems like the state of the art in open source deep RL is that it's pretty closeish to DeepMind-level performance, getting better gradually. Looks like there's been a lot of progress in the last year or so on various open source projects on deep reinforcement learning. Helpful. :) With some human reward/human-crafted models of world/etc., one needs less CPU/GPU time for fancy games. Useful for diff. research questions. Sidenote: when I say deep RL I am mostly referring to Deep Q-Networks (DQN)/the Atari paper but also the broader research program. Deep RL+. In theory you could semi-straighforwardly solve some early 90's+ games w/ model-free ML but would take vast computation. Need models 4 now. There's a bunch of stuff AI folks would like agents to learn automatically: value functions, policies, world model, etc. takes CPU/GPU time. The deep part in deep RL is about NNs which are getting easier to use, but RL part unclear: which rewards, at what level, human role, etc. Deep reinforcement learning for general game playing raises interesting Qs: optimal model richness, simulation runs, search algorithms, etc. Some of those research issues: probs learning from delayed reward w/ partial observability, simulator efficiency, deep RL, search algos etc. Put differently, DeepMind seems interested in the remaining research issues in ~fully automatically solving ~all Atari+ games b4 90s+ games. + I underestimated how focused on learning they are - don't care much about moving fwd in game time as long as probs in simple games. (2/2) In light of recent reading/conversations/etc., I've concluded my earlier bullishness about DeepMind game stuff was realistic but that (1/2) @JohnDanaher that whole series, yep. @JohnDanaher that too ;) @JohnDanaher there's a whole bunch on autonomy, preferences, etc. including Conly, dunno key words besides those..on Youtube. Looks like I'll be going to HRI this year and also visiting the Bay Area the same week (early March). :) @jon_jeckell do think his point was true: among other things, he was saying it is often posed as false choice, good policy options ignored. @jon_jeckell that's reasonable - just clarifying :) @jon_jeckell and imagine specific scenarios then I think he has various context-based things to say. I saw no signs he's dogmatic- opposite. @jon_jeckell if you define geoengineering narrowly...if you include carbon dioxide removal, testing before full scale, good governance, etc @jon_jeckell well, I had to leave early so missed end of Q+A/don't know this guy, but my impression was that that wasn't his point, at least @jon_jeckell yup, enjoyed a seminar of his on many of the same topics a long time ago :) Much of conversation still the same as then... @jon_jeckell but yes, there are challenges. I am more optimistic than most (with good reason--I think, of course, haha). @jon_jeckell He wasn't telling anyone to hold their breath... he has nuanced views on geoengineering research/testing/etc. RT @danieldewey: Go apply for a grant from Elon Musk & Max Tegmark to make artificial intelligence more robust and beneficial! http://t.co/… RT @LeoShane: Carter calls problem of sexual assault "widespread in (US) society but particularly offensive in the military ... we have to … @danielaphd think AI in general is super fast re: commercialization, but autonomous cars decades old :) not my fave example to make that pt. @j2blather there is no corresponding paper, this was just an intro to future of AI to (partly) non experts sort of thing at the open house. Didn't appreciate until recently how spoiled I was learning answer set programming in my first AI class. One of easiest AI methods to use :) @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman likewise! @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman again, to be clear, I wasn't attempting to use those args against new nukes. @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman with you 100% on that. @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman how to address huckster issue and also help ppl isn't clear, but yes, it's prob. @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman I agree!! But would still reiterate - many many ppl actually benefit from solar. @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman agree people have dumb views, many pro-solar args are naive, etc. :) @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman compared to grid stuff! I get that. But 1. it will soon be cheaper, 2. grid issue @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman that's why I pointed to solar thermal with storage. Anyway, yes it is expensive!! @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman what is problematic is expecting stuff like that to solve all problems. I don't. @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman ...expensive intermittent solar versus no electricity period is often great deal. @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman I think that is an unfair characterization of the way solar can and has helped... @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman I do not endorse or speak for any "mainstream push" or anyone but myself :-) @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman NOT saying that is good everywhere, but addresses some issues you raises. @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman ..scale plants and especially solar thermal ones with thermal storage for night. @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman ...your points on intermittency, cost, etc more true of rooftop/PV than large.. @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman now there we disagree. Depends what solar we are discussing if it helps. E.g... @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman ..emphasize that relative cost, not just absolute, matters. Grid there or not etc @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman ..is THE factor but especially in developing countries you are right. But would.. @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman I agree cost is extremely important. In general I hesitate to say anything... @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman Cost is important, yes. relevant discussion: http://t.co/LnePuMpOvT @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman and to be clear, I never made any anti-nuke arg. Responding to anti-solar args :) @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman trends, that is. LCOE cost today, yes nuke can be cheap. So can solar. Depends. @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman would gladly compare historical solar v nuke price data any day of the week :) @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman didn't mean to be rude with "lol" but I would be happy to point to evidence on it @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman LOL no. See: billions of people around the world. @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman those are bigger problems depending on *options*. With no grid, solar appealing. @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman when I said millions I was mainly referring to Africa btw. @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman thanks for putting words in my mouth. @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman I can answer specific claims. "Suspect" just meant I don't know ur exact views. @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman could say same thing about generalizations about nukes always being cheap :-) @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman agree with you on those general points for sure. Just disagree on solar's role. @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman ...which aren't always true. Solar often very cheap relative to building grid etc @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman you are making arguments based on specific assumptions about relative costs... @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman not sure what exactly you mean but suspect it is false. Solar benefiting millions Opposite prob from climate policy - one actor can mess up/geoengineer climate, but no one country can reduce emissions the normal way.-Burns Burns: if it happened someday, there are ways to do geoengineering better rather than worse re: termination effect, etc Coordination issues. "It's time to tell the crazy old uncle to shut up" on geoengineering/climate-related false choices/bad args posed by various ppl - Burns. Co-benefits of addressing black carbon as example of good policy options we could act on today - Burns Burns: better option than geoengineering or nothing is "getting our crap together" this generation on emissions. Hear, hear! Burns now addressing args for geoengineering helping future gens. "too clever by half." Suggests false choice re: policy options. Burns: carbon dioxide removal falls under UNFCCC bc X, Y, Z. What about solar radiation? Not addressed in UNFCCC. broadening UNFCCC unlikely Burns now talking about moral hazard viz-a-viz emissions reduction effort and geoengineering (I have big issues w/ this argument...). Burns connecting termination effect re: solar radiation management (ending geoengineering --> disaster basically) violates intergen. equity. Burns: see also Convention on Biological Diversity, endangered species, migratory species, UN Charter...he could clearly go on forever :) Burns emphasizing that intergenerational equity is part of international law, including in UNFCCC/climate context. Burns on Weiss on intergenerational equity. http://t.co/LU6uYF31ef Burns is mustering a wise range of arguments/POVs in defense of intergenerational equity viz-a-viz geoengineering. @abetidwell science automation raises many interesting issues :) @abetidwell interesting stuff but makes it sound more unique than it is - many ppl/groups around the world doing similar stuff :) Cool talk by Will Burns on geoengineering science/policy/ethics, etc. right now. TL;DR it's super complicated :-) @randethepoet @robinhanson also has a nice primer on this. @randethepoet I tried to summarize much of the situation in Economic Possibilities 4 our Children - paper/slides you can get on my website. Konidaris told me very interesting things about the challenges in soft material manipulation with robots. Lots of work on it, but very hard. Had a nice chat with George Konidaris at AAAI this year on human-robot interaction, machine learning, AI econ., etc.: http://t.co/BwuVPRhWfM Have also enjoyed the AI and robotics (/related terms) series at AAAI... cognitive computing was OK last year. Glad ethics will be at 2016! I'm a big workshop fan in general (assuming they're well-done, of course). Really enjoyed AI and ethics and general game playing at AAAI 15. Seems like I might need to go to both the ethics/policy and human-robot teamwork workshops at HRI/go to HRI in general this year! :) Tons of great feedback on AI progress working paper versions 1.0-1.2. Version 2.0 will be way more epic, I hope. :) Few weeks or so, prob. @markcojuangco @totterdell91 @Craig_Hotrum @SuzanneWaldman if "always" then nuke no good --- maintenance ;) solar good in some places= my pt @knewscript not really my main focus but I suppose I am curious about job impacts, how it will work technically, user experience, etc.. @knewscript both are interesting/I have many thoughts on all that :) more questions/thoughts than issues/beefs at this point :) (2/2) @knewscript in this case I was referring to Google competing with Uber on taxi-like stuff, not Uber getting into driverless cars, but (1/2) RT @AliMattu: Star Trek: Peep Space Nine #ReplaceALetterRuinATvShow http://t.co/zVUqsuq6a1 @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman except as a means of clarifying points which I agree on! @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman all fair/true points, but not sure I see relevance in world without free storage? @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman agree. We don't disagree on these points. Solar imperfect. Everything imperfect. @totterdell91 @markcojuangco @Craig_Hotrum ..things in terms of storage, just saying it CAN be stored for solar. Makes sense in many places. @totterdell91 @markcojuangco @Craig_Hotrum clarify what you mean by corralled? Also, was never claiming anything about solar vs other.. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman If it were free, yes. Currently, molten salt is cheap vs other methods. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman ..locations, 8+ hours of storage gets you LONG way to smooth solar, steady output @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman ..solar lower still than fossil, nuke. Granted. My point is just that for many.. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman yes, I am with you on that. Capacity factor, output predictability, etc. of... @totterdell91 @markcojuangco @Craig_Hotrum Yes, storage can reduce waste. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman OK. If storage free, that's true. What's solar connection? @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman k, with you so far :) @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman right, that is why I gave concrete example of built, operating plant. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman not sure I follow but sounds like an interesting topic! @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman if you want my nuanced take, I have a book chapter on solar thermal you can read. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman OK. Why? In what way? Easy to say that, I could say same of you. Specifics please @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman I don't mean that as an attack, but I have tried to answer every issue fairly. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman ..views on its challenges. I do, but storage is no longer deal breaker. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman you seem to think everyone who says things about solar must not have nuanced.. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman you have yet to raise one issue I have "denied." Still waiting. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman So? @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman I have stood next to and toured those tanks. They are big. So is the plant itself @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman I am all for engaging on real solar issues. "but nighttime/rain!" isn't one. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman again, "it" is vague. You raised one issue and I debunked it. Happy to continue.. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman you are implying it can't be stored or dispatched at night. That is not true. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman obviously that shouldn't be done/should only build where it makes sense. But.. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman btw: the short answer is that is not intractable. Can store for days, weeks. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman you raised storage as show stopper. I debunked. Any other general antisolar pts? @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman I literally just addressed that. Did not say it works well everywhere. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman to be clear, did not say it is viable everywhere. you made big claims, i answered @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman for reasons like? @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman yes I will continue believing in the fantasies of real plants I have studied. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman ..but if you care about power at night, solar thermal has you covered... @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman ..each issue you raised I addressed. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman you clearly don't want to engage on details of how solar works, just dismiss it.. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman so I put things in your terms. In my terms, solar can produce power at night. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman no, I have "discovered" as expected you use terms differently from me. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman what matters re: nighttime is reliability, power at night, etc. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman ...buffered. You store things and put it out later. Coal does that. Everything.. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman then you have a silly standard for such things. I could say nuke power is all... @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman what "is" the heat storage buffer? i don't know your claim/disagreement clearly. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman if you are making other point then would love to hear it! @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman if you are saying new energy isn't going into plant at night cuz sun down..duh.. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman what is putting electricity on grid day and night if not production? @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman no I do not. I have been there multiple times/discussed with the ppl who built.. Long suspected Google and maybe Google alone could beat Uber, now seems like default. Hope they do this stuff in more ethical way than Uber. RT @JesseJenkins: Google plans to launch an Uber competitor, betting big on autonomous, driverless cars http://t.co/5sBsZVziuy @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman Solana in Arizona is just one I have much direct knowledge of but not only one. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman didn't say it did @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman false again @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman false. Google Solana. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman ...is simple, more persuasive if built/operating :) not only factor.. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman which isn't the only thing that matters, just saying, if you are gonna say X.. @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman OK, then not addressing my point...plenty of solar, etc plants already *do* exist @totterdell91 @markcojuangco @Craig_Hotrum @SuzanneWaldman are these both operating? @Craig_Hotrum @markcojuangco @SuzanneWaldman my point was that the simplicity thing depends on drawing line around the plant, not system @Craig_Hotrum @markcojuangco @SuzanneWaldman wasn't questioning enviro impact. specifically responded to implication it is simple.. @markcojuangco @Craig_Hotrum @SuzanneWaldman until then, it is complicated on many levels, not just construction/safety/regulation, etc. @markcojuangco @Craig_Hotrum @SuzanneWaldman When there is a big thorium reactor or waste problem solved or mining uranium unnecessary..sure "If the inexpressible cruelties of slavery could not stop us, the opposition we now face will surely fail." - MLK, Jr., 1963, Ibid. "We must use time creatively, in the knowledge that the time is always ripe to do right." - MLK Jr., Letter from Birmingham Jail, 1963. RT @CSPO_ASU: Government & Energy Innovation - Kindle edition is now available! http://t.co/IFpkJLP8d9 @Miles_Brundage @ericbkennedy @heath… RT @erichorvitz: Call for input on 100yr Study of AI. Framing: http://t.co/gDV27b2vU8, Main: http://t.co/q217PrVEIi. Comments: ai100-info@l… RT @erichorvitz: Bill and my views are close. Press amplifies differences. Beyond worry, we can work on concerns w/ long-term programs http… @j2bryson @SGaudl my latest paper (and slides also available) was on the nuances/real issues of AI "taking jobs" etc/what to do about it.. @j2bryson @SGaudl yes. the economic stuff is huge but even there it depends a lot on ppl's choices/investments/policy, not just AI progress. @markcojuangco @Craig_Hotrum @SuzanneWaldman all things equal, sure, simple stuff is good. If the full value chain of nukes were simple.. ;) @ansgarjohn still wasn't any hate involved, but whatever... :) @ansgarjohn ah, cool :) @nerdsrocket solid choice @ansgarjohn ? Not sure which would be harder: robot soccer or football. Former is more mature today/in business as usual, but what if latter were a thing? @AliMattu Tomorrow Land looks a bit like the real life Robot Land opening in South Korea next year! @JohnDanaher some good points, but then again many have made many good points, so things like that raise eyebrows... @JohnDanaher I lost all respect for the article after the bit on driverless cars "reversing" global warming effects. Completely uninformed. RT @JohnDanaher: Does Work Undermine our Freedom? http://t.co/1C8JZSe5m9 @AliMattu and I realize that me making that distinction prob makes me a stereotypical jock-hating geek, but...color me skeptical... :) @AliMattu lots of good points, though I distinguish jocks from sports nerds. Some overlap but data thing seems more latter than former? RT @asmith83: Good luck tonight, brands RT @amcafee: “Technological progress always benefits workers” belongs in the same category as “more financial derivates mean less risk.” RT @rcalo: This lit review in @sciencemagazine on privacy and human behavior is a must-read. http://t.co/oet5DdEVcm RT @helengreiner: Hotel staffed entirely by robots to open in Japan http://t.co/LlZVnpBkAF via @CTVNews "Using AI to Study Poker Is Really About Solving Some of the World’s Biggest Problems," great article by @lilyhnewman http://t.co/kUoK8SRKDZ TL;DR Hinton's keynote - some of us thought deep nets would be great with faster computers, now we have em and they work great, told ya so!! Or was it "get over it"? Anyway, it was clear from the very beginning/especially clear at the end Hinton came for a fight. :) Fascinating... Specifically, he ended: ~"[In light of recent evidence, the physical symbol system hypothesis] is probably false. Deal with it. Thank you." At AAAI, Hinton made most forceful/interesting case yet that NNs are actually a lot like what brains do, ended his keynote w "deal with it." All time fave written sci-fi novels/universes/authors, etc so far: Asimov, 1984, Brave New World, + Player Piano. Prob forgetting something. ICYMI- my slides from AAAI ethics workshop (PDF), with some minor changes. More detailed in some ways than the paper: http://t.co/3HnqV8I3qO How much does one need to use cloud and/or cluster and/or not my laptop to get a good feel or deep learning stuff? Essential? Helpful? Etc.. RT @sarahjeong: basically this trial is going to end with the judge revealing she is actually Satoshi Nakamoto """If you're dull as a napkin, don't sigh; Make your name as a 'deep' sort of guy."" Epic AI limericks by Henry Kautz: http://t.co/Qr7ly2TXE6" Slides from Kambhampati and Talamadapula's tutorial at AAAI 2015, "Human-in-the-Loop Planning and Decision Support": http://t.co/jILr5w8X9o Pretty epic AI paper - Toward Minimax Off-policy Value Estimation, Li et al. 2015 http://t.co/o9cidvh7JC RT @therobotreport: $100 million in funding for robotic companies in January. #Rethink, #Xenix, #Rapyuta, Perceptron, #Skydio, and #JIBO! h… Russell's talk covered a wide range of issues related to the future of AI and what to do about it. Highly recommend the slides (last tweet). Slides from Stuart Russell's talk at the AAAI 2015 open house: http://t.co/IRLjnwzqvQ Rise of the robots at AOL lead to job cuts http://t.co/ie7Une2bz6 via @usatoday RT @ChetanNNaik: @Miles_Brundage Not running again: I don't think the prediction would change. Team @ 538 have been predicting http://t.co/… @ChetanNNaik by similar stuff I mean using modern AI methods to predict the outcome. Know many folks have all sorts of prediction methods :) @ChetanNNaik have you thought of running it again today? Or has anyone done similar stuff? @ChetanNNaik gotcha...thanks for clarifying! RT @ChetanNNaik: @Miles_Brundage The final prediction was done on Jan 1st using all the regular season games. Clarification: was saying that @ChetanNNaik used AI to predict long-term Super Bowl winner a while ago (Dec.?) using data then not new data. @ChetanNNaik now I see that a run was on Friday, December 21, 2014... is that the main relevant date? Was curious if anyone used AI to predict the Super Bowl champions. Turns out @ChetanNNaik did. Seahawks. When was that result made, Chetan? RT @MargotWilliams: “Never trust a corporation to do a library’s job” @Google abandons the past http://t.co/lzlMMlAcB8 #NewsResearch #Arch… RT @peterxing: "Now, Even Artificial Intelligence Gurus Fret That AI Will Steal Our Jobs - Forbes" http://t.co/0fxwUX9dFz RT @tegmark: Here's an essay about AI and the future of humanity that I wrote for the annual Edge Question: http://t.co/foHYZniwg6 http://t… "Optimal Rewards for Cooperative Agents," Liu et al. 2014: http://t.co/rjyfUzzP8Z RT @GaryMarcus: The Plan to Replace the Turing Test with a ‘Turing Olympics’ | 1st report (on workshop led by @garymarcus) http://t.co/307… Really enjoyed meeting @mark_riedl at AAAI. Doing lots of cool stuff on narrative, AI, games, etc... Publications: https://t.co/mJz3Jp38EI Note: the Xiaojin Zhu paper in my last tweet has technical parts but you can get the gist even if you skip parts. Non-technical coda at end. "Machine Teaching: An Inverse Problem to Machine Learning and an Approach Toward Optimal Education," Zhu at AAAI 2015 http://t.co/UGf5I5iuPr Optimal Cost Almost-sure Reachability in POMDPs, Chatterjee et al. AAAI 2015 http://t.co/8dHelSEsxx "Deep Learning for Real-Time Atari Game Play Using Offline Monte-Carlo Tree Search Planning," Guo et al. 2014 at NIPS http://t.co/vnvqSAdM1f @rcalo then again, access being legitimate or not could also be disambiguated, etc. Anyway, I think that's a cool/suggestive framework :) "RT @rcalo: information asymmetry = greater access to knowledge, actuator asymmetry = disproportionate ability to manipulate the physical wo…" @rcalo memory or information, data, knowledge, etc. (I like Floridi's framework there)... something of that sort, as opposed 2 just sensing. @rcalo latter makes perfect sense to me...former is ambiguous. You could also disambiguate sensors from memory and have three asymmetries. @Aelkus btw you coming to AAAI next year? It's in Phoenix :) @Aelkus didn't actually talk to Stone, though :( talked more to the et al. part haha. Toured Stone's lab and rest of CS dept. Super cool. @Aelkus thanks! @Aelkus talked to lots of UT folks at AAAI including Stone et al... Still welcome any specific recs, though, still working up reading list. @Aelkus rec. any in particular? Yes, that is a key area. I like Bieger's overall take in Raising AI: Tutoring Matters. #NAME? Seems like lots of ppl in AI more or less agree combining the latest machine learning w/ human feedback is a key to much future AI progress. Lots of discussion of hierarchical model learning, including but not limited to via neural nets and learning from demonstration, at AAAI. Talvitie helped me understand the state of the art in RL + why DeepMind and others like ALE so much. Will use more in my work going forward. Satinder Singh also said some super interesting things at the general game playing workshop at AAAI. His recent pubs: http://t.co/UvmvN5EqPG Really enjoyed chatting with Erik Talvitie yesterday at AAAI - knows a ton about AI, UCT, general game playing, etc: http://t.co/JZ7vCihJ3s RT @dschatsky: Kiva founder: secondary benefits of advanced #robotics: flexibility, adaptability, and a reduction in human errors http://t.… Put differently: nothing about advanced AI and society should be talked about as inevitable. Raises Qs of research/governance, not destiny. Journos: if you really wanna talk Terminator/AI, see T3, which makes plain that human greed/stupidity --> existential risk, not tech per se. @Craig_Hotrum @SuzanneWaldman ah OK i was thinking you meant Canada as a whole, which raised my eyebrows ;) @Craig_Hotrum @SuzanneWaldman again, broad claim...wind works. solar works. diff things have diff costs and tradeoffs in diff locations. @Craig_Hotrum @SuzanneWaldman that is a very broad generalization that is demonstrably false. Needs caveats on locations. @Craig_Hotrum @SuzanneWaldman semi-predictable interconnected intermittent renewables can provide some baseload. devil in details tho obvi. @jrbarrat hm works for me too now. before it showed up as weird and compressed. maybe glitch, nvm @Craig_Hotrum @SuzanneWaldman depends on many factors. marginal unit of wind shouldnt be expensive. if it is, policymakers' fault :) @Craig_Hotrum @SuzanneWaldman I wasn't proposing any "it" but yes if you scale up too much problems arise. v geography-specific @Craig_Hotrum @SuzanneWaldman ..and often it makes sense to just plain add wind to the grid. But yes, agree intermittency is a big issue :-) @Craig_Hotrum @SuzanneWaldman well, I take issue with the nat gas point bc that makes assumptions about storage, location, grid, etc... RT @JaneFriedman: Seeing lots of talk about whether “blogging” is dead. But isn’t it as broad/vague a term as “publishing”? So many manifes… @Craig_Hotrum @SuzanneWaldman I am skeptical of plans and think they generally are not ambitious enough so those figures don't say much ;-) @Craig_Hotrum @SuzanneWaldman not so much wondering what ppl plan on but what's possible, quality of resources v population centers, etc. @Craig_Hotrum @SuzanneWaldman what's the word on wind in Canada? Know the solar resource situation pretty well ;-) RT @jon_jeckell: @Miles_Brundage Another concern is amplifying the power of authoritarian groups (far short of full AI), provide power to f… @jon_jeckell that is also a challenging and important issue, but somewhat distinguishable and more research prob today than governance. @FrankPasquale @dalecarrico @BanKillerRobots thx, yep familiar with all of em :) @jon_jeckell "just" a bit tongue in cheek/galley humor, of course, but really, you needn't fear uprising to think it is a super urgent issue @jon_jeckell I did not, btw, mean unintended (by humans) killing sprees. Just mass efficient murder by human-governed robots. @jon_jeckell think you should be worried about both. Former under development, strong incentives to use, could make war easier. @jon_jeckell lethal autonomous robots could have related effects but much more general purpose than nukes. Not obvious to me what effects. RT @jon_jeckell: @Miles_Brundage I think nuclear weapons made people look into the brink & take a step back. Then found new ways to fight s… RT @jon_jeckell: @Miles_Brundage I think one major factor in reducing violence is control of disease & other factors that made life seem ca… RT @jon_jeckell: @Miles_Brundage @stcolumbia Definitely. And there are tons of things that could throw "progress" & "modernization" into re… @jon_jeckell if not literally dead then a horrible civilization not worth surviving in current form, in need of rethinking self. @jon_jeckell I would reframe the issue: if we can't figure this stuff out, we are likely all dead. So let's figure it out. @jon_jeckell and also make people less desperate, misinformed, poor, enraged, etc. Tall order, AI insufficient, but could help perhaps. RT @jon_jeckell: @Miles_Brundage So AI can help find ways to enhance cooperation or find acceptable positive sum resolutions to conflict. @jon_jeckell @stcolumbia my sense is that the trend is positive overall, some countervailing trends, but regardless nothing is inevitable. @jon_jeckell depends what you mean by "is ending." I do not at all think an end to war this century is crazy. @Craig_Hotrum @SuzanneWaldman not necessarily. Maybe it was a mistake to build em. Again, realize geography matters... @Craig_Hotrum @SuzanneWaldman sidenote: btw: robotics can solve that problem, but yes it takes upfront cost/makes more sense in diff places. @Craig_Hotrum @SuzanneWaldman nice :) to be clear, I am not trying to say you are wrong, am genuinely curious about the robustness of args @Craig_Hotrum @SuzanneWaldman ...seems maybe plausible but in need of substantial evidence to claim that oil/gas was only reason 4 this. @Craig_Hotrum @SuzanneWaldman are you absolutely 100% sure there are no legitimate arguments against that reactor besides self-interest?... @VincentCMueller those aren't nec. mutually exclusive, since people are often justified in helping self. Matter of degree, design, etc maybe @VincentCMueller put differently, should people be allowed to have biased/personalized secretive AIs to do their bidding, v AIs for pub good @VincentCMueller and yes, I meant more as second-order rights of human who owns or controls or designed that AI, not first-order. @VincentCMueller well article is in German so I had to guess on relevance ;) @Craig_Hotrum @SuzanneWaldman be more specific please. @VincentCMueller related question: should AIs ever have privacy or should always be transparent, human-understandable/explicable, etc.? @Craig_Hotrum @SuzanneWaldman ...a big role, but so does the high capital cost, need 4 certain (large) plant sizes not arbitrary size, etc. RT @muradahmed: Had fun doing this Lunch with the @FT with @demishassabis - the Google Deepmind boss racing to make machines smart http://… @Craig_Hotrum @SuzanneWaldman what are main barriers to scaling in your view? My sense is yes, regulation/policy/public fear etc. play... @SuzanneWaldman and the energy is ultimately from the Sun anyway..arguably both are nuke or both are solar from certain POV :-) @SuzanneWaldman I would like to be able to say that too! I can also say solar thermal already is ;-) @jon_jeckell Pinker et al. Lieberman emphasized poverty and ignorance as drivers of war. Dunno bout that, but yes AI can help w such things. @jon_jeckell would also be keen to discuss specific scenarios for the end war thing. Arguably trend is overall very positive per Goldstein, @SuzanneWaldman do not think anyone can realistically claim the same for next gen nuke. Current gen, sure, but that wasn't the discussion :) @SuzanneWaldman in contrast, near 24/7 proven *already* to work at multi hundred megawatt scale. Almost entirely economic hurdles, not tech. @SuzanneWaldman nukes will still be early stages of scale up at best, no new whole terawatts over that timescale, happy to be proven wrong! @SuzanneWaldman ..unless pace of business, regulatory, social, political, etc. innovation accelerates a lot, default scenario in my mind is @SuzanneWaldman ..many terawatts of non-fossil power, solar can do that among others. Expect nuke innovation over 15 year time horizon but @SuzanneWaldman neither I nor anyone intelligent said solar will soon scale everywhere. My point was that something will need to make .. RT @jon_jeckell: They should read some Clausewitz then. Because that's the point. Achieving your policy ends. Violence is last resort @Mile… @SuzanneWaldman ...ppl working on it, but id say solar thermal is better understood and known to be more scalable already than any 1 nuke ex @SuzanneWaldman would love to hear/examine specific example of such nukes. u mean thorium or something else or in general? no denying that. @SuzanneWaldman ...have long known nuke scaling about capital cost, regs, etc. not if it is tech-plausible. raises diff Qs from renewables @SuzanneWaldman doesn't mean nukes won't scale, just saying I question the existence of any "race" to speak of. Innovation, sure, but ppl.. @SuzanneWaldman not aware of any significant investment outside DOE and a few startups in such nuke. Small relative to fossil, renewable $. RT @joshtpm: She considered tetanus shot after he cut himself on wire fence but decided no: “He has such a strong immune system.” http://t.… @jrbarrat link not clickable fyi RT @catherinebuk: Alan Turing institute for data science, to be based near kings cross http://t.co/7zrpgLLJZT The example used in the talk was creating plausible next few frames of a flapping flag video. Big improvement over the state of the art. The key idea of that time series paper (Ibid) was to frame the multi step time series prediction problem as imitation learning. Interesting. Enjoyed talk on this at AAAI: Venkatraman et al., "Improving Multi-step Prediction of Learned Time Series Models," http://t.co/NaM1JIbqSZ RT @robot_MD: @RoboEthics's Workshop on the Emerging Policy Ethic of HRI (March 2nd, Portland, OR) Student scholarships: http://t.co/qxsOI5… RT @nmpanek: Building Robots With Better Morals Than Humans -- http://t.co/zkUcpGpvDd http://t.co/uEOR2foEkg @dmarthal will do, thanks! RT @mpshanahan: My book Embodiment and the Inner Life, which was a major influence on #ExMachina, has been reduced by OUP to £9.99 - http:/… Besides deep RL, want to get better sense of state of art model-based learning, LfD, robotics, and human-robot teamwork over next few years. RT @IBMWatson: University of Toronto students created "ROSS" using Watson Services that helps automate legal research. http://t.co/kziIoTLl… Agreed with Lieberman that Arkin/Goose too pessimistic and narrowly focused. Don't think improving/stopping war nec. mutually exclusive tho. Ideally I would like a moderate degree of both conceptual and programming challenge, not all of either (e.g. not a demo, not from scratch). Recommendations for languages/libraries/algorithms/etc. to use for deep learning on my laptop that would be good for pedagogical purposes? Have made Q-learning agent before but toy domain, crappy code, etc. Need to use ALE for Atari game learning. Not sure deep net application? Henry Lieberman's critique of Arkin/Goose + proposal to use AI to help end, not improve, war, got enthusiastic audience response last night. Decided I prob. need to implement deep RL for educational purposes re: both AI knowledge and programming skills. Deep nets in general first. RT @katypearce: Subjective wellbeing and human welfare around the world as reflected in the Gallup World Poll http://t.co/2HxLfd5PFx @alan_winfield btw really enjoyed Louise's talk and learning about y'all's research at the AAAI ethics workshop - very cool stuff! :) RT @alan_winfield: @Miles_Brundage Thanks Miles. Yes agree likely tough to define and enforce. But then so are other taxes, like Value Adde… @alan_winfield indeed! @alan_winfield ...bots work better and not have to be as smart, etc. Also, global capital tax a la Piketty vs automation? @alan_winfield ...automation is since it encompasses more than just discrete robot purchases, also restructuring company/enviro to make... @alan_winfield interesting ideas - have thought about this a bit before...thoughts on feasibility of enforcement? seems hard to say what... RT @alan_winfield: One step toward sharing the wealth created by robotics and automation: an Automation Tax: http://t.co/7ojETycVuB RT @carolinedleger: Attended #AAAI15 debate last night on fully autonomous lethal weapons. Scary, fascinating, totally new. #feedyourmind T… Bowling confirmed my impression that human dominance of Go has been vastly overstated, won't last more than another five years or so #AAAI15 @justinnhli see #AAAI15 RT @sgaudin: RT @Computerworld: Scientists say #AI fears unfounded, could hinder tech advances @sgaudin #AAAI15 @WPI http://t.co/MWwowA2IRb… RT @AAAIConference: Check out #AAAI15 rather than #AAAI2015 - lots of activity there... Medicine not adversarial or game but same methods can be/have been applied to such domains among others where imperfect information. #AAAI15 Took 900 CPU-years to drive exploitability below 1 mbb/g #AAAI15 Bowling: went from 200+ TB to 9 TB to store strategy #AAAI15 Bowling: ten years ago took 7 days to solve Rhode Island Hold Em. Now it takes 7 minutes. #AAAI15 Bowling: abstraction helps but insufficient, decomposition helps but insufficient, ultimately algorithmic improvements were the key #AAAI15 Bowling measures poker exploitability with thousandths of big blinds per hand that can be made against a given agent #AAAI15 RT @JimSpohrer: Poker solved - Michael Bowling (U Alberta) at #AAAI15 #Cogntive2.0 http://t.co/cfi8sFBk8O Bowling has complex definition of heads up limit hold em being "essentially solved" but bottom line is you. will. lose. to. Cepheus. #AAAI15 "essentially solved"= if you played optimally for a whole human lifetime against Cepheus, 95% chance u can't make > 1 milli-bb/hand. #AAAI15 Poker has continuous outcome space, not win/lose/draw - Bowling #AAAI15 Bowling quotes Koller and Pfeffer saying in 1997 we are unlikely to ever solve full scale poker...whoops! :-) #AAAI15 Actions of other players, random future events, and missing information = three different sources of game/problem hardness - Bowling #AAAI15 "Games are a proving ground" for real world cognitive skills- Bowling. True for humans and AI research #AAAI15 Bowling going back in time on AI/games, went through Babbage/Lovelace #AAAI15 Sandholm introducing Bowling and his epic contributions to AI poker/related areas. #AAAI15 Hinton's "math sign language" (Russell's apt way of characterizing his enthusiastic gestures) also was quite memorable. #AAAI15 One thing that stuck with me from Hinton's #AAAI15 keynote is: "synapses are cheaper than experiences." Many interesting points like that... RT @ChengSoonOng: Geoff Hinton talks about building #babelfish at #AAAI15 https://t.co/nLlBecfeVJ Stuart Russell seems v. open minded - first time I met, not a huge neural net fan to say the least. Now super into deep RL as AI progress. RT @BanKillerRobots: Thanks for scheduling it RT @AAAIConference: Debate on Autonomous Weapons starting in 5 minutes - a first for AAAI #AA… Would love to see a rigorous argument against AI risk based on computational complexity, flawed models, etc. but that op-ed wasn't it. :-/ On that Littman thing: Bostrom et al. are aware models are imperfect and many probs. are intractable. Not a decisive counterargument at all. Surprising to read Littman (Ibid) say something like "The notion of the intelligence explosion arises from Moore's Law." Demonstrably false. Super helpful feedback on solar robotics-related stuff from AI, robotics, HRI, etc. ppl at AAAI this year...better sense of tech issues now. RT @MatthewGombolay: While the debate event has ended, the argument over autonomous weapons will continue. #AAAI15 @AAAIConference http://t… RT @MatthewGombolay: A passionate audience member asked why are we debating about autonomous weapons instead of how to use AI to prevent wa… Glad someone stood up to Arkin and Goose on pessimism and the need to apply our efforts to *stopping war* not (just) ethical bots. #AAAI15 My main beef with both Arkin and Goose is selling humanity short by assuming wars will last forever. Let's think bigger than that. #AAAI15 RT @MatthewGombolay: Stephen Goose believes stigmatization of autonomous weapons via an international ban is key to preventing others from … No tradeoff between dignity and right to life. Both threatened by killer robots - Goose #AAAI15 "Enforcing a ban is, plain and simple, infeasible to do." - Arkin #AAAI15 "Right to life trumps a dignified death." - Arkin #AAAI15 (context: his main arg for LARs is based on helping noncombatants). Goose and others' view on "compassionless robots" is generally indefensible and completely ignores Arkin's points on AI ethical advantages. Goose making huge tactical error emphasizing overstated technical barriers. Has debated Arkin before, no idea why he would do that.. #aaai15 As I mentioned before, the human dignity/compassionless robot/etc. thing Goose emphasizes is not remotely a solid argument. Wrong emphasis. "It's only inevitable if we don't act now." - Goose. Yup, though now overstating his own case/skepticism re: technical aspects/ban.. #AAAI15 Arkin has said "inevitable," "never," "always," etc. soooo many times. Totally wrong way to think about issues like this. Ughhhhh "A human will never be out of the loop." Ugh, Arkin, don't say things like that. Stop predicting, tell us what is OK and why exactly #aaai15 RT @AAAIConference: Debate on Autonomous Weapons starting in 5 minutes - a first for AAAI #AAAI15 #AAAI2015 @JesseJenkins would much rather see comparable action on other issue @JesseJenkins anything serious, but this middle ground where we kind of oppose it but also overstate it but are also blaisey...dont get it.. @JesseJenkins agree, I think. Except in the sense that activists could have done better/more civil disobedience etc. if really going to do @JesseJenkins have a guess ;) mainly wondering if you think climate/enviro movement focuses too much on it and/or success of their methods @JesseJenkins yes @JesseJenkins what do you think of the issue? ...not doing enuf about non-trivial long term issue + that should end. In neither case is doomsday plausible soon or feared by experts.(2/2) I am "concerned" about superintelligence in similar way to being concerned (not "worried") about climate change...concerned humans (1/2) RT @MatthewGombolay: Here's a peak inside the brains of this lifelike robot by @hansonrobotics at #AAAI15. @AAAIConference http://t.co/IxZO… RT @ken_goldberg: Is the Singularity a latent monotheism that threatens to run amok? @JohnDanaher for what it's worth, think what he said =sensible, he just isn't a leading expert and there are tons that could be asked abt it @JohnDanaher or do homework? or think? @JohnDanaher so? that means you needn't talk to experts? @JohnDanaher his view and most experts' = nothing inevitable or imminently existentially risky/"worrying." Press tone implies otherwise. @JohnDanaher like there being a major international AI conference happening this second which addressed this in detail w public talks etc @JohnDanaher yeah there are so many levels on which a competent journalist would have contextualized it but didn't @JohnDanaher never said it was surprising, not whatsoever, totally saw that coming. But I am saying it is unjustifiable on journalists' part @JohnDanaher more fundamentally, it was an AMA. He gave his opinion. Not OMG BILL GATES WARNS HUMANITY. It's called ask...me...anything :-) @JohnDanaher as opposed to just saying let's do research but not panic, the mainstream view these days. @JohnDanaher framed by journos as meaning he is personally scared or thinks people should be or thinks it will be super hard or whatever.. @JohnDanaher the latter. Concerned isnt worried isnt scared etc. And his concerns (unless he is an idiot) aren't of the sort people imply. RT @elonmusk: Tesla dual motor cars are also all-wheel drive. Main goal of dual motor was actually insane traction on snow. Insane speed wa… RT @larsz: The robot-puts-cat-in-the-oven scenario was concocted by Prof Stuart Russell who gave an enlightening talk at the #AAAI15 confer… Epic chat with Joohyung Lee (super smart/nice guy and also my first AI class prof :) ) on AI ethics/safety, KRR, etc. Many ideas cooking. :) @nathansttt yes please! thanks for the offer! @nathansttt some local journos cared, but I am talking about the latest Gates hyping. Ways press got wrong SUPER debunked already. Sifh. Super depressing that people at AAAI like @nathansttt put a ton of work into the open house, public talks, etc., journos 2 lazy to find out. "RT @mpshanahan: Know your #AI distinctions 1 Fiction: #ExMachina Reality: http://t.co/yeSrbcUXs1" "RT @mpshanahan: Know your #AI distinctions 2 Near term: @erikbryn and @amcafee, 2nd Machine Age Long term: Nick Bostrom, Superintelligence" @JohnDanaher congrats, but horrible coverage :-( Bowling: games good cuz progress more measurable than real world problems, hard enough to teach lessons about other domains (e.g. Cepheus). Bowling (panelist) on @murraycampbell's point/question: much depends on timing between competitions, see planning competitions. #NAME? @murraycampbell raising key point in Q+A session on AI competitions: code sharing helps progress, raises profit/secrecy/etc. issues in (1/2) Looking forward to "Von Neumann's Dream" talk by Bowling on Friday presenting the Cepheus paper/history of computer poker/game theory, etc. @plastiq thanks!! RT @AAAIConference: Today at 9:00am: Meinolf Sellmann in Zilker and a panel "Do competitions help to advance AI research" in Texas #AAAI15 … Somewhat biased on lithium-air stuff since I worked at ARPA-E when they funded some such things, + would like to say I told ya so someday ;) Lithium-air will never be as energy or power dense as gasoline (other stuff could, though). Overall eval depends on e.g. battery/tank sizes. Sidenote on lithium-air: disagree with the framing it as potentially "as good range as gasoline." Could be way more, depends on many things. I would like to think that most people are skeptical of such fear-mongering/know it is over-hyped, but it's subtle issue so not clear to me. I don't really have a sense of if a non-trivial number of ppl are genuinely scared of near-term AI because of bad media coverage. Thoughts? "In the camp that is concerned about superintelligence" this day and age generally means thinking we should do a buncha research. Not panic. It cannot be emphasized enough how NOT "scared"/"worried" Gates/Musk/Hawking/AI experts are about near-future AI x-risk. Long. Term. Issue. "Worry isn't same as concern, isn't same as warning, isn't the same as answering a question on an AMA*. *anything. Think about it, journos!!" Very misleading tone/headline, ugh RT @JohnDanaher Bill Gates is worried about artificial intelligence too http://t.co/Vixm1M6aEb via @CNET For reasons such as these http://t.co/cfHOw3Kmzy I've long been a big lithium-air booster. Could actually be done now/soon tho w/ tradeoffs. + I am confident that an order of magnitude or more increase in energy density is doable technically before 2030, dunno when exactly. (2/2) Carrie Rebhurn impressed upon me the importance of battery life for drones earlier...would have to do deeper dive to say for sure but (1/2) ....that is, unless you want practice, or to see how good modern AI is at such things. Just don't expect to make money that way!!! Bottom line of all this poker stuff lately: don't play heads-up Hold Em against someone/thing who could be a bot or bot-assisted, period. :) RT @NatashaPrasad: "Reasons you were not promoted that are totally unrelated to gender". Epic list @mcsweeneys. http://t.co/jGESjEac8h RT @ImagiDrone: #UK Guide for #UAV's http://t.co/H83CSWPgWx via @Ethicaldrones Forget exactly what Sandholm told me about increase in complexity from 2 to 3 player poker but something about 10^16 becoming 10^160... :) Among other things, going from 2 to 3 player poker introduces non-zero sum-ness and dramatically increases importance of player modeling. Tuomas Sandholm: non-trivial but possible to make freestyle poker (as in freestyle chess) reality someday, no one really working on it, tho. @jeffbigham yea didnt mean he hasn't tested against humans, just not against the world's best. Picked Stefan Witwicki's brain on technical challenges in automated robotic construction, and solar in particular. Many new ideas :-) @jeffbigham maybe, definitely not me, though! ;) I got stomped. I am not a poker pro but was definitively stomped after making a bad all-in bet against Tartarian7. Noam Brown, creator of Tartanian7, state of the art heads up *no limit* bot, suspects it can beat *any* human but hasn't tested yet. #AAAI15 Lots of cool stuff being cooked up 4 AAAI next year in Phoenix, it seems. Will see what I can do to help on the ethics/policy stuff side. :) Great chat w/ Manuela Veloso on hardness of machine ethics/safety, need for managing expectations re: AIs/bots necessarily making mistakes. Great chats with @murraycampbell on AI, human-machine symbiosis, sci-fi, etc. this year. Super smart/nice guy. Always a AAAI highlight! :) RT @sgaudin: Geoffrey Hinton: If you have good ideas, good data & fast computers, you can do almost anything. #AAAI15 #AI #Google RT @sgaudin: Geoffrey Hinton: Impossible to predict tech advances more than 5 or 10 yrs out. After that, we haven't a clue. #AAAI15 #Google… RT @sgaudin: #Google's Geoffrey Hinton: "I think most people have no idea how difficult it is to make a general purpose intelligence." #AAA… "RT @lreyzin: ""What's in your head is big vectors and big matrices and stochastic gradient descent."" Geoff Hinton (sarcastically I hope) #…" Great discussion with Brad Hayes on neural net opacity viz-a-viz other AI methods and risk/safety/ethics, performance/risk bounds etc. The autonomous robots wandering around #AAAI15 have much better obstacle avoidance/crowd navigation skills than I do, it seems. RT @GoriffaZ: Amazing talk on #deeplearning: @GeoffreyHinton explains how it works at #AAAI15 http://t.co/waf90SQ3ja RT @maidylm: curious to know the topics focused @ @AAAIConference word cloud created from paper titles #aaai15 #learningtopthelist http://t… RT @DJGagneDos: Deep network can translate from language to multiple ones in parallel. End goal: Babelfish. #AAAI15 Hinton briefly mentioned Neural Turing Machine in Q+A with Vardi. Great discussions. #AAAI15 "My new view is you can't predict anything beyond five years." - Hinton Q+A on if hardware ready yet for human-like/level AI/beyond. #AAAI15 @Aelkus of course, his point is the evidence in last few years is pretty decisive. "The physical symbol system hypothesis is probably false. Get over it." - Hinton #AAAI15 Dumb stuff like stochastic gradient descent working so well raises huge problems for GOFAI advocates - Hinton. #AAAI15 "And I really mean 'thought vector.'" -Hinton Hinton's talk has persuaded me I need to do a deep dive on ML, DL, and deep RL over next year or so at least. RT @DJGagneDos: Hinton: models should be bigger than the data. Ex: your brain has many more synapses than experiences. #AAAI15 RT @DJGagneDos: Hinton: statisticians wait for a stable dist, physicists wait for something reasonable, cs people wait until they get bored… Who did Hinton say is working on 20 later nets? Anyone catch that? #AAAI15 "Synapses are a lot cheaper than experiences." - Hinton #AAAI15 @gleemie around same time Player Piano also came out! Read it? Seems up your alley :) RT @larsz: "It just takes one cat in the oven to set back domestic robots by twenty years" #AAAI15 RT @sgaudin: At #AAAI15, waiting to hear #Google's Geoffrey Hinton talk about using #AI for speech recognition. He's drawing the biggest cr… RT @lreyzin: "Compress & Control" by Veness et al. in #AAAI15 reduces control/RL to compression. They get Lempel-Ziv to play pong! http://t… "Brace yourself... Geoff Hinton keynote tweets are coming." @jon_jeckell VS serious/cutting edge AI r+d. @jon_jeckell yeah, trying to caveat my claims appropriately for that reason but frankly, it is reasonable to think much of that is hackery. @jon_jeckell corporate R+D arguably >> govt but just saying the Wall Street thing is ill-articulated usually and highly dubious IMO. @jon_jeckell I have heard that *claimed* but think it has not been remotely demonstrated at least in terms of *quality* work. Speaking of Bill Gates and Shakey...one of Shakey's legacies was inspiring a young high schooler named Bill Gates who came to visit the lab. RT @BillGates: Ask me anything on @reddit this morning at 10:15 a.m. Pacific time. To be clear on military/intel: I do not think working with military/intel is necessarily bad, but think people should have *choice* not to. Abridged case for changing US AI/robotics R+D system: people shouldn't have to deal with DOD/intel to do AI. Need robust civilian options. May take years to change US AI funding but things have changed b4 + the case for doing so is very strong, just needs to be made/pushed more. Many ppl seem to think it is lame in many ways that AI/robotics ppl have to apply to mil/intel comms for $, but think inevitable. Disagree. Bowling on my long term plan to rebalance civilian/military AI funding options: "that would make a lot of AI people happy!" Yup! + others :) + in the same breath is misleading...billions versus quadrillions in long term potential. Not even remotely comparable in my opinion. (2/2) I actually agree with much of that article I complained about last night on $ opportunities, just think comparing Bitcoin + AI market (1/2) RT @AnnieRKH: #PokerStars Adds #Cepheus to Team Pro Roster http://t.co/S028elbsH8 via @PokerUpdate RT @PolarisPoker: We're at the #AAAI15 conference doing demos of #Cepheus! Bowling will present the Science paper on Friday, will post the… Anyone been to HCOMP before/thoughts? RT @elonmusk: Great DragTimes video of people experiencing P85D "Insane Mode" acceleration for the first time https://t.co/gqN9oremMQ Bitcoin is equivalent in market size to something like annual potato chip and shampoo R+D funding. 10 billion or so. NOT that big a deal. I don't doubt there will be many companies doing various Bitcoin things in the future, I just think they're mostly dumb/few should care.... This paragraph. Come on, people. Get some perspective on Bitcoin in SV versus world at large. http://t.co/TeTzySjvqO http://t.co/WtYW5IwryX Broadly, most relevant experts expect more (semi)autonomous cars in future, but sectoral order, consumer market, 10 v 30 years, etc debated. Not sure I really have a good handle on expert opinions of future of (semi)autonomous cars. Expectations/assumptions are all over the place. ...more tractable in general than taking over the world in general and that might make superintelligence less dangerous... w/ caveats. (2/2) At one point in Q+A, Stuart Russell seemed to be saying yesterday that he was sympathetic to Ernie Davis's point on ethics maybe being (1/2) Talked to Michael Bowling a little bit about freestyle poker...little bit harder than I had expected, but not completely crazy, I think. :-) Nice piece by Bryce Paradis on the implications of Cepheus (~perfect heads up limit hold em AI) for human poker: http://t.co/HNvbW6xOT4 Non-zero-sumness of 3+ player poker, among other factors, make it much harder than heads-up. SOME, not all, poker AI techniques work w/ 3+. Great discussion with Michael Bowling and Nathan Sturtevant on state of the art/future of poker AI...fascinating probs, broadly relevant AI. Looks like I need to read Structure and Interpretation of Computer Programs! h/t @mdelachang RT @danielah_24: I <3 Shakey the Robot. Glad to see he was honored at #AAAI15 http://t.co/1q1crVSe8R @hannahgais cuz AEI RT @annegalloway: Best advice I got when I entered academia: "We're all smart. Distinguish yourself by being kind." "Nothing else I've done was more important or more fun than making Shakey." - Peter Hart. #AAAI15 RT @vardi: Artificial Intelligence and Technological Unemploymen (ICDT'15 Tutorial Slides) http://t.co/Bd2k99Klsm RT @AAAIConference: Shakey celebration now starting in Texas ballroom, not Zilker ballroom. Should be a highlight of #aaai15 #aaai2015 RT @sgaudin: Excited to hear about #AI and #robots at the #AAAI15 conference today. No pressroom, tho? I'll be camped out in a hallway. Frickel/Gross argue senior profs + students tend, for good/explicable reasons, to be the most engaged in scientific-intellectual movements. ...generally seem more open to talking about ethics stuff. As mentioned before, consistent w Frickel/Gross on movement leadership Qs. (2/2) As usual, very junior and very senior AI people (i.e. undergrads/grad students and tenured profs, less so assistant/associate profs) (1/2) In short, DeepMind's normalization/bureaucratization could make them be less ambitious someday but v unlikely as long as they are in London. ...autonomous as long as they can to the extent they can, which I suspect will be minimum few years and to a very significant extent. (2/2) Slightly better sense of DeepMind in broader Google context now...many connections/collaborations but essentially DeepMind is/will be (1/2) @tonyjprescott agree on consequence evaluation being key! One of key issues w MTT I think is if works most of time but catastrophic failure. Haven't come across any company remotely like DeepMind in terms of actively hiring neuroscientists + other non-AI people to do AI research. Among other issues, MTT ignores bots should act diff/less selfishly than humans, we are wrong abt ethics sometimes,+ avg vs worst case, etc. While it is interesting, provocative, worth discussing as foil, etc., now convinced Moral Turing Test is totally wrong idea for such things. Haven't met anyone at AAAI yet who disagrees with me that "human level AI" has overstayed its welcome as main metric of AI future claims. @robotenomics @alan_winfield (which btw you seem to agree with if I had to guess ;) just highlighting the word choice issue) @robotenomics @alan_winfield awesome article/talk/POV! Have to mention related but diff framed POV from my advisor :) http://t.co/bp3Oquzlc9 Expertise heuristic: if you learn medium amount from talk on topic A, prob. not expert. If little, maybe you're expert. If none, over head. That was a long list of constraints as far as such requests usually go, and Doctorow was also excluded, so that one was v tricky. What else? Was asked earlier what sci-fi I'd recommend, in book form, that's recent, interesting, etc. on AI and economic stuff. Said Stross. Thoughts? Lots of great chats with Judy Goldsmith at AAAI this year... she teaches a super cool class on AI/ethics/sci-fi/etc.: http://t.co/9lklQmtZEh ...if "working" is getting conversations going, at least. Roughly everyone this year wants to talk about economic stuff, wasn't the case b4. Have also gotten better at explaining my research interests over the years, but I think it's reasonable to say the ethics push is working... In prior AAAI years, I've had to do a lot more work to explain/justify what I do and why I'm there. This year, tons of talks on such things. Not shocking, but great for my purposes/worth noting otherwise: people way more into talking about AI ethics when primed by conf organizers. Interesting discussions in general game AI workshop earlier, e.g. diff. forms of stochasticity, deeply delayed reward, deep partial obs, etc Great chats earlier with Joel Veness, Marc Bellemare, Alvin Chua, and other DeepMind folks on ALE, AI futures, etc...super smart/nice folks. Seems based on my chats with DeepMind folks at AAAI this year that they are basically as autonomous/ambitious as I thought they were. Hmm... "Singularity" prediction: by 2029 (Kurzweil's prediction for Turing Test passage - bogus btw), far fewer people will discuss "Singularity." RT @AAAIConference: Moshe Vardi speaking on "If Machines are Capable of Almost Any Work Humans can Do, What will Humans Do?" #AAAI15 http:/… Didn't get to see as many demos as I wanted to, but the AAAI open house today seemed very popular/well received. E.g. http://t.co/sxv8dXqOoA Reactions to the ethics push at AAAI this year have been mixed from what I can tell, but mostly positive. Russell talk mostly well received. #AAAI15 = dramatically more focused on ethical/social/economic/etc. issues this year than in 2013/2014, at least. Great news from my POV! :) @rcalo for more context...you can prob get slides from him/he will prob post them soon and is usually good about that. @rcalo Stuart. Context: super widely attended talk on future of AI, ethics, etc. at AAAI 15. Have complex views on FRC, appropriate role of gov't in AI and robotics funding and governance, etc. Not sold on FRC but agree w/ Russell. Russell on @rcalo and robotics agency idea: don't assume that sort of thing = nec. bad/regulate AI. Need ppl in gov't who get AI. (agreed!). RT @mark_riedl: People playing computer games that were generated by AI #AAAI15 http://t.co/AZyeM7JbVk @Aelkus thanks! and likewise! Need more, better theories of agents in general, goals, limitations - Russell. Agree times a bajillion!! Russell: big change in recent yeard is emergence and refinement of the Omohundro/Bostrom etc args replacing vague implausible risks. Agreed! Russell: deep learning progress in recent years surprising to many (himself included). Progress on "signal to symbol" problem now rapid. Russell at #AAAI15: people incredulous, shocked by 2 player poker being solved. "But surely they can't bluff?" Nope, they do it perfectly!! Braylan on frame skip in ALE environment at #AAAI15. http://t.co/RxQPc1zL7R RT @nathansttt: Here is the public playing with robots at @AAAIConference #AAAI15 http://t.co/re89JulGyt RT @mark_riedl: Demoing the Scheherazade story generator at #AAAI15. The calm before the storm. http://t.co/U56Ercn5Az From Singh's talk earlier at #AAAI15 general game playing workshop. http://t.co/TeqLy89Ejp Bowling in Q+A per my question on Atari v modern videogames: I feel like Atari should be solvable today/soon with plausible AI. Not Xbox yet Bowling: we often unintentionally test designer+algorithm. Want to disentangle to better evaluate AI progress and generality of algorithms. Bowling at general gaming/AI workshop: transfer, apprenticeship key in ALE/RL/AI. Ex. on transfer, Pitfall 1 should inform Pitfall 2 skills. Very glad that I took this utopianism class (though sad/ironic that I am missing it tomorrow cuz I'm at AAAI discussing related issues :) ). RT @WendellWallach: Archbishop of Canterbury's dystopia view of AI research and gene therapy – the politicization of AI is underway. http:… RT @mpshanahan: Nothing in http://t.co/yeSrbcUXs1 about "a race of machines" with "artificial superiority" @alvanoe - http://t.co/mIY9wdmAU… RT @j2bryson: @alan_winfield @tonyjprescott #exmachina exposes what happens when you violate the 4th @epsrc principle of robotics—even with… RT @alan_winfield: .@tonyjprescott Agree. #ExMachina strengthens my view that we shouldn't even be building gendered robots. RT @tonyjprescott: #ExMachina is more of an argument against building #sexrobots than against building strong AI @tegmark on Future of AI panel at #AAAI15: much consensus at FLI conference.; 5k+ signatures so far; step 1 of FLI application is v easy! :) I'm often asked: "What are good references on responsible innovation + related issues"? JRI = a great starting point: http://t.co/gAv3YUweHD Goose made good pts for need for foresight, planning, etc. AI ppl agreed, though some had big Qs about details of pro-ban args/feasibility. There was much richness/complexity to LAR discussion at ethics workshop (/more to come at AAAI), just trying to capture some major themes. Goose emphasized stigmatizing bad practices, norms in technical communities, etc. But consensus (him included) seems to be: LAR ban=v vague. Point made by various AI folks pace Goose on lethal autonomous robots: details of ban on LARs unclear/implausible near-term. Goose: (~)yeah. Lots of cross-cutting issues across domains/timeframes re: what we want AIs to do/not do/how, fleshing out ethics/safety notions/models, etc Have long wanted more/better exchanges btwn machine ethics, Friendly AI, existential risk, etc. ppl. Workshop today confirmed it works. MOAR Goose et al may be right + consequences of LARs existing/being used would be bad overall. Responding here to intrinsic wrongness claim only. As many rightly pointed out pace Goose, AIs/dumber tech "make life/death decisions" all the time. That's not unique to killer robots at all. ...in that many draw on that claim and/or purported intrinsic wrongness of "machines making life/death decisions". Both v problematic. (2/2) The "AIs/bots can't be (as) ethical (now)" thing is far from Goose's/others only pt. on LARs but very key rhetorically/politically/etc (1/2) Goose + others rightly point out that AIs/bots can't discriminate as well as humans today. Wrong to use as basis for long-term ban/policies. Just to clarify: I think Goose walked back the "never" point, but think he did say it/others have said it/believe such things very strongly. Will be very interesting to see Goose debate Arkin on lethal autonomous robots, moderated by Dietterich, I think. Polar opposite views, etc. ...on AI/bots *never* being able to make as good/better ethical decisions than humans were greeted skeptically by AI experts in room. (2/2) Steve Goose's talk on lethal autonomous robots at the AI/ethics workshop earlier was interesting. Suffice it to say that w/ his claims (1/2) RT @JimSpohrer: #AAAI15 Barbara Grosz (Harvard) makes point that good design is needed, not just good policy to get beneficial outcomes of … RT @JimSpohrer: #AAAI15 Panel wrap-up and Beyond Turing Test Workshop, Ethical AI and AI Impact on Society http://t.co/9wGeT7RBxc http://t.… Here are the slides from my talk, "Economic Possibilities for Our Children," at the AAAI AI/ethics workshop today: http://t.co/3HnqV8I3qO Wanted to tweet much of the AAAI AI and ethics workshop until I lost my phone right before it. :-( Suffice it to say: super fun/interesting! First day of AAAI 15 was epic. Just got back to hotel room/lost phone earlier (though might get it back soon!) hence my Twitter silence. :-) @FrankPasquale would love to see more serious examinations of robotics divide questions. only aware of one book, some papers, explicitly on? RT @astepanovich: Every tech policy person I know also doubles as the family IT professional. Found out that the Super Bowl is in AZ *next week* so I will not be out of town for the whole thing as hoped. Lame. First thought on Austin: needs way more solar. :) RT @harpistkat: After Turing and Hawking, *please* can we now have a Hollywood film about Ada Lovelace, Marie Curie or (my fave) Barbara Mc… @roseveleth epic RT @rcalo: Jibo raised A LOT of Series A money ($25.3M). http://t.co/0IAijzftwT My take on what they'll need to succeed http://t.co/u0dYhyJ… RT @ellenhuet: When we are all gone from this earth, Uber and Lyft will still be sitting in war rooms, plotting how they can undercut each … @beaucronin the AI one? that's what Edge is like... At least in the latest thing there on AI they included *some* ppl familiar w the lit :-) RT @femfreq: A couple days ago I tweeted that threats shouldn't be an accepted part of gaming. This is how some gamers responded: http://t.… RT @CSPO_ASU: See new article about CNS fellow and Miss Phoenix 2015, Kaitlin Vortherms http://t.co/OCBiQ5fUuU @rcalo DOE is also solid IMO. BTW - I realize that Wired regularly lets random entrepreneurs promote their technologies on the site...just saying...it's still lame. :) "Indeed government regulators in this space are all AI researchers, often funding AI startups with taxpayer dollars," Ibid. Huh? Who? What? TL;DR of article in last tweet [it actually is too long]: AI researchers out to get me/neurosci/everyone (?) cuz they signed the FLI letter. Why does Wired publish silly stuff like this?: http://t.co/VHElNTri2B so many weird/incoherent/false claims on AI progress, FLI letter, etc. @hermione1 makes sense! :) thanks! @hermione1 would be curious to know more about the stuff you said on varying maturities/how you evaluated that, etc... interesting stuff! :) RT @MSFTResearch: “Benefits and Risks of Artificial Intelligence” by @tdietterich & @erichorvitz https://t.co/0jcRKrhwdE RT @beaucronin: Pretty sure all the questions I had with Magic Leap about computer vision and scene rec apply equally to HoloLens https://t… "State Compliance Options Under EPA's Power Plan," Swayne Wilson et al. 2014 http://t.co/FwHvyOnIN2 Looking forward to epic discussion of EPA/coal stuff tomorrow :) Finally catching up on the details of the latest reg stuff. V. interesting. @rcalo Microsoft also seems to be saying: You want AI? I'll show you AI. :) RT @stevenstrogatz: Writing workshop for professional scientists, sponsored by @KavliFoundation and led by @GaryMarcus http://t.co/pasay8Si… RT @KavliFoundation: Enrollment is now open for 2015 Kavli-NYU 5-day writer's workshops for scientists & engineers. Info: http://t.co/uUTR… The dystopian aspects of H+ The Digital Series have more to do with brain implants than augmented reality per se, but both are explored. On Hololens and AR in general: H+ The Digital Series (https://t.co/dLea39wli8) = dystopian but has cool AR stuff. Continuum too but less so. RT @cns_asu: Guston will talk #Frankenstein, scientific creativity, & #RRI @ #SIFF Seattle this Saturday https://t.co/cMpPbMqH5P http://t.c… H.L.T. Quan (prof. of utopianism class I'm in) = one of the coolest people I've met - docu. filmmaker, scholar, etc: https://t.co/8kZQRxV7Z4 @mpshanahan seems like his beef is more with Kurzweil et al.'s laissez-faire attitude towards AI stuff than Google per se/e.g. DeepMind... @mpshanahan I thought the Google jab was especially interesting....and perhaps unfair at least re: DeepMind viz-a-viz x-risk concerns? @tonyjprescott agreed...will send you some stuff on this and would love your thoughts if you have the time! @jon_jeckell agreed! @tonyjprescott have working paper on related issues if you want to discuss :) RT @MFordFuture: What does @BillGates think about #robots taking jobs and whether #AI could threaten humanity? https://t.co/OxFscbKvl3 http… @alephbass speaking of Youtube...have enjoyed your talks on there :) would love to know more on such issues, e.g about HCI vision/goals/etc. @alephbass the stuff I've seen on there has mostly just whetted my appetite for learning more :) haven't dug super deep yet tho admittedly. @alephbass able to find some stuff via Google Scholar... I dunno, haven't watched all those videos/read all those blogs, lots of content :) @alephbass def. a lot of cool stuff there, thx! doesn't seem super technically detailed, tho...would love e.g. papers on the AI aspects..(?) Wish there were more publicly known/written about Palantir so I could compare them to e.g. Watson re: HCI, AI, etc. but just vague stuff. :/ DeepMind = super committed to general learning agents. Watson more about learnedness (?). One better at unstructured data, other structured. ... what are the fundamental limitations of deep RL in general? DeepMind et al. have to cave in and do Watson-y stuff eventually/soon? (2/2) (Cont'd) Some questions for such a deep dive could be: how hard will that vision/language integration stuff take/how good could it be? (1/2) Think I need to do a much deeper dive on deep reinforcement learning viz-a-viz other stuff inc human feedback/crowdsourcing stuff. Thoughts? RT @KatjaGrace: The slow traversal of 'human-level': http://t.co/9Grwka0Gis RT @SAWEvans: My article on “What’s the matter with Biosecurity?” is in J. of Responsible Innovation. 1st 50ppl can download free! http://t… ...also think AI could perhaps help much more than it has to date with solar (/energy in general) soft costs in other stages but less clear. Thinking that the solar scaling/automation nexus definitely needs more attention, esp. viz-a-viz desert utility-scale PV/thermal deployment. Very productive chat with Minh Le at DOE about SunShot, automation, etc. They're doing some super cool stuff there! Soft cost stuff so huge. @jrbarrat hmm. perhaps we disagree on whether name calling occurred here/where (?) and the value of snark, which I don't oppose always ;) @jrbarrat P.S. perfection def. is unattainable on anything AI futures-related so with you on that :) just think this was solid overall. @jrbarrat ....and if that is indeed the main point, I agree with that point (but again, not the whole thing necessarily). Lots of bad stuff. @jrbarrat agree on all of those counts! But don't see whom is being quashed here exactly. I take main point to be: journos, learn/read more. @jrbarrat ...and as to some of the things you mentioned, those are super commonplace in journalism on these topics anyway. This >> average.. @jrbarrat .. as to the overall message/tone, though not endorsing the whole thing...def. overstates case at times IMO, but many fair pts. @jrbarrat Unlike "he'd like AI risk convo to go away"? ;) and perhaps this comment... but anyway I just reread parts/skimmed + disagree... Just read Mike Boots now runs the White House Council on Environmental Quality now - excellent news IMO. Smart/dedicated guy + cool name. :) @jrbarrat disagree more with that set of claims or the tone or something else? Didn't seem especially rabid/unjustified to me. (2/2) @jrbarrat the author is right IMO that many journalists don't seem to do their homework on such things, e.g. on the open letter. Do you(1/2) By "which" I don't (just) mean which current products available on the market, but more broadly which R+D directions/goals/approaches/etc. To me, some of the key questions raised by "drudgery" viz-a-viz AI/robotics are: what is it, when is it good/bad, which AIs/bots would help? Advanced AI/robotics as a plausible (?) solution for "drudgery" is a big topic these days. Ng, Musk, others have made this point explicitly. Everything I said about energy in utilitarian-looking humanoid robots like Atlas is *truer* of more human-ish robots like Ishiguro et al.'s. Many energy "experts" seem to have views frozen in 2008 or b4 about the state/costs/reliability/feasibility/etc. of solar (both tech types). Solar can't power all economies, for sure, but many of these "expert" views on solar are totally out of date/unjustified given new tech etc. I would love to talk to someone who's toured or just knows anything at all about the Solana plant and thinks solar can't power an economy :) Not to mention community scale, various versions of small scale/rooftop solar, etc. Point is, in some places now, that claim is v laughable. ... the "many experts think" line is bogus/oldest trick in the book. Would love to talk to said "experts" re utility scale solar stuff.(2/2) Overall I liked that Economist piece I RT'd on solar, but would emphasize the "solar can't power an economy" thing at end is false and (1/2) RT @TheEconomist: Solar is giving hundreds of millions of Africans access to electricity for the first time http://t.co/L6LMyftPtQ http://t… Excited to learn more about a few papers in particular at AAAI soon, esp. Tractability of Planning w/ Loops, which uses laundry example. :) @jon_jeckell not mutually exclusive ;-) Drones are an interesting case study re: energy (efficiency) etc. Solar can help, but cuz solar=diffuse, perching/waiting etc super helpful. You can build all sorts of cool energy efficient robots now, but they can basically just walk around on flat ground. For more, need >energy. RT @ABI_Robotics: Japan's first #robotics billionaire - exoskeleton maker Cyberdyne Systems' CEO Yoshiyuki Sankai. #robotics @Skynet http:… Robots are super duper inefficient from an energy perspective today vs. biological organisms, hence the need for tethers, fossil fuels, etc. On "PR" stuff and Atlas: didn't nec. mean that in a bad way. Also, many good reasons for tetherless, not having smoke in ppl's faces, etc. I don't really know how quickly, today, we could mobilize humanoid bots 4 Fukushima-type stuff, but would prob. would require fossil/tether. I'm ALL for batteries, battery innovation, use in robot, etc. but my point is, the "1 hour" battery thing is NOT running around doing stuff. Can't rule out the possibility Atlas is only battery powered for PR reasons. If Fukushima happened tomorrow, we'd use diesel gen carts, etc. RT @FLIxrisk: Grant applications for our global AI research program, generously funded by @elonmusk, open tomorrow! http://t.co/NBzXLB3AZ9 ...Atlas is optimized to do heavy duty tasks, which would drain its batteries in no time if it did em non-stop (AI insufficient now). (2/2) Many cool/energy-efficient robots exist with (more than humanoid) efficient legs/locomotion in general, passive walking, etc. but (1/2) RT @ken_goldberg: Let's replace the #Singularity w/ #Multiplicity: where diverse groups of humans + machines work together to solve hard pr… RT @tiffanyshlain: "The #Multiplicity aims to supersede the notion of The #Singularity."-@Ken_Goldberg #WEF http://t.co/zscYJyaO53 Lots of great feedback on AI progress working paper, which is resulting in rapid paper progress. :) Happy to share with interested others! RT @DPRK_News: Following drunken speech to nation, Obama derided by U.S. people as incompetent. Supreme Leader Kim Jong-Un enjoys universal… It will be a while before robots of the size/force of Atlas can run for non-trivial amounts of time w/ non-fossil/non-tether power sources. implications....better techs with higher energy/power density possible eventually. Also, "1 hour" = "mixed mission" = standing a lot. (2/2) Some thoughts on the new version of the Atlas humanoid robot being tetherless: that battery is heavy/lithium-ion, which has various (1/2) So who's gonna be at AAAI in a few days? :) Undercover Bots: TV show where high profile CEOs try to do the work that their AIs/robots do for a week and fail miserably cuz wrong skills. Nothing new from Obama on climate tonight. Fail. Cybersecurity isn't my thing but if what I've seen/heard in the energy sector is any indication, US gov't stepping up couldn't be soon enuf. @robinhanson @Aelkus @lynncrees @Scholars_Stage ..so that more people can have good lives/options/+ not all such things need be zero-sum. @robinhanson @Aelkus @lynncrees @Scholars_Stage book Bottlenecks on equal oppo, for example, argues for focus on complexifying opportunities @robinhanson @Aelkus @lynncrees @Scholars_Stage seems 2 assume status/merit= 1-dimensional? if not, more can be "good" status if not "high." No doubt the core Watson team at IBM is probably far more integrated, coherent, etc. than Google writ large, but dunno about IBM writ large. @JasonOLearyUS will be out of town. wonder if i would have found out otherwise ;) All corporations are hierarchical/too top down at times to an extent but IBM seems especially so historically, dunno about today w/ Watson.. Google is definitely bureaucratic/stifling of new ideas/slow/poorly integrated etc. to some extent, just wondering how compares to e.g. IBM. Plenty of smart/ambitious people at IBM/Watson, but one key question = are they empowered/connected enough to keep up with likes of Google? RT @xuenay: A poster version of my "Concept learning for safe autonomous AI" paper: http://t.co/P6CIvBKM2g DeepMind seems more concerned about technical progress than any big commercial AI group vs IBM being more concerned about specific products. RT @iGEASmit: 5 areas for making cognitive computing robust http://t.co/YUiRqQENDo New IBM think piece on cognitive computing (PDF)...slightly more detail than prior vision/strategy statements by 'em: http://t.co/JiE9zK9JpV RT @profron: ATLAS, The Pentagon's Humanoid Robot, Just Got A Major Upgrade http://t.co/qE0FOxrsY7 #skynet May also throw some solar considerations into the mix over the next few months of work on utopia...e.g. poverty/growth/solar nexus issues. Using utopia class as excuse/venue to do research on basic income, AI futures, post-(bad) work possibilities/challenges, etc. Fun stuff. RT @basicincome: The State of the Union? It's a system in need of a #BasicIncome Guarantee... @JasonOLearyUS not me, haha found out from this tweet! ;) @Aelkus yeah overall solid doc, obv some things i would add in my areas of expertise but well caveated, researched, etc in general. @Aelkus thoughts on FLI open letter research priorities doc stuff on related issues? also see Atkinson on psychopathology of intel machines. "RT @jon_jeckell: ""Watson is Real Artificial Intelligence"" by @Miles_Brundage & @j2bryson http://t.co/eQ4Im9UFzg // Ken Jennings agrees" RT @tonyjprescott: @WiredUK have just published my article on how robots can help us as we age http://t.co/F5TzB26Hou RT @deeplearning4j: We just released an early alpha of our integration with Spark. That's right: #deeplearning on Spark with GPUs. It's buz… Kartik Talamadapula, who just finished dissertation on human-robot teamwork stuff, is now at IBM Watson. Cool papers: http://t.co/kxMJDTjJaR "Metals Production Requirements for Rapid Photovoltaics Deployment," Kavlak et al. http://t.co/jUS125Sokl Version 1.0 of AI progress paper done! :) Nowwwww The Office. Among other things, will be interested in folks's thoughts on relationship btwn analysis and synthesis in AI. Discuss some in working paper. Working paper so far fleshes out AI progress model desiderata, reviews much lit/identifies many gaps/Qs, makes a few claims on future, etc. Almost done w/ working paper on AI progress...last chance for volunteers to read/ideally provide feedback :-) finishing first draft today... RT @alaindebotton: What matters more than inequality is the extreme disproportion between merits and earning. @j2bryson + Hassabis spelled out while ago....e.g. Legg made predictions several yrs ago that make more sense now given deep RL :) (2/2) @j2bryson yeah, I think it's interesting that they have all those resources/ppl at fingertips but also are executing on vision Legg and(1/2) @j2bryson if he said that then he was def. wrong ;) but generally I find what I've read/talks by him etc. to be reasonable re: such stuff.. @j2bryson he may have/many folks there have used it in various ways. My main pt. was just that they seem aware prior/others' work has value. @j2bryson if you mean the interview with Levy... I thought he made clear/has made clear elsewhere many research probs/questions exist still. @j2bryson when did he claim to solve AGI? @j2bryson or did you object more to his point? i didn't interpret anything there as mainstream AI bashing, if that is what you meant. (2/2) @j2bryson Just watched, heard him make narrow/general distinctions (as many folks do) but not AGI explicitly...did I miss him say it? (1/2) Got "Forecasting and Management of Technology," second ed., Roper et al. Epic. H/t Phil Shapira..not on Twitter but some of you know him. :) "There is no such thing as an appropriate joke. That's why it's a joke." - Michael Scott, The Office (US). Among other things, I'm impressed w/ the design, HCI, "human-machine symbiosis" etc, NLP, + computational creativity aspects of Chef Watson. The NLP stuff in Watson is used in the Chef Watson case to iteratively make plausible/novel/well-written recipes ~instantly. V. impressive. People needn't know every aspect of/angle how e.g. Chef Watson works but should know it portends big things AI/tech/econ/ethics/etc.-wise. I worry with Chef Watson/other stuff like it, as with AI in the past, many will just see it as a cool app and not appreciate underlying AI. Chef Watson also demos some underlying/v. cool AI tech, but notably you needn't understand full details of it to come up with useful stuff. What's cool about Chef Watson to me is it combines multiple stages, types, parameters, etc. of human/machine interaction/passing of control. Google has iterative search in some respects/is cooking up more, but not familiar with anything they've shown analogous to Chef Watson... Chef Watson, the Watson app. I am most familiar with, is super well thought out from design/HCI POV. Dunno if Google thinking like that....? DeepMind folks def. know human-computer/agent interaction is key, but they (/Google?) aren't hiring a bajillion design/HCI people like IBM.. Watson folks seem to have a better handle on the AI marketplace and human-computer/AI interaction than DeepMind folks, from what I can tell. I can't rule out the possibility that Watson folks are cooking up more ambitious stuff than DeepMind behind the scenes, but not written yet. Still don't get what is really going on in the rest of Google's AI R+D ecosystem, though.. Is detailed map of said stuff available anywhere? TL;DR- there is just no equally highly funded/resourced/coherent/ambitious/credible single R+D enterprise in AI today compared 2 DeepMind :) The Watson enterprise seems similarly highly coherent + bigger than DeepMind proper (though not Google), but IBM stated ambitions are lower. My main point, though, on DeepMind stuff, is that they have a super ambitious, coherent vision and a ton of resources at their disposal now. On other hand, def. plausible DeepMind doesn't take lits. on, eg., cog. architectures/prior AI integration/etc. vs own ideas seriously enuf. In particular, Legg et al. have been talking about integrating basic vision, language, etc. into something roughly like "deep RL" for years. Many others at DeepMind (e.g. Orseau) use the term AGI favorably. There is a high concentration of such folks there...ambitious/not dumb. :) Agree w/ @j2bryson much "AGI" ignores prior work, but I consider Legg/Hassabis special cases - DeepMind (if not Google) has coherent vision. Then again, maybe those words are out of order. As of when I read of a few of the Levy articles, they were riddled with typos. Interesting to note Hassabis uses term AGI favorably, but also GAI in slides apparently. See also @j2bryson on "AGI": http://t.co/YEgBVminsD Bottom line is Legg and Hassabis (not to mention many others now at DeepMind) have thought v. long and hard about A(G)I integration issues. Many of the core ideas in Hassabis's interview have long been in the (gray) literature - e.g. interviews with him, Legg's blog posts, etc... Hassabis interview (last RT/one of a few new Levy articles on related stuff) underscores DeepMind's emphases on integration + collaboration. RT @lispmeister: The Deep Mind of Demis Hassabis — Backchannel — Medium https://t.co/QhiBGoIcCE There's a very interesting literature on technology roadmapping in general. Not sure how often it's used vs. people doing stuff ad-hoc-ish. ICYMI "The Evolution of Technologies: An Assessment of the State-of-the-Art," Dosi/Nelson 2013, key ref on tech prog: http://t.co/wHYPYmfLNm RT @beaucronin: These claims from @StevenLevy’s article on deep lrng at GOOG are problematic in several ways https://t.co/WAYAgI6OZs http:/… "RT @beaucronin: ""a so-called neural network of machines"" So called by whom? http://t.co/KBO3mXO0OR" RT @beaucronin: "[DL] is a type of machine learning that mimics how scientists think the brain works" And which scientists are those? http:… "RT @beaucronin: 1. The “like the brain” claim is…tenuous 2. Adherents don’t actually make it very strongly 3. DL means a lot to GOOG beca…" .. a well-edited collection of essays surveying various ethical aspects of/Qs re: work, e.g. right to (not) work, alienation etc. Cool book. After reading some "future of work," basic income, etc. stuff lately, will reiterate my (now stronger) rec: "Phil + Probs of Work: Reader".. RT @karpathy: Steven Levy has a few new articles on Google / Deep Learning + Geoff / DeepMind + Demis https://t.co/lKKZJdBStT RT @amcafee: Reefer sanity: after a year of legal pot, Colorado is not yet a wasteland of ruined lives http://t.co/Ycwwzvquym Hard to say much about future post-(bad)work world with very different policies/technologies/social norms etc. based on existing policies... My initial hunch on the empirical vs. theoretical aspects of the BI lit.: not enough data yet, social/future stuff is hard 2 predict anyway. Empirical analyses/interpretations of the history of BI/related policies seems very contested/complex. But theoretical args. seem plausible. Many in the basic income literature argue (well?) that strong BI gives people more flexibility, autonomy, etc viz-a-viz work quality/choice. Diving into the literatures on basic income, drivers of work quality/work options, and relationship between the two. Very interesting stuff. @Aelkus indeed/agree 100%.. tho also matters a lot if ppl can have code running on own comp, can edit etc not just user friendliness per se @Aelkus latter would intrigue me more but former cool too ;) @Aelkus havent looked closely at the JS watson stuff..it is for interfacing w legit watson stuff not eg reverse engineering of watson right? @PabloRedux both good Qs I could go on at length about but working on paper explaining related things now so happy to share that soonish :) Will be interesting to see how much further deep neural networks can be pushed viz-a-viz NLP (e.g. Socher et al. do surprising stuff w/ em). Similar things apply to energy viz-a-viz developing countries...huge opportunities but how can/will they seize? Not entirely clear. No doubt there will be many huge AI/bot enabled economic growth/development etc opportunities for developing countries, Qs= if prepared, etc 1 key concern I have with automation writ large viz-viz global poverty is ~what sorts of growth options will be available given AI/bot prog. Automation and innov. in general can help developing countries in all sorts of ways, big Qs on how to get most out of it, fund R+D, etc tho. E.g. see debate on skill-biased technological change: super related to e.g. developing country edu./innovation system stuff. V. interesting. Lots of super interesting papers/books etc. related directly or indirectly to automation/developing country growth opportunity stuff. Hmmm.. RT @ylecun: FAIR is open-sourcing a super-fast deep learning package for Torch. http://t.co/D9qReQr00I @merylalper @gleemie awesome work!! I also cite some of @gleemie's Mech. Turk work/discuss related issues here FYI http://t.co/rVkqVu30pu RT @BarackObama: Retweet if you believe solar energy is critical to America's future. #GoSolar RT @etzioni: Ocean Life Faces Mass Extinction, Broad Study Says, http://t.co/yZQIi2CFJt @Aelkus in other words don't need to know everything or history, just stylized facts (for now that is. want to read/learn moar one day). :) @Aelkus + stuff that speaks explicitly/implicitly to change over time in the field, plausible futures, ditto 4 lower levels of analysis, etc @Aelkus I am not sure on texbook vs handbook vs buncha papers, etc. but looking for best (besides misc. related stuff I've read already) + @Aelkus was just saying stuff on Levesque but assuming he has multiple related books (?) @Aelkus be more specific? Seems like Brachman & Levesque's textbook would be solid, but also some handbooks look cool, etc. Anyone read any cool textbooks on knowledge representation and reasoning/recommend one or two in particular? RT @hannahgais: Must read ---> RT @WIRED Opinion: President Obama is waging a war on hackers http://t.co/5u9h1QnCMs @rcalo sooo gooood...I finally got into it like a year ago and am now totally obsessed. enjoy!! :) + agents/robots about plausible futures, how can high level understanding of field/plausible futures inform R+D decisions today, etc. etc.. By "analysis" I am trying to be inclusive of theories about the past/future of AI. So e.g. what do people know based on experience building+ More on synthesis/analysis in AI: Kim (1990) makes strong case that they are complementary, theory under-valued etc.. Raises interesting Qs. Laurent Orseau (super smart/ambitious AI researcher) now works at DeepMind- has many interesting recent publications: http://t.co/yj7cKNOfbk RT @ylecun: A sane reaction to the insanity surrounding wild claims about the dangers of AI. http://t.co/heCTzM361r On synthesis/analysis in AI: in general, synthesis prioritized today. Analysis lagging in e.g. deep learning now. Phil/theory help bridge 2. RT @FLIxrisk: We are delighted to announce a $10M donation by @elonmusk to create a global AI research program at FLI! http://t.co/NBzXLB3A… RT @mpshanahan: Accurate critique of media coverage of #AI: "An Open Letter To Everyone Tricked Into Fearing AI" http://t.co/YvVXW5ePhK via… Will be super interesting to see what sorts of research @FLIxrisk funds. Given white paper, will be super diverse, probably, which is good. One of the key challenges in an open FOA is getting a bajillion experts to actually carefully review (multiple) submissions. Non-trivial. :) Open FOAs are just intrinsically hard to manage, but they can be done better or worse. ARPA-E does it super well/has improved much over yrs. Of course @FLIxrisk will have issues deciding what to fund...will get a bajillion applications. They could talk to @ARPAE about open FOAs ;) Overall the FLI thing is super positive IMO. Letter received broad support, is well-written/has good white paper, funding thing seems broad. TL;DR AI letter stuff: FLI letter says AI ethics/safety/etc raise big Qs, here R some ideas, @elonmusk says yup, here's $10 mill 4 research. RT @sabinehauert: Excited to listen to the first @TlkngMchns podcast on "Machine learning and magical thinking with Ilya Sutskever" http://… RT @elonmusk: Will be building a Hyperloop test track for companies and student teams to test out their pods. Most likely in Texas. Still, one can learn/be provoked in many ways by Bringsjord's work, esp. recent economics/AI prog. stuff regardless of consciousness Qs IMO. Think Bringsjord's arguments on machine consciousness ground out in stuff I/many disagree w on e.g. free will, but haven't read all of it..? Still don't fully get Bringsjord's views on logic and consciousness (he has many :) ), but def. agree w/ him on many Watson-related things. Selmer Bringsjord writes many interesting things on AI progress-related issues. Interesting cluster of POVs on phil of mind, AI, logic, etc. Not convinced air-conditioned clothes per se is the answer but def. thinking outside the box on energy efficiency/building stuff is great. RT @WIRED: Elon Musk donates $10M to keep AI “beneficial to humanity" http://t.co/RGLeBVKl5N Can't speak to tech details of the Cornell project (Ibid) but was involved in brainstorming on related things once...reaction to big issues. Specifically, for ~air-conditions clothes. RT @ARPAE Check it out! @ARPAE awards $3M grant to @Cornell researchers: http://t.co/fQnOG4r9h0 Recs papers/books etc. that speak to my last few tweets would be very welcome! :) ~Neuro/AI futures and their plausible interrelationships. Of particular interest to me in "future of neuro" lit are ways in which brain stuff could inspire/supplement/supplant/change/etc AI methods. RT @TlkngMchns: Ep2 Ilya Sutskever, magical thinking in ML, we start thinking about talking about ethical q's in AI #machinelearning http:/… The huge lit(s) on what neuroscience could plausibly accomplish soon-ish (e.g. in Future of the Brain) is super intriguing from AI prog POV. Working on AI progress working paper...starting w/ lit review, gaps, inspiring examples, + some v preliminary syntheses/takeaways. Thoughts? With 10 million dollars to give away, a conference under their belt, the open letter, etc. FLI is now a super big deal in AI. Interesting :) In summarizing the state of play in long-term AI risk/safety research to someone a year ago, I said ~ "dunno bout FLI." A lot's changed! :) What do people think of Vicarious and their AI stuff? Lots of interesting papers by e.g. Legg on definitions of human/machine intelligence, their interrelationships, etc. Need to reread those :) We know "human level" AI is vague, not what we actually (only?) want from AI, etc but maybe some dimensions/domains of "HL" can be salvaged. "Human level" AI is sometimes problematized in lit but more often used as a super vague benchmark that should be disaggregated/defined etc. Decided that in addition to surveying "AI progress" literature in general, should go deep on "human-level" and its ambiguities/discontents. Sutton has been talking about Singularity stuff, RL as a unifying theme in AI, AI progress as fast now/soon, etc. for a while. Interesting. On those FLI AI conference slides - interesting that (not just there but before) Richard Sutton (co-wrote "the" RL book) is v bullish on AI. Many slides are now available from FLI's recent future of AI conference in Puerto Rico. They can be downloaded here: http://t.co/SOwU4cuQa6 RT @elonmusk: Funding research on artificial intelligence safety. It's all fun & games until someone loses an I http://t.co/t1aGnrTU21 RT @erikbryn: There's more slack in the labor market than the unemployment rate implies -- @econjared http://t.co/sclWC3EcrB "RT @RoboEthics: Fostering a culture of shared values: designing with ethics in mind From time to time, peopl... http://t.co/o29nz3AUkh" RT @SusanaBorras: Research Evaluation and Policy Learning http://t.co/aJRlnlmqj5 @Aelkus @pmarca MetaMind is cool in that respect - super user-friendly deep learning. :) Could be more user-friendly, but great start IMO. @robotenomics btw, just noticed that info's not in that article. is in others, tho, e.g. one i tweeted earlier - him saying clone v storm :) @robotenomics Clone Trooper, not Storm Trooper - he said so himself ;-) and he's right about the distinction, which is amazing!! :) 7 yrs.. @Aelkus @pmarca Yep! And tons of folks working on that :) @smc90 Asimov makes related pt in essays in Robot Visions, analogizing AI/bot stuff to (some) aristocrats being into arts, education, etc :) RT @FLIxrisk: Heard about our open letter? Check out the priorities supported by researchers for robust & beneficial AI development http://… "Mostly" AI folks maybe was too strong. "Many" def. is true - hundreds at least. Dunno what percentage, AI vs. robotics vs. other stuff etc. Case anyone cares, the AI open letter grew exponentially, tapered off after blowing through 1k, still growing, mostly AI folks, misc others. RT @susie_c: Find all of my and @sarahjeong's ongoing illustrated coverage of the Silk Road/Ross Ulbricht trial at Forbes: http://t.co/88Y8… @sarahjeong @susie_c Y'all rock!! Can say from experience Majumdar puts an epic amount of work into his talks. Ditto for Steve Chu. Both have epic energy talks on YouTube. :) Majumdar's views = interesting/worth listening to in general, just sayin, YouTube is convenient, he gives epic talks, my old boss, etc.. ;) Super duper highly recommend that (https://t.co/3vSjKuZ6pG) Majumdar talk. You'd be hard pressed to find better take on energy on Youtube :) "Energy and the Industrial Revolution," talk by Arun Majumdar: https://t.co/3vSjKuZ6pG ICYMI "What We Instagram: A First Analysis of Instagram Photo Content and User Types" http://t.co/dHgjv4Avd2 Related: http://t.co/ezxvmGfcoY @hannahgais shows major institutional/system level/leadership etc. levels, not really resolvable by any one person...culture, etc. @hannahgais omg people/Gelb said that? facepalm.. @hannahgais HK? There's a whole thing about pet cloning as "softening people up" to human cloning in The 6th Day. Interesting stuff. The Sixth Day is particularly interesting for how it portrays the politics of cloning and related things..silly in many ways but not 100% :) In The 6th Day, Arnold's friend has a virtual reality girlfriend. Super ambitious movie in a lot of technology vision-y sorts of ways. @chenghlee not to the same extent perhaps... but still. hits some key nerdy notes. @chenghlee lol that could work on a wide array of nerds :) @chenghlee could be win a date in five words if it's an ML persona, lol :) Epic chat with Tony Barrett at @GCRInstitute on AI progress, AI risks, research strategy, etc. They're doing some super cool stuff there. :) RT @therobotreport: SoftBank/Aldebaran Pepper robots go on sale in February for $1,700 in Japan. http://t.co/eOXVW4qZMW Also lots of cool feminism/civil rights/globalization/etc. social justice-related stuff. Hope to develop some AI/utopianism papers in it. :) Super glad I took this class on utopianism. The syllabus is basically all sci-fi or serious utopia(s)/-nism studies I want to read anyway :) @SuzanneWaldman which ones?/what percentage? etc. Yes, taking oil industry raises flags, sometimes addressable, sometimes not. :) ICYMI "Tractability of Planning with Loops," Srivastava et al. at AAAI '15, laundry used as example of loop learning: http://t.co/20ntfQc0hB @Aelkus @traviskorte @chrisalbon @treycausey @joshuafoust Here's the latest one from them that's super relevant here: http://t.co/Pp8dOyKZdE @Aelkus @traviskorte @chrisalbon @treycausey @joshuafoust Rao's page/publications/dissertations advised etc. FYI :) http://t.co/cN6zp7P8ik @Aelkus @traviskorte @chrisalbon @treycausey @joshuafoust only skimmed cuz know him/relevant papers ~well but epic tome for others I'll bet. @Aelkus @traviskorte @chrisalbon @treycausey @joshuafoust if you want a serious review of related stuff, see Talamadapula's dissertation. @Aelkus @traviskorte @chrisalbon @treycausey @joshuafoust + stuff and it's super interesting, e.g. H-R/A teamwork, planner as mediator, etc. @Aelkus @traviskorte @chrisalbon @treycausey @joshuafoust Thomaz, Shah, Scheutz, etc. doing fascinating stuff. Most familiar w/ Rao's lab's+ @Aelkus @traviskorte @chrisalbon @treycausey @joshuafoust totally agree on hotness of the lits you mention. Great other ex.'s: Rao@ASU et al In that paper I use a broad meaning of "machine ethics" which includes e.g. "Friendly AI," etc. (which in my biased opinion is useful :) ). Paper I wrote a while back on why machine ethics is hard, relevant to AI letter stuff (slightly more optimistic now): http://t.co/uReE2QBEz2 @jon_jeckell Robopocalypse is also good in that respect. Haven't read Robogenesis but suspect something similar. See also: Delete on Netflix @jon_jeckell indeed, some super hot work right now IMO leverages human/AI skills like fancy crowdsourcing stuff drawing on/coordinating both @jon_jeckell e.g. learning about nature, experimenting on humans, etc. more plausible than a clumsy attempt to wipe them out. @jon_jeckell oh, not saying it was a good example of efficient extermination. just a good example of other stuff it could do to/with humans. Signed up for @xdotai, hope I'll get a chance to actually try it out sometime soon (wink wink @xdotai :) ). Sounds v. interesting/ambitious. RT @jon_jeckell: @Miles_Brundage Assuming (which I do not) that an AI would want to get rid of humanity. Unless it reads 4Chan. Then we are… RT @jon_jeckell: @Miles_Brundage Why not trick humans into bio-engineering a really nasty pandemic cloaked as a cancer cure or something? @jon_jeckell Robopocalypse more realistic (tho flawed) in terms of what superintelligence does to/with humans. RT @jon_jeckell: @Miles_Brundage And building robots to hunt the remnants of humanity down after nuking us seems awfully inefficient @bengoertzel nvm saw Monteverde - don't remember that/CR geog...fun country though regardless :) @bengoertzel Where in CR? loved manuel antonio :) RT @karpathy: Baidu gets 6% ImageNet top 5 error (prev state of art 6.6% by Google) http://t.co/YReQXQONY2 lessons: moar GPU, moar data aug… Think mapping, bibliometrically etc., AI as a whole/parts thereof as well as the evolution of ethics in AI both = ~semi-tractable. Thoughts? RT @BanKillerRobots: #Australia's @CIO_Australia's @Rebecca_Merrett reviews autonomous weapons aspects of @FLIxrisk call by AI experts: htt… I don't say "~zero value" etc. lightly...e.g. I think The 6th Day has non-trivial value. But Inception....ehhhhhhhhh no it's just fun stuff. As far as I am concerned Inception is an awesome movie overall but has ~zero value from a sci-fi-as-engagement-with-future point of view. :) Haven't seen all of Person of Interest yet but seen some eps/some finales, it's super gripping/entertaining. Dunno bout AI plausibility yet. @michaelccata @AppCharlie thanks for the rec! Will check out! :) Dunno about the stuff on pets' memories etc. being recreated, just referring to poss. of making similar looking pets/gen. engineering em. Emphasis on "potentially" :) Anyway, that's one thing I like about The 6th Day in terms of sci-fi-ness. Not all of the movie The 6th Day is well thought out but the bit on pet cloning as a potentially huge market is for sure. Super well done. 6th Day: "God doesn't want you to go in [pet cloning store]."-protester. "Well, then God shouldn't have killed my dog."-Arnold. "Atheist!!" Funding from big names is cool but only if those big names know anything about AI. Musk does, dunno about Kutcher. :) Technology fundamentals and design/execution are perhaps two of the key attributes of AI-as-assistant startups. Other stuff 2 but both key. Yes, many factors affect technology adoption, but it is a super duper competitive market. It can't all be spin/hype/branding/design/etc. One of the central questions with any AI-as-personal-assistant start-up is if they are actually competent in AI. If not they have no chance. RT @amcafee: The Surprising Benefits of Solitude http://t.co/xjz4Jfa23F And if they don't have such a coherent/plausible vision, some aspects of their business are in big trouble. Not sure about shopping stuff. My question re: Amazon is if Bezos et al. actually have a coherent/plausible vision for how to profit from AI + robotics. If so, huge deal. ...and I can say from experience they have a non-trivial role in the AI community in terms of funding stuff/recruiting smart people/etc. Clearly a bunch of Amazon's robotics stuff (at least the way they hype it around shopping season) is PR/BS/etc, but they are doing things... Way less clear vision of Amazon's competence in AI/robotics than some of the others. Could be HUGE if competent R+D management/strat.-wise. Also fair to say IBM/MSFT/Google etc. prob won't buy the others anytime soon but that doesn't tell us much about near-term AI market issues. In a couple cases it is fair to say what's going on with high confidence, e.g. MetaMind won't be bought by Google. Dunno who else, though. It seems fair to say a non-trivial number of AI startups expect/hope to be bought by Google et al. Unclear what fraction exactly vs. v indy. Also interested to hear what people think is likely/plausible w.r.t. AI assistant startups competing against/being bought by tech giants. :) The 6th Day and Demolition Man are just two examples of sci-fi movies that (correctly?) envisioned interesting semi-autonomous car designs. Have a few thoughts on specific startups/the challenges involved in AI-for-personal-assistant-stuff but don't have super strong views/faves. Can anyone who knows about the details tell me ~what I should think about the current batch of AI startups doing personal assistant-y stuff? My working explanation for the glowing back thing in the BSG miniseries is it was just poorly thought out and they pivoted back immediately. There's some attempt to resolve these things in Season 4/Caprica but really there can be no full resolution to the early "superhuman" stuff. I have always assumed that Cylons have human-ish conscious experiences, but legitimate Q's could be raised given (maybe) diff substrate etc. FWIW, I think BSG (let alone extended Battlestar universe) more than recovers from early missteps on Cylon details in S4, but still unclear. The whole Cylon detector sub-plot is also super ambiguous/misleading in some ways with respect to Cylon biology/DNA or lack thereof/etc. As I've mentioned before, the glowing back/Caprica Six thing on the mini-series and various "Cylons as superhuman" moments cause plot probs. Think this kid asked me one time something about the nature of consciousness/biology in Cylons, which is super astute cuz poorly explained. Comicon/similar events are prob. my favorite events to participate in panel-wise since you get epic questions from super nerdy kids, etc :-) Wish I could remember this kid's question on BSG/Caprica one time, but it was brilliant/super informed/nuanced...about consciousness maybe? Not surprising that teenage kids would be savvy on sci-fi, but more impressed by e.g. tweens/younger who are experts on some sci-fi domains. I'm often impressed by the level of kids' understanding of science fiction. Gotten some of my sharpest Q's ever on e.g. BSG/Caprica from em. CLONE TROOPER ARM!!! SO GOOD. http://t.co/IxQvLlDPRR Liam is right to distinguish btwn Storm Troopers and Clone Troopers/to want an arm based on the latter. See e.g. Ep. 7 trailer discussions. "The boy thinks the new arm is not only “extremely awesome,” it’s lighter and easier to move." Ibid again. Cool story. And cool arm. :-) "'Liam wants it made clear it is a Clone Trooper not a Storm Trooper arm,' said his mother Ryan Porter." Awesome kid. :) Ibid. 7 year old kid gets epic 3D-printed Star Wars-themed prosthetic arm: http://t.co/jBd8897lGP @jon_jeckell same. arbitrary length is fine if the quality is infinitely good :) and in Capital's case, the quality is high. It's just big. @jon_jeckell same, but for me it's so closely related to my interests and @robotenomics told me it's worth actually reading, so doing now :) @jon_jeckell yeah for me it is completely inexcusable to not read it immediately, or I would be more daunted by the length. @jon_jeckell ...in particular given that strategy in general is super hard/intractable etc. and he seems to get that, soooo dunno. @jon_jeckell yeah my key question is how much insight he gleans from the history that is above and beyond just facts/narratives/etc.... @jon_jeckell but do let me know if you read it soon/love it!! :) @jon_jeckell hmm so the Q for me, as always, is: do I have to read it before my upcoming talk ;) def not as urgent as e.g. Capital.... RT @binarybits: Bitcoin bloodbath: down almost 30 percent in the last 48 hours to less than $200. @jon_jeckell would also count him as "super serious(ish) person" in some relevant areas :) enjoyed Terror and Consent for example. @jon_jeckell nice. can't speak to the other stuff you mentioned but will also add the Bobbitt blurb carried much weight for me re: Freedman. @jon_jeckell ah, yeah, Freedman is super serious. Just Q (for me) of relative urgencies/epicnesses ;-) @jon_jeckell and good luck w/ the project/exam! :) @jon_jeckell nice. will be curious to hear your thoughts on 1 and 2 there, as well! Both on my list eventually, #2 being slightly higher. @jon_jeckell Also discussed in Bostrom's work ;) highly recommended. @jon_jeckell Much discussion of this in Bostrom's Superintelligence. Nor would I agree with "Forget Cylons" because Caprica shows the complex origins of them, too, and their rise not being remotely inevitable. I don't actually agree with "Forget Skynet" as a title (then again most titles are problematic). In T3, evidence Skynet coulda been stopped. RT @jon_jeckell: This raises some interesting possibilities about emergence of Artificial Intelligence http://t.co/kpJUEZKu7S (caveat: have… @jon_jeckell I've long thought Person of Interest was a big area of weakness in my AI-in-sci-fi knowledge and have enjoyed it when watching. @JesseJenkins paper link being weird for me but google "Graffy solar death spiral" and it comes up, also vid of talk http://t.co/jXOXOdb5eR RT @GaryMarcus: novel machine learning algorithms from neurally-inspired architectures - great call for research proposals, due 3/13 http:/… @mdelachang well, that explicit reason/stuff related to opportunity costs, but also I just hate learning languages :-) @JesseJenkins havent read in full but seems relevant/she is super smart if you don't know her yet :) @mdelachang still glad I gave up Chinese for this reason ;) RT @mdelachang: First speech to text, now picture to text in google translate app. Very cool. #wordlens >> http://t.co/i7rTSXO1Dv via @goog… @JesseJenkins nice! related: have you talked to Elisa Graffy and/or read her paper on PV and utility "death spiral"? top stuff on said issue @SpencerGreen111 likewise! @SpencerGreen111 seen a season* :) @SpencerGreen111 indeed - season a season or so. plan to finish someday. @SpencerGreen111 Nice. Yeah, I really enjoyed what I watched of SG-1. Powered through the first season or two super quickly :) Looks like I might have good reason to visit Portland for first time soon: this epic HRI workshop! :) h/t @RoboEthics http://t.co/NAPuTKv28Y @SpencerGreen111 hmmm sounds interesting, SG-1? only seen some of that/not much of the other series... "Reactions of People with Parkinson's Disease to a Robot Interviewer," Briggs et al. 2014 http://t.co/1m5z76gcHQ Abstract I just tweeted builds on much earlier work by Kartik Talamadapula while in Rao's lab/now at IBM - papers: http://t.co/6YyWodcavF Last tweet was an extended abstract...long title so couldn't fit that info in. :) Interesting stuff. Human-agent/robot teamwork = super hot. "Automated Planning for Peer-to-peer Teaming and its Evaluation in Remote Human-Robot Interaction," Narayanan et al. http://t.co/Pp8dOyKZdE RT @CostaSamaras: Rules to reduce methane leaks make sense & will have impact. http://t.co/o6hqf1De0V. @PauliJllo is an expert on this: htt… Besides stuff like the CHC model of intel., much AI-relevant stuff in that lit on e.g. the question of how to interpret one task in context. While not straightforwardly portable to AI for testing purposes, the human intelligence literature is super relevant to AI evaluation stuff. In addition to being noteworthy for their ambition/resources/demos/etc., DeepMind was also super involved in the open letter on AI stuff. Haven't read this book on biofuels in the "The Rightful Place of Science" series but prob should, Alic does cool work http://t.co/osQDY0ItLT I also recommend this other cool/short/cheap book in that series, on the politics of science and technology: http://t.co/7NTcTpT3eX ICYMI cool/short/cheap book with many case studies on gov't role in energy innovation, inc. my solar thermal one: http://t.co/6lEw0qbFSX BTW, when I say "AI safety issues" there I meant long-term ones. Short-term safety issues are a more complicated situation. Lots of progress on AI safety issues in the last few years. Bostrom's Superintelligence summarizes a lot of that work/progress really well. Another connection between that BSG article and the AI open letter: @danieldewey is cited in former/1 of the lead authors of the latter. :) One big thing that's changed since I wrote that article is that I would now cite Superintelligence. Sadly the book didn't exist yet then. :) I would definitely also update my estimate of how many people are working on AI safety issues (let alone AI ethics). Dunno exactly how much. Overall, I think we are in somewhat better shape today in terms of responsible innovation being taken seriously in AI vs. when I wrote that. On the AI open letter: this thing I wrote on the 10th anniversary of BSG gives some institutional/historical context: http://t.co/Tli0uJtF6k My analysis of deep learning viz-a-viz AAAI was shallow ;) i.e. based on paper titles, but seems fair. Isn't/shouldn't be AAAI's main thing. Seems like there's a little more deep learning stuff than last year at AAAI in a few weeks, though still a very small fraction of papers. @hannahgais it's a veiled threat from Skynet. RT @hermione1: Elon Musk: SpaceX will hire up to 1,000 people in new Seattle office http://t.co/gZYMSu51DE via @GeekWire That paper also had state of the art results on some Twitter stuff but meh, that's like every AI paper, dunno if I should be intrigued. :) Don't really know much about the domain/challenge in question in the example in said paper (protein prediction stuff), anyone have thoughts? Source code for TODTLER...."will be available soon." Hope it actually is cuz it seems super cool/cutting edge/general based on that paper... TL;DR that paper: they introduce a framework for deep transfer learning using Markov logic networks. Don't get all of it yet but seems cool. They go on to say they specifically use Markov logic networks, etc. Interesting stuff. "TODTLER views knowledge transfer as..process of learning a declarative bias in the source domain and transferring it to the target domain." Van Haaren et al. at AAAI 2015, "TODTLER: Two-Order-Deep Transfer Learning": https://t.co/uOWUYMH6wM TL;DR Legg basically argues in that post for a portfolio approach to funding a variety of organizations/people working on AI safety issues. 2009 post from Shane Legg on "Funding Safe AGI" - just as/more relevant today in light of AI progress since then: http://t.co/Rrxd7W0hgx Strumsky dropped some serious knowledge bombs on me earlier re: solar progress modeling. SunShot is funding lots of cool work on that issue. One more plug for Strumsky's work - super interesting stuff on all sorts of things related to innovation + technology http://t.co/6M8NKejKKc For more nuance on Moore's Law, Wright's Law, and related issues than my last few tweets, see e.g. http://t.co/jOWJxRqC2c +their other stuff There is no Moore's Law for solar in strong sense. There isn't even Moore's Law for computers really, +Moore's=special case of Wright's Law. And more specifically, there is not a ton we can derive about the trajectory of soft costs in solar from anything remotely like Moore's Law. In particular, I would note that Moore's Law has been super problematized in the relevant lits in various ways viz-a-viz solar prog analogy. Having just talked to top expert in solar progress today, can say 100% the discussion in last RT=simplistic, but solar potential=def huge :) On last RT: don't agree with all of it, but do agree with the solar bullishness. :) RT @PeterDiamandis: Thinking exponentially applies to energy and infrastructure too. Some good ideas from @tgm - http://t.co/4PjlzByMOx As I've said previously, it's interesting that Russell/Norvig is assigned in basically all intro AI classes, but not nec. the ethics stuff. Russell/Norvig = ultimate ref. on pretty much all things AI-related and even excels at AI/society stuff. = context for my book/paper recs ;) @paulonabike I hope he does sorta because he isn't cut out to win elections. :) That Netflix documentary humanized him a bit for me, though. Suspect various folks will find things to disagree w/ in Atkinson's tutorial but overall IMO it's an epic survey of AI/bot stuff. Recommend. Ibid "intended for technical individuals who need more familiarity with the enabling technologies of autonomous systems." ~achieves that IMO Atkinson's tutorial also reflects his view on human-agent/robot teamwork in general to an extent, but mostly on state of the art in AI/bots. Another killer ref on AI progress is David Atkinson's fairly comprehensive autonomous systems tutorial. It's p. epic: http://t.co/dR5b4a7fer RT @yksnpnwrbrhsa: Here's my impression of Gordon Ramsay at a wedding: "this chocolate fountain is a bloody disgrace". Thank you. @Aelkus Van Jones (2012) has interesting analysis of Tea Party and Occupy Wall Street through political variation of swarm/CAS etc. lens. @Aelkus @MrMeritology nice to meet you btw :-) @Aelkus @MrMeritology sounds great! Russell, any publications/etc. you'd point me to first on your work, esp related to issues I mentioned? Put differently, now that I have a framework for responsible innovation in AI and AI-in-econ, I need to know domains/Qs to apply it to. :) Already have pretty good handle on my long-term research questions/goals, but dunno what's most pressing in 2015 - AI prog model? solar? etc More specifically, what do you wanna know that I could plausibly answer immediately or after some research :) TL;DR recent tweets: thinking lately abt exploration/exploitation issues in research/writing. What do you wanna know about solar/AI futures? Advice welcome on all said issues! Like I said, know I could improve but not sure how much/how quickly/how much those issues will endure...? Guess I do like some aspects of learning a programming language, but mostly I like thinking about the problem. Sidetracked by other stuff :/ If I could always use the same IDE/language, I'd probably be way more into programming, but getting random new stuff working is always hard. Would like to think I could figure out some of the command line shenanigans if I programmed more/took classes but sorta chicken/egg problem. The stuff that annoys me about programming is mostly not the actual coding itself which is interesting, it's e.g. command line/install crap. I follow a few aspects of that model ;) not sure if I'll ever get a programming-centric job, though. TBD. Super bad at it now. I have met/heard of/read abt a non-trivial number of people who follow more or less the life plan @tegmark describes. http://t.co/EBuU4i1Lik Can/should never fully eliminate uncertainty about future of AI and society, but scenarios can help identify risks/opportunities/be robust. #NAME? Lawrence Krauss's commonly made pt. that if he knew better idea for research, he'd be doing it, is applicable to discussions of AI, in (1/2) Relation between assumptions/models is itself an interesting thing to debate...so will start w/ literature review/gap analysis. Make sense? Putting my point in last few tweets somewhat differently: to me, key next step on AI prog is building detailed models, debating assumptions. ...Q is what levels of analysis useful. Good metrics ~easy to come up w/ (e.g. how hard is task?). Trick is good confidence intervals. (2/2) On the hardness of coming up with useful AI progress theories: sufficiently advanced one indistinguishable from full AI built today, so(1/2) Have not even remotely come to grips with all of that book but among other things, has provoked me on relation between analysis + synthesis. Ambitious framework Kim (1990) puts forward for thinking about intelligent systems (attached). Rest of book explains. http://t.co/S2Sq727Jte Also still have much to learn from the late James Albus. Wrote a ton on AI progress/econ/utopianism-related issues. Only read some so far. Designing Intell. (Kim 1990) is far and away the closest I've come so far to finding coherent model of AI progress. Much to build on there. Gather from @Aelkus's praise that Vernon's latest book is prob. v. relevant to AI prog. stuff too, will read soon. + Designing Intelligence. Other examples of people saying useful things on near-ish AI progress stuff: Gomila/@VincentCMueller's "Challenges" paper, AIMA in general. RT @danieldewey: Christiano's ideas for next steps on long-term AI safety: https://t.co/Z9cM9S3Lmz Could go on and on about those pages/the CHC model in general/have to some extent already but anyway, would be curious what people think! Unfortunately that example as currently written uses jargon from the CHC model of intelligence but much of it is clear anyway, I hope/think. Already shared one example of such inspiring frameworks - see e.g. my pics on here, last few, for pics of section in a human intel textbook. Lots of said examples come from the literatures on human/non-human animal intelligence, others from AI/mostly ignored by AI folks to date. #NAME? Gonna have lots of impressive examples of AI progress-related stuff to show soon...impressive in that they synthesize large bodies of (1/2) Thoughts on all that welcome! Not to mention offers to read AI progress-related drafts ;) Have a few already but more always welcome! Next step on solar is to continue getting feedback from people who know about solar/soft cost issues, eventually merge that w AI prog stuff. + that speak most clearly/usefully to AI progress modeling issues, highlight inspiring examples, and outline next steps/collab stuff. (1/2) Next step from recent feedback: having explained AI progress modeling desiderata to my satisfaction already, will review literatures (1/2) @JesseJenkins @CostaSamaras @mackaymiller technical/social plausibility evals, solar scaling, public CC views. happy to discuss all/more. :) @JesseJenkins @CostaSamaras @mackaymiller indeed! in broad strokes, key topics discussed earlier/open Qs=integrated energy/climate pol,(1/2) @rcalo darn... pride myself on not knowing about it until it's happening and I find out about it on Twitter. Now I am ~aware it's soon! ;) Epic chat with @JesseJenkins on energy policy, climate change politics, solarbotics etc. Many new research/collaboration ideas produced :) "The twin ironies [liberal/conservative ideas vs recent tactics/strategies/successes/failures] ought to be cause for some reflection." Ibid. "These [Tea Party] rugged individualists have enacted the most collective, cooperative strategy for taking power in [US history]." Ibid. "The Tea Party re-presented [small conservative groups], not "represented," but re-presented them to the public as something new." Ibid. "The Tea Party understood that a smart movement does not have just one charismatic leader but acts as a charismatic network." - Jones 2012. RT @BadAstronomer: FYI: Earth science, including climate study, is ~10% of @NASA’s budget. NASA is a world leader in global warming researc… RT @hannahgais: it's a lot more accurate to call the ideology driving Islamic terrorism "radical Islamism" than "radical Islam"—one's inher… @hannahgais exactly. one of my fave classes ever was on political Islam...wish more ppl knew meaning of Islamism @thekibosch crock pots are good as is Fix It and Forget It cookbook. Big fan of Greek Chicken/Potatoes. Another pt on AI/solar/bots/labor (in short, solarbotics): most solar ppl seem basically unaware of recent AI/robotics progress, vice versa. Tentative conclusion based on early feedback: my thoughts on solar/AI/bots aren't totally crazy, many would be interested if case made well. Epic chat with Deborah Strumsky on solar/AI progress modeling, exploration/exploitation in research, etc. She does v. cool solar(/etc) work. The open letter is new but the issues/debates aren't. Will put in broader not-just-AI sociological context eventually. Could go on and on about the open letter and related issues now but holding off somewhat til the underlying sociological case is finished ;) Hope to soon go into far more detail on the sociological/ethical/historical etc context of the AI open letter but 1st need to write paper :) Day b4 the open letter, was talking about basic income viz-a-viz AI/politics/developing countries etc. w responsible innovation ppl. Timely. Suffice it to say for long-time tweeps that I was a huge fan of work stuff getting serious attention in the open letter, and basic income :) All things considered, the AI open letter is a big success so far from various POVs, inc raising profile of ethics/safety and outlining Q's. AI open letter research priorities document = gold mine for anyone looking for related research Qs (already working on many mentioned :) ). Looks like the open letter on AI has ~800 or so signatures at least so far. @cthorm @SuzanneWaldman yep! @cthorm @SuzanneWaldman this is something @soundbitelife studies so she prob has things to say... Jen, discussing solar etc perceptions :) @SuzanneWaldman @cthorm partly cuz ppl don't have much exposure to mega-solar/wind etc. cuz it's mostly brand new. many more will soon :) @SuzanneWaldman .. in general I don't really see the public's views as fossilized ( ;) ) on this issue. so much could change/has changed etc @SuzanneWaldman can def see how if you have certain views on RE's scalability etc. RE seems contractive but most don't know much anyway so.. @SuzanneWaldman I don't see contractive stuff in your sense as being a primary implicit *let alone* explicit driver of much, maybe activists @SuzanneWaldman I'm weird but not *that* weird - people have all sorts of idiosyncratic views on energy. Most don't have informed views tho. @SuzanneWaldman what is a contraction person or an expansion person? I can imagine what you *might* mean but suspect I disagree with use ;) @SuzanneWaldman have thoughts on all those but obvi tricky questions..not all bad news. lots of common ground exists/is used all the time. @SuzanneWaldman agree totally. all energy technologies have various affective appeals/negative aspects etc. RT @CostaSamaras: Many of the world's experts on transit egress, ventilation & emergency evacuations are in DC this week for #TRBAM. Talk t… @SuzanneWaldman people are basically right that big fossil fuel industries are harmful to them in a bunch of ways...etc. @SuzanneWaldman ...but you could say, e.g. people are right that renewables would be beneficial in some respects if wrong about cost, etc. @SuzanneWaldman a wide variety of things in different contexts. energy affects everyone in a bunch of ways. didn't mean any one example... Source on recent solar progress data: http://t.co/JJ4XxQDgVy As the SunShot team emphasized in their Vision Study, both evolutionary and revolutionary progress needed in solar. Many ideas still needed. Fantastic SunShot chart on recent utility-scale PV solar progress (in part thanks to them!). http://t.co/e9IjZJHOdr @SuzanneWaldman ...though often people actually have informed views/realize stuff isn't good for them policy-wise :) =often case w/ energy. @SuzanneWaldman right, def. multiple factors/levels etc. Definitely agree that people often rationalize stuff in terms of their values...+ @SuzanneWaldman def. agree that resistance to/support for change qua change is a thing for some ppl but for most, about what kind of change. @SuzanneWaldman think most of disagreement is over values/policy/politics etc. not so much any particular theory/fact... @SuzanneWaldman not gonna argue with you that experts matter/can have useful things to say :) still big Qs about e.g. energy/climate policy. One of the SEEDS grants in particular I'd highlight (in part cuz meeting w/ PI soon :) but was my fave before anyway) http://t.co/4oX7kym4fs @SuzanneWaldman which experts, determining risk how? All that sounds nice but pretty abstract. Most ppl in general are sincere, but disagree List of grants in the "Solar Energy Evolution and Diffusion Studies (SEEDS)," super interesting program at SunShot: http://t.co/KWhk720nTd @JohnDanaher might have working paper or something on related issues soonish tho. anyway, glad youre thinking about that. key issue! :) @JohnDanaher will do, +likewise! your next one sounds v up my alley. Prob wont have any papers on this for a while myself but def someday :) @JohnDanaher /detailed AI tech futures elements, so def. lots to talk about. Taking class on utopianism and looking at through similar lens. @JohnDanaher look forward to that! we should also prob email/Skype at some point - cooking up related stuff w utopianism/ideology lit/ @JohnDanaher I've read/skimmed some papers- super interesting/provocative stuff, and I found pretty persuasive but want to read more soonish @Aelkus also two recent movies on WH takeovers RT @loriara: Am sorry to report that one person had died following the evacuation at L'Enfant Plaza. #WMATA http://t.co/0oMWBRMyVM RT @dronelaws: @rcalo @CNN Not a grant "to use." Approval is for public university-based testing under a COA. Same not allowed at private … @JohnDanaher havent read all of those but related Q: familiar with Julia Maskivker's stuff on right not to work/discussed in yours/thoughts? RT @CSPO_ASU: "Science, information, and politics in the Anthropocene" By CSPO's Brad Allenby and Daniel Sarewitz http://t.co/LwxG5FeBTR #S… @tonyjprescott @KatjaGrace @VincentCMueller another pt on this- ppl doing tech progress models in eg solar starting to use error bars now :) @Aelkus also just ppl who are unfamiliar with the diversity of AI aka most ppl ;) Biased cuz working on both but think a good theory of AI progress will be helpful for grounding discussions of utopian-esque AI impact args. Claim that eliminating poverty someday in part with AI = plausible is correct IMO as stated but needs to be subjected to way more scrutiny. Particularly noteworthy point in open letter (/sections in associated paper): poverty/work. Unpacking/caveating those claims = 1 of my foci. @karen_ec_levy been hoping to find something like this, thanks!! can't wait to read. General impression is nothing super interesting on the AI technology front demoed at CES, some cool hardware/applications though. Thoughts? RT @rcalo: "@AutomatonBlog: Are small drones a 'no-brainer' to legalize? via @FortuneMagazine http://t.co/fd9NxMaS72" yes, with safeguards … RT @elonmusk: Rocket made it to drone spaceport ship, but landed hard. Close, but no cigar this time. Bodes well for the future tho. RT @elonmusk: World's top artificial intelligence developers sign open letter calling for AI safety research: http://t.co/ShWc8F7Kyq @PabloRedux make sense? @PabloRedux + even if possible, that could be problematic from POV of closed mindedness, "experts" claiming knowledge/control of future etc @PabloRedux not sure exactly what you meant but what I meant was that anticipating future hard period so no perfect model forthcoming and+ Bostrom bet big that people would eventually look past/reconceive the title of his book...TBD but early signs of success in some quarters. Thinking maybe the title of Superintelligence may have played a sadly big role in its reception. Content not flaky like title may suggest. @tonyjprescott @KatjaGrace @VincentCMueller not great sample but much discussion of extents/types of uncertainty in futures/scenario lits :) Year or two ago I dismissed idea of Obama getting v involved in AI/detailed responsible innovation stuff in general, now seems ~ plausible. Related to points on cloud AI/bots yesterday: in this context, speed/level distinction in something like Carroll's (1993) sense = critical. Another point on AI progress modeling: I doubt one model to rule them all likely/desirable. Rich ecology of (meta-)models seems much better. One pt I will def make in talk soon = any AI progress modeling effort worth its salt must be v. collaborative. Hoping to help kickstart. :) Another way of putting my pt/question is there is a ton of ~great stuff on ~AI progress modeling, Qs = integration/quality assessment, etc. Also a big gray literature on AI progress by non-AI people commenting on it. Much of it non-serious (then again, some AI stuff is, too ;) ). TL;DR recent rants (/repeating something I said before) - many thoughts/research Qs on AI progress, v unsure what ppl care most about tho :) Re: my rant on AI prog modeling - very unsure how to most efficiently express near-term (individually and also in talk), thoughts welcome :) + in papers/textbooks on future stuff/history of various aspects of AI, historical books (Nilsson, McCorduck, etc.), AI ppl interviews (2/2) Few examples of relevant (gray) literatures on AI progress modeling: pop books by AI/robotics folks, think pieces in said fields, stuff(1/2) "Anarchy of Methods" is great at capturing some aspects of the diversity in AI research, but not so much the full lit. on progress theories. Think I'm familiar enough with the AI progress modeling literature (broadly defined) so could pretty easily write up summary of themes, etc. Took brain-dump approach 4 solar/AI/robotics stuff, only handful of folks got engaged...maybe that's OK, though. Lit review first in AI? Hm. An alternative (/complementary? thoughts welcome) model would just be brain-dumping my model as it currently stands. Right balance unclear. +Could survey some of what I've found to be most inspiring (w.r.t. tractability of AI prog modeling) examples from various relevant lits...? + e.g. AI (w/ some sub-fields more important than others), (cog.) psych, neuro, STS, sci/tech prog models from all over, +phil of sci. (2/2) Thinking through how to summarize some key AI progress stuff in one page/few slides...to start, could outline relevant literatures: (1/2) Much to say in few weeks on details/subtleties of AI funding but for now, pretty clear gov't should play active role in ethics/risk funding. Gov't involvement in AI risk/safety/ethics stuff should at the very least involve substantially more funding for research on such issues. The obvious next step on the AI open letter is to talk specific details about how governments should get involved in this stuff immediately. Would love to spoil lots of things about the responsible innovation paper I'm working on but involves lots of interview data etc so can't :( RT @MackFlavelle: @elonmusk @cdixon that's not a mission to a space station. That's you in an iron man suit. #ISeeYou #avengersassemble RT @elonmusk: Yesterday's mission to the Space Station lights up the cloudy night sky of Cape Canaveral http://t.co/DFB742HaQt Another point I've made before on DeepMind, shoulda included in R+D strat summary b4: they have unusually coherent vision/agenda for AI. Next few weeks' plan: AAAI slides, responsible innovation paper progress, AI progress model progress :) hopefully much to share/tweet soon.. In light of the open letter/Google people's signatures on it...would be nice time for Google to say what's up with their AI ethics board ;-) @tonyjprescott @KatjaGrace @VincentCMueller +Hinton articulated/defended exponential decay/fog at ~5 years model here http://t.co/kA06CQhPwM @tonyjprescott @KatjaGrace @VincentCMueller wld also be curious to see e.g. rigorous comparison of US/EU robotics roadmaps, both ~10-15 yrs. AI open letter = good news cuz issue being taken seriously by at least some relevant ppl, progress being made, many ideas 4 future research. Not sure yet how it will be spun in the press overall but to me the open letter thing is very, very good news in various ways, not scary. @tonyjprescott @KatjaGrace @VincentCMueller the confidence issue is tricky of course :) but am big fan of more/better roadmaps/visions/etc. @tonyjprescott @KatjaGrace @VincentCMueller working on my own model of such things, not nec. representative but will specify such timeframes Decided I won't be able to finish Capital as soon as I hoped 4 various reasons, including it being non-trivial substance-wise. Good stuff :) @rcalo me too! the Puerto Rico stuff makes more sense now ;) RT @rcalo: I signed this letter outlining a research agenda for the responsible development of artificial intelligence. http://t.co/gISecGP… Many noteworthy new signatures to the AI open letter I could go on and on about, but bottom line = it's worth reading http://t.co/JJ2w1QfYKu Specifically, comparing yesterday to today in terms of the length of the open letter signature list (screen capped it), 4 pages --> 15.25. My signature has now been added to the open letter on AI (as have many others' - it's huge now!): http://t.co/JJ2w1QfYKu @gsvoss would be interested to discuss at some pt, wish i knew more what you meant :) def need for critical lens on lab types/models.. @gsvoss not super familiar w that/similar phrases' usage but def have thoughts on diff types of labs/innovativeness in general etc :) @PabloRedux @j2bryson look forward to reading! :) @gsvoss @thezhanly also could maybe help point to some lit (if im familiar depending answer to this) if you clarify on "innov/culture labs?" @gsvoss @thezhanly ...dimensions at the end you list are super interesting, but are you looking for integrated framework, separate, etc? @gsvoss @thezhanly sounds like something I would have thoughts on but not sure what you mean by/are looking for re: taxonomy - all those... Some Watson folks on the open letter, as well. Interesting (though not nec. v. representative) sample of academia and industry in AI today. Note: on the Neural Turing Machine thing - it was also cited in places other than that one DeepMind paper but that's only technical AI one. The Neural Turing Machine paper has been cited once by another DeepMind-related paper, vs. e.g. huge corpus on deep RL/related issues/apps. On the DeepMind R+D strategy stuff: don't have clear picture of Neural Turing Machine stuff viz-a-viz other stuff, deep RL ~=unifying theme. + specifically it being common 4 senior researchers to decide X needs to be done, engage in forms of collective action to pursue, etc. (2/2) On the current/former AAAI Presidents being involved in that - makes sense given Frickel/Gross 2005's theory of movements in science, (1/2) + already a non-trivial amount of ppl inc. many influential ones, inc. several AAAI Presidents. AAAI playing increasing role on this. (2/2) Would be interesting to look at what fraction of the AI community was represented in that open letter - will def grow over time, but (1/2) @nerdsrocket not just from here* @nerdsrocket not just here but in general...looks especially epic :) @nerdsrocket Totally. I was thinking something similar the other day here as well :) i really need to visit SoCal one day. So epic/different We Know How You Feel http://t.co/Cv3HKsK3Tz via @newyorker + See also Nourbakhsh's book Robot Futures re use of AI for marketing in general. @nerdsrocket epic. The key point on DeepMind's R+D strategy, though, beyond all of those details is that it's very ambitious. Unsurprising given Legg/Hassabis. #NAME? TL;DR of my non-existent write-up on DeepMind's R+D strategy: deep RL key focus but many flowers blooming, collaborative in/out, big (1/2) We know Google is interested in driverless cars, but the rest is super unclear - they could use that talent to compete in so many domains. There's no sign that Google wants to fully integrate all their labs (nor should they) but they can't really leverage them much w/o some.... Extremely puzzled by Google's robotics research/goals in general and how they plan to integrate all their recent acquisitions. Very hard. Already done comprehensive-ish survey of DeepMind, but have much less of a sense of their connections to other labs/those labs' ambitions. @MattPovey whenever there are actual ads I mean. @MattPovey hint: every time ;) Thinking it might behoove me to do a comprehensive-ish survey of Google's AI research. Could be helpful for a variety of reasons. Thoughts? ...not to mentions folks at Google (esp DeepMind) etc. Suspect many ppl signed since (myself included :) )/not reflected yet cuz moderation. Some interesting (for various reasons) signees of the AI open letter (http://t.co/JJ2w1QfYKu): Musk, Vinge, Boden, Hinton, and Sam Harris :) And by "v fast decisions" earlier I meant speed of light/distance from cloud issues in addition to processing stuff..e.g. bot motor control? Caveat to that caveat: we know a lot about what can and can't be sped up, just not everything :) Many old school AI methods could come back. Also, caveat on the IoT/AI/etc stuff: agree with point in Anarchy of Methods paper - we dunno yet what else can be sped up besides deep NNs. Lots of stuff can be offloaded to the cloud from an AI/bot POV (as also with humans, where cloud = other ppl :) ), but not v fast decisions. In particular, would be interested to know relation between neural net depth, task complexity, processing power reqs onboard v cloud, etc. One reason such prob not super well understood is that deep learning today itself isn't that understood, let alone future comp requirements. ... if it's as appreciated that Internet-connectivity and/or fast comp key 4 "smartness" of IoT stuff - esp with stuff like deep nets. (2/2) The problems of IoT from an energy efficiency POV are pretty well understood - need batteries, efficient computer, etc. But not sure (1/2) Not all of the aspects of cloud AI/bot stuff I mentioned depends on sharing reps/skills....tons of potential anyway for enabling e.g. IoT. #NAME? Technically, though, some of those are really hard. Easy to speed up X program w/ cloud, though won't solve everything. Sharing reps/skills+ Cloud resources can help AIs and robots cognitively in many ways. Shared reps, shared skills, speeding up processing, etc. Many options. @CostaSamaras @Aelkus likewise! ...and skills (at various levels) btwn AIs/bots, which is super hard/comes in degrees/etc. but don't see other way that it'll get big. (2/2) Thinking a lot lately about the potential for cloud robotics/AI, seems like key factor is progress on merging/sharing of knowledge.... (1/2) @Aelkus @CostaSamaras yeah, there are so many super obvious connections across disciplines, just Q of when/who points them out, etc. :) @CostaSamaras @Aelkus nice, thanks! looks like lots of relevant stuff for me. @CostaSamaras @Aelkus also - meant Lempert et al. more on the many point...Dirk Helbing has some interesting stuff on integrated models too. @CostaSamaras @Aelkus need to be used w/ appropriate caveats of course but huge untapped potential/linkages btwn fields re: modeling society @CostaSamaras @Aelkus I concur with Lempert et al. 2003 (Shaping Next 100 Years) - need epic models w/ many scenarios/assumptions etc. @CostaSamaras @Aelkus am biased but think AI will play a big role in that and suspect e.g. economics maybe should be taking way more notice. @CostaSamaras @Aelkus yes, I think it's reasonable to assume much richer models of people/societies will be available, Q is when exactly ;) @CostaSamaras @Aelkus + vague prediction of course but seems like reasonable assumption, at least some uptick. hot now/unlikely to cease. @CostaSamaras @Aelkus can't speak to those but in general policy stuff will become more S+T centric, STEM skills key to engage competently. @Aelkus @CostaSamaras if you're in 2014 you're behind the curve in more ways than one. ;-) RT @jameswilsdon: Scientists & entrepreneurs, inc. Hawking & @elonmusk, call for more 'robust & beneficial' AI http://t.co/62xPCqF8hl; http… @Aelkus @CostaSamaras though I think the freshness factor shouldn't be underrated either... in various directions/permutations. @Aelkus @CostaSamaras definitely an advantage to coming from a STEM background above and beyond just a fresh perspective in general I think. @CostaSamaras @Aelkus also, what do you mean by policy schools exactly? @CostaSamaras @Aelkus AI stuff in general will infuse a lot of disciplines, I think. @CostaSamaras @Aelkus when you say STEM next, do you mean more that STEM people will dominate or STEM ideas or what? some mix def plausible. @CostaSamaras @Aelkus whereas anything that involves analyzing people/societies/technologies/etc in real world requires interdisciplinarity. @CostaSamaras @Aelkus seems like it's sort of easier in general for humanities/some parts of STEM (e.g. math, physics) to ignore the rest :) @Aelkus @CostaSamaras seems key to have basic knowledge of such stuff to just be an informed person in general, not to mention academic :) @Aelkus @CostaSamaras not sure I follow your point on incentives but I benefit from STEM methods/ideas etc. in my work to say the least :) @Aelkus @CostaSamaras on the other side, as well, some folks go into STEM not being aware of lots of opportunities for policy-related jobs. @Aelkus @CostaSamaras lots of barriers to such stuff but also lots of interesting initiatives/methods/etc. being tried as well :) @Aelkus @CostaSamaras could talk your ears off about that. Was big focus of retreat over the weekend, focused on nano but STEM generally too @CostaSamaras ...infusing other disciplines/vice versa as has happened historically/is super hot right now in e.g. digital humanities. @CostaSamaras not sure that entails them coming from STEM so much as interdisciplinary methods/collaborations etc. spreading+STEM methods... Anyone have any thoughts on the AI/robotics stuff at CES overall/any highlights in particular? Highly recommend this http://t.co/l8A0SGMZaG which perhaps helps explain @elonmusk's silence on AI stuff lately (besides the sci-fi recs) :) RT @peterxing: Scientists and investors warn on AI - http://t.co/C0lpS9pRdP http://t.co/2vI9YZFOuX via @FT @smc90 someone could have conceived of the possibility, perhaps, if not them...but they wouldn't have been able to say it with certainty.. @Aelkus yup. Even in AI community. Awareness of approaches lower still in programming world generally, + lower in business/society at large. @ansgarjohn do care about it, sorry, misstated own position :) just care MORE about policy-relevant debates and yet to see it explicit there @ansgarjohn + will mention again that I don't care about this unless it is policy-relevant. Few energy things depend on perfect predictions. @ansgarjohn if such a claim is in IPCC, suspect it was never stated with "high certainty" etc. But again I am not as into this as once was.. @ansgarjohn what is? ice sheet stuff gone in near future? that would surprise me. "For a few years, Obama's supporters expected the president to act like a movement leader, rather than a head of state." Yup... Jones 2012. So true (Jones 2012 again): "The Obama admin had wrong theory of the movement [that elected him], + [they] had wrong theory of presidency." @ansgarjohn Gore here analogous to Musk/Hawking. Sure, listen to em, OK, but they aren't the key people to argue against on such issues. @ansgarjohn or basically anything other than one guy's statements :) @ansgarjohn he's just one well known guy. If you really care about this, comment on full IPCC reports that are way better caveated than him. @ansgarjohn I consider Gore a relevant expert but critiquing his vs eg actual climate scientists seems like red herring in this context.. @ansgarjohn more specifically you seem to focus on discrete, unrepresentative, non expert predictions eg Gore/ @ansgarjohn whose forecasts and tracked in what way? Looks like an assortment of ideas/comments etc. Happy to engage on specific bets etc :) RT @MelMitchell1: @GaryMarcus I think you mean "Beyond the Turing Test", but I'd also like to see "Beyond the Turing Machine"! @ansgarjohn and in no case am I dismissing the person. Am a huge Musk fan. But no one is right about everything... @ansgarjohn and I think Ockham supports me here - what's more likely, one dude is is wrong or whole climate community full of idiots? @ansgarjohn to be clear, Kurzweil's views on this are coherent but wrong and Musk's have not yet been publicly explained in detail to judge. RT @romanyam: Glad to see AI priorities report cites my work on AI Containment Problem ...... http://t.co/hPQalgugt0 @ansgarjohn disagree with the first few on some stuff... @ansgarjohn :) I don't have disdain for any of those people. Having written related stuff/being familiar with the lit, have much to add to it, but v. appropriately caveated/framed as not comprehensive. Can't emphasize this open letter thing enough. Big milestone in AI ethics + responsible innovation in general IMO (more on latter soon :) ). RT @dl4j1: Love this initiative for a more robust and beneficial AI: http://t.co/3zy80EvVV9 #deeplearning "If Bush/McCain had been pres. during an oil spill of [Deepwater Horizon's] magnitude, enviros would have protested coast to coast." - Ibid. know some ppl think Obama has tried on climate, but no, in big scheme of things he hasn't done very much. Mostly climate movement's fault. Still not too late to fight CC but Jones is, I think, right that "enviros slipped on the oil spill." Obama still hasn't pushed hard on this. Jones notes also (2012/Ibid) that the April 5, 2010 Massey Energy coal mining disaster killed 29 people around same time. Should have acted. RT @GaryMarcus: Beyond the Turing Machine (& around the paywall!) http://t.co/b7uHYjzkCJ RT @xuenay: Number of prominent AI researchers, others call for research into AI safety: http://t.co/8SuNEWYFF4 "Resuming the fight for planet-saving climate solutions would have been one way to honor those who died [on Deepwater Horizon]."-@VanJones68 For more on the Q of research agendas in AI and society (/a mostly complementary view to the new paper - Ibid), see: http://t.co/cJ2OMQzxmV Suffice it to say I have thoughts on said documents, especially the econ stuff, but it's characterized well/agree with highlighting it obvi! Super duper highly recommend reading that open letter and research priorities document. Note also on the open letter I tweeted (h/t @romanyam btw)...there is a more detailed "research priorities" document included/linked there. "Research Priorities for Robust and Safe Artificial Intelligence," open letter signed by many leading experts on AI: http://t.co/cRTbfFK16A RT @romanyam: This is huge ... Top AI researchers from industry and academia have signed an open letter arguing that rapid AI... http://t.c… + etc... more fundamentally, tho, the 15-20 year horizon is super duper contested now in terms of what is technically plausible then. (2/2) Short case for 15-20 year time horizon for AI/bots being key: clarity on this relevant for education, good/informed R+D investments, (1/2) I've made this pt b4 but it bears repeating/is tricky so will flesh out soon: why ~15-20 yrs= critical timeframe for thinking about AI/bots. Rereading Simon's Sciences of the Artificial...classic book. Highly recommended. Covers many broad issues relevant to AI. Well written, too. Superintelligence doesn't really use much technical jargon and that which it does is often defined well, which is nice. Def. dense, though. They could have looked at the table of contents on Amazon. Or they bought it elsewhere. Still...not sure how one could be surprised by that. Some Amazon reviewers are disappointed that Superintelligence was super heavy. Maybe cuz bought on Amazon/didn't flip through it first? ;-) Many folks on Amazon point to legitimate issues with/questions about Superintelligence...just saying, lots of super dumb stuff there, too :) Huh. Amazon quotes @elonmusk's tweet review: "Worth reading.... We need to be super careful with AI. Potentially more dangerous than nukes" This one's a bit better than those but not much: "[Arkin's work] shows how easily [sic] it is for robots to generate their own values." No. @davegrundgeiger not so much 1 aspect but like the fact that the world is super different from ours in surprising ways + different planets. "I give it two stars because, while extremely diluted, it does present an interesting idea every now and then." What's up with these people? "There's enough material in this book to make a really good Wired magazine feature." 2 star review. Some reviews are great, though, btw. :) Beginning of Superintelligence...so reviewer didn't read it or is a superintelligence. + 5/10 found review "helpful." http://t.co/Z7Q8uPN5jB "It seems that philosophy training confers a talent for squeezing the maximum number of words from a..minimum of ideas." Worst review ever. "After reading 100 pgs and noting a complete absence of original or enlightening ideas.." 1 star review of Superintelligence on Amazon. Um.. @davegrundgeiger not too mention he was very involved in TNG, which I'm also a big fan of :) @davegrundgeiger I am a huge Ron Moore fan :) ~everything he does TV-wise is awesome.. Outlander seemed cool based on few eps but am behind. @davegrundgeiger not sure I can really put my finger on why, though... but yeah, the vibe here is more appropriate for a different world. @davegrundgeiger well put...yeah very different vibe. Similar in many ways cuz Moore was involved in writing etc. both but don't feel same.. @davegrundgeiger Oh and Cyrus!!! Cyrus is the best. @davegrundgeiger as I mentioned before I'm a big Tomas Vergis fan. Also V-World in general is fascinating to me. @davegrundgeiger any favorite aspects/elements etc. that aren't too spoilery for those reading this? :) @davegrundgeiger Nice!! :) Wonder how many people in real life have ever actually had to say "we're running out of road" in the sense used in fiction vs. in fiction. Thought maybe everyone was wrong on I, Frankenstein (slash rationalized watching the first few mins cuz Netflix). Nope, fail. Don't do it. Reverse ski-lift for hiking: climb to top of the mountain, ride back down cuz climbing down is lame/dangerous. A slide could also work. :) Guaranteed basic income has lot of resonance in many developing countries, to far greater extent than e.g. US. Interesting reasons for this. Fun discussion earlier on basic income... one takeaway: need to learn more about issues raised in literature on BI wrt developing countries. Plan to take more int'l/nuanced POV on AI/bot stuff going forward... e.g. differences within/btwn countries re: hopes/fears/risks/needs etc. On last tweet - specifically interested in the first case in ppl's prefs for human/machine service etc. In 2nd, effect on growth/jobs etc. Pondering deep dive on current/~near future consumer demand for AI/bots...and/or one on automation viz-a-viz developing countries. Thoughts? This was recommended to me earlier/sounds cool - Forecasting and Management of Technology, Porter et al., 2nd. ed.: http://t.co/5XzBu62ATf Great chat with Jan Youtie on lessons learned/methods used for mapping/theorizing nanotechnology field. Some papers: http://t.co/8cjzCPKHNO Discussions on public engagement with science, tech. progress modeling, etc. today with cool folks --> new paper ideas on AI/econ. stuff. :) @VincentCMueller well that would be fun! but just meant that I have many publications in the pipeline on FHI-relevant themes/papers etc :) Poorly labeled/otherwise managed detours are so lame. So many ways to address. @ansgarjohn he claims it is exponential though and hasnt explained what that means. Kurzweil's views of AI exponentiality also simplistic Lots of serious waste etc. happens in government R+D when there's bad management. Many steps taken in right direction in US in recent years. High quality gov't R+D management=essential. SunShot has great leadership (can vouch for Le and Sekaric at least :) ) http://t.co/EUGfxiczds Energy and Environment Initiative at Rice actually has a coherentish summary of 1 "all of the above" energy strategy: http://t.co/tFSnJRGKaT Just found out that the guy behind much of that carbon utilization R+D stuff at DOE in recent years runs this: http://t.co/DbxB3ekfVr Cool! Among other accomplishments like outlining a vision, funding innovative technologies, and being super well run, SunShot is well named IMO :) Hard to say what SunShot's precise impact has been yet but definitely influential so far/will be going forward in PV + thermal cost drops. SunShot Initiative at DOE might be under-appreciated. They set crazy goals a few years ago, rallied the solar industry, still inspiring ppl. The whole carbon capture, storage, and utilization thing by DOE was pretty well conceived/managed IMO, but it's a super difficult problem. Theoretically, you can do many awesome things w/ carbon from fossil fuels. Hard, though, + not excuse to be easy on new/old coal plant regs. On CCS: storage hard = partly why DOE started also getting more into carbon utilization a few years ago. Huge challenges of its own, though. @hannahgais genius Easy to come up with "exponential progress in AI" narratives but just as easy to poke holes. Modules vs. architecture, speed vs. level, etc. Musk/someone else could make the case that AI progress is/will soon be "exponential" in some meaningful sense, but not aware of such a case. Most suspect thing about Musk's public (whether at the time or since being leaked) comments on AI = "exponential" progress claim. V dubious. Musk seems more familiar with relevant stuff than e.g. Hawking, but neither totally insane. Q is emphasis/timeframe/solutions/alarmism etc. Plenty of plausible ways @elonmusk could explain that email - just hasn't. Hopefully 2 busy saving world in other ways/will explain soon. ;) Musk is an investor in the company he bases his fears on in part, DeepMind (other fear part is more legit/less alarmist - Bostrom et al.). What is more damning about Musk and AI is how he hasn't yet clarified that leaked email thing. People have a right to know what's up w that. Elon Musk gets way too much crap for AI stuff. Related to what I discussed earlier - overreaction to x-risk discourse. Musk tweets not crazy RT @SpaceX: F9 & Dragon now vertical on the launch pad. Liftoff @ 4:47am ET. Live launch webcast: http://t.co/6Db27OEotr http://t.co/fSAjzB… With keynotes, the presenter almost has to take it seriously. Not quite - some rush through bajillion bad slides. THE WORST of all worlds. In general, high level keynotes are more epic than high level shorter/smaller speeches, but both can be lame. Hinton's sounds cool, though. Expecting big things from some of the keynotes at at AAAI this year... Hinton for example says he's gonna talk about new deep NLP stuff. Speaking of Dollhouse: raises lots of provocative points on brain stuff. I enjoy it. Mediocre overall/mostly implausible but intriguing IMO. @JoeyEsch Nice!!!! I love Dollhouse. On ideas/visions: Russell knocks it out of the park here http://t.co/53PSe9PE5X - goals of AI are ours to define, not derivable from nature. AI itself is largely an idea/vision broadly defined - field defined by what it hasn't achieved. Sub-ideas move faster than the whole thing. Not all ideas in AI go from idea (however defined) to application that fast, but some of the latest deep learning stuff does, for example. Difference in time from idea to $ in context of AI vs. other techs maybe underappreciated. Compare to e.g. energy. Weeks/months vs. decades. + ways. Anyone read it/thoughts? Have read decent amount of Marxist literature but dunno if Capital vs. others stuff worth the time..? (2/2) Thought it'd be cool/funny/interesting to read both Capitals (Marx and Piketty) but Marx's Capital seems super boring/outdated in key (1/2) Have to finish Capital in a few days before meeting - should be fun :) Very relevant to AI/work issues in a number of ways. @ansgarjohn btw I am huge believer in the potential of Solar City et al. Not sure if it will be realized (working on such Qs :) but hope so. @ansgarjohn but fwiw - you can think climate change = almost certainly bad overall and be optimistic overall :) i do. @ansgarjohn as with any political issue, people see things through their lenses. obvi i have strong views. @ansgarjohn the sort of questions Ratan raises. So again, people make mistakes (him included :) ), but super duper skeptical. @ansgarjohn to me this is not like e.g. AI where there is legit debate about whether existential risk exists. in climate, trivial debate on @paulonabike nailed it. "RT @paulonabike: @Miles_Brundage Brooks: my point was the US needs more free speech. Shields: you played moral equivalence to talk about y…" @ansgarjohn not to mention explicitly and definitively rejected *similar* though not nec. exact same claims by many others repeatedly. @ansgarjohn in an ideal world everyone can make such judgments for themselves w/ right data etc. but IRL climate ppl have heard this stuff. @ansgarjohn now, do scientists make mistakes? yes. but do i trust one dude I barely know anything about versus a major scientific field? @paulonabike nope. What was the gist? Got some very exciting/interesting meetings related to solar/AI progress modeling in the near future! Working papers to share soon I hope. @ansgarjohn + is shoved down their throat by anyone and everyone who thinks they're an expert. I promise you the right ppl have heard this. @ansgarjohn (just) him individually but also the class of people and comparison to priors for *climate scientists themselves* for whom this+ @ansgarjohn That is where we differ perhaps 1. many such ppl make dubious claims e.g. Freeman Dyson, 2. the right level of analysis isn't + @ansgarjohn rule of thumb: for any remotely plausible climate skepticesque arg, it's been exhaustively considered by climate scientists b4. @ansgarjohn if you were to articulate the case yourself then I would listen but not gonna look at what I am pretty sure is crackpot stuff ;) @ansgarjohn into the Ratan thing for example when prior probability of it being novel near zero + focused on eg getting solar scaled etc :) @ansgarjohn agree, my point wasnt that no one's claims/views matter, but I would need more than a few positive tweets to bother going super Important factors influencing feasibility of IRL poker AI-enabled cheating: Internet/cloud access wrt speed, discretion/size/energy,+quality Interesting to note that freestyle chess typically is done with smallish computer resources. Poker AI thing not. Scaling down is tricky. @ansgarjohn would be happier to elaborate on such considerations than one specific person's predictions/claims etc :) @ansgarjohn having done energy/climate stuff for a while, have p good sense of which of my views do/dont depend on specific climate stuff :) @ansgarjohn not too be too glib abt question u raised - clearly climate one way or another is relevant to evaluating coal - it's just that.. @ansgarjohn yup! China is crazy. What do people who have read it think of the poker AI paper? @danielah_24 Heads up NL is obvi poker, just sayin. :) @danielah_24 I can hold onto some pride as long as I define poker (as I actually often do/most do outside this story) as big IRL games ;) @ansgarjohn climate only one among reasons coal bad for humanity overall @ansgarjohn also: would engage more seriously if I thought many of my energy claims depended on it but they don't. @ansgarjohn and I know you are smart enough to distinguish but just saying i am skeptical :-) @ansgarjohn many many many many rich and famous and seemingly reputatable ppl say such things, that is my point. @ansgarjohn PS not denying interesting/real uncertainties exist, just think overwhelming evidence the earth is in bad shape/getting worse @ansgarjohn so not sure what i could add beyond stuff you could find. prob huge lit on this and specifically reacting to his claims. @ansgarjohn so I have reactions/speculations on that but engaging on such issues is typically time consuming/polarizing/not super my thing @ansgarjohn no offense :) just used2 have job focus on explaining climate change, not anymore. behind on latest science/communication theory @ansgarjohn sounds like pretty run of the mill disproven denier claim to be frank but happy to engage if specific data provided etc @ansgarjohn know he has said some stuff but anything in particular you meant claim/tech wise? RT @AJ_Conti: "I do not agree with what you have to say, but I'll defend to the death your right to say it." Voltaire #JeSuisAhmed Again, note my caveats about "decades"/"maybe" etc. Like fusion, worth pursuing, but not betting farm on. Big Coal wants us to, obviously. Pumping GIGATONS of carbon back into the ground after burning it flies in face of almost all plausible considerations except Big Coal's own. Again, no coal buff but at the plant I've been to, which is pretty modern... just silly to expect cheap CCS there 4 several decades minimum. There are important/complex Qs wrt ethics/policy/tech of coal, but first/foremost = get off it as justly/safely/cheaply/quickly as possible. Unlike many techs, people in CCS/other long term R+D like algae/fusion know it's not near term. Big Coal wants you to think otherwise. One major problem with CCS is that when you consider the $/R+D/time/rhetoric/false expectations etc., the opportunity costs become enormous. Many arguments made for why CCS makes sense/could make sense etc. and I am more optimistic than some, but not scalable soon whatsoever. More on coal/EPA: CCS isn't my main focus but familiar enough to say it's plausible some day maybe but mostly just rhetoric/stalling by FF. @Aelkus also is everyone but me watching all this on TV or something? my data flow on this issue seems quite problematic.. @Aelkus in general? France? RT @KatjaGrace: A mistake in comparing AI to nukes http://t.co/fZVjcuicBC RT @KatjaGrace: The project of finding the biggest discontinuities in technological history http://t.co/tEf3KptE2X RT @KatjaGrace: New blog about impacts of advanced AI: http://t.co/XQ8U3nVjsl RT @KatjaGrace: New(ish) project with Paul Christiano: http://t.co/STut9y8bW6 Another point in Jones's Rebuild the Dream I really agree with on the Obama admin: they should have/should address socialism charge better. Obviously I think there are ways forward on all the Bostrom/AI discourse issues I raised...just saying, situation today needs a ton of work. + inevitable outcomes of the way modern science works and how people are trained, incentivized, etc. Raises many fundamental issues. (2/2) Another point on AI risk discourse and the AI community: many reasons latter not as serious about former as I'd like are more or less (1/2) My latest Bostrom etc. rant notwithstanding, the AI community is making super rapid progress in these areas. The Q is relative prog rates :) Said overdefensiveness translates into overly sharp distinctions between present and future of AI + demonstrably dumb claims on some issues. The "risk" I alluded to earlier on Bostrom etc. is that AI people are maybe being unnecessarily/unhelpfully defensive, for complex reasons. Rather: the issues it raises are more complex than most get, inc many in AI, making ignorance of said book perplexing and inexcusable. (2/2) Clarification on Superintelligence rant: my point is not that people should be worried about AI killing them. Quite the opposite. (1/2) RT @danieldewey: Check out Paul Christiano & @KatjaGrace's AI Impacts blog: http://t.co/ebmZb9iKWw @rachelmetz "level" vague but in broad strokes, it should handle cognitive/physical tasks I dislike but not so totally I become super lazy. Can say definitively that many in administration at the time thought e.g. green jobs hype was risky. So why did it happen? Still don't know. The failure of the stimulus bill spin from Obama et al. is interesting on many levels, not least of which is: why did WH do what they did? Seems like a nice time to read Popper's The Open Society and its Enemies. Anyone read it/thoughts? Saw new 1 vol ed recently, looked epic... So true: "By letting the stimulus bill be judged solely on the grounds of job creation, the Democrats put themselves in a box." -@VanJones68 RT @Telegraph: #JeSuisCharlie has become one of most popular hashtags in Twitter history http://t.co/BV97yhwMJd http://t.co/EfruWfX9b3 Corollary on Superintelligence: the issues discussed there and elsewhere in near/long term AI discussions are important and affect everyone. Surely many who haven't written stuff on the subject were provoked, but many who should know better unjustifiably dismissed without reading. There have been some serious reactions to Superintelligence but mostly reactions have been long-debunked simplistic claims or non-sequitors. In general, people who were obsessed with long-term AI stuff before now think Superintelligence is legendary, others who weren't ignored it. In broad strokes, AI people risk winning the "is superintelligence gonna kill us soon" battle and losing the serious future discussion war. protect their turf, respect, power, authority, self-image, etc. Such explanation fits w/STS lit on such things + other cases of same. (2/2) The reasons for unserious reactions to Superintelligence are many and complex but include (often unconscious) misguided efforts to (1/2) ..hasty + unserious reactions to Bostrom's book Superintelligence, considering the high quality of (at least some of) the ideas in it. (2/2) Example of an AI-related issue I want to provoke some people on: while there are exceptions, in general AI ppl have had unjustifiably (1/2) Mindful of going overboard but there is urgent need for some real talk on AI, the future of humanity, + what to do about it/who knows what. Unrelated originally to #JeSuisCharlie but now inspired by it: hope my new paper will be by far my most provocative (to some at least) yet. P.S. realize those thoughts on satire, etc. are super obvious to many/most, but not to everyone and something on my mind right now.... #NAME? My point, if I have one, about Paine, Brooks, and what's going on in France and around the world is that these issues aren't new and Islam+ As I mentioned before, Paine believed correctly that he would face serious social backlash over his thoughts on religion. Did it when old. Paine said some seriously provocative things about religion in general and Christianity in particular and did in fact provoke as expected. In case anyone was wondering about my tweets before/cares, the Thomas Paine quotes were from Common Sense + Age of Reason. Super smart guy. I've always thought Leoben and Caprica Six were interesting - esp. their religious/political ideas late in the show. Dunno performance-wise. Speaking of Cylons, who are y'all's favorites? Of the early/miniseries-known ones, that is. Even I wouldn't spoil all of BSG in one tweet. RT @asunews: A report on heroin use in #Arizona - produced by students @Cronkite_ASU - will be simulcast statewide Jan. 13: http://t.co/KVj… Elaborating briefly on the EPA thing: coal is super complex/diverse. Only been to one coal plant but even there, super rich regulatory Q's. Anyone care about the EPA delay stuff/disagree w/ this assessment?: reasonable to delay *for few months max* if nec. but not to back off FF? #1 in last tweet p. clear (though also capital in general vs. just $ is an interesting Q), but in #3 meant applications/approaches overall. 1 tweet version of case: 1. bots ~require more $, 2. "AI" vague=bar ~lower vs. hard real world, 3. more/more diverse AI apps being tried now ... but not crazy to say: the duplicability/editability/etc. of AI/bots, challenges of real world, etc. suggest prima facie plausible. (2/2) In general, robotics progress seems slower to me than AI progress but the meanings of both those phrases/metrics etc. are complex... (1/2) Esp. for RI/STS/tech ethics/etc. folks, THIS on "Internet and society" in comparison to alternative framings, etc: http://t.co/z6ir2alNDi Cylon-like sexbots long off but inhuman ones still raise Qs MT @JohnDanaher Sex Work, Tech. Unemp, + Basic Income https://t.co/FlVtdrfMZc Many technical hurdles to poker cheating scenario, low tech more plausible (?). Point: per @romanyam agree this is big deal in myriad ways. Last tweet was intended to be a semi-illustrative thought experiment/semi-cool fact, not prediction btw. Many cheating possibilities open up + he could put an AI poker assistant w/ real time video processing and output on retina or w/e. Computation hard to squeeze in. cloud? (2/2) Demis Hassabis plays high stakes poker, co-runs DeepMind. Watch out casinos for him/others, bc if he or someone else tech savvy wanted (1/2) + important considerations arise in transition from 1-on-1 to n-player games, not least of which is modeling multiple opponents' strat.(2/2) More AI poker thoughts: unclear how/in what way/with what changes this new stuff will help with larger (3+ ppl) poker games bc many... (1/2) @hannahgais @Brett_Fujioka I try to follow that FWIW so just tell me if I violate it. good luck w work! :) @hannahgais @Brett_Fujioka religions and not be accused of being/be racist etc as seems plausible. @hannahgais @Brett_Fujioka "w muslim friends" meaning not im awesome cuz know muslims but, how to strike tone thats anti bad parts of relig+ @hannahgais @Brett_Fujioka not so much cuz I don't have good ideas for satire but bc dont know what anti-(parts of) religious claims OK. @hannahgais @Brett_Fujioka not trying to be cute tho. Have serious Qs about how to be ethical sometimes trolling atheist w Muslim friends :) @hannahgais @Brett_Fujioka sidenote: agree new atheists often lame and troll badly/meanly etc. do not affiliate with that at all.. @hannahgais @Brett_Fujioka I agree is should be patently obvious but isn't to many today and satire key for dealing with that fact. @Brett_Fujioka @hannahgais fundamental and contended question than the one I meant. @Brett_Fujioka @hannahgais at least in the way those terms are ascribed socially. question of if "real" christian is necessarily "good" more @Brett_Fujioka @hannahgais independent in particular is vague. my use here means: ppl can be bad ppl if christian/whatever and vice versa. @Brett_Fujioka @hannahgais lots of issues raised by my simple tweet length summary, agreed. Paine also way more nuanced than me here :) @hannahgais @Brett_Fujioka my pt tho is "anti christian" or muslim is vague. @hannahgais @Brett_Fujioka not endorsing Paine's theology btw. Just interesting, relevant etc cuz anti Christian and super nuanced. @Brett_Fujioka @hannahgais + thats basically Paine's/non dumb atheists pts - religion is human invention, ethics independent of God existing @hannahgais @Brett_Fujioka wasn't saying "good." saying the sensitivity issue is interesting, old issue, not religion specific. @hannahgais @Brett_Fujioka + would put in sharply worded/imaged tones if I had that skill... @hannahgais @Brett_Fujioka + be through reducing redundancies btwn religions, not anything new. stuff like that is stuff i care about.. + @hannahgais @Brett_Fujioka one point he emphasizes is the commonalities of religion and that if "true universal religion" emerges, it will+ @hannahgais @Brett_Fujioka + note 1. he waited til end of life to say some stuff, 2. targeted christianity above all else, 3. got shit 4 it. @hannahgais @Brett_Fujioka this is why I started but didn't finish yet rereading and tweeting Thomas Paine. Related historically and also+ @hannahgais @Brett_Fujioka agree 10000% with that characterization. @hannahgais @Brett_Fujioka maybe 1000% @hannahgais @Brett_Fujioka 100% agree. @Brett_Fujioka @hannahgais agreed! not making any equivalences, hence the scare asterisks ;) those distinctions=where action is... @Brett_Fujioka @hannahgais do like *good* troll (eg Satanists *amazing* at trolling (some) Christians legally in US) but not my main tool ;) @Brett_Fujioka @hannahgais agree. Never would claim any of the cartoons linked to this I've seen are "good." @Brett_Fujioka @hannahgais and I think (rationalize at least) it is in that spirit I am asking questions here. def not trolling :) @Brett_Fujioka @hannahgais and I will emphasize I know y'all do ;) just want to explore limits in part bc vocal atheist/general critic... @hannahgais @Brett_Fujioka on terrorist side not "muslims" in reasonable sense at all. so agree not hard and fast, but religions play role.. @hannahgais @Brett_Fujioka nothing is a strong word but yes, not all christians or muslims are oversensitive and arguably those involved + RT @Brett_Fujioka: "But why aren't we allowed to make fun of Jews." Said nobody who actually read a book without pictures on European histo… @Brett_Fujioka @Aelkus @hannahgais how so? Been in apartment sick for most of this. What have ppl said? #sry #seriousquestion @Brett_Fujioka @Aelkus @hannahgais oh I agree. That is fair point/bears repeating. @Brett_Fujioka @Aelkus @hannahgais obvi ppl valorizing satire/FS but most smart enough to distinguish that from the specific cartoons here. @Brett_Fujioka @Aelkus @hannahgais who is valorizing bad art and in what way? Maybe not reading enough coverage but thats not my take. @Brett_Fujioka @hannahgais absolute terms and if others should be mocked more... but maybe missing yalls points. @Brett_Fujioka @hannahgais if the claim is that Islam is targeted disproportionately for ridicule, duh. Question to me is if too much in+ @Brett_Fujioka @hannahgais Christians also oversensitive. But dont see situation as as bifurcated as author says. @Brett_Fujioka @hannahgais but I don't see that as especially noteworthy if it weren't about Muhammad. Jesus mocked too.... @Brett_Fujioka @hannahgais admittedly I have only seen glances of some of the images, seemed stupid (?). @Brett_Fujioka @hannahgais what specifically is the best version of claim/evidence (if ur saying) they were overall/generally etc bad taste? @Brett_Fujioka @hannahgais if such prohibitions are "real" Islam then that's ridiculous. If not, ridiculous. Regardless, worth satirizing. @Brett_Fujioka @hannahgais can see how (though disagree) ppl see Muhammad jokes as inherently as anti-Islam/Muslim ppl but not true at all.. @Brett_Fujioka @hannahgais right. but trolling people with ridiculous views is often OK in my book, in this case "Muslim" extremists.. @hannahgais with criticizing variations /impacts of any of the above/don't see any reason for explicitly/implicitly racial overtones. @hannahgais for someone like me who sees all major religions as basically similarly harmful in similar ways, doesn't resonate. Zero qualms+ @hannahgais seems also highly relevant to me if satire intended specifically to inflame/offend/provoke action vs provoke thought. @katypearce FB can be longer form so more likely to result in persuasion than this. @katypearce sorry, social media not just here.. @katypearce depends. if Q is whether it is cool to use that disparagingly for wide swathe of ppl...doubt u will persuade anyone on here :( @grok_ agreed!! RT @grok_: Well, the robotics marketplace at CES looks pretty boring. http://t.co/BtYy6OKhTO One tweet version of accurate (IMO) hype of the Texas Hold Em AI stuff: 1 of first non-trivial-non-toy environments in which PO game solved. Also: the algo involved in the Texas Hold Em stuff is more definitive solution than some stuff I mentioned. Pt is, many metrics relevant. :) Another more subtle claim that could be fairly made is that poker is first IRL-hard-4-humans+P.O. game solved, etc. but PO=not whole story. Lots of video games have partial observability, plus other reasons why they are hard, and AIs can dominate some of em. PO = not everything. Misleading to say (as some are saying) heads up poker is "first partially observable game" solved. Only counts famous/high profile games. @romanyam hmm. have only played as unintended effect of too few players, always thought same was true of high players/NL. interesting :) @jathansadowski I tend to tell it how I see it re: the quality of work :) @hannahgais with racial hatred/generalization. I at least would happily draw anti-Judaeo-Christianity stuff if I had relevant skills. @hannahgais great points/agree with most but seems like the pt re: how most wouldnt dare criticize other stuff etc. conflates tough critique RT @hannahgais: In Solidarity With a Free Press: Some More Blasphemous Cartoons http://t.co/DVYqrnatMi @doctaj well put :) @jathansadowski actually might not be as painful as you think. Barber has made some non trivial points over the years IMO. RT @romanyam: "Responses to catastrophic AGI risk: a survey" was chosen by editors as Physica Scripta "Paper of the Week". It... http://t.c… @jon_jeckell Avatar :) RT @MazzucatoM: In Rome Jan 14? Come hear unions, govt & me discuss how Italy can go from stagnation & inequality to INCLUSIVE GROWTH http:… RT @social_brains: Banksy tribute to Charlie Hebdo Cartoonists (If ever a picture was worth 1000 words) http://t.co/l8jkBKG7zb @romanyam good pts! 1 thing I'd add is that i at least didnt take HL PL Hold Em that seriously before, is it that lucrative/big # players? RT @SwiftOnSecurity: Surround yourself with people who aren't afraid to disagree. Otherwise you'll end up making stuff like that last India… @robotenomics @PabloRedux if it would be useful at some point let me know if you wanna see my slides on US Robotics's business model. @robotenomics @PabloRedux and most importantly - when :) @robotenomics @PabloRedux yep just q of who gets ech/human interface/business model etc. right first/what structure of market will be etc. @robotenomics *would have to be a super narrow set of tasks/range of tasks. his rhetoric unjustifiable, but more limited claims def true! :) @robotenomics his theory about why he failed, that is, not for why it could work (w/ good tech). but for now wldhave be SUPER narrow tasks @robotenomics @PabloRedux dunno bout this factory-in-a-day stuff but generally, think Google et al. must be thinking of similar stuff. @robotenomics sounds like company in question is a joke/his theory makes no sense, but w/ competent company/innovative tech def good model! In addition to Curie, also interested in what people think about Intel RealSense! Nice interview with @erichorvitz on his vision for the 100 Year AI Study: http://t.co/dKk80KFfde Study site here: https://t.co/Kvr8c6GqIn RT @dabeard: Wow. @newyorker cover. #charliehebdo http://t.co/7lXstToyKw RT @SPRU: PhD projects: delivering business transformations / building innovation systems http://t.co/h5SsjWMIWR. Apply now for @ESRC fundi… @FHIOxford I will definitely be adding a few in 2015 :) @PsychScientists yep, lots of tricky aspects... also some good discussion here: http://t.co/wjMczKUCIl @PsychScientists for many players/no limit, way harder...might take a while for AIs to be good at that :) @robotenomics what's the gist/alternate version elsewhere? Could get it if it's important/unique, just takes a few mins vs free :) @PsychScientists it isn't in general, but constraining the problem to two players and fixed bet sizes makes it way more tractable. @robotenomics paywalled but sounds interesting/reminiscent of US Robotics's business model in Asimov's universe :) Two points on my last tweet: 1. raises interesting questions :) 2. it's not actually that long really, just technical in parts. Intro isn't. TL;DR "Stochastic Privacy" (http://t.co/8vw7OqsqYz): people might want/want to pay for various probabilities that their data will be shared. What do people think of the Intel Curie? West Wing is a great show. Amazing performances, directing, etc. and pretty realistic/well-researched. Anyone else a fan? Really hoped mid-reading that Brooks column would say "good satire is X, bad is..." Nope, just "satire=necessary + done by tasteless idiots. Cepheus (new poker AI) site not working for me - anyone? http://t.co/YcJQBLrcLm Slash is there a diff site? Got here: http://t.co/wjMczKUCIl Brooks says satirists deserve "bemused semirespect." Like his columns. Maybe I'm overthinking this Brooks column and he's just saying something even more basic, like social norms/judgments=good. Can't rule out. Think Brooks is saying satirists are "unguided missiles" who make fun of everything, and it's up to us Very Serious People to.....something. @yksnpnwrbrhsa help me out here. I have to be missing something. Normally I get his columns more than this one. If that summary is true....then the column is coherent after all, but false. Maybe Brooks's point is that Very Serious People like him don't make fun of other people ever but it's kinda necessary for some to do it...? Also possible I got trolled big time by Brooks and his piece is itself satire, but doubt it. Suspect if David Brooks saw my tweets he would say I have bad taste. Don't care, his column makes no sense and deserves to be satirized. :) Suffice it to say Brooks loves being a "wise and considerate scholar" but anyway, his point, if there is one, is either incoherent or false. According to Brooks, these 3 groups are and should be respected unequally: "Wise and considerate scholars," satirists, racists/anti-Semites. Brooks seems to conflate "satire" with "bad manners/taste" and erect one of his usual grand narratives around it. Not remotely the same. My interpretation of Brooks's column (http://t.co/t9CzXtbmZz) is: "satire is key. but ppl who do it are dumb. tolerate them though." huh? @Brett_Fujioka #seriousquestion @Brett_Fujioka I get that, but sometimes they're plausible. What is he trying to say here? Don't get what if anything Brooks is specifically trying to say re: Hebdo in relation to Coulter/Maher etc. Could someone explain to me why David Brooks lumps all satirists together? Normally I get his columns but his latest is super weird to me. @Aelkus @robertcaruso yeah I have absolutely no interest. One of the few trailer-types that immediately makes me grab phone in theater. TL;DR poker rant: poker is very hard for humans and machines. Experiments w/ 2+ humans vs. IRL pokerbots could help understand exactly why. Poker players think they're good at reading/avoiding tells but maybe pokerbots could exceed them in various ways with the right data. However, emphasis on poker thinking "today." Maybe, for example, people overstate the significance of IRL human factors vs. sound strategy. According to what people think about poker today, a high performing IRL pokerbot would need tons of different types of knowledge/reasoning. Could say "imagine a pokerbot that is better than all humans at poker...raises issues etc." but we don't know what that would look like yet. + solution that 1-on-1 games are in general, + in poker in particular IRLness introduces many issues. What's plausible in near future? (1/2) Having trouble coming up with thought experiment on IRL poker bots in big Hold Em games because not amenable to the sort of definitive (1/2) @Aelkus unclear if in this particular context ppl are good, bad, etc. in what ways/under what situations. experimentally testing wld be cool @Aelkus cool, lemme know if you do. I met Peter Lane who also does CHREST stuff and discussed such things a bit. cool research program. @Aelkus FWIW I think good player models are prob necessary among many other approaches to be combined to do well IRL in big no limit games. @Aelkus yep know a bit about CHREST. dunno Gobet. @Aelkus not only AI research strat wise but also in terms of deeply understanding poker. what works will tell us a lot.. @Aelkus oh absolutely, I think such an approach would probably be necessary to win at the highest levels. but my point is, that's the Q :) @Aelkus ... in that it's (I mean big games here) intractable to far greater extent than heads-up. But unclear if in this particular context- @Aelkus of course it's a problem, but neither are poker AIs in big poker games, anyway, which is part of what makes it interesting... @Aelkus with you so far :) @Aelkus not sure what you mean. that humans can't make quasirandom decisions? or AIs "get" some aspects of such strategic q's better? etc @Aelkus especially since it is a super well understood game theoretically, humans have advanced models in heads of it, etc. @Aelkus want to say anything too strong. complex obvi/big biases etc. but also some impressive stuff. unclear what's relevant in poker. @Aelkus actually I am more in the other end of the camp in terms of interpreting the data on human prob. reasoning but have few papers I @Aelkus + humans learn from experience/reinforcement etc. (imperfectly obvi) and have good priors for lots of relevant things. unclear how. @Aelkus tricky to say what's human-like now/in future about approaches. some functionally similar if superficially diff approach, e.g. + + detailed models of opponents' strategies, etc. IRL poker bots playing humans would be interesting/require careful experiment design. (2/2) Eventually AI poker might help us empirically test folk poker wisdom about, e.g. the relative importance of tells, bluffing, accurate (1/2) RT @BoredElonMusk: Reverse phone alarm that shuts down your device during sleeping hours and loudly plays Ke$ha if you try powering it back… RT @BoredElonMusk: Retractable hidden rooftop umbrella that keeps you dry while you open your personal umbrella. http://t.co/3tubXIxbh5 RT @BoredElonMusk: Year-in-review of all the people you argued with on the internet. @JesseJenkins @jonWturney I am attending to that issue at the moment in the context of automation. Could make many energy techs cheaper. @JesseJenkins @jonWturney + cheaper and in that they aggressively protect their power politically, buy up energy techs they fear, etc. @JesseJenkins @jonWturney yeah, the moving target problem is big, both in the sense that fossil industries will keep trying to make stuff+ "RT @SwiftOnSecurity: Bill Gates took all your money and is curing Malaria with it. You're technically a humanitarian." @Aelkus @jon_jeckell Easier to make cute little "secret" lair accessible from just off Wall Street or w/e than show real ppl/processes.. @Aelkus @jon_jeckell *are often not done well :) @Aelkus @jon_jeckell secrecy/eliteness are often done well. Super secret task forces etc. that are horrible at basic security/secrecy stuff. @Aelkus @jon_jeckell not familiar with 24 but I do really like it when bad/good guys are competent. Especially both. As with any case of human-machine comparisons, AIs have very diff poker strengths than humans. Freestyle poker a la freestyle chess soon? :) @JesseJenkins btw made some related points here - I'm now more optimistic than I wrote it, but related: https://t.co/U61fYOnDbp @JesseJenkins *not that you/anyone credible disagrees the other factors matter. just wish more would engage in details not just moar $$ :) @JesseJenkins if, e.g. gov'ts used money less wastefully, more innovatively, had better incentives, etc. money required may actually be low. @JesseJenkins don't have super strong views on the global Apollo approach but don't see money as the major problem at all right now. @JesseJenkins easy to say more money is needed, harder to say exactly what we aren't funding now/why we're funding it wrongly etc. @MarkMuro1 @MattRosoff undoubtedly IMO they will make major contributions to AI, robotics, etc. soon. Q is if they will be ones to profit :) @MarkMuro1 @MattRosoff the factors that will determine if any 1 succeeds may affect all of them - high level R+D management/strategy, etc. @MarkMuro1 @MattRosoff ...and they have way more than enough in terms of dollars, people, hardware, etc. Q is strategy, collabs, apps, etc. @MarkMuro1 @MattRosoff can't speak to the coherence of their overall R+D enterprise but pretty familiar with the AI/bot stuff... @MarkMuro1 @MattRosoff to me the central issue isn't so much number but if they can deliver any. AI/bot strategy may be too incoherent still Made an annotated list of select publications for anyone interested: http://t.co/IooUkIvJLi Thoughts on style/substance always welcome. :) @romanyam also raises question of super sneaky cheating methods in casinos. @romanyam what do u think that could look like? freestyle poker a la freesyle chess w AI assistants? Thomas Paine waited until the end of his life to say, among other things, "my mind is my own church" and ~Christianity sucks. #JeSuisCharlie @MattRosoff @MarkMuro1 agreed! one of my big areas of research so am last to deny there are many open questions about their management, etc "[C]ircumstances have, and will arise ... through which the principles of all lovers of freedom are affected." - Paine, 1776. #JeSuisCharlie RT @mtaibbi: So we should be able to present them unredacted, without warning labels, etc. @SeanErnst RT @mtaibbi: The whole point of our system is that we believe adults are responsible enough to handle/judge controversial ideas... @SeanErn… @hannahgais = something I'd trust him with a lot more than a country... :) @beaucronin certainly not the best technical intro but if you wanted to throw some historical learning into the mix.. :) @beaucronin have long wanted to read Newton's stuff but dunno if counterproductive for technical learning purposes or what... @hannahgais unless of course it was an IRL extemporaneous quotation of Durkheim, which would be epic. @hannahgais nice!!! want to know more about Durkheim eventually so look forward to reading :) Some have long argued (even at time/within) Obama admin sold stimulus stuff poorly, e.g. jobs" focus 4 energy $. Jones 2012 puts in context. @jon_jeckell yes, but more fundamentally tech/social factors are deeply intertwined...eg Stuxnet was super complex operation in many ways.. @Brett_Fujioka think you could convince lots of ppl in many places of many things ;) doubt many familiar with both... RT @jon_jeckell: Seriously. How many times did the crew or at least leadership get incapacitated, gas-lighted, or controlled by external ag… @jon_jeckell On cyber/EW/infosec writ super large...love Ship in a Bottle ;) RT @jon_jeckell: For all of the potential hijinks with EW & Cyber on a Star Trek ship, the crew seems to be the biggest vulnerability. By f… @MarkMuro1 @MattRosoff huge uncertainties there, but the salient fact to me at least on AI/bots is it's their market to build/destroy now... @MarkMuro1 @MattRosoff IMO we are not even close at least if their AI/bot stuff pays off. I may be more bullish on that than most are :) RT @jon_jeckell: Also, given how totally bridge relies upon computer-synthesized sensor feeds in Star Trek, you'd think there would be more… RT @jon_jeckell: I have always found bridge location on Star Trek baffling though. Entire situational awareness feed via sensors, not windo… RT @GrumplessGrinch: You want the truth? You can't handle the truth! No one can, the truth is computationally intractable. @mattthomas In one case, most $ goes to person-hours. In the other, much higher fraction to expensive equipment purchases. So unsurprising. RT @davidad: Don’t ever [think] you can design something better than what you'd get from massively parallel trial&error with a feedback cyc… Love @VanJones68's writing style, puns, e.g.: Obama et al. failed to "spank the banks," environmentalists "slipped after the oil spill." :) In Rebuild the Dream, @VanJones68 persuasively explains many Obama et al. mistakes, e.g. OFA misused, spin fails on stimulus/oil spill, etc. "RT @sallykohn: Muslim shooter = entire religion guilty Black shooter = entire race guilty White shooter = mentally troubled lone wolf" @Aelkus @jon_jeckell bringsjord writes all sorts of stuff but havent read the fiction but think its more jack clancy soviet stuff, dunno @Aelkus @jon_jeckell many more have written on latter issues vs writing per se but non trivial real authorships @Aelkus @jon_jeckell most of the major "names" have not. most said names were influenced by sci fi and vice versa in myriad direct+ ways @Aelkus @jon_jeckell didnt mean to be too coy sorry, minsky is big example. lots of others but thats good case study @Aelkus @jon_jeckell will definitely be making a plug for sci-fi at AAAI. @Aelkus @jon_jeckell many thoughts on this. yes and in many ways. @Aelkus @jon_jeckell also since ELIZA etc ppl have pushed back on humanlike metaphors/framings, ESPECIALLY the creator of ELIZA :-) @Aelkus @jon_jeckell def, just articulating ~my plan of pushback :) more to say on it but basically, it's the defining down human/sex thing. RT @techreview: The world’s largest chip maker, Intel, hopes an itty-bitty computer will mean better wearable gadgets. http://t.co/ABRRYfuM… RT @techreview: Hawaii Battery Gives Wind and Solar a Boost http://t.co/cbkz4jRfaw @Aelkus @jon_jeckell only super simplistic definitions of sex and/or humanness would support claim of "humanlike sexbots" in near future. @Aelkus @jon_jeckell speaking in broad strokes of course and exceptions abound, but that's ~the state of play. many relevant techs not used. @Aelkus @jon_jeckell related: the potential techwise is super unrealized. sexbot "industry"=joke technically. big guns not on the tech yet. @Aelkus @jon_jeckell applications of modern bots/AI, eg immobileish human replica, limited part of human replica, and so on and so forth. @Aelkus @jon_jeckell like I said, super realistic already in limited ways. if ppl define sexbots loosely, could make SUPER domain-realistic @jon_jeckell same. been involved w energy from WH to DOE to climate orgs to big/small business etc so very opinionated to say the least :) @Aelkus @jon_jeckell nt etc so Cylon-esque expectations unfounded 4 decades. but limited aspects/domains/sense of realism plausible/real now @Aelkus @jon_jeckell state of art (including direct exposure 2 top Japanese stuff 1 year ago) looks good still, bad moving, energy inefficie @Aelkus @jon_jeckell I have pretty strong feelings/detailed thoughts on it- Great ref on this w/ Amir and someone else? but briefly.. to me, @jon_jeckell and on sexbots not familiar w AVN much, just meant mainstream AI/bot ppl dont care much about this very often. @jon_jeckell both I think. Lots of interrelated issues involved in solar future(s) plausibility discussions. Have detailedish slides fwiw @jon_jeckell I follow all your other points. Could you elaborate? If easily here then if not maybe we should email :) agree many challenges. @jon_jeckell thanks for the thoughts! have slides on it if interested. and yes agree on non-tech stuff- also have ref on that. but not sure+ @robinhanson by "simpler" I meant "(more) amenable to definitive foundations being established" or something? @robinhanson do you mean A. if he were more productive then, B. if problem were easier, C. if math were simpler, D. other, etc.? So heads-up (2-player) Texas Hold Em is basically solved AI-wise now. n-player games = harder but many working on it. http://t.co/MDQR0zKfpQ @RoboNarratives good thing there are lots of fun conferences/workshops :) hope it was productive! @RoboNarratives thanks, good to know. Familiar with IHMC's approaches so Johnson etc. but sounds like I missed lots of other fun stuff! :/ @beaucronin tl;dr last few tweets, will read soon, super important stuff/look forward to discussing more when i know some/much more stuff :) @beaucronin of course it doesn't remotely grapple with all q's but one reason i like sci fi is so we can use common examples/comparisons etc "RT @helengreiner: Not ""self-aware"" but ""aware of obstacles"" W/ SkySpecs’ Guardians, The Drones Have Become Self-Aware http://t.co/GtSnlmC…" @beaucronin to frame some questions/examples etc cuz lots of folks have seen it.. Would have written up lengthy case for TR b4 but time :) @beaucronin have made short version of case before on twitter but i love the movie and think while its not always plausible ( ;) ), good way @beaucronin elephant in my sci-fi filled room at least ;) @beaucronin nice, will read (eventually at least). If we're gonna talk VR/Mars, tho, elephant in room is Total Recall ;) "RT @sankalpbisme: do not accept the future that has been imagined for you. @futuryst" @beaucronin yup...even Ready Player One is/should be staggering to some folks and just the beginning of both the tech+speculation sides :-) @beaucronin yep...science/history/sci fi/etc key for thinking through such things :) future could be quite wacky to modern eyes... @Thad_Miller I'll send you an email :) Also in Hieroglyph, there are explicit discussions of technical stuff in the "fictional" text. So interlaced on multiple levels throughout. Hieroglyph problematizes maybe more clearly than anything else hard fic/non-fic distinctions: stories *with* science/ethics stuff 4 context. So a book exclusively on the history of utopianism =~non-fic, but fortunately there are good narratives/facts/values in many literatures. :) And notably, the quality of said prose is often super high relative to often deeply un-serious "non-fiction" discussions of the future/tech. Much sci-fi includes explicit, lengthy prose on shaping the future, risks of tech, etc., so "fic/non-fic" problematic but sometimes useful. In (implicit or explicit) utopianism discourse, fiction/non-fiction boundary is central Q. For shorthand, tho, e.g. Dispossessed=fiction. ;) @Aelkus maybe some fact i don't know, but based on overall personal charisma/reputation in the beltway, he faces zero obstacles whatsoever. @Aelkus I don't take "wills" and "won'ts" lightly but he will very prob be nominated :) Facebook limited in aims/scope (maybe?for now?) vs. others mentioned, Baidu/others unclear, open sourc=small and faces big challenges. (2/2) Elaborating a bit on my prior sweeping generalizations on AI futures.. :) Google maybe has incoherent strategy, IBM maybe too coherent,(1/2) @Aelkus exaggerating, of course, but the point is, in relation to how good their reports are, they're basically ignored sometimes. @Aelkus most glaring case study on this is the report they did on autonomy. EPIC, no one cared at all even within DOD. About half the assigned readings in the utopia class I might take are fictional, the other half non-fiction. Very appropriate. :) @Aelkus recaping my tweets on it so far: good they're thinking abt it, DSB reports often good but not taken seriously *esp* on this stuff. @Aelkus many thoughts on this... @alan_winfield congrats! would love to see a similarly high quality "intro to AI" or similar these days. mostly pop sci/ethics or textbooks. @JesseJenkins skype soon? ~2030 solar (one of my foci) plausibility considerations could be nice case study to discuss among others :) RT @chronicle: Arizona State University has moved to fire an officer who arrested an English professor last year: http://t.co/255MchYr9J @JesseJenkins super related, though, of course. to extent stuff cheap, more policy/politica--plausible. etc... @JesseJenkins if I had to guess, we are ~ as optimistic on policy potential but I am slightly more optimistic on what's tech-plaus soon :) @JesseJenkins if I had to summarize my reasons for optimism, it's prob. a combination of policy-optimism and tech-optimism. @JesseJenkins agreed. all for that, sizing up scale of prob, feas/plausibility, models, future tech potential (latter what focused on now) @JesseJenkins No fate but what we make" - Terminator ... just as true of dangerous AI as dangerous climate change/shitty energy systems! :) @JesseJenkins let alone the much broader array of possible/existing/historical etc. policy options. Been through jaded periods but not now. @JesseJenkins yes, people have ~no clue what e.g. ARPA-E is doing/how important it is... @JesseJenkins some cool recent papers laying out conceptual framework for such stuff by miller/o'leary etc. if u haven't read. @JesseJenkins not just on "acceleration" but on the thoughtful construction/shaping/imagining etc. of energy futures, u may like @JesseJenkins *call, in that policies etc matter, which you know, just a matter of emphasis/degree/hope/myriad assumptions etc. @JesseJenkins the Smils of the world are right that energy stuff usually takes time, I/others are right things can change/it's our clal ;) @JesseJenkins absolutely a scale issue, but lots of hope - part of why I'm looking seriously at eliminating ~all human labor from solar. @JesseJenkins that =~ what I wish ppl talked about all the time - scale of challenge viz-a-viz solutions. again mostly kid gloves so far. :( @JesseJenkins coal stuff being non-trivial = part of why I feel that way - big challenge but also big oppos, solar etc. ready b4 clean coal. @JesseJenkins we should talk with higher bandwidth sometime then, cuz I feel strongly most ppl are too pessimistic about 2030 plausibilities @JesseJenkins personally I'm worried about deep decarbonization by 2030 ;) @JesseJenkins but as for actually dealing with the fact there are many coal plants that won't plausibly go "clean," kid gloves still. @JesseJenkins resonates with my views... non-trivial effort by EPA (dunno how relates to what's "possible" w/o working there..) Piketty's Capital = dense conceptually, few if any equations. Latter often used as crutch in books bc author can't use words well enough. @JesseJenkins don't know McCarthy but think very highly of EPA and her in particular from what I know/hear indirectly... @JesseJenkins yeah like how serious you think EPA is, political situation viz-a-viz how tough they could plausibly be, tech plausibility etc @Brett_Fujioka rest assured I will be letting everyone know about various aspects soon ;) just juggling various books so not my focus yet @JesseJenkins what do you think about such things? RT @ARPAE: Calling all #innovators: @ARPAE issues $125M in funding to support all types of disruptive new #energy technologies: http://t.co… Piketty's Capital is mostly about g vs. r but super relevant to capital vs. labor stuff and AI in particular... so far/I hope at least :) RT @MarkMuro1: RT @BrookingsInst: What can we expect for U.S. unemployment rate in 2015? http://t.co/Xje8jfapl4 http://t.co/gdQb7IoGOD @Div… RT @Floridi: "If journalists sound friendly, that’s because they’re writing for strangers. With academics, it’s the reverse." http://t.co/r… RT @neilhimself: How important are free speech and satire? Important enough that people will murder others to silence the kind of speech th… RT @katypearce: Has Technology Killed the Jewelry Industry? - Pacific Standard: The Science of Society - http://t.co/Y7eeCguqf8 RT @FlyingTrilobite: They murdered people but they will never murder ideas or the artistry to make them come alive. #JeSuisCharlie http://t… #NAME? Somewhat related to the Minority Report stuff: plausibility and entertainment needn't inherently conflict, but sometimes do in some (1/2) More importantly, Minority Report is solid sci-fi because it (sorta/imperfectly :) ) grapples with the social/ethical contexts of that tech. Few examples of at least *somewhat* plausible/provocative techs in Minority Report: spiderbots, VR, driverless cars, AI-enabled surveillance Minority Report's central technological conceit is implausible but the social context surrounding it + many of the other techs in it aren't. + 2. Spielberg et al. actually put effort into making it somewhat plausible, 3. excellent performances/casting/directing/effects etc. (2/2) Thinking about why Minority Report continues to be so relevant/good.. at least three reasons: 1. based on clever Philip K. Dick story, (1/2) RT @rcalo: New 4D printer prints objects before you even ask. #CES2015 @rcalo Sounds a lot like the movie Primer ;-) Even w/ "just," though, misleading. Even if specific techs in sci-fi aren't "real," sci-fi itself inspires innovators etc. IRL/vice versa. "X no longer (just) sci-fi" reinforces false models of sci-fi as detached, only about future, inherently implausible, etc. Better w/ "just." RT @hannahgais: The Blame for the Charlie Hebdo Murders http://t.co/XPAWQbDArK via @newyorker @Aelkus keep me posted. I haven't yet decided the optimal amount of time to spend thinking about robotics stuff btwn now and my next talk.. RT @helengreiner: CES 2015: Drones, Drones and More Drones http://t.co/cb3Ccbk1rh Vonnegut's Player Piano=classic satire on/of many hot topics these days. Even more relevant now cuz focused largely on automation and jobs. @Brett_Fujioka @hannahgais so did Hitchens, though he was much more of a serious person in general I think... @Brett_Fujioka @hannahgais (he may have other args, just saying best version of his arg i can think of is obvi untenable) @Brett_Fujioka @hannahgais problematic/untenable obvi cuz begs fundamental Qs of eg whats Islam that hes dumb about to begin with (2/2) @Brett_Fujioka @hannahgais suspect he would say ppl obligated to defend their faith/clarify about their faith for others benefit/truth (1/2) @Brett_Fujioka @hannahgais they're not. He holds ppl to silly standards. Was just making sure not problematic on other levels unaware of :) @hannahgais that's helpful, thanks. Have run into lots of e.g. Europeans with veryyyy different views on such things so good to know :) @hannahgais and if I am bungling it :) and you know such things, which is why I ask, DGAF about Maher @hannahgais more broadly wondering about role of Islam as example/model etc for how to talk about religion accurately/appropriately etc.. @hannahgais "that, too, bad" not "that too bad" @hannahgais at least some ways/should be open to critique/laws shouldnt be based on protecting feelings etc" ? or is that too bad? @hannahgais or is he just bad at making such remarks? e.g. is saying "any faith/ideology etc that prohibits free speech is troubling in + @hannahgais main Q is: is it inherently wrong/tone deaf/otherwise problematic to say better worded/caveated versions of that claim today? @hannahgais he does seem like one* not consider himself one, I hope, haha @hannahgais many cloak Islamophobia in FS garb + I don't consider myself such a person, but he does, so genuinely wondering. sry 4 naive Qs! @hannahgais and lots of folks of various faiths/lacks thereof actually don't care very much about free speech in contexts like this.. @hannahgais not looking to vindicate him (couldn't care less), just want to not hold offensive views (to smart ppl like you) if I do/dunno.. @hannahgais obvi disagree w him Muslims have any special obligation to do/be x/y/z in response, satirists can be dicks etc.. @hannahgais PS can think of many things wrong w his tweet for sure, just worried I may hold some similar views ao want to make sure! @hannahgais agree he is horrible, but if you replaced Muslims w/ e.g. "ppl" would u agree w claim in terms of content? or other reasons? "[We must] learn the right lessons from the successes of the Obama 2008 campaign, the Tea Party, and Occupy Wall Street." -@VanJones68 Geithner/Summers gone, not appointing Warren also big mistake per Jones (/many folks), but set horrible precedent. CFPB not taken seriously. Obama failed sooo majorly appointing Geithner and Summers...Obama-era Treasury 1 of worst/most corporate-kowtowing agencies in gov't today. In @VanJones68's latest book, makes strong case econ policy/Wall Street reg laxness = biggest Obama admin fail of all, Geithner super lame. RT @arusbridger: The case for mocking religion, by Christopher Hitchens (from 2006) http://t.co/HxkoBz9Fa5 RT @AutomatonBlog: Rethink Robotics, selling versatile worker bots, raises $27 million more http://t.co/gEZw63g9IH via @ScottKirsner RT @jameswilsdon: Your opportunity to input to CST's 'Science Landscape Project': https://t.co/Jyi8h9XXTq (ht @research_uk) #scipolicy On the Solar Tulip site: disagree with some points there on limits of other tech (unsurprising cuz corporate site), but overall great info. One of the coolest/most interesting/most ambitious energy tech projects these days IMO is the AORA solar hybrid Tulip http://t.co/cDFPqkBg1q "The [Obama] campaign's galvanizing slogan was never, "Yes, HE Can." It was always, "Yes, WE Can." And together, we still can." -@VanJones68 RT @Neuro_Skeptic: "Of 100 UK science PhD graduates, about 30 will become postdocs, but just 4 will secure permanent academic posts." http:… Here are the projects ARPA-E funded in their 2012 open FOA (click on left for more info). Some seriously cool stuff. http://t.co/3YWYya1e4F ARPA-E will get at *least* $125 mill. of super interesting/potentially important tech proposals, so expert review key=world class processes. RT @susie_c: Not here for media Storifys of cartoonist grief today. If you care about cartoons so much, support cartoonists. Pay them for t… Oh yeah, forgot to mention the ARPA-E open FOA is $125 million. This is serious stuff on many levels. RT @ARPAE: .@ARPAE issues $125M FOA to support R&D of disruptive new technologies across full spectrum of #energy applications http://t.co/… @2020science corollary: everyone makes mistakes :) i'm sure you won't make that one again! i def learned after the egg on my face there.. @2020science the key to "smartness" is not making same mistake twice ;) @2020science have made that mistake before (just once at least) :) Lots of diffs btwn dogs + AIs/bots, of course, but I am a big fan of comparisons. Thoughts? (+my dog makes me think of such stuff a lot) :) + but super useful/impactful in complex ways, humans responsible for their growth/learning/behavior not dogs (/bots/AI) themselves, etc(2/2) Fun to compare dogs' impact to AI/bots: e.g. non-human systems w/ diff capabilities/some learning, raised w/ ppl, not perfectly safe, (1/2) RT @Rochenko: @Jackstilgoe @jameswilsdon My new book on technol. uncertainty, care ethics & intergenerational morality, pls RT? http://t.co… @SuzanneWaldman Michael Freeden has a new book on the nature of politics/pol ideology etc you might like. Plan to read eventually. Also FWIW - cannot say all these same nice things about very many energy-related/gov't funding agencies in general. Not just a DOE fanboy ;) ARPA-E pioneered things like a rebuttal period for proposers, etc. So FWIW they take doing this open FOA stuff right/fairly super seriously. Not sure how much the open FOA process has changed in last few years but back in my day at least ( ;-) ), was an epic/v fair review process. Also, superficial silliness is not at all a central consideration for ARPA-E - e.g. they made big early bet on aerial wind turbines, etc... ...again, though, I can say with authority that ARPA-E has astronomically high standards vs VCs/rest of gov't. Not for casual tinkerers. :) Another point on ARPA-E: you don't just get money from them, you get leadership, resources, expertise, commercialization help, etc... @SwiftOnSecurity INTJ Another point on ARPA-E for techies: they have more accurate and open-minded views on tech plausibility than most, and great review process. Odds of getting ARPA-E $ generally are ~zero if it is best funded elsewhere or demonstrably implausible, but otherwise worth considering :) If you have novel energy tech idea 2 risky for most of gov't(s)/VCs, but can withstand *serious* expert scrutiny, consider ARPA-E open FOAs. @ARPAE just announced their latest open-ended innovative energy technology funding opportunity. Details/apply here: https://t.co/XlWjjvVJjI RT @APSphysics: Apply now for APS/@IBMResearch internships for undergrad women http://t.co/Q4XTIkqwiR Deadline Feb-15 @hannahgais congrats! @hannahgais nvm ur name is visible IN article just not in title/other embedded info! @hannahgais yours, I take it? Don't read Bosnian ;) Next few books: Capital (Piketty), Tech Revolutions and Financial Capital, Diffusion of Innovations...hoping for cool new AI ideas v soon :) @roseveleth see: scene in Idiocracy at hospital :-) @roseveleth third thought for now: also big issue in classrooms generally, not just projs, e.g. answering Qs in class. same struggle 4 me. @roseveleth done now btw and stand by all said opinions ;) great article @roseveleth content and details of such groups/projects have changed and im more cognizant than once was but always struggled w such stuff.. @roseveleth also note that agree it is wrapped up in larger stuff. much of what i said applies to early childhood as well as adult meetings. @roseveleth unless and until it is absolutely 100% clear no one has good ideas or willingness to share them :) @roseveleth and I realize that may have come off as assuming leadership of groups etc but really i almost always stay silent at beginning. @roseveleth assignment well. Often try super duper hard to elicit female/other voices but non-trivial sometimes or I'm doing it wrong. @roseveleth second thought on piece: 100% agree on many guys (myself included) being cognizant of such stuff but not knowing how to also do+ @roseveleth do you strongly recommend that Tannen book? @roseveleth first reaction so far is your pet theory def resonates w stuff ive been involved in unfortunately :( @roseveleth almost bought few times, seems solid from skimming. says ppl are natural born teachers and should take that seriously,basically. @roseveleth if not, maybe up your alley. if so let me know ur thoughts :) if not covered in article of course.. @roseveleth also speaking of "pretty much everybody," seen the book The Teaching Brain making that case psych/evolution-wise? @roseveleth will share if any after reading :) @beaucronin not all equally valuable - I would make big plug for automation if had to rank em. But each worth thinking a bit about IMO. @beaucronin good ideas in various research/scaling/business models etc, govt funding, subsidies, other tech prog, other political/econ stuff On the Defense Science Board study on AI progress: sounds cool but not clear ppl/DOD would care much anyway. Many reports ignored already :) @RoboNarratives sounds like a fun workshop. is any info on it public I could see? Not saying in prior tweets there won't be big DL/hardware market in future - there might - but Nvidia at least didn't make that case at CES. + cars learning stuff, drones navigating some stuff, etc. while also overstating proprietary hardware's contribution to those things. (2/2) Common trend in Nvidia, Intel, maybe other press confs at CES: hyping not-that-impressive-anymore AI-related things like driverless (1/2) Speaking of Nvidia, their CES press conf didn't seem very impressive technically on the AI side, mostly just basic deep learning stuff. (?) Kurzweil is obviously a big fan of exponential trends, and solar has indeed dropped exponentially in price lately but IMO future is unclear. Super duper agree with Kurzweil on at least 1 thing: solar could grow way bigger way faster than people think. He's sure it will, I'm not :) RT @kxande2: Intel Budgets $300 Million for Diversity - CEO BK Promises Full Diversity Parity by 2020 http://t.co/vqQsqjkPLZ Best CES head… Prior tweets were prompted by Nvidia/CES driverless car stuff. Also, nature/size of demand for DL in IoT/mobile/desktop/cloud still unclear. + perception/intelligence etc. are required. Truly deep learning requires multiple processors, so fast=more=$$ for CPU/GPU/etc. makers.(2/2) In general, deep learning requires faster GPUs/CPUs/etc. to the extent it's used in more complex environments and/or higher levels of (1/2) If you are super pessimistic about the prospects for sustainable renewables and want to be maybe more optimistic, read Chu/Majumdar 2012. ;) Chu/Majumdar 2012 is good reference for debunking various forms/types/extents of naive pessimism about the future of energy. :) Re: Chu/Majumdar 2012 paper: 1. epic/important/inspiring stuff, highly recommended. 2. Yes, they actually wrote that while running DOE. :) Oldie but goodie (bit technical): "Opportunities and challenges for a sustainable energy future," Chu/Majumdar 2012 http://t.co/maLv4C8IBX Makes a ton of sense Nvidia would be into deep learning for various reasons, not the least of which is GPU/neural network complementarity. Ah so apparently there's somewhat detailed info on the interwebs about the Nvidia deep learning stuff.. any other big AI/bot things at CES? Very impressed w/ the Intel pledge. Can't say I'm completely shocked it came from Intel - some great people working there on such things. :) Anyone recommend any great articles/blogs/whatever rounding up AI/robotics-related stuff at CES so far? @chenghlee not that into such stuff but seems pretty easy to do..then again i get attacked by terminator bots when i discuss skynet a lot :) @chenghlee sometimes could have nothing to do with what you/anyone said, just finds people somewhat randomly? RT @dl4j1: new ND4J getting started page now in Japanese! http://t.co/OmwnPUcl9g non-English video coming soon... #deeplearning @Brett_Fujioka related - I see lots of signs for optimism. @Brett_Fujioka well I have pretty informed views on some energy/climate stuff so happy to dispel any unnecessary pessimism if u elaborate ;) @Brett_Fujioka you should raise your standards ;-) lots of progress needed on lots of things super fast. on emissions, be more specific pls. @Brett_Fujioka things, but FWIW IMO rare earth minerals/mining def. huge issue, insufficiently addressed thus far but non-trivial progress. @Brett_Fujioka mainly familiar with things reducing runoff/harmfulness of chems in panels/long-term enviro issues, new materials for various @Brett_Fujioka could elaborate in some detail depending on your specific interests/standards for what constitutes fast progress ;-) @Brett_Fujioka many people working/some progress made in both characterizing and addressing both of those in various ways/senses. Sidenote: tweeting more about solar lately cuz thinking about what role it could play in my next few years' work, so thoughts def welcome :) + that clean panels, push stuff (like PV panels) down long metal racks, etc and lots of slightly more ambitious/vague stuff discussed.(2/2). Lots of cool (though limited in scope) robotics-related projects in the solar industry today, not just in manufacturing. E.g. robots (1/2) RT @KiraRadinsky: Proud to be on the same list with the rest of the amazing people in @Forbes 30 under 30! http://t.co/P0Ayc9dvMY RT @SalesPredict: Congrats to @SalesPredict CTO @KiraRadinsky! "30 Under 30 in Enterprise Tech" by @Forbes http://t.co/dvqYfjdfJe http://t.… @paulonabike which I'd love to engage at eventually but first want ppl to agree it's worth discussing. hasn't worked yet, maybe paper'd help @paulonabike I think it raises a ton of interesting Q's - who is harmed by killing future jobs? what should they be? human/machine role? etc @paulonabike so that's just one example, don't have perfect model of why ppl might be offended, but think only a matter of time really... @paulonabike not to mention tech/energy is inherently political etc. and the sort of stuff I want people to explicitly consider is big etc.. @paulonabike I don't think they deeply/inherently conflict - that's kind of my point, it's complex - so chopping block = shorthand obvi :) @paulonabike sort of explicit chopping block seems sorta taboo to me on some level politically but dunno. Again, no significant pushback yet @paulonabike many want/expect solar to create bunch of jobs. many want it to scale. i am saying those may conflict. putting former into any @paulonabike suspect some combo of following is true: ppl dont care, dont get it, think im mean for saying such things, think implausible.. @paulonabike no...been thinking about/paid to study such issues for a while/haven't written up tho so wish they would, but nope. @paulonabike surmountable IMO but yep. Would love for someone to challenge my solar claims on such grounds but no one seems to care :) @paulonabike huge ,just meant not ~global/total like solar. energy v local so obviously i think it/other things make sense many places tho. @paulonabike also, on the logarithmicness of that figure: IMO helps my pts on solar bc highlights need for outside box thinking to keep up. @paulonabike unless you mean ocean renewables writ SUPER large, including e.g. solar on water. but if you meant tidal and/or wind...yeah @paulonabike nice. Haven't had as much exposure to ocean renewables as terrestrial over the years but interesting. Scale limited cuz math :/ RT @FrankPasquale: “Observers are skeptical that high-tech cities are the best course in a country where many lack basic infrastructure” ht… @paulonabike take it from someone who has looked at thousands of solar-related figures like that - the rate of progress is pretty solid ;-) @paulonabike yeah, just one of many possible ways to represent related things... could show you data seemingly more promising on solar. Some stuff by Trancik here on theories of solar/energy technology progress in general/policy/related issues FYI: http://t.co/SF40shTTZn Related: automating all things solar would have sounded/been crazier just a few years ago, but hard cost drop was HUGE!! Underappreciated. $1/watt as a near-term goal/target, I mean. We're not yet there but within striking distance IMO, partially cuz DOE SunShot set goal, acted. Recent solar progress=huge/maybe underappreciated. $1/watt fully-installed solar price was considered/was crazy few years ago. Not anymore. 50% renewables in CA/anywhere raises lots of economic/political/etc. questions but technically speaking, even way more than that is doable. People have argued ~persuasively New York could be mostly renewables-powered. 50% in CA is piece of cake techno-economically/geographically. @paulonabike nice. Anyone have thoughts on the latest Brown/California/renewables 50% thing? "RT @David_A_Talbot: At CES, powerful vision-processing brains for semi-autonomous cars. http://t.co/idVIOI002h" FWIW progress being made on all tech issues I mentioned + more realistic sexbots could be made if lots of researchers cared, but they don't. Last tweet=just few reasons realistic sexbots=long off. Unrealistic ones exist/will be used more maybe but not like realistic ones could. Seen most human-like bots in world and FWIW they're unrealistic in motion, human-controlled mostly, driven by noisy pumps in other room, etc Clarification on prior sexbot rant: porn/sex industries=early tech adopters so many things plausible soonish, but not Cylon-like sexbots. :) @mariana_farinha lol looks like one of Hiroshi Ishiguro's bots...dunno though :) @yksnpnwrbrhsa should be (/prob is) somewhere a list of mega-casts. ultimate one in a laughable way is expendables 3 trailer, just lolol. Also on solar: unclear how exactly 4 solar to ever create mega-jobs anyway bc low maintenance plants once built. Super duper project-based. @yksnpnwrbrhsa no @yksnpnwrbrhsa and the Bay/Cage nexus in particular is quite sweet. Consider The Rock. @yksnpnwrbrhsa that's a bold claim, lots of movies do that. Dunno. But yeah it's def a big one. I like Michael Bay in general. + "destroyed" by such stuff, tho raises big justice Q's. Also, cheap solar would help many folks/create jobs in various other ways. (2/2) Another point on labor in relation to solar: jobs created on ~project basis, disappear mostly after. So only hypothetical future jobs (1/2) @yksnpnwrbrhsa that's part of why I watch so many bad movies. they often have unbelievably epic casts. @yksnpnwrbrhsa Cage really gives things his all. @yksnpnwrbrhsa absolutely amazing movie RT @femfreq: Thanks @Intel for stepping up to lead by example and take real action in addressing rampant gender disparity within the techno… @mark_riedl and how to engage the public in such things. Still working on the exact details of what to include :) @mark_riedl only have pretty basic ideas on AI funding per se now though anyway..talk more on future of work, edu/welfare, AI prog modeling. @mark_riedl I will be tweeting the slides soon after in case not - would do so now cuz would love feedback but first they must exist.. :) @mark_riedl better distributions/types of funding of AI will be a (brief) topic in my talk in Austin :) hope to do more work on that later. @mark_riedl that's helpful, thanks :) Note on last RT: don't endorse the hypey title, but the actual content is worth reading :) RT @intelnews: Intel CEO Outlines Future of Computing http://t.co/MrYzKlxIK2 Put differently: if solar ppl want to really win, must take automation more seriously than energy-dense industries w/ intrinsic advantages. + bc most cost is ppl, rate of deployment limited now cuz more power means land=labor=$, look at all costs if we take solar seriously. (2/2) Abridged case for solar labor being a thing: marginal cost of producing 1 piece of solar hardware--->0, but cost can remain high even (1/2) @mark_riedl meant similar in terms of goals at the person level, not necessarily field...but don't know scope of field(s) anyway, seems :) @mark_riedl what are main goals of non-testbed-oriented game AI research? surprised no similarity but must have big misconceptions on it... RT @hermione1: Intel @ces - robots. Eek. Robots moving around with real sense cameras and autonomous nav. Smaller footprint and lighter wei… RT @hermione1: Intel brings new meaning to look ma no hands - or at least no keyboard and no touch. Pure gesture interaction. @ces @mark_riedl true a lot of the time in AI /academia generally frankly ;) way too little communication/collaboration across the board... @mark_riedl yeah diff games/complexities good for education, entertainment, measuring prog etc. @mark_riedl it's really in the testbed sense that I refer to games/AI usually...what's impressive for one reason isn't for another often... @mark_riedl at least that's the idealized case for it as put by legg/hassabis et al. not saying fun, etc doesnt play role in them doing it.. @mark_riedl *but don't think DM cares @mark_riedl agree 100% but think DM cares - game stuff for them is just method for testing/inspiring intel/generality of agents/algos @mark_riedl if I take ur meaning to be it's not useful for developers, yes. But I think stuff developed there first could have broad use... @mark_riedl you mean by the thing about devs? @mark_riedl agree the value is questionable directly, tho potentially good commercially if inspires more ambitious R+D etc. but dunno what+ @mark_riedl whereas e.g. DeepMind wants (I think) some non-trivial fraction of games from year X to be learnable, inc. not just FPS elements @mark_riedl well, there are many distinctions evoked that, but I meant not so much the learning but the cross-domain/highest level analysis. @mark_riedl bringing up cuz in e.g. Destiny, have to go through menus, create chars, go to town, etc. Shooting/fighting easier than all that @mark_riedl another relevant distinction: in-game performance in game X being impressive vs. learning to play game X...related, obvi, but+ @beaucronin obviously the loosey gooseyness has value, but yeah agree that in the status quo, the field barely understands itself at all. @beaucronin another interesting thing is that this is often remarked on by AI people/attempted to be fixed etc, more integration etc. etc.. @beaucronin like progress as accumulation of facts, as approximating some thing, as revolutions, etc. many lenses helpful for AI, prob >1. @beaucronin to say on comparisons to other fields, etc. after reading book on general purpose(ish?) theories of scientific progress soon... @beaucronin oh absolutely, devil is in the details, though. many fields are loosey goosey in various ways/extents. hopefully will have more+ @beaucronin in part cuz ppl want to fit all of AI in one umbrella (for good reasons) but ppl pursue radically different goals, etc. @beaucronin yeah, that's big part of the can of worms. One I had in mind is - if it's a science, what are its aims/scope? Few full answers.. @beaucronin good points. still not sure what I think about all the uses of "scientist," "engineer," etc. in terms of AI. it's a weird field. @beaucronin p.s. was overgeneralizing obvi on "engineer" inflation :) @beaucronin but even engineers have good theories of stuff that they apply in various ways, etc. need MOAR theory on so many levels in AI. @beaucronin but to the extent that it is more just throwing resources/tricks at problem (some NN stuff), more approp. than other subfields? @beaucronin related: I often am befuddled by everyone calling everyone/themselves an "engineer" in AI when they do other stuff.... @beaucronin sure one could point to many examples of cool theory papers at various points but yeah, only as urgently needed lately :) +like that at as frequently before this deep everything craze? Or, outcome of being befuddled by especially impressive results lately? (2/2) Interesting that there have been various papers recently on testing, theorizing, etc. deep neural nets. Were people publishing stuff (1/2) @Aelkus and affect local ppl etc. but whether those are the questions people actually raise/if they're well-posed is more complicated :) @Aelkus know you were talking about the border thing not just in general but still, think people have legitimate questions of if it'll work @Aelkus ehhh people care about/are affected by policy details. They just don't often know them or have ways to engage with them effectively. RT @amcafee: Worries about tech and jobs are NOT new. http://t.co/nkgMnj3hxu Are things different now? More I see tech progress, more I say… RT @paulonabike: The persistence, even if casual, of the use of horoscopes and signs is very interesting. @paulonabike and often not casual Watson ecosystem=big/complex but their visions/goals are clearer than Google's anyway, so less challenging from a what are they up to POV. DeepMind papers = example of Google having ton of labs doing different stuff interconnected in publicly unknown ways, frustrating for me. :) DeepMind papers I've shared on here were found via Google Scholar/Google, def. not "Research at Google", let alone http://t.co/rLPA6dd0R6 :) Lots of reasons it's unsurprising Google wouldn't want everyone easily/commonly browsing their research, but just saying, you kinda can't. Noteworthy that Google's system for browsing their own publications is so arcane (no global search), when they also run Scholar which rocks. @mark_riedl my naive understanding is game AI today does benefit from transfer in sense that humans mix/match, not AI-led really tho.. (?) @mark_riedl as Legg said, learning/transferring across games impressive, hard.. think I should check out your class syllabus on this :) @mark_riedl yep! Hard to elucidate/implement "fair" in human-AI comparison very hard here :) RT @mark_riedl: @Miles_Brundage But how much prior do AIs get? Human have strong priors: Destiny is usually not first game played; RW exper… Even under the best of circumstances, tech management is hard, but Google also has to deal w AI people, who are super ambitious/opinionated. Google prob top AI company overall (wrt human/other capital) but integrating that talent/ambition in coherent strategy hard for any company. + whether that's plausible depends on lots of stuff, but one from their POV is if they can manage their vast AI R+D ecosystem. Unclear (2/2) Dunno if others think Page/Brin et al. are joking about expecting to make advanced AIs/cognitive prostheses super soon, but they aren't(1/2) Compared to a dominant AI team in Destiny, I'd be even more impressed by an AI that could play *on* a top Destiny team/communicate v. well. I'd take Amazon's "12 left in stock!!" stuff seriously if it were reserved for fast-selling items, but doesn't scare me re: obscure books :) @hannahgais if that was an epic pun and not typo for pope I don't get it ;) @hannahgais pupe @hannahgais sounds like it Per @mark_riedl's points, impressiveness of Destiny AI depends what the criteria for success are, what info it's given, etc. If a team of AIs beat the world's best Destiny players in a fair (e.g. AIs must use vision only) game, I would be impressed. :) @mark_riedl @mark_riedl running around, shooting people, sure that's easy, but teamwork, weapon drop strategy, diff gametypes, etc? or not what u meant? @mark_riedl expect most of what DeepMind is doing now is between those two extremes. @mark_riedl for PvP would still be hard for a while to beat humans in a fair game IMO but not that familiar w Unreal Tournament results (?) @mark_riedl but disagree with *only*. Lots of other reasons I give it as example of hard game, including that I include PvE/campaign too.... @mark_riedl yes completely different questions :) For the Bostrom super-fans reading my last few tweets: I know, he suggests more research at the end. Just saying that part is vague/short. + ...which isn't shocking - he covers the existing lit. well. But worth noting the paucity of serious work on > few years from now AI stuff. More to say on stuff like this soon but Superintelligence (Bostrom) is generally better/more detailed on risks than solutions esp. policy. + Big uncertainties in future of solar, but state of the literature has advanced a lot lately, partially due to US gov't grants on such stuff. Future of solar (compared to AI, at least :) ) = relatively well modeled/understood in some ways. Much known on e.g. cost drivers/scenarios. RT @j2bryson: us: http://t.co/35QEWIgCwf Value homophily benefits cooperation but motivates employing incorrect social info. JTB, final, fr… @beaucronin yup! When I said Google HQ has to prioritize "apps", what I meant was $$$. DM wants to change world so *def* cares about applications writ large. Tensions implied by my last few tweets on DeepMind viz-a-viz Google HQ, as I've mentioned b4, make DM's location in London absolutely key. If I had to guess (haven't met em), Google's senior leadership cares ~the same abt # 1+2 in last tweet as DM, but obligated to prioritize 3. DeepMind seems to have put a lot of resources into 3 things: AI progress, impressive game AI, apps. Google HQ cares about all but esp. #3. DeepMind made big splash playing Atari games w/ ~no human-coded input to the AI before learning. =Unsusustainable approach, which they know. ..Many argue this, and it's one part of e.g. Legg's benchmark for AI progress: systems that can learn hard video games *not* from scratch. For many reasons, transfer of knowledge w/in AIs/bots (across domains) + across AIs/bots (sharing skills) seems key going forward R+D-wise.. @mdelachang well, I hope it will be more than a nugget, but until it's written.... :) But yeah, all for such knowledge exchange anytime!! @mdelachang excellent hashtag! :) @mdelachang could give you more than just a nugget soon too if you want - draft working paper on theories of AI progress/progressing them ;) @mdelachang my impression from skimming it is that it's super relevant to AI/cognitive science etc. issues, w.r.t. brain-like etc goals 4 AI @mdelachang anytime! speaking of POS, reading a book on theories of scientific progress by such a person soon. should be very interesting :) One thing that DeepMind et al. at Google could be focused on given their patents/papers is super good (w.r.t. today) iterative image search. @mdelachang nice. jealous of your knowledge of such things :) @mdelachang which one? :) @Aelkus I'm impressed with their super old (in AI timescales) research/ideas. Suspect they're ~1 year ahead of anything we have read... @Aelkus way beyond me at least ;) you know more on games, but everything i see suggests they are taking it super duper seriously @Aelkus oh for sure. But again I suspect DeepMind is way beyond us in theory/practice of game eval and have made prog on all that stuff... @Aelkus haven't ever tried to mod tho, just play e.g. RL in flappy bird or whatever @Aelkus right, big diff between new and old. Atari etc super useful in mod form. @Aelkus can imagine it being prob for new games in general but usually not old, plenty of examples/frameworks to use.. @Aelkus how? hasn't affected me one bit @Aelkus ya ALE is decent but DeepMind surely has way better systems for this stuff. It's their thing (70%ish? subtracting apps/eval theory). @Aelkus no doubt they could do impressive things, just not eg learning campaign from scratch @Aelkus interesting paper on general framework for markups/etc in video game AI by Schaul I think? Anti-prediction for DeepMind 2015-2016: them playing Destiny or other current video game. Way too hard/not worth their time except for fun. AIs of the sort DeepMind makes benefit most easily from a bunch of simulated experiences. Obv trades off w complexity/reality of that world. All of last few tweets, FWIW, are specific to 2015-2016. *Eventually,* AIs may be able to learn rules of most complex games on own, not yet. In general, more complex games/bigger state spaces/harder AI probs/etc. are easier to mess up, =need human feedback at various time-scales. If DeepMind really wants to move to more and more complex games, they will need a good system for human input. Signs they're working on it. Another key pt on DeepMind's near-term game stuff: suspect some of the impressive results they show will *not* be fully autonomous learners. How DeepMind balances exploration/exploitation in terms of game dominance/products is unclear, but evidence suggests serious effort on both. DeepMind *could* focus on playing higher fraction of old games w/o input, but they're also simultaneously moving forward in time game-wise. + Also, on ~2000 era games: games vary a lot in AI hardness, AI that plays higher # of harder games with less input = more impressive (2/2) Elaboration on previous 2015-2016 DeepMind predictions: simultaneous to video game stuff, they will prob make some big progress on Go. (1/2) @gsvoss @jathansadowski might have thoughts :) @nerdsrocket you have way more willpower than I do in that respect... @hannahgais not mutually exclusive with what you said, just another data point.. @hannahgais guilt vague/intimately tied to other factors in my experience... @SuzanneWaldman apparent indeed ;) @SuzanneWaldman *note: I know you referenced BBC in earlier tweet, just meant - doesn't sound like they put it that way... @SuzanneWaldman who said they shouldn't? @badnetworker Tax Reduction and Budget Bureau. Wow. "RT @badnetworker: Bo is great and all, but presidents should have more opossums with names like Mr. Reciprocity and Mr. Protection. http://…" @Aelkus yes, love to see provocative stuff on that angle. Also, what top recs for non-US/Canadian (esp East Asian) plausible AI-in-sci-fi? Because of Caprica's abrupt ending, some aspects of the Cylon uprising are super vague/implausible, cuz crammed into ~few mins at end of S1. Important thing to keep in mind about Caprica and wikis related to it: the show was cancelled/had to end after one season and a S2 trailer. @Aelkus learned a lot about Mass Effect universe on their wikis recently too. Lots of AI stuff obvi. @Aelkus solid. In my book, though, the Battle at Atlas Arena is legend. ;) Here's a more extensive wiki page on the U-87 hardware (some context for that in the MCP page) as well FWIW: http://t.co/sOa3B9J6ZS To be clear: the MCP sub-plot is far from the most impressive/plausible thing about the Battlestar universe, just key AI-wise/nice wiki. :-) For anyone who won't watch Caprica but is interested in the tech side of the Cylon uprising (never know) here you go: http://t.co/rXun3juHXs The meta-cognitive processor (MCP) = key underlying tech. behind the 1st generation of Cylons. Some details discussed, not all obviously. :) @zeustoves good to know :) liked the main characters from what I saw. Notable diffs btwn Graystone Industries/Google: Graystone def evil in some ways, more dominant, Google has no lucrative bot/VR product (yet) Graystone Industries (Caprica/Blood & Chrome) is similar to Google in some key ways: most powerful tech giant (for now), AI/bot/VR R+D, etc. @Aelkus what do you think of 50% renewable thing by Brown today? @beaucronin (for a certain time period, forget exactly how long people were anti-robots on Earth?) @beaucronin like the way they sold robots as a service (used as business model example in class once :) ), use in space not earth, etc. @beaucronin related: the nearly-fully automated economy and policy issues Asimov imagined in some stories are wacky/genius/relevant here. :) @beaucronin + to ppl for w/e reason, if it takes a while, leisure(/ish) society through various means, open source dominating, etc. (2/2) @beaucronin don't think no one caring soon or ever would be good, just meant future considerations like: if other tech more salient (1/2) @Aelkus as case study of expertise, public(s) participation etc. @Aelkus Yucca Mountain is interesting (but super complex agh) case study here :) @Aelkus just not clear on exactly what steps, etc... lots of structural, other factors at work. @Aelkus to quote Tomas Vergis out of context, we can do both at the same time :) (re: idealism/pragmatism). it def doesn't, + could improve. @Aelkus additional steps that should be taken? @Aelkus at least lots of folks know it's a problem and/or have taken big steps to fix it. Wayy better than Bush administration in many ways. @beaucronin wondering what, if anything, existing/on the horizon could plausibly create e.g. Graystone Industries ;) @beaucronin more specifically on VR: what do you see as the first few big/lucrative/whatever applications/domains? @beaucronin other uncertainty for me is whether, by the time these things hit stride, many people still care about market share etc. or not. @beaucronin a sci-fi series I mean. @beaucronin wasn't there a series specifically about that and the environmental aspects of VR? utopian something something? green cover? @beaucronin oh absolutely. could be the biggest market, period. on AI, VR, and a few other things, for me it's all about time/social context The # of AI-related novels, short stories, etc. is huge, way more than any human could read in a lifetime. An AI, on the other hand.... :) Person of Interest = one of my most glaring AI-in-sci-fi-related knowledge gaps right now - seen some eps, enjoy, seems important. Thoughts? @beaucronin by "big" I mean trillions, basically. Easily see that for Q+A, various bot applications, dunno about ads for social media. @beaucronin granted, not super savvy on social media stuff in general, but it seems like the big bucks are in the real world, tech, not clix @beaucronin somewhat related: come to think of it, VR and AI-related things are my only scenarios for how FB could survive long term anyway. @robinhanson you had the equivalent of a whole em city in wealth next to you! ;) or maybe building? I dunno. @robinhanson no worries, I will pry various insights out of various people at various points ;) hope was good experience/new ideas produced. @robinhanson any interesting insights that can be shared yet from the conversation, at any level of abstraction besides that one? ;) @robinhanson He sounds a bit like Jaan Tallinn in some ways (rich, x-risk-oriented, hangs out at AI confs chatting with people). :) Want to share Battlestar Wiki pages cuz v. impressive. :) But suffice it to say if you get serious about BSG/Caprica, they've got your back. May have won old bet on 3D printing but forgot detailed terms. :) Anyway, 3D printing has HUGE potential, dunno if will be realized/by whom. RT @io9: Why do some people think anime characters are white? http://t.co/jiKaV73Id2 @mrgartrelle @paulonabike worked out quasi-detailed scheme for that in my head once: called it unvesting. In Phoenix, there's nontrivial # of startups/small to medium size businesses in AI, e.g. machine vision for surveillance. Interesting stuff. @hannahgais no bravo, then, just sorry :( RT @nancyleong: I have a new column for @HuffingtonPost summarizing #deathpenalty in America in 2014: http://t.co/3mMxiyl8lX #lethalinjecti… @hannahgais if you're not sick, then bravo. @hannahgais I basically haven't left my apartment in 3 days cuz I'm sick, but have been noticing how not unusual that is for me at all. :) Anyone recommend good serious (text)books on labor econ, education econ, welfare state econ, etc economics bearing on AI/jobs? @robinhanson @Brett_Fujioka @hannahgais not that y'all aren't great, but this got me thinking about how great dogs are. @Brett_Fujioka @hannahgais new idea: we need to befriend some actual dog species experts who post poodle/Pom/etc. pics all day or something. @Brett_Fujioka @hannahgais there are many types of specialization. I am also a full-time Pomeranian expert/buff ;) @hannahgais cool topics btw :) @hannahgais yeah that was the level of analysis I was interested in :) mine is mostly "idk" too, just wondering if I was missing some theme. @hannahgais like if you are a Russia buff or that is your "beat" or what. Seems like mode topic but many others too :) @hannahgais oh, I was asking what your "official"/"day"/whatever job/focus is tweet-wise, if any, given your various hats/interests. @hannahgais (removing New Yorker this time) not that one need have such a clean separation. I don't have one at all. Just wondering :) @hannahgais @NewYorker can't always tell, is this your full time thing? Do you have one tweet topic-wise? @beaucronin I prob should eventually, tho, so lengthy technical/historical treatments of such issues welcome if you find/remember any.. RT @kileykroh: California Gov. Jerry Brown just set a huge goal for his state to obtain 50% of its power from renewable sources http://t.co… @beaucronin prepared to defend Watson-as-breakthrough, DeepMind-as-breakthrough, but not quite anything car-related yet ;) @beaucronin I think "successful hacking" is EXTREMELY unlikely to be accurate re: Thrun's role, just saying, I don't have rich model of it.. @beaucronin if that's the metric, IBM deserves a bajillion more medals cuz their money/team, goal, work, vision, etc. vs. successful hacking @beaucronin I just don't have a good enuf understanding of what the key/concerns/events/issues at the time were, etc. @beaucronin that's fair, but justifiable surprise (?) still unclear to me. Cars can have Google godfathers perhaps, makes more sense. @beaucronin much of that $$/push not being from them, but emergent from the competition design, lessons learned, shared code, etc. @beaucronin agree/disagree in many ways, shockingly :) but yes, true, but quibble abt "out of blue" vs reasonable outcome from big push/$$$. @beaucronin not arguing with you, just soapboxing ;) @beaucronin godfather implies early. Google was not early here, didn't exist early here, can't see how ppl keep giving them so much credit. @beaucronin well, can't speak to Google details, but no one at Google is the godfather of anything self-driving. Decades of R+D b4 Google. *I've settled some solar combine-related questions to my satisfaction, that is. Want more data/analysis on many related issues but time.. :( Think I've settled some Qs on solar combines, but lots of open ones, e.g. tech details, green job--cheap energy tension, role of gov't, etc. Real version of a solar combine might be slower than ag one, do fancier site prep, etc. but key point/similarity is a huge change in labor. @thekibosch jealz! Another clarification: even without large-scale automation, solar is way cheaper than it was and will get cheaper. Not nec fast enough, tho. "Solar combine" term comes from early draft of SunShot white paper, not mine. Also, *many* key differences btwn combine + solar automation. This slide sums up roughly what I think (welcome counter-args!) may be nec. for solar to reach terawatt scale soon. http://t.co/UjaeUOm0Yz @beaucronin people have basically no idea what could be coming v soon. + the solar people are disrupting a ton of real stuff right now...oy. More fundamental than "not having perfect info," many who live under Real Capitalism today have *false*/*harmful* info on AI, robotics, etc. Should probably go without saying based on my recent tweets that I don't put much stock in econ args premised on (nonexistent) perfect info. In all of those cases, I have ideas for how to overcome them, but first need at least one other person to ~care about solar automation. ;-) Some reasons solar industry (/others?)=ignorant of AI/bots: no one's job, short horizon, lack expertise, AI/bot ppls' fault, econs of scale. One conclusion of my solar/labor work of broader interest perhaps: many, many reasons why solar industry is unaware of automation potential. @VanJones68 FWIW also have related (tentative/in slide form but could write up if asked) thoughts on tension btwn green jobs+cheapest solar. @VanJones68 would mean a ton, thx so much! I suspect/hope you will find much in it relevant to your interests, + much to add/correct etc. ;) Was annoyed, to say least, when I found out (before liking Obama was cool/uncool) I missed a chance to meet 1-on-1. Again, Tapestry, tho. :) See Tapestry (TNG ep.) on regrets per se being unhelpful, but I pseudo-regret barely not meeting Obama one-on-one in 2007 cuz laziness. :( @paulonabike just need to actually *have it* first.... after that, will cite it/some other upcoming epic reports all the time. @paulonabike I'll be yapping about it for a long time to come, rest assured :) @paulonabike you are gonna poop your pants when the report on that NASA public engagement event comes out...so am I. @paulonabike watched Apollo 13 the night before a big public engagement/NASA thing on asteroids. was so epic/appropriate ;) @paulonabike thanks! @paulonabike /ulterior motives for watching - inspiration etc. beyond just quality :) in any case, will check out. @paulonabike sounds worth it. 3 hours is nothing - I regularly rewatch all of Caprica for inspiration ;) key is quality... @paulonabike yeah heard of it, but just havent seen or at least not recently. strongly recommend? @paulonabike elegant unlike my poor editing job/change of heart there (decided to uncensor) ;) @paulonabike my fave is him talking to ppl while taking a shit. doesn't take shit from people, makes them watch him take a sh**. So elegant. @paulonabike not familiar...takeaway? IMO Obama has not spent enough political capital on climate, + has diff constraints from LBJ, etc. But still arguably no LBJ-level push yet. LBJ came into office getting similar expert advice to Obama's: don't spend your political capital on [civil rights/health care]. Did anyway. I don't say things like "risked/lost ~everything" lightly - most politicians don't really sacrifice anything. But in LBJ's case, applicable. I'm no LBJ buff, but Caro is + argues (pace WaPO article/contra others) that LBJ risked/lost ~everything over civil rights/related issues. On last RT and LBJ in general: recommend Robert Caro talks/interviews on Youtube (there are >1, can point to 1 tho if needed) on such stuff. RT @monkeycageblog: Who disagrees with ‘Selma’s’ portrayal of LBJ? Blacks in the civil rights era. http://t.co/UAeeLrmd3v RT @MarkMuro1: Gov should lift sights beyond correction of market failures to play "visionary" role in innovation, says @MazzucatoM http://… RT @elonmusk: Ask me anything at 9pm Florida time (focused on tomorrow's 6am rocket launch) http://t.co/DvCbw4kTJy @VanJones68 speaking of ideol's, curious what u might think about my work on tech/social justice, if u have chance :) http://t.co/qBK4afmV8B @VanJones68 so chose to highlight that one aspect :) @VanJones68 anytime! Also a great thinker/boss etc. ;) but feel like ideologies, importance of good ones, + your skills=underappreciated... One could argue (on DC vs. academia cultures, if anyone else cares :) ) that academics are ~realistic, DC ppl aren't. Many counter-ex's tho. RT @nmpanek: Such an honor to be included in this list! 30 Under 30 Reinventing Manufacturing #Forbes30under30 http://t.co/Ko0TuCD5TO via @… RT @techreview: A company called Seeing Machines wants to use cameras and software to make sure you’re focused on driving. http://t.co/Oc0y… IMO both of those conceptions of expertise (at least as exemplified by those 2 publications) are too narrow and/or broad, in different ways. + as more or less "AI researchers" whereas Pew Report had basically no standards whatsoever, wanted diverse "sample" of "expert" views.(2/2) Noteworthy that most credible analysis to date on expert opinion in/on AI (@VincentCMueller + Bostrom 2014) mostly treats "AI experts" (1/2) RT @MarkMuro1: And here's the charismatic @MazzucatoM calling for more visionary gov. engagement in innovation http://t.co/yyIPsuj5Nm @bruc… More charitable/rosy version of last tweet: sex bot/Pew thing shows uncertainty about future of AI, complex/contested nature of expertise :) @Aelkus better be ~ a trillion times better than Lucy (will settle for Her level). Walked out, a right I invoke only very, very sparingly. Sex bot/Pew thing is one example of a bigger, more fundamental issue: many in tech think they're experts on everything, + many believe them. I can imagine quite a bit AI/robotics progress-wise, but overcoming all key sex bot issues soon (/other stuff in Pew report) = ridiculous. I'm last person to deny sex bots=real issue. But they won't be v. good or mainstream in 10 years. That being published shows systemic probs. One of the biggest AI/robotics progress fails in the Pew AI/jobs report was roughly this: sex bots will be good, widespread in 10 years. NO! I should have added: economists perhaps most of all should be appalled by that Pew AI/jobs report. Much of it nonsense, clearly their turf. Embarrassingly (for Pew/AI people/humanity), huge fraction of people quoted in that Pew AI/jobs report had totally wrong/indefensible views. To be clear, assembling wide range of views of quasi-experts and a few real experts in X is often helpful. But that's pretty much all it was Great example of many things wrong w/ AI/jobs debate = that Pew report. Confident, diverse views, no common framework, no policy takeaways. Notably, almost all estimates of future AI/robotics market sizes make few mentions of any of the serious literature on AI/robotics futures. Many estimates of medium-term (~15 years) AI/robotics market size, mostly ballparks. Wide range, but I suspect most underestimate potential. "Maybe" in last tweet/projection on smartphones specifically meant that it depends on policy, etc but the *potential* market=trillions easy. Pretty mainstream/likely (tho simple/BAU only!) near-term projection: smartphones = big $-maker for while, maybe bigger when actually smart. Note on that business model book I just recommended: I know it looks kind of un-serious but the content's great, "hot" right now, +coherent. Business model design=tricky (accessible intro here, tho: http://t.co/MpzDwIYlts), but AI prog. makes *some* bus. models way easier than b4. @robinhanson I consider my own reluctance to send papers to people a problem at various stages. open/frequent sharing seems close to optimal @robinhanson sidenote (not on ARPA-E :) : re ur post/paper circulation, 1 heuristic I use: send stuff to critics before and after finishing. @mark_riedl on behalf of any students too coy/not in front of Twitter to say this.... so you mean you don't love them!?? ;-) On the "take an existing process and add AI" business model (per last RT): yes, widespread. Often naive, but w/ AI progress, not nec. crazy. "RT @erikbryn: The recipe for startups that I'm hearing more and more: Take an existing process and add AI. #2MA" @robinhanson I see it as more of an innovation policy/gov't efficiency/sci-tech prog. experiment but arguably a culture experiment, too. ;) @robinhanson sorry, I take that back. from top up and down ;) meaning, went to Secretary of Energy level/higher/sideways etc. Huge effort. @robinhanson also noteworthy: *everyone* involved in ARPA-E from top down put in effort to keep things that way. Ultimate fate still unclear @robinhanson "such stuff" meaning both places where the "problem" has been "solved" and ppl amenable to such solutions. Both unclear to me. @robinhanson that being said, I have little knowledge of how pervasive such stuff is. Suspect not much. Have had some fortunate experiences. @robinhanson like lots of things, I think that issue/cluster of issues is increasingly well-understood+tools increasingly avail. to address. @robinhanson right, you and I both often paint in broad strokes ;) just pushing back on your real or perceived-by-me tone of pessimism. @robinhanson to clarify - my use of "~" may have been vague. I meant "approximately." Most probs you mention depend on partic. ppl's psychs. @robinhanson I mean there are places where regular, sharp, accurate, truthful fundamental criticism is *genuinely* valued and encouraged. A few things I fancy myself a super-fan/friendly-skeptic of: sci/tech, good gov't programs, moral/political philosophy, BSG, and Caprica. :) @robinhanson nowhere perfect, but based on that experience I'm confident for some ppl in some places, probs you identity ~totally solvable. @robinhanson "constructive confrontation" as articulated by Andy Grove, cognates by others, was in practice at ARPA-E when I left 2 yrs ago. RT @robinhanson: Audiences who don't demand that arguers be matched w/ motivated capable critics, visibly don't care re hidden flaws. http:… @robinhanson 1. agree mostly, 2. you're one of my MCC's in that sense ;) 3. org culture/leadership matters. been in 1s where ur post false. People at e.g. IHMC (including ppl involved in DSB report) have said smart things on autonomy for a while. DOD rarely cites in pub. reports. Among the ways in which DOD keeps getting AI progress/ethics wrong: treating autonomy as 1-dimensional/otherwise well-understood. It's not. Ditto for a few other Defense Science Board reports I'm familiar with, but most knowledgeable about AI one/responses (/lack thereof) to it. Alternative TL;DR of "Role of Autonomy in DOD Systems": we need to think about this in nuanced way, seriously!!!! [promptly ignored by DOD]. TL;DR "Role of Autonomy in DOD Systems": autonomy key for DOD, need to think ahead abt meaning of/changes in autonomy+threats/opportunities. Given AI/bot folks involved (Murphy, Ford, Pratt, Mooney), unsurprising "Role of Autonomy in DOD Systems" = outstanding/1 of best DOD docs. @stcolumbia @Aelkus admittedly, the considerations there are very limited in detail compared to what's possible/desirable, but I found good. @stcolumbia @Aelkus particularly thinking of the sections on technological surprise, vulnerabilities, etc. RT @petitegeek: Wow, a 1 million yen prize for best Pepper app ! And 50,000 yen for best photo/ video http://t.co/EhBWN4xnUN @himisanta @stcolumbia @Aelkus not sure of full context but agree logistical drone issues important. Read "Role of Auton. in DOD Systems"/thoughts? Seen/heard many academics set sights explicitly at middle/top of their field. Rarer in DC. "Wanna be POTUS/stop climate change" etc. common. Suffice it to say the "outs" in last tweets are problematic. DC/academe culture=on my mind cuz dissertation/jobs afterward on my mind now :) + no choice but to be explicit on power/ambition issues, but academics have outs: retreat to "pure" knowledge, jargon, ignore policy...(2/2) General (though naive/tentative) theory of DC-type ambition vs academia-type ambition and their levels of explicitness: DC ppl have...(1/2) In preparation for talk, rereading one of @VanJones68's books, Rebuild the Dream. One of the great ideologists of our day, in a good way. :) People in DC think they have (/often do have) a rich POV on relations btwn ideologies, policy, etc. So do academics, for diff reasons. (2/2) Many of the differences in manifestations/characterizations of ambition in academia vs DC have to do with very different self-images. (1/2) RT @EvanSelinger: R.I.P. Ulrich Beck. Here's @nytimes obit with brief mention of "risk society" thesis. cc: @jathansadowski http://t.co/3rb… Makes sense that academics, for many reasons, often feign modest, but noticeably diff. from DC (+SV?) where explicit ambition rewarded more. Caveat to last 2 tweets: maybe lots of academics just are actually not DC-level ambitious, but suspect much feigning is going on. Annoys me. Examples of salient sims/diffs: in both, *many* ambitious ppl. DC ppl more open about long term agendas. Academics feign modesty more. (2/2) Haven't come to many robust conclusions yet on differences btwn DC and academic cultures, but they are very say, similar+different. :) (1/2) + big progress in AI, robotics, responsible innovation, etc. :) RT @mdichristina: What's ahead in science for 2015: http://t.co/2BrP7bALMf @FrankPasquale = lots of policy issue, sadly. @MattPovey but yeah they'd be super crazy/bureaucratic if *something like* BlueMix didn't have a fair shot. @MattPovey I have a better understanding of Watson at technical/limits/personnel/possibilities levels than applications/high level strat :/ @MattPovey agreed. IMO that's one of key progress metrics for AI and one where IBM's standing is, well, complicated ;) @MattPovey again, many thoughts on that. True of much of AI, IBMs just open about that aspect/have specific model that fits that label well. @MattPovey two examples: Chef Watson: V cutting edge AI+interface. BlueMix: make sites/apps super (relatively) easily, mix n match stuff etc @MattPovey I have a bit and IMO while lame somewhat cuz limited/short term trials often etc, impressive technically/HCI/design etc wise. @MattPovey agree with all that. Have you tried any Watson stuff? @MattPovey importantly, not (just) cuz of tech innovation. Many factors on their side besides that even if it were super dismal + it isnt :) @MattPovey giga/terabucks, I mean ;) many companies of many sizes/types to various extents will make $ but google, ibm, etc could big time. @MattPovey agree w/ that. Though again, matter of emphasis. Expect many from IBM + others but they are among few who might make $ off of it. @MattPovey large/complex personal/cultural/historical/economic forces at work, but saying, on merits, Watson solid, +institutions change. :) @MattPovey I am one of their biggest skeptics in many ways, but also know many smart folks there/know of more, + w right mgmt could change. @MattPovey agree usability huge/cautiously optimistic; Watson and *its ilk* will be huge, but cui bono?; product space big soon if done well @MattPovey far more than handful of tweets worth ;) but agree it is partly hype but would emphasize massive IBM potential if they do X, Y, Z @MattPovey yes, that too is complicated :) have many views on Q of cognitive computing's meaning as buzzword and reality at IBM... RT @iGEASmit: IBM continues pursuit of cognitive question answering systems - http://t.co/WYUMBkIWac via @ipwatchdog @MattPovey disagree but agree it's complicated :) crashes at various scales could happen, but enormous overall boom soonish= ~ my baseline. "RT @hilarysutcliffe: A must-read article for anyone in #synbio or #RRI fr @claire_marris on imaginings of public perceptions. http://t.co…" Patent trolls not being a huge problem in AI (yet/to my knowledge) isn't too shocking for various reasons (software, people involved, etc.). "Bostrom has a draft of a paper on what he calls ""farfetched* AI safety stuff"": http://t.co/xfUQwUwnkk *from him, that means something. ;)" Much to say on Bostrom's Superintelligence soon, but for now, highly recommend, impt. stuff, MANY open Q's inc. ones he highlights + more :) "[James Albus's vision included] world of prosperity/opportunity, w/o poverty, pollution, war, etc.,+ detailed plan." http://t.co/p3l5rpTC9H James Albus was working on a well-thought out, ethically-informed decades-long AI roadmap under DOD auspices before his death in 2011. RIP. DARPA, etc. deserves credit for a ton of things AI/robotics-related, but should be kept in perspective of gov't role in sci/tech in general. DARPA, ONR, etc. play big roles in funding AI research, but, as w/ gov't's role in AI generally (but NOT like some other techs), v reactive. Wish I could compare e.g., DeepMind to a well-funded, well-thought out, ongoing gov't (DOD or otherwise) AI effort, but not aware of any. ?? Naturally, the first response to my tweet about Google and cardboard was from @GooCardboardBot RTing it... This job opening nicely exemplifies Google's relative openness to wacky R+D: ~"Engineer, Cardboard/Virtual Reality." https://t.co/Lbn0Zjlwno Reasons for the stuff in last tweet on researcher autonomy stuff are complex, but include academic culture, where many such folks come from. Suspect that not just DeepMind but many "hot" AI groups/projects/etc. are trying to hire directly + cut out corporate HQ, getting pushback. That being said re: Baidu/Facebook, one reason I focus on Google/IBM is they're way more committed to AI, financially at least. For now. ;) Have less detailed knowledge of ppl/issues in Baidu/Facebook than Google/IBM but think Ng/LeCun would leave if/when majorly cramped by mgmt. Much of DeepMind's hiring seems to be handled by them directly, not Google HQ. This is one of several signs they're relatively autonomous. Also worth noting for ppl interested in AI + jobs that that's one of key focuses of Bringsjord et al.'s recent papers, funded partly by IBM. Selmer Bringsjord has many recent papers on issues re: AI + its future, too many to tweet. Recommended to AI folks. Has well-hyperlinked CV. Haven't done detailed analysis of Runaway (1984) but first impression was: funny, campy, but nice that bots weren't omniscient for a change. Haven't done detailed analysis of Runaway (1984) but first mpression was: funny, campy, but nice that bots weren't omniscient for a change. Sometimes, sci-fi depicts AI/robotics limitations somewhat well, like Runaway (1984): example of dumb robots used for malicious purposes. :) RT @juliansavulescu: Treated like Animals, Guest Post by Christine Korsgaard - http://t.co/qyGtlmX99S Realize my last tweets on spiders may be super obvious to some roboticists, biologists, etc. (/everyone?), but weren''t for me at first. :) + because spider hardware--->hard control problem, esp for tasks we care about for which other models (e.g. bird/snake) better suited. (2/2) If you didn't care about robot spiders before, maybe you will now - new theory: they're common in sci-fi, not reality (except as toys),(1/2) On last tweet: see also the Journal of Responsible Innovation, but @MazzucatoM's book is a bit more accessible. Both worth a peek tho IMO :) RT @MazzucatoM: What do Internet, Shale gas, GPS & Tesla S car have in common? PUBLIC financing! http://t.co/a2vRClQAkg DEBUNKING entrepren… Gov'ts always have/will/should "pick winners/losers" broadly construed, i.e. care about/drive innovation + its impacts. See e.g. @MazzucatoM Corollary of last tweet: Caprica encompasses critical time in the development of AI and robotics in the Battlestar universe, including BSG. Google, with its newly acquired AI/bot companies, could make ~"good enough for military" mid-Caprica (ep 10) Cylon but not late-Caprica/BSG. @Aelkus shouldn't be surprising given Hassabis/various other early people, but anyway, seem super game-centric but learning more v soon :) @Aelkus I would have to recheck various data sources to confirm exactly how many on that vs. applications, but both are very substantial IMO @Aelkus that's a simplification obvi - some joined late, etc but acc Hassabis, it's Apollo Missionesque. True order of magnitude in few ways @Aelkus to be precise, they have several dozen people (each acqui-hired for several million) working right now on evaluation in game enviro. @Aelkus and yes, it was expensive. ;) @Aelkus not to be too glib about it, but really, they're super duper serious about evaluation in general and games in particular as testbed. @Aelkus well, that's basically what DeepMind is. @Aelkus see: Spore. Limited in each layer, but done right, could be great. Infinite spectra/points thereon, like life ;) Cf. Caprica,V-World @Aelkus any sufficiently advanced video game is indistinguishable from blah blah...social sims, reality. Depends, but big stuff as u know :) @Aelkus might have been unclear in my tweets: agree what you refer to is interesting, I meant one game to rule them all level-wise basically @Aelkus RTS in scale (let alone richer reps of each layer, let alone more like non-/not-easily-/well-quantifiable interpersonal stuff, etc. @Aelkus what would REALLY be impressive (and politically/ethically scary) would be AIs doing well in a game spanning from FPS to @Aelkus maybe covered in these but in your opinion, what are most impressive domains AI-wise? Chess obvi, Go seems meh to me, RTS?FPS? etc. Singla, @erichorvitz, Kamar, and White's paper "Stochastic Privacy" is very provocative technically/ethically, etc. http://t.co/8vw7OqsqYz @Aelkus and thanks, that's what I was looking for :) @Aelkus sidenote: "closest thing to survey paper"=similar to point I was making earlier w/ someone - ~infinite paper options 4 grad students @Aelkus that's sort of 2nd order question...1st being: what are the aims/scope of game/AI stuff :) /how important is technical stuff there. @Aelkus any papers/demos/etc. that you would point to that are most impressive technically from an AI in games POV, either built-in or not? "It remains to be seen ... how much of what humans do for a living would be replaceable by ...mechanical behavior [as defined here]." Ibid. @Aelkus never mind that one's readable/tweetable if you want :) just a discrepancy of last name abbreviation vs. spelling out in two places. @Aelkus new one messed up for diff reason, ugh... last time.. Great/interesting paper on the future of AI by Bringsjord/Govindarajulu (tho disagree w/ their heavy focus on logic): http://t.co/VJrblMVLiE @Aelkus edit fail @Aelkus yep workin on it :) A "scenery channel"/wall (e.g. in Back to Future h/t @iGEASmit http://t.co/z3py08Myog) =common in sci-fi (Total Recall, Hunger Games, etc.). @j2blather @UN_Women @FortuneMagazine relatively speaking :) @j2blather @UN_Women @FortuneMagazine depends on reason? I'm not an entrepreneur but if I were, would like to think I'd pay myself v little. DeepMind is in London. That's great for their autonomy, but far (in many ways) from most of Google's CPUs/GPUs/data. Has many implications. The Google/Youtube/etc. connection in terms of video data is key with respect to DeepMind. They could do a lot of crazy stuff w/ that data. DeepMind/others at Google will improve search a lot over next few years, but bigger impact(s) will be Q+A/bots/etc., not just search per se. It's possible that in a few years, people will look back and say not much has changed in search/AI lately. But I suspect they'd be wrong. :) @Brett_Fujioka agree... I'm all for discussing detailed analyses of/solutions to such (labor) stuff. Drop me a line whenever if you want :) Between DeepMind and the rest of Google's vast AI/search/~everything ecosystem, safe to say Google search will be a LOT better in few years. @Brett_Fujioka that is, in order to know if I agree with your characterization of the situation - but agree US should maintain unique stuff. @Brett_Fujioka oh absolutely. I'd have to know in much more detail exactly what you meant by Asian schools, I guess. @Brett_Fujioka what do you mean by "if we're compatible with it"? Don't follow closely enough to know how/to what extent downsides addressed For the serious student of DeepMind/AI markets, ICYMI they have Googleable ( ;-) ) patents. Basically: fancy iterative (image) search stuff. Amazon also juxtaposes "Related to Items You've Viewed" w/ "More Items to Consider." No explanation given, and they seem interrelated. Lame. Amazon gives one list of recs inspired by "browsing history" and another inspired by "shopping trends." Weird dichotomy/choice to present... @Brett_Fujioka fair that that could be effect of stuff, but few push for it per se. feel like most get countries have strengths/weaknesses. @Brett_Fujioka @Aelkus well, could be related in different ways/at different levels :) but yeah that was my impression there, as well. @Brett_Fujioka @Aelkus tho that's my view of most countries/corps ;) but ya, my pt is: I'm optimistic. Challenges maybe, could be overcome. @Brett_Fujioka @Aelkus my main impression from short trip there: HUGE potential, want their techs to be available globally, dunno prospects. More importantly than that stuff, Caro seems to know what he does/doesn't know about LBJ. In video I tweeted before, discusses many open Qs. @Brett_Fujioka @Aelkus all good access wise - thanks!! Thinking I might need to read at least some of Robert Caro's books. He's a great speaker/storyteller/seems to know all things LBJ. Thoughts? @Brett_Fujioka @Aelkus any/all of the above that wouldn't be too hard for you to come up with references for. :) @Brett_Fujioka @Aelkus English language recs on the subject welcome if you have any :) Tweet-length case 4 Total Recall: Sci-fi, action, Schwarzenegger, brain implants, AI/driverless cars, Mars, mutants, and it's on Netflix. :) Original Total Recall is approximately a bajillion times better than the new one and worth watching in its own right for various reasons. @Brett_Fujioka @Aelkus not that incident in partic. (would have to check my notes to see if discussed/focused on) but the issue you mention. @Brett_Fujioka @Aelkus yes, much discussion of this at first international conf. on responsible innovation in Japan (Osaka).+Fukushima, etc. Only had 1 brief interaction w/ + few hours watching Ash Carter in mtg, but FWIW, he seemed smart/nice personally/strong leader/into energy. RT @paulonabike: 10 years ago Mexico wages were double manufacturing wages in China. Today, China is 20% more than Mexico. @Aelkus @badnetworker that's better than me, at least: defaulting to no habits/flailing around basically ;) will make progress on that soon. @Aelkus @Brett_Fujioka not so much focused on corps or any groups/ppl in particular, but Japan as a whole not going beyond R+D in e.g. bots. @Aelkus @Brett_Fujioka only been there for few days/rest of knowledge from just reading English stuff, but common refrain in my chats=that.. @Aelkus though I am impressed by their research/wish the following weren't true, many Japanese companies are bad at follow-through+ know it. TL;DR recent tweets/related stuff: Role of Auton in DOD Systems=cool report; note authors; rarely cited; DOD bureaucracy=lame in many ways. Many DOD reports ignore (/were written by people ignorant of) the fact that the Defense Science Board wrote a better, super relevant report. Role of Autonomy in DOD Systems, by Defense Science Board, is easily one of best things written on AI, but rarely cited (even/esp. by DOD!). @Aelkus @badnetworker what specific Qs on building sims? If I had better feel for that, could put this in context/maybe be better free RA ;) @Aelkus @badnetworker as in, don't have a feel for the lit./haven't seen anything mind-blowing. Specific rec.? Seen cool multiagent stuff :) @Aelkus @badnetworker have you read Wooldridge's (text)books on multi-agent stuff? They look cool to me but dunno bout ABM etc... Some key DOD docs on AI/robotics futures, in no partic. order, IMO: Unmanned Systems Roadmap, Role of Auton. in DOD Systems, Tech. Horizons. I take that back: I've seen good analyses of those issues before...in sci-fi. :) Like drone manufacturing or rich autonomy Q's, for example. #NAME? The only serious analysis I've seen of several key technical/logistical/tactical/strategic issues raised by drone warfare is 1 DOD report... @nerdsrocket and if it makes you feel any better, people very rarely tweet about my favorite shows ;) @nerdsrocket well, I LOVE it. I just love lots of shows and am behind on it so no point in watching this second. Wish more ppl outside DOD had read/wanted to talk about their reports related to long-term AI issues - super interesting/provocative stuff. @Aelkus been* @Aelkus salient fact about old scientific literature: it generally raises far more Qs than answers, not all of which have yet be answered :) @Aelkus I expect much/most of the specific facts/theories I learned in poli sci to be irrelevant, but the line of thinking/questions, no. @Aelkus @badnetworker what's the Watson/DeepMind etc. equivalent of social science sims or related stuff, i.e. state of art/impressive etc.? @Aelkus (I took that to mean military ops, but dunno?) @Aelkus what if anything do you think of Nagl and Kilcullen? @Aelkus @badnetworker point being: on paper, it had all sorts of "smart" features - walked, reacted to enviro, send emails, etc. but dumb... @Aelkus @badnetworker when I hear stuff like "agent" used sometimes I think of Nao bot I made in sim living room (trivially) emailing, etc. @Aelkus @badnetworker And in business...some parts of political science...maybe history.... ;) @Aelkus @badnetworker for any definition commonly used, pretty easy to make one, right? People maybe mistake "can do stuff" for super smart. @Aelkus @badnetworker unless you mean sending messages in a richer sense than I inferred (?). Like interagent communication? Or that+ABM? @Aelkus @badnetworker I mean, all sorts of stuff sends/receives messages/emails/data/etc. Agent often uses sort of as adj. to mean ~smart. @Aelkus @badnetworker when I hear agent, I usually think something more along Bradshaw et al.'s usage here, or ~AI: http://t.co/pF06NEA6uq @Aelkus @badnetworker well, depends how you define agents. For pretty much anything in 80's, lots of precedents in prior decades (?)... @Aelkus @badnetworker right, lots of key building blocks already exist, with various degrees of maturity. Key caveat to scenario in last tweet that didn't quite fit: just stuff on Web. Also, could be done now but *much* higher quality in future. Nano-thought experiment: End-to-end AI historian. Reads everything (explicitly) relevant ever written on X ~instantly, spits out paragraphs. @chenghlee thanks, will do! I have a talk on the first workshop day but am super free after that :) Current historians use scarce, sparse data on past people and abundant, rich data on present people. Unclear what future historians will do. @chenghlee gotcha. what's the professional stuff? see you're at Austin - looking forward to visiting there first time for AAAI soon :) @karpathy here (ASU) we just use Blackboard for stuff like that... do you not use anything analogous like that at Stanford that could work? @chenghlee run into contract law issues a lot? /what's your research on these days? see it's biomed/data mining-related, but more detail :) What ppl mean by "sci-fi is about the present" (under one/my interp) = it's inspired by/should influence present. But only 1 role of sci-fi. People often say sci-fi is "actually" about the present. Actually, it's about the past, present, future, and/or no time at all, depending. Don't have informed views on if Continuum's time travel makes sense, but it IS used well (vs., say, Terminator) to explore issues of choice. Continuum is interesting to me/maybe to others in part cuz of the explicit links it makes btwn sci/tech choices today + diff. human futures. @hannahgais @zackzachariah I try not to get too obsessed about it cuz I have only been there once but Japan is kinda the best place ever. :) Compared to the surveillance state in Continuum, the one in 1984 lacks AI/IoT, isn't business-y, and is 100% evil. But some common threads. A few notable (but not too spoiler-y) things about Continuum's surveillance state: corporate-led, IoT/AI-based, many support it, kinda evil. Continuum is, first and foremost, a fun/cool show I recommend for those reasons. But FWIW the surveillance society stuff is super well done. The show Continuum, in one of its time periods, is an epic and provocative reimagining/corporatocratic remix of 1984 in US/Canada in 2070s. RT @sflorini: I’ll be fascinated to see how people will use those Twitter archives to frame the history of this moment. @hannahgais also noteworthy there was a lot of pushback from service people on the interwebs, +his not conceiving of himself as a hero, etc. @hannahgais was super interesting, to say the least, seeing our hometown blatantly commercialized/misrepresented in that way... @hannahgais TL;Won't Write: agree, but it is complex sometimes tho when the specific people highlighted for $ actually are chill/good ppl :) @hannahgais though come to think of it that's true of my views on pretty much everything anyway ;) @hannahgais good friend of mine was highlighted in a Budweiser commercial so I have strong (+decidedly mixed) feelings about such things :) @hannahgais sigh. @mpshanahan @j2bryson good to hear - Chatham House rules = good model for some events of this sort. Look forward to hearing more someday :) Clarification on Legg: IMO his views are worth taking super seriously, I'm just very skeptical about specific dated predictions in general. RT @beccabigwords: Margaret Hamilton, lead software engineer for NASA's Project Apollo, and her code, 1969 #WomenInSTEM http://t.co/HN5CA2H… Key takeaway from Legg's point there is there's a lot about the future of AI we don't yet know, including recalcitrance in Bostrom's sense. Last tweet was from this very interesting and provocative interview w/Shane Legg on risks from AI from a while back: http://t.co/oaSWtsITxi "[E]ven ... optimal algorithms [might] experience strongly diminishing intelligence returns for additional [speed]. We [dunno]." - Legg 2011 I mention Kurzweil's predictions cuz they're popular (if often misquoted), and nuanced in *some* ways, but overall I disagree with his take. On my taking Shane Legg's human-level AI in 2020s claim somewhat seriously: unlike Kurzweil, he has specific/plausible AI progress theories. @beaucronin also a few folks have papers there, but upon looking at the abstracts, nothing to suggest large scale push going on there... @beaucronin immediate prompt for that Q was noticing they are one of many sponsors of AAAI.. Kurzweil/Legg/some others predict human-level AI in ~late 2020s. Coincidentally, Keynes predicted ~leisure society in 2030, starting b4 now. @romanyam of course, beer pong players aren't vulnerable to automation in the same way/in the sam sense that e.g. taxi drivers are ;) What do people familiar with the history of James Bond/the writing thereof and/or WWII think about the accuracy of the miniseries "Fleming"? @romanyam reminds me of poignant remark/point in Carr's The Glass Cage: lots of work on driverless cars, etc. + lots of ppl love driving :) Think I'm going to practice what I preach and rewatch some Caprica (I'm also sick so watching/recommending lots of things this weekend). :) RT @minakimes: "RETURNS ON CAPITAL CONTINUE TO EXCEED THE GROWTH RATE OF OVERALL WAGES AND OUTPUT!!!" http://t.co/VlU9IyVQ4g @davegrundgeiger that's what I was going for! :) always want more people to discuss it in detail. Much to chew on, at least in retrospect :) @davegrundgeiger let me know what you think! also FWIW - I didn't "get" Breaking Bad at all the first time, either. Now obsessed with both. Summarizing my views on BSG + Caprica: BSG>Caprica re: acting/character/production, Caprica>BSG re: near term tech ethics, both worth a try. Per chat with @davegrundgeiger (who I may have inspired to re-watch Caprica, yay! :) ), I didn't really like Caprica 1st time, now love it. @davegrundgeiger I thought so the first time through, too, but FWIW now I think it's super underrated/important/I was wrong before, etc. Yoshua Bengio giving a lecture on deep learning and AI at AGI 2014: https://t.co/Ry4oUOBAbg Considering I've tried (unsuccessfully) to get ppl excited about a whole book on Caprica, I really don't think I tweet *that* much abt it ;) More specifically, I hope to inspire some people to persevere past first few episodes of and/or rewatch Caprica. Very high replay value IMO. Sidenote on my Caprica-related tweets: I know many don't care, but if I inspire a few ppl to watch Caprica, then it might be worth it IMO ;) Many of the tech ethics issues explored on Caprica are not AI/robotics/VR-specific, e.g. profit's role in tech innovation + its discontents. One of my favorite sub-plots on Caprica is the one involving the ethics and business of illegal "underground" VR applications. Great stuff. Not to mention, w.r.t. Caprica, that the issues that Graystone Industries and Vergis Corporation face on the show are (sometimes) plausible. One reason I love Caprica is that Graystone Industries/Vergis Corp=most detailed vision of "Big AI/Robot/VR" in sci-fi film/TV in existence. Wish I could talk to more ppl about how awesome Tomas Vergis is as a character on Caprica. Unfortunately, not all characters as awesome. :) @barneyp @Uber did he feel he needed to work for @Uber for economic reasons or genuinely wanted to? Seems like elephant in the car there. :) As is often the case on the cool AI Topics website (hosted by AAAI), some great stuff here on science fiction and AI: http://t.co/uZJPFy0gl9 Anyone know if Yahoo is doing anything super noteworthy in terms of AI? If so, curious to know more. If not, bodes very poorly for them. :) List of the most read articles in the Journal of Responsible Innovation (all open access btw, not surprisingly :) ) http://t.co/zicgzc6O8S ICYMI: "The UK [EPSRC]'s commitment to a framework for responsible innovation," Owen in Journal of Resp. Innovation: http://t.co/lQ4PbSRxWC On last tweet: ideally said great publications would detail exactly what "should know" means and why that particular information is the key. What are some great pubs on what exactly the public should know on X sci/tech thing? Seen ones 4 energy, climate, nano, any other good ones? 2 notes on that list of public understanding of AI topics: 1. ~from my papers, v tentative, 2. history too but arguably fits in other boxes. People should know at least this about AI: state of art, plausible futures, social context, how it affects them, and how they can affect it. RT @jeanburgess: Happy new year, doctoral candidates! #PhDchat RT @AcademicsSay: via @mechikana2 http://t.co/p1XlPF1CZQ @kevin2kelly like that A LOT more than the version without the "n" in it :) RT @andrewsu: visual timers for speakers should be standard equipment at conferences @nerdsrocket :) @nerdsrocket not "every time" for me but ditto for things that should go on toothpaste vs. hands, in fridge vs. microwave, etc. @j2bryson so, v frustrating for me knowing people there will say lots of wrong/vague things about AI progress.. @j2bryson not that I am the only one w expertise obvi - you not being there is crazier - but just saying, most thinking on "future" is vague @j2bryson on the sour grapes thing: especially when I am giving a talk/laying out most detailed theory of AI progress this month. lame. @j2bryson not panicked but think it's prob not justifiable (and def not justified) in this case, default should be open+ some sour grapes :) @j2bryson @mpshanahan hoping for summary of it soon :) hunch is it should/could've been more open but don't know what was discussed obvi... @j2bryson @mpshanahan /the one I doubt actually needed to be secret ;) and not just cuz I would have wanted to go if it were public... @hannahgais I don't do it, just saying... more of a class thing than an intrinsic jerkiness thing IMO. Time will tell.. @hannahgais dunno bout jerks, at least for all time - I dream of a day when everyone can unironically afford/eat "brunch". Not yet though :) Last pt. on solar for now (unless someone cares, which I am hoping for ;) )... solar is NOT only tech with such issues. Just one I "get." :) "The Age of Social Democracy: Norway and Sweden in the Twentieth Century" looks/sounds epic. Anyone read/recommend it or something related? John Tomasi on his book "Free Market Fairness," nice effort to put econ liberty and social justice in one framework: https://t.co/89BsFJRq0Z Again, have slides making this solar/labor costs case/raising many issues, but happy to engage at Tweet level of detail, or more or less. :) +yet, hence why I bring it up, and 2. not obvious to me "green jobs" etc could plausibly outweigh rest of case for rapid deployment. (2/2) One could argue for X, Y, an Z reasons that eliminating human labor costs from solar isn't urgent. But 1. that debate hasn't happened (1/2) Context for non-solar experts on this stuff: ~everyone agrees "soft costs" are key going forward. Last tweets take that fact to conclusion. + But *if* we want solar to be cheap everywhere on price soon, rethink deployment process, esp: humans' role if any. Raises many Q's. (2/2) Clarification on solar: it arguably already is "dirt cheap" in some geographies/policy environments, esp. if you count externalities. (1/2). @petitegeek great way of putting it, thanks :) yeah, the prob/stat stuff is huge. *some* AI ppl get by w basic calc/lin algebra it seems :) Chat on LBJ/power w/ Robert Caro (who, speaking of power/the Presidency, looks/sounds like Leo from West Wing :) ). https://t.co/z94F986bwa Great interview with Joyce Appleby about her book on the history of capitalism. Touches on lots of interesting stuff https://t.co/RKH6GYZOGl @kevin2kelly do agree such a term could be useful, though :) @kevin2kelly hope not - don't like it, frankly. Sounds jarring, ambiguous btwn cognitive + "cog" in machine, unphonetic pronunciation, etc.. @SuzanneWaldman @ActinideAge speaking for myself, at least, having looked at the issue somewhat closely: lots of alternatives forthcoming. @SuzanneWaldman @ActinideAge just hype, I think. People in the know know we need solutions to material, etc. issues, think we have some time @SuzanneWaldman @ActinideAge I am not necessarily opposed to it happening sometimes or even a lot, but then again that's his tech so w/e :) @SuzanneWaldman @ActinideAge dunno bout "enough"-diff. technologies will work better in diff. places, etc. but non-lithium storage def key. Stiglitz drops some serious knowledge in this interview, which is also very well conducted and edited. Recommend it: http://t.co/GGwrsMvfdP @SuzanneWaldman been part of interdisciplinary group focused on solar buildup challenges (more or less) for a few years so many opinions :) @SuzanneWaldman fair. I get up in arms over solar buildups ;) one of my things. materials side not my thing, know some for whom it is tho :) @SuzanneWaldman not to mention a huge solar push hasn't started. think with a bit of notice before Push Day One, decent subs could be found. @SuzanneWaldman key things IMO are that it isn't green yet in terms of chemical stuff, but is EROI etc wise, ppl working on all such aspects @SuzanneWaldman really though I think we ain't seen nothin' yet really solar-wise. So yep lots could change. @SuzanneWaldman yeah, it's pretty complicated :) but FWIW silicon has great properties/is cheapish so keep will keep trying that+other stuff @SuzanneWaldman right, just reacting to wording of tweet..overall I am optimistic cuz of the super huge variety of approaches being pursued. @SuzanneWaldman agree the resource issue is huge for PV though. @SuzanneWaldman if those are needed for said buildup :) not all possible PV buildups, or even all mainstream commercial techs today @rcalo awesome! Any sort of write-up planned? When I say "writ large" I mean more fundamentally than is currently being discussed, i.e. not just factory automation but all of deployment. TL;DR of my slides/current thinking on AI/robotics and solar: if we want solar to be dirt cheap fast, need to reduce labor costs writ large. My thoughts on solar and AI/robotics are still pretty naive, but my slides try to make prima facie case for looking into it/maybe optimism. Have slides on future of solar viz-a-viz AI/bots if anyone wants to see em. Big issue but no time to tweet/write it or do more research yet. @SuzanneWaldman also, a confessional for people who wish everyone was as excited as they are about solar thermal ;) Related to AI's mathiness: what sorts of things do most people most need to know about AI science/technology? Depends for what purpose (?). @SuzanneWaldman have been wanting to read Marshall's climate comms book "Don't Even Think About It" but haven't,seems 2 have general lessons @SuzanneWaldman makes sense, slash not accepting it as useful/relevant to begin with. Dunno comms theory/strats :) @SuzanneWaldman financing, too, has been huge lately. Lots of reasons for optimism IMO, but rooftop not really my thing, no dog in fight :) @SuzanneWaldman I dunno what "the important thing to do" means exactly here but will say that the price drop/subsidies etc. plays huge role. @SuzanneWaldman *for homeowners in certain areas, that is. Not for people everywhere, or even everyone (/apts) in Phoenix, just some parts. @SuzanneWaldman it's just a complete and utter no brainer between the geography, cheaper panels these days, subsidies, financing, etc. @SuzanneWaldman obviously I agree there is no good reason why not, but yeah it is slightly surprising but def. understandable :) RT @J_Lovering: Very sad to learn that sociologist Ulrich Beck has died, author of The Risk Society http://t.co/ZF5iNqqAAb @SuzanneWaldman interesting local politics/variation in AZ on this, e.g. some super duper conservative cities have tons of solar. In regard to the possibility of clear non-mathematical explanations of (some) AI stuff, this talk=proof of concept :) http://t.co/VFv2DFFOGG Per @beaucronin + @Aelkus , AI's mathiness varies by sub-field, etc. More limited claim: getting *many* AI concepts requires no/little math. @beaucronin agree 100% with that. was careful in my use of "at times" and "that", though latter is more suspect than former. @beaucronin if anything that could fit in a tweet :) @beaucronin Yeah, overly generalized, fair. What would you say instead? @beaucronin besides, my concern isn't really about # of projects for its own sake. I wouldn't nec. be opposed to MetaMind getting huge.. @Aelkus @traviskorte mistakenly consider them unimportant* to understanding the broader picture. Clearly I disagree :) @Aelkus @traviskorte slash just don't mistakenly consider the technical aspects important and are overconfident about that, don't try it out @Aelkus @traviskorte yeah, "math illiterate" was way too nice ;) anyway, think we have consensus. People are super lazy. @beaucronin that's business as usual, yep. depends on lots of factors. Will be one of many things I discuss in AAAI workshop talk :) @Aelkus @traviskorte the situation is worse than that, to be blunt. Cuz much of this stuff doesn't require math. Just TRYING to understand. Unlike The Matrix's (maybe) self-consciously escapist/unrealistic world, Caprica explores (some) real issues of AI, VR, and the near future. Some interesting themes broadly related to AI, robotics, and the future are raised in Matrix but little if anything directly relevant today. @Aelkus @traviskorte but more fundamentally I think, in the public at large, people have negligible awareness of AI in basically everything. The Wachowskis do a lot of things right film-making-wise, but AI/robotics-related scientific plausibility is definitely not one of them. Sad to say, cuz I love a lot of sci-fi that others hate, but the 2nd and 3rd Matrix movies are irredeemable plot-wise. I've tried, trust me. RT @j2bryson: We had 5K words to explain the biology of communication to roboticists http://t.co/XZxBXHK4zN Draft, comments welcome. @RobWo… @mark_riedl thanks, yep she high on my list of people whose work I want to read much of. Barely missed talk of hers at last AAAI :( @nerdsrocket reminds me of time I really regret not engaging such a person on the details of it, prob wouldn't have persuaded him anyway. :( @nerdsrocket naturally. @Aelkus @traviskorte to many I fear, roughly this holds: AI=machine learning=software=algorithm... @Floridi my pleasure! Big fan of your work. E.g. I cite some of your latest here FYI, thoughts welcome! :) http://t.co/qBK4afmV8B Much of DeepMind's deep RL stuff is fancy version of Q-learning with fancy neural nets, but last 2 tweets=basic framework/model of much RL. +So you (the agent) try out a bunch of actions in different states, remember stuff, + learn better and better policies/model of world. (2/2) Example of simple (at high level) AI idea in 2 tweets: Q-learning. You want a policy, aka list of what action to take in a given state.(1/2) @OddLetters yup. Marx too. ;) @schfrrn @kevin2kelly didn't mean to deny it has big selling points :) just (intuitively at least) a bit zany/misleading given state of art. Jordi Bieger on his paper, "Raising AI: Tutoring Matters," argues humans training/teaching AIs is key going forward: https://t.co/jCaGz97MCI @OddLetters fortunately I only currently have 2 of those as active concerns myself ;) @OddLetters here's a brief version of such a list: adviser is impatient, wrong adviser, wrong topic, too slow, wrong field, wrong career. ;) @MarkMuro1 @mattyglesias long suspected they could save selves w massive veg/health push, but they've failed before/prob. disagree w that :) RT @MarkMuro1: McDonalds plans to introduce new "platforms" that will provide "more focus on lovin' it" http://t.co/tRlDfibTeA via @mattygl… RT @eboyden3: Posted extended version of "Designing Tools for Assumption-Proof Brain Mapping" to web, plus link to Neuron version: http://t… @kevin2kelly there is a page on such a word/concept in the Star Wars universe, but a bit wacky for the real world :) http://t.co/jxRoRb9tGy @Aelkus I'm ~ reacting to the fact that, e.g. the Nourbakhsh Intro to Mobile Autonomous Robots textbook scares me, AIMA doesn't (anymore). @mpshanahan /any thoughts on whether it truly needed to be secretive? :) @mpshanahan how's it going so far? @rcalo @Aelkus to varying degrees based on one's focus, maybe also advanced calc. Less clear on NN details but def more mathy than much rest of AI. @Aelkus hmmm... yeah, the three killer ones for AI seem to be a nebulous basic-math-/logic-competence (pre-calcish), + linear alg, + Took me weeks/months to master the basics of photovoltaics once, whereas some key AI ideas are easy-ish to explain (see Rao's Last Lecture). @Aelkus makes sense. What's a slightly longer version of that claim - like which areas of math in particular? @chenghlee oh, for sure. Plenty of very legitimate reasons TO do such things, but in this case, the reason was, well, not those reasons. :) @chenghlee was thinking of 1 case (in this case I'm *actually* speaking for a friend) of just typing 3.14159 vs learning to use Pi right ;) Robotics seems more math-heavy than AI to me, but dunno if that's just cuz I'm more familiar with AI-related stuff at the moment...thoughts? Besides not requiring (tho rewarding) crazy math skills, many key aspects of AI are easy to grasp without math. Again, this bodes well IMO. Mathematically, AI is at times complex but not THAT complex compared to other fields. Bodes well for public understanding of it long-term. @chenghlee but yeah, sounds like lots of folks I know for whom it's work... temptation to solve all possible problems immediately... @chenghlee for me, opposite prob. cuz my programming is for lulz/learning,+ AI ppl have low standards for code, tempted to take shortcuts ;) @BiellaColeman @OddLetters yes! Was recently thinking about how many bajillions of experiments haven't been run. Good for grad students :) @OddLetters I dunno if it's normal, but I'm at roughly that stage and occasionally think such things. But also think that TONS of opp'ties.. Lots of startups/open source projs in AI. Some will fail, some will be bought, some will thrive on own. Hope # of latter is non-trivial. :) When I say "no one else" is close, I am talking about big tech companies. Microsoft def. has some strengths, + IBM, etc but talking overall. On machine vision today: my impression = Google's strongest by far overall, Baidu/Facebook have some strengths, no one else close. Thoughts? Broadly, more effective machine vision (w.r.t. diverse metrics) would enable more $ to be made, more/more diverse apps, + more surveillance. +Where's Waldo skills alone=problematic macro-ethically (e.g. surveillance). Fast accurate high level scene understanding=long(er) off.(2/2) Machine vision getting really effective + fast at playing Where's Waldo (more or less). But not human-level vision overall (for now). (1/2) @pmarca sci-fi has huge impact but much tech they wrote about wasn't original to them, + no govt really cares a ton about e.g. jetpacks ;) @rcalo how's the conf. going? @rcalo rhymes with... ;) The audio never gets perfect on that video, btw, but it does get better than it is at the very beginning. Worth it IMO :) For a shorter/more accessible version of the world/AI according to Rao than his class videos, see his "Last Lecture": http://t.co/VFv2DFFOGG *Small* diffs between those videos and version I took, but we used the vids as ref, so v. similar, making my recommendation very strong. :) Also, in the Rao grad AI class, I was expecting to be bored by the LDA stuff at the end but it was super cool, HW was modeling tweet topics. Overall, very highly recommend those Rao videos to anyone interested in AI/wanting to master some fundamentals. Great explainer/super funny. Spoiler (but useful info so ppl don't stop a vid early): in Rao grad AI class vid, I think, he pulls prank by being super technical briefly. Those 3 courses have titles too long to fit in one tweet but basically, intro AI, grad AI (took/loved diff iteration of it), + Web analysis. Rao Kambhampati is great AI prof at ASU, has vids of 3 classes online: http://t.co/LKiM2WzYHa http://t.co/eirvOuWlzJ http://t.co/gePiz2IjRl @mark_riedl also concerned about medium-lay person usability aka me ;) not very competent at basic programming stuff yet... @mark_riedl FWIW I don't deny lots of free stuff exists already. Qs mostly on (lay) usability, comprehensiveness, how new the algos are, etc @mark_riedl seems like intrinsic problem for this, MetaMind etc is just that big corps have economies of scale, can get CPUs/GPUs cheaper.. @mark_riedl awesome, thanks! Added to my (super partial) list of such stuff I want to play with soon :) thoughts on the hardware side? @VincentCMueller PS your Challenges in Cog Systems comes in handy a lot so thx for that :) can send draft of AI prog model soon if u want.. MetaMind is one of most interesting non-megacompany deep learning projects. Socher et al get it + are on the cutting edge. Worth following. One of the most interesting things that could happen AI-wise in 2015 (won't bet on it, though) is flourishing of free, GOOD, open source AI. There are many reasons to want corporations to play big role in scaling up, distributing AI. Also reasons not to trust them to do that well. Issues of IP, corporate secrecy, open source, and the battle for the control of AI's future are important, understudied IMO. Mixed feelings. @karpathy recommend this take on that comment explosion if interested :) : http://t.co/Dna2vhs0NQ In general, easier for Google to rip off Watson (at least after the proof of concept, etc.) than to rip off/build robots, so just bought em. Difference between AI and robotics: latter requires more capital of various sorts. = partly why Google panicked/bought everything recently. Without knowing what Google envisions for this robot stuff, it's impossible to say if they will succeed. *Could* make trillions, dunno yet. Google's robotics potential is huge, but need to distinguish mature bot markets (industrial automation) from new niches they want to create. More skeptical of Google's ability to commercialize robots than AI, but they def. have the people/$/ambition for both. Management unclear. The AI market's complex, but for innovative robotics (i.e. ignoring some industrial automation), not really. Google's market to create/ruin. Will say that Zuckerberg has made a compelling case/is right AI *could* help with $$$. But dunno when, let alone how creepy the AI would be. On Facebook's AI lab, they're doing interesting stuff (see LeCun et al's latest pubs), but key to FB's future? Does FB have a future? Dunno. Google isn't just secretive AI-wise, they're overly secretive. Announce AI ethics board then never mention again? Fail. No org charts? Fail. Relative to (my understanding of) Watson and its management, Google's AI ecosystem seems more secretive and maybe too distributed/unwieldy. Watson people are good at medium-term commercial AI visions. Google specializes in "whoa new breakthrough" and "Star Trek computer someday." Watson folks haven't/won't reveal ALL of their plans, but relatively speaking the public knows much about their plans, nothing re: Google's. Worth noting on the Google and IBM comparison that they have *completely* different models of long-term strategy, system integration, etc. @Floridi well deserved - epic book! Alas I haven't made it far yet, but about 90% through Ethics of Info. at least ;) My last tweet notwithstanding, I'm open to evidence that IBM's or Google's other stuff merits similar sorts of techno-economic analysis. :) BTW I mostly mean DeepMind/Watson when I say Google/IBM. Know v little abt Kurzweil's/other Google HQ AI groups, IBM neuromorphic chips, etc On Google/IBM cultures, there are tons of innovative people at both. Q is how many doing what, if rewarded, top down vision(s) setting, etc. i bristle somewhat at my own generalization in my last tweet but there is some truth to that assessment IMO. Could elaborate... In broad strokes (obv there are complexities), Google is at risk of failing AI/robotics-wise cuz incoherent strategy. IBM, cuz too coherent. Google and IBM could hardly be more different AI tech/strategy wise. Allegedly innovative vs allegedly boring. Probability vs logic. Etc. + but to me Watson's future is more mysterious for managerial/human capital reasons (can IBM be innovative enough) than tech reasons. (2/2) I/others could say pretty confident things about what Watson's future limitations, cuz better studied, analytically clearer, etc. (1/2) @VincentCMueller also think/hope next few weeks will be temporary in terms of tweet randomness - soon will have something longer to share :) Way more to say on Watson than I could/should fit into tweets but happy to answer Q's about it. Compared to deep RL, more lit on limitations @VincentCMueller so, aware many not interested in all of these things/not best format, but dont wanna write something no one reads either :) RT @romanyam: Brian Tomasik looks at how predictions of speed of artificial general intelligence takeoff vary with years worked... http://t… @VincentCMueller interesting analogies btwn DeepMind and Watson w.r.t. games followed by "what to do with this" :) @VincentCMueller am confident many will want to read paper detailing full AI prog model, but less clear about detail level btwn this+that :) @VincentCMueller depends - If I knew what people would wanna read, would be easier/more likely. :) I do write for Slate sometime... My twitterbot thought exp. assumed *realtime* learning. If you have tweet pipe, good way to label data, could train huge nets on old tweets. What I said on twitterbots didn't depend on NNs vs another representation, but if NNs used, you need NN--NLP bridge. ppl working on that too Much of what I said about twitterbots would also apply to email-based spambots. Some of same factors apply, like total size, detection, etc. Suspect more than that would increase chance of getting caught, but my numbers are basically made up. Dunno bout spam/twitterbot issues...? Twitter is big, but not big enough to have more than maybe 100s (1000s? anyone have thoughts?) of bots trying new tweets out. Slow process. #NAME? Clarification on the twitterbot stuff: something like that could be done immediately, for sure. Question is relative/optimal role of humans+ Some parts of that thought experiment could be implemented now, others are more speculative. Data maybe insufficient anyway, tho. Thoughts? Another pt on the deep RL twitterbot thought experiment: methods for sharing learning across agents is in early stages but ppl working on it More fundamental Q is, in general, how much data do you need to train on on task X before deep RL works? More/less than get away w spamwise? Other deep RL twitterbot Q's are: if similar stuff could be incorporated in viruses, spam detection, combination w/ other >human approaches. Some Q's raised by deep RL twitterbot (besides ethical ones) are: reward function, means of varying tweet strats, optimal #/lifespan of bots Thought experiment: army of twitterbots that in the aggregate uses deep reinforcement learning to become better twitterbots. This raises Q's @hannahgais @RT_com lol UFOs. Great talk by Brian Little on his book, "Me, Myself, and Us: The Science of Personality and the Art of Well-Being": https://t.co/ZsGCeF49G7 Last AI progress-related tweet for the night then I'm done: it matters a TON if data relevant to a given AI task is abundant + high quality. Changes in learning shots matter more in real world vs. in simulation. Robot that learns 1st time vs. n-th time in real vs. simulated world. Marginal changes in learning shots matter more when shots are fewer. Compare 1 vs 2 times teaching robot to do X, to 100 vs 101 data points. Deep learning requires lots of "shots" of learning, but not (inherently) much human effort. Trainability, with e.g. Baxter, different. (2/2) The human-effort-to-produce-result metric for AI progress is important but also importantly diff. from # of shots in machine learning. (1/2) The amount of human effort required to produce an AI ability from scratch or train an AI to do X is big metric, especially for $$$ purposes. Whether AI ability/task/etc. X is amenable to progress-through-speed is one factor. Another such factor: human effort required to produce X. Sidenote: will have working paper on AI progress soon, and slides after AAAI, but for now still thinking/tweeting through some key issues :) Lack full view of AI prog/speed still but have some ideas: planning solvers/NNs/CSP more speed-friendly than architecture, commonsense, etc. So the speed/AI progress connection is complex, but generally I think it's extremely fruitful and I plan to use it to clarify lots of stuff. In AI speed/progress stuff, important to consider hardware stuff, computational complexity, metrics for good enough speed/performance, etc. The speed distinction I'm making in AI (which is related to speed/level distinction in Carroll 1993) is def. not binary or one dimensional. Need to distinguish aspects of AI amenable to progress-by-speed from those that aren't. Bringsjord/Bringsjord make this pt in recent papers. Lots of AI stuff would work better w impossibly fast computers, but wondering bout non-NN stuff where, say, 10-1000x boost would help a lot. Listening to Thinking Machines podcast (last RT), wondering if other techniques exist that, like deep NNs in 90s, mostly just lack speed...? RT @karpathy: This is making rounds: Machine Learning has a podcast now :) "Talking Machines" http://t.co/UERQNHan45 ep1 is up 1 thing the world needs ASAP: inclusive, informed debate on which AI/bot techs, funded/governed how, make what lives possible for whom when. @jathansadowski @paulonabike those are just two examples of potentially useful heuristics. "similar" vague/maybe unhelpful distinction here. @jathansadowski @paulonabike in general it would seem that ppl in more cutthroat fields doing more similar work to others are more at risk.? Fictional robot spiders come in many shapes/sizes/plausibilities, ranging from the silly Wild Wild West to the disturbing Minority Report. @nerdsrocket If I can I'll catch up... doesn't matter if you finish the movie by an inch or a mile etc. @nerdsrocket hmmm need to rewatch that one. Thanks. @jathansadowski @paulonabike I would be super sad if I couldn't use this openly as resource to get quick feedback on stuff. Fine for now. :) @jathansadowski @paulonabike I don't worry about this much in part cuz I think no one would/could follow up on my leads faster than I do ;) @jathansadowski @paulonabike suppose there are other exceptions I should have mentioned besides IRB. Like public-facing article. Rare 4 me. @jathansadowski @paulonabike I specifically go out of my way not to censor anything I say research-related except for IRB issues obvi. @paulonabike @jathansadowski exactly. Super big concern of mine, not so much for my own research cuz publicy anyway but others more at risk. @paulonabike @jathansadowski not super worried about it for my own sake now cuz explainable/norms still evolving. Wonder bout future tho... @jathansadowski @paulonabike so yeah self-plag. not the issue, but suspect ppl prob saying stuff that's been said on twitter all the time.. @jathansadowski @paulonabike broader point is that if/as twitter becomes more of a real research thing, plagiarism becomes more real too... @jathansadowski all that makes sense to me. what about other-plagiarism? are the norms the same? seem different in terms of due diligence. @paulonabike @jathansadowski right, it seems crazy, but at the same time citing Twitter is a real thing... @jathansadowski also, this is related to a point I raised and no one responded to at one point: self-plagiariam w.r.t. Twitter. Is it bad? @jathansadowski haha no nothing in particular, just thinking about stuff. Super *related* issues will play role in future stuff, no doubt.. "In crude* terms neural nets=DeepMind's Go AI's System 1, Monte Carlo=System 2 *Less than in humans, for whom, pace Kahneman, it's metaphor." Last tweet is from the optimistic and reasonable conclusion to the Maddison et al. paper. Basically says what I said: Impressive, w caveats. "2 core elements that scale effectively w increased [compute]: scalable planning, using [MC]; and scalable eval functions, using deep NNs." "remarkable that a single, unified, straightforward architecture can master [a bunch of Go stuff] to such a degree [caveats..]" the Google 1 One takeaway from the deep neural net/Go stuff for me is that while neural nets can't do everything, they can do a lot, more + more easily. Maybe If I knew more re: neural nets, Go, and supercomps I could say for sure, but for now I dunno how long human Go supremacy will last. :/ Even with, say, 20 or 100 layer neural networks, it isn't obvious how far heuristics/neural nets can take you in Go (/in general ;) )... To the extent that Maddison et al. were just using a tiny fraction of Google's resources for that paper, scaling up a lot/soon = more likely Clark and Storkey say they ran their system for a day at one point, Maddison et al. say they used GPUs/which algos but not how many/how long That being said, people keep coming up with ways to apply neural nets to new stuff, so maybe a more deeply neural netty system is possible. ..but it's far from perfect and will never be perfect, cuz the search space is huge. So other methods are needed to do other move analysis. The role of neural nets in the broader Go systems these folks are making is basically to provide a high quality heuristic for move quality.. Also note that the papers I mentioned on Go do discuss other cool stuff/methods, Maddison uses Monte Carlo etc. But focusing here on NNs. Also, on that sub-linear thing - not clear how important that metric was anyway, just one of the one ways they explicitly evaluate by depth. Reasonable to infer based on Clark and Storkey and Maddison et al. (both 2014) that more computers would help a lot, dunno exactly how much. + success, but other metrics matter too, and it's unclear (to me at least) the relationship btwn those and overall skill. But >CPU/GPU helps From looking at the data in Maddison et al. 2014 (the DeepMind Go one), there is a sub-linear relationship btwn net depth and one metric of+ Important to know how far deep neural nets can be scaled both up (supercomputers of present/future) and down (desktop, mobile, IoT, etc.). Would be good to have detailed understanding of, given some efficiency assumptions, what's plausible for diff NN depths in different domains So, we know that you can get super impressive human-ish results out of 12 layer neural network, + human adjustment etc. What about 5? 20? Fun fact for Friday: both Google DeepMind folks' paper on Go move evaluation and other Google folks' one on street signs use 12 layer nets. #NAME? The essential problem in Go from a human or machine POV is that you can both put tiles wherever the heck you want, so can't do exhaustive + Thinking somewhat seriously about getting into computer Go stuff for the lulz/research. Fits my interests AI-wise, and IRL Go is super fun. In terms of sci-fi films that aren't part of a bigger universe, one I love (which also happens to have time travel) is 12 Monkeys. So good. Rare 4 sci-fi universe to get so much detailed attn (inc. a book available upon release) on science aspect as Interstellar. Cuz Kip Thorne. For Interstellar, there's a big gray literature on its plausibility, inc. book by exec. producer/science adviser. Mostly physics stuff obvi. Don't have remotely informed views on the plausibility of Interstellar's time travel aspects/haven't read the literature on it. Anyone have? Interstellar's AI/robotics stuff is generally plausible (though not the focus of the movie - see my piece on this). Envir. stuff, not really Time travel sci-fi can be done well (Morgenstern has formal theory that accounts for many such plots, could help writers), Terminator isn't. On top of my prior confusion (which I don't care to remedy) re: Terminator, new trailer says ~ time travel changes everything, so I give up. It's possible that the Terminator universe is just not actually thought out well. Dunno. Frustrating if so cuz so many billions spent on it. A few times I've thought I've understood the extended Terminator universe, but then I realize time travel was nec. to get to X point in plot Impossible for me to give a good evaluation of Terminator's plausibility before grappling with the time travel aspects, which I haven't yet. I have more fixed feelings about Terminator's plausibility than any other series's, probably. Sarah Connor Chronicles helped w.r.t. that. The AI uprising in The Matrix doesn't make much more sense if you include the whole trilogy. No Caprica equivalent to explain early stages. Transcendence is somewhere in the middle of the (actually multidimensional, but simplifying here) spectrum of plausibility IMO. Hit and miss In contrast, some aspects of Robopocalypse make sense, likewise for BSG at least if you include Caprica. Extended universe makes some sense. Put differently: in many (/most?) AI uprisings, the uprising AI's origins/advantages/goals/tactics/success or lack thereof make no sense. If my description of Robopocalypse in last two tweets didn't sound very favorable, consider many AIpocalyspes are implausible at all stages. +strategic advantage (in Bostrom 2014's sense) made sense, + it used its DSA to good effect w.r.t. its goals. Goals kind of hand wavy. (2/2) On Robopocalypse as plausibleish scifi: vague origin of AI's intelligence advantage over everyone else, but given that, its decisive (1/2) @nerdsrocket oh yeah, that's my key point - he got away with murder. Whatever the case may be, I love it ;) and sorry bout Watson haha. @nerdsrocket I'm talking specifically about out of control giggle fests that disrupt the entire show, often his fault cuz forgot lines, w/e @nerdsrocket you'd think it would be easy...nope @nerdsrocket like, dozens of incidents of stuff, each of which would have gotten him fired for doing it live in front of anyone,but Seinfeld @nerdsrocket haven't seen that, will take your word for it, but will say Seinfeld breaks character an embarrassing number of times. @nerdsrocket I also just love/am George, Kramer's OK, Elaine is the bomb. @nerdsrocket Seinfeld is objectively horrible in a lot of ways, mostly the eponymous character's acting ;) but I love the humor personally. @nerdsrocket for me, Seinfeld is the show that I feel like people are most likely to get references to (if that's what you my background?) @nerdsrocket still too gross for me. Rocko is where I draw the line. @nerdsrocket lol I was just typing another tweet clarifying that I use that phrase too much ;) yeah not remotely my fave show, just funny. @nerdsrocket some Nickelodeon stuff like that (not to mention Ren & Stimpy, my god) was super duper edgy and gross and provocative. @nerdsrocket it's like the best thing ever. @nerdsrocket right, yeah, I didn't watch it live/care much at the time, sorry ;) later became obsessed with the relevant tech/econ issues.. @nerdsrocket hey I watch an ep occasionally. Rocko's Modern Life is legend. @nerdsrocket for me the earliest non-Nickelodeon stuff is South Park, Friends, Seinfeld, Frasier, maybe a few others.. @nerdsrocket only plausible equivalent here would be something like "freestyle" chess - humans can use computers however they want midgame. @nerdsrocket well, or the beginning of the John Henry story ;) actually not really, humans are toast BUT humans+AI>either alone so maybe + @nerdsrocket that's awesome :) there isn't really any one show like that for me. Most I started no more recently than 10 or so years ago... @nerdsrocket also, thoughts on Watson? ;) @nerdsrocket and I only tried it like once or twice for a few minutes and it seemed like a different ep, or played diff time. longtime fan? @nerdsrocket at least not at same time... Honestly haven't done a comprehensive analysis cuz don't watch much, just when you've mentioned :) @nerdsrocket too bad we have different local stations or time zones or whatever cuz when I see Jeopardy it isnt what you're talking about :) @zeustoves but doubtless very thought provoking!! ;) BSG + Caprica not entirely plausible - nothing is in the current sci-fi multiverse - but they deal w/ human/machine stuff in many cool ways. Conclusion of prior tweets (+unstated info re: extended Battlestar universe excelling in such areas): Ron Moore should write everything. :) Also easier sci-fi production/budget-wise to have robots be exactly like humans cuz then you can have humans play them vs. epic robots. Sci-fi on specific AI/bot adv/disadvantages wrt humans often better in various ways, but easier writing-wise to make robots just human-like. Many (though not all) sci-fi robots have abilities that wouldn't be poss. w/o solving all AI, i.e. they solve AI-complete/AI-hard problems. @bengoertzel corollary: ppl more likely to care about AI technique if described in brain-like terms? ;) @SuzanneWaldman a few others off top of my head: govt, altruism, curiosity, unintended effects of other stuff, war, necessity. many more :) @SuzanneWaldman not that that's a slogan, just meant brief stuff. hopefully that made sense :) @SuzanneWaldman which BTW i think is interesting..often slogans help build consensus... @SuzanneWaldman whereas a more long winded and unambiguous sentence clarifying/caveating such things might be more agreeable to some @SuzanneWaldman right, I get what you mean. I am just sayin', the brevity and ambiguity is in part why you are gonna get pushback there. @SuzanneWaldman if the claim is that that is the MAIN or only driver then absolutely not, disagree. depends what % of "driving" you mean. @SuzanneWaldman as it stands literally, again, most would agree, but it is such a short sentence, Q is emphasis. many drivers IMO Definitely should have included Player Piano on my (super biased/AI-centric) list of most important sci-fi today. Great on automation stuff. Ranting abt machine vision cuz folks have been/will continue to prob overstate how big e.g. Google's latest neural net Street View stuff is. Many AI vision strengths rely/build on fast computer speed but they'd still be stumped even with arbitrary time by some stuff we find easy. Is AI better in some ways than humans at playing Where's Waldo for arbitrary people in a bajillion images? Prob, we excel in many ways still Claims about human-level/human-superior AI face recognition should generally be taken with grain of salt. Some aspects of prob. but not all. @jastrd gosh sounds like something I have to read, just read some stuff on Wikipedia. thanks! :) @jastrd @k8elahi I LOVE the God's Gardeners. So interesting. @jastrd what I will say is I have heard ppl say they loved O&C but hated YOTF and that I do not understand at all. @jastrd yeah, haven't decided what I think about the series as a whole/relative preferences, but O&C is my current go-to rec cuz it's 1st :) @TommyGDore no prob - glad someone else cares ;) @TommyGDore just way more than normal ;) @TommyGDore /cuz Wilson is a roboticist who had thought and written about such stuff before/is good at it. Not intended to be 100% plaus tho @TommyGDore not saying it would have been totally realistic, just would have at least seemed super well thought out (cuz book in fact was). @TommyGDore combo of source being good (book), plus author's involvement in production, plus Spielberg (hopefully, maybe) caring somewhat :) @yksnpnwrbrhsa wyrdd @yksnpnwrbrhsa whats an example? need specifics to be on lookout for eg at bookstores @yksnpnwrbrhsa I just worry about name/attention fatigue cuz guilt over fiction reading/stopping is the reason I'm in this sitch to begin w @yksnpnwrbrhsa worth the effort vs other uses of time? @yksnpnwrbrhsa ya I know that part from utopianism books. Just haven't felt it in my bones ;) @yksnpnwrbrhsa word all about dat good move/pairing. Like Peter Thiel's latest and histories of neoliberalism (preparing that delicacy soon) @yksnpnwrbrhsa That's already on my list for utopianism history reasons, didn't realize it was also reputable on other terms (?) if so siqqq @rcalo some better than others, of course. But replacing simple effective things with more complex/ineffective ones seems very common.. :/ @rcalo bathrooms seem shockingly not human-centered in their designs. Not sure why - seems like businesses would notice/care at some point. @yksnpnwrbrhsa maybe @yksnpnwrbrhsa I won't be submitting it to literary journals @yksnpnwrbrhsa could give answers to things like that for sci fi ;) at least if tailored to person X. neednt be be all end all, just for me. @yksnpnwrbrhsa nah like who are the who's who of Russian lit. Per Michael Scott on The Office..pretend I'm a six year old. No, two @yksnpnwrbrhsa so what are the top recs youd make overall in that space? RT @EJ_RES: Will robots eat all the jobs? Video of #economicsfest session @FestivalofIdeas @RD_Economist @diane1859 @brosewell: http://t.co… @yksnpnwrbrhsa for real tho let me know what you find out. I am a Russian lit scrub. @yksnpnwrbrhsa Old World problems? "Got bored" is one simple interpretation but dunno. Spielberg has lots of stuff to do. Point is, that project had/has serious potential IMO. If it were ever made, Spielberg's Robopocalypse movie could be best, most plausible, scariest AI uprising on film. Spielberg got bored tho. Sci-fi AI uprisings needn't be realistic *but* by that metric they vary in many plausibility dimensions, with nothing high in all of em yet. Much sci-fi depicts AI uprisings. Most=implausible in at least one key way given modern research. Robopocalypse maybe closest but key flaws. @jathansadowski could be interesting to look at rise in such stuff over time. when was first biosensor stuff in film for example :) @jathansadowski The Island (movie) is v biosensor heavy, was just watching last night. common theme in real and fantasy worlds.. Sci-fi I wish everyone discussed 24/7: BSG/Caprica, TNG, Asimov (esp Robot Visions), Atwood (esp Oryx and Crake), 1984, Brave New World. :) @rcalo not to trivialize the real need for some secrecy sometimes. Just often skeptical of where/why the line is drawn in AI ethics today.. @rcalo + general closed offness of much conversations on these topics. Thoughts on this/what to do about it? Oh and have fun ;) @rcalo on a serious note, I was thinking of writing something a while back on the harmful effect of corporate secrecy on AI as well as the+ @rcalo nice weather? ;) @mark_riedl importantly different from history of course, not all sci fi is plausible, etc. so yeah, devil is in the details ;) @mark_riedl at its best I see it as sampling from space of plausible worlds, then use aspects as "evid" plus real analysis. like history. @mark_riedl yes! love it. Think scifi has huge role and agree w ur caveats but the rub/disagreement if any is what it means to use as "evid" @mark_riedl PS best refs on that appreciated! I enjoyed Riveted by Davies but pop book/just one aspect.. @mark_riedl attuned to not using "bad" analogies but to me that=essence of issue - we nec. use analogies, let's be explicit abt why/which 1s @mark_riedl I am ALL for facts but agree w Miller/Bennett 2008 that sci fi is de facto means of pub engagement w lots of stuff. shared refs. @mark_riedl yep! read related book recently (Davies/Riveted) :) generally I agree. more glass half full on citing it, using examples etc tho Go is hard but that's not only reason for state of art: it hasn't had full AI effort thrown at it like e.g. Jeopardy. This NN stuff is v new @mark_riedl do think sci-fi has critical role in identifying important *considerations* but v different from it predicting things in detail. @mark_riedl also flying cars = one of my pet peeves re: futurism/futures/etc...never made sense energy efficiency wise and never will :) @mark_riedl well I played Go for the first time IRL last night so resonates with me ;) @lacker specifically this http://t.co/pXkjuGuwYb but more broadly that plus the similar Clark/Storkey one (see footnote in former on latter) Competitive w/ best Go AIs doesn't (yet) mean competitive with best humans, but progress is pretty rapid and easily measured, see Wikipedia. DeepMind folks' new Go paper basically says that using easyish methods to apply NNs to Go move evaluation, competitive with best non-NN AIs. Not stunned neural nets would help with computer Go, cuz pattern recognition key, big state space etc. but dunno exactly *how* helpful yet.. @Aelkus sometimes I skip those parts of academic sites but his is solid @Aelkus also has lots of slides on his site fyi.. @Aelkus he has a lottttt on such things :) One of the many things I actually do like about The Island is Steve Buscemi's role as a tech guy/contractor for the colony. Funny as always. There are lots of reasons the underground clone-slave colony *could* have plausibly been discovered, etc but no, they just had lax security. Ultimately, the bad guys running the underground clone-slave colony in The Island are undone cuz they were outwitted by 3/4 year old clones. Also, the relationship between the time period *in* sci-fi and the tech therein is weird/diff from the other trend in this (small) data set. Suffice it to say: I don't think it's a coincidence that real and fictional robots have both gotten progressively smaller over the years. :) @dl4j1 happy to! Will do soon. There's plenty of room for evil robots at the bottom: even the ones in Transcendence were kinda sorta visible to the naked eye or something. Matrix may not belong in the list I gave as stated cuz main ones are squid-like, but lots of other (macroscale) ones in e.g. Machine City. Metal insect-like robots used by the bad guys in sci-fi have shrunk. Matrix=big, Minority Report=small, The Island=micro, Transcendence=nano Last tweet is basically a summary of The Island in addition to AI/IoT's role in it. And no, it doesn't make much sense In The Island, the bad guys try (very incompetently) to use AI and ubiquitous sensing to run slave colony. Thwarted by 3/4 year old clones. @hannahgais how is The Onion so good AI necessarily plays big implicit (+sometimes explicit if vague) role in robotics roadmaps/visions. Mostly written by roboticists, obvi :) On "AI kinda" in last tweet: AI futures are generally less clearly laid in stuff like roadmaps vs robotics so far, tho many working on it. If the US and/or EU robotics [/AI kinda] roadmaps are even close to realized in 2025-2030 as predict-/proposed, huge possibilities open up. At a high level, my impression of stuff in last tweet is it's interesting and ambitious but link to rest of AI unclear.Need help w last part What do AI folks think of IDSIA/Schmidhuber et al's recursive self-improvement/optimal AI, etc. stuff? Don't know quite what to make of it. Micro/nanoscale science/engineering is very wild stuff. Crazy we can reliably do things like manipulate/build nanoscale stuff in real time. Gotten to do lots of futuristic stuff over the years, but top was prob using PlayStation controller to operate nanoprobe/poke nanowires :) @dl4j1 are you going to add deep reinforcement learning by any chance? :) @SuzanneWaldman @traceydurning @jeffmcmahon_chi also key 2 consider geography, transition time,in cost comparisons. cheap in some places now @SuzanneWaldman @traceydurning @jeffmcmahon_chi don't know how Q's were framed but taking into account externalities, that isn't crazy. Computer Go shows "human level" AI (let alone even vaguer stuff) is ill-defined. AI can stomp me now, but not everyone. Eventually everyone. Finally have a Go partner to play with! Confirmed it is super hard (but fun IMO), why hard for AI, but do think AI will dominate eventually. @cthorm @robinhanson @erikbryn @FareedZakaria stability, predictability also nice. may trade off against sudden increase in $... @cthorm @robinhanson @erikbryn @FareedZakaria yes, = Sarewitz's pt. Long term $ pretty stable. *what* to increase/decrease/restructure=key. @CostaSamaras also, one pt on $ amts in context: Majumdar, Danielson et al. helped get ppl to talk across stovepipes etc. bang for buck up. @robinhanson @erikbryn @FareedZakaria non-DOD R+D pretty stable for decades+ $ amount not everything. See Sarewitz, "Does Sci Pol. Matter?" @CostaSamaras related bc AI/robotics is necessary 4 cost reductions in solar, etc. going forward, but haven't articulated that in detail yet @CostaSamaras unrelated (well, somewhat) stuff on responsible innovation theory/practice in AI and future of economy. do solar on side tho. @mark_riedl not sure relation between that (which I have read and is cool) and deep apprenticeship learning but def agree human reward key. @mark_riedl yeah, I think deep RL plus good use of human reward is key - paper at game playing workshop on reward via crowdsourcing online.. @mark_riedl sounds like it is similar to e.g. Brad Knox's work on human provided reward for MDPs. Deep + expert signal. But haven't read. @beaucronin awesome, thanks! @CostaSamaras @JesseJenkins was Majumdar's assistant when he oversaw all of those so have pretty good sense of what's good/relations btwn :) @beaucronin killer reference you recommend making that, or just something I'll gather by digging? @CostaSamaras @JesseJenkins but sure 10 billion of the stuff you include is fine by me. Piece of cake, Danielson could handle. What else? ;) @CostaSamaras @JesseJenkins my number is significantly higher than yours because Office of Science. Often indirect but nontrivial role. @CostaSamaras @JesseJenkins billion dollars I meant. To me that's fine target for a few years from now, not 2 fast. OK w way higher someday @CostaSamaras @JesseJenkins yup that is one important level at which to/at which I engage. So what do you advocate? agree w 1 bill? @CostaSamaras @JesseJenkins so my $ for "good" R+D that is risky, maybe promising, etc is way more than ARPA-E. But yes, ARPA-E should grow. @CostaSamaras @JesseJenkins that's why DOE spends many billions on R+D. Danielson et al. way more competent at doling it out than before. @CostaSamaras @JesseJenkins right, I advocate growing- 100% annually for a few years would be sustainable at least w management I knew :) @beaucronin slash lots of AI? any reason why PP in particular moreso than other non-GOFAI stuff? probabilistic at deeper level, more levels? @JesseJenkins @CostaSamaras ah totally oblivious to that. Enjoy :) @JesseJenkins @CostaSamaras agree with everything you're saying, just think DOE does a TON now in the respect you said, also ya ARPA-E def @JesseJenkins @CostaSamaras one of many though...whole Obama era is massive success story IMO. @JesseJenkins @CostaSamaras reason for optimism: ARPA-E still exists even tho no massive market impact yet. MANY in DC get it will take time @JesseJenkins @CostaSamaras even on ARPA-E I am not ready to wipe my hands - must be advocated continuously by many. But, doable IMO :) @JesseJenkins @CostaSamaras and so forth for other reasons for optimism IMO :) even GOP mostly has reasonable views on many energy things. @JesseJenkins @CostaSamaras think we are way further along/more glass half full guy myself. ARPA-E's bipartisan status wasn't built in a day @JesseJenkins @CostaSamaras to mention having incompatible views on specific policy issues... but ya consistent w ur other tweets. @JesseJenkins @CostaSamaras well, most think gov't has role to play. They just have indefensible views factually about how big role is, not @JesseJenkins @CostaSamaras clearly I am a big fan of high risk stuff ;) but ya just putting people's OMG SOLYNDRA attitudes in other terms. @JesseJenkins @CostaSamaras right, my point is just that some folks can't comprehend any failure rate and think 1 => abandon program... @CostaSamaras @JesseJenkins problem is that from some folks POV the optimal rate is zero. well, they don't put it that coherently, but... @nerdsrocket Obvi. @nerdsrocket Musk level rich prob won't be one of em, though. Not my jam. @nerdsrocket yeah I am kind of a younger version of him in a lot of ways ;) @nerdsrocket he and I are both INTJs and obsessed with all the same things so I think we'd be chill. @nerdsrocket also, epic family reunions. @nerdsrocket I do think about this sometimes...Musk and wife are cool/interesting too. @nerdsrocket def smart/fun, sure, I just don't see an urgent shortage of such people anytime soon, whereas to me Gateses are legend. @nerdsrocket wife sounds super interesting though. Would def have a lot to talk to her about :) @nerdsrocket in contrast, IDGAF about Gordon-Levitt ;) sure he's cool or whatever but wouldn't short list him for people I'd meet :/ @nerdsrocket "interesting" is tough. Very personal. @nerdsrocket I think I would have a lot to talk to em about :) @nerdsrocket Steven Pinker and Rebecca Goldstein are super interesting too :) @nerdsrocket the Gateses might take the cake there... Kierkegaard wrong on "Life must be understood backward/lived forward." Life can be/is necessarily understood forward, just probabilistically @hannahgais unrelated: did I miss your piece on social media? :/ Unstated premise of last tweet: lots of AI people are super smart. Most people in AI and in science/technology think what they're doing important. Reason to be bearish on each group/claim but bullish overall @xuenay made big "worldview.doc" years ago, look at every few year, helps inspire/remind self of convictions as well as how things changed. @xuenay on external v internal morality - I find writing stuff down on your own views is sort of both at diff time scales. Reading dense textbooks on leisure studies might be the ultimate leisure activity for someone in the field. They've carved out a sweet niche Does anyone have a good handle on the # of current open source deep reinforcement learning/DeepMind replication projects? Is it just the 1? Humans can't learn everything in 1 shot so it's unreasonable to expect AIs/bots to, but be aware DeepMind relies on bajillion shot learning. Didn't mean to suggest one shot learning is end all be all, but in general a demo in a rich world AND few learning shots is tall order now. @2020science replies/requests for clarification and explicit feedback are all self-evidently useful/essential "small data" in this contxt :) @2020science my key pt is IMO those are all imperfect but v. useful proxies for attention, interest, understanding, and depth of engagement. @2020science citations down the road on social media count for even more than RTs etc in the moment. Not sure if those are what u asked for? @2020science more concretely: favorites indicate ppl agreeing or seeing value, RTs moreso, straightforward to calculate subsequent eyeballs. @2020science making new connections btwn people, finding new ppl, changing minds of other ppl, having own mind changed by said ppl :) Other less RL based AI approaches could do Oblivion better than DeepMind's typical approach now, latter will one day help, not yet I think. + which means time in game, C/GPU-time. Impressive final product but not 1 shot learning,=key for "breakthrough" fame not to mention $$(2/2) DeepMind can't do anything super impressive to human eyes soon in e.g. Oblivion cuz they specialize in fancy trial and error basically,(1/2) @beaucronin or is it "breaking shit"? "making cool shit?" there's like a handful of such phrases I've heard a million times... @beaucronin perhaps they're too busy "building cool shit" ;) (sarcasm cuz Silicon Valley but I actually do think it's cool shit as well) More on games as AI progress metrics: DeepMind doing cool stuff in Oblivion wouldn't impress me, but one system learning any such game would @beaucronin dunno what determines stuff like that. Occasionally I am taken aback by high quality of AI related stuff. @mark_riedl well, FWIW the game workshop papers I've read were interesting. Haven't found Deep Apprenticeship Learning but sounds very cool. @mark_riedl I took "deep RL game playing paper" to mean the DeepMind paper showing results in Atari so my bad if this is old for you :) @mark_riedl from Turing http://t.co/2CrqMeUKOb @mark_riedl err it might not have been from that. Let me check and give you link @mark_riedl I got title from the schedule and Googled it to find the draft. @mark_riedl no, referring to a new (2015, that workshop or tutorial, whichever, obvious in the schedule which one) paper making similar case @mark_riedl cool, I'll try to say hi if poss - Turing overlaps with ethics unfortunately. Good luck w demo! I just have to worry bout PPT ;) @mark_riedl there is a paper there making a similar/updated case (dunno if it cites this, only skimmed it) being presented there. @mark_riedl you going to the general game playing workshop at AAAI by any chance? RT @mtaibbi: So tired of all these moralizing white internet warriors who insist they've never broken the law. Stats say about half of you … Also, obvi. (I think) everything I predicted re: DeepMind's near term future hinges on them not e.g. deciding soon to focus on Go or robots. Know there are good reasons academics often have to and/or prefer to work on campus. Just saying, not everyone does, but ppl assume they do. Was stunned upon entering grad school to find out that most academics don't choose to work from home. For me that was huge selling point. :) People often seem baffled that I work from home (see: Cain on norms re: extroversion), but I am just as baffled others don't see the appeal. Reading some cool books on histories of capitalism, Communism, still looking for great history of socialism. Heard "Socialisms" good. Recs? @mariana_farinha yes, that is also on my near-term list in part cuz @robotenomics encouraged me :) Another way of putting my last tweet is: AMA about AI progress anytime. Good test for me/helps me decide what to focus on modeling-wise... Could give lots of AI predictions if people cared but 1. easier to answer Q than spontaneously say what ppl care about, 2. paper someday :) DeepMind will prob someday (if they haven't already) do non-game stuff, but for now that's their metric, with some reason - it's very hard! @mariana_farinha what I can say is next several will b on histories of capitalism and communism, leisure, AI progress, and science policy :) @mariana_farinha a lot ;) Mode prediction for where in videogame chronology/complexity space DeepMind will have impressively dominated many hard games in 2016 is 2000 On error bars: wouldn't be stunned if what I said re: DeepMind demo happened in 2016 not 2015, but if not in 2016 then my model is v. wrong. Between now + fleshing out stuff I said in last two tweets, hoping to play with deep nets in general/deep RL in particular. Should be fun :) +published stuff, in a few months I am hoping to be able to say some very concrete/useful things re (near at least) future of deep RL. (2/2) Speaking of DeepMind predictions, don't have my first draft AI progress model finished yet but will soon and between that and all their(1/2) In 2015 I think DeepMind will prob demo some sort of mind blowing learning thing in a 3D world or at least much-richer-than-Atari 2D world. Franklin had "family" each on 2 continents, shy Madison's outgoing wife responsible for much of his success, etc-Int Lives of Found. Fathers There is a huge literature on leisure drawing on many disciplines. Wanna read all but focused on leisure economics/policy/future for now... I love that there is a super serious academic literature on "serious leisure." Reading such stuff for work/pleasure is pretty meta for me. A Handbook of Leisure Studies (Rojek et al. eds) is not remotely a leisurely read. Fortunately that isn't why I picked it up. Heavy stuff. Per Fleming in The Intimate Lives of The Founding Fathers, their spouses took issues of fame/place in history super seriously from the start TLDR of The Intimate Lives of the Founding Fathers: they were real ppl, all shaped by women in their lives, sexual mores surprisingly modern I haven't tried anything that would tell me in real time who unfollowed me on Twitter but like ThinkUp that sounds too self-censory for me. On ThinkUp: Social media should be better than offline in some ways. People shouldn't be mean on Twitter, nor should they unduly self-censor Suffice it to say I have little interest in ThinkUp. Already worry too much about specific people's possible reactions to all my tweets... More general pt on ThinkUp: speaking truth to power, criticism, etc legitimate functions of Twitter. Harassment bad. Both can be impersonal. More on ThinkUp, empathy, and self-censorship: I would be less critical of e.g. Google, other powerful ppl/orgs if pics of them popped up. @Jackstilgoe my understanding is they want people being more reflexive. My last two tweets tho are on the risks of taking that too far... To me, part of value of Twitter is putting new ideas out there. To imagine all possible specific people's reactions can be counterproductive On ThinkUp: seeing people as generic is often bad, but there is value in it sometimes, e.g. to avoid being overly polite to those in power. Last 2 tweets are related to Russell's points in Edge piece/@j2bryson's points that goal of AI needn't/shouldn't be systems w own interests. +new goals for oneself are considered aspects of intelligence. Yet we don't nec. want AIs to have/use these abilities. Raises some Q's.(2/2) In humans and non-human animals, the abilities to 1. shape one's environment rather than (just) problem solve within it, and 2. set (1/2) @nerdsrocket :) @nerdsrocket huh? @nerdsrocket yup @nerdsrocket yeah and the world is clamoring to hear what I think about The Island ;) + Earth's plight in Interstellar is insufficiently explained and implausible. Climate change and other stuff are bad, but not THAT bad. Have previously noted that I like Interstellar's treatment of AI and robotics, but I absolutely hate its treatment of environmental issues.+ @paulonabike oh to be clear I got nothing wrong with perusing, skimming, stopping reading, etc., just misread your first tweet as "read" :) @paulonabike sorry, I HAVE perused. not read in full. so "yes" ;-) @paulonabike no but have almost done so/plan to one day. should I expedite? Freeden (2003 in summary/elsewhere in detail) does great job explaining why liberalism is so durable yet flexible over time as an ideology. One of main reasons I'm working on model of AI progress is 2 inform MOAR/better debate on future of work/edu/leisure. People thinking small. @hannahgais what would you do as world emperor, that can fit in one tweet? @hannahgais you're not going in are you? @hannahgais Mordor New Years resolution: understand why many people ignore the fact that New Years resolutions rarely work + you can improve yourself whenever. @yksnpnwrbrhsa not enough I guess I kind of like the fact that 2015 will be a slightly easier reference point for calculating years, but otherwise don't get NYE, etc. On a scale of 0-10, the extent to which I care about NYE/calendar years is about 1...some party caused 1 roadblock. Affects Twitter briefly. RT @CSPO_ASU: Editorial in Nature lauds transdisciplinary efforts for positive future outcomes in science policy. Happy New Year! http://t.… @pmarca Ben Franklin was quite the techno-optimist, see e.g. http://t.co/aq9R3VSRym @pmarca assume you've seen Ben Franklin's musings on immortality, humans flying etc.? @pmarca *relative importance and urgency of efficiency versus fairness, etc. @pmarca "too efficient" sounds like strawman/not really any serious person's arg. Legitimate Qs about relative importance of urgency. @pmarca recommend other books by him or is that the end all be all? RT @ilaba: @tanehisicoates But that "love as missing ingredient" speech was so embarrassing. No scientist would ever say that. Esp. female … @tanehisicoates BB and DKR both so much better in their own ways. DK is the most popcorn flicky/crowd pleasy of em all to little good effect @rj_cubarrubia all part of the plan @mattyglesias progress in AI seems faster to me than it seemed a year ago, so have different probability distro now re: future possibilities My working definition of "gun nut" is someone who isn't outraged by deaths resulting from kids using guns, thinks stopping that is tyranny. Gun nuts often think they care about sustainability of US liberty yet are blasé about its building blocks like dissent/education/tolerance. "of the linguistic flexibility of language, and of historical context. [Thus ideology is contingent but not at all content-/formless]."(2/2) Well put by Freeden (2003): "ideological meaning is a joint product of the degree of analytical rigor possessed by its formulators, (1/2) RT @abuaardvark: Let's hope Egypt finally releases AJ journalists - and that it doesn't end attention to its thousands of other political p… @roseveleth if one takes broad def of resolutions as near term goals ignoring years- improve re talking abt mental illness+be more political @roseveleth "it" being average New Year resolutions and their longevity/success rate. things can be done to increase, tho true year round(?) @mariana_farinha you too! @roseveleth wish I could but haven't done that in many years...isn't it pretty established it isn't helpful anyway? #seriousquestion #cynic @mariana_farinha I enjoyed it/thought that as movie it was excellent. As history, agree w criticisms such as this http://t.co/idbPgaDlQX Reading Hamerow's 1997 book on German resistance to Hitler. For all its flaws The Imitation Game put me in mood 4 learning about epic people Still mining copy of The Left Hemisphere (Keucheyan) for references, rereading parts, etc. Recommend as lucid intro to contemp. Left thought @Aelkus havent read Shield of Achilles but thought Terror and Consent was gripping when I did some IR/political Islam/counterterror research @Aelkus also, a Bobbitt blurb goes a long way for me. He doesn't mess around. @Aelkus cool yeah seemed smart when i skimmed it. @Aelkus meant this: http://t.co/jDtIWTXf7h @Aelkus have you read On Strategy? The movie The Island has super high level of logos/quasi-ads BUT also no reason whatsoever for ads to exist in underground slave colony. @hypatiadotca giving talk next month on lots of ways to make progress on such things :) @hypatiadotca indeed - another reason for optimism: much of that work on the heap will be lots of fun :) @hypatiadotca right - I like way you put it more than his ;) in motion, but so is ppl understanding/caring about it... i'm optimistic. @hypatiadotca only disagreement is with "quite likely." In our hands completely. Michael Bay is a genius, just not the sort critics like. The Island is about toddler-aged, adult-looking people. Justifies awkward delivery. Have to occasionally mention one of my strongest AI/robotics-related book recommendations: Robot Visions by Asimov, includes stories/essays. @yksnpnwrbrhsa didnt think of that @yksnpnwrbrhsa by email or w/e but again do not agree utopianism, optimism, hope, or whatever else is dead in US or everywhere or such claim @yksnpnwrbrhsa this/related issues will occupy many books worth of writing for me eventually so ya super important and we should prob engage @yksnpnwrbrhsa don't agree they are all that's left of it at all. utopianism, liberalism, and various hybrids are very much still around... @yksnpnwrbrhsa in other words I could go on arbitrarily long but could easily e.g. answer lots of direct questions on such issues ... @yksnpnwrbrhsa the relationship between utopianism, liberalism, AI, and some other things is one of my current focuses. @yksnpnwrbrhsa sounds like whatever you are getting at is closely related to my interests/current work but dunno exactly @yksnpnwrbrhsa What is that? @yksnpnwrbrhsa assumptions related to inevitability of certain social/technological changes between now and whatever concern in question. @yksnpnwrbrhsa you'd have to unpack the parenthesis for me to get the full meaning but on the rest, yeah thats true given various + @yksnpnwrbrhsa lots don't appreciate those aspects of many such issues. Think agree w pt on basically- good they're optimistic if naive (?). @yksnpnwrbrhsa well "probs" related to AI these days/going forward in general are complex, sociotechnological in nature etc.. @yksnpnwrbrhsa give like a thesis it holds or name for it so I can respond more specifically cuz havent read whole thing. LW-esque stuff? @yksnpnwrbrhsa in general sounds like I probably agree, though... @yksnpnwrbrhsa what "school"? Of thought? institution? @yksnpnwrbrhsa you'll have to be more specific...just skimmed again (assuming we are discussing same article?) like MIRI, Less Wrong etc? @yksnpnwrbrhsa summary: Yeah the writer is prob right to be skeptical, but lots of folks doing serious thinking about important future stuff @yksnpnwrbrhsa do plan to at least write one paper on the subject (sociology of futures/expectations in/around AI) but not for a while :/ @yksnpnwrbrhsa feel like I have good handle on the many such ppl/mindsets, no time to explain it all. did to tiny extent in seminar once.. @yksnpnwrbrhsa skimmed, seemed like lots of stuff/folks i know... anything in particular intrigue you? IMO Google is elephant in the room robotics R&D-wise at company level but have less confidence re: other companies' relative interestingness So which companies do folks think are doing the most interesting/exciting/otherwise noteworthy research and development in robotics today? Huxley says a lot of very wacky/wrong things in Brave New World Revisited, but as with BNW, I think he was super prescient in various ways. TL;DR [it isn't long though :) ] of Brave New World Revisited is: Whoa, tech is moving fast, BNW stuff is even more urgent than I thought. + but they maintained quite different views on lots of stuff such as most durable forms of tyranny. Also v interesting: BNW Revisited. (2/2) One thing I find particularly interesting about 1984 and Brave New World is the fact that the authors discussed em amongst themselves, (1/2) + in that I think RTMT will continue to improve a lot, but never had any illusion that it would be perfect. Just good enough for me. (2/2) I gave up learning Chinese years ago in part cuz (or so I rationalized) real-time machine translation would improve a lot. No regrets, (1/2) Any sufficiently advanced machine translation is indistinguishable from fully general AI. Corollary: perfect MT is not likely anytime soon. @FrankPasquale long thought people cared too much about lobbyist status. Not necessary and often harmful to ppl's effort to influence stuff. @SuzanneWaldman tl;dr (from my skimming) is it's rigorous analysis of role of values/interests in policy, + why they should be "public." @SuzanneWaldman serious book (which I haven't read yet but plan to, related to its seriousness)/related- Bozeman's Pub Values/Pub Interest. @beaucronin looks like something I'd be excited about if I knew nothing about AI/robotics, but yeah, depressing for those in the know prob. @beaucronin worried Chappie will fall short of its potential due to glossing over its sentience and why it should exist/be autonomous at all @beaucronin also, I thought The Machine was kind of weirdly overrated. Yawn at anything so clearly fitting the Turing Test/AI as human mold. @beaucronin thx I'll check out. Also sad the explicitly Singularitarian movie Prototype never got past the prototype trailer phase. RT @dl4j1: our nets are now composable: you want a convnet, you add a conv layer! same for recurrent layers and RBMs. #deeplearning Key distinction in my latest paper: between difficulty of automating job X and if it "will" be automated. Latter is ill-posed and unhelpful. @pmarca agree greater absolute number and fraction of ppl benefited in recent years but nevertheless that "before" rubs me the wrong way... @pmarca they still benefit elites most acc'ing to many reasonable metrics like relative income gains, work satisfaction, social status, etc. @pmarca 3 for 3 so far... ;) @pmarca reconciled: businesses not investing at socially optimal rate, gov't should accelerate, but regs not (only) reason for current rate. Among other things, A Very Short Intro. to Ideology by Freeden is a handy, concise, super well-argued demolition of "end of ideology" theses Philosophy and the Problems of Work: A Reader is probably my current top book rec. for serious ethical discussion of post-(bad-)work issues. Would love any reading recs ppl have on comparative welfare state theory/practice/history as well as top quality critiques of basic income. Haven't had chance yet to dive as deeply as I'd like into the computational sustainability lit, but so far seems cool, impt, and too small. "There are no gods, Sam." - Joseph Adama. "Then all the more necessary to make our own justice." - Sam Adama. (Caprica) @pmarca important to distinguish Q of intrinsic goodness of manu. vs. other sectors from args that having it here good 4 R+D feedback loops. For obvious and non-obvious reasons, companies hyping their AI don't talk much about governments' roles in their success, but it's def there Show me an AI "breakthrough" and I'll show you a long history of US (and other gov't) funded research, including prob. the authors' RAships. Would one day like to do similar analysis to my solar thermal case study (Ibid) on gov't role in (some aspect of) AI. Super underappreciated For final version of the book chapter in my last tweet with better figures, etc. and several more case studies see: http://t.co/6lEw0qbFSX IYCMI/if you wanna know why I'm excited about recent progress in solar (though in a much drier tone), see this draft: http://t.co/ElKVcaocYv Curious to know answer anyway but also so my research (/prep for upcoming talk) can be useful: what Q's do you have about future of AI/work? + something like "makes it act in a way that is behaviorally like human versions of X emotion" as opposed to it being literally true. (2/2) For the foreseeable future, "X [anything] makes Y [A/robotI] sad/happy/etc." will almost always only be appropriate as shorthand for (1/2) Just watched some videos of the MiP toy robot and now I kind of want one. See, e.g., this stacking game mode. https://t.co/EYCm8J3MbV RT @danielah_24: No one gets by @jorgeramosnews. BADASS. http://t.co/vxhklBnUdX RT @femfreq: A compassionate piece from @PennyRed on the difference between nerd bullying and structural oppression http://t.co/WGDVjIufMQ RT @mpshanahan: Deep learning and the AI startup scene: http://t.co/ZrNxC83LUW @nerdsrocket love the treadmill etc. one. Wish people knew many promising sustainable (some day) energy techs being pursued, but that any they think are sustainable probably aren't. One cool thing about @asulightworks from an energy POV is that the founding director (Dirks) used to run BP Asia. He's not messing around. If you wanna see some epic solar-related ideas that will really blow your hair back, check out ASU's Lightworks Initiative @asulightworks. Alternative TL:DR of my last several tweets: I wish more people knew there are many, many promising ideas for sustainable tech being pursued Realize that my last tweet was (/many of my tweets are) super high level, but happy to elaborate/defend against criticisms. Think most wrong TL;DR last several tweets: solar thermal and PV are ready tech-wise in many places, more soon, + non-fossil fuels aren't but worth pursuing. There are some seriously interesting ideas for sustainable fuels (not just of the "bio" variety) that many folks are working on. Super hard. RT @jtoy: deep learning reading list http://t.co/RaoASoGwSM +but important to note a ton of progress is being made in absolute terms...it is just a super hard problem. Also key: not impossible. (2/2) Sustainable jetfuel/plane batteries by any reasonable standard are decades away at current rates of progress based on what I've seen (1/2) +so far relative to what's possible and what other energy techs have wrought land-wise (compare oil). Also, lack of sustainable jetfuel(2/2) Saw (while on plane) some of the biggest solar thermal plants in the world again today... Reminded of how tiny solar's impact has been (1/2) @yksnpnwrbrhsa at least it isn't Ow My Balls. @yksnpnwrbrhsa then again I guess some other folks are that way for life not due to wisdom/experience but for other reasons. @yksnpnwrbrhsa it takes a lifetime of experience to get to that level of "DGAF about what I'm watching." I aspire to be that way someday. @yksnpnwrbrhsa lol @yksnpnwrbrhsa elaborate on that grace. RT @hannahgais: Russia Update: Hacker Leaks Show Kremlin Effort to Frame Opposition Leader #Navalny http://t.co/9Tmdswz3I9 via @Interpreter… @yksnpnwrbrhsa Love BB but yeah I guess it's not appropriate all the time. If you might be interested in reading a draft of some stuff on progress in AI, let me know..tho I'm already planning to email some of you ;) @hannahgais less cliche/preachy sounding/being* @hannahgais insert less cliche/preachy sounding version of "be the change"/"best way to predict the future is.." etc. here. I'm optimistic. @hannahgais then again, I can imagine quite a bit. ;) @hannahgais I could easily imagine marijuana legalization being one among many issues that solidifies Dem./liberal dominance in 2016/after. @hannahgais on Planet Miles this would be one of Obama's big remaining pushes after climate push 3.0, responsible innovation push 1.0 etc ;) @hannahgais seems weirdly state-specific tho sometimes, like Florida voting down a super restrictive MM bill with like one impotent strain.. @hannahgais also seems like popular opinion shift bodes well for medical marijuana laws, etc. then again Florida just voted down basic stuff @hannahgais there's a big push in AZ in 2016 I think. RT @hannahgais: At point where @nytimes is writing & tweeting about cooking wi pot, I'd say we're close to legalization. https://t.co/DbqWR… @hannahgais *first tweet was supposed to say "been to CO and/or WA." #fail @hannahgais /thoughts on how that bodes for continued state level/not too distant federal action? I've only been to WA but my take is: well. @hannahgais CO and/or WA? @beaucronin *actually, I think the report is fair, I just wish it were expanded in proportional and absolute terms in the report/elsewhere. RT @helengreiner: How the Pentagon's quest for insect-sized combat drones could end up saving lives: https://t.co/ni6xYRXBpq @ansgarjohn I'll make a note to send u paper draft soon when my ideas are more coherent/interesting than anything I could say right now. ;) @beaucronin report understates their role IMO, as well as significance of not just Chu but his team's super rapid learning of tons of stuff. @beaucronin was a tough time for lots of folks (and most of course for those who died/their friends/fams) but inspiring story in some ways. @beaucronin never seen so much nerd cred and props given by fellow nerds. @beaucronin my fave was Garwin, I think, pulling out his lab notes from Fermi (!) to disprove an argument for nuking the well. @beaucronin technically and leadership/general heroism-wise (waking up at night with nightmares, redoing calculations), super impressive. @beaucronin by searching Chu and reading surrounding regions of this report: http://t.co/nN6giqVthT @beaucronin whole thing is (tens of?) thousands long/dunno bout publicness but excerpts/examples of Chu et al.'s contributions can be found+ Series of tweets on relationship between AI-completeness/hardness results and AI progress omitted cuz few care but if you do let me know. :) @robinhanson + don't have sub to NBER so maybe addressed by Levinson but Aroonruengsawat et al. 2012 found effect of policies across states. @robinhanson at one point Steven Chu et al. were working on a cool paper on the impact of appliance standards; can't find it now, though. :( @yksnpnwrbrhsa np. want more people to know about it (preferably without me having to do much work, though, cuz I have other stuff to do). @yksnpnwrbrhsa search for Chu. @yksnpnwrbrhsa http://t.co/nN6giqVthT @yksnpnwrbrhsa or they forgot. @yksnpnwrbrhsa besides, my point is there is plenty of juicy stuff in the public domain already, people just don't know about it. @yksnpnwrbrhsa I haven't read any of the books on the spill as a whole so dunno what role this plays in their narratives. Should be central. TL;DR of my recent tweets: Steven Chu et al. stopped the oil spill that BP caused with minimal help from BP, NOT the other way around. My last tweet was glib on BP. Many at BP played role in stopping the spill. But BP as whole 1. caused it, 2. couldn't have stopped w/o help. For reals, the email thread between Chu et al. (with occasional dumb stuff from BP) on how to stop the oil spill was most epic in history. Example of Chu et al.'s contribution: Chu proposed scanning the spill with gamma rays. BP never would have thought of that in my opinion. Doubt most folks read it, but in official oil spill report, there's section on Chu's nerd squad saving the day. Should've been bigger focus. Besides having firsthand knowledge of it, I bring up Deepwater Horizon cuz Steven Chu et al. saving the day is an epic, partially told story Reason I ask about BP stuff is that I was the assistant to one of the "Chu et al." people. This is public record, just don't know who knows. Are people aware that BP plead guilty to felony charges in the deaths of 14 people and that Stephen Chu et al. had to step in to stop spill? What do people think about BP's role in Deepwater Horizon? Know what "the law" "thinks", but are they/you outraged? Cuz you should be... RT @smc90: impt, nuanced, fair, tough read on diff btw nerd bullying & structural oppression http://t.co/doDKwdhOXG @pennyred [v @femfreq @… @smc90 agreed on all counts! Making a fully autonomous AI science journalist is probably not the best way to use human/machine strengths; would be wild to see, though... Making an AI science journalist is an AI-complete problem if (but not iff) it has to impersonate human in interviews (per @romanyam 2013). Thought experiment: end-to-end AI science journalist that crawls Google Scholar/etc., analyzes evolution of scientific lit., writes stories. +and its results are helpful for me, + I don't know better way to find arbitrary companies' (w/o better proprietary sites) papers. (?) (2/2) Haven't done any serious analysis of how comprehensive or timely Google Scholar is, but does pretty good job of finding my own papers (1/2) @robinhanson not coincidentally, in Brave New World, they have a religious obsession with Henry Ford who supposedly kind of made their world @robinhanson + just remembered what you described is basically the case in Brave New World, achieved by genetic rather than digital means. Maybe obvious but in case not, may be helpful for some: it's easy to find latest papers by people at company X via Google Scholar cuz emails Between Politics and Science by Guston (my advisor FWIW) is best book on sci. policy theory/history I've read. Not for the casual reader tho In one of my AI classes we made Q-learning agents in toy enviros while learning RL. Future students may do deep RL w/ video games...jealous. Need to play around w/ deep learning on my own soon so I can quote The Terminator: "my CPU is a neural net processor, a learning computer." Haven't decided yet how strongly I recommend the entire MaddAddam trilogy vs just Oryx and Crake/to whom, but I DEF. rec. O&C to everyone. 1984 and Brave New World are classics for a reason. Highly recommend to everyone at all times that they consider (re)reading them. @Jackstilgoe @AdamThierer PS boarding flight at moment but happy to engage in more detail later when I land :) @Jackstilgoe @AdamThierer is (Adam, tweeted abt "permissionless inno" last night, didnt @ u for fear of self censorship/overpoliteness ;) ) @roseveleth cant speak to the et al or the TV version but in both cases http://t.co/Z9Dc2zg5vO had it as leading story plus some "breaking"s RT @karen_ec_levy: more than half of domestic abusers use electronic surveillance to keep tabs on their victims: http://t.co/efzIQOfN04 h/t… Not everything hyped as a breakthrough in AI really is 1, but some do deserve to be hyped a bit, like deep RL (see again Lehman et al 2014). We should distinguish incremental, revolutionary, non-progress in AI. Headlines usually suck, OK, but "breakthrough" talk has def. run amok. To Kelly in Wired, AI "breakthrough" is decades long trend. To Simonite in MIT Tech Review, it's a story. Need better vocab for AI progress. Really agree w Penny's take on Aaronson and male/female nerds and privilege (Ibid). Recommend reading full Aaronson comment for context too. On Nerd Entitlement: "[he] was taught to fear being a creep/objectifier..I was taught to fear being a whore/loser" http://t.co/Vh2GkvZtL6 @MattPovey and they just ignore all the cases that don't fit the narrative of oppressed heroic innovator. Like gov't funding said innovator. @MattPovey much of what people object to when they think they are objecting to anti-innovation politicians is just bureaucracy, complexity. No, automated Linkedin email, NBCUniversal is not "looking for candidates like me" unless they're into AI ethics now. Algorithms these days. @MattPovey related beef with "permissionless innovation" is we SHOULD be engaging broad range of stakeholders. "permission" trivializes this @MattPovey definitely lots of factors at play for sure, US def. more on risk taking side vs. EU on risk aversion. But extremes not helpful. ...and we have huge probs due to irresponsible innovation. So, no, "permissionless innovation" as an urgent US priority isn't a thing. (2/2) Lots of countries do stifle innovation to an absurd extent, but the US is not one of them or in danger of becoming one anytime soon...(1/2) @smc90 that was a nice tweet, I'll see if I can match it, with this quick haiku. +used here/elsewhere (http://t.co/Y8RhCDnYE3). "Permission" = strawman for broad conceptions of responsible innovation and governance. (2/2) While I completely agree that innovation is important and we want more of it, I really don't like the term "permissionless innovation" (1/2) Last few tweets gave me idea for corny (but accurate) paper title: Deep Uncertainty about Deep Learning. Can someone write that, please? :) +which to be super bullish or super bearish on deep reinforcement learning, a few other "hot" AI things. Deep uncertainty still reigns (2/2) One key point in Lehman et al. 2014 ("anarchy of methods") that should be emphasized: people just do not yet have any good basis upon (1/2) @robinhanson that being said, future people (especially if you're right about ems) may have a much truer, richer agent-centric origin story. @robinhanson you can also embellish the narrative going all the way back to non-life, say "because" asteroids didn't hit etc. but ya, agree. @hannahgais so yeah. Keep it up!! I know the piece will be awesome. @hannahgais not just "thoughts" but also feels ;-) @hannahgais :) let me know if you want another set of sympathetic eyes on that piece... have many of my own thoughts on such things. @hannahgais :( I will do better about this myself. For concrete examples of my prior few tweets on methods for analyzing scientific fields/literatures, see e.g. Jan Youtie's cool nano stuff. + that could be adapted to the AI case/improved using AI. This isn't really anyone's job, though (except maybe me), so rarely done. (3/3) + come up with better topic models/track framings for conferences) but most unaware of the many methods to analyze selves/lit better (2/3) In the AI community's defense, they are actually (/not surprisingly) good about using tech to improve various things (e.g. using AI to (1/2) Bibliometrics is a good example of rigorously mapping/analyzing a scientific field, but just one of many current methods, let alone future. Lots of methods exist to analyze scientific fields/literatures, esp. nano. Want AI people to improve those, use on selves, + give to others. Lots of recent work mapping AI landscape, which is necessary but insufficient ingredient for modeling AI progress. Much to cite/build on. Many individual points in Lehman et al. paper (Ibid) will be obvious to close followers of AI but thought it was framed, synthesized well. ICYMI highly recommend this paper on the diversity of approaches/theories in AI and why that's interesting/important http://t.co/w2WS3PThx0 @yksnpnwrbrhsa also, that concert sounds amazing(ly tacky) @yksnpnwrbrhsa this is very serious stuff. very upstanding establishment's reputation hangs on the balance. but ya just a big building. @yksnpnwrbrhsa unless I'm thinking of another joint in Orlando by a different name with the same general business. Which has no dog track @yksnpnwrbrhsa nope...(?) I've been there.. @hannahgais also think it is funny to think of his mostly super obvious ideas making money but hey, there is a precedent (Thomas Friedman). @hannahgais ya I mean it makes sense corporation-wise if he will bring in big bucks, but from a human POV i wouldn't hire a dude like that.. @hannahgais not being a journo/full time writer maybe I am missing something but seems like there is no reason ppl should give him a job? +like being super skeptical of anything focused on specific expected future careers. However, many aspects of good education converge. (3/3) + the divergence hypothesis, the opposite = convergence. AI progress is fast enough to prima facie support divergence in *some* ways (2/3) Call the idea that different long-term goals (economic, democratic, personal) for education should entail different concrete practices (1/2) RT @Recode: “The Interview” generated $15 million in online sales since Wednesday, Sony says http://t.co/OZf8f4uoYr http://t.co/QOtldzBrNo RT @p_e: The @80000Hours way of doing research http://t.co/pgjD5VADfG + crap on Twitter (/online in general) and not getting harassed/threatened as a result. Aware, but dunno what/if anything to do abt it (2/2) Aaronson's comment (Ibid) on male privilege, feminism, etc. reminded me of an issue I think about a lot: my privilege in saying random (1/2) RT @jathansadowski: My new article about urban space & public protests RT @ajam: Opinion: The architecture of dissent http://t.co/36okTjlX0… Don't agree 100% but Aaronson's experiences with dating/anxiety/feminism resonate with my own/many male nerds I know http://t.co/7lo1rOsus9 I would prob be even happier about the whole NYT robot vs toddler camel jockey story thing (Ibid) if they had also begun using robot camels. "owners beep at their camels [while driving SUV alongside them in race] for reasons they struggle to articulate" lol. http://t.co/X9KUfm6NJr ...but impt to keep in mind those kids shouldn't have been in that life in first place, and it was ppl who saved em, not "tech" per se (2/2) Toddler camel jockeys will not be last humans replaced by bots/spared from hellish life as a result. Great ex. of one upside of bots.. (1/2) Based on a more personal data set (vs a paper) of stuff I've written, Watson still thinks I am introverted, now thinks I am agreeable though Some interesting parts of the (great) NYC robot camel jockey story: role of tech. innovation, fact some ppl still not happy about it..etc. @SuzanneWaldman @dhdeangelis as to whether we can ever specifically prove GMO or non-GMO as a whole is safe or unsafe, no, that is nonsense. @SuzanneWaldman probabilistically/contextually/with many caveats, yes. Definitely for all contexts/possibilities/scenarios, absolutely not. @DenisonBe @Aelkus what was unmodern about eg. Marcus Aurelius's approach to governance, though? Did he not use/defend evidence? Surprising. Watson thinks based on the first page of my latest paper that my personality is open, disagreeable, and introverted. Not bad for small data. @Aelkus @DenisonBe not to mention there was an actual explicit technocracy movement people love to forget about. @Aelkus and "there is nothing ideological about this approach" is one of the dumbest things a student of politics could possibly say. @Aelkus another pt is that only a trivial fraction of politicians SEE what they are doing as protecting useless programs/pork. Not the issue @Aelkus also, sure sign someone is naive is them saying "we're not naive"...? @Aelkus prob thousands of years ago. Would be stunned if Greeks/Romans didn't write/speak equivalent of this many, many, many times. @Aelkus they think proposing cost benefit analysis and empirical evaluation is super novel, unambiguous, and apolitical. wrong wrong wrong. @Aelkus had early direct exposure to this lack of seriousness in CBA implementation when interning at WH.. @Aelkus like OIRA/CBA for example. Paucity of serious analysis of what Sunstein et al did there and are continuing to do. "RT @robinhanson: Politics Isn't About Policy. Our talk prefs: How we'd rule world >> physical/org constraints >> political compromise. http…" @Aelkus ignore "not even that" @Aelkus not even that but the Sunsteins/Orszags/Chopras of world don't even take a serious analytical lens at stuff they JUST DID in govt. @Aelkus there is an emerging cottage industry of naive, crappy books on making government more tech-savvy and innovative. @robinhanson Most people I associate with do not fit that description so bristled at the generalization but I associate with weird people. @robinhanson "people" is mostly composed of nonexperts so in that sense you did say that ;) @robinhanson well I specified non expert because you didn't, or I missed it, will reread ;) but yes I agree with that formulation. @robinhanson agree nonexperts have misconceptions/indefensible constellations of views but that is understandable/rational given their lives @robinhanson many in DC are well aware of all those things and actively work on compromise. And they are the ones that matter most IMO... @beaucronin sounds a lot like the responsible innovation problem ;) we should discuss more at some point @beaucronin using "fixed" roughly obviously... @beaucronin lame. what are main real or claimed reasons why it can't be fixed? @beaucronin how can we make it not harmful when it does happen, or reduce the time between beginning work on X and finding out it's scooped? @beaucronin but again, my broader point is that the optimal rate of scooping is not zero. Good to be on the edge of that possibility. @beaucronin also, I arguably addressed that with caveat about "deception" writ large ;-) system level science ecosystem problem to be fixed. @beaucronin well yeah, that would be frustrating. Guess things look different when you don't run experiments (though I have some ideas ; )). In general, being scooped research-wise is worse the more time/$ you spent on X and the less other sources of value you get from that work. @beaucronin in other words, to what extent is it an information/collaboration problem vs. ethics, inevitability etc? @beaucronin at the same time, though, is that really an intrinsic problem or just a reason for scientists to map network of work better? @beaucronin in general, it is a better thing to happen the less time you spent on X, but again, I think good sign you're not crazy. @beaucronin right, was just typing something to effect of "there are legit reasons to be upset about it in some situations..." @hannahgais lol I love getting "scooped" research-wise... means possible new collaborator, can move on, think bigger, others care about this stuff, etc... Not sure I really get some researchers' opposition to being scooped, unless result of deception. To me, means I can think bigger/move on. RT @hiskov: Robotics 2014 in a word: MORE @therobotreport http://t.co/7Q1TbmF99J @Sparkyparky82 also good to know for future reference/visits someday, etc. cuz I love London ;) @Sparkyparky82 interesting. that bodes well for Google's shareholders, if I had to speculate ;) "Deep Learning for Answer Sentence Selection," Yu et al. [DeepMind folks] http://t.co/c0xXyin0hG @robinhanson suspect @beaucronin would have things to say on this... ICYMI, nice, short, important paper, "Robot Trustworthiness: Guidelines for Simulated Emotion" https://t.co/RaApZYYZIy Just found out there's a debate on autonomous weapons at AAAI 15...Ron Arkin (Georgia Tech) and Stephen Goose (Human Rights Watch). @hannahgais me neither. "Recurrent Models of Visual Attention," Mnih et al. [at Google DeepMind] http://t.co/dZt0Jndtip """An Anarchy of Methods: Current Trends in How Intelligence Is Abstracted in AI"" Lehman et al. (AAAI workshop summary) http://t.co/w2WS3PThx0" @zeustoves sounds good to me @hannahgais but how would I and your other followers see your poodle multiple times a day spontaneously if that happened? cool words too. ;) @Aelkus agreed "The opportunities [to rationalize apparent inconsistencies in ideologies] are legion, and not all of them are cynical manipulations" Ibid. "Even ideologies conventionally deemed to be broadly irrational, such as fascism, possess a grim internal consistency [given premises]" Ibid "Ideologies also need to decontest the concepts they use because they are instruments for fashioning collective decisions." Freeden/Ibid. "[Ideologies'] competition over plans 4 public policy is primarily conducted thru...competition over...control of political language." Ibid. Freeden's A Very Short Introduction to Ideology is a solid intro to political ideology/language, w further reading recs as usual for series. @amcafee @2MAbook not a review, but here's my latest paper which draws on it/related literature, suggests research Qs http://t.co/NW01PrWy1K @smc90 great org. several friends used to work for em. @smc90 in my experience, EA folks are quite understanding of the need for engaging on an emotional level, just see it as means to an end. Thinking about Huxley's notion of "education for freedom." Also, education for leisure. Humanity isn't doing either one super well currently @j2bryson I think the key fact about them is that the "board" is like a bajillion people. I declined... @j2bryson yeah, I never use it myself unless necessary to make a point to a particular person. Agree 100% w/ your points in your post on it RT @TeachGuz: Before you see the movie: A Poor Imitation of Alan Turing by Christian Caryl http://t.co/eztWIVaEZS via @nybooks "the Nazis would have never allowed a bunch of ... eggheads to engage in such ... work, + suffered the consequences." http://t.co/idbPgaDlQX @dbiello @SuzanneWaldman *and not just cuz I live there :-) see e.g. the book Bird On Fire. @dbiello @SuzanneWaldman my hunch is any such list is necessarily arbitrary cuz sustainability vague, but Phoenix is def. worth highlighting "As his biographers vividly relate, though, [Turing] could..be a wonderfully engaging character when he felt like it" http://t.co/idbPgaDlQX Enjoyed The Imitation Game, but annoyed by the inaccuracies (see last RT). On other hand, fewer would have seen w/o the Turing=awk jokes :-/ RT @carlzimmer: A pretty devastating look at The Imitation Game’s distortions of Turing’s life. http://t.co/T3gWGM8ndC @dbiello @SuzanneWaldman Phoenix and Las Vegas are prob both highlighted often bc of water/"unnaturalness" but not only relevant metric here @dbiello @SuzanneWaldman probably others more unsustainable by some metrics but as far as BIG cities it is definitely up there in some ways. @SuzanneWaldman lots of potential (nowhere near solar tho - not just me saying that, it's a fact ;) ), big siting/transmission issues. Never got chance to use Chef Watson as much as I intended to (/don't cook much anyway) but it was impressive/is sign of some things to come. @SuzanneWaldman I do!! but I know I'm weird ;) @hannahgais :-/ @hannahgais sorry for the dumb questions, never lived in NYC but trust your judgment :) @hannahgais are they super conservative? Just incapable of grasping idea that killing innocent people in general is bad? RT @wtfirl: First time I read so many details about what happened when creating Pepper, well done IEEE http://t.co/BbLLU7turN Education has broad social benefits but also positional/social stratification aspects. MOAR education is NOT solution to tech unemployment. For example, if less technical need or social demand for work in 20 years, rethink education, but don't expect it to give everyone job.(2/2) There are similarities btwn what individuals and groups should do to prepare for future of work (e.g. rethink education), but not same.(1/2) @hannahgais k "Anticipatory Competence as a Key Competence in Sustainability Education" Lauren Withycombe Keeler's master's thesis https://t.co/TjYg5XxFv1 "Plausibility indications in future scenarios," Wiek et al. https://t.co/jTOhTuqWfX @hannahgais (w.r.t. DeBlasio I mean) @hannahgais so I'm not following this closely, but is this interpretation right: NYPD being a bunch of ridiculous/hypocritical whiners? +about getting AIs/bots to do right thing. If synthetic emotions help with that, use em. Also, emotion displays good 4 social interface(2/2) The relationship between synthetic emotions and machine ethics is complex/contested, but IMO something like this holds: ME is/should be(1/2) RT @amcafee: Non-Technologists Agree: It’s the Technology (that's reshaping the workforce) http://t.co/xn5Y3pcKuh #2MA #NAME? Super duper partial but illustrative list of AI ethics issues anticipated in sci-fi: killer bots, x-risk, tech. unemployment, sex bots (1/2) Obviously there are plenty of examples of *specific* issues/cases sci-fi didn't anticipate, but also examples of *broad* issues it did.(2/2) At some point I'd love to see/make a list of AI ethics issues *not* anticipated in science fiction. Way harder than positive examples. (1/2) RT @bengoertzel: @Miles_Brundage Demis is brilliant and Deep Mind is a cool project. I think deep learning of their sort is only part of t… @bengoertzel if we start seeing DeepMind job listings that have the location as the US rather than London, that could be beginning of end ;) @bengoertzel in my experience in an ambitious/innovative start up within US govt, physical separation was key to cultural difference from HQ @bengoertzel yup, was just commenting on this other day actually. IMO their location in London absolutely critical to that. @bengoertzel agreed.... very fertile area and they're succeeding in getting others fired up/inspired about it... Cool, thx :) yeah, will be very interesting to see how they evolve. @bengoertzel not denying that's their area of expertise...but w/ that ambition/competence, seems like they'd agree with you/deal w/ that (?) @bengoertzel agree on DL, but do you have reason to think DeepMind is overly/totally focused on that? Lots of people, lots of publications.. @Aelkus meaning, my paper will be way more useful/true/up to date in some ways, but you still may enjoy the book regardless. Great stuff. @Aelkus btw still digging Kim 1990/suspect you would, but in a few months should have first draft of my paper on same issues if u can wait.. @Aelkus cool thx. @Aelkus have you read this in full/do you recommend it? @Aelkus one of the better books on AI IMO. Thought skimming the book The Moral Case for Fossil Fuels was depressing, then I read some of the glowing reviews.. http://t.co/GMwyuRin3K … @Aelkus forgot about that one/lost that file a long time ago, I think.... nice, thanks. If Google needed AI to learn there are cat videos on Youtube, that'd be embarrassing. Not what the paper said despite (semi?)popular belief. A lot of what I say about gov'ts not thinking enough about future of AI applies to most gov'ts, esp. US, but Singapore is possible exception + with cat videos. That's nonsense/not what the relevant paper said at all. Did Google contribute to this, or just game of telephone? (2/2) I've heard several people confidently claim Google did something like "let AIs learn what's on the internet/Youtube" and they came up (1/2) Of DeepMind's two big hyped techs so far (deep RL + NTMs), only former has had real impact on the scientific lit so far. Slightly older tho. RT @mpshanahan: Kurzweil: Safe AI is good "We have a moral imperative to realise [the promise of AI] while controlling its peril": http://t… RT @VincentCMueller: I offer a job Research Fellow (PhD/PostDoc) in Risks/Ethics of Digital DIY Manufacturing, 30 months, DiDIY EC project … @bengoertzel what do you think of DeepMind, esp. considering they (at least Hassabis) explicitly call selves Apollo Project for AI? @rj_cubarrubia looks like Eddie Munster/Paul Ryan My view of future of work is vague/flawed/partial, but at least trying to make explicit. That's my main claim...need explicit, open futures. @OddLetters which is probably more circumspect than the occasion called for, haha. but hey, I'm an academic. Can't speculate on IRL you ;) @OddLetters in case another one wouldn't hurt...you also seem very cool based on your tweets. :-) TL;DR of a bunch of the stuff on the Common Core site is "we talked to a bunch of people/thought about a lot of stuff." I'm not convinced... It's not necessarily obvious that we should radically change education given future tech considerations, but not obvious we shouldn't either @danbann2 nice, will do! Thanks! @OddLetters you're a great role model for ambitious PhD students in terms of publications :-) @SuzanneWaldman @chilifarming yeah my pt is consistent with that - not that corps being dishonest is shocking, but *effect* is bad long term @SuzanneWaldman @chilifarming I mean buying a promising clean tech company specifically to prevent a threat/put it on ice. Super douchey IMO @SuzanneWaldman @chilifarming example of sketchy fossil fuel behavior besides discussed already is buying clean tech to *not* use. V common. The time lag between education policy interventions and students entering (or not) the workforce is super obvious but not taken seriously... What does the Chamber of Commerce (example of Common Core stakeholder) know about workforce issues beyond, say, 5 years? Almost nothing IMO. I'd like to think the various Common Core stakeholders did *try* to think about long term issues, but it's super hard, so doubt successful. AFAIK Common Core process involved looking at literature on workforce issues, surveying employers...tells little about job market in 20 yrs. One would think a major effort to change education would be informed by a serious analysis of the future of work. AFAIK one would be wrong. Have seen Common Core defended as preparation for college and/or inter-kid/-state fairness but begs question of education's goals generally. There is in fact a moral case for using fossil fuels NOW while making them obsolete but painting fossil fuel industry as moral hero is silly Almost bought Epstein's The Moral Case for Fossil Fuels but skimming suggests it's not worth rebutting/I don't want to give him money.. :-/ And if not, or if that shouldn't be a/the driving force behind education in the future, why exactly are the standards what they are? (2/2) Another way of putting my Q on AI and Common Core: do we have any reason to think ppl taught that way will be employable in 20 years? (1/2) Lots of books written on how to thrive in the economy of future. Alas, most are self-help-y, not group-help-y, and/or totally unsystematic. @EvanSelinger I can send you an email on this later. Hard to fit in tweets. @EvanSelinger sort of a generalization of the point that commanders ordering drone strikes are responsible for outcome, to all of AI/bots. @EvanSelinger basically autonomy (ethical or otherwise) enables humans to impact world more with individual decision to build/deploy. @EvanSelinger did that make sense? could try to rephrase again :) @EvanSelinger with high fan out rate (eg human controlling bot swarm making individual local ethical decisions), person's role even bigger. @EvanSelinger currently high ratio of ppl to machines (eg drones). If reversed, human decisions to deploy more impactful on world overall. @EvanSelinger @om @smc90 @davewiner if anything AI ethical autonomy could raise stakes of human decisions bc higher fan out of AIs/bots. Not naming names, but some folks will regret using Go as a supposedly enduring example of something humans are better at someday. Temporary. @EvanSelinger @om @smc90 @davewiner would add: still moral matter even if AI fully moral. Higher order decision to build/deploy still human. @fmanjoo the latter is a scenario in which I wouldn't endorse H/Ts. H/T to me implies you would not have found it otherwise, maybe just me.. @mariana_farinha likewise! :) @PTee17 sure, send me your email address via direct message. @mariana_farinha done :) @mariana_farinha sure :) let me know via Direct Message or otherwise what email address to send to... "If humans are willing to accept poor customer service from a robot in exchange for cheaper goods and services [that matters!!]," me, Ibid. + aimed at disentangling factors like consumer preferences for human/machine, quality of service/competence of human and machine, etc. (2/2) TL;DR of paper on AI/robotics/customer service (can share privately): demand side of future economy unclear, have ideas 4 experiments (1/2) If anyone is ever interested in relation btwn AI/robotics progress and customer service, lemme know, have crappy class paper I could share. Can't say I'm really surprised by that paper on fooling neural networks...the general point has long been known. Just rigorous demonstration @OddLetters thanks! :) @hannahgais psh. looks like a great research assistant. moral support is the key. RT @Jessicalessin: Google, Uber and Amazon have all been considering building APIs to their delivery networks. Would be a big deal. https:/… @hannahgais some findings on not just content but network structure etc. @hannahgais also, if you wanna be 1st to make non-trivial pt on relation btwn Instagram studies/other stuff, see top: http://t.co/ezxvmGfcoY @hannahgais cool. not my area of expertise but I thought the Horvitz et al one was cool... @hannahgais you seen the scientific papers on the depression/social media stuff? Horvitz et al + that other one recently that got more attn. @OddLetters inspiring to a fellow grad student/aspiring book writer ;) @hannahgais :) @OddLetters congrats! RT @sadydoyle: Seth Rogen: World's Greatest Advocate For Free Speech Who Also Contacts Magazines To Cuss Them Out For Bad Reviews. Not actually super interested in what deep RL *could* do in industry...answer is a lot. My Q is, what is happening, how will affect workers? Look forward to raving about forthcoming articles in the Journal of Responsible Innovation soon. In the meantime, see http://t.co/kyE3LR5WjM Kevin McGrew writes great stuff on the CHC theory of human intelligence. One of his more recent/accessible papers: http://t.co/2IT51RwCO6 + not necessary to accelerate latter but in Carroll's terms ('93, ch 1), hardware boosts "speed" abilities more than "level" abilities (2/2) The relationship between computer hardware progress and AI progress is complex, but broadly speaking, the former is sufficient but not (1/2) RT @robinhanson: For centuries, civil service exams decided who were Chinese elites. But merchants & sons not eligible; their work seemed t… "Socio-energy systems design: A policy framework for energy transitions," Miller et al. 2014 http://t.co/qNGF8RisjD @smc90 for showtimes, that is. :) @smc90 I'll keep my eyes peeled :) "Higher Educated Guesses," by Yoav Shoham, nice set of predictions/considerations related to MOOCs, universities, etc http://t.co/3DRlNKjfip @hannahgais sounds like fun actually. ;) The Interview's 50% is way better than Seth Rogen's worst rated movie on Rotten Tomatoes (The Watch, 17%). Not saying *good* but not panned. Now, if The Interview were animated/by Pixar, I'd say 50% was a bad Rotten Tomatoes score. But for live action comedy, more than I expected. Some folks pushing the "The Interview got panned by critics" part of overall narrative, but not really true. 50% not bad for comedy on RT. AFAIK (?) this is the only serious discussion so far of specific commercial apps of deep reinforcement learning https://t.co/mwPE2xQC0H @hannahgais some. but regardless, strange framing of issue. ppl wanted X, Y, Z so forgive torturers? @hannahgais not surprising coming from him honestly. @elonmusk hope you will discuss the role of sci-fi in thinking about the future of AI in your long-awaited blog post on the risks of AI ;-) RT @elonmusk: Reading The Culture series by Banks. Compelling picture of a grand, semi-utopian galactic future. Hopefully not too optimisti… @smc90 yes agree 100%. On one hand I like pushing back on li-ion specific battery gripes but also dont think super range strictly needed. @smc90 so yeah dont mean to downplay the scaling/maturation challenges, but beyond say 5 years, I would be less inclined to rule out 400+ mi @smc90 OK, well suspect there was some overlap btwn that and what Im familiar w (ARPA-E funded super long range early stage battery chems). @smc90 in what sense? full disclosure, EVs not remotely my focus...but isnt Tesla using lithium ion? @smc90 not soon but lots of post Li-ion chemistries could someday. @NotMyBro I have not but sounds like maybe I should! looks very up my alley. thanks :) Zero-Shot Learning Through Cross-Modal Transfer by Socher et al., NIPS 2013 http://t.co/pbKy7FoMHy "Move Evaluation in Go Using Deep Convolutional Neural Networks,"Maddison et al (see footnote on Clark/Storkey paper) http://t.co/pXkjuGuwYb "Generating Real-Time Crowd Advice to Improve Reinforcement Learning Agents," de la Cruz et al., AAAI 2015 http://t.co/MkVvR5uVmK Last three tweets = basically a summary of what I think DeepMind is up to, but they're def. not the only ones thinking about related issues. + general (see e.g. Bieger's "Raising AI") is paving way for synthesis of big/deep and small/human data (like correcting AI behavior). (3/3) + they'll get better and better at solving narrow probs w/ big data, and simultaneously work on apprenticeship learning/AI tutoring in (2/3) In super broad strokes, one key trend I suspect will accelerate progress in AI is the following: as deep/reinforcement learning mature (1/3) "Seven Cardinal Virtues of Human-Machine Teamwork: Examples from the DARPA Robotic Challenge," Bradshaw et al at IHMC http://t.co/mBYIAJaerb @Aelkus rhetorical Q, obvi there are reasons to publish stuff besides fostering convos. Just wish latter happened more, more spontaneously.. @Aelkus indeed, tho sad it takes an article like this sometimes to get ppl to talk to, understand opponents. Why is article needed? + lest they incentivize excessive focus on narrow benchmarks; dynamism key to incentivize generality. "Campbell's Law" would work too. (2/2) Paper I almost wrote: "Goodhart's Law and AI Progress." TL;can't read cuz nonexistent: metrics for AI progress should be vague, dynamic(1/2) Anyone read/recommend The Rise and Fall of the Third Reich, The Rise and Fall of Communism, or similar books? In the mood for such analysis. Lot of non-DeepMind co-authors on DeepMind papers, belying their supposed secrecy. Suspect most secrecy pertains to applications, long term. There are themes (e.g. deep RL) in DeepMind people's publications, but also random stuff. Less random than Google overall - all AI focused. Would be interesting to compare Brown paper in last tweet re: theories of politics in sci/tech w/ Douglas's/others view of values in same. Serious stuff by Mark Brown MT @Soc_Stud_Sci Politicizing science: Conceptions of politics in science + tech studies http://t.co/NUaZd4Unes @hannahgais it's all relative to what you're familiar with, in the mood for, etc.. could handle that now but prob not Command and Control.. @hannahgais and FWIW, I had quasi-appropriate xmas reading earlier ;) brain emulation economics, to be precise... @hannahgais nice. yeah, my hope is it's a good big think book on not just the specific issue but also socio-tech system complexity/safety? @hannahgais have gotten serious about reading it several times already and didn't follow through. :( stuff comes up up. will eventually :) Some factors suggest it's better to overprepare for automation education-wise than underprepare, but overall, dunno. Ditto for welfare etc. Important consideration in future of tech/work/education is cost of prediction/preparation error: cost of under/overpreparing for automation '95 Hunt book "Will We Be Smart Enough?" explored relation btwn cog ability distribution of ppl and future labor market. Needs to be redone. Haven't done relevant research yet but would be v surprised if I found coherent account of Common Core in context of plausible tech progress AFAIK there hasn't been any (recent) effort to systematically compare plausible AI/tech progress through time X to education btwn now and X. Might do medium dive soon on relationship btwn AI progress, future of education/work, and US Common Core education standards. Could be cool. RT @IBMResearch: New book in 2015: Cooking w/ #ChefWatson: Recipes for Innovation from IBM & @ICEculinary http://t.co/tchyO8wduH #ibmresear… All I want for Christmas is a comprehensive model of the nature/pace/drivers of progress in AI. Santa ran out, will give to self next year. @hannahgais exactly Interesting to note many fears of US right wing conspiracy theorists are valid but not actually fears (eg. New World Order to deal w probs). @gsvoss my chapter (draft) is free on Publications section of my site if u want a sample :) @gsvoss book of case studies mostly tech specific (mine is solar thermal)/US focused but a few nice takeaways, and a DOD specific chapter. @gsvoss nice job! btw on related issues(/ppl :) ) see Sarewitz ed Rightful Place of Science: Govt + Energy Innovation. Wigner chapter on DOD Barnes & Noble locations in more educated/affluent areas tend to have more academic/low volume sale books and smaller Christian Life section Not just one but two copies of Bostrom's Superintelligence at this Bellevue Barnes & Noble location. Def haven't seen that in AZ locations. Seattle/Bellevue area Barnes & Nobles are radically better (for my purposes) than Phoenix area ones. More science/tech stuff cuz MSFT/AMZN. "Our insistence on the reliability of robot affect signals is therefore essential for honest social behavior by robots." Atkinson, Ibid. "Robot Trustworthiness: Guidelines for Simulated Emotion" by David Atkinson https://t.co/RaApZYYZIy @hannahgais lol yeah I know. wasn't worried about that. ;) @hannahgais well you do seem fired up about this Christmas thing ;) anyway, cute poodle. @hannahgais is this a threat or something? @gsvoss left there over two years ago btw. question of making innovative culture endure was central from day one but dunno current status. @gsvoss good luck! happy to answer q's about it in future, have somewhat unique pov doing sts/innovation policy stuff now/working there.. @gsvoss (which shouldnt be surprising given the history, ie it stemmed from a recommendation of a high level report/years of groundwork) @gsvoss devil is partly in detail/visionary founding leader who can recruit well etc but the high level model is very well thought i think. @gsvoss this one is the key/most definitive wrt model (worked on early much longer version while there ;) ) http://t.co/GkVueBxnOU @gsvoss see eg their strategic plan for an outline of the model if u wanna know more. @gsvoss take all that with a grain of salt since I am a big arpa-e fan. many from around world came to learn about it/model but non trivial. @gsvoss np! @gsvoss in terms of flexibility, broad mandate, hiring practices/staff caliber, innovativeness, etc doubt anything else comes close frankly. @gsvoss having worked at arpa-e for 2 years..no. Maybe stuff similar in *some* respects but doubt anything deserving "equivalent" label :) @OddLetters hope kids these days get cool open ended games like KidPix. Oregon Trail I think kids could prob live without, in all honesty :) @OddLetters Not just great, amazing. Huge part of (part of) my childhood. RT @StevenLevy: North Korean Internet is down, not sure it US's fault. Millions of Americans don't have Internet to speak of, either. THA… Cool paper applying AI (etc) theories 2 time travel: Foundations of a Formal Theory of Time Travel, Leora Morgenstern http://t.co/ESq4du9fcj RT @MazzucatoM: My article in current @NewStatesman "Public risks, private rewards: how an innovative state can tackle inequality" @n http:… @beaucronin i suspect in part bc format's legit, writing etc=not obvi silly, lack of good alternatives for high article # science news (?) @beaucronin and not just in the broad sense of hype being common, but there being other equally unskeptical sites. but it's def one of worst @beaucronin unfortunately they're not alone :/ RT @beaucronin: Man, @ScienceDaily has never met an incremental or isolated result they couldn’t fluff into a paradigm-busting breakthrough @hannahgais yup @Aelkus "what is an ocean [AI] but a multitude of drops [bots/simple algorithms]" - Cloud Atlas "‘Excellence’ tells us nothing about how important the science is and everything about who decides." - @Jackstilgoe http://t.co/KcOL17rY0j Some key dimensions to consider in AI progress modeling IMO: domain/environment, TRL, safety/ethics, building blocks, integration, and TIME. ICYMI earlier tweet on this: would love to hear what anyone thinks on Danks' book Unifying the Mind arguing 4 centrality of graphical models +the idea that NN performance outpaces understanding, but ppl do know things, depends on level of analysis in question, etc. Thoughts? (2/2) Haven't wrapped my head around neural nets (lack of) comprehensibility/extent of theorization... one the one hand, there is truth to (1/2) If Piaget were alive today he'd be super stoked about all the data with which he could build theories of intelligence. So ahead of his time. A* search algorithm still being explored/improved decades l8r. Core idea simple: consider heuristic cost and path cost-->guarantee solution. If I had a trillion dollars every time I read "technology augments/doesn't replace humans" I could give everyone a basic income and robots.. Norman's Design of Everyday Things is best by him I've read, great intro to human centered design in general w/ pointers to additional work. If you dig human-centered automation stuff in Glass Cage, consider Norman's design stuff (+1 rigor wrt GC) or Eng. Psych+Human Perf. (+3). + to exclusion of e.g. physical labor, repetitive calculations, etc. in part cuz tech --> perception more significant proportionally. (2/2) Key point in Engineering Psych + Human Performance (4th ed) - focus of textbook (/much human factors work) is on perception + cognition(1/2) "The Gov't Role in Developing Solar Thermal Tech." (PDF) http://t.co/madtygK5TH draft of my chapter in this cool book http://t.co/EEogA2nvdm @hannahgais sigh. sounds epic. @AliMattu @zeustoves @knewscript @nerdsrocket speaking of stuff getting supernatural at the end..I need to rewatch Interstellar asap! @AliMattu (or else they dont do anything, another way of putting a similar point maybe?) @AliMattu heard someone use library metaphor super recently but forget who: buncha DNA in library, ppl have to actually read [express] books @AliMattu nice!! love me a good video. will check later :) TL;DR of Engineering Psychology and Human Performance (4th ed): ppl know stuff about making tech fit/augment human abilities, not used much. @AliMattu nice, sounds epic :) also something id love to know more about but havent gotten into yet.. Basically what Mcgrew/Schneider are getting at in two part tweet a minute ago is: synthesize models of cog architecture and cog differences. RT @elonmusk: I'd recommend competing for the $10M Learning XPRIZE. Illiteracy is the wellspring of poverty. http://t.co/NLuFheVmpx @AliMattu also, IMO super interesting issue: relation btwn factor analytic/individual diffs in IQ POV and how exactly brains work POV :) @AliMattu that section really knocked my socks off/came at a great time in my research so wanted to share the fun ;) work on cognitive architecture etc. Worth a glance. From Schneider/Mcgrew chapter in Contemp Intel Assessment (2/2) http://t.co/0GxCWoIoM9 @beaucronin likewise for a bunch of other pairings of people. Collaboration is insanely understudied (and good studies insanely ignored). Super epic (for those into intelligence theories) speculative synthesis of CHC model of intelligence and other (1/2) http://t.co/D0PohLqnFd RT @julia_mk: 100 year study on AI starting at Stanford w/ an interesting list of topics - technical, ethical, practical https://t.co/uE7xn… @SuzanneWaldman and those GHG virtues are re: nat. gas and coal. Anyway, TL;DR, one can be a solar extremist like me for other reasons ;) @SuzanneWaldman comparing to nukes and other renewables I meant*. :) @SuzanneWaldman (as far as comparing it to nukes, that is... has obvious virtues in respect to GHGs, water use, etc. @SuzanneWaldman for me it's more about maturity, geographic flexibility (not infinite, e.g. with thermal, but decent for PV), resource scale @SuzanneWaldman yup! Absolutely agree both that for *some* people that's the virtue ;) and it sort of is, just not one I focus on much. @SuzanneWaldman IMO those are def. big themes for sure but relate only loosely to tech...eg. I expect much big (ugly and beautiful) solar :) @j2bryson "everything is obvious once you understand it" ;) - Duncan Watts/others? @SuzanneWaldman would need to know more about ghana though... anyway, very interesting to hear!! :) @SuzanneWaldman like I said, hope they do it well/safely/more, but just wouldn't be surprised in the least if it fizzled out.. happens a lot @SuzanneWaldman yeah that's a big difference from India ;) @SuzanneWaldman also India is diff in important ways... regardless, my point was just that cost will be key, interpret that how you will ;) @SuzanneWaldman if you had listened to anything they'd ever said and they'd been right it'd be like hundreds/thousands now... @SuzanneWaldman right, but look at their projections. Consistently SUPER DUPER over optimistic. Wrote a paper on that specific issue once :) @SuzanneWaldman that being said I'm happy to see that quantity of energy going to a place like Ghana (if it actually happens). @SuzanneWaldman /complexity (and associated human capital/workforce/regulation/etc. stuff being hard). Coal, nat gas makes more sense.. @SuzanneWaldman would be surprised if went anywhere, for same reasons it hasn't despite hype in other dev countries (e.g. India). Cost (1/2) @beaucronin @danieldewey drove me insane back in day. e.g. ill examined folk theory that green jobs good framing, climate bad, etc... @beaucronin @danieldewey CSER, AI100 Stanford study (others?) do have this as serious part of mandate which is great IMO. again, details.. @beaucronin @danieldewey yeah i was just writing follow up saying "but..." :) exceptions all over place, trends in right direction IMO @beaucronin @danieldewey yes, big diffs, prob still fair to say comms in movements generally = ad hoc/based on folk wisdom from that domain. Enjoying Miller's Theories of Dev Psych. Fun fact: Piaget had to turn down a job offer (mollusk curator at museum) cuz he was in high school As Bringsjord notes in recent paper on Watson limits, big Q is how far shallow logic [+ deep learning I'd add] can go competence-wise. (3/3) #NAME? Watson is interesting for a similar reason (but in a different way technically) to DeepMind - getting a lot (of competence) out of a (1/2) @mark_riedl thanks!! @SuzanneWaldman @traceydurning related issue is that even w/ free panels, still labor cost. Efficiency has to be high enough so worthwhile. Anyone recommend any Asimov novels/short story collections that are not robot-specific or Foundation-related? Decided I need to practice what I preach regarding appreciating Asimov and reread Foundation, read some robot stuff I haven't, reread others Been happy with Very Short Intro series books so far...Sargent/Utopianism, Freedan/Ideology, Floridi/Information, all v clear/authoritative. Sargent's Utopianism: A Very Short Intro is great. Read it, but if not TL;DR: utopias risky yet essential for critiquing dominant ideologies Jim Davies's book Riveted is a super readable overview of the authors' theories on what makes stories compelling to people psychologically. @danieldewey @beaucronin PR/framing/risk communication not my area of expertise but know enough to know most NGOs know very little of it.. @danieldewey @beaucronin piece seems to conflate "not being crazy" with "having done what they should have done framing wise." not same. @danieldewey @beaucronin + certainty that NGOs there dont draw on enuf relevant evidence to make good PR/framing decisions. SOME do, rare.. @danieldewey @beaucronin + while I am not super up to date on animal rights movement theory, I am for climate change and can say w/ some+ @danieldewey @beaucronin + if I concede "media machine" suboptimal, don't think just media's fault. Article gives PETA too much credit...+ @danieldewey @beaucronin sympathetic to/agree w/ many of the issues here, but devil is in details/varies across domains in impt. ways/even+ In Space Jam whistles are blown not by refs but off screen (aliens? an AI?), impressive refing considering potential risks to tiny players. + for other domains on the value of social scientific analysis and a socio-technical lens for analysing threats/risks/tech in general. (2/2) Phantom Menace or Looming Danger?: A New Framework for Assessing Biological Threats by Vogel is about bio but also has great lessons (1/2) Govindarajulu, Licato, and Bringsjord, "Toward a Formalization of QA [Question Answering] Problem Classes" http://t.co/gYM0iu9ZIo ICYMI Bello and Bringsjord - On How to Build a Moral Machine [start w modeling folk morality/don't expect perfection] http://t.co/kLJiheBSPv @sramamoorthy will do, thanks!! :) +book on analogies/metaphors re: capitalism/socialism/utopia etc, argues ideal capitalism > ideal socialism. Fun/short, recommended. (2/2) After thinking about it for a while, don't agree w/ *all* of Brennan's pts in "Why Not Capitalism"? but overall super good/well written(1/2) @petitegeek awesome, thanks!! :) + in particular, I found Carroll's magnum opus Human Cog Abilities and subsequent refinement of the CHC model to be super helpful lens (2/2) Read a lot about intelligence assessment, psych models of intelligence, etc. in last few months, v. useful lenses for thinking about AI(1/2) Of particular note in the 100 year AI study is its open-endedness with respect to research topics. Solid, long list of possible research Q's If you're interested in the 100 year AI study, be sure to check out @erichorvitz's great white paper outlining it: https://t.co/WbadjIBTQ0 Long suspected there'd be useful insights for AI progress modeling to be found in dev. psych but still new to it. Recommendations welcome :) Have to return Theories of Developmental Psychology (Miller, third edition) in a few days, so need to actually read it now. Looks epic. @beaucronin clarification: probably more a matter of disinterest/ignorance than skepticism per se. Most ppl prob totally unaware of him/Goog @beaucronin I would be taken aback if I heard an AI person talk positively of his work, honestly. Maybe unjustified skepticism but def there @beaucronin don't doubt his ambition, but doubt the generality of his preferred approach to modeling cognition. @beaucronin agree that's one interesting thing, here's another: does anyone in AI think he knows what he's doing? Haven't met anyone yet.. RT @beaucronin: @beaucronin the interesting thing about Kurzweil at Google is that he's *only a director. Pretty humble title for someone o… RT @beaucronin: Always a tipoff when an author refers to "Ray Kurzweil, Google’s director of engineering", as if there's only one; cf. Glad… @VincentCMueller variables including that I often get super valuable feedback on the long tail (re: specificity/randomness) of my tweets.. @VincentCMueller can do better signposting/numbering/making things self contained (they all seem so to me...). Overall # determined by many @Aelkus here's a random heuristic: more concentrated power suggests psych more important, less -> systemic. @Aelkus don't think there's any general purpose answer possible in principle here. Case by case. @Aelkus for a second I thought you meant states in an AI sense and this tweet was super confusing. Anyway, certainly not short of humans. "What's new in responsible innovation research and why is it necessary?" Tsjalling Swierstra (47 mins) https://t.co/MlqfjEL2fn Another tricky thing (last for now) is the intertwining of human/technical factors, units of analysis (e.g. deep learning tacit knowledge).. Another tricky thing I'm grappling with at the moment modeling-wise is AI's weird/evolving mix of science/engineering, academia/industry etc #NAME? Concluded a while ago there is nothing remotely like a tech progress modeling template (yet), many researchers making up as they go along+ Point is, I'm working on pulling a bunch of threads together. Should have something in the way of a more coherent overview at AAAI soon.... Other key disciplines/methods involved in the "society" side of AI+society in particular modeling are economics, social psych, sociology.. #NAME? Whole bunch of different disciplines, methods, theories, etc. relate to AI progress/society modeling. Some of my faves so far: theories of+ RT @sapinker: Our Global Lang Net confirms '02 UN Arab Hum Dev Rep re insularity: Few translations into Arabic | http://t.co/kECvTnKlMn via… @Aelkus agree headline etc is sensationalist but the actual quotes mostly seemed reasonable to me @Aelkus not sure anyone there fits the mold you mentioned before..? concerns about surveillance culture neednt assume conspiracy (?) @Aelkus anyway ill read it :) @Aelkus never heard of elf on the shelf, should i have? @Aelkus example? I agree such a view is untenable, though not sure I've seen many academics make that explicit or even strongly implicit..? @Aelkus so many ideas that didn't take off. One on my mind lately: rigorous AI progress modeling. Kim came closest in 1990 I think. RT @beaucronin: I'm writing a book for @OReillyMedia on the neuroscientific basis of effective VR. Follow my research at @NeuroVR and http:… Press release on 100 year Stanford AI study funded/led by @erichorvitz here - some more details than in the NYT piece http://t.co/Hpleg2cMpS @Aelkus nope. will DM you about it though. Then again it's hard for me to say what others will think of Chef Watson since I'm pretty familiar w/ Watson. Any of yall used it? Thoughts? One quick thought on Chef Watson, though: I think many who use it will fail to appreciate how significant the underlying AI is. Just saying. Also have much to say on the social analysis of Watson as a research enterprise but that will have to wait until another day. Much work :/ TL;DR tons of super ambitious/smart AI researchers all over Google. Just know less about that distributed vision vs. DeepMind's specific one Only faint idea what other hyped AI groups @ Google (e.g. Kurzweil's) do, but nothing to suggest they're bigger/more ambitious than DeepMind In my experience at a gov't start-up (ARPA-E) intended to be autonomous from the rest of DOE, physical separation was key. Ditto 4 DeepMind. RT @MelMitchell1: Half of papers appearing at NIPS [one of most prestigious ML venues] would be rejected if review process were rerun: http… Another point on DeepMind: their ability to stay autonomous of rest of Google/stay in London will be key to not being run of mill AI group. @romanyam very solid piece IMO It's also possible DeepMind is super dysfunctional internally. Don't know, just wondering what could happen AI prog.-wise if they aren't :) All of which is to say that even if you ignore the technical details of DeepMind, there is a prima facie case for being interested... Lots of big, ambitious/organized AI research groups, but generally big trades off w/ organized/ambitious. DeepMind = weird in this respect. + outlier in terms of scale (soon to be ~150), organization, ambition, etc. That being said I'm not as familiar w eg. EU, Japan groups (3/3) + united under one framework/goal/project, and some academic labs more ambitious but less $. In that specific sense, DeepMind is an (2/3) If I understand correctly, AI2, Microsoft Research, Google, Baidu, FB, etc. have big AI research groups but mostly they are not super (1/2) @SuzanneWaldman exactly. esp. w/ baseload renewables becoming possible in more and more areas more cheaply (not fast enough but still) :) RT @robotenomics: Gofai, for good old-fashioned artificial intelligence. Interview with @etzioni by @markoff http://t.co/VMEITBVcdu #AI RT @SethBaum: Recent typo: 'no good deed goes unpublished'. Alas, if only it were true @robotenomics working on it ;) @robotenomics very solid white paper IMO. + that AI's hard to govern, others suggest opposite or are unclear. Emphasis on all things being equal - just for heuristic use anyway (2/2) Clarification re: earlier tweets on AI being hard to govern: *some* (not all) of Tucker's considerations (e.g. digitality) suggest (1/2) @hannahgais :( @beaucronin not ALL about but a little...i'll DM you :) RT @erichorvitz: Skype Translator preview out today http://t.co/mtFtHIKDRi. Out more quickly than predicted in my 2006 forecast http://t.c… RT @markoff: The Long Now Now http://t.co/424jHsJdpZ @PabloRedux subtitle of Real Freedom For All is What if Anything Can Justify Capitalism (his answer: maximum sustainable basic income 4 all) @PabloRedux for longer version/representative replies, see Whats Wrong w Free Lunch? slim volume, for much more detail, Real Freedom For All @PabloRedux you may like him then. see Capitalist Road to Communism. Not saying i agree 100%/more radicalism isnt justified but recommend @pmarca Agree with first point but second depends on many factors, including many beyond SV's control: education, inequality, culture, etc. @PabloRedux one of my fave on related issues is Phillipe van Parijs...synthesis of efficiency virtues of cap'ism/Marxist case 4 basic income @PabloRedux some, yes. Left Hemisphere: Mapping Critical Theory Today helped me identify ideas/threads but I'm still early in following up. Tucker: ease of governing tech varies directly w/ materiality, inversely w convergence/rate of prog/int'l diffusion, + medium maturity=best. Lesson from the general decision framework in Tucker's (ed) "Innovation, Dual Use, + Security": relative to other tech, AI's hard to govern. @clairecm I review the lit on these Q's and suggest a research agenda for clarifying the issues you raise here FYI http://t.co/NW01PrWy1K @beaucronin whether people *want* engagement on risk as opposed to the issue in my last tweet (ie relative priorities)= even longer story :) @beaucronin there is some truth to that in that it is not their highest priority anymore, research/recruiting math ppl is. Long backstory.. RT @beaucronin: @Miles_Brundage what stands out about recent “don’t worry” pieces is total lack of acknowledgement of/engagement with MIRI-… @beaucronin agreed. = what part of I liked about Russell's piece..clarifies what are/aren't concerns and why, formalizes MIRI/FHI core claim increasing exponentially, since random combinations are generally bad. Q of how hard selecting/making good combinations will be is open(2/2) Can't infer too much about future AI progress rates from the fact that the options for combining tools/architectures/modules etc. are (1/2) + needn't be invented at a fast rate in order for all the possible combinations of those building blocks to increase exponentially. (2/2) A meso-level application of Strumsky et al.'s analysis of the history of technological innovation is the following: AI building blocks (1/2) Last several tweets also serve as explanation of why DeepMind acquihired at such high $$$. Epic synthesis blew people's minds analytically. What I said about synthesis outpacing analysis in deep neural networks probably was true b4 DeepMind/deep RL and its wake, but def true now! Lots of explorations in recent years of why deep neural networks work/don't work etc. but innovation in synthesis seems to outpace analysis. One of the big problems in thinking about the future of deep learning is that the leading experts only partially understand the present :) @curiousepic @FHIOxford sorry, second from the bottom now.... @curiousepic @FHIOxford it's the response at the bottom here http://t.co/ZNdSl9rc06 Abstracts due January 15 for Third Annual Conference on Governance of Emerging Technologies: Law, Policy, and Ethics http://t.co/AQ3HXlbJS1 For example, what role the military and intelligence communities should play in AI R+D (currently a big one) is a legitimate "regulation" Q. + banning AI research, OK. But that's narrow slice of "reg" space. Gov't funds/regs (in broad sense) AI in many ways, Q is details IMO.(2/2) There's truth but also something misleading in "no one is calling for regulating basic AI research" (Russell/others). Insofar as this (1/2) Re: last RT, agree that it's only a matter of time b4 humans lose to computers at Go, not sure it's soon, but agree the paper is impressive. RT @techreview: Why Neural Networks Look Set To Thrash The Best Human Go Players For The First Time http://t.co/93oKocrpnX But again, highly recommend it... tons of important clarifications/formalizations of AI risk points. Key point missing from Russell piece IMO is emphasis on human responsibility for deploying/using AIs well, not just designing em ethically. Things I'd add to Russell's remarks but hits nail on the head in several respects re: what ppl at FHI/MIRI/CSER et al. do/don't fear re: AI. I still super highly recommend Stuart Russell's mike dropping response to the Edge debate on "The Myth of AI" http://t.co/53PSe9PE5X My last tweet is from an interesting paper from NIPS this year, cool interdisciplinary POV from Berkeley cog scientists, Stuart Russell, etc "Rational metareasoning [seems] promising framework for reverse-engineering how ppl choose [..] cognitive strategies" http://t.co/o4vk9pbMjx Ideally more detailed than that half-tweet version of an argument....but yeah that's the *sort* of insight I'm looking for. Don't expect perfect theory, just something like: hardware will help with depth, not much w transfer, or proficiency but not generality, etc People agree hardware helped deep learning (Schmidhuber makes case explicit), but does anyone have any idea how much it could in the future? @Aelkus nice, have liked some shorter stuff by Vernon.. RT @Floridi: Short, brilliant, Quine's: Universal Library (do not miss it) http://t.co/gqJbHukjog Related (to Kim) point made by responsible innovation scholars (e.g. Fisher wrt STIR)=ethical reflection/creative science can be synergistic +not perfect, more on that soon, in meantime, 1 of Kim's key pts is complementarity of analysis/synthesis- his framework aimed at both (2/2) Designing Intelligence (Kim 1990) attempts comprehensive framework 4 evaluating natural/artificial intelligent systems. Very useful. (1/2) @Aelkus there is also the company Cyberdyne with their product HAL, I think...prob a few other such things I am forgetting right now. RT @ArtificialOther: Court Says Chimp Not a Person http://t.co/pSU0icZHj7 #personhood #animals Can anyone recommend great English language reading material on the details of Japanese/Korean gov't's robotics investment strats/visions? @SuzanneWaldman really just cuz of efficiency. Photosynthesis super bad for this purpose. Innovative approaches pursued but too soon to say. @SuzanneWaldman now that, tho not solar, is one area where I think there are completely legitimate showstopper arguments about land. ;) @SuzanneWaldman lots of real/likely uses of biofuels, etc. but my personal best case is aviation fuel, high value products, etc. not cars.. @SuzanneWaldman not super surprising IMO, follows straightforwardly from e.g. Trancik's pts on complexity, resources... not holding breath. @beaucronin thx will check out! @Ikemeister @SuzanneWaldman plus back of envelope transmission, efficiency, materials etc but mostly land. will let u know if written up :) @Ikemeister @SuzanneWaldman "do the math" in my case just means having done calcs on solar land viz a viz energy demand, conclusion: plenty. @Ikemeister @SuzanneWaldman + I made no claims about renewables overall, wind, am biofuel skeptic etc. Just think solar big part of solution @Ikemeister @SuzanneWaldman maybe I will read some day. to be clear, I did do work on this in past but not right now, or id prioritize ;) @Ikemeister @SuzanneWaldman yeah that's why I had those caveats about the literature. dont expect u to take at face value, goes both ways ;) @Ikemeister @SuzanneWaldman That book as far as I know is not a detailed analysis of solar resources in relation to population areas, is it? @Ikemeister @SuzanneWaldman so I agree insofar as the case hasn't yet been made sufficiently well for what I was saying. for now :) @Ikemeister @SuzanneWaldman all that being said I do think there is a paucity of good published work on that Q. Mine unpublished for now @Ikemeister @SuzanneWaldman if your point is solar thermal is not going to power every appliance on Earth, I agree.... so? again, BILLIONS @Ikemeister @SuzanneWaldman "do the math" not an arg. I have, many times. i focus on this for part of my research. lots of ppl near deserts! @Ikemeister @SuzanneWaldman most people aren't Europeans or East Coast Americans, though. Again - can help MANY. Not everyone. @Ikemeister @SuzanneWaldman yes other stuff is needed, transmission issue is non-trivial. But: don't see how 1 can look at Solana and yawn! @Ikemeister @SuzanneWaldman yup! included in that world is 1 billion in deserts and almost everyone w/in 100s of miles. @Ikemeister @SuzanneWaldman a much shorter read is the Wikipedia page on the Solana plant ;) Not saying it's perfect/good everywhere but key @Ikemeister @SuzanneWaldman don't have time/doubt I'd learn much on the specific issues I raised/have studied but happy to discuss thermal @Ikemeister @SuzanneWaldman agree! See: Solana plant. Arbitrarily scalable in deserts, storage working already an hour from me :) @Ikemeister @SuzanneWaldman as long as you don't define away upstream/downstream nuclear issues, happy to defend solar in fair fight :) @Ikemeister @SuzanneWaldman @amazon the land issue is diff from material resource question but happy to throw down on solar v nuke land ;) @Ikemeister @SuzanneWaldman @amazon so what is the constraint on molten salt storage? Salt? Metal? Pipes? @Ikemeister @SuzanneWaldman compactness sounds like an anti-solar/pro-nuke metric ;) but yes storage key, works well already w solar thermal "With great AI power comes great human responsibility." Uncle Ben remix Not to mention it comes up in basically every book/long form article on the topic. Keynes's "Economic Possibilities" = so hot right now. Brink Lindsey's book ends w it, @Floridi paper begins with it, my latest does both ;) Emphasis on "super" because 1. such args are already suspect given today's tech, 2. 20 years is a long time/could be huge AI progress wise. Hypothesis 2 explore someday: plausible AI progress rates make gloomy args re welfare state unsustainability SUPER suspect beyond say 20 yrs As for how to get such a transition (if we want one) right, I am still searching for a killer sci-fi reference/anti-Player Piano. Thoughts? Vonnegut's Player Piano is must read on how not to transition 2 post(-bad) work world. Important aspects of leisure, pride in work explored. ...none of which is to say progress hasn't been made. A ton has been made/is/will/could be. Point is don't forget history/scope of challenge + those Q's or the meta-Q of how long they'll take. Super old AI work often has great summary of challenges. Fallen out of favor a bit (2/2) Overall, AI researchers have been more successful over the years at putting their finger on important research questions than answering(1/2) @beaucronin that review actually has a decent discussion of the importance of general intelligence theories, social implications thereof etc @beaucronin Albus's general theory of intelligence also is another good ref. Sad I didn't get to meet him b4 he died, similar goals/ideas :( RT @ArtificialOther: Reddit AMA right now: 3 female computer scientists at MIT, here to answer questions about programming and academia htt… @beaucronin basically seems like he did the best he could with ideas/tools available in 1990. Much to improve on surely but super stoked ... @beaucronin the appendices alone on important things like general theories of design, intelligence, etc. look super epic. @beaucronin haven't read this review but might be helpful for those without it in hand ;) Found at lib. Cite up top http://t.co/CrrPRQvdU3 Makes me sad finding one typo in my own/others' work, especially in a paper book. just found one near end of Human Capitalism :( so close!!! "This framework may serve as the foundation for a more comprehensive theory ... in the years ahead" (Kim). Working on it...24 years later :) Tons of theories relevant to intelligent systems analysis/modeling but Kim's is one of the more general/rigorous approaches I've seen so far Interesting general framework for intelligent system analysis in Kim's Designing Intelligence (1990). Too bad that sort of work dropped off. "The design of intelligent systems may be characterized by six factors: purpose, space, structure, time, process, and efficiency." Kim 1990 @mark_riedl well, few things in AI and in particular its future are universally agreed on ;) but your hypothesis seems interesting to me. RT @mark_riedl: @Miles_Brundage Not sure commonsense knowledge isn't just ML at scale in real world contexts. Most exciting stuff IMHO from… @mark_riedl fair to take away from your comments that the domain's too early/contested 4 useful/fair/representative textbook/lit review yet? @mark_riedl very helpful feedback, thanks. Would you recommend any reading material giving a different perspective? Lots of super interesting debates about whether bad jobs are inevitable, etc. that I haven't really read enough of yet to comment on, sadly. The phrase "post-work" is vague and what it connotes isn't what many (/I) want anytime soon. Prefer post-*bad* work. Still vague but better. Not to mention there is a vast spectrum between everyone doing alienating work and no one working/planet of couch potatoes a la Player Piano There are good args for a post-work world having risks/challenges, but the potential upside is staggering. Dismissing glibly is silly IMO. (hence why I try to mention alternative, more considered ethical POVs re: work/leisure despite recommending Second Machine Age highly :) ) Besides the usual quibbles about AI progress, my biggest beef with Second Machine Age is the treatment of radical economic possibilities. And not only do people make bad arguments against the right not to work (per Maskivker) but we underestimate benefits to "work lovers" (!). No jab at negative liberty intended. I'm all for it. Just hope 21st century is, among other things, about taking both seriously 4 everyone. Hers is just one of many args for rethinking the relationships between free time, ethics, work, etc., + actively increasing positive liberty Julia Maskivker has some epic publications on the right not to work/related issues. Much to say re: that/AI someday https://t.co/lMMGvmoLAL Specifically I'd love anyone's thoughts on this textbook: http://t.co/nrZVZX3ujS And I know "good or bad" is simplistic but just wondering if there are aspects missing from that EC account I should attend to elsewhere.. What are AI folks' thoughts on event calculus? Like if I read a textbook on commonsense reasoning that is event calc oriented, good or bad? @robinhanson sounds very cool! Hope my dissertation is the opposite of this paragraph.. False starting point, bad metric, random progress rate, why? http://t.co/TdKXsD03K0 RT @chrishtill: Should sociology try to predict the #future in order to produce a better one? http://t.co/9eMm0V4kjC Better Solana video than the last, sorry for anyone I subjected to that wacky music. APS propaganda but nice images https://t.co/TOGGkeLx8r @nerdsrocket Agreed!! 1 billion people live IN deserts and if you include ppl within 100s of kms, you encompass billions more. = partly why I dig solar thermal. Solar thermal with storage isn't perfect/cheap enough yet/for everywhere but 1. epic proof of concept 2. many people live near deserts! :) Solana [solar thermal] Generating Station's molten salt energy storage system's epicness is underappreciated IMO. Mega-solar power at night! @luisbaram @SuzanneWaldman @cthorm :( @SuzanneWaldman @cthorm @luisbaram problem is, it's best for rural areas, not urban. Goes on the ground, not roof @SuzanneWaldman @cthorm @luisbaram (as in, integrated system that you just plug into and manages the battery, etc. automatically). @SuzanneWaldman @cthorm @luisbaram I've seen cookie cutter ones up to 1.7 KW. @SuzanneWaldman @cthorm @luisbaram then again that's just one sample.. they were optimizing for stuff other than eco-friendliness I guess ;) @SuzanneWaldman @cthorm @luisbaram cookie cutter solar/battery systems I've seen use car batteries w/ ~5 years life, def innovation needed. RT @rcalo: Facebook artificial intelligence might detect and deter embarrassing photographs. http://t.co/OVh5ShzTFI RT @garyrosenWSJ: Will superintelligent machines threaten humankind? Unlikely, says @GaryMarcus. But we should prepare more. http://t.co/fz… @SuzanneWaldman see also my old boss and his old boss on the case for energy tech optimism+hard work (basically :) ) http://t.co/Ag1F7ofBiA @SuzanneWaldman @ActinideAge @CarlsonEngineer think you'd actually dig her stuff. Compares coal vs. solar vs. nuclear etc. cost drivers. @SuzanneWaldman @ActinideAge @CarlsonEngineer which is my way of saying "dunno" :) @SuzanneWaldman @ActinideAge @CarlsonEngineer the relation between complexity, innovation, and resources is something Trancik covers. @ActinideAge @SuzanneWaldman @CarlsonEngineer issues, challenges, ethical/policy issues, yes. But it's v feasible at mass scale technically. @ActinideAge @SuzanneWaldman @CarlsonEngineer I'd gladly defend the claim that solar thermal DEF doesn't have land/resource showstoppers :) @SuzanneWaldman @ActinideAge @CarlsonEngineer how did you get me to defend PV? I'm a thermal guy ;) Like both but can defend latter better. @SuzanneWaldman @ActinideAge @CarlsonEngineer has some good papers on related issues. Can't speak to if resources mess up his calculations. @SuzanneWaldman @ActinideAge @CarlsonEngineer the resource Q in particular is not my area but 1 thing: Woodhouse argues v cheap v soon. @beaucronin but my hunch is it will be about relatively narrow senses of common sense and the broader sense is non-sense. Sense @beaucronin I am sympathetic/inclined to agree but am trying to withhold judgment til reading a textbook on AI commonsense reasoning.. @ActinideAge @SuzanneWaldman @CarlsonEngineer the fact using silver forever is impossible doesn't mean we can't get a lot done w/ it. @ActinideAge @SuzanneWaldman @CarlsonEngineer I address that in my next two tweets ;-) Can't wait BUT not running out of silver soon so.... @ActinideAge @SuzanneWaldman @CarlsonEngineer i.e. start putting institutions/processes in place for deployment, switch tech when needed. @ActinideAge @SuzanneWaldman @CarlsonEngineer we need mix of pursuing new chems and ramp up. Not every aspect of ramp up depends on chem. @beaucronin he doesn't put it in terms of common sense per se, I think, but just more generally saying humans have rich logics. @SuzanneWaldman @ActinideAge @CarlsonEngineer I wouldn't advocate eg. WWII style ramp up/lock-in of today's tech but also can't wait forever RT @doctorow: Spacetime curvature placemats http://t.co/RhPn2BWx8s http://t.co/f1FeClx766 @SuzanneWaldman @ActinideAge @CarlsonEngineer also, no one argues (/I don't) there aren't challenges, just think e.g. silver isn't last word @beaucronin see e.g. Selmer Bringsjord's analysis of Watson's logical depth. @beaucronin and that in a nutshell is a succinct critique of the Watson paradigm ;) @beaucronin exactly. I think it is super damning from a research difficulty POV. @SuzanneWaldman @ActinideAge @CarlsonEngineer not to trivialize the importance of the other elements but again many approaches being pursued @SuzanneWaldman @ActinideAge @CarlsonEngineer one would come up with different intuitions looking at how much silicon there is on Earth ;) @SuzanneWaldman @ActinideAge @CarlsonEngineer lots of good work on that topic, not mine though :) E.g. Michael Woodhouse, Jessica Trancik @beaucronin I agree that it highlights the gap. Just from a pure performance POV, at least it wasn't incoherent ;) some worse answers. @ActinideAge @SuzanneWaldman @CarlsonEngineer suffice it to say that that only applies to solar chemistries with those elements :) @ActinideAge @SuzanneWaldman @CarlsonEngineer MANY solar chemistries. Perfect mix of cost/resource/efficiency yet? No but many working on it @SuzanneWaldman "sufficient" as in sufficient to deploy a ton of solar and help lots of people. Will create new probs, requires foresight.. @SuzanneWaldman besides, though, I don't think that's strictly necessary, though may be sufficient. Finance innovation helps a lot, too. @SuzanneWaldman not a solar array per se but energy types appropriate locally, which in an increasing # of areas happens to be solar/battery @SuzanneWaldman Great examples of this on a local scale on e.g. some Indian reservations. On large scale soon? No. Do I advocate it? Yes :) @beaucronin how so? @danieldewey granted, I don't have super good evidence for that, but this seems consistent with it/in general, never say never ;) @danieldewey I often wonder if people are vastly underestimating the plausibility of superhuman computer Go in the near future. For the record, there ARE cities named Toronto in the US. Watson wasn't completely wrong about that, just lacked commonsense to disambiguate Nice overview of AI ecosystem by @shivon https://t.co/zcRH8olXDg Point abt. academia vs. industry key. All recent AI PhDs I know did latter. RT @shivon: The Current State of Machine Intelligence https://t.co/PcDyZTseQH http://t.co/KZKC9P3m3p OK, end of rant about fandom wikis. Back to work... Should be non-linear relationship btwn content volume in fandom domain and wiki size for that fandom, more content --> more synthesis/themes You can only milk so much out of the Harry Potter books in order to populate a wiki. Doctor Who, expanded Star Wars, etc. more to work with. The only way I can think to explain the Harry Potter wiki in particular's small size relative to others is that content volume is big driver In general one would expect to see more detail, higher quality, more pages, etc. to the extent passion/content/reader/viewership increase... Essentially I'm curious what accounts for the variation in size across fandom wikis. Passion? Content to draw on? View/readership? Etc. Had to gather all the data I've been listing myself. If you Google stuff like "wiki fandom size/biggest" etc. you just get crap results. There's gotta be data somewhere on fandom wikis and their relative sizes/characteristics but Google doesn't get what I'm looking for. :/ The Harry Potter wiki has 11,984, i.e. just between BSG and Star Trek then Star Wars on a log scale. Gotta be something bigger than SW tho!? "None of these failures should be downplayed" [rewind 30 seconds] "the vast majority of officers didn't do anything wrong" etc. - Brennan. TL;DR of Brennan on torture is #notallCIAofficers @beaucronin Have you read Ready Player One? Critical reference point for me in thinking about VR. Will add your book to that list someday ;) @NotMyBro thanks for the kind words btw! :) "RT @vardi: 21st-Century Postdocs: (Still) Underpaid and Overworked http://t.co/9BiXY4omFS" @NotMyBro you can also see my older stuff (some more popular audience oriented than others, esp see the Slate stuff) on my site ;) @Aelkus ...which I unfortunately never mastered... @Aelkus familiarity with the concepts/debates def helps with the coding, but really getting things to compile etc is a distinct skill set. @NotMyBro should have a long form piece to share next week to tide you over for a little while at least ;) @Aelkus yeah taking AI classes is a trip for me cuz I typically am way ahead of most students on concept level cuz research, but bad coding. @NotMyBro I also try to make sure each tweet is self-contained but maybe the only seem self-contained to me :) @NotMyBro ah, good point. I'm not looking at other tweets when ranting so don't notice :) Do write long form stuff tho, working on 1 now... The publicly available evidence does support the view that DeepMind is super ambitious, but again, pace @elonmusk, no basis for alarm (yet). @NotMyBro this doesn't count? ;) @Aelkus yup. Plan to do such stuff eventually but still v noobish coding wise Even if I learned they were trying super hard, though, so are lots of smaller groups/individuals, so again, both effort and difficulty key. I would reassess that if I learned something about e.g. DeepMind or someone else giving huge focus to integration of AI components. Not yet. Example of my level of confidence: for my own personal research scoping/career planning I give ~0 weight to AI being solved in 5 years. All that being said, I think the problem difficulty aspect is key and insufficiently understood so my claims should have big error bars. :) Figured I should share what I think about the Musk thing since my dissertation will largely be about AI progress modeling/shaping :) That formulation was vague but main point is: progress depends on what researchers, funding agencies etc. do, not (just) problem difficulty. + well funded but don't consider that business as usual and, pace @elonmusk, haven't seen evidence DeepMind trumps such considerations (2/2) IMO super huge progress in AI in the next decade is *plausible* if the AI community became more collaborative, interdisciplinary, and (1/2) @romanyam not so much skeptical of there being big progress but about any one company like that doing much on their own by then... @romanyam neither v plausible though IMO. Huge progress in machine learning, etc in 5 years? Sure. But that's a low bar/far from general AI. @mark_riedl maybe AI + social science + futures stuff rolled into an AI system that can do all those things. Bit ambitious :) @mark_riedl and what I said isn't mutually exclusive with it being (done by) AI, I was just framing it in a disciplinary way :) @mark_riedl only read the first one though, more knowledgeable about the robot specific aspects of Asimov's universe... @mark_riedl it's a matured form/synthesis of social science and futures studies but as to what the models consist of/run on, less clear IMO. See also the mad scientist in Asimov's Naked Sun and his illegal plot to take over the galaxy with advanced robot starships. See e.g. Caprica for a great treatment of killer robots and the complex socio-technological and policy/cultural factors surrounding em. Banning of killer robots or at least narrowly circumscribing their ethical decision-making is common. So is their illegal use anyway. Clarification on killer robots in sci-fi point last night: there are lots of killer robots in sci-fi, but they're typically controversial. There are also widely ranging views in sci-fi about the relationship between AI's levels of sentience, intelligence, rights, autonomy etc. Another difference across sci-fi universes is if stunting the intelligence of AIs is effective, usually helps a lot with the control problem What's inconsistent across sci-fi universes is whether the AI autonomy-safety tradeoff can be eliminated (i.e. the control problem solved). Many across the sci-fi multiverse agree there's a trade-off between machine autonomy and safety and making robots moral reduces it somewhat. Technological unemployment, robot rights, intelligence explosion, machine ethics/trolley problems, driverless cars, military robots... Few major contemporary AI/robotics ethics research issues weren't anticipated in *some* way in sci-fi. Can't speak to other sci/tech domains Case could be made that Asimov was especially perceptive re: future ethical issues related to AI and robotics. Regardless, not the only one. I could seriously talk forever about how often sci-fi anticipates the specific contours of an AI/robot ethics issue decades in advance. At the very least there are usually strict legal/hard coded criteria for when robots are allowed to harm humans in sci-fi universes. Another theme in sci-fi is banning killer robots and the use of robots in warfare. Seems to be a near consensus in the fictional multiverse. Asimov's universe also depicts a range of possible human/machine configurations(robot rights, cyborgization, robots being humanoid/not, etc) On Naboo, in particular, apparently, intelligent robots were treated like people. In general though they were mostly considered dumb/useful. As depicted in the Star Wars wiki, that is. I'm mostly just familiar with the movies. TL;DR it seems that AI, robotics, robot rights, human-machine interfaces, and cyborgization have a very rich history in the exp. SW universe "Had the project come to full realization, it would have produced the perfect battlefield infantry unit," be given to stormtroopers as exo. "The Phase III dark trooper was the last and most powerful dark trooper exoskeleton/droid." Clone creativity + droid firepower. A few built. That's a pretty huge advantage in a dogfight in space, I would think. A common theme in at least a few sci-fi universes is that droid starships can do maneuvers that would kill human pilots b/c of the g-forces. The resultant droid ... had the limited cognitive capabilities of a labor droid, but its physical characteristics would be [what it was]." There's a short stand alone Star Wars wiki page on droidification, which means turning an everyday object into a droid. A little bit of movies, TV, etc. but most of the material upon which the Wookieepedia is based must be from books and comics I think...? There doesn't seem to be anything else remotely comparable in terms of content to books and comics (hundreds each) in SW universe... Based on a brief perusal of the wiki, it seems the bulk of the content in the expanded Star Wars universe is books, comics, other. Thoughts? I guess you just have to have read a ton of expanded Star Wars universe to know all that stuff. Anyone recommend embarking on it someday? :) Specifically that it was cheap processors and not e.g. stunting their intelligence, or being made in a different time period, etc. Discussion on that droid page about how probe droids are dumb because they have cheap processors and "dumb" AI. Wonder how that was derived. Not familiar with the expanded SW universe but this says droids started getting memory wipes after someone made a personality-inducing virus "During the Yuuzhan Vong War .. droids were targeted ... by the technology-hating Yuuzhan Vong invaders who saw them as abominations." Ibid. Nice page on droids (including a brief section on legal status thereof) in the Star Wars universe http://t.co/eIxzbXJsS9 Game of Thrones Wiki has 2,486 English pages vs. BSG at 3806, Star Trek at 37,569, Doctor Who at 42,148, and Star Wars at 115,000 right now. Wikis in general are often impressive, but this (Battlestar Wiki) just happens to be one on a topic for which I can confirm it's accurate :) Reason I mention this is that I occasionally have minor questions about Caprica/BSG plot detail issues and Battlestar Wiki always delivers. I mean come on, look how many entries have the word Caprica in it. Some serious person-hours went into this stuff. http://t.co/WpKASeqfq3 Lol just as I said that, the home page of Battlestar Wiki seems broken. Individual pages working, though. Anyway, content (when up) rocks. I am consistently super impressed with the Battlestar Wiki's crystal clear/always (in my experience) accurate pages on BSG/Caprica stuff. @beaucronin @jathansadowski stuff to say on this next month after next month's DeepMind workshop/ethics workshop (Google appearance?) maybe. @beaucronin neither of which actually grapples with anything anyone cares about...like jobs. @beaucronin He has a mix of bizarre (Turing Test in 5 years? What?? no not at all lol) and banal "um we can recognize cats lol" AI takes. @beaucronin fortunately it isn't an attempt to "settle" every debate, just a few. @beaucronin @jathansadowski e.g. Google's role in this stuff? They're by far the most mysterious in terms of AI/bots of companies w/ talent. @beaucronin like the book The Digital Age. Per @jathansadowski the Schmidt/Cohen thesis is tech creates probs but fixes more. Umm OK so @beaucronin I'd almost rather them not address it than pretend to address it/think they have. What sort of ed. will be needed to use them? Will robots actually reduce consumer prices enough to offset employment losses? Tip of iceberg. +to jobs. Who controls it? What's Google's role? Is it gonna perpetuate the rat race of help us escape from it? Who will be able to use em? In particular I would like to see Schmidt/Google in general (maybe their AI ethics board?) think about the *details* of tech. in relation+ Education and tech change/the future of employment are related but MOAR education is not a cure all for the future of the economy and work. And I'm including his book New Digital Age and its recent post script on jobs in my assessment that he hasn't addressed it :) Super shallow. I can imagine good arguments for why Google isn't worsening it or is even addressing it, but he makes no such arguments anywhere I know of. And saying computers make people make more money is true but banal. Heard of job polarization? Why isn't what Google doing worsening it? I'd be the last to argue we shouldn't improve education, but it's not a cure-all for tech. unemployment assuming we even WANTED a cure-all. I could not disagree more with Eric Schmidt about the "correct concern" about tech unemployment is more education "http://t.co/2oQ5byW2FM @Aelkus also, did his code compile? RT @beaucronin: "Aliens" finally gets its due as high-art meditation on the relationship btwn humans & technology https://t.co/TadROWtqti h… @jathansadowski my takeaway from this chat is I should prob reread or at least attempt to skim that this weekend ;) @jathansadowski yeah, omg when I found it like a year or so ago I was soooo happy haha. @jathansadowski the title of her dissertation is "Mind the Gap: A Critique of Human/Technology Analogies in Artificial Agents Discourse" :) @jathansadowski in fact I should probably reread it (the dissertation). Super good. Also a few papers summarizing much of it. @jathansadowski Yup. Good sign :) @jathansadowski the ability to skim things/predict what's coming next is a hallmark of expertise for a given domain. Good heuristic at least @jathansadowski right. I've also read Noorman's dissertation, which is great btw :) @jathansadowski think we also need to move beyond vague frameworks but this is one of the richest yet for sure. @jathansadowski Super well structured/thought out/executed IMO. Useful grant! @beaucronin similarly, Skynet in pop discussion connotes an autonomous AI that inevitably took over but see T3 - greed/politics played role. @beaucronin would like to make case (poss. in this article) Caprica is similarly rich, and e.g. shows complexity of Cylon origins. That paper frames precisely the sort of socio-technical complexity minded, collective responsibility-oriented perspective need in AI ethics. @beaucronin well, not at least since I've known anything/remembered anything lol. Will have more to say on the relationship between that stuff and existential risk and scifi stuff in the not too distant future hopefully :) Required reading on AI ethics - "Recommendations for Future Development of Artificial Agents," Johnson/Noorman (PDF) http://t.co/VNIrFvX6gZ @beaucronin btw I'm sold. watching Aliens later. @beaucronin not yet/same one. Don't hold your breath, lots of good but conflicting feedback from folks I need to come to grips with :) @beaucronin soon...Caprica will get the attn and Skynet the nuance it deserves! Have tentative approval to incorporate former in a piece... Any INTJ tweeps thinking about the future of AI? :) INTJs do tend to self select/many of my best friends are INTJs so wouldn't be shocked... INTJs are into system/theory building/big picture/long term stuff so it would make sense on that level if there were some connection... Learned last night that many of the people I'm discussing in an article (@elonmusk, Hawking) are INTJs like me. Relationship to AI concerns? Epic/diverse feedback on article from @thekibosch @j2bryson @danieldewey. Tricky to find right tone on Skynet analogies/their discontents :) "No, they [Cylons] don't score in the sentient range...but they shoot and fight, and that's good enough for the military." - Cyrus Xander. The punch line, though, is that Graystone uses the mob's power to take back his company Steve Jobs style and then commercialize Cylons. @jathansadowski could be. Not sure I've seen that one! I have a tab open... Daniel Graystone tells the mob he'll make em money via selling avatars of dead people to grieving families. Effective if unethical VC pitch. "[Avatars of dead people are] the ultimate drug to heal the ultimate pain. Now what do you think that's worth to someone?"- Daniel Graystone @robinhanson what would your odds be for 2035? 45? 55? @robinhanson or there will be no super AI boom that quickly... If any tweeps try Watson Analytics do let me know! Barely enough time to take a look at Chef Watson yet, behind in trying/evaluating stuff. Good (if brief) points on education, culture, income, etc in relation to inequality. Mostly synthesis, not new args. Clever framing/title. Human Capitalism=good quick read on inequality, nothing earth shattering tho. TL;DR See the title: capitalism becoming about human capital. "Despite rising returns to human capital, human capital development is slowing down or stagnating [in much of US]" Lindsey, Human Capitalism @Aelkus er not really, I spoke too soon. The tech was def a big part, but also talent. Intimately related/unclear how Google saw it exactly. @Aelkus not nec that paper per se but that demo/proof of concept was def the reason they were acquired @Aelkus yeah made/still making a huge splash. Rare for one paper to ~~~> 600 million etc @Aelkus (which contradicts what I said about 90s but I think they just want to share relatively old lessons learned and not the latest) @Aelkus will attend game playing workshop at AAAI next month prob. Much DeepMind Atari stuff. @Aelkus so according to Hassabis DeepMind is roughly going in chronological order thru history of games to test ML, in 90s now.. @Aelkus no one with power or courage at least. @Aelkus absolutely not RT @JohnDanaher: My latest paper asks whether we should criminalise robotic rape and robotic child sexual abuse? What do you think? https:/… Could be interesting (if suspect) findings there on dating stuff but I am more interested in the framing/discussion/lack thereof re: ethics. Kinda wanna hateread Rudder's (tone deaf on privacy/ethics OkCupid guy) book Dataclysm. Anyone have thoughts on it? From what I hear, v dumb RT @_TheTerminator_: @Miles_Brundage There is another chip. And it must be destroyed also. Get ready for some seriously nerdy/nerdily serious stuff on Hawking, Skynet, AI and jobs, etc. soon.... RT @googleresearch: Care for a little light reading? Check out a summary of all the accepted papers at #NIPS2014 at http://t.co/50ZUpoaQ8E RT @IBMWatson: An app with Watson technology and 9,000 recipes from Bon Appetit's culinary knowledge is available to download here: http://… RT @robinhanson: @Miles_Brundage Industrial era work is alienating in many ways, incl our putting up with more domination. A price we pay f… @robinhanson particularly interested in relation btwn productivity, basic income, and alienation being eradicable. To be cont'd by email.. @robinhanson I would like to read the people's history of industrial revolution (book title along those lines). Agree hugely beneficial. @robinhanson I will have plenty of stuff to say on your draft so might as well include a plug for that issue ;) @robinhanson fair My shallow dive has led me to think strong args for dom/alienation mattering exist, relative importance less well argued. @robinhanson if that's still too vague I will include an abbreviated case for (some) such stuff in my book draft feedback in few days :) @robinhanson clearly there are other things like efficiency to think about but just wondering about that aspect of the capitalism ethics Q. @robinhanson think about e.g. arguments for harms (domination, alienation) etc associated with work and if they have been articulated well. @robinhanson agree/that was my impression from book overview of critical theory/Marxist econ stuff but still, specifically wondering what u "RT @Curious_Kurz: Well, the torture report is out and can be summed up pretty easily https://t.co/KbvV1R3fMt http://t.co/I5lrieVbgJ" RT @Jackstilgoe: Interesting to hear Anthony Seldon talking social mobility again. Social mobility in a flatlining economy means some going… RT @Jackstilgoe: 2/2 So perhaps the solution is for Seldon to encourage some of his students to renounce their places and climb down the so… @beaucronin however, people have just been plain wrong and it is an intrinsically hard prediction/shaping/envisioning problem. Truth=middle @beaucronin and insulation for/money for scientists. Hype cycle, close enough to get $ but far so no accountability.From more sympatheticPOV @beaucronin from a strictly social scientific POV I think a plausible narrative can be made that AI futures reinforce legitimacy of + @beaucronin FHI/MIRI folks have shown age of predictor, time during which prediction made not key variables but definite mid term clustering RT @zeynep: Does WaPo have a @sulliview? That story fluffing up a troll who lives to out & prey on vulnerable people is 21st century journa… RT @zeynep: Creating ego-stroking profiles of people who've done something awful for attention, with no journalistic value added, is lousy … RT @RedScareBot: Lies and Calumny! RT @miles_brundage: @robinhanson what is your opinion of Marxist economists? Can't speak to SV but design WAY undervalued in tech MT @amcafee: human designers are now 'rock stars' in S. Valley: http://t.co/cfEXwFUELU @robinhanson what is your opinion of Marxist economists? "RT @ylecun: Wired magazine has a very nice article about Facebook AI Research for our one year anniversary. It talks about... http://t.co/…" RT @robinhanson: For most product, services, people have limited tolerance for change. But for a few, e.g. smart phones, they LOVE change. … RT @ylecun: The papers of the NIPS 2014 workshop in Deep Learning are available on line... http://t.co/WuPFj1eEmf @beaucronin question is the sweet spot btwn general ideas of tech progress and on the ground AI researchers's knowledge/reasoning re future. @beaucronin this can be fiddled w on margin but not eradicated: sufficiently advanced theory of AI prog indistinguishable from theory of AI. RT @BillGates: 5 terrific books I read this year: http://t.co/u5UNhYzb0W #Bestof2014 http://t.co/5huERDziQC Short story is that it's sort of a false distinction/there is good and important work all over the place in various literatures. Barely thought through the relationship between the literature on cognitive architectures/cognitive systems and "mainstream AI". Long story. Assumption of that approach is that all or many sub-fields in AI community matter. Doesn't account for e.g. Deep RL taking over market. The ideal would be a super rigorous yet also participatory/crowd sourced etc. model updated in real time w/ new AI progress. Hard to do. More specifically: I like that those sorts of tools for tech. prog. modeling pair well with expert knowledge elicitation methods,e.g. Delphi That curve/web analysis is only one potentially useful lens for thinking about AI progress, but it seems especially productive to me for now Little in the way of consensus about what exactly those curves are+their relationships in AI(e.g. modules, architecture, finer distinctions) Augmented performance curve analysis and trophic web analysis are cool ways of disaggregating technologies and the causes of their progress. One way of framing much of what I've been thinking about lately re: AI progress is: how many learning curves are there in AI/what are they? @SuzanneWaldman "if you're unemployed, the unemployment rate is 100%" - Biden. Applicable here. The Caprican military turns a blind eye to the fact that Graystone Industries' Cylons R based on the MCP stolen from the Vergis Corporation. @Aelkus yep @Aelkus Techno-Human Condition: increase frequency, reduce magnitude of socio-tech interventions. Daniel Graystone basically gives a Cylon a reverse Moral Turing Test to ascertain whether or not someone's consciousness is in the chip. The MCP chip underlying Cylons was stolen from the Vergis Corporation by Graystone Industries to meet an urgent military contract deadline. "The game speaks to all of us differently, changes us in ways we can't expect. Stick around long enough and it'll happen to you."Ibid re: VR RT @alan_winfield: 14 days left to comment on new BSI proposal Guide to the ethical design and application of robots and robotic systems ht… RT @_TheTerminator_: @Miles_Brundage There is another chip. And it must be destroyed also. Retweeted one of my Terminator quote bot trolls as a reference for those who haven't talked about Skynet on Twitter before... RT @_TheTerminator_: @Miles_Brundage My mission is to protect you. Skynet hardware unclear, except that its "CPU is a neural net processor, a learning computer." CPU+neural net...Neural Turing Machine? :) The meta-cognitive processor (MCP) running the initial Cylons is a better-than-today digital-analog neuromorphic chip/AI architecture combo. "I work with top secret military robots." "That's really hot." - Caprica "Are you gonna tell me now why you didn't just make yourself a better pilot?" "I set my avatar so I could acquire skills naturally."-Caprica Caprica's got everything from robots used by terrorists/freedom fighters to VR addiction. And not really the best characters ever but still. + In particular because (as @Annaleen emphasized at the time. so sad more didn't listen/tune in!) it shows the complexities of tech/society. That was re: New Cap City, a model of Caprica City in V-World accessed by Holobands sold by Graystone Industries. Love details on Caprica :) "Come on, man, get with the program. If you can't do it in real life you can't do it in a non-fantasy game. No one has super powers"-Caprica @pmarca not either/or but plenty of cases of ppl trying to bring stuff about, often w/ corruption, not just customers buying cool stuff. @pmarca History of e.g. energy infrastructure is history of gov't and techies and tycoons getting what they want, not broad based demand. @pmarca don't want to deny customers' absolutely critical role in tech change. But 1 factor model absolves techies of responsibilities. @pmarca you can look at it through the customer-as-prime-mover lens, or innovators...etc. Complex ecosystem. @pmarca what is available to be bought or sold in the first place depends on way more things than customer decisions at point of sale. @pmarca based on what data? The history of technology is a history of complex linkages of buyers, sellers, innovators, policy makers, etc. @pmarca that's a strange dichotomy... Duh tech doesn't, but innovators, business ppl, marketers, policy makers, etc. do. More on AI and printers: fair to ask why AI hasn't been applied to that/user-friendly stuff in general. But lack of effort is prob, not AI. Another way of putting that broader point is that one shouldn't confuse realized and potential intelligence. Interesting literature on this. Broader pt.: generalizable AI techniques (e.g. deep RL) can be applied to new domains/robots, etc. Not just abt knowledge, what you do w it! the nature of intelligence, which is relative to one's resources, goals, SENSORS, effectors, etc. (2/2) I don't like: "I'll worry about AIs taking over when my computer recognizes my printer." Many say this. Fundamental misunderstanding of(1/2) @KatjaGrace other factors as well, though, e.g. if pressure will be different/recalcitrance will vary at different levels. Many permutations @KatjaGrace pending editor liking it, I'll have a piece on related issues in Slate tomorrow...among other things, case for more such work :) RT @KatjaGrace: If you think human-level AI is likely to cause doom, some plausible ways to avert that doom. http://t.co/4tcYIMddQW @KatjaGrace related: how socially sustainable is stunting? Raises Q of relationship between recalcitrance and ppls willingness to improve AI Good thing there's a DeepMind-related workshop at AAAI next month/a bunch of related papers being published in the AAAI proceedings! :) Not that DeepMind etc. change everything, but they definitely seem likely to change some things, and in particular on the learning front. Anyway, lots of things *would* be useful to me/others, but I feel like that would be especially useful for thinking abt e.g. future of work. And in particular nothing on the connection between hardware futures and neural net futures. Useful futures for different areas of AI/different domains in the US Robotics Roadmap but it's pre-DeepMind/deep RL/lots of recent trends... I'd also take 15 years. 10. 5. 1. Something I'd love to have (Bueller?): detailed theory of plausible future(s)(~20 years) 4 neural nets, including software+hardware progress RT @TerynNorris: U.S. Senate confirms new @ARPAE Director, Dr. Ellen Williams http://t.co/hFtAEghNkD @Aelkus also, I like to think that's what academic Twitter is all about. Everyone is everyone's RA. @Aelkus dude, super proud of my piece. I'll send now. Phew, done with the article!! :) Thoughts on the relationship btwn short-term and long-term AI risk issues forthcoming tomorrow hopefully .. @alan_winfield @PabloRedux @jathansadowski thanks! Been thinking about how to frame for a while, will actively promote it when it's out :) @alan_winfield @PabloRedux @jathansadowski aiming for tone of long term AND short term issues mattering but clarity on timeframe etc. needed @_beenkim thanks and likewise! @cthorm @SuzanneWaldman my point is, to extent to which we think ahead/shape things proactively we have less need for "hard" restrictions. OK, I need to stop writing tweets and finish writing this article... Many of the issues that paper raises are related to those I discuss in Limitations and Risks of Machine Ethics. TL;DR ethics is very hard. This paper is one of the first formal/technical analyses of limitations on AI ethical decision-making...thoughts? http://t.co/nJcza5Ja15 @cthorm @SuzanneWaldman which I can confirm since my boss was on it at the time/I read all the emails they sent to each other :) @cthorm @SuzanneWaldman counterfactuals hard, my understanding is imperfect, etc. but relevant reports show Chu's dream team played key role @cthorm @SuzanneWaldman much more important is that BP would have completely bungled it w/o DOE help. That's insufficiently appreciated IMO. @cthorm @SuzanneWaldman that's my beef. BP's competence is separate story but good DOE experts had reason to reject. Press was like, BUT BUT @cthorm @SuzanneWaldman also a funny side of the story, not nec. twitter-appropriate/don't know if public info :) stand by what i said tho. @cthorm @SuzanneWaldman *maybe* it actually made sense/they were wrong but doubt it. Know lots of smart ppl who considered/rejected it. @cthorm @SuzanneWaldman and yes it had something to do with geology, shock waves, etc. :) @cthorm @SuzanneWaldman honestly don't remember details but ppl in press pointed to that, ppl involved saw it as disanalogous/harmful. @cthorm @SuzanneWaldman the macho factor def. played into people proposing nuking stuff and asking questions later :) @cthorm @SuzanneWaldman *not that you're advocating that... still point is, people have both irrational likes/dislikes re: tech :) @cthorm @SuzanneWaldman yeah, if done right. What many ppl were touting as techno-fix would have blown hole wide open re: BP oil spill :) @cthorm @SuzanneWaldman that being said, people proposed that for the BP oil spill and w/o going into too much detail that was bad idea! :) @cthorm @SuzanneWaldman was just thinking about that the other day. Nukes are one of only readily available options for stopping asteroids. @PabloRedux @alan_winfield @jathansadowski /more generally how to seriously prepare for the future of AI without freaking out about it :) @PabloRedux @alan_winfield @jathansadowski Indeed. I will have some stuff to say soon in Slate on thinking about risks comprehensively. RT @SuzanneWaldman: .@Miles_Brundage Indeed. If there's one essential book for the twenty-first century, it is *The Technohuman Condition* … @SuzanneWaldman great book, right!? :) I will have some stuff to say on technological risks, uncertainty, and robustness soon... @SuzanneWaldman I am strongly in the camp of proactively shaping what techs become (X better than Y AI design), not banning bc Y possible. @SuzanneWaldman exactly. We're on the same page, different emphases :) @SuzanneWaldman out of the space of possible technologies, maybe only some fraction should be pursued. Fortunately ppl pick mostly ~safe 1s @SuzanneWaldman + spend all their time making dumb/super dangerous (even if not weapons per se ) things. Society's job to make sure tho :) @SuzanneWaldman I'd put the point abt weaponry somewhat differently... most scientists aren't horribly unethical/stupid so they don't+ @PabloRedux @alan_winfield @jathansadowski some new ideas but more importantly it synthesizes their work/others' in coherent framework. @zeynep probably just wishful thinking (/if people specifically chose not to watch the video, that's bad too, etc.)... @zeynep haven't looked at the poll methods but at least in other public opinion polls, I wouldn't put it past lots of ppl to lie/extrapolate @zeynep I might be slightly less outraged to the extent sheer ignorance and not exclusively prejudice etc. was a contributing factor here. @zeynep wonder what percentage of people actually watched Garner video? Not that that would be a good thing all things considered, but + @Aelkus you'll like my Slate piece. Hawking, Skynet insurance, etc. @Aelkus over my head, maybe I'll catch up on Gundam someday. Plan to someday take more systematic approach to AI-sci-fi consumption. @Aelkus speaking of which, Big Hero 6 takes place in San Fransokyo and features robot fight clubs, STEM stuff/nerd pride, lots of robotics. @Aelkus exactly, it is super common for it to be portrayed as a benign, useful, maybe kinda funny/silly/crappy technology. @Aelkus I've hypothesized before (no time/effort spent following up) that most AI portrayals are in non-AI focused movies and positive. RT @zeynep: On Facebook, Sudanese friend can't use her real name because Facebook thinks it's fake. No, FB, whole world doesn't just speak… @alan_winfield relevant to robotics/AI and codes of ethics - highly recommend this to you/others http://t.co/VNIrFvX6gZ h/t @jathansadowski RT @csandis: Seinfeld meets Zizek: http://t.co/N9MlZjQPIs Could go on long rant about why I don't like the name..."sentient" is ambiguous, people will overinterpret it, etc. You prob. get the idea. Haven't given Sentient AI (hyped AI company) much attn yet, but for now, I hate the name but think Cheyer (Siri) is no one to sneeze at. :) RT @alan_winfield: Robotics needs to get Political: http://t.co/SS5iGodKHD from debate w. @Frances_Coppola @TimandraHarknes @martynperks @k… @riddle @elonmusk I'm working on my own article on such things, bored of waiting, hopefully @elonmusk will read it ;) Bit heavy 4 lay person who would benefit more from a lighter introduction to neuroscience but accessible for jargon-comfy brain enthusiasts. Still early in @GaryMarcus/Freeman's Future of the Brain...impression: fills niche 4 readers on spectrum btwn neuroscience expert/lay person RT @riddle: @elonmusk Didn’t you want to write a blog post with your complete thoughts about AI, singularity and robotics? A subset of the AI progress and societal context modeling problem is: which jobs are safe from strictly economic POV. Theories 2 ad hoc IMO. RT @elonmusk: Dune series by Herbert also brilliant. He advocates placing limits on machine intelligence. I don't have all the technical details worked but I do plan to bring the audience up to speed on state of the art/tools in tech prog models. Can't fit everything I have to say on timeframes/AI progress in the piece I'm working on - for technical details go to AI/ethics workshop :) @beaucronin yup @elonmusk writing some stuff on DeepMind, you, scifi, and future of AI you may be interested in :) RT @elonmusk: Reread Asimov's Foundation series. Brilliant. RT @dl4j1: Our first screencast covering how to run #deeplearning examples in DL4J is up! http://t.co/Q4Pa6eMtQB @_beenkim among other things..but, def some stuff relevant to your research @_beenkim btw if interested I have a paper on the economic/social/ethical context of usable/comprehensible AI :) http://t.co/qBK4afmV8B RT @_beenkim: How can we make machine learning explain itself to humans? Come to poster M93 today at 7pm #NIPS2014! More on: http://t.co/W… @_beenkim wish I could! Will you be at AAAI 15? RT @nathanjurgenson: facebook thinking "graph search" would be popular captures how they misunderstand sociality through the eyes of an alg… RT @nathanjurgenson: facebook's entire premise is to treat sociality as 'content', searchable, rankable, and algorithmically sortable RT @nathanjurgenson: generally like google sorting search results, amazon recommending stuff. the sort-fatigue happens for me when it's soc… Finally putting pen to paper on some thoughts on Hawking/Musk et al, civilizational robustness, and the future of AI...stay tuned :) First superhuman visual pattern recognition result in 2011 traffic sign recognition competition. Important for autonomous cars- Schmidhuber ...cuz back propagation is "3-5 decades" old and pattern deformation, the other key part of a winning 2010 neural net, is also 2 decades old Ibid. He's certainly not saying algorithmic progress is unimportant, just specifically interpreting backpropagation's recent success. (2/2) "these results seemed to suggest that advances in exploiting modern computing hardware were more important than advances in algorithms"(1/2) Another way of putting my last few tweets: the generality of, e.g., deep reinforcement learning has implications way beyond Atari games. And conversely, much "shallower" AI approaches like logic can be applied to super important/highbrow issues (w/ right prior assumptions!). #NAME? On deep neural nets and the stuff they represent... tempting to think deeper correlates w/ intellectual/high brow/important/executive level+ SL=supervised learning, BP=back propagation, FNN=feedforward neural network...sorry, that paper uses a lot of abbreviations. Slash jargon. Paragraph length summary of the history of deep neural nets vs. the term deep learning. Schmidhuber/Ibid. http://t.co/aZ8tly7zGc TL;DR of Schmidhuber's review of deep learning: part of super long neural net history with lots of soft/hardware improvement. Term is recent Letters, images, and scenes are just examples in rough order..point is, faster computers will indirectly enable representing richer concepts Faster G/CPUs helped w/ the qualitative leap in neural nets from recognizing letters-->images-->scenes. What's possible w/, say, 1000x more? "In general, [recurrent neural networks] may learn to solve problems of potentially unlimited depth." - Schmidhuber/Ibid. Hardware critical. Schmidhuber on the relationship between hardware and deep learning success in the 21st century. http://t.co/5vtXsUK2EH Epic review of deep learning, Schmidhuber (2014) http://t.co/9pTE94onNG Pretty technical at times. Most detailed overview I've seen so far.. "let me just define for the purposes of this review: problems of [neural network] depth >10 require Very Deep Learning." Very deep indeed! Some seriously nerdy neural net jokes in the preface to Schmidhuber's deep NN review paper... he seems funny based on this/his lectures. RT @alan_winfield: Robotics needs to get Political http://t.co/SS5iGodKHD @SimonWierny @alan_winfield spoke too soon :) Anyway, would welcome your thoughts @alan_winfield if you take a look at it. Up your alley. @alan_winfield I have a new paper that's related - specifically to the part at the end about the market: http://t.co/qBK4afmV8B Those aren't mutually exclusive..it surely didn't hurt that it was DeepMind/brain-like-computer-sounding. Just not sure who's excited abt it Or did it just get disproportionate attention relative to other AI progress stories cuz it sounds brainy/was related to DeepMind? In contrast I totally get the hype around deep reinforcement learning/DeepMind... am I missing something re: Neural Turing Machines? Not that it necessarily needs practical uses...it is a theoretical concept... But it was hyped a lot when it came out, not sure why... "Someone please tell me what to think about Neural Turing Machines :) Reading the paper it seems interesting, dunno bout practical uses.." More to planning than loops though :) Nice ref: Talamadupula et al. on the various types of planning in robotics http://t.co/qJuUARU11H The details on implementation in that paper unfortunately leave much to be desired :/ it's all about the proofs. Will attend talk at AAAI :) Learning and managing sequences of such loops, in turn, is part of the broader open world AI planning problem with laundry as a special case What they mean: people good at doing quasi-repetitive stuff without getting stuck forever/failing, paper abt AI/bots learning such "loops." Srivastava et al.: "intuitively, [ppl] construct cyclic plans with strong guarantees of correctness and termination"(when doing laundry etc) #NAME? Another noteworthy thing about that paper/the coverage of the laundry robot aspect of it is that, as is common, the AI is *close* to being+ Not to mention it's often cited as an example of the current shortcomings of AI/robotics - "you can't get a robot to do the laundry/dishes." Very interesting to see the laundry problem being taken so seriously as a challenge problem for AI. Makes sense...it's hard and practical. = non-technical gist/context of the paper from the intro (end of last sentence: "robot to actually do the laundry." http://t.co/VelDvo34G0 "Doing the laundry...represents a challenging planning problem involving partial observability, non-determinism, and unknown #'s of objects" +part of broader goals. Humans good at it (laundry breaks down into pick up clothes, fold, etc.). Paper abt learning em from examples. Much of it's technical but the intro/conclusion gives the general idea: "loops" in this context = part of task repeated uncertain times as+ For the AI folks... Tractability of Planning with Loops (basis for that Berkeley laundry robot story) is an interesting and ambitious paper. @jathansadowski mind sending me a copy of your new paper if not too much trouble? @jathansadowski some day maybe the day will be right ;) @jathansadowski he agreed I had a good case but popularity was an issue. @jathansadowski not a full proposal, just an exploratory email to an editor as was the protocol I gathered from a bit of digging. @jathansadowski Nice/congrats! WIll read both. Johnson and Noorman have both written great stuff on related issues, sure it's worth reading. Problem is, it's not popular enough for a X and Philosophy book (I tried :) ), or references in popular pieces, so not much written on it. I think it is worth working one's way through/rewatching. I have enjoyed it more every single time I've watched an ep. SO relevant to today. Can offer more tailored cajoling if e.g. you think the beginning sucks/is worse than BSG, which I'm sympathetic to in some respects. Still.. Have said before but will keep saying it until I have someone to talk about it in more detail :) Caprica has interesting tech ethics stuff!! Almog's piece on Blade Runner emphasizes that AI/robotics being in early stage makes it interesting. Agree! Also Caprica, I think, wrt BSG. @Aelkus this one isnt non sequitor - related issues to the book you mentioned in context of competing DARPA challenge http://t.co/an1a015DZ3 @SuzanneWaldman @JesseJenkins we should discuss solar again when I have read that paper. A few other stuff to get out of way first :) @Aelkus last quasi non sequitor: the book Positive Computing has a rigorous framework. Not exactly same as other stuff discussed but relev. @Aelkus more general pt: occasionally u see eg. AI equivalent of lesion studies to show X Is important. maybe not used enuf/under theorized? @Aelkus http://t.co/GuresvDtT4 @Aelkus maybe also help; stuff on specific aspects (practical books/articles on neural nets etc) of AI with generalizable lessons-reuse etc @Aelkus seen Paul Cohens book on AI evaluation? on my to do list, he has article length versions too. @Aelkus tons of relevant literature, ideas (ergo, design, human factors, human-centered/adaptive autom.), less handle on theories/frameworks @SuzanneWaldman @JesseJenkins for real tho I get there're huge transmission and other issues what I said raises. 140 chars maybe not enuf :) @SuzanneWaldman @JesseJenkins :) @SuzanneWaldman @JesseJenkins different in that I see what's possible but not that Arizona is the only place with solar resources like this! @Aelkus others superficially similar in scope, see ex stuff w the buzzword joint cognitive systems engineering...will need to see details @JesseJenkins @SuzanneWaldman my point was also def not that price is low enough everywhere. But I expect/advocate epic desert solar boom. @JesseJenkins @SuzanneWaldman point wasn't that price is low enough for all time. But lower than appreciated and good deal from broader POV @JesseJenkins @SuzanneWaldman it matters but so could massive govt purchases of clean energy, carbon price etc :) @Aelkus indeed!! @JesseJenkins @SuzanneWaldman looking forward to hopefully being corrected :) @JesseJenkins @SuzanneWaldman I haven't done much reading on scenarios but from what I have seen most assume solar limits I am skeptical of @JesseJenkins @SuzanneWaldman indeed, as fully baked as I could handle in a few tweets and I haven't seen the paper yet. /more generally @JesseJenkins @SuzanneWaldman I tried once but paywall stopped me. send to miles.brundage@asu@edu? @JesseJenkins @SuzanneWaldman btw disagree about "a lot." Taking externalities etc into acct I think overall Solana is steal :) @JesseJenkins @SuzanneWaldman hard to compare bc premium for baseload but I don't sneeze at PV either. Just know more bout thermal myself. @JesseJenkins @SuzanneWaldman indeed, we referred to that early on, BPC was involved, prob familiar faces.. @JesseJenkins @SuzanneWaldman it'll get cheaper, so will PV, dunno bout power tower but anyway that's my short critique of solar assumptions @JesseJenkins @SuzanneWaldman yeah there aren't thousands being built now but true of nuclear too. Solana lesson- in sunny places tech ready @JesseJenkins @SuzanneWaldman BUT having visited multiple times/knowing broader context IMO it's milestone showing big baseload solar works @JesseJenkins @SuzanneWaldman don't wanna attribute too much significance to Solana, power tower also hot/Solana part of long history... @JesseJenkins @SuzanneWaldman http://t.co/YNCG8l8QqO @SuzanneWaldman @JesseJenkins btw Yall may like that book - all case studies on energy innovation and govt. @SuzanneWaldman @JesseJenkins or so I hope :) @SuzanneWaldman @JesseJenkins 4solar thermal in particular (I have a book chapter on it so know more ;) ) storage is new normal post Solana @SuzanneWaldman @JesseJenkins so, I don't assign much weight to greens having rosy views of EE. Not rosy enough re: solar anyway :) @SuzanneWaldman @JesseJenkins nice post. Agree on EE but think solar potential way bigger/way sooner than any scenarios I have seen. @Aelkus @selil cool @Aelkus useful for AI specifically? RT @leabajc: What if new technology only bakes in and amplifies current inequalities? https://t.co/UL1zZcisgb #bigdata #hiring #education #… @leabajc think ur link was broken by an extra "s" at the front fyi :) @MarkMuro1 that is aimed at/focused on AI people's role in particular, doesn't discuss as much what gov't etc should do- related though. @MarkMuro1 "may" is key word :) I discuss related issues and consider how to bring this about deliberately here FYI http://t.co/NW01PrWy1K RT @MarkMuro1: Tech has contributed to inequality, says @tylercowen, but it might eventually also reduce it http://t.co/yv1HT1hMtq @erikbry… @Aelkus @j2bryson besides knowing @j2bryson has written some related things, not sure :) Lots of complexities re: industry-academia-gov't relations in AI, and capital DOES matter, but not as much needed as other tech examples... You hear an utterly different story on the importance of the valley of death, commercialization etc. from e.g. energy tech v AI researchers. A related point to my last tweet is that (AI ppl say this to me all the time, now I'm getting why) the transition to market is smoothish. Relative to other sci/tech domains, AI is one for which capital matters least, ideas matter most, and industry-academia links are strongest. @PabloRedux Sargent's Short Intro to Utopianism gives taxonomy of uses of utopia: model for future, critique of present, few more. Cool book @beaucronin @mshron talking about this http://t.co/Ye18jGlE2E @beaucronin @mshron recommend browsing at least for the lulz...super densely cited paper @beaucronin @mshron im gonna read Jurgen Schmidhuber's overly epic literature review on deep NNs soon, will let you know any insights gained @robinhanson gotcha, thanks! @robinhanson yeah I was thinking for humans :) what do u mean by need borders, for determining who to give $ to? no global basic income? @robinhanson what do you think of steadily rising basic income as AI/bots policy response? sorry if I asked/you already answered this.. RT @wef: Does technological innovation increase #unemployment & reduce wages? @JosephEStiglitz http://t.co/gazWQ6zAZU #robots http://t.co/3… We need to be able to rapidly create, negotiate and communicate coherent models of our dynamic societies and their priorities"@j2bryson/Ibid AI and Pro-Social Behavior - by @j2bryson, lots of cool ideas here on social modeling, AI progress, AI ethics etc. http://t.co/HEcY6n4R7J Also themes of nerd pride, STEM education's importance, etc. Nothing new on innovation ethics: TL;DR don't let evil ppl steal your tech. :) The movie Big Hero 6 involves advanced cloud robotics, soft robotics, microrobots, + brain-machine interfaces. Oh, and good family fun :) RT @peterjcook: Great @tylercowen article on the potential for technology to fight income inequality -- http://t.co/4EFfNS34yC I discuss many of the same issues as @tylercowen in his great oped in my paper on AI + the future of work/ed/leisure http://t.co/NW01PrWy1K @Aelkus on bricolage, seen that paper on atypical combinations and scientific impact? :) @Aelkus yeah we should exchange notes/drafts perhaps, related themes... @Aelkus working on own piece on Hawking/Musk. whatcha thinkin about? @paulonabike ohh nice. Thanks! @paulonabike even more specifically (not expecting this in a book, would be nice tho): does bot growth worldwide close off labor options? @paulonabike most interested in: where is automation (not) happening/why + how does it affect prospects for broad based dev world GDP growth @robinhanson fair. Guess I think they're correlated. I don't know which way both will go, though. Hazy still on some tech/societal factors. Does anyone know of (/have any of you written :) ) good stuff on the relationship between automation and developing country economic growth? @Aelkus @treycausey any in particular? I get value from MOOCs tho one can only learn so much w/o solving problems, tempting to just watch :) Given the most thought to the application of the methods I was just talking about to AI and work, hopefully it will be broadly useful though @Aelkus Thanks! Much to flesh out but that's what I've been thinking about lately. Thoughts welcome :) Goals a la Lempert et al. (2003): imagine futures w human (narrative, risk IDing, ethics) machine (stress test billions of scenarios) skills In particular I'm thinking about the connection between specific futures and scenario methods and models of AI progress w/in societal models Much progress in recent weeks (/esp days) on selecting/adapting methods applicable to modeling progress in AI. No model of PhD progress yet. "RT @RichardSocher: We are live! :) Train your own deep learning classifiers via our drag,drop & learn demos http://t.co/f76CnVPcaB" @beaucronin or at least, a good way. Not that way :) @beaucronin I do think that sort of detailed scenario analysis has a lot of value, but it has to be framed in the right way. ...which is precisely the sort of analysis I wish Singularity is Near had done....anyway... Don't think Kurzweilian Singularity is likely/default, but point is if you change one thing, ex. human-AI merger, house of cards falls apart Much of Kurzweil's rosiness depends on incorporating AI directly into our brains to keep up. Otherwise no good reason we remain in control. That being said, a TRULY TT-capable AI could improve (either autonomously or w/ human help) beyond average human level. Kurzweil vague here. (I don't actually think we will pass a fair Turing Test anytime soon/hope we don't, that'd be a huge waste of time/resources vs. useful AI) People say he says the Singularity occurs in 2020s. Really he thinks that's when AIs pass TT then for vague reasons don't quickly surpass us Kurzweil says Turing Test late in 2020s, then full-blown/real/etc. (vague) Singularity in 2040s. Both flawed but at least get em straight :) That quote gets to the core of a lot of hype/hope around deep learning: shared representations for a bunch of tasks/modalities/agents. Hard. (full end of that quote) "in one coherent semantic framework." "hope that the models in this thesis can be extended to eventually jointly model language, images, and knowledge bases in 1 framework"Socher I remember being surprised that the results were so good and impressed at the elegance of the way meaning was learned, but need to brush up. Only know a bit of the details but basically Socher's dissertation was on using neural nets to learn a bunch of NLP tasks automatically/well One thing that doesn't come through in MetaMind article is how innovative Socher's work is - will be interesting to see if it is made free! Wonder if there is a measurable statistical effect of companies being valued higher with the word Mind in the name. VCs want next DeepMind. Everyone and their mother is starting an AI company with the word "mind" in it (DeepMind, SkyMind, MetaMind). My ideas: OpenMind, DataMind.. Kurzweil is more on the "prophet" end of the spectrum than "futurist" IMO not because of the content of his future but b/c there's only one. Lots of foresight/futures/scenario etc. methods/practitioners, obvi., but ppl say "futures studies" not "future studies" for a good reason. The irony in ppl calling Kurzweil a futurist is pretty epic... Laying out one specific detailed future is everything futures studies opposes Good article on MetaMind http://t.co/2lK3aHheQ6 … Agree w/ last part on Socher - really enjoyed a talk of his on NLP once. Very cutting edge RT @etzioni: New Startup Sets Out to Bring Google-Style AI to the Masses | http://t.co/v2lwQ1UIh1 All that being said I haven't actually cooked anything based on it yet. Will soon. But they're firmly rooted in the ingredients you give and various other preferences you can modify in real time so easy to iterate recipes. The ingredient combinations often sound strange/gross, which I think is kind of the point (add value via out of the (human) box combo ideas) Impressed with the Chef Watson interface/overall flow, speed. and coherent recipe construction. They all look very fancy. Bad recipe names. Preliminary impression of Chef Watson beta is it's very cool but gotta run so have to stop playing with it... @jathansadowski as I briefly mentioned yesterday, she is a/the master of plausible speculations. Re: telekissing, I've already telehugged :) The third issue of the Journal of Responsible Innovation is out: http://t.co/bM6GaxeaBm Moore's Law continued despite soaring R+D suggests recalcitrance of problem rose, given certain assumptions. Unlikely in AI for a while IMO. One of Strumsky et al's more interesting pts is despite increasing rate of recombination v novel patents, tech search space still exploding. Anyone else get this Chef Watson beta invite? Wondering how big of a blast it was/why I was selected. Trophic level/augmented performance curve analysis of tech: disaggregate tech into complex ecosystem w multiple learning curves - Strumsky Drawing on other disciplines/frameworks/tech cases in my AI progress modeling work, but some differences. More abt ideas, less capital/scale 1 point she made that really resonated was the importance of confidence intervals in tech prog models. She/colleagues pioneering such stuff. Learned about state of the art in technological progress modeling from Deborah Strumsky. She's working on cool stuff: http://t.co/6M8NKejKKc @icowrich didn't mean to say tech/automation irrelevant. Net impact on employment could both more or less than 50% depending on many things. Obvious to many but it bears repeating: even if half existing jobs could be automated in 20 years, that doesn't nec. mean 50% unemployment. RT @louiseadennis: First Verifiable Autonomy meeting: http://t.co/H0DPSCo7my with @alan_winfield and @OwenMcAree @jathansadowski more to say on that specific connection of ppl and ideas soon. Hope he doesn't see that and retweet it for the lulz... Sidenote: beware that if Elon Musk ever retweets/mentions you on Twitter you will get updates about ppl favoriting it for weeks. Gets old. @j2bryson my hunch is for lay people the mode response is 0/1... @j2bryson yeah, I'd say a decent chunk I could learn plenty more abt w/ time. Main uncertainty is re what applications Google et al envision @j2bryson :) RT @alan_winfield: Gosh. I've been quoted in @WIRED here: http://t.co/iiRzCM6qbK @uwebristolnews @PabloRedux the former is something Demis Hassabis discussed briefly in his interview at MIT Tech Review. @PabloRedux the ideal would be biodegradable, self-organizing, renewably sourced solar powered robots. @PabloRedux yes. We do not want coal powered robots. I ask cuz I'm working on an article on related issues, wondering what would be useful to explain/clarify w.r.t. Hawking/x-risk, state of art And if the number is lower than you want, what specifically would you want to know? On a scale of one to ten, how much do you feel you know about how DeepMind, Watson, and other state of the art AI systems work? @PabloRedux I've spent a decade+ on energy/climate issues so have my own ideas about how AI could help w/ that ,not only impt issue tho :) @PabloRedux think this will be big discussion at AAAI workshop... or at least I will try to make it one :) which applications most impt? etc @PabloRedux related to 1 of my preoccupations now. How far can narrow AI, big data etc. be pushed, tasks simplified to fit AIs in jobs, etc? Alright, for my next article I'm gonna have to read that whole Schmidhuber review on deep learning. *gulp* Should be super interesting, tho. Margaret Atwood on robots http://t.co/UcwExVyUqF She's a master of speculation. Re: tele-kissing: I've already tele-hugged someone via robot RT @EvanSelinger: . @MCoeckelbergh, a very good Philosopher of Tech, argues Hawking's end-of-the-world AI worries are a distraction. http:/… Someone, please set me straight on Terminator issues. I'm a novice on such things. BSG and Caprica are a different story, I like to think :) I'm not sure they adequately address the paradoxical and other aspects of time travel, though, and how that relates to Skynet's initial dev. My understanding of T3 is that Skynet's a US military-built superintelligence that scares humans w/ a computer virus so they give it control Then again, with all the time travel, and this view of time travel in the new trailer, I really don't have a good handle on Skynet's origins Those parts are often glossed over. Still, it hinges on time travel securing Skynet's decisive strategic advantage. Not sudden innovation. Terminator: Sarah Connor Chronicles is more realistic in many respects than the movies - Skynet securing rare metals, energy, information. @Aelkus also interesting case study cuz it involves an intelligence explosion and depicts in detail. =Rare. Usually before or after, not mid @Aelkus you seen Sarah Connor Chronicles? I enjoyed it/thought that made a little more sense than this trailer seems to :) @jathansadowski going through walls, being invisible, etc. piece of cake. They really don't use their innovations responsibly. @jathansadowski even if they couldn't solve poverty, many mutants could e.g. assist a worldwide coalition in peacefully taking down N. Korea @jathansadowski yup, that was in the back/front of my mind :) Same applies for a variety of heroes with different sorts of powers, I think. Whenever I talk about Skynet/Terminator, the first responses are always from Twitter bots slinging Terminator quotes. Stranger than fiction. Lack of realism in sci-fi/fantasy cuts both ways, though, w.r.t. catastrophic risks +utopianism. Magneto could run mega-turbines worldwide. Also, I love that Skynet is the name of a successful Starcraft bot. So appropriate. Agree with Dudek that Skynet is very inefficient. Really bugs me. Robocalypse's Archos makes (/has) more sense in regard to killing humans. "If I was an evil Skynet [with liquid metal skills, I'd make] ball bearings and make them fly through [everyone]." http://t.co/cB28aEdyYd @amyleerobinson @MIT not mutually exclusive... intelligence and propensity to boredom/resenting being enslaved needn't correlate in AIs :) RT @karaswisher: new terminator movie trailer! https://t.co/6nqdjBQ0Kn @petitegeek I think you (and I when I get past the intro) will love it :) seems as high quality and comprehensive as I hoped/as advertised. @petitegeek I'm juggling many books right now so don't get your hopes up about more details just yet ;) Loving it tho! 2 many epic books :) Lots of discussion of the ethics, hype (ex. "well washing" = wellbeing hype), funding issues, other tricky aspects of "positive computing." Barely started but impressed so far with book Positive Computing: coherent framework, lit review, caveats on tech/wellbeing/design issues... @PabloRedux more detailed theory and ethics, less economic stuff @PabloRedux even higher level analysis @PabloRedux Brundage (forthcoming) can be found on my website :) @PabloRedux I tried to raise a huge number of caveats/complexities but can't do em all. Prob hubris on my part in scoping paper :) @PabloRedux yes, I def paid a price in specificity/relevance by trying to lay out general agenda. Big differences across countries etc Very Nicholas Carr/Glass Cage sort of case for human-machine dialogue in this WatsonPaths paper. Interesting stuff http://t.co/KpcfifXPqY "In a fully automatic system, user receives answer using little or no time or cognitive effort." In collaborative, more effort/better answer "We suspect... in many applications of Q+A, [better answer after dialogue w Watson] will be attractive tradeoff 4 user" - WatsonPaths paper. Bit of a simplification but that is really the basic idea of RL - learn state-action-value triples from experience, try stuff out, improve. Basically what DeepMind is doing is testing AI versions of this guy https://t.co/GO5ZZmtTmv + neural nets, learning from human reward, etc. RT @michaelcrow: My @CNN op-ed w/ Mark Becker on college value & the need for more equitable access to #highered. http://t.co/9mIZWmR4F9 #C… Watson researcher Erik Mueller has lots of cool books... this one's on a model of daydreaming http://t.co/sqgqvjw3X0 other on commonsense. "The book" on reinforcement learning (Sutton/Barton) is free online at http://t.co/4FVJVKUceL including draft of new version. RT @deray: Eric Garner's last words. Read them aloud. This. Is. America. #EricGarner http://t.co/vjTHSPpJmg @nerdsrocket did not know that, thanks. "increased [AI] generality affects the reward engineering task by making the agent’s behavior more diverse/less predictable" - @danieldewey You probably wouldn't want a superintelligent amoral reinforcement learner running around - @danieldewey's paper http://t.co/tBzYob08qS IMO reinforcement learning is one of the easier and most intriguing sub-fields of AI to learn the core idea of, def. hot right now as well. ...in case anyone didn't know. Maybe it was already super well explained elsewhere, sorry if so :) Deep reinforcement learning (DeepMind's first big paper/demo) is basically that plus neural networks for learning to represent the world. Video explaining the Q-learning algorithm in reinforcement learning well (building block of DeepMind) w/ live humans https://t.co/GO5ZZmtTmv RT @brookejarvis: It's easy to read #EricGarner's final words and feel like he's speaking for thousands http://t.co/L6EeCCVbs1 RT @cthorm: @Miles_Brundage Caprica deserves a real reboot. You listening g @Netflix? Daniel Graystone has a (non-human looking) Cylon rip its own arm off to demonstrate to his board of directors that it has no rights #Caprica YES! PR2 [slash team at Berkeley. More about the software/AI than robot] Very Close to Completing Laundry Cycle http://t.co/nsOzH508YU … Insert caveats about it just being one cell, not economical, etc. but still cool. Soitec announces record 46% efficiency multijunction solar cell, think they can reach 50% (!) http://t.co/OJ11eyp2Pg @CharleyDrums not in all areas though or I would be more worried...Not in the hard parts of AI I think unless something huge I don't know of As far as optimistic scenarios for robotics, no contest: Asimov wins by a mile in variety, quality, novelty, and inventing the word robotics @CharleyDrums fortunately threat not existential now/foreseeable future contrary to @elonmusk. Agree ppl should know about AI!! Occupy AI :) As far as robopocalypse novels go, my favorite is probably Robopocalypse :) Film/TV=different story. Robopocalypse movie endlessly delayed. RT @CharleyDrums: @Miles_Brundage it all seems to be pretty scary. Things that pose existential threats might be considered for mandatory p… Supposedly he will clarify this "soon" ;) MT @CharleyDrums @elonmusk what exactly is terrifying you about AI? Should it be public knowledge? RT @thiapax: KNOW Justice, know Peace. Hit the streets, NYC. http://t.co/3LXfjgk0qW Now would be a good time to bone up on some surveillance studies literature... recommendations welcome. RT @OUTERNATIONAL_: "IT ENDS TODAY!" Eric Garner's last words. NYPD murdered Eric Garner...Now, no indictment again. INTO THE STREETS! #Eri… RT @MarkHarrisNYC: Next time you try to get out of jury duty, think about who might be taking your seat. @mshron @beaucronin this seems more polished if not Deep RL though http://t.co/IgPuyxDB6C @mshron @beaucronin I haven't actually messed with it, maybe it doesn't work yet, but I like the idea https://t.co/UZaC5JX9qm @mshron @beaucronin would be interesting to take a systematic look at all theri stuff, not just Deep RL, and plausible e.g. apprenticeship L @mshron @beaucronin ppl already replicated Deep RL and open sourced it. Seems viable to do same for some other DeepMind stuff, lotta work @beaucronin k let's discuss that and broader stuff besides just prob. prog. at some point not on twitter :) not urgent question on my part @beaucronin @mshron Bit of moving target too. Besides challenges in representation learning, now there's deep RL. Soon, deep apprenticeship. RT @beaucronin: Needed. Who? RT @mshron: Anybody know of a sober review of how far deep learning might go? Keep being surprised, don’t want… @beaucronin @mshron @GaryMarcus I am also looking for additional resources on that question. :) Algebraic Mind is what I was referencing. @beaucronin @mshron @GaryMarcus framed in terms of neural nets/few years before deep learning got so deep but lots of relevant points. @beaucronin @mshron @GaryMarcus has a book on some aspects of that question. @beaucronin could have gotten it to work eventually with some elbow grease, just wondering if that vs. other open source AI stuff worth time "RT @jathansadowski: I'm thinking my locations will be: 1) home 2) transportation 3) work 4) public places (e.g. street/park) 5) social spac…" RT @jathansadowski: Next week I'll write 5 place-based episodes (≥500 words) over 5 days, which tell a day in the life story of a near-futu… @beaucronin recommend either? Tried briefly with Alchemy API but ran into my usual suck at command line issues @beaucronin sidenote, I have a pretty superficial understanding of cost disease arguments. Recommend stuff directly or indirectly related? @beaucronin much larger fraction of "jobs" can be done by bots if ppl have low standards @beaucronin one factor in particular I would love to see more rigorous evaluation of is people's extent of caring if a robot does a bad job @beaucronin exactly... IMO not really any fact of matter. Depends largely on investments, good AI ideas/collab, policy, consumer standards @beaucronin there's also Larry Page's pt about people not appreciating AI will make stuff cheap. From him, a bit rich maybe, but truth to it @beaucronin big question about when, who, open vs. closed, quality, options, services, etc. but the writing's on wall Software key. @beaucronin there's a new book on history of smartphones. skimmed at bookstore, last chapter briefly says -maybe AI is next big thing? YES!! RT @romanyam: Google is making a lot of progress in AI lately ...... http://t.co/lgwOkkK710 RT @sickjew: #EricGarner http://t.co/ntYHz60HOD Seems like a big theme of the AI and ethics workshop (definitely in my talk, Manuela Veloso also) will be shaping, not predicting, future. Anyone used the open source probabilistic programming language Figaro? Sounds a lot like Alchemy API, never used either, though... And of course I'm only talking about one very specific interaction btwn people and AI (AI as personal assistant), not broader context. Still The really key word in my last few tweets is "marginal". Not denying rich people will benefit, but asking how much/in what specific ways. RT @katecrawford: No charges in the Eric Garner case. Using a banned chokehold. On camera. Now tell me police body cams fix everything. htt… A rich person can just pay for an assistant. A poor person can't. Is super high quality free AI a viable alternative? Not now, maybe someday It's really a point about control over one's information flow/sphere and how AI could help so that you can focus on what you want (ideally). +at least in terms of wellbeing, perceived autonomy/control over schedule, health, etc. if not in terms of e.g. money-making ability (2/2) What I meant by that thing on cognitive burdens is that the marginal benefit for poor person of good AI may be higher than rich person (1/2) Also risks of it running in the opposite direction (which I mention in the same sentence) :) but should take upside seriously as well. serve as an "equalizing force by disproportionately benefiting those most cognitively burdened by scarcity of time and resources." (2/2) RT @etzioni: @paulgallen gives $5.7M to top AI researchers http://t.co/7DVcW59dkv. My blog post here:http://t.co/QZWMFSkwAo @PabloRedux thoughts welcome! @PabloRedux http://t.co/qBK4afmV8B Point I made briefly/without adequate justification in my new paper, but would love to explore more: widely available good AI could (1/2) This Bruce Willis robo-paradise movie seems like it has elements of Surrogates (inc. BW himself), Gamer, Elysium http://t.co/l0tUfQX0Jt Deep learning and apprenticeship learning are both not new, but deep apprenticeship learning could be cool. Deep RL sure was... This is epic. @aeonmag "A stunning vision of the possibilities of humanity’s expansion into space" http://t.co/W3ZjATqhIH "Deep Apprenticeship Learning for Playing Video Games" that one prob. intrigues me the most. Human-in-the-loop learning SO key long term. "Reinforcement-Learning Evaluation for Better Generalization" "Generating Real-Time Crowd Advice to Improve Reinforcement Learning Agents" Some cool/important sounding submissions at the DeepMind-centric workshop on general game playing AI at AAAI 2015 http://t.co/TE1yKyz0uZ @rcalo still wish I had more to say on the emergence thing w.r.t. different types/technical reasons/ethical implications but not yet :) Moshe Vardi is leading a tutorial on technological unemployment debates at AAAI 2015. Lots of cool stuff going on there this year it seems. Walsh TL;DR - let's talk about risks related to AI, jobs, and increasing rate of return to capital, not just it not murdering us. Agreed :) "This [AI/work] is the sort of serious debate that we need to start having soon for it will impact on all of us"Ibid https://t.co/VuwaI5LJha This. "Actually my suspicion is that [contrary to @elonmusk's fears] AI's biggest threat is to your job"- Toby Walsh https://t.co/KNlMXuIwUi RT @ScienceGroen: Holy living shit, this NASA press release. http://t.co/Nj989KHxAD "RT @MikeAaronson: Recommended: 'Robo-Wars: The Regulation of Robotic Weapons' Policy Brief from Dr Alex Leveringhaus @oxmartinschool http:/…" @Aelkus I lol'd @Aelkus or rather i just got notice they'll be due soon and I have other things to do besides hastily read em... @Aelkus buncha textbooks I rented just came due, I'm dying @beaucronin thoughts welcome if you slog through it, not super user-friendly... @Aelkus as in no more or no less than 3? Also, yeah agree on FOCA. Learned a lot from it but esp. loved demos, best in class. @Aelkus though if money is no object, AI:MA 3rd. edition seems like far and away the best in almost all ways if you had to have one, no? @Aelkus Foundations of Computational Agents is solid, free online legally, has fantastic demos/learning tools, good ethics stuff (1/2) @Aelkus super under-valued IMO RT @bengoertzel: Stephen Hawking TL;DR "My new AI communication tech is great; BTW beware AI may soon end humanity", http://t.co/79M6PdXs… @beaucronin oh now I see this haha whoops. @beaucronin https://t.co/gGoGndLeGf ++ https://t.co/bRk4SYvk2p @beaucronin I put a lot of work into those Prezi slides and didn't get much out of it ;) Q is marginal effort of paperification 1 thing to add for anyone looking at those slides (besides forgive the typos/notes to self), see @j2bryson on "AGI" http://t.co/YEgBVminsD TL;DR it's complicated I'd probably frame things differently today but there are a few ideas there that are at least helpful (for me) in thinking about such things Turns out my Prezi from a @GCRInstitute seminar I gave on the social dimensions of AI risk debates is still online https://t.co/iuF6t3iGFI Butttt so many other things to write. Sigh. If anyone wants to follow up on such things, I have lots of ideas for relevant literatures. Sooo now might be a good time to get serious about writing that paper on the cultural/media/intellectual dimensions of AI risk discourse... @smc90 Indeed! And I don't mean to pick on you, there is indeed SOME difference, just a matter of emphasis :) @smc90 I worry that that framing misleads people into thinking they are some natural pristine tech-free whatevers when they're not. @smc90 the fact that it's more or less direct/physical/obvious etc. doesn't really change the fact that all of our lives depend on it. @smc90 I guess, but I just don't see the point of drawing lines like that when we would all die in weeks without computers, modern ag, etc. Hawking may be more directly and obviously dependent on AI/tech in general than most people but indirectly/less obviously, no big difference @smc90 fair point, but honestly everyone who uses modern information and communication technologies does, too. RT @mark_riedl: Press is asking AI experts to weigh in on Hawking/Musk comments. Good! I'm slightly surprised (but very pleased) there's so much machine ethics/Friendly AI-type research at the workshop. Hot topic these days. ...and not just cuz I'm giving a talk there. :) Very diverse but interrelated topics. Both ethics *for* AI and ethics *of* AI. Draft program is up for the 1st Int'l Workshop on AI & Ethics at AAAI '15: http://t.co/gtI9QWo2ye Should be a really interesting event! @SimonWierny see also what @j2bryson and @tonyjprescott had to say in response :) @j2bryson @tonyjprescott = why I don't like "should we fear x?" framing. Ambiguous about this vs possible worlds, extent of preparation. @j2bryson @tonyjprescott but in world where we act, those risks dont nec materialize. should fear space of possible worlds, not ours (2/2) @j2bryson @tonyjprescott there's a bit of a grammatical ambiguity here- many agree in world where we arent careful, default outcome bad(1/2) @j2bryson @RobWortham also liked @tonyjprescott's take here https://t.co/UAjEPZlmQ9 @j2bryson @mark_riedl on my phone, havent heard it yet. "RT @j2bryson: @mark_riedl mT @BBCNewshour Is Artificial Intelligence a threat to humans? @jrbarrat & @j2bryson in discussion http://t.co/o…" RT @j2bryson: @ndresmarino @BBCJamieCoo @BBCNewshour or specifically to the Hawking debate, here: http://t.co/a7EDcQm5Vw Sorry if this tweetstorm is a bit much, been saving up thoughts while finishing my paper, glad to be able to think random thoughts again :) TL;DR: Watson uses (from Bringsjord's POV) super shallow logics still relative to humans, and the fact it can still do things is interesting Selmer Bringsjord basically has a grant from IBM to theorize Watson and its limits/his recent papers do this, def. up some of your alleys :) It falls short of my desiderata and is too logic focused for me but def some interesting and important thoughts to be considered there. If anyone is concerned about AI progress rates stuff, check Selmer/Alex Bringsjord's latest. Don't 100% agree but they do have a model... Surely IBM's internal metrics much more strongly favor Watson as a sign of AI progress than DeepMind, esp on the language and dialogue front It's not just a benchmark tailored to Legg, Hassabis et al's approach but also glosses over language, sociality, etc etc etc etc etc etc It is just an interesting one to discuss and compare to what he and his colleagues have subsequently accomplished. Another clarification: I completely disagree with that benchmark having super special significance - it is self-serving from Legg's POV :) I am glossing over lots of complexities (narrow vs. general is NOT sharp) but basically this is why I don't fear DeepMind-geddon in 5 years. A general approach to easily making narrow agents is huge. General -> general would be huger but no evidence to support DeepMind being close Don't get me wrong: DeepMind having a general approach to making narrow agents (/Google commoditizing it) is HUGE. Not general agents though DeepMind could (in theory - don't think they're this dumb/unambitious) make it infinitely easy to train 1 agent to do 1 thing but never >1. At least that's how I understand DeepMind's papers and the broader significance of transfer learning, someone correct me if I'm wrong. TL;DR recent tweets - deep reinforcement learning is cool but DeepMind still has to train new agent for new task. Diff from Legg prediction @mariana_farinha so my understanding is they still need to train a new program for every new task. @mariana_farinha so if doing more than one thing with the same brain/app/whatever is important to intelligence, got a ways to go still @mariana_farinha my claim (no insider knowledge tho) is it is not likely that the individual Atari playing agents share knowledge in big way @mariana_farinha google Legg Lesswrong interview. then compare his thing abt how we know if we r close to summary of DeepMind/Atari stuff @mariana_farinha google 3 misconceptions about Edge debate, I basically agree with that, though more uncertain re timeframe/how hard prob is You could say the same thing about Watson in some regards, but that's a longer discussion. That distinction is key. Difference between a general approach for making narrow agents versus general approach for making general agents. DeepMind has done the former, not the latter, to my knowledge. Shared representations aren't used across individual deep RL Atari agents (?) As I understand it, Legg's "this proves we're close to AI" benchmark prediction involved pixel-to-play deep learning PLUS transfer learning. Despite the superficial similarity between the Atari paper and Legg's prediction years ago, DeepMind has NOT passed the threshold Legg gave. Actually, more interesting than the distribution itself is Legg's choice of intermediate benchmark for progress to human-level AI. HOWEVER+ Not so much cuz the distribution proper is revealing (one can just assume a normal distro) but because it signals serious thought. Not that people need to give probability distributions on all their views, but when smart people do re: the future of AI, I pay attention. Hassabis seems to have pretty coherent views, too, but hasn't given specific probability distributions and metrics repeatedly like Legg has. I get why people focus on Hassabis, but IMO it's more interesting that DeepMind founder Legg has coherent and specific views on future of AI Piece on Hassabis-DeepMind in @techreview (Legg-as-superintelligence-theorist/DeepMind founder intrigues me more :) ) http://t.co/7Kytt4ip7y I did think the Bluemix environment was pretty cool and user-friendly, though. I suck at programming and made a Watson app. Not surprising, makes sense from their POV prob, but I got overly excited then it's like, here's a poorly trained Watson using dumb data... In case anyone was wondering, the IBM Bluemix demo thing doesn't really let you make a full fledged Watson app. It's pretty nerfed. :/ @OddLetters totally true, though. RT @karen_ec_levy: Optimism over the rollout of police body cameras is striking (as feds fund 50K more). May be part of a solution, but ver… @karen_ec_levy yup! Often get impression European AI people organize more/faster in response to PR issues than American, at least on twitter/among ppl I know. RT @karen_ec_levy: Police cameras are tech tattletales, but can't solve social/economic/cultural problems on their own -- we shouldn't lose… @karen_ec_levy Indeed! I was just mentioning earlier the not so flattering role of body cameras in enabling a police state on show Continuum @jathansadowski nice, yeah, some of it's pretty new to me (not all of course - lots of pop audience stuff for total noobs) @jathansadowski speaking of sociology...read Mcdonaldization of Society? Dabbling in it now... My favorite thing about the US Robotics Roadmap is it gets close (15 years) to my pet timeframe of concern: about 20 years (cuz education). Recap: lots of great underused resources to draw on in stimulating thoughts on AI/econ. Theory/method comparison/common framework needed. Problem is, too many apparent pearls of wisdom that can't all be true. Not to mention that the studies I cite in the paper all have pearls of wisdom and methods that should be explored more/combined etc. Also, someone could systematically compare US and EU roadmaps. They differ in a lot of subtle ways I haven't articulated yet. I would ideally like to see a bunch of different scenarios, not just the one robotics roadmap, but it's a super useful resource as is. Don't think the US Robotics Roadmap is perfect but has a lot of cool features w.r.t. modeling AI/robotics progress. Wish more read/analyzed! If someone wants to scoop me on this, go ahead (just tell me :) ) - compare job requirements/human skills to US Robotics Roadmap timelines. While I do think there are lots of open questions, there is also plenty of low hanging fruit for progressing quickly on AI/economics issues I'll have much more to say on AI progress theories in the years ahead (desiderata are in Econ. Poss. for Our Children) but for now, 1 thing+ Another thing it would have been nice to discuss explicitly in my new paper: different countries' issues. HUGELY important. h/t @SimonWierny RT @j2bryson: Going to be on the BBC World Service / NPR in 1:20 or so, re Hawking. RT @tonyjprescott: Worried about AI after listening to Prof Stephen Hawking ? Read my view on how human intelligence will stay ahead https… RT @amcafee: Re economic growth: the difference between 2% and 3% isn't 1% -- it's 50% RT @rcalo: Robots: so close, and yet so far. HT @RooneyMcNibNug. https://t.co/3GGAW3CSU6 RT @robinhanson: @JasonKuznicki @barneyp @DavidBrin @CatoUnbound Agreed. But the usual approaches to make our AIs friendly are useless for … RT @robinhanson: @barneyp @DavidBrin @CatoUnbound We have much better reasons to expect aliens to arrive suddenly and powerfully, if at all… Lots of cool stuff in the current issue of the Journal of Responsible Innovation: http://t.co/fzCBuHlneU If you like my new paper on AI/work (http://t.co/qBK4afmV8B) check out stuff by @Floridi I cite. Compare 2014b to 2nd Machine Age re leisure Speaking of sci-fi...and body cameras...the latter are featured (not too flatteringly) in a late 21st century police state on Continuum. One day I hope I'll persuade more people to slog through the meh parts of the show Caprica and appreciate the fascinating AI/VR themes :) Daniel Graystone was fired as CEO bc he wanted to give Holoband (=better Oculus) profits to charity, eliminate motive for irresponsible tech RT @mattthomas: Actually, you know what, people, don’t watch “Black Mirror.” You probably can’t handle it. RT @jameswilsdon: Watson “knows fuck all about history, human evolution...psychology, or any rigorous study of intelligence or race." http:… "Instagram is an asymmetric social awareness platform," second interesting Instagram study so far from ASU AI folks http://t.co/c3p27DmY9A RT @JayCyde: Watched Ep 1 of Black Mirror "The National Anthem" and good god. Vicious storytelling. Completely upsetting, utterly compellin… This!!! RT @kashhill If you love tech dystopia, rejoice, for the BBC show Black Mirror is now streaming on Netflix. http://t.co/tILzOPwd73 … RT @kashhill: If you love tech dystopia, rejoice, for the BBC show Black Mirror is now streaming on Netflix. http://t.co/VOpp8jumpq RT @mattthomas: My favorite are the students who quote a dictionary definition and then do a works cited page with one entry: the dictionar… What I like most about Shaping the Next 100 Years is that they have a coherent/well-argued (if imperfect) vision of humans'/machines' roles. Lempert et al. have done a lot to follow up on the ideas in that book in recent years...haven't read it all yet but super interesting. Shaping the Next 100 Years: New Methods for Quantitative, Long-Term Policy Analysis is epic. No AI (yet) but 10^7+ scenarios, data viz, etc. @SimonWierny @MaxMckeown @profhamel thx unfamiliar with site, will check out! @SimonWierny @MaxMckeown exactly. Time frame hugely important for education, welfare, etc. If ppl take that away from my paper I'm happy! @SimonWierny @MaxMckeown one can argue automation makes more jobs in other areas but not nec of any use to local communities directly @SimonWierny @MaxMckeown specific example: solar panels. Wide range of automation depending on if country wants jobs created locally @SimonWierny @MaxMckeown yup, should have mentioned that in conclusion as important - automation vizaviz dev country growth is HUGE issue @SimonWierny @MaxMckeown many thanks! Hope it will generate lots of debate and more specific research questions/agendas at the workshop. RT @SimonWierny: @Miles_Brundage @MaxMckeown Brilliant: 'clarity is urgently needed with regard to the susceptibility of jobs to automation… "RT @SimonWierny: @Miles_Brundage 'people and organiz need to know about the likelihood that a job will be possible to automate over a given…" @SimonWierny @MaxMckeown thanks! Feedback welcome! It was intended to be provocative. Oh and using AI to better anticipate the future of AI (h/t Selmer Bringsjord for putting it so well). Details not yet ready for prime time.. That being said, there is a lot of stuff to chew on in there as-is, I hope :) Few things I would have liked to say more on in that paper: politics of hype, different ways to fund AI, non-R+D funding policy issues... My latest paper, Economic Possibilities for Our Children, to be presented at the AI & Ethics workshop at AAAI '15: http://t.co/qBK4afmV8B RT @anildash: I support body cameras for cops, but it exemplifies tech solutionism's myopia. Video of police abuse doesn't magically cause … Economic Possibilities for Our Children: Artificial Intelligence and the Future of Work, Education, and Leisure http://t.co/NW01PrWy1K If you were bored by my rants about solar earlier, don't worry, I'll return to the regularly scheduled AI stuff with a new paper today/tom. RT @MHendr1cks: 12. But we’re not just scientists, we’re humans. So if you need them, pick your role models and heroes based on how they tr… RT @MHendr1cks: 10. And professional respect is not owed to someone who diminished or prevented other scientists’ work to further their own. RT @MHendr1cks: 9. There is no need to accord personal respect to anyone for how good they are at science. @GrumplessGrinch this is on my to-read list: http://t.co/XnWdBMv3xv @GrumplessGrinch I assumed the same about critical theory but turns out there are some popular, well-established, dumb ideas there... @mattthomas and mutants and robber barons. See: Total Recall. No fact of matter re: how much land we need for solar/where--lots of variables--BUT policy processes, not space per se, rate limiting factor And those saying it takes way more land than we have are just not defensible on any level either. Truth is siting raises ethics issues (3/3) Bad estimates/args re: land requirement for solar abound. Those saying it's trivial underestimate energy demand/solar's contribution (2/3) Maybe should write this up in a paper someday on land/solar, don't have my old calculations readily available, but here's the TL;DR (1/2) My point, though, is that solar needn't/won't inherently always be produced near people. With transmission, storage, big plants...not nec. Or at least Google it :) Not everyone lives close to a huge/near-24/7 solar plant. Some day many more people will, though! I've said this before but it bears repeating: if you think solar can't be baseload, can't be big, is immature, etc. visit Solana immediately I didn't realize so many people had taken the diffuseness of solar energy thing and come up with implausible anti-capitalist implications. I know solar energy's diffuse/there are implications for spatial organization but it's NOT so diffuse as to prevent Big Solar. Far from it. + standards of living incompatible w/ solar energy as critical theorists think. Rude awakening coming! We ain't seen Big Solar yet (2/2) Section on "fossil capitalism"/radical ecology in book The Left Hemisphere interesting but not persuaded capitalism/contemporary (1/2) RT @BuzzFeed: A Student Has Died After She Confronted A Group Of Men Harassing Teenage Girls http://t.co/IS8j1QJ0A0 http://t.co/iiT3erFW3G @jmugan and on the opposite end of the spectrum, serious relaxation has a role to play too. Not everyone need be optimally engaged 24/7 @jmugan yeah i was annoyed when Carr's book Glass Cage took flow to be basically the only good experience to be pursued viz-a-viz automation @danieldewey awesome, thanks! ICYMI: Government & Energy Innovation, ed. Sarewitz [on US successes/failures; I wrote the chapter on solar thermal] http://t.co/YNCG8l8QqO Seriously, the references section there takes up *significantly* more space than the meat of the paper itself. Bravo, Jurgen Schmidhuber. I've seen some epic lit. reviews b4, but this one might take the cake: Deep Learning in Neural Networks: An Overview http://t.co/vgg8uOobok And when I say "taken more seriously," I don't know what that means exactly but at least a few well designed/located refuges would seem wise This (http://t.co/glVdEKWaWS),"Existential Risks: Exploring a Robust Risk Reduction Strategy," was the proximate cause of my last two tweets ...more seriously as a public policy priority, then I think, maybe they're just secret. Gov'ts bad at hiding stuff though. Thoughts? (2/2) I often think (/others often say) it's strange we don't take the idea of bunkers/space stations/etc. as hedges against existential risk(1/2) @nerdsrocket Noted :) @nerdsrocket Netflix? amazon prime? @nerdsrocket havent seen an ep. RT @arthur_affect: Black ppl shot dead on sight. Women threatened for not knowing their place. The nation's wealth owned by robber barons. … Building the capacity for public engagement with science in the United States - David Guston http://t.co/LXFewVonsz "Search, Goals, and the Brain" - Winstanley et al. 2012 http://t.co/WIfh3zlhFb I can think of args against that policy, but not sure if that reasoning would square with other args I agree w/ re: Twitter being important. If I had to rigorously cite the early Twitter forms of all my subsequent paper ideas, I might reconsider Tweeting research stuff. Thoughts? Sidenote: I'm referring to inchoate/similar ideas, not verbatim quoting. My impression(/selfish hope, so I don't have to do it right now) is most people think "no" or there would be more tweet citations. Why tho? Research ethics question: Do one's tweets count as something you shouldn't self-plagiarize when writing a traditional publication? @smc90 perhaps I should have said "think" not "agree" - anyway, I enjoyed your tweetstorm :) @smc90 still, overall I agree the pendulum is too far on the technocratic/deference/uncritical conceptions of expertise side of the spectrum @smc90 though those implementing such hoops should also not be douchey about it :) @smc90 yes, there are good reasons for not wanting people to say dumb things all the time/having some hoops to jump through sometimes etc. @smc90 if you mean that a fresh perspective can help produce insights, then yes. :) @smc90 elaborate? had me until this tweet.. @smc90 much rhetoric from techies is colonial/caste-y in that sense. @Aelkus http://t.co/RAHEopbvbD here ya go, not sure why the abstract is weird but think that's what I was thinking of. @Aelkus plus the ones that did exist often didn't compile, etc. @Aelkus minimally, people should give it upon request. The study showed many people outright refused. @Aelkus nope, probably way worse actually. Can't remember where that study was. @Aelkus i.e. not just a matter of it not being readily available but it being straight up secret for no good reason. @Aelkus so I was literally just looking for a study of that I read a while ago. Asked a bunch of ppl for source code, v. damning results. @Aelkus the system of source code, replication, not reinventing the wheel etc. is totally broken :/ Any sufficiently opaque technology is indistinguishable from magic in a society with poor public understanding of science/tech- Clarke remix Positive Computing: Tech. for Wellbeing and Human Potential looks like a seminal books on such things http://t.co/jy1xakId7W h/t @petitegeek @petitegeek nice, hadn't heard of this book but def. up my alley, thanks for sharing! @Aelkus good to see this, I've thought about that issue a bit before.. @Aelkus A* will save us Talks at Beyond the Turing Test workshop look great, same day as the ethics workshop though!! :( hope 4 videos/slides/summaries @GaryMarcus RT @ArtificialOther: Beyond the Turing Test conference is Jan 25th in Austin http://t.co/3SquLKZzXz #artificialintelligence IMO Stuart Russell's response here wins that Edge AI debate thingy. Wraps it up pretty well http://t.co/DtQFMDGCuM "this issue [safety/ethics] is an intrinsic part of AI, much as containment is an intrinsic part of modern nuclear fusion research."-Russell RT @nancyleong: "Women said 'wearing that shirt is not cool.' Men are now telling those women they would like to rape & murder them." http:… @SuzanneWaldman reacting to the sub-headline: duh, we "may" need GMOs. Devil in details re safety, no need for anti or pro GMO essentialism. 1 tweet version of the rant - Kurzweil's Singularity is incoherent/only seems otherwise because of false assumptions, superficial coherence. *rant about Kurzweil, hedgehogs, confirmation bias, complexity, and the determinants of trustworthiness of experts omitted cuz Thanksgiving* RT @voxdotcom: Poverty is down, literacy is up, & solar power is cheaper. 26 charts & maps to be thankful for http://t.co/kvTauDp5Bm http:/… @Floridi indeed! my next few tweets elaborate on why, not that you need an explanation ;) Also note Searle's review was just as horribly wrong about Bostrom's Superintelligence, another book that I highly recommend. Anyway, I recommend the book (4th Revolution), plus Philosophy of Information if you want to know more, as perhaps Searle should have done.. To accuse Floridi of not having a coherent account of information, when he's one of the only ones who actually does, is just so facepalmy. Searle's strategy is common: pick a few quotes from a popular book on X, say author doesn't get X, ignore author's other work clarifying X. Searle defending his horrible review of Floridi's 4th Rev MT @Floridi: At the Information Desk by Luciano Floridi http://t.co/gUKQJUBFRL RT @j2bryson: A reply to @kebwi "Interstellar Might Depict AI Slavery" http://t.co/RZrJ4cqz4b ht @Miles_Brundage. Summary of my robot #et… @nerdsrocket = every time I go to campus Nicholas Carr at Google discussing his book, The Glass Cage: Automation and Us https://t.co/0pgOHHAS1M @mark_riedl some analysis here - http://t.co/tZprfa1O9B Many movies depict humans poorly designing/controlling a system, but Jurassic Park is special in that it happens over. And over. And over. The meta-premise of all the Jurassic Park movies is that humans are incapable of designing socio-technical systems that don't suck(disagree) @Aelkus (and how they both looked clunky/old) @Aelkus sounds interesting... I was blown away by how identical the systems at a coal and cement plant were to each other. RT @cthorm: @SuzanneWaldman @theturner to change someone's mind, more often than not you need inception. Plant the idea such that they thin… That paper is moderately accessible btw, you will definitely learn stuff even if you skip over some of the more jargon-y parts. """If a true science of intelligent agent design is to emerge, it will have to operate in the framework of bounded optimality."" Russell/Ibid." "Rationality and Intelligence: A Brief Update," Stuart Russell (draft) http://t.co/XtyI6Myt6r good summary of AI today acc'ing to Russell. RT @VanJones68: Trapped between cops firing tear gas at everyone who moves and protesters -- it is a war zone. A basic income would address some issues in that Yuma article (basic needs, perverse incentives), complicate others(job quality/competition) Life in the unemployment capital of America [Yuma, AZ] http://t.co/EbnpgDesxi lots of interesting/important issues discussed here More to say re: "enslaving" future AIs being misleading and the relation btwn preferences/freedom/sentience but too verbose for Twitter. :) THAT being said, I know no good arg as to why AIs will necessarily be conscious, suffer, etc. under all possible hardware/software setups. #NAME? I totally agree with Wiley that the case for/against "enslaving" AIs depends on a host of empirical and normative factors, some v uncertain+ "Interstellar Might Depict AI Slavery" by Keith Wiley http://t.co/Q5tp4Qged3 mentions my piece and @j2bryson on robot slavery. You could design a swarm of robots today to defend a building at all costs, but it would be super dangerous. Nuanced security bot is harder. Serge's (robot) demise on Caprica = the sort of thing that would happen btwn competent robbers and today's security robots. Totally owned. The usual tech/employment caveats apply here (ie. making some security guards more efficient may make others obsolete, may create diff jobs) Robots have lots of potential security applications, for sure, but they're not gonna be "replacing" security guards wholesale anytime soon. Sidenote: breaking into a bank guarded by non-lethal robots could be a fun sci-fi or comedy plot, depending on the robots' skills/antics. Not if they don't wanna get robbed soon MT @RobotNext Will Robots Replace Human Security Guards in Silicon Valley? http://t.co/Qm4DwSjX4J @jathansadowski sweet, sounds really interesting! I've been meaning to read Lessig's Code or a similar thesis, maybe a good one to pair with @jathansadowski (since, among other things, it has an original typology of thinkers, interpretation of history, and connections drawn) @jathansadowski yeah, I agree with the blurbs on the back (/presumably on Amazon) to the effect that it's good for multiple expertise levels The Left Hemisphere: Mapping Critical Theory Today by Keucheyan is a super lucid analysis of contemporary Left thought and its antecedents. Elaborating briefly on point 2: not only is the current pace unclear/under-theorized/under-tracked, it is subject to social/policy influence +no matter how good your list of stuff AI's bad at, 1. people are aware/working on it, 2. the plausible pace(s) of progress is unclear (2/2) One of the biggest issues the Frey/Osborne paper faces (/pretty much every paper/book on the future of AI/work faces) is the fact that (1/2) Definitely much more to be done but the paper is a good start, especially in the literature review department - best free read on AI/work :) Which is to say, modeling the state of the art/plausible future of AI and its relation to human skills, economic conditions, policy, etc. I've discussed issues related to that paper here (http://t.co/b8cTbYmqjl)/on Twitter but overall I think that line of work is super valuable RT @petitegeek: My latest paper is online! A Recipe for Empathy http://t.co/JHsnVMhlOr http://t.co/r47WUj1Zxy Oldie (on a Twitter timescale - last year) but goodie - The Future of Employment by Frey/Osborne http://t.co/etfNP15OgU Haven't read it all yet (it's 168 pages long) but interesting so far: "Ethical Artificial Intelligence," Bill Hibbard http://t.co/io1KenjBaE @robinhanson Do you want to know what accounts for ppl buying non fiction vs something else or why some books are favored over others? @robinhanson some factors prob more important at point of sale at a bookstore (e.g. author fame) vs. indirectly resulting in it being there. +based on such analysis, we might get lucky and find out it is relatively easy to stunt AIs well short of superintelligence - unclear (2/2) Also agree with Davis about the need to consider multiple dimensions of intelligence (Bostrom does address this to some extent) (1/2) Davis is right to leave open the possibility of regs as a complement to work on the control problem, but we don't yet know how hard each is. If we can just ban sophisticated AI (or something else along the lines Davis says he is open to), then the control problem isn't as urgent. Bostrom agrees AI may take a long time, so their disagreement is largely about the difficulty of the solution and the cost of not having one (sidenote: I'm elaborating on this review because I think it is a commonly held constellation of perspectives) Specifically, he seems to think that it won't be that hard to avoid superintelligence risks and that we have a long time to avoid them. One way to summarize Davis: possible stakes of superintelligence high but urgency also depends on difficulty of solution and time - big Q's. Don't think Davis's review fully addresses Bostrom on ethics, reasons to think superintelligence is likely, etc. BUT pinpoints right issues. +raises key points - esp. the relative difficulty of ethics and intelligence and the need to question superintelligence's inevitability(2/2) Re: Davis review of Bostrom's Superintelligence - overall I have a more positive assessment (working on my own review), but think he (1/2) Ethical Guidelines for a Superintelligence - review of Bostrom's book by Ernie Davis http://t.co/K2gDmP1bkW "Will the next technological wave eliminate the middle class?" - Gilles Saint-Paul https://t.co/xDoYOLbJQ2 You could make finer distinctions like what is achievable given X effort in Y domain in Z time period, but just getting Z clear is a start. Suffice it to say I think distinguishing those is a good thing/important for policy reasons. + yet been applied to aggressively, what's currently hard in AI even with high effort, and what will be hard for decades (2/2). A few things that are often not distinguished clearly: tasks that are impossible for AIs (/agents generally), domains that AI hasn't (1/2) "Where and Why g Matters: Not a Mystery," Gottfredson 2002 http://t.co/BVtrwhVdg2 RT @elonmusk: About the Nevada deal with Tesla ... http://t.co/hAeyOc5OzC RT @alan_winfield: One suggestion under How to implement RRI in projects: move from dissemination plan to societal interaction plan. #sisrr… RT @VincentCMueller: @OpenRoboethics Simpson & @VincentCMueller argue in @BlavatnikSchool memo"Killer robots; Regulate, don't ban" http://t… RT @AcademicsSay: I do my best proofreading after I hit send. @beaucronin still the only book I can recommend on the economics of AI in good faith @beaucronin indeed, and also I thought the dismissal of a post work future was way too glib esp. coming from MIT profs with cushy jobs... Anyway, point is I read a lot of the popular books on AI and can give more recommendations if anyone wants em but those 4 are a GREAT start. Glass Cage is a well written book on subtle risks of automation (Superintelligence is the best on not so subtle, e.g. existential risks). Superintelligence is the most challenging of those but it's 100% essential reading material for thinking seriously about long term AI issues I have previously recommended Robot Ethics but have decided it's too academic in style to recommend to a wide audience (great stuff though). List of top popular/accessible books on AI and society that fit in one tweet: 2nd Machine Age, Robot Futures, Superintelligence, Glass Cage. Last tweet was from "Robots in the Home and Industry," chapter by M. W. Thring in Cybernetics, Artificial Intelligence, and Ecology (1972). "Clearly none of these problems [perception, dexterity, etc.] is ... as difficult as getting a rocket back from the moon." M.W. Thring, '72 Google Scholar's Updates feature comes up with *new* publications relevant to my interests but that's a very narrow slice of publications. I love Google Scholar, search engines in general, journals, etc. but it is hard to beat the epicness/serendipity of wandering in a library. ..which isn't surprising given they're competitors, but interesting to note the contrast with Watson viz-a-viz hype/brand/product management What's less clear than the distribution of talent/research goals in commercial AI labs is their envisioned products/services (except Watson) All that discussion was about AI proper but bringing robotics into the discussion makes Amazon more interesting. Google still top notch tho. I've seen Baidu AI lab's research statement, know DeepMind/IBM pretty well...what are goals if any of MSFT Research/FB AI labs? More vague? There are certainly ambitious AI people at Facebook, Microsoft, and Baidu but to my knowledge there are fewer than at Google. #s, anyone? My (stylized) impression of commercial AI R+D: Google wants to make learning agents; IBM, learned agents; FB, MSFT, etc. less focused on it. If (Google) DeepMind is "an Apollo program" for AI according to Hassabis, then what is Google? A meta-Apollo project? That doesn't mean they'll be commercially successful, though. (with respect to the amount/quality of resources being applied to the AI problem, I mean) I know less about the ambitions/competence of Microsoft Research, Facebook, Baidu, etc. but would be surprised if they beat Google overall. I know less abou tthe ambitions/competence of Microsoft Research, Facebook, Baidu, etc. but would be surprised if they > Google overall. Watson is VERY impressive and important economically/socially/technically but they don't see themselves as an "Apollo program" like DeepMind All that being said, Google/DeepMind continues to be the obvious place to look for rapid pace in general AI if it is happening anywhere. I have yet to see good evidence for Musk's claim that progress in AI is or is likely to be exponential soon (Kurzweil's arg is bad). Another big point: even if "which jobs will be automated" were a well-posed question, we still wouldn't know how to answer it yet. Time to reassess the promise of nanotechnology? An analysis of research, developments and commercialization - Youtie http://t.co/2D9yDTNuY2 Another point of the paper: there is no fact of the matter about which jobs "will" be automated. Depends on SO many factors in our control. TL;DR of my paper "Economic possibilities for our children" -now is the time to get serious about envisioning/building a post-bad-work world Lots of new thoughts on AI and the future of work, education, and leisure, will share paper on it soon when I finally get to editing it :) RT @elonmusk: Really hate it when companies bring out an awesome show car and then you can never actually buy it. So lame. + the few ppl I'm aware of to have repeatedly made thoughtful, specific predictions about the future of AI and which milestones matter (2/2) Some additional context for my recent tweets: besides being a DeepMind cofounder/superintelligence theorist/not crazy, Legg is one of (1/2) RT @StefanieBLI: MT @Miles_Brundage: DeepMind co-founder on unsafe AIs (@elonmusk's fear?) http://t.co/dT78GEcKkl Read @BV on the hype http… to build significantly more general and riskier systems. IMO Bostrom's right the control problem is hard, don't know about the timeline(3/3) basically just referenced Bostrom on the control problem being hard and (I think) Legg's/others at Deepmind's views on how long it take(2/3) Agree Musk's fears/warnings are *in part* hype, but they also didn't come out of thin air - besides the demon metaphor stuff, he has (1/3) DeepMind co-founder Shane Legg on unsafe AIs being given access to supercomputers in the 2020s (@elonmusk's fear?) http://t.co/20HmP9q6P4 RT @mpshanahan: Nice discussion of #AI here http://t.co/NYv3GsHUQj - but most commentators seem only to have read media stories rather than… RT @sapinker: Less than a third of Americans realize that violent crime is falling; half mistakenly think it's rising. http://t.co/tj84YyLE… RT @danieldewey: Misconceptions about long-term AI risk: https://t.co/57RHK3CqpR Will be interesting to see Musk's blog post explaining that soon. That Musk screencap on 5-10 years to dangerous AI is interesting. Still vague, though, and he may be overinterpreting DeepMind's success. @KatjaGrace Maybe discussed there already, but I thought the endnote about some convergent goals maybe being good was very interesting. @robinhanson Interesting topic, though I clearly am not in a good epistemic position to bet on it haha :) @robinhanson so a "AI success" scenario could be compatible with no change in GDP % @robinhanson right, that was my (unclear) point... computers boost economy but get cheaper fast so share of economy doesn't grow (?) @robinhanson could also imagine other countries making all the computer chips and the US share staying the same/declining, importing more.. @robinhanson makes sense...though does that account for exponential cost reductions in computers/related reduced profits? @robinhanson OK, well, I won't be taking that bet, then ;) @robinhanson isn't the more common claim that AI/computers make other/all sectors, not just comp/elec manufacturing, more productive? RT @ArtificialOther: 'Interstellar' co-writer Jonathan Nolan is adapting Asimov's 'Foundation' for HBO http://t.co/fVadAON4uA #scifi @jathansadowski paraphrasing George Ritzer: where there are already human robots, mechanical ones are likely to follow My paper on AI and the future of work, education, and leisure was accepted for the AI & Ethics Workshop at AAAI in Jan.! Final version soon. @beaucronin http://t.co/99h3NWLad0 RT @RoboEthics: ABB invests in AI startup Vicarious http://t.co/1o11IsWs61 "RT @Nelson_Bridwell: #Robots and #ArtificialIntelligence in @Interstellar http://t.co/nxde2RJQVa" RT @soundbytelife: Government & Energy Innovation now available on Amazon! @Miles_Brundage, @ericbkennedy, @heathermross, @CSPO_ASU http://… Might have the wrong robot pic (CASE instead of TARS) in my article - IMO the fact that they're forgettable/indistinguishable is the pt. :) #NAME? You could also interpret HAL's failure as a problem of it being in control of the ship, not humans, but the deaths could have been avoided+ My view is that HAL failed due to ill-considered/opaque decision-making processes and in particular bad high level goals (not self-interest) Some pushback on my interpretation of why HAL failed in 2001 in the comments section of my article: http://t.co/99h3NWLad0 RT @jeffjotz: TARS was my favorite character in Interstellar (spoilers abound) http://t.co/YkjAvUG5fi via @FutureTenseNow RT @SpaceCoastLaw: Written by AI to trick us “@FutureTenseNow: robot from Interstellar should be future of robotics. http://t.co/FCr8kMaz17… Wrote some stuff on the future of AI, human-centered tech design, and Interstellar: http://t.co/MUGQzFd753 RT @FutureTenseNow: The robot from Interstellar should be the future of robotics. It's the anti-HAL http://t.co/HLT5qHwWBM by @Miles_Brunda… The Knightscope K5 (http://t.co/xWIfBmCDO0) reminds me of a bigger, dumber Serge (http://t.co/tyC0rxF9iS). Writing up some thoughts on Interstellar and the future of AI :) RT @DanielSolove: RT @WSJ 91% of Americans feel they've lost control over how personal data is collected & used http://t.co/peaHcUrTQa http… @AliMattu @zeustoves @knewscript @nerdsrocket many a blog post could be written about its treatment of science (good and bad) I think @zeustoves @knewscript @nerdsrocket @AliMattu yup! plus also some long weird sequences even by those standards hehe :) @zeustoves @knewscript @nerdsrocket @AliMattu def recommended, though full disclosure: it can be pretty slow/boring to modern (/my) eyes :) @knewscript @zeustoves @nerdsrocket @AliMattu also Contact :) even ignoring MM.. @knewscript @zeustoves @nerdsrocket @AliMattu it is VERY 2001 @knewscript @nerdsrocket @zeustoves @AliMattu overall loved climax/resolution - just some aspects, maybe @knewscript knows what I mean :) @knewscript @nerdsrocket @zeustoves @AliMattu I just saw it last night so I guess haven't really come to terms with if I hate the ending... @nerdsrocket @knewscript @zeustoves @AliMattu only a little bit awful IMO, whole lot of awesome @knewscript @nerdsrocket @zeustoves @AliMattu Loved it!!!! RT @RobotLaunch: .@Robohub Google commits $1.36 billion for NASA facility, to house their robotics, space and flight technologies http://t.… "RT @harperga: After today's deal, get ready for a lot of this- Buffett plans to double clean energy spending http://t.co/bsS8lnaPaG" RT @Philae2014: Touchdown! My new address: 67P! #CometLanding @rcalo Indeed! @rcalo you may also like the stuff in there on emergent risks and the relation to autonomy. @rcalo Interesting read on the subject suggesting the odds are not equal :) (@danieldewey's reference does as well) https://t.co/bkxpLHcqqV "Google [seems to] really cares about ensuring technology is deployed responsibly. That's why I'm happy to work for them but not [DOD]" Ibid "I think the long-term future is quite likely to be something that most researchers currently regard as utterly ridiculous." Hinton AMA. "All good researchers will tell you that the most promising direction is the one they are currently pursuing." Hinton AMA "It would be very helpful to understand how neural networks achieve what they achieve, but its hard." Hinton AMA "I think that Google, Facebook, Microsoft Research, and a few other labs are the new Bell Labs." - Hinton AMA http://t.co/sNTkiI4ysc RT @JohnDanaher: Reblogged - Bostrom on Superintelligence (2): The Instrumental Convergence Thesis http://t.co/f57qRbcSTm via @hplusmagazine RT @etzioni: I agree with @rodneyabrooks "Let’s get on with inventing better and smarter AI." http://t.co/1v0vn1SrrS #AIisnotaDemon @PabloRedux yeah, I don't think there is as sharp of a distinction as he makes it sound like. RT @digiphile: Space is Coming. RT @io9: @HBO Will Make Isaac Asimov’s Foundation With Interstellar’s Jonathan Nolan http://t.co/yfcbwDJYOp RT @zeynep: @nathanjurgenson Early tech punditry=what's social structure, tech will blow it all up. Late tech punditry=what's tech, it's ju… RT @zeynep: Yes we hate the label "techno-determinist." But much current punditry is technological erasure. It's all nbd, as life spins aro… Hinton is being pretty generous with his knowledge/opinions on deep learning and related issues. Definitely recommend checking out the AMA. RT @alan_winfield: Want to do research on ethical robots? Position open at the Bristol Robotics Lab here: https://t.co/EzDdk8wd8s (Please R… "converting pixel intensities into sentences that answer Q's about an image does not seem nearly so prone to dirty tricks [as Turing Test]" "@GaryMarcus and Levesque...will be impressed if neural nets can correctly answer questions about Winograd sentences"http://t.co/OwcRzJye3v "important to get our critics to state, in a clearly decideable way, what it is they think these nets won't be able to learn to do" Ibid. Hinton on hype: "for many probs deep...nets really do work ... better than shallow ones, so using "deep" as a rallying cry seems justified" "But currently [neuro example] just makes the models work worse and ... its silly to add it just to be more brain-like. ... hurts the tech." "When they [Vicarious and Numenta] can solve a problem that no one was able to solve before, I'll take notice." Hinton, Ibid. Exactly. "I completely omitted reinforcement learning from the course, but now it is working [via Google/Deemind] so well that it has to be included" Curious what people think of Danks's claim in Unifying the Mind that graphical models/common representations are key to explaining the brain "I will be disappointed if in five years time we do not have something that can watch a YouTube video and tell a story about [it]" Ibid. "[fog] is a very good model for the fact that the next few years are pretty clear and a few years after that things become ...opaque" Ibid. "A bunch of slightly new ideas that play well together can have a big impact." - Geoff Hinton AMA http://t.co/sNTkiI4ysc "it's still possible to achieve spectacular new deep learning results with modest resources if you have a...new idea."http://t.co/OwcRzJye3v @beaucronin if I were familiar with Magic Leap I would be :) RT @PJ_Muncaster: RT @RethinkRobotics: Artificial Intelligence is a tool, not a threat. @rodneyabrooks clarifies. #AI http://t.co/bWHw2O6rje Lots of lessons for tech policy from the history of energy (that's what the whole book is about, can't really give a good lesson summary). under way, thru R+D (esp at national labs), industry collab demos, subsidies, + technical assistance like making solar radiation maps (2/2). TL;DR of my chapter in this book on energy innovation policy http://t.co/wUgS2fMRQU: US gov't key player in the solar thermal explosion(1/2) @VincentCMueller great discussion of biohacking in context of sci/tech risks/policy/ethics at this (https://t.co/dCbDPSPMfF), report soon! RT @annegalloway: The Roboroach: a dodgy way to normalise animal experimentation. https://t.co/b5lcPSV996 RT @ylecun: Geoff Hinton, a prominent member of the Deep Learning Conspiracy, will be doing an AMA on Reddit tomorrow Monday,... http://t.c… @Aelkus right, I just don't count those as representative of DC or politics in general..just elite DC/px :) @Aelkus pop/folk/anecdotally based theories are considered sufficient to make huge investments in NGOs etc @Aelkus not so much not well liked as not even part of their worldview one way or the other...most ppl don't know poli sci relevant to them. @Aelkus likewise with my paper referenced in there...this sort of research program is what I was groping at. @Aelkus lots to chew on in it @GaryMarcus would be curious what you think of the "psychopathology of intelligent machines" approach proposed therein :) @GaryMarcus speaking of AI risk and timelines, I loved this paper (and not just cuz I'm glad to be cited) https://t.co/ELsbTKkdz2 @Aelkus speaking of the proper use of metaphors/sci-fi... I thought this was well done in that regard https://t.co/ELsbTKkdz2 @JohnDanaher charm? No. Quality? Yes. Insofar as high quality arguments are fun to read then I think it counts as entertaining ;) @JohnDanaher have only read (and love) On What Matters, not Reasons and Persons, so I always assumed the opposite! "We simply do not have an understanding of fault modes that are likely to occur as a result of emergent behavior." Atkinson/Ibid I could keep tweeting interesting quotes from this paper all day (https://t.co/bkxpLHcqqV) but will try to refrain. Highly recommended. @jathansadowski Nice. Should be able to get to it eventually :) @jathansadowski ah haha we tweeted simultaneously. Sounds like my fears (but also hopes) were somewhat correct :) @jathansadowski wasn't sure how sensitive to STS sensibilities it was... @jathansadowski I haven't but thought of it, recommended? "Ultimately, the real payoff for AI R+D of applications is the opportunity to increase the trustworthiness of machine intelligence." Ibid. "Of greater concern, it is possible that some psychopathologies of machine intelligence could be induced in a new form of cyber-attack."Ibid @jathansadowski ever read The Control Revolution? "Can we identify plausible mechanisms that explain the nature of the amok machines’ failures, given [state of AI/foreseeable future]?" Ibid. "Could something like the behavior of these fictional malevolent machines actually occur? ... In a few cases, the answer is “probably yes.” Anyone else driven completely crazy for a few seconds when Twitter puts a notification button ON TOP of this text box so you can't type? "We stand to gain certain benefits by analyzing the unique fault modes of autonomous systems." Ibid. "An instance of APEX, interacting socially with each of these people, is both a social actor as well as a cyber-human prosthetic device"Ibid A Cyber-Human Prosthetic for Mental, Physical and Age-Related Disabilities, Atkinson et al. https://t.co/T1bUngL8eC Emerging Cyber-Security Issues of Autonomy and the Psychopathology of Intelligent Machines, by David Atkinson https://t.co/bkxpLHcqqV Last tweet was an excerpt from Graystone's diatribe to the company board on the endless applications of (his) intelligent humanoid robots. "This Cylon...won't need to be paid, ... won't retire or get sick, won't have rights, objections, or complaints."- Daniel Graystone, Caprica @zeustoves I'll settle for not actively reinforcing misconceptions for no reason ;) (e.g. "we only use 10% of our brains" in Lucy) "RT @danieldewey: New paper: ""Long-term strategies for ending existential risk from fast takeoff"" http://t.co/zDS4qqZCsH" RT @mpshanahan: We should be clearly distinguishing the short-term implications of #AI (say 10 years) from long-term implications (say 50 y… RT @SwiftOnSecurity: We write instruction manuals for our elimination. http://t.co/tjvEBedaFb @AliMattu @NASA I will try to assure it is very widely read :) @AliMattu @NASA for reals. Can't discuss the content til the report comes out but it will be epic and I think a model for future events. @AliMattu You would have loved this event today! https://t.co/SxC0va82P4 Can't talk about the content until the report is released (which should be fascinating) but this https://t.co/SxC0va82P4 was epic. Musk is right to worry about artificial intelligence but it's not as close as he thinks - @GaryMarcus https://t.co/0IXCjq6Skv RT @beaucronin: AR like Magic Leap must solve vision AND graphics; VR only needs to solve graphics. So AR is a superset of VR, which kind o… Looking forward to playing a small part in the Phoenix part of this NASA-funded public deliberation event tomorrow!! https://t.co/SxC0va82P4 @mark_riedl Indeed. Related discussion: http://t.co/roQwAs35cp. Key pts IMO: some deception/misinterp inevitable, informed public good :) @flexibledragnet @SuzanneWaldman issue isn't whether we have the land SOMEWHERE but which to use, how, where, transmission, etc. @flexibledragnet @SuzanneWaldman anyway, yeah it's on the order of hundreds to thousands of square kilometers (I lean towards latter)... @flexibledragnet @SuzanneWaldman heard that figure before but don't think that's supposed to be for 1. 100% solar, 2. higher energy demand? @mark_riedl anthropomorphism isn't all bad, of course, can help facilitate use etc. But the specific features in those products...meh. @mark_riedl oh, I have no beef with the plausibility of uninformed ppl making that attribution - what I don't like is companies doing it. @SuzanneWaldman Actually it is Gila Bend in general that proves point 1, not just Solana. @SuzanneWaldman if local gov't motivated, tho raises justice Qs, 2. 90%+ capacity solar now ready for deserts; the basic plant design works. @SuzanneWaldman running out door/will read later :) but also, on Solana, some lessons I take are that 1. permitting/siting can be fast (1/2) @SuzanneWaldman not just in general (RE is progressing, makes more sense considering externalities, etc.) but specific rapidly scaling techs @SuzanneWaldman I'm open to a thread of diffuse points, too :) my intuition is just that it's much more feasible than many think. @SuzanneWaldman @mwt2008 I agree, ICE not important for much of transport. @SuzanneWaldman @mwt2008 internal combustion engine (sorry to speak for you Mark, I'm impatient) ;) @SuzanneWaldman def. agree such factors should be taken into consideration, I'm just questioning if a knock down arg. has been made re: RE @SuzanneWaldman everyone who works in CSP, I mean. Seems like Solana is the new standard. @SuzanneWaldman you're right about batteries, I should have said storage earlier, not batteries. @SuzanneWaldman Extremely and it will happen faster than many think (or it could). Everyone basically says no new CSP w/o storage. @SuzanneWaldman big resource issues raised by Jacobsen et al. about high-RE scenarios/battery/motor materials etc. but don't see (1/2) @SuzanneWaldman what about it? There will be waste...it will take energy... so? It won't be perfect or happen overnight... @SuzanneWaldman progress needed in many areas. I used to work at ARPA-E so big advocate! They did/are doing good grid level storage stuff. @SuzanneWaldman I've visited Solana twice, once during operation with 90% of 24/7 and rising, so beg to differ ;) @SuzanneWaldman (cont'd) ASAP and using it for building more fossil infrastructure makes sense for a while but not as much long term. @SuzanneWaldman as to #2, yes, should be considered, but overall such considerations suggest use fossils to make renewable infrastructure. @SuzanneWaldman I only really see biofuels for jets, trucks, etc. Batteries at various scales, solar, wind get you VERY far. @SuzanneWaldman *given many political assumptions, of course, which are made by all who make "X is/isn't possible" arguments. @SuzanneWaldman my view is: energy demand will go up, a lot, for a while, sure. We have way more than enough renewable resources to do that. @SuzanneWaldman I would not be surprised, though, if IPCC had generally not that aggressive RE scenarios. Compare to Jacobsen, others @SuzanneWaldman oh, I misread it. And yes, 2100. In that case then I am skeptical of those all-RE scenarios, haven't seen them. @SuzanneWaldman Not so much interested in the total as in specific arguments as to why renewables can/can't scale at what pace. @SuzanneWaldman just to be clear, I was just talking about your second graph. @SuzanneWaldman slash not sure why all the scenarios concocted for renewables getting WAY higher than that WAY before 2010 are implausible.. @SuzanneWaldman if I were convinced there were a good basis for thinking new renewables will be that limited, sure, begging the Q though? :) Jibo is physically designed in a clever non-anthropomorphic way, but the last tweets refer to things like sense of humor, inflection, etc. Even though the Echo's ad makes it seem less human-ish/social, they still call it a member of the family at the end. ¯\_(ツ)_/¯ The Amazon Echo seems like a less anthropomorphic version of Jibo http://t.co/FioJ32l77r and https://t.co/s9T9s51JCN I prefer the former... @Aelkus Bringsjord and Bringsjord's Minimaxularity has huge socio-economic implications. @Aelkus You sure won't find me laughing at it ;) @Aelkus last sentence is most important IMO. @Aelkus well, USED, not so much usable in a broader/more empowering sense. @Aelkus I would also say that that's not so much a prospect but our everyday life currently :) @Aelkus http://t.co/VJrblMEaaA @Aelkus you should check out Bringsjord's latest work theorizing Watson's limitations btw @Aelkus I dream of a day when those aren't considered separate criteria ;) @Aelkus not super shocked...reminiscent of crappy/clunky looking but trusted software in retail, etc. Hear SAP = lots of legacy code too. @Aelkus @fedcyber Indeed. @Aelkus no, and yes, debugging/testing/theorizing autonomous agents is/will be hard. @Aelkus of the differences btwn current/future systems and their ease of use/capabilities, and 2. by that measure, Stuart Russell beats him. @Aelkus elaborate? I tend to take issue w/ "these worried ppl haven't done AI work so are wrong" b/c 1. Bostrom et al. are quite aware (1/2) @Aelkus disagree with Kurzweil about most stuff,but he's right ppl in trenches often miss fast progress in field as whole/other areas tho. Looking forward to lots of asteroid discussions this weekend! https://t.co/tMSUYB6on2 Wikipedia's history of autonomous cars...also includes predictions for the future: http://t.co/92zlg64nXK I prefer Watson as an example of a sudden-ish breakthrough in AI. Built on prior work but many experts did say it was impossible (that fast) Was referring to this... http://t.co/EsPVqZrDCw scientists saying it's impossible, etc. but it's *not* a good example of a sudden unforeseeable breakthrough. Built on decades of work (2/2) The DARPA Grand Challenge for driverless cars *is* a great example of gov't involvement in robotics, poor foresight by some social (1/2) @xuenay sounds perfect :) @xuenay the difficulty of cleaning em up to send now would be lower if they weren't handwritten... @xuenay they're written down/safe, don't worry ;) I could share a draft paper in a month or so with relevant ideas if you want though! @xuenay I personally am jazzed abt synergy btwn pub. engagement, scenarios, models of AI progress,+ quantitative innovation systems analysis @xuenay very broad range of stuff from engaging public to futures studies, policy etc... cross section: http://t.co/VcAvAVtsfQ There will one day be a cool report (and more) articulating a research agenda in societal aspects of syn bio...should be of broad interest! Took away a lot of info/perspectives on syn bio as well as inspiration to apply many of the methods/concepts to the study of AI in society. Really enjoyed the @NSF Workshop on Research Agendas in the Societal Aspects of Syn Bio...very diverse group, productive discussions, etc. @Aelkus @mark_riedl yep. @j2bryson and tried to do that for Watson here http://t.co/nkEYKaUDZo both over/underestimating AI progress harmful @PabloRedux @drgjdcam or rather which levels of abstraction are appropriate for which questions :) @PabloRedux @drgjdcam both AI and cog sci/neuro ppl should want a list of cognitive operations/primitives, though what level of abstraction? Looking forward to the Workshop on Research Agendas in the Societal Aspects of Synthetic Biology starting today near ASU! :) RT @ThirdProject: Voting is pointless because the system is broken. A new political system wont work either because the only good system is… part of an interesting long-term project -Artificial Intelligence Outperforms Average High School Senior http://t.co/W17LiFg1EW via @wsjasia RT @NTSB: Hart: We have formed a new group, human factors, to examine the human-machine interface. #SpaceShipTwo RT @Floridi: Pianist asks The Washington Post to remove concert review under EU ‘right to be forgotten’ ruling http://t.co/WPrEeAvDdr @wash… John Oliver, Nick Offerman, and Lowe's robots. http://t.co/cx0RAhYV3c @mark_riedl http://t.co/RnG0Xw1qUl :) @mark_riedl tricky thing about predicting the future of AI is that when ppl say AI can't do X, there are invariably ppl working on X :) RT @mark_riedl: “We won’t see [robots] tell jokes, do research, or be creative.” http://t.co/SgNVBqNfq4 << I strongly disagree! Already evi… @mark_riedl indeed. Also: don't make robots capable of resenting being enslaved. Cylons did this with Raiders. @mark_riedl @j2bryson relevant discussion here - http://t.co/47TswhijEz planning to read the whole report that it draws on...some day :) The Cylons, in contrast, solved the control problem, at least until stunting their minions became a matter of political/religious dispute. In the parlance of Bostrom's Superintelligence, the Fall in BSG results from (among other things) botched domestication/value loading of AIs Whether the "hold them close/treat them well" approach to AI actually has merit is another story, I'm just discussing plot interp. here :) Not that BSG has a single coherent message about AI and society (it has many of varying coherence), but "breaking the cycle" is a big one. It seems that many who watched BSG missed/forgot the Final Five plotline and, relatedly, the point about human-machine harmony being good. @Aelkus @lynncrees read the Hieroglyph short stories? I'm just getting to the first AI-related stuff now... @Aelkus "no fate but what we make" is a good message. Judgment day's inevitability contradicting that, not as much. @Aelkus @selil my main problem with Terminator as a cultural touchstone/shorthand is that it takes place in the very near future :) @Aelkus @selil key point there i think is that good analysis and a variety of framings are compatible. Which ones, when... trickier question @Aelkus @selil not sure whose derp...but anyway, good discussion here: http://t.co/nNpSaY2PIU @Aelkus @selil I agree. @Aelkus @selil Sci-fi can be fruitfully used IMO to highlight both pos/negative futures. My imperfect attempt here :) http://t.co/EMB8EOvakW @Aelkus @selil scientists and a Bostromian "treacherous turn" :) 2. the key thing, though, is not using them as prophecy but prevention(3/3) @Aelkus @selil been helpful in justly calling attention to lethal autonomous robots, and in the story results from well-intentioned (2/3) @Aelkus @selil inclined to agree on the general point/most examples but re: Terminator...is it such a bad metaphor? 1. seems to have (1/2) @Aelkus @selil really, though, it's obviously a more complex issue than that and different framings are appropriate for different contexts. @Aelkus @selil the Musk case was almost a good one - he was drawing on good analysis. Maybe should have stuck to Bostrom's own parable :) @Aelkus not either/or...metaphors are indispensable in/outside science. Need to be good ones and not overgeneralized, of course. @Aelkus various myths, like genies, can be apt metaphors for at least part of Bostrom's control problem. Not that Musk put it aptly, though. Re: last RT (Pinker)...see also FAQs associated with that paper - http://t.co/gS286bLv1S RT @sapinker: How do brain circuits make us smart? Groundbreaking new ideas in @garymarcus The atoms of neural computation | http://t.co/Em… RT @lukeprog: How far has superintelligence theory come in the past 2 decades? Compare Bostrom's new book to his first paper: http://t.co/a… RT @rodneyabrooks: Breathless & totally misguided. Artificial intelligence: machine v man - http://t.co/172wWalb5f http://t.co/R0EcucFSRh … AI and Robotics at an Inflection Point - @steveom http://t.co/ZzX21baqwG @davegrundgeiger @steveom I particularly enjoyed this recent talk - http://t.co/ZzX21baqwG @davegrundgeiger I had in mind the sort of stuff that @steveom talks about. @j2bryson not that being included in a textbook means it's true, but it prob. wasn't quite as "cool" yet in 2009 ;) @j2bryson First point is fair... he could be parroting people with bad views. X-risk stuff has been in Russell/Norvig since 2009 though @j2bryson @robotenomics @lukeprog see also @lukeprog here - http://t.co/lFCivB0sW2 @j2bryson I should have said "there is a lot we still don't know" not "we still know little" ;-) RT @SwiftOnSecurity: Look, no one starts off in AI research intending to kill billions of people. RT @smwat: ah yes, the future is always dystopic (soullessly utilitarian) or utopic (humanistic) http://t.co/LhflYqJrw7 Total Recall is streamable on Netflix now... Just saying. Also, Netflix is great about sending me relevant updates. @SuzanneWaldman like how much add'tl storage? or how much more energy vs. fossil? Mark Jacobsen may have related scenarios.. RT @ellenhuet: Andy Rubin, Android's former leader, leaves Google http://t.co/Sewv4OWZyX @ForbesTech @danieldewey plus the civilian govt has lots of purchasing power and uses it to spur renewable energy development. AI equivalent = ? @danieldewey in theory the civilian agencies don't need to focus on quick commercial payoff and can do any blue sky stuff DOD can do (?) @danieldewey Big difference currently is DOD can buy outputs w/ less regard for $, and improve them through learning... @danieldewey indeed...although questionable whether that is inherent or just a reflection of us being more careful abt non-Pentagon $ :) "I am not surprised when people hit, kick, or otherwise attack their computers" because of bad design. - Norman, Design of Everyday Things. RT @ellenhuet: “Any more tweets of this nature will result in termination of partnership," Uber told a driver. http://t.co/q9vmbaxlDW There can also be commercialization/rapid deployment benefits from military R+D for sure, but that's not a reason to not have choices... I don't just mean saying that it's not that bad, but that it's actually GOOD/better than ppl being able to choose civilian $. Doubt it... Has anyone ever argued that it's actually a good thing that the military and intelligence communities fund most AI/robotics work in the US? RT @karen_ec_levy: I wrote about technology, data, and sexual violence for @TheAtlantic -- http://t.co/mSUJnlRTaP RT @jathansadowski: "where might service workers go if their positions, too, were to be eliminated in favor of automated replacements" http… @AIUpdate the algorithm for this twitter feed needs work! too much Musk stuff :) RT @danieldewey: An AI existential risk reading list, for after you've finished Bostrom's "Superintelligence": http://t.co/WigIWQ42ZK ...policy implications, so it's premature to lump AI risk concerns/fears together with a purportedly Big Brothery "solution" to them (2/2). There's discussion of that stuff in Superintelligence, but the bottom line IMO is we still know little about the future of AI and its (1/2) I bring this up bc some reactions to Musk's comments on AI (e.g. at @hplusmagazine) seem to assume that if he's right, draconian regs follow One can imagine scenarios in which it's ideal safety-wise to spread intelligence/AI widely, not curb it sharply...or something in between. Yes, one superintelligent AI in a world of dumb humans/AIs is nuke-comparable, but a self-regulating network of various AIs/humans isn't. From "AI could be more dangerous eventually than nukes" it does not necessarily follow that AI research should be banned or curbed. @j2blather I think less for extremely attractive men, not at all for the rest. RT @CSPO_ASU: RT #ASU Pres. @michaelcrow discusses the need for culture change in #highered with @timeshighered. http://t.co/wxQEdtn4yS #i… Addressing the interests of the involuntarily unemployed, happily employed, and miserably employed is tricky but a basic income is a start. It's easy to imagine a world w/o work and how to get there: AI R+D, wealth redistribution, laissez faire. But many want to work/be served. @paulonabike @Oregonian what about GMO marijuana? Specifically, Musk and others (e.g. Jaan Tallinn) have said they invested in AI to steer it positively. How? And why is $ needed? The interesting thing about Musk's comments on AI isn't his concern about the future, it's his role as an (activist?) investor in AI. Confusion there may arise from the way researchers are trained (diverse/specialized), the difficulty of knowing what everyone works on, etc. Yeah, they have met with mixed success, conceptual challenges remain, and many AI researchers do go super narrow. But plenty do think big. Perhaps the biggest whopper used to dismiss concerns about AI and society is saying that no one's working on integrated/"strong" AI systems. @mark_riedl thanks! 31% is the mean probability of a bad outcome per experts, not % of them who said bad outcome likely (Bostrom/Mueller 2014) h/t @danieldewey @mark_riedl most of it's publicly-funded anyway so in a broad sense it is already being "governed" and actively promoted - gov't not neutral @mark_riedl yep, which seems reasonable. If that's the definition of regulation then it's probably inadvisable now, but seems a bit narrow RT @1stYearPhil: Don't get me wrong. I'm not being sexist. But men evolved to be good at ethics and video games while women evolved to have… @mark_riedl (I don't know if I would :) ) @mark_riedl computer security, cryptography, privacy, etc. are very policy-relevant areas. Would you say those "fields" are regulated now? @mark_riedl is there any particular thing that should be banned now? Prob. not. Middle ground is collaborative, soft (at first) governance @mark_riedl depends what is meant by regulated. Self-regulated, for sure. In a broad sense, yes too http://t.co/klKLvgpKmY For the record, though, there would be nothing wrong with Musk gleaning a lesson from sci-fi -- that's just not what's going on here. Bostrom isn't an "AI person." But Stuart Russell, who wrote a blurb for him, sure is! So, no, bad sci-fi didn't create AI risk concerns. Also worth noting that pretty much everything Musk has said about AI is just paraphrasing Bostrom's new book. In http://t.co/v6Ueq5qQWL, 31% of AI experts expect bad outcomes from AI. Musk needn't "watch too much sci-fi" to want to prove them wrong. @pmarca Ditto! @pmarca especially if (as seems plausible) the costs of underpreparing for its consequences are greater than the costs of overpreparing. @pmarca Indeed, ppl usually expect AI in a few decades/are bad predictors. Given the stakes, though, seems worth taking seriously (1/2) @pmarca see also this recent survey of many AI experts :) http://t.co/v6Ueq5qQWL @pmarca just fit several AI risk tropes into 1 tweet... concern = "freaked out," "he doesn't do AI," and putting "imminent" in Elon's mouth. RT @RikerGoogling: ethics in holodeck journalism RT @therobotreport: Google DeepMind acquires two more AI companies and allies itself with Oxford University: http://t.co/tJVgsI8hNM RT @jathansadowski: "With AI we are summoning the demon…it’s like yeah he’s sure he can control the demon. Didn’t work out." —Elon Musk htt… RT @aeonmag: Balan happily talks us through the ancient craft of blowpipe-making: 7 min on Aeon Video http://t.co/PtvXbLHHLC http://t.co/Ei… @zeustoves @knewscript @nerdsrocket @AliMattu def unique aspects but he is a rich white billionaire heir dude fighting crime in Gotham(ish) @knewscript @zeustoves @nerdsrocket @AliMattu vs more crime/corruption stuff in Arrow (at least early on). @knewscript @zeustoves @nerdsrocket @AliMattu also watching and enjoying Gotham! Flash seems fresher (less Bruce Wayney), +bad guys w powers @nerdsrocket @knewscript @zeustoves @AliMattu what I like about both is the origin story is threaded throughout the shows, not just pilot. @nerdsrocket @knewscript @zeustoves @AliMattu same here re: Flash. Seen 100% of Flash and only 10% of Arrow, but I like Flash more so far :) @nerdsrocket @knewscript @zeustoves @AliMattu anyone else watching The Flash and/or Arrow? just started! RT @jahendler: Today's talk to @IBMResearch - “Watson: the academic perspective” on slideshare - http://t.co/9Tkf5cYiaL #watson @IBMWatson Are we really running so low on time/attention that we can't care about ebola plus other things? Maybe I'm underestimating harms of panic? Ebola is no more or less threatening to me personally than starvation, terrorism, etc. I have mixed feelings about the "ebola isn't a big deal [for you Americans]" meme. Agree panic bad but thousands of ppl dying = big deal. RT @michaelcrow: As a public university, ASU's job is to ensure that merit, talent & energy are the predictors of a person's success. http:… @PabloRedux yep...in a class on engineering psychology with a big focus on human-centered design. Also depends on the person and context, but in many cases improving outcomes for many is straightforward...start with the user (Norman) Putting that rant differently, for a randomly selected task or domain, a marginal increase or decrease in automation may be good. Depends! Carr is right we underestimate how hard it is to automate away certain forms of tasks, but we sometimes succeed. Need to account 4 this before that, too little assistance - after, too automated. second is the option to opt out of previously necessary activities entirely (2/2) ...which suggests a sort of two hump model of the desirability of automation: first maxima is user-centered design....(1/2) Speaking of which, I think Carr's new book is good but doesn't quite account for why we often have reason to want X to be fully automated... Indeed, user-friendliness can be taken too far (see: The Glass Cage) but for lots of technologies, it isn't remotely there now in many ways. Recommend The Design of Everyday Things by Norman. Design and usability aren't the whole story of tech and ethics but def a big part of it. TL;DR of Sargent's Very Short Intro to Utopianism: utopias are old/global, potentially dangerous but essential for challenging status quo Netflix just asked me if I watch "cyborgs & robots" a lot. Well, yeah, but it should have known that already, probably. RT @mattthomas: In the future you won’t commute home to eat with your family, you’ll take an Uber back to your Airbnb to drink Soylent alon… @robotenomics Good to know! :) @robotenomics though he also said "or at least a good review" ;) have you read it? For obvious reasons, it isn't often cited as an example of effective crowdsourcing, but online movie piracy is an impressively robust system RT @martinenserink: Reactions to today's major decision on risky #flu, #SARS and #MERS studies run from "very pleased to "WTF?" http://t.co… @paulbloomatyale @rossmyrandomem1 because of your blurb for Harris's book perhaps? Multiple people have told me I could skip Piketty's Capital given that it's mostly about the data, long, and well reviewed. Anyone disagree? Really, though, I like that Person of Interest has so much stuff about responsible technology development, privacy, machine ethics, etc. I've decided I'm negligent for being so far behind on Person of Interest. I mean, come on, the new season is about two superintelligences! RT @OrinKerr: "In Defense of the Panopticon," from William Simon, certainly cuts against the usual grain: http://t.co/96E0zrnCmN Battlestar Galactica takes place a long time ago in a variety of galaxies, some closer than others. Paper submitted, whooo! :) Writing all the things. The key point of that article IMO is that people keep playing Destiny cuz it keeps getting better as problems are identified, + new content. 3.2 million players are still playing Destiny every day [I'm one of em] http://t.co/NE1gTOMzvd @nerdsrocket ditto @jathansadowski speaking of which...watching now :) @jathansadowski Kumare? @jathansadowski really though, I suspect there are tons but we may never know who exactly cuz it would be counterproductive to be honest @jathansadowski Gorbachev? Haha @jathansadowski the Sokal affair came to mind but there's a fine line between trolling, pranks, and what you're talking about :) @nerdsrocket agh he's on SNL? I don't watch it....but yes, he is what everything needs. RT @SwiftOnSecurity: I'm not a transhumanist. The machines will strike us down before we get there. =( @nerdsrocket omg I know, right? He rocks. The "insights" about governing technology in fiction aren't always explicit but 1. They sometimes are and 2. They're often still quite clear Asimov's work alone anticipates an insanely high fraction of current discussions about machine ethics, robot ethics, and tech. unemployment. One of these days I want (someone) to come up with lists of insights re governing AI, 1 from sci-fi and 1 from non-fiction, and compare them "We don't cite other authors because we agree or disagree with them but because the hard work they have done has taught us something." Ibid. RT @digiphile: I predict the questions raised by @STS_News about @evgenymorozov’s review: http://t.co/QdnTSOB3Vm will need to be answered b… Education has many goals and responsibly/enjoyably living a life of less work should be one of em. Easier said than done (see: aristocrats). Paraphrasing one of Nel Noddings' points: education can be for work, personal life, democracy. I'd add leisure/community service, as well. The (strong) possibility that today's kids will live a life of more leisure and less work than us makes education reform even more urgent. RT @femfreq: Today marks the 3rd time I’ve gone on stage after specific death and bomb threats where issued to an event where I’m scheduled… Societies with 2nd chances/truly diverse life options > those that put weight on a few credential/developmental/resource bottlenecks (2/2). Bottlenecks: A New Theory of Equal Opportunity by Fishkin is very provocative. TL;DR - opportunity pluralism > "big test" society (1/2). RT @annegalloway: When animal cruelty is - and isn't - a crime. http://t.co/upDNfyVBOS Consciousness: Here, There but Not Everywhere [and Not in Robots] by Tononi and Koch http://t.co/dza9RXrbzi RT @jameswilsdon: I love that the Japanese government has a "robot revolution realisation council" http://t.co/DHxCn9w3F9 (ht @davidpilling) Nice lecture by Philippe van Parijs defending a basic income against various objections: http://t.co/Q7aMRWDo56 @JohnDanaher he brings that up, though it's not central to the book. @JohnDanaher On related issues, I enjoyed Brennan's Why Not Capitalism? RT @juliawatzek: Why academics stink at writing by @sapinker @chronicle #AcWri http://t.co/E995QyKEIm OK, Lizard Squad, you've had your fun, now let me play Destiny again. Rewatching Battlestar Galactica for the nth time, my reaction is it's still my favorite show, but incomplete without the prequel, Caprica. @knewscript @nerdsrocket @zeustoves @AliMattu @d_seaman yup! @mdelachang Indeed! I'm a bit jealous :) @jathansadowski yeah...it's like a book review for an intro philosophy class haha. #burn RT @etzioni: Please join me for a @reddit_AMA tomorrow, Wednesday at 3pm PT where I will slay Frankenstein once and for all... Can anyone recommend good basic reading material (critical review of the field would be ideal) on computational creativity? @jathansadowski "I do not think he offers a precise and specific answer to these questions," say that this is Floridi's mass market book :) @jathansadowski right, there are are always ways to address it even if you don't go into detail....like when he says stuff like this + @jathansadowski +they just happen to be reviewing the accessible summary, and don't bother to look beyond that book in the review. Agh. @jathansadowski my other pet peeve is the "X doesn't define Y, so we can say...." when the author is the definitive expert on the topic and+ @jathansadowski seems to just be playing fast and loose with levels of abstraction e.g. re: motivation, ironically, Floridi's pet peeve :) @jathansadowski Superint, under review 4 Futures special issue. I mean, I get what Searle is "saying" e.g. about motivation but it's muddled @jathansadowski most bizarrely, his point about consciousness w.r.t. existential risk isn't even clear (enough for me to get it, at least). @jathansadowski not super impressive, sadly... he did what I tried to avoid in reviewing one of those - make it about him and his issues Not to mention the availability heuristic. Everyone can think of at least one dystopian AI movie. Is it really surprising that sci-fi focused on one technology would be dystopian? Compare to sci-fi about e.g. cloning. Prob more negative. I think people not counting the latter (huge) category as being about AI accounts for the "AI-related sci-fi is dystopian" meme. There are lots of good AI-pocalypse stories, but there are also plenty where it plays a mild, positive supporting role in reducing drudgery. I know that may sound crazy but consider that AI is involved in far more sci-fi plots than the number where it is in center stage. It's not obvious (and it certainly hasn't been demonstrated in any exhaustive way) that AI is portrayed, on balance, that badly in sci-fi. I've mentioned this before but it bears repeating in the context of the latest Hieroglyph/dystopian sci-fi and its discontents discussion: + That being said, augmenting technologies can play an equalizing role, but that doesn't just happen automatically. Where "advantage" could be that the already intelligent/rich can boost their information access/processing more than those who aren't. To give just two examples, making person A more productive can displace person B's job, and augmenting A can contribute to advantage w.r.t B Saying AI augments, not replaces, human cognition doesn't seem to do the work of defusing ethical/economic considerations the way ppl think. Disutility, personal fulfillment (/lack thereof), a social relation, caring for others, identity, and service. Diff things to diff ppl (2/2) In The Thought of Work, Budd distinguishes between conceptions of work as a curse, freedom, a commodity, occupational citizenship, (1/2) RT @CSPO_ASU: If you missed hearing Dave Guston live this a.m., you can catch his presentation on Responsible Innovation here http://t.co/L… RT @cns_asu: Apply now for CNS Winter School 2015. #AnticipatoryGovernance #EmergingTechnologies http://t.co/hxA6G4A5hx http://t.co/1bGyhde… So far I'm much more impressed by Regan's The Case for Animal Rights than Singer's Animal Liberation, though the latter is more accessible. RT @mlamonica: Price of residential solar has gone from $12/watt in 1998 to $4 watt. Still going down. See slide 12 http://t.co/YApNT8oE54 @KatjaGrace actually I'll send you an email with my current half-baked thoughts on AI progress models. Will be interesting to compare. @KatjaGrace Def. miles . brundage @ asu . edu. @KatjaGrace I'm currently working on something similar to in depth investigation #2 and would be interested to hear more thoughts on it. @paulonabike @jathansadowski look forward to reading that. Also just picked this up, will tweet about it at some pt http://t.co/kpC6XOoh0r @jathansadowski @paulonabike looks like some googling is in order :) @jathansadowski def still more open than closed questions, to be clear, though :) @jathansadowski Yup. I can recommend good stuff on that soon, working through various books, but Phil. of Work Reader is great on that. @jathansadowski Borgmann book is in my Amazon cart...a socio-tech system that wouldn't last long w/o most ppl working ;-) @jathansadowski not sure which chapter I sent? haha. = ~my view of the main obstacle to leisure/good work society drawing on various sources @jathansadowski without most people working, which is more fair today than it will be in the future. Doesn't mean action isn't needed though @jathansadowski *on what. But I can see how you can take that work less seriously if you think we can't sustain remotely the same QOL (1/2) @jathansadowski There actually is a lot of good work onw hat kinds of work and what kinds of leisure are good/desirable, eschewing hierarchy @jathansadowski explicitly) draw on a wider range of, arguably sometimes legitimate, critiques of such views, if that makes sense (3/3) @jathansadowski is plausible this century in a way that could (if well governed) eliminate unwanted labor, one can (implicitly or (2/3) @jathansadowski that's what I'm thinking. And yeah, I almost mentioned Marx. What I mean is that without knowing widespread automation (1/2) @jathansadowski Not that that's an excuse- ppl after all need to find out facts for themselves - and general conservatism is def endemic too @jathansadowski Nope, thanks! Re: L.S., I hope it can be *somewhat* explained by ppl not being aware of expert views on future of AI. By envisioning and defending a post-bad-work/leisure-filled world, I mean ~ following up on the open issues here: http://t.co/lypS8IHls8 L.S. seems an ideal field from which to envision and defend a post-(bad)-work, leisure-filled world, increasingly plausible tech-wise. (2/2) The extent of radicalism/ambition in leisure studies seems limited to ensuring ppl have *some* good leisure. Which is surprising, b/c (1/2) What's the best (or at least something decent) thing written comparing robotics research foci and commercialization cross-nationally? RT @BNerlich: Job with me on responsible research and innovation in synbio http://t.co/N0VFratg95 @karpathy *or if it works well :) I do agree with the point about a range being useful even if exact calorie counts aren't possible.. @karpathy hmmm... not sure how these people did it: https://t.co/4kVp23Zqha @karpathy is there a good way of estimating calories etc from a pic of food? Loving Destiny so far. Recommend Floridi's book The 4th Revolution if you're new to him. Think he's too blasé about the pace of progress in AI but overall, read it Anyone else more concerned about Destiny today than Apple? @jathansadowski wow...I can't imagine that. I mean, I can imagine it happening, kinda, but not what would lead someone to that point haha. @jathansadowski nice, gotta get on that stream... A Plea for (The Philosophy of) Leisure by Alex Sager https://t.co/nvzXfeF7El @jathansadowski lol this is the apple thing? RT @j2bryson: Misplaced empathy is why the EPSRC Principles of Robotics is against humanoid robots http://t.co/t2mokyrJR9 #storyofmemory @p… Oh and somehow "cognition" is ok by some people, but "thought" entails language...why?? I certainly understand the need for precise terminology, but being ok with "minds," "planning," "learning" etc but not "thought" is weird. Am I missing something or is the refusal of some ppl to use the word "thought" re non-linguistic animal thought just silly anthropocentrism? RT @TheSwitch: Your guide to caring about Destiny, the most pre-ordered video game in history http://t.co/p3VNUatzXR RT @juliawatzek: Dogs prefer petting over vocal praise. In fact, praise is as unrewarding as no interaction at all. http://t.co/LLrLVvgdOR @knewscript @zeustoves @nerdsrocket @AliMattu @d_seaman Hmmm I don't really know how to judge that, I think it is? http://t.co/dnIUc4Y1UP @knewscript @zeustoves @nerdsrocket @AliMattu @d_seaman I officially really like Extant as well :) and @nerdsrocket, Enver Gjokaj is on now. RT @PsychScientists: Also: psychologists RT @MichaelKitson BBCNews doesn't understand diff b/w 'significant' & 'statistically significant' … RT @charlicarpenter: Some have accused the #bankillerrobots campaign of invoking 'Hollywood paranoia.' Is this fair? Nope: http://t.co/f47A… @jathansadowski hmmm... @jathansadowski hunch is: old guy's semi crazy idea and had little influence on mainstream thought but would be fascinating to be wrong! @jathansadowski oh I do have a choice ;) haha but yeah, super interesting. The "who" is LaVey himself who wrote that, the when is 1988... Today I learned that "development and production of artificial companions" for all is a pillar of Pentagonal Revisionist LaVeyan Satanism. RT @xor: If you don't want nude photos to leak, don't inhabit a corporeal form. RT @j2blather: Come on LEGO! girls aren’t a fad! RT @markgbaxter: #Lego says no more female scientist sets; parents cry foul. http://t.co/w… @thisischristina Autonomous Technology, Does Technology Drive History?, The Social Control of Technology. What's Hot in Planning/Human-in-the-Loop/Human-Aware Planning, talk at AAAI 2014 by Rao Kambhampati https://t.co/iidi0tdrNT Smart machines and what they can still learn from people - @GaryMarcus https://t.co/6j1DqzBX7l RT @GaryMarcus: Beyond the #Turing Test! Help us construct Turing’s sequel! January, 2014 in Austin. #AI http://t.co/UrKnYeNsN3 @nerdsrocket except maybe not understanding 2+2=4. Or TNG. @nerdsrocket insert anything else for "3D printers" and the answer is also yes :-) Turns out, it is not easy to find a Go board IRL. Replicating DeepMind, Korjus et al. 2014 https://t.co/T3dih51LKZ Site for Beyond Turing Test workshop at AAAI 2015, organized by @GaryMarcus, Rossi, and Veloso http://t.co/K30lHiEf1Q @j2bryson @beaucronin @zeustoves @Ultimaker guess I stopped watching Defiance too early. Don't remember people with six limbs! Except maybe that jacked boxer guy @knewscript @nerdsrocket the way you keep up is just waiting until a critical mass of people have recommended stuff :) that's my lazy method @nerdsrocket @knewscript I officially recommend Extant too, by the way. Yeah, derivative, but not distractingly so, and good performances. Finally decided on my schedule for this semester. Just taking one class...drum roll... HCI/cognitive psychology of user interface design. @nerdsrocket @knewscript yeah. Scott Card said some insightful things about fantasy v sci fi in his book on writing sci fi but I forgot :) @knewscript @nerdsrocket just 2. @knewscript @nerdsrocket Outlander! @nerdsrocket @knewscript watching as we tweet :) @knewscript @nerdsrocket skip last ship. Ron Moore always takes precedence ;P @nerdsrocket @knewscript for realsies, not sure, many ideas. Maybe I'll know after watching Outlander. Y'all seen it yet? @nerdsrocket @knewscript what she said, pretty much. @knewscript nah, requires being better at programming and less in the middle of grad school than i am :) Sweet job opening - research evaluation (aka testing the intelligence of learning agents) for Google DeepMind https://t.co/DwfBSMCNO6& "Jumping NLP Curves," review of NLP by Cambria and White, 2014 http://t.co/9u6FmK5joF ICYMI from a while back - Anticipating a Luddite Revival by Stuart Elliot (re: what jobs can be easily automated) http://t.co/foWkgAShgY RT @elonmusk: Model S drivetrain warranty increased to infinite miles, applies retroactively ... http://t.co/0Gwukwj6qT @knewscript @nerdsrocket @zeustoves @AliMattu yup!! :) Understanding Knowledge Work and the Performance Potential of its Computerization, master's thesis by @lampelto http://t.co/isGmWuSPJJ RT @justinpickard: Not entirely convinced, but: 'We need our dystopias more than ever': http://t.co/zTLSb0atdl @jathansadowski that's how it works on Continuum in the dystopian corporate police state... @nerdsrocket I just might! If I knew what the heck I were going to do today, I could be more certain :) @nerdsrocket other than you, of course!! :) @nerdsrocket haha I meant some hangout with people I don't know. Sets off introvert alarm bells. @nerdsrocket sounds scary. :P @karpathy all that being said, curious about your weights! :) @nerdsrocket ohmigosh love it. Glad you ended up reading it!!! @karpathy sure, some people have good implicit mental models, but they're often flawed/contradict others'. Must be brought into light of day @karpathy yeah, same here. Think we need not just args but better models of what's easy/hard to automate. Only aware of 2, clear limitations @karpathy Just don't expect a satisfying takeaway. Not a lot of "uncertain," "unknown," "don't know"s, just contradictory predictions ;) @2020science great article! This also just came out, related: http://t.co/8Khfe9q6mG @nerdsrocket :) @JohnDanaher and I should have said a related argument, not the same argument. Surely you will find many important distinctions ;) @JohnDanaher Yup...similar length, as well. http://t.co/UYCxf8MUBk RT @mark_riedl: Waiting for a company to pledge to never make a fully autonomous robot that makes fully autonomous robots that kill. #looph… @JohnDanaher for a better version of this argument (IMO), see Stephenson's "Innovation Starvation." @JohnDanaher Ugh... not a good sign when the first source is some random unprofessional poll from 2007. RT @clearpathrobots: Clearpath pledges we won't make #killerrobots #cprbottalk http://t.co/sX6v1lVTO0 @BanKillerRobots @knewscript @zeustoves @AliMattu @nerdsrocket finished the second ep. Third today! And maybe more :) RT @wkamaubell: I HATE how "gentle giant" is used to describe #MikeBrown & #EricGarner. It implies that it's somehow unusual to be tall, bl… RT @doctorow: "Years ago I learned a very cool thing about Robin Williams, and I couldn’t watch a movie of his..." http://t.co/88CYFdRgjq @jonWturney kind of a bad version of Stephenson's Innovation Starvation piece. +Starting with a dumb internet poll from 2007 about AI...sigh The title/topic is a bit of a straw man but it's an interesting discussion nonetheless. Are animals autistic savants? Vallortigara et al. 2008. TL;DR: not really http://t.co/2LxuN51x9A (Reply to Grandin, includes her reaction) @nerdsrocket @knewscript @zeustoves @AliMattu revised hierarchy of new sci-fi - Strand >> Extant >>> Last Ship @nerdsrocket @knewscript @zeustoves @AliMattu I know, right? Also, Jonathan Hyde, or as I know him, Richie Rich's butler :) @knewscript @nerdsrocket @zeustoves @AliMattu oh and I JUST recognized Sean Astin...knew he was familiar looking! @knewscript @nerdsrocket @zeustoves @AliMattu I'm finishing 1 now. Watching for real now that I've made measurable progress on my work :) @knewscript @nerdsrocket @zeustoves @AliMattu Stephen didn't mention this, so I will - it stars Corey Stoll!! Draft of one paper down, one to go! @SuzanneWaldman as an advocate of fully automated solar plant construction in deserts, I'm definitely sympathetic ... @SuzanneWaldman well, I def. agree that is silly. :) Will read this when I'm done with a paper... @SuzanneWaldman I don't encounter them all the time, so will try to withhold judgment for now :) policy-makers don't listen to that tho (?) @SuzanneWaldman sounds like a bit of a straw man... admittedly, I haven't read it yet and don't know who exactly he's arguing against. @knewscript @nerdsrocket @zeustoves @AliMattu Haven't quite finished the first ep but I'm intrigued. Love the style. Rest after this paper! @knewscript @nerdsrocket @zeustoves @AliMattu I decided I officially recommend Extant :) not over anything, just in general. @nerdsrocket yay! Won't be the last time, I suspect - you're a great writer! :) @nerdsrocket my marine biologist friend says it inspired him to work on sharks originally but he hasn't watched in 6 years. RT @JohnDanaher: Another new blog post (getting tired now) -- Are we heading for technological unemployment? An Argument http://t.co/Mc1Cf… RT @icracnet: Here's The World's First Robotics Company To Pledge Not To Make 'Killer Robots' http://t.co/zpOxgFTauu RT @toddkashdan: why is everyone describing #RobinWilliams as having depression? he had #bipolardisorder & his hypomania defined his influe… @nerdsrocket @zeustoves @AliMattu @knewscript killer poster :) @nerdsrocket @knewscript @zeustoves @AliMattu last ship is entertaining but missable. I'll check out the strain later! :) @nerdsrocket @knewscript @zeustoves @AliMattu Deferring to @knewscript - the Strain- Extant does have Halle Berry and robots though :) @nerdsrocket watching dead poets society later :-/ @knewscript @nerdsrocket @zeustoves @AliMattu Roger that. @knewscript @nerdsrocket @zeustoves @AliMattu No, should we ? :) Gosh, there's so much to keep track of! Just recently: Last Ship, Extant.. @zeustoves haha I suppose ;) With Internet out for 4 days, I was constantly reminded of "Those who live by the digit die by the digit" (Floridi). Internet's back! Whooo :) RT @TechPolicyLab: Curious about #robots and policy research? Find out what experts and their centers are working on in our new post http:/… Day 4 without Internet at home, should be the last. I have watched a lot of Seinfeld. George/Larry David will always be my spirit animal. RT @zeynep: Dear media, CDC guidelines on suicide reporting. DON'T talk method; DO talk of help resources & problems people face. http://t.… RT @alan_winfield: .@2045singularity We don't need the singularity to end world poverty. Just the will, visionary world leadership and majo… @nerdsrocket you rock. RT @nerdsrocket: My thoughts on why Robin Williams's death should impact the way we relate to loved ones w/ mental illness http://t.co/1brY… @nerdsrocket haha yep. :) @nerdsrocket haha <3 bloopers in general. News ones are great too! No cable/Internet => Seinfeld DVD/reading marathon til tomorrow. RT @ArtificialOther: AAAI Video Competition 2014 winners http://t.co/upP5NiyhlX RT @AutomatonBlog: Robotics Company Prepares to Take Responsibility For Displaced Workers - IEEE Spectrum http://t.co/f1QYDnLugj via @IEEES… RT @erikbryn: My MIT colleague Cynthia Breazeal on "Why We Will Learn To Love Our Robots" http://t.co/4sbvmFfhED #2MA RT @beaucronin: Quick notes on the @oculusvr as a powerhouse of applied sensorimotor neuroscience. http://t.co/D0NCf6Izk7 /cc @pmarca @cdix… @robinhanson indeed you didn't ;) Though if those conditions are relaxed, outcomes and effort aren't (easily) distinguishable. @robinhanson if not, should they not be motivated like others who can? @robinhanson that is true; can everyone make a large discernible positive outcome though? @robinhanson why include hard working among the rest of that list? Effort/grit/persistence towards said valuable outcomes is critical. RT @Floridi: "The Fourth Revolution: How the Infosphere is Reshaping Human Reality" on Google Books http://t.co/LEFhkSZHyE @j2bryson that's pretty much what I was trying to say - consistency/coherency, reflective equilibrium (Rawls) etc. Moral realists disagree.. @j2bryson PS other more knowledgeable people disagree with my assessment re: foundations but it is what it is currently :) @j2bryson hard to believe IBM is hiring 2k for Watson group but they say so. Not coincidentally, they sponsored a very nice lunch at AAAI ;) @j2bryson which cohere better w some views at various levels...many tools to elicit those. Re: me, TBD but Dave/Erik have done it :) (2/2) @j2bryson haha. TL;DR of hypothetical email: in general, IMO ultimately it grounds out w/ evolved/culturally influenced intuitions (1/2) @jathansadowski nice, let me know how that is. And yes, agree re: Ready Player One. :) @jathansadowski I'd recommend it for sure. Best survey of the relevant literature (even though I disagree with some of the normative stuff) @jathansadowski cool. Did you ever read second machine age btw? @jathansadowski btw how was that Carr book? @j2bryson meaning...in general? W.r.t. my dissertation? Perhaps a more email friendly topic :) @jathansadowski yup! A cool one billion. @jathansadowski ain't seen nothin yet. Watson team is hiring 2k ppl @beaucronin section 5 of Forbus's paper is basically a more articulate version of what I said ;) I've mentioned this before but it's worth repeating - this tutorial on autonomous systems is really good - http://t.co/YlJSmlR9pE Nice piece - "AI and Cognitive Science: The Past and Next 30 Years," Forbus 2010 http://t.co/WrOEVwWVG0 @danieldewey @beaucronin "Leibniz's Art of Infallibility, Watson, and the Philosophy, Theory, & Future of AI," Bringsjord/Sundar, forthcoming http://t.co/VJrblMn78A @j2bryson definitely - that's ultimately the part I'm most interested in, just trying to lay some foundations for it now. RT @HarvardBiz: Are robots going to steal your job? Why the experts can't agree on an answer http://t.co/lGufTREqaA http://t.co/4bntV3kFXy @jathansadowski interesting/horrifying, possibly. @jathansadowski countdown until Oculus Rift is declared by SV the new best reading platform ever: 3, 2.....but really, could be interesting. The Lego Movie is really good. @j2bryson I have a biased sample but many of my friends bonded over video games. Def. not an unalloyed bad... "RT @j2bryson: Not so doomed: computer game play and positive adolescent development http://t.co/PtjSmw04oh •Kevin Durkin, & Bonnie Barber 2…" All things equal, that implies a higher future rate of progress as several complementary modules are "completed" (but things aren't equal). #NAME? 1. Conceptually - what's level of intelligence of system with poor perception but good logic/planning? 2. Practically - many modules are + The main prob I've run into in working on a model of AI progress is accounting for interaction among modules. Thoughts? Two aspects: + Slash Valley "experts" are confident but disagree abt everything MT @aiupdate Americans split on effects of AI/robots http://t.co/nGMCZyuGDS @SuzanneWaldman like the Navajo + Hopi reservations in AZ, marginal cost of grid ~$100k so gov't subsidizes up to 1.8kW systems w batteries. @SuzanneWaldman nah that's puny, missed that. More like 1 kW or so, enough to do real things @SuzanneWaldman yeah...though I've met plenty of ppl who benefited a lot from off grid solar. + not much 24/7 grid in india anyway ;) @SuzanneWaldman seems pretty straightforward...they want more electricity 24/7? Speaking of IBM's announcement, I'll just go ahead and get this out of the way: my CPU is a neural net processor, a learning computer. Point meriting emphasis in the IBM neuromorphic chip thing: they can't do anything other chips can't, they just do some things efficiently. Anyone else watching Extant? @jathansadowski lol and obvi the viewpoints selected are the most extreme. And also, 0 results when I searched "unsure," 1 for "uncertain." RT @j2bryson: Why haven't I seen this CFP before? http://t.co/soCYFRD3Vl Seems everyone wants to corner the market on #AIethics Thanks @M… @nerdsrocket in my defense, I was out of town when it came out ;) but yes. High on the to do list. @nerdsrocket oh and nice poster :) haven't seen it yet. @nerdsrocket lookin snazzy! :) Started on two of my papers at last! Ok, now that I've been productive, I can watch more sci-fi. RT @IBMWatson: #IBMWatson Groomed as C-Suite Advisor http://t.co/pd9lVAoJkh via @TechReview Universal psychometrics: Measuring cognitive abilities in the machine kingdom http://t.co/bf8VRzq5Fy @karpathy independent of time til ~human ish AI. Main concern is subsequent rate of change, not how long it takes to get there. @karpathy somewhat agree (e.g. Lots of work on cognitive architecture going back decades) but regardless, Bostrom's book's relevance is + RT @elonmusk: Worth reading Superintelligence by Bostrom. We need to be super careful with AI. Potentially more dangerous than nukes. New reading material! :) http://t.co/UPGgGbQD70 Selling mostly (non-truck) electric cars by 2020-2025 is plausible IMO with a combination of gigafactories, new chemistries, and good policy Musk's vision of 200 battery gigafactories is another way of saying sell all electric cars from 2020 on + turn over fleet 15-20 years after. I agree with Musk that this is just the beginning RT @techreview Panasonic Agrees to Help Tesla Build Its Gigafactory http://t.co/8IHDA7hKJu Had a great time at AAAI again this year! On the way home. Now back to reading/writing all the things. RT @nathanjurgenson: the absolute ignorance abt research, ethics, & research ethics that the okcupid guy has is the best argument for outsi… RT @katecrawford: Beneath the tech-dude humour, ('we experiment on you - LOL!') lies the veiled ultimatum ('we own the platform - put up wi… @JohnDanaher ah yes, you did, I just missed it (skimming on phone, at a non-super intelligence conference haha) @JohnDanaher I seem to recall him addressing the maximizing v satisficing objection somewhere there (not nec to our satisfaction, but still) RT @SCSatCMU: Smart regs, good design foster acceptance of robots, says Carnegie Mellon's Knight in @BrookingsGS report, http://t.co/19ZUpn… RT @keithmcgreggor: Automating Science is an AI Grand Challenge. #AAAI14 @smc90 yup/Andrew Ng is quite the coup for them @j2bryson @VincentCMueller I mentioned both of you in an email to the new Pres. (Tom Dietterich) :-) RT @zeynep: Singapore tests if mass surveillance & big-data analysis can be used to "engineer a more harmonious society." http://t.co/Qi0QW… @nerdsrocket MM + space. Contact 2.0!! Lots of work done by AI and non-AI ppl on short and long term societal issues. My map of the terrain here: http://t.co/JT9XTvVI39 #AAAI14 Agree with Veloso at #AAAI14 we should take AI's societal impact seriously. Let's not reinvent the wheel, tho: much good work done already @VincentCMueller now I definitely will. @VincentCMueller ditto. I was actually planning to some day pitch a workshop at AAAI or IJCAI on such things. RT @VincentCMueller: Manuela Veloso, outgoing president of #AAAI14, announces work on societal impact and long term threat of AI in her key… @mgubrud haha well yeah, when you put it that way. Could be framed better. Specifically, w.r.t. capability, not motivation. @mgubrud oh I just meant good ideas are often forgotten and for example, in the case of architectures, cooperation seems way below optimum. Symbiotic autonomy: otherwise autonomous bots that know when to ask for help with what they can't sense, think, do - Veloso keynote #AAAI14 societal impact of AI shout out by Manuela Veloso in #AAAI14. "let's talk about this", recommends proposing workshops. Will do! Eventually @beaucronin sure, any aspect in particular? could write up a preliminary summary when I get home. My email is first dot last at asu dot edu RT @JohnDanaher: Reblogged on IEET -- Bostrom on Superintelligence (2): The Instrumental Convergence Thesis http://t.co/eCrgD8N8C7 @robinhanson haha, I mean at least my predicament is different in degree, not in kind, from that of more disciplinary researchers ;) @robinhanson indeed, as an interdisciplinary scholar this is a pleasant reminder :) E.g. one on why it's needed, one outlining it, one with implications, with some overlap of course. Should keep me busy for a while. + Also, more reasons to think my AI progress model project is worthwhile/I have the building blocks but should prob not cram into 1 paper. 2 personal outcomes from AAAI so far: reminded that within fields, most ppl don't "get" other's work's value, let alone outside it :) + RT @Neuro_Skeptic: Effects of Internet use on the adolescent brain: despite popular claims, evidence is scarce http://t.co/BAX5TIdbNp RT @robinhanson: Adam Ford interviews me on the Great Filter: http://t.co/UESfsIPQ6g Nice to see @VincentCMueller bringing philosophy, ethics, + the future into the discussion at #AAAI14. Referenced his/Bostrom's poll results @JohnDanaher yes, though he is specifically trying to provide counter to dominant naturist discourse so it must be read in that light @JohnDanaher finished it* @JohnDanaher Prinz's Beyond Human Nature is good so far though I haven't read it. RT @katecrawford: “The fact that something happens all the time is almost never an argument for it being ethically defensible.” https://t.c… Breazeal: (main? One?) purpose of Jibo is open, real world, cloud connected social robotics platform for HRI/other research. Breazeal (discussing Brad Knox's work): autonomous robot playmates comparable to Wizard of Oz in child engagement, both >> tablets. Now she is talking about robots as learning companions. Any literacy/Jibo connection? Breazeal: kids given tablets with curated educational apps show big improvements in various ways. Can we build meta-app to improve learning? Cynthia Breazeal talking about global literacy and her experiments to improve it in impoverished areas. Def more important than Jibo! @mgubrud e.g. the stronger theoretical foundations could also make the agent more predictable or controllable. @mgubrud slash that would further support belief in faster future rates than now, anyway. doesn't mean we should accelerate integration tho @mgubrud reasonable but currently not true, lots of reinventing wheel. Maybe a sufficiently advanced AI would but that could beg question(?) Call it module overhang. Related: theoretical overhang...later AI progress/integration will have stronger theoretical foundations than now. That argument has many problematic assumptions but just thinking out loud... #NAME? Computational overhang (discussed in e.g. Bostrom's Superintelligence) is not the only reason to think AI progress could be faster later; + @SuzanneWaldman @toxicpath well, no one does, really. But the Solana plant has a decent amount haha :) RT @ashk4n: Yikes. @okcupid responds to Facebook controversy with new blogpost/data: Get over it, "WE EXPERIMENT ON HUMAN BEINGS" http://t.… + that the way the Russell/Norvig textbook is used leaves much to be desired. Don't skip the great last two chapters!! Point made in cognitive computing workshop yesterday: AI often taught as discrete algorithms, not unified field/vision (yep). Also, I'd add+ We really need to be able to move beyond that level of discourse, especially those who are in a position to make a difference. Had a disappointingly generic convo with another AI person: "we need to work on human-level AI; but it's sci-fi so don't worry about it" :-/ RT @KevinBankston: Tomorrow! Massive @OTI report on "Surveillance Costs: NSA’s Impact on the Economy, Internet Freedom & Cybersecurity" htt… RT @NeuroPolarbear: Easy fix: yes, we all use 100% of our brains, but Lucy can use 1000% of hers! RT @TheAlexKnapp: .@mpigliucci Never get tired of people who dismiss the relevance of philosophy promulgating arguments philosophers destro… @VincentCMueller you here in Quebec? I'm at the cognitive computing workshop currently. RT @jrbarrat: Scientists Are Afraid To Talk About The Robot Apocalypse, And That's A Problem http://t.co/bz21Nc92Yg via @sai @nerdsrocket I recognized more of it than I expected. Love the music!! :) and what's her name, Winona Ryder's character. And Alec. Baldwin!! @nerdsrocket + "Charles, we're here to see some ghosts." that guy!! haha @nerdsrocket watching Beetlejuice for the first time in like forever :) @danieldewey I was thinking about that today when I saw someone with one! @knewscript @nerdsrocket @AliMattu @zeustoves yep, about robots and space and stuff. Spielberg is executive producer. @knewscript @nerdsrocket @AliMattu @zeustoves anyone else seen Extant? Halle Berry and robots, 'nuff said. @robinhanson I'll send an email. :) @robinhanson your view seems to follow logically from your theory of intelligence, his concerns from view that modules aren't (nec.) equal. @robinhanson a huge boost in fluid intelligence, and in turn general intelligence, then it's plausible. @robinhanson recalcitrance levels, and (related) the requirement of huge innovation processes. If, e.g., huge boost in working memory -> + @robinhanson 1. not sure the entirety of the book's relevance hinges on weeks-long transition, but anyway, 2. difference seems to be re: + RT @robinhanson: Re Nick Bostrom's new book, I still don't get how one project can innovate faster than rest of the world put together http… RT @JohnDanaher: When all the jobs belong to robots, do we still need�jobs? via @BoingBoing http://t.co/nPCMxzS4VM @jathansadowski yeah, it's not 100% anywhere. @jathansadowski outside DC maybe ;) @PabloRedux Not really familiar with temes, but yeah, that sounds like a fair point! @mark_riedl @zookae @boneillhawk will do! @mark_riedl won't be making it to that workshop (sounds great, though!!) but will be at AAAI. Your keynote sounds cool :) "This [MOOCs, ed tech] is a very particular take on learning: the autodidact’s take. We shouldn’t mistake it for most people’s reality" Ibid "Even the autodidact is ... guided by the voices of parents and past teachers, as he roams library stacks." http://t.co/sMEMLUuKyk @PabloRedux @alan_winfield yeah, Bostrom (if I recall correctly) uses FLOPS and his estimated range spans dozens of orders of magnitude :) RT @OlivierGeorgeon: I present the Developmental #ArtificialIntelligence #MOOC Teaser http://t.co/YZycULGyir @univLyon1 #IDEALMOOC +would be helpful for analyzing the economics of AI. E.g. Frey/Osborne 2013 could be redone with a richer model of automation difficulty. This wasn't the (only) reason I began working on this, but a good theory of AI progress over time/state of the art across domains/abilities+ @j2bryson @alan_winfield @wood5y I always thought the diff. was - thought leader = with respect to a field, public intellectual = in general @alan_winfield Look forward to hearing your thoughts! :) @alan_winfield Have you checked out Nick Bostrom's new book by any chance? Some related analysis in there, though less quantitative. RT @alan_winfield: Estimating the energy cost of evolution, and why we won't be evolving human-equivalent AI anytime soon http://t.co/bwuOz… @j2bryson Yeah, it definitely has a very nice, clean design. It's just the eye/mouth thing that I was skeptical of, haha. "This R2 unit has a bad motivator!" - Luke shortly before triggering a perversely instantiated intelligence explosion. RT @j2bryson: Draft book chapter: Artificial Intelligence and Pro-Social Behaviour http://t.co/YvFxBVYJGT final version due late August, co… RT @beaucronin: “Typical errors among [AI] practitioners have been to…overestimate the advantages of their own particular pet project or te… "RT @huwcdavies: Paper - Reverse engineering Google's 'filter bubble' http://t.co/AM87Tkft5B" @beaucronin *best argument. @beaucronin I did the same. Enjoy! Great read, def the next argument of its kind. Can be controlled for statistically or with orphans, twins, etc. Yes, g/IQ aren't everything and can be used inappropriately but still real For example, on intelligence heritability, he says family correlations could just as easily prove social factors matter. V old arg/deal with Somewhat dated args against validity of intelligence measures in chapter 2 ibid). 150 IQ savants are not immune to motivated reasoning :) Today I learned there are estimated to be just 50 or so (!) prodigious savants in the world today (Tammet, Embracing the Wide Sky). @zeynep @pomeranian99 reminded of Vonnegut 62 (!) years ago “First the muscle work, then the routine work, then, maybe, the real brainwork.” RT @zeynep: I think robots taking over caregiving jobs is a bad idea, and check out @pomeranian99's smart notes in the margins: https://t.c… @jjhikes @robotenomics it isn't so much that we need "better"/real AI to make those decisions as we need *different* AI along those lines. @jjhikes @robotenomics yeah, that makes sense, though I'd still add the point about transparency (/human-comprehensibility) of decisions + #NAME? Even that claim, though, I'm not sure abt. since you can do lots of fancy things w [x]POMDPs. Better claim still: driverless cars should be+ Will also need capacity to reason about social/legal/ethical norms directly or indirectly, which in turn require richer representations(2/2) More specific/plausible version of that claim: socially/ethically acceptable driverless cars will require more than just POMDPs and ML (1/2) People recently have taken to saying "driverless cars require real artificial intelligence." Not sure such ppl know what they mean by that. "RT @cns_asu: The next JRI issue is now available online: http://t.co/rBbWrmQ3GC #RRI #ResponsibleInnovation http://t.co/8HpGU8iRu6" RT @sandsfish: In one study, 62.5% of participants were not aware that their #facebook news feed content was mediated by an #algorithm. #be… Volume 1, Issue 2 of the Journal of Responsible Innovation is out! http://t.co/TH0rnioouz (Cont'd) namely, that for work on modeling/automating social skills generally, stuff written by/for autistic ppl could help bc so explicit. From Tammet's book, Embracing the Wide Sky (good so far). I've been saying something similar for a while (cont'd) http://t.co/pVbRlEpeTq @Ahaverine congrats!!! RT @Ahaverine: It's official! My PhD thesis is now online, feel free to download a copy and rt: https://t.co/jZvREj6Ohf #phd #digitalcultur… @petitegeek ahhh that's so awesome!! Congrats! @petitegeek :) yep! Good luck with the job hunt!! I'm sure you'll end up somewhere awesome. @petitegeek @himisanta @WomenWhoCode sounds fun! :) I take it you won't be making it to AAAI then? Who among my tweeps will be at AAAI-14? I get in Sunday! :) @petitegeek @himisanta which workshop? @yksnpnwrbrhsa (see subsequent 2 tweets) @yksnpnwrbrhsa yup. Clever way of slipping in the assumption that "needing work for income" is OK and we shouldn't rethink the role of gov't *too* much. "challenge for econ. policy will increasingly be generating enough work for all who need work for income, purchasing power and dignity." Don't get me wrong, there are some plausible args for the intrinsic value of work, I'm just surprised Summers didn't even bother to make em. Oh and if we don't have enough jobs, this will cause problems because when people are out of work a long time, they can't get new jobs. Huh? Something something universal expectation of work, dignity. Larry Summers: tech kills jobs, but we're making plenty of stuff. we need to fix this because (? no reason given) http://t.co/6SJXNXQe6Q /more fine-grained distinctions. Doesn't mean a system doesn't become more intelligent if run faster, just that the difference btwn general/narrow itself isn't just speed. More of the former than the latter, though "In the whole spectrum of cognitive abilities, some can be classified as characteristically *level* abilities, others as *speed*." Carroll While speed obviously is important, more important at moment is the wide range of tasks machines can't do given unlimited time and we can. + can and can't be souped up just with running the AI faster? (Well, with present AI- very few. But this could change) Also, interesting discussion of speed v ability level on tests in Carroll. Related also to Superintelligence. What cognitive abilities+ + cuz there were lots of studies involving it. Carroll didn't think perception was cognitive. But v important progress domain for AI. +model of intel in general that could be (cautiously) compared with AI, but not its goal obvi. E.g. Carroll only included visual perception+ Reading Carroll's Human Cognitive Abilities. As I mentioned previously, the CHC model (based partly on that book) is a good first pass Anyone interested in the future of AI, humanity, life, etc. should read Bostrom's book Superintelligence. Def a book to be reckoned with. @danieldewey haha hmmm! Interesting, guess it partly depends on how good of investors people are. I've seen some v stupid AI/bot stuff there @j2bryson it also looks HAL-like/evil to me, though maybe I am in the minority. Not sure if it would be more or less creepy in real life. RT @JohnDanaher: Reblogged on IEET -- Should we have a right not to work? http://t.co/34nfEukrYj @nerdsrocket I've wondered that many times. Let the world know if you figure it out ;) RT @rcalo: I'm sure @cynthiabreazeal is working on a privacy policy for @JiboRobot. And if not, she should call me. RT @JustinBrookman: JIBO's FAQ does say that they take privacy "very seriously," however. So there's that. RT @JustinBrookman: Adorable robot JIBO that uses biometric ID and uploads constant data and video to the cloud does not have a privacy pol… Will also be interesting to compare Bostrom's to Floridi's (less existential) AI ethics concerns in their respective magnum opera. + excited to be getting to the part most closely related to my interests (science/technology policy and what to do about this AI stuff). :) Onto the penultimate chapter of Bostrom's Superintelligence. So far, lots of original args as well as great summary of MIRI/FHI arguments..+ @PabloRedux Esp. considering the vast array of interesting responses at the end :) I'm about halfway through the target paper myself... "[T]he dynamic between genes and their host organism is analogous to the relationship between goals and the individual pursuing them." Ibid. The Selfish Goal: Autonomously operating motivational structures as the proximate cause of human judgment + behavior http://t.co/2sxqheWi4M @nerdsrocket agreed!!! :-) @nerdsrocket of course! Twice actually :) RT @AliMattu: For the last time, WE USE MORE THAN 10% OF OUR BRAIN! http://t.co/TwrQ8jwAo1 #psychology RT @heatherknight: The MIT prof that got me into robotics, Cynthia Breazeal, launched a company today! Check it out: http://t.co/tTPrnlAXkx RT @petitegeek: Thanks, @VulcanPost for the fun interview! :) http://t.co/AGFNkrLnlI RT @sapinker: Time 2 lern grammer & hire a cunning linguist, u morron- hilarious prescriptivist spoof of Blurred Lines by Weird Al- http://… Enjoying Bostrom's Superintelligence so far...now for the chapter on different types of superintelligence. :) RT @AndrewYNg: Deep learning has 13/13 streak for World Cup predictions. Check out Baidu's remaining predictions! http://t.co/06Rqe44J9D RT @danieldewey: A poll of 4 sets of AI academics about the future and impacts of AI: http://t.co/qYhgL3qpoy by @VincentCMueller and Bostrom "A Survey of Research on Cloud Robotics and Automation," by Kehoe, Patil, Abbeel, and Goldberg http://t.co/67pEFi7emP @rj_cubarrubia Eurydice Fun month of reading/thinking/writing ahead! :) http://t.co/KNJfxc7Z1R RT @alan_winfield: My Next Big Things in Robotics. Blog post http://t.co/NfAK93QeYw and chapter 5 here http://t.co/37llYNRPaC @AliMattu @NerdHour yay!!! Happy to be of service :-) Looking forward to getting my copy of Superintelligence by Bostrom on Monday! :) RT @Floridi: “The Fourth Revolution: How the Infosphere is Reshaping Human Reality” is out: http://t.co/DOO2rwf8CN @alan_winfield thanks! @paulonabike nope, it is now, thanks! Just skimmed it and seems quite good! :) RT @Floridi: Bits of a longer interview with Financial Times: "Google U-turn over deleted newspaper links" http://t.co/TnQes6WuqD Spoiler alert: I'm working on an AI progress model with not just off-the-shelf parts ;) but will take a while. Lots to learn from human int. Arguably, some of that could be dealt with under McGrew's proposed broad ability, "domain-specific knowledge," but some of it is fundamental If I were building an AI progress model just from off-the-shelf parts, I'd add to CHC some of this as broad abilities http://t.co/SqZmWGS9Vm #NAME? The CHC model of human intelligence is a surprisingly good first approximation of a model of progress in AI, though that isn't its purpose+ @paulonabike haven't read that.. bookmarked! @paulonabike sigh. part 3 here looks particularly cool: http://t.co/BdPCmD5xiu @paulonabike scientific change/progress that I'd love to read at some point. Need more time. :) (2/2) @paulonabike hmm sounds plausible! I suspect philosophers of science have many things to say there. Have a few books on theories of (1/2) @paulonabike not sure that's really distinct from other theory formation. Someone has probably said something related, not me, though.. :) @paulonabike hehe raises the question: what is the (type/extent/etc. of) creativity involved in grand synthesis, which is what the book is? + standards -"the finest work of research and scholarship I have read"..etc. Cited everywhere. Just got my copy, hope it lives up to that :) The praise for Carroll's 1993 book Human Cognitive Abilities: A Survey of Factor-Analytic Studies is high, even by close academic community+ RT @techreview: IBM: Commercial Nanotube Transistors Are Coming Soon http://t.co/bywl11HxXJ RT @rcalo: We're not ready for robots. @megangarber writes up her captivating interview with Missy Cummings http://t.co/Q80yjbV4b1 #AspenId… @jonWturney You mentioned most of the classics! I'm a bit easier on Asimov bc of, e.g. Naked Sun and his great essays in Robot Visions :) Jaan Tallinn discusses DeepMind and MetaMed with Adam Ford: https://t.co/trjOka95oS Quote in last tweet from @jonWturney's sci-fi chapter in Our Work Here is Done: Visions of a Robot Economy. "Work is not an aspect of life which science fiction often deals with convincingly or well – something it shares with [other literature]." Though the reasons our fluid intelligence doesn't increase over time are different from the reasons AIs are bad at fluid intelligence now. Lots of evidence for stable/decreasing fluid intel., stable/increasing crystallized intel. w/ aging. Separability = good news for AI safety. One of the more interesting distinctions in the lit. on human intelligence is fluid vs. crystallized intelligence - AI better at latter now. RT @jathansadowski: "If one must be either a popularizer or a "true" scholar, no wonder many faculty members react harshly to the former" h… RT @jathansadowski: "A More Nuanced View of Legal Automation" — good, though-provoking post by @FrankPasquale http://t.co/mSUvYUCHj8 cc @Mi… "Designing a Universal Interfacing Agent," Josyula, Anderson, and Perlis, 2005 http://t.co/lgi7usjqAE Speaking of IHMC, ICYMI their Hexrunner set the new land speed record for robots, beating Google-Boston Dynamics ;-) http://t.co/jttUzVrLzN So now that Google-SCHAFT is out of the DRC, my prediction of IHMC doing well has retroactively improved, they won rounds 1 and 2! ;-) RT @Recode: Google Standing Down in DARPA Robotics Challenge / by @jtemple / http://t.co/TRPWHLJZPL @danieldewey thanks for sharing! I had missed one of those op-eds and some of the slides. + looks like the AAMAS workshop was very cool! RT @danieldewey: Russell's index of his work on the future of AI: http://t.co/5buTloPjeL The "Risks of General Artificial Intelligence" special issue of JETAI is out, edited by @VincentCMueller: http://t.co/QZ8Ua6qV4U with the specific goal of being able to reduce risk from that tech, "buying a seat at the table" - Jaan Tallinn, Elon Musk = examples (2/2) Interesting un(/partially)told story at the intersection of #responsibleinnovation and #xrisk is rich people investing in AI companies(1/2) I wouldn't even say that it's more relevant to AI progress than, say, evo psych or neuroscience, just that its relevance seems ill-explored. #NAME? What I hope such analysis would help with is more empirically grounded (in what's funded/attempted and demonstrated) and theoretically...+ Bringsjord's paper Psychometric AI is a good example of thinking in this vein but there is surprisingly little connection between the lits. #NAME? Example of AI progress stuff that could benefit from more cross-disciplinary fertilization: measure AI progress by task? Battery thereof? + Particularly looking at the relevance of the lit. to evaluation of AI progress (past/present/future, including its nature/pace/drivers). Preliminary conclusion based on deep dive into the literature on human intelligence assessment/theory is that it is super relevant to AI. RT @petitegeek: Would You Want Therapy From a Computerized Psychologist? The Atlantic http://t.co/0eOt1vYB9l How about this app for #Pepper… @soundbytelife cool!! :) To be sure, there are lots of planning/memory approaches in AI/robotics, but better/faster simulation seems like a big part of the solution. variety of dynamically interacting cognitive modules... AIs: super fast low-dimensional search over states/features thereof. May converge. + cooking that capability into AI systems, though in a different way. Humans: emotion-rich processing of detailed scenarios with a huge + One big difference between humans and other animals seems to be mental time travel for learning/planning. Interestingly, we are already ...+ @danieldewey paper you may find interesting on related issues - http://t.co/6y1NFVrBPc ICYMI - "Our Work Here is Done: Visions of a Robot Economy" http://t.co/TFQOSFGmMH RT @ArtificialOther: Daniel Keyes, author of Flowers for Algernon, has died http://t.co/BtfrlAIGT4 RT @GenerationMeh: As a child, parents reassure you that your life will be okay. As an adult, it's you reassuring your parents that your li… Pundits who like to talk about how you can't store solar energy should visit the Solana Generating Station where they store solar energy. @nerdsrocket congrats!! :) @petitegeek thanks!! The HRI lab at Tufts has some cool new papers, including several making the case for machine ethics: http://t.co/xSe8huwiQG "Action understanding as inverse planning" - Baker et al. 2009 http://t.co/ouWksgW0Vb As that article makes clear, and I also discuss here (http://t.co/rVkqVtumfq), work could suck a lot less, and tech isn't the main factor. "For most of us, in short, work is a depleting, dispiriting experience, and in some obvious ways, it’s getting worse."http://t.co/vvVaZ2SwBm One can agree passing an indefinite Turing Test would be very impressive while also thinking it'd be really stupid to focus on such a goal. RT @PJ_Muncaster: Ray Kurzweil response to claim that chatbot Eugene Goostman passed the Turing test: http://t.co/1CgiNFTue8 @nerdsrocket haha :) @nerdsrocket yay! Any Watson discussion? Just don't expect a coherent viewpoint. Fine by me - lots of interesting stuff, some portion of which is relevant to AI. :) The Cambridge Handbook of Intelligence is great for what it is - a whirlwind tour of many literatures with good references. Daily Show segment on Google Glass with Jason Jones - Glass Half Empty http://t.co/VQLP1hzp1K RT @danielwilsonpdx: Err.. Ask Me Anything at this link, I think, what? I'm new to this! http://t.co/Fc3VEDQoOi The site for Cog Sci 2014 now has a schedule and workshop listing. http://t.co/GOFROZP2bn @j2bryson loved, not sure whose it was though (?). Speaking of Wilson, just got his Robogenesis (sequel to Robopocalypse which I recommend) @j2bryson yeah, there are some better ones later that should be upfront. There was a short story in some AI journal or proceedings that I + @j2bryson the Robot Uprisings volume edited by Wilson and Adams? I'm reading that now. Love that there is a story by John McCarthy. RT @BillGates: The most staggering statistic in @VaclavSmil’s new book: http://t.co/2N6cpXQsJ5 http://t.co/QPcBscSLXj RT @beaucronin: Machine intelligence is deeply embedded in and constrained by larger systems of human nature, behavioral econ, collective a… @petitegeek sweet! @petitegeek what's the stuff with the big robots at the end? :) That being said, obviously the world is its own best model so Cruise's simulator beats AIs/'ours. But we can do a lot better. @BKneuer yeah I think so. Definitely more blockbuster-y, more laughs, etc. Both are about equally well explained haha + 2 places at once. As shown by the Mimics, this can be emulated w/ communication. So future AIs may be similarly badass but by other means. While we, other animals, and AIs can't relive things, we can imagine and evaluate possible scenarios. Also, Cruise can effectively be in + Anyway, Cruise's superpower stems from a time loop but the result is ~superintelligence: highly effective perception, thinking, and acting. Saw Edge of Tomorrow. First of all, good movie. Doesn't overdo the time loop gimmick and it is somewhat coherently explained. "Why Eugene Goostman Did Not Pass the Turing Test" by Jack Copeland http://t.co/JU0bVlVmxE via @HuffPostUKTech RT @jathansadowski: Creating a Taxonomic Tool for Technocracy and Applying it to Silicon Valley http://t.co/gWFb1V3VN4 Forthcoming article … "Technological unemployment is what we have been planning all along, by relying on animals, other humans, science, tech,. capital..." Ibid. "Technological Unemployment, Leisure Occupation, and the Human Project" by @Floridi http://t.co/pF2ma0InYj TL;DR - get freedom right and justice, democracy, and sovereignty take care of themselves. BUT ppl have way too narrow a view of freedom. Just Freedom by Pettit is a solid primer on small-r republican conceptions of freedom. Can't speak to this vs. other stuff by him. RT @mdichristina: What comes after the Turing test? asks @GaryMarcus http://t.co/bFbJ1MvWCM Re "Eugene Gootsman" + of the infosphere." Floridi's The Ethics of Information. As mentioned before, prob boring for most, but essential for those interested. "IE [information ethics] is an 'architectural ethics,' an ethics addressed not only to the users but also to the creators and designers + RT @tsimonite: Seems that a social psychologist's take on the Turing test "pass" would explain more than any AI expert's. RT @mark_riedl: Dear The Internet: This is not the first claim to have passed the Turing Test. This bot likely doesn't possess general inte… RT @patrickc: (Why this is a bad idea: http://t.co/fDIS3kN4Bq.) @OddLetters three eps. left! So good. @mark_riedl @j2bryson he does briefly mention 5 mins/70% but (I would like to think?) in a thought experiment sort of way. RT @Recode: #mustreads from other sites: What Oculus Rift and VR Mean for Sex, Death, Violence and Identity / by @jeffgrubb / http://t.co/q… RT @aeonmag: Specialisation is for insects - anyone can learn to be a polymath: http://t.co/NIPRCQNUXS RT @MelMitchell1: Good article: “Do we really need to learn to code?”: http://t.co/QxWrqGkTcm @j2bryson @mark_riedl yeah, that's a big difference :) I was mainly thinking of the 5 minute and 70% threshold parts as being the same. @j2bryson @mark_riedl for sure, I just doubt he'd consider passing the test that central to AI...maybe he'd be more impressed by Watson. :) @mark_riedl @j2bryson think he imagined a generally intelligent system being tested, not chatbot - 13 yr old thing makes ignorance plausible @mark_riedl @j2bryson on paper it seems to meet most of Turing's original criteria (though doubt they were intended to be used that way), @rachelmetz @rcalo the 13 yr old thing just helps make its ignorance plausible. I'm still w/ Hayes/Ford on the TT - http://t.co/eDgE2BwjGK @j2bryson @robotenomics just did - I'm generally with Hayes/Ford on the relevance of the TT (http://t.co/eDgE2BwjGK). @j2bryson @mark_riedl Hawking thing sounds cool! RT @katecrawford: Here comes the deluge of ahistorical claims about the Turing Test being passed. http://t.co/01Ajq0je5z @mark_riedl Same, though I've never been a big fan of the test as an actual thing vs. a thought experiment as part of an argument, anyway.. I have many thoughts on this, what do you think? http://t.co/IIhW7xOTvj calling @j2bryson and @mark_riedl :) maybe worth writing a thing on. RT @patchurchland: The report from the Brain Initiative committee is out. Sensible, visionary, clear, and logical. http://t.co/6jatfYzdBb @nerdsrocket can we talk about Crazy Eyes being awesome? RT @JohnDanaher: Is Modern Technology Creating a Borg-like Society? http://t.co/SKldwc34oK @abetidwell Yup! :) @mark_riedl Exactly. We should have to make a choice to use it, and it should be biased against being used, especially for big decisions. + doesn't aspire to big things, and is reluctant to act in a way that makes a big impact on the world. In short, anxious and depressed. The safest superintelligent AI would probably be one that is constantly unsure about its goals and needs constant assistance/reassurance, + resources to act on your choices, 2. regardless of which preference you happen to have and 3. regardless of what others want you to do (2/2) Enjoying Pettit's Just Freedom, on freedom as non-domination - TL;DR - a choice is free to the extent that 1. you have the room and (1/2) RT @intel: The first Intel "Pentium" processor debuted in 1993 at a speed of 66 MHz. #MicroHistory @nerdsrocket OMG. Thanks. People at Comicon and in the AI/sci-fi session are a very self-selected group, but anyway, they had especially good questions. AI/sci-fi panel at Comicon went well, tons of questions. People always have q's about machine ethics- it's at intersection of lots of stuff. @petitegeek wow, that's like the coolest thing ever :) congrats!! @jathansadowski nice!! @petitegeek Thanks for tweeting all of this! :) Was your work involved? Will be on the By Your Command (tomorrow) and Astrobiology of Mass Effect (Saturday) panels at Phoenix Comicon. Should be fun! RT @Floridi: #RTBF Depressing to see how abusive and vicious human communication can be when unleashed http://t.co/zvjUYgZljv @jathansadowski of their own jobs' necessity/automatability - inertia, inefficiency, laziness, also plausible. But agree w/ much of rest. @jathansadowski ya that's what I was referring to. Don't think a grand explanation is needed, or that ppl are reliable judges (1/2) @jathansadowski Thanks! Not convinced about the BS job thing - could also be called examples of inefficiency - but agree w much of his POV. @knewscript @zeustoves @nerdsrocket @AliMattu So, I loved the new X-Men! @jathansadowski Very well deserved! RT @davidad: My answer to Is the C. elegans nematode suitable for a Kurzweilian Singularity mind transfer? http://t.co/4YJ81xeSag @AliMattu or someone knows and we're just not that observant... ;) @AliMattu haha good question! RT @SlateVault: From an Anti-Slavery Alphabet for kids, 1846 http://t.co/Tg4I6rxYFi (A similar document: http://t.co/cH0LHr7gzf) http://t.c… Speaking of Floridi's books...looks like he's advising Google on the recent EU "right to be forgotten" ruling. http://t.co/9ef5guKjyB This 5 minute video is a succinct summary of optimistic techno-hype (good luck with "infinite computing") https://t.co/k5XaWdKEws @nerdsrocket yay!! :) @nerdsrocket haha how was it? @nerdsrocket A-Trak, my fave DJ/remixer. Oh well haha , I forgot about it til you mentioned this ;) IMO sleepwalking into no work could prob be a disaster, but so could sleepwalking into most futures. Should consciously manage transition. Asimov's non-fiction essays in Robot Visions and elsewhere also cast some (necessarily speculative) doubt on the no-work-pocalypse scenario Philosophy and the Problem of Work: A Reader is a good reference on the last few tweets. Start with satisfaction is good, human well being is good... Not one possible means to those ends and one that demonstrably sucks for many. The case for the instrumental value of work today is much stronger than the case for its intrinsic value/priority over other modes of life. "Work is good" says guy with great job. IMO that should be a conclusion, not a premise/foundational principle. http://t.co/r9V5kKTjFw @nerdsrocket did you make it?? Most of it doesn't depend on overpop., tho - that's just 1 catalyst for gov't motivation to increase order. Recommend (re)reading BNW(R) His point about BNW>1984 bc positive reinforcement, environmental structuring, etc more efficient than punishment timely - see nudges. Lots of still relevant ideas in Brave New World Revisited (not to mention BNW), need for "education for freedom." Overpopulation centric tho "Permanent crisis justifies permanent control of everybody and everything by the agencies of the central gov't." Huxley, BNW Revisited ('58) "RT @went1955: LOL! Cartoon Google unveils the driverless taxi by @MartinShovel No more ""My taxi driver told me that....""? http://t.co/NAxR…" RT @AshFrieds: A Kickstarter where you donate yearly based on your income and they build roads and hospitals and your kids can go to school… Would only recommend on a need to read basis. His Very Short Intro to Info. and his next book this year are more general purpose. Floridi's Philosophy of Info. and Ethics of Info. (2 books) are long slogs but very well written for what they are (serious philosophy). "The Future of Technology: Benefits and Risks"- cliche title, but anyway, Future of Life Inst launch/panel discussion http://t.co/FPwHZcKvJl @nerdsrocket For what it's worth, I did the exact same thing one time and it sucked, so I feel ya. @nerdsrocket Nooo! Sorry to hear. :/ This is why everyone needs an Iron Man suit. @nerdsrocket Enjoy!! RT @rcalo: Pentagon releases hack-resistant drone.http://t.co/RF3RiKXKYs Work by my @UW colleague & co-director @yoshi_kohno "The errors, insights and lessons of famous AI predictions – and what they mean for the future" by @FHIOxford @xuenay http://t.co/Yqc1kD5gtV RT @eboyden3: Our course on Brains, Minds, and Machines at the Marine Biology Lab will be webcasted live. http://t.co/RdhIwYa0an https://t.… "The fate of information in the typically American world is to become something which can be bought or sold." - Norbert Wiener, HUOHB, 1954. RT @TeachGuz: "Portrait of a Young Man with Down Syndrome" - the search for employment http://t.co/8anRnNEqUQ + change your environment to be more motivating. Don't expect more motivation in future, learn to do it anyway, focus on mood rewards. TL;DR- ppl vary in mid-exercise moods but ~100% feel better after; various ways to improve former if exercise sux 4 U and savor latter more. That's from Exercise for Mood and Anxiety by Otto/Smits - nice, quick read summarizing research on exercise/motivation/mood- very practical. "If you exercise to improve your mood now, you will not encounter the same delay in reward as if you were exercising for future fitness." @knewscript @zeustoves @nerdsrocket @AliMattu Scotty and Bones save it, IMO. RT @j2bryson: re twitter data RT @bkeegan: @David_G_Rand Flat out false title: it's actually 6 teams out of 1300 who applied. https://t.co/… Why Men Don't See the Harassment Women Experience. Yes, All Women. http://t.co/D6bVriT6IW via @slate @jathansadowski sucks seeing people waste money like this. ~0% chance of impact promised. Same w some AI/bot funding campaigns. What to do? RT @j2blather: RT @kxtenxsh: "@MReed1970: #YesAllWomen http://t.co/DjucjGC5M2" finally RT @j2bryson: US universities team up to make Designer Monkeys—in China. “Are Humans Next?” #ethics http://t.co/F3kFo9vyIk ht @ArtificialOt… @knewscript @AliMattu @zeustoves @nerdsrocket there's probably some stuff on Battlestar Wiki, I haven't read/written anything though. @AliMattu @knewscript @nerdsrocket @zeustoves ditto re: time-travel :) "Attitudes and Personality in Trust of Intelligent, Autonomous Agents" - Atkinson and Clark https://t.co/s9RkxW7UAH @nerdsrocket @knewscript @AliMattu @zeustoves early reviews of X-Men are looking solid! :) Who's gonna see it? @knewscript good, thanks, you? Been light on Twitter lately, traveling and reading a lot this summer :) RT @MarkMuro1: Are Tesla's plans for a giant battery factory realistic? See what the experts told The Wall Street Journal. http://t.co/hLlr… RT @jathansadowski: On the hidden politics and ideologies of the "maker movement" http://t.co/bT4urxreEq New piece from me and @paulonabike "RT @ra: how to use twitter 1. tell a robot a joke 2. wait 3. the robot will tell you if some people laughed or not 4. you are alone in your…" RT @GerardJRego: Google Has Acquired Quest Visual, The Maker Of Camera-Based Translation App Word Lens http://t.co/Z4whdXMSoa via @techcrun… @mgubrud recommend any good articles on the meeting? I just know a few miscellaneous things from twitter... RT @danieldewey: Christof Koch (Allen Institute for Brain Science) and Stuart Russell on machine superintelligence: http://t.co/RBLo82NdWv RT @tariqkrim: Person of Interest Shows Us What Techno-Fascism Really Looks Like http://t.co/jRm1yGHtp8 (spoilers ahead) RT @TheAtlantic: What would the end of humanity mean? Most people don't care http://t.co/exXhtdH0q8 RT @JohnDanaher: The Case Against Killer Robots http://t.co/uT1Mr4wMhV via @ForeignAffairs RT @danieldewey: Slides from a new talk, "What could we do about intelligence explosion?": http://t.co/zCDVJtADVq @jathansadowski not recently: http://t.co/WOD06EyD7D RT @mgubrud: 2 yrs ago it was too soon to stop #killerrobots, now it's too late. Fortunately, in between @bankillerrobots campaign got star… @AliMattu @NerdHour everyday RT @jgcarpenter: Yay, @martincbsmith! Well-deserved coverage. http://t.co/e3QNBfZVNu #robots #ethics #emotionaldesign #artificialintelligen… About the same proportion of the general public as AI scientists (~1/3) anticipate negative outcomes from AI: http://t.co/H7upLJq1Ux RT @erichorvitz: Stephen Hawking's mention of AI brings to mind Asilomar AI study: http://t.co/SgQIxbSiuv with more details here: http://t.… @nerdsrocket It also makes me contemplate how unhip I am - I've never used it :) or Pinterest, or Instagram... @nerdsrocket Haha, considering the reactions I get when trying to summarize it, I wouldn't be surprised ;) RT @24kgoldsher: My 1st ever peer-reviewed paper is up at @gnovisjournal now on innovation and sport: http://t.co/OHwWiGyYbc #sts #technolo… RT @petitegeek: 20 TED Talks by Women in Computer Science (playlist): http://t.co/ihDzRpxvVX RT @mgubrud: Transcendence, the movie, reviewed by Yours Truly at Futurisms: http://t.co/28CpwO5mjq @Ahaverine yep - Robin Williams plays a guy who edits people's life histories from implants for funeral vids - seemed up your alley :) @Ahaverine have you seen Final Cut? @OddLetters biggest Y possible @nerdsrocket don't think so, but worth tracking down! :) @TeachGuz haha it's okay, I tweet spoilers all the time ;) I'm just sad I can't watch orphan black for a few days! @TeachGuz agh spoiler! ;) @TeachGuz same! "Whereas the short-term impact of AI depends on who controls it, the long-term impact depends on whether it can be controlled at all." Ibid Transcending Complacency about Superintelligent Machines - Hawking, Russell (kind of a big deal in AI), and others http://t.co/EueYS4aXtU @nerdsrocket you seen Another Earth? @nerdsrocket obvi @zeustoves I guess they're all at Sakura-Con lol I'm in Seattle for other reasons but the city is full of cosplayers everywhere right now. RT @gleemie: Just noticed that Google no longer lists "don't be evil" as one of its core values (though the phrase lurks in its corporate d… @nerdsrocket yup it's Sakura-Con. My parents were utterly confused by all the cosplayers on the street. The reviews of Transcendence are spot-on. Some good ideas and visuals but poor characters and plot. Better than I feared, worse than I hoped RT @patrickc: When helping people learn to code, about 60% seems to be helping them through PATH and stupid library installation issues. Saw Judge Dredd walking down the street in Seattle (some kind of convention I guess) and thought of @nerdsrocket. And Power Rangers, etc. :) @jathansadowski alas I'm out of town this weekend :/ RT @alicebell: This is ace. Your penis is getting in the way of my science: http://t.co/tMwcaaEIZM #NAME? Paul Churchland on zombie argument begging the question: back in the day one could have said - imagine world with electromagnetic waves all+ @j2bryson @FHIOxford existing and life with less Y is still worth living, I'd be grateful. So depends on X and Y (and other stuff). :) @j2bryson @FHIOxford re: New Hampshire: If ancient Greeks avoided X risk by reducing Y freedom and not doing so would have meant us not + @j2bryson @FHIOxford dunno, but the probability need not be very high for avoiding them to have high expected value. There are, of course, exceptions to all of these "rules," but there is a kernel of (descriptive, not normative...) truth in each, I think. The 6th rule of US science policy is that you must acknowledge the huge role of defense funding but not think too hard about changing it. The 5th rule of US science policy is you must call for taking ethics seriously and then not do so and ignore lessons from prior efforts. The 4th rule of US science policy is you must exclaim the value of basic research and then forget it happened and only praise entrepreneurs. Third rule of US science policy is you don't talk about US science policy except to say we need more money for science. First rule of US science policy is it's basically just science funding policy. Second rule is that it's decentralized, plural, and reactive. RT @FHIOxford: How close are we to machine intelligence? Nick Bostrom discusses the movie Transcendence and the coming century http://t.co… @JohnDanaher def. I read it as well and have mixed feelings. I'm just sensitive to the speculation thing bc my work is very future-oriented. @JohnDanaher also think he misses the point about post-persons. Singer would prob say saving the cat is wrong. If not, then def. an insect. @JohnDanaher also, Miller and Bennett 2008 on sci-fi specifically. Seems the "too speculative" point comes up independently in many fields. @JohnDanaher discussion paper and responses here http://t.co/pi2WXre7hg deal w/ the speculative thing somewhat (I'm on the Selin side here). RT @Floridi: Big Data, Smalll Patterns, and Huge Ethical Issues, BJET-Wiley Seminar, March 2014: Luciano Floridi - YouTube http://t.co/bpEB… @nerdsrocket yes! RIP old Nickelodeon. RT @nerdsrocket: The Quiet Radicalism of "All That" http://t.co/kTGZ4Gqqeg #nickelodeon @Ahaverine awww :) @Ahaverine multiple pups?? i'm jealous! :) @Ahaverine dogs are the best RAs. And the book looks cool, too :) RT @techreview: World Cup Mind-Control Demo Faces Deadlines, Critics http://t.co/fE5dnB5gSS It is clearly written but dense with references, ideas, taxonomies, etc. so a slow read, but worth it if you are interested in those topics. I super highly recommend Origin of Mind: Evolution of Brain, Cognition, and General Intelligence by Geary. Epic interdisciplinary synthesis. @nerdsrocket oh and I agreed with you in the podcast about the Firefly companion thing, I totally could see that, too. Def a compliment! :) My paper, "Limitations and Risks of Machine Ethics," is now open access at JETAI: http://t.co/r3OLFRcYCs via @PaulNaish78 @PaulNaish78 thanks! @JohnDanaher yep. New issues arise obv but lack of consensus doesn't mean we can't govern stuff. Very narrow view of nature/origins of law. @JohnDanaher lame headline. We don't do X with small effort=/=we can't, and the args put forward aren't good or the best ones 4 the headline RT @royalsociety: New #scipolicy BLOG on the latest #IPCC_wg3 report on #climatechange mitigation http://t.co/SkCxdUMXet @nerdsrocket @knewscript @AliMattu @zeustoves I really liked Europa Report (it's on Netflix). Good hardish sci-fi. Not as scary as I feared. Final draft of the IPCC WG3 report on climate change mitigation is up now: http://t.co/8C5D9hPGKb @nerdsrocket whoa! that's really good. Origins of Violence - good panel discussion chaired by Krauss and Pinker - part 1 http://t.co/mUeAYiSwLz and 2 http://t.co/neCffsGsp9 @danieldewey @j2bryson sounds like a very interesting talk! @robotenomics @CatMKennedy @rcalo @GarryMathiason there are good args in support of the thesis but lack of consensus+complexity aren't them. @robotenomics @CatMKennedy @rcalo @GarryMathiason "we aren't succeeding at X w/o trying hard" =/= "X is too hard" ;) @cthorm @SuzanneWaldman link? "RT @washingtonpost: Reports say as many as 1,200 men have died building infrastructure for the 2022 World Cup in Qatar. http://t.co/pQ40vox…" My paper "Limitations and Risks of Machine Ethics" is finally up at JETAI: http://t.co/bJtRw9bP7B TL;DR: machine ethics is hard. @j2bryson @danieldewey Daniel, could you post your slides somewhere please? :) @petitegeek haha :) @petitegeek haha you're not old. Or at least, you don't look old! Don't know how old you really are ;-) @petitegeek do you recommend that? I've only read Alone Together by Turkle... @Atomicrod @cthorm 90k tons is much less than what a gas plant of that size would put out. @cthorm @SuzanneWaldman oh i thought you meant molten salt for thermal. Well, at the very least we can agree molten salt is very useful ;-) @cthorm @SuzanneWaldman in the long long run, I'm all for thorium, fusion, etc. but in the meantime let's also build 1000's of Solanas. @cthorm @SuzanneWaldman but cost also isn't the only factor, obv., the others we pointed to matter, as well. @cthorm @SuzanneWaldman regardless, I don't deny that nuclear can be much cheaper if done right. I'm anti-anti-nuclear, just not bullish. @cthorm @SuzanneWaldman like what? I don't doubt it's possible in theory, but easier said than done. @cthorm @SuzanneWaldman Solana is $.14/kwh, started construction long ago, has storage. Not universal solution but lots of ppl near deserts. @cthorm @SuzanneWaldman depends on lots of factors, but it isn't outrageously expensive and will get cheaper (not as fast as PV admittedly). @cthorm @SuzanneWaldman Was at a huge coal plant the other day and it is by no means a small land user, nor is nuclear, or anything really. @cthorm @SuzanneWaldman grid adaptation is best reason for solar skepticism IMO. Land, waste, cost (now), etc. not unique. @cthorm @SuzanneWaldman ...and capacity factor is included in LCOE, and solar is still getting cheap very fast. @cthorm @SuzanneWaldman Disagree about baseload, though. Of course, you have to consider capacity factor, but storage helps esp w thermal... @cthorm @SuzanneWaldman I won't even go there on non trivial waste streams in nuke context ;-) haha but yes, nothing is perfectly clean. @cthorm @SuzanneWaldman yeah, second part is more true of distributed solar, though. Utility-scale can be contributor (/is in some places). @SuzanneWaldman @IdiotTracker it's so awesome. I've been around the perimeter of Solana a few times, touring soon. @SuzanneWaldman @IdiotTracker def. not straightforward to do all renewables everywhere, but will & $ aren't abundant soooo...it's tricky :) @SuzanneWaldman @IdiotTracker in some places, that is. I have a Southwestern POV...want us to power the US w/ solar. @SuzanneWaldman @IdiotTracker you could say that about solar thermal, too ;) @cthorm @SuzanneWaldman agree that counts for something, tho nat gas cheaper now anyway and solar is front loaded too. @SuzanneWaldman @IdiotTracker yeah, def. has to be considered - my point was just that that applies equally to nuclear as to renewables. @SuzanneWaldman @IdiotTracker nothing's easy - any transition will lead to millions of jobs lost, angry NIMBYism, etc. @SuzanneWaldman @IdiotTracker many overlapping policies, plans, visions, etc. some of which are awesome, but none of which have force of law @SuzanneWaldman @IdiotTracker IMO "experiment" is overly charitable. US (can't speak to EU) has no energy policy, plan, vision, etc. @SuzanneWaldman @IdiotTracker well in 10 years, don't complain to me if it isn't going well, b/c I don't think anyone's trying hard :) @SuzanneWaldman @IdiotTracker I'm not really anti-nuclear, I just don't get the obsession when what's actually scaling rt now is renewables. @SuzanneWaldman @IdiotTracker My pt is just that there are strong reasons a mix of renewables can do it all, it's hard but so is everything. @SuzanneWaldman @IdiotTracker Well some ppl are stupid, what do you want me to say ;) Obv. a mix of centralized/decentralized needed. @SuzanneWaldman @IdiotTracker and besides no knock downs, many strong positive args for why it could work/how to do it (ex. Jacobsen et al.) @SuzanneWaldman @IdiotTracker yeah, no one really advocates that (all rooftop), though. Not me at least :) My vision ~= Mark Jacobsen's work @cthorm @SuzanneWaldman what do you mean by prob. adjusted in that context? @SuzanneWaldman @IdiotTracker agree "uncharted" but we know a lot abt the challenges, will learn more, and no knockdown args against it. @SuzanneWaldman @IdiotTracker Sure, if we built TWs overnight, we'd have huge issue, but over reasonable timescale we'll learn lots,>storage @SuzanneWaldman @IdiotTracker depends what you mean by the problem. Even now w/o much effort, many many GWs of solar going up in US. @SuzanneWaldman @IdiotTracker w/ few major grid issues except extreme cases like Germany, and we are learning lots about how to deal w/ that @SuzanneWaldman @IdiotTracker + there has been no effort yet on appropriate scale but renewables are scaling well, dropping in price, etc. @SuzanneWaldman @IdiotTracker in what way is US failing w/ solar/wind/gas? Or you mean hypothetically? Case studies of limited use since+ Points to need for robust public understanding of/engagement w/ tech., security, privacy, etc. not just now but indefinitely. Things that could help reduce x-risk, e.g. surveillance, make slide towards tot'ism in case of political turmoil/post-catastrophe > likely. Caplan: worst case for freedom is global totalitarian state. @FHIOxford, etc.: worst case, period, is extinction. Avoiding both=complicated. @SuzanneWaldman needs to be accelerated obv, as does storage RD+D, maybe CCS?, but still haven't seen great arg. for nukes being essential.. @SuzanneWaldman IMO we won't get much new nuclear regardless bc capital cost/risk, solar/wind scale-up in recent years speaks for itself. @SuzanneWaldman 1. yes, assumptions farfetched - true of all scenarios, tho, but 2. we won't get much nuclear w/o policy anyway, too costly. @pomeranian99 Yeah it is (at least according to some articles, e.g. http://t.co/tdp1DnMDLl, I think just for some canned phrases, tho (?) @SuzanneWaldman Sure - http://t.co/ndjrmPFtEW I was referring to table SPM.2 - my interp. is they think nukes help but not as key as CCS/bio @jathansadowski in 1984, mind reading is one of the few things still being researched, for that reason. Such a good book. @nerdsrocket in that case, I think that may be a cause for celebration. @nerdsrocket lol if you don't get it unclasped now, it'll be on (or off) for the rest of your liiiiiiiiife @SuzanneWaldman how do/will the nuke folks respond to the fact that IPCC WG3 says no new nukes not a big problem cost-wise (but no CCS is)? @nerdsrocket noted. Hard when most of my best friends live far away. My dog says she counts, so everyday is a slumber party. #crazydogperson @j2blather population growth also makes interpreting the multi-century data tricky (among other factors)... @j2blather yeah, that's just one I found quickly on Google images, not knockdown evidence by any means. Haven't read Pinker's book, plan to Can we really upload Johnny Depp’s brain like in Transcendence? by Armstrong @ @FHIOxford + @lukeprog @ @MIRIBerkeley http://t.co/U7b1KfWYQB @j2blather trend looks more promising on a linear scale (http://t.co/tVO0Xuh9mb) but as Pinker admits, a big war could mess it all up... :-/ + 3. bio-energy/CCS combo shoutout. Will be interesting to see what else there is on that and negative emissions in general in full report. Stuff I found interesting about IPCC WG3 summary: 1. cost impact of no new nukes small, big cost for no CCS. 2. useless int'l coop section.+ @nerdsrocket don't get me wrong, I'm all for 'em. Does sharing a room with bffs at a hotel for a wedding count? then I still have 'em too ;) @nerdsrocket P.S. sleepovers...*nostalgic sigh* @nerdsrocket Agh! You should watch it at some point. Maybe it won't hold up as well without rosy memories of it already imprinted, though. @nerdsrocket Rush Hour 2 is one of my all-time fave movies. @nerdsrocket lawl. The century that grew up loving Rush Hour and accepting anything Chris Tucker said as cool, I guess? ;) @nerdsrocket yay! It's the bomb. RT @jgcarpenter: Laurel Riek on @CBC discussing a code of ethics for robot #design. http://t.co/qi8qpo3yx7 #Ethics #robots ht @RoboEthics @… @j2bryson main reason prob being the possibility of more ubiquitous and effective telescreen surveillance and behavioral anomaly detection. @j2bryson reading Caplan's "The Totalitarian Threat" also gave me some ideas but it's pretty obv reading 1984 nowadays that it cld be worse @j2bryson just reading it for the first time in a while :) @zeustoves @nerdsrocket @AliMattu @knewscript haha no, I'm a young whippersnapper and have fond memories of Blockbuster. RT @PaulNaish78: Limitations and risks of machine ethics http://t.co/PED2NAdc8S - interesting new paper by @Miles_Brundage @nerdsrocket @zeustoves @AliMattu @knewscript Great minds think alike! :) @zeustoves @AliMattu @knewscript @nerdsrocket I recommend Mr. Nobody for those who haven't seen it (it's on Netflix). RT @gleemie: Ah yes, Silicon Valley on HBO kicks off with tired 90s band paid to play corporate party. Nailed it. Nice post on automation and quality of work by Nicholas Carr (h/t @jathansadowski) http://t.co/2KDm94wnbG See also my http://t.co/3JbAVsd542 RT @mccrabb_will: CHRISTOPHER NOLAN directs the aerial stunt work for TDKR from a helicopter. He has never used a 2nd Unit Director. http:/… @nerdsrocket lol um, def. political (<3 house of cards, and lived in DC for a long time), dunno about soapy... @nerdsrocket I should be watching Scandal, I take it? @jathansadowski if the reader is just skimming, though, it can be quite valuable to do so. @robotenomics @erikbryn and just as important, we need to adapt technologies to our economy and society. :) +slide towards tot'ism. Some premises of the arg have been argued 4 already and some techs might advance enough to add fuel to that view 2/2 One point Caplan doesn't make (may have been made elsewhere) is that surveillance motivated by managing risks from dangerous tech could 1/2+ For musings on the 1984/long term totalitarianism risk/technology nexus, see Caplan's "The Totalitarian Threat" http://t.co/EBhyh65pQK @nerdsrocket and should by all means go beyond what's known but endorsing stuff we know *isn't* true is just annoying/unhelpful/lazy. 2/2 @nerdsrocket I agree with your Lucy take. Sci-fi has lots of value for society beyond entertainment (http://t.co/T6mZQEqNr5 ~= my view) 1/2 This week I learned 1984 is still super awesome and relevant. Also, AI-assisted totalitarianism could be far more awful and stable than that @nerdsrocket lol. I had to defend this preference recently though fortunately it was with a tech ethics nerd so he was amenable :) "RT @nerdsrocket: Me: I like Caprica better than Battlestar. Wes: There's some obscure actor you love in it, isn't there? Me: …No… Sasha Roi…" @nerdsrocket I'd give further rationalizations about how I hung out just w nerdy dudes who like stuff but in the end, I like what I Iike ;) @nerdsrocket lol I'm 26, which helps account for why I am obsessed with mid-90s action adventure/sci-fi of dubious quality ;) @nerdsrocket not about her being meh in stuff but about the awesomeness of Armageddon. It is symbolic of my last vestige of silly patriotism @nerdsrocket I know, I know...I respectfully disagree one zillion percent tho ;) @SuzanneWaldman I don't want either "off the table" but nuclear is super expensive and nat gas is not "low carbon." @nerdsrocket *cough* Armageddon *cough* :) Had fun pushing around nanowires with a sub-micron scale probe today using a playstation controller today. #science @j2bryson There is data on M Turk demographics, don't know where that stereotype comes from. Lots of em depend on it 4 income, many in India RT @WSJD: Microsoft: We're in an Artificial Intelligence Spring. by @Amirmizroch http://t.co/hf8c5gaKLf "RT @EUCogNetwork: Event Post: 2nd International Conference on Human-Agent Interaction (HAI 2014) October 29-31 Tsukuba Japan http://t.co/6…" @nerdsrocket k, will listen this week and let you know :) @AliMattu Nope! On my to-do list :) Picked up Island by Huxley, the (real) utopian counterpart to Brave New World. Should be interesting. RT @adamleealter: Smart and timely @nytimes op-ed, on the problems with big data, by @GaryMarcus and Ernest Davis: http://t.co/B2aSvUxZL8 RT @rcalo: We Robot on @npratc. MT @mfroomkin @profabartow @ianrkerr. http://t.co/OCeFYe0pj9 cc @HennsEggs @AliMattu yay! You'll love it :) Not complaining, though! Every X-Files ep: 1. weird stuff happens, 2. Mulder suspects weird stuff, 3. Sculley skeptical, 4. case solved, 5. but weird stuff survives! Technology's Man Problem http://t.co/IdHL0mW4m6 [sidenote: says something about the times that "technology" in the title means programming] RT @jadedid: 5 years ago tomorrow I 3D printed a human. RT @katecrawford: Everything is going to be AI. http://t.co/ABEYUs33MZ RT @danieldewey: I'm on the @NonTheology podcast, talking AI & intelligence explosion. Friendly & articulate hosts, it was a pleasure! http… RT @danieldewey: New paper, "Additively efficient universal computers": some computers can simulate any other with only O(1) overhead. http… Didn't get the memo that there was a new (and substantially beefed up) edition of Andy Clark's great book Mindware! Look forward to reading. @nerdsrocket haha. NDGT (NDT?) is the man so I'm not surprised, but it is indeed fantastic. :) I don't judge books by their covers per se, but I do judge them based on whether that cover has "look inside!" superimposed on it on Amazon. @nerdsrocket right now, though, I'm binge watching X-Files :) RT @j2bryson: @AISB2014 http://t.co/yU5Icbpvjk The Ethical Principle of Transparency for AI Romantic Companions (just the slides, there’s … @nerdsrocket Obvi :P Visited one of the biggest coal plants in the US today...very interesting. Many possible takeaways but not sure which to focus on :) @nerdsrocket no Watson, though? ;) Even such a model should still be used to analyze scenarios/options, not make one specific prediction, anyway... Intuitions re: plausible futures have value, but so could an actual model of different drivers of AI/robotics progress (kinda working on it) Such analysis can be useful, but is hard. In this case, looks like the main methodological issue is the lack of any model of tech. progress. Good cautionary tale - 2003 predictions about the future of humanoid robots, wrong about basically everything: http://t.co/jfn90APVDB "[An autonomous car's ethical algorithm] should be made clear in advance together with its exact parameters." http://t.co/c6kRKWXKEe … AI, Technology, and the Human Condition by Nick Bostrom http://t.co/wq9pZzAKgA (~15 mins plus Q+A) RT @aktant: New Sage journal "Big Data & Society" is now open for submissions: http://t.co/JFqqpew1fy @BigDataSoc #datasociety #bigdata RT @went1955: Debate: Was Marx right, is his view of our economic future being validated? — New York Times — http://t.co/LNIqFx6lHB RT @aeonmag: When is it ethical to hand our decisions over to machines? And when is external automation a step too far? http://t.co/VMglQC3… RT @mattthomas: Sent an Evite to Ray Kurzweil to see this new movie #Transcendence in IMAX but so far nothing. RT @rocza: Wow. Yesterday, the FDA quietly gave one hospital permission to use suspended animation to try to save lives http://t.co/SWH5rsd… Skimmed the draft 2014 Robocup@Home rules and they're pretty well thought out. Fairly complex environment, minimal/natural human input, etc. Speaking of home robots, I've been impressed by some videos of the Robocup@Home competition lately. Ex. from 2012 http://t.co/7o1IodkFXz Norvig on home robots: likely at some point in my/your life, varying degrees of autonomy. How long? Dunno. Norvig on Omohundro (MIRI/FHI etc.) "make sure you get AI utility function right" pt: yeah, problem. AI ethics board: we'll see what happens Norvig on intelligence explosion: unlikely, but we should spend some resources looking out for it. Such concentration of power would be bad. Norvig paraphrasing Russell: if we got message from aliens that they were coming sometime this century, we'd freak out/plan. AI analogous. Norvig on Google's plans for robotics: I don't know, meeting w/ Rubin group soon to find out/couldn't tell you anyway. Good interview w/ Peter Norvig for a computer science class http://t.co/QWTZPeBDtk on research at Google, deep learning, Singularity, etc. John McCarthy (1995) against robots being designed (to be seen) as moral patients @j2bryson http://t.co/u7nupsxXDD http://t.co/jjH8CWancb @CaptainCalliope @smwat fair enough, it's a decent metaphor for that stuff. Just meant the literal interp. Other stuff more literally plaus. @RobotDiva fyi the link doesn't work, need to remove the "f" at the very end :) @SuzanneWaldman @MilesGrant nothing against either in theory, just think wind/solar are the key to the 10s of terawatts needed :) @SuzanneWaldman @MilesGrant Land for biofuels is pretty prohibitive IMO (non-trivial for solar, too, but not as bad). @SuzanneWaldman @MilesGrant geothermal can help for sure, but still nothing compares to wind/solar in terms of resource potential, though. @SuzanneWaldman @MilesGrant renewables and storage manufacturing, yesterday, and maybe still nec. hopefully-not-out-of-panic geoengineering @SuzanneWaldman @MilesGrant hmm well in that case, yeah, should be punctured ;) IMO only plausible "solution" is massive scale-up of 1/2 @smwat Interesting movie if just for the unusually big effort at tech plausibility (minus the precogs, at least): http://t.co/NOvEt9nakG @SuzanneWaldman @MilesGrant agreed, except maybe about "widespread"? Seems to me like most people just don't care much, or want > renewables @SuzanneWaldman @MilesGrant widely distributed solar/storage is great, can leapfrog grid, etc. but ya still depends on big manufacturing etc @SuzanneWaldman @MilesGrant well, I meant mass use for electricity but yea, old either way ;) on scale, there is a good arg. to be made that @SuzanneWaldman @MilesGrant not oldness per se. Coal was once new. Impact is the key criterion IMO, though valence may change over time. @zeustoves @AliMattu @knewscript @nerdsrocket haha for being evil in the movie. That's like the only thing I know him for. @j2bryson @conjugateprior not surprising to those inside, somewhat moreso to those on the outside :) @j2bryson @conjugateprior in DC I learned DC would cease to function w/o interns, assistants. In academia, learned same goes 4 grad students @AliMattu @zeustoves @knewscript @nerdsrocket I also like Awake since the star is the bad guy from The Patriot. Still hold a grudge tho :) @j2bryson good point. makes more sense (though still not perfect) in contexts where there's an actual intelligent designer w/ knowledge/exp. RT @staeiou: Dear Motorola, please stop whatever algorithms are judging me for still being up at 3:22 AM. http://t.co/LgzuB8WKSl @knewscript @nerdsrocket @AliMattu @zeustoves something Ali might like - lots of psychology stuff :) [of dubious accuracy perhaps though?] @knewscript @nerdsrocket @AliMattu @zeustoves Speaking of free(ish) stuff, powering through Awake. So much stuff on Netflix! #firstworldprob @knewscript @nerdsrocket @AliMattu @zeustoves sometimes, tho for ex. Netflix doesn't cost more. If it's good (read: entertaining) it's good! @nerdsrocket @knewscript @AliMattu @zeustoves LOL. Guess so. And yeah - I watch the same exact movie many times, why not a similar one? :) @knewscript @nerdsrocket @AliMattu @zeustoves Lol the Iron Mans? Def. similar style. I like em all, though. @nerdsrocket @knewscript @AliMattu @zeustoves JBD? @knewscript @AliMattu @nerdsrocket @zeustoves Yeah, I didn't like it either. My fave recent Marvel stuff is the Iron Mans (Iron Men?) :) @AliMattu @nerdsrocket @knewscript @zeustoves disclaimer: not saying it's exactly like the Black Eyed Peas, I just like that related line :) @AliMattu @nerdsrocket @knewscript @zeustoves theory: the hype comes mostly from ppl who don't like much sci-fi - http://t.co/JY221HKrok @PrincetonUPress @robotenomics @GaryMarcus when's the book coming out/where can one find info about it?+link to further event info is broken "Incomplete Domain Models, Uncertain Users and Open Worlds", talk on "model-lite" AI planning by Rao Kambhampati http://t.co/4FRyCXQdY2 @nerdsrocket @zeustoves @knewscript @AliMattu Better than mine apparently. I will remedy, though skeptical I'll like it at this point. TBD! @nerdsrocket @knewscript @zeustoves @AliMattu lol OK i'll watch it. @nerdsrocket @knewscript @zeustoves @AliMattu Lol Beetlejuice? That's a thing? I only have very vague memories of it. @nerdsrocket @knewscript @zeustoves @AliMattu fair enough. I used to watch one every night when going to bed... @nerdsrocket @knewscript @zeustoves @AliMattu In just 5 words you've caused a billion nerd tears. ;) Haha I grew up w Star Wars so rosy view @zeustoves @knewscript @AliMattu @nerdsrocket *"excuse" is the wrong word. It does many things right, the premise just isn't my thing prob. @zeustoves well if they're FX guys (or acting, writing) then I think they did great :) I'm just not big on western stuff so wrong audience @zeustoves Haha ranting is allowed (/what Twitter is for?) :) Anyway, I do cut slack for stuff, esp. early on, Firefly just isn't my thing. @zeustoves @knewscript @AliMattu @nerdsrocket That's possible, though also no excuse - Orphan Black has legs from ep. 1 IMO ;) #fanboy @knewscript @zeustoves @AliMattu @nerdsrocket Those who don't watch Demolition Man and Judge Dredd 2x in a month shall cast the first stone. @knewscript @zeustoves @AliMattu @nerdsrocket Star Wars...I"ll hold my tongue :P @knewscript @zeustoves @AliMattu @nerdsrocket lol. we're def not the only ones who didn't like Firefly, I remember Corrigan didn't either... @knewscript @zeustoves @AliMattu @nerdsrocket watched Serenity, tho, liked it more. Think my prob is wanting more sci-fi, less Western :) @knewscript @zeustoves @AliMattu @nerdsrocket still only like halfway through ep. 1, not gripped. Dunno if I'm broken or something. @zeustoves @knewscript @AliMattu @nerdsrocket pretty solid list, except perhaps for Firefly ;) @zeustoves @knewscript @AliMattu @nerdsrocket if anyone doesn't already have enough to watch ;) Enjoying Awake so far http://t.co/mYRrOKY1B6 Though if "we have no idea" how to do X just means we lack a robust consensus/roadmap, then yeah, that's true. Er, *one of the hard parts :) obv. progress is also needed on said modules, among other things. Maybe none of the ideas are right or sufficiently evidenced, but there's plenty of 'em. Evaluating/improving on them is the hard part. It's often said that we have no idea how the brain fits together/how to integrate AI modules. Actually, prob is too many ideas, not too few. RT @grok_: You guys the robots are on the verge of taking over. http://t.co/fQjokwxEwA via @AutomatonBlog @OddLetters absolutely. As opposed to the authors just being ignorant of the possibilities of enhancement, which is more likely but less interesting. Closing chapter on Star Trek as good model. Agar's revisionist interp of ST: a future where radical enhancement is possible but rejected. *while defending moderate enhancement. Others have argued some harms (based on ex. bc higher status of enhanced) could be outweighed. Dunno. Truly Human Enhancement: A Philosophical Defense of Limits is interesting, explores ways radical enhancement could harm enhanced/unenhanced. @robotenomics @2045singularity @ramez + on Watson, yeah it isn't based on humans but has many functional similarities http://t.co/nkEYKaDAXo @robotenomics @2045singularity @ramez agree w/ much of it, though seems to lump sentience, thinking, awareness, goal-directedness together. RT @keithfrankish: It's frightening to think that humans are allowed to run this planet. @2045singularity @robotenomics but that conveys the gist, and my paper gives more detail. @2045singularity @robotenomics given infinite time i'd just write a long version of: utopia's great, dystopia's bad, neither's inevitable ;) @2045singularity @robotenomics also the whole time thing, i.e. have to go to sleep and it would take me all night to go pt.-by-pt. ;) @2045singularity @robotenomics I think by reading each other's respective articles it will be pretty clear what we disagree about. :) @2045singularity @robotenomics going point-by-point would probably produce more heat than light as we seem to have very diff. starting pts. @2045singularity @robotenomics see: http://t.co/z8DTYh1jOB for diff. perspectives on much of it. And much of MIRI/FHI work. @2045singularity @robotenomics and "caution fails to appreciate X, Y, Z" doesn't seem valid - if we're all dead who cares? @2045singularity @robotenomics ex. I think the last part about conflict is obviously false. See: much of human history. @2045singularity @robotenomics we're obviously starting from very different evidence bases so don't think we'll make any progress arguing+ @2045singularity @robotenomics or that delay is what anyone is advocating, except maybe Rees but he's not focused on AI/not representative. @2045singularity @robotenomics agree "delayed AI due to misguided caution is risk" but don't see clear argument why caution is misguided+ @robotenomics @2045singularity yup - chatting w/ Nick soon actually. small world :) lots of v. sound arguments for thinking about big risks. @robotenomics ah, k - knew who you meant, just wasn't sure if you meant "heed" as in him saying it's impt or his specific MIRI critiques :) @robotenomics @2045singularity IMO we should definitely think abt. long-term risks - what they are/what to do/urgency vs. short term=tricky @robotenomics @2045singularity You mean Legg on Friendly AI/x-risk? He disagrees w/ some things abt MIRI/FHI but thinks important issue. @robotenomics @2045singularity future AIs aren't harmed by present people thinking about how to design them well. Alt. = give random goals? RT @Annaleen: Also, the movie version of Noah totally changes the book version in inexplicable ways. Fans will be pissed. Captures the essence of the meaning and also allows for degrees. "A system is autonomous to the extent that its behavior is determined by its immediate inputs/past experience rather than by its designer's" One of the more coherent definitions of autonomy (in AI/robotics) I've seen comes from Russell/Wefald's book Do the Right Thing (next tweet) I've had really good luck with everything I've read in the Intelligent Robotics and Autonomous Agents book series. Very readable and helpful "I can't get used to a woman on the bridge. ... no offense intended, Lieutenant. You're different, of course." first ep. of Star Trek OTS. In terms of making sense, 4 is probably at the bottom regardless of whether there's a curve. My rough ordering of Terminator movies/show: 2>Chronicles>3>1>4. 1 is pretty boring to me but is graded on a curve cuz it's so much older. @OddLetters Haha I know, right? Dude lived a freakin whole different life on a dying civilization. Kind of a big deal. @OddLetters and all sciencey in general. The Inner Light is the bomb. @OddLetters Don't know much about Doctor Who but Q could exist in many universes. Plausible hypothesis in the sci-fi multiverse. @JohnDanaher @drcolekat the burden part sounds reminiscent of Dennett's point in Information, Technology, and the Virtues of Ignorance. RT @OSRFoundation: RT @ROSIndustrial: An Immersive Virtual Robotics Environment based on ROS http://t.co/SpL5AUpuDQ RT @rebecca_roache: I've written a response to comments/concerns/questions I've received about my views on punishment http://t.co/ABlDZE4auG RT @RobotLaunch: .@Robohub CSAIL panel discussion at SXSW YouTube - SXSW 2014 panel featuring CSAIL members Daniela Rus, Tim Berne... http… @nerdsrocket I agree with your take. The trailer is kinda incoherent but I'll see it bc superheroes and apocalypse and JLaw and reasons. @nerdsrocket kinda ruined the feels for me, felt weird/pointless. Anyway, I like the new trailer better. @nerdsrocket lol maybe it's just me but I thought the cut to Wolverine/song change was strange, epic until then http://t.co/XNaY1RgLjC @nerdsrocket lol good enough for me :) just starting the new podcast. Did you mention the awkward cut to Wolverine screaming in trailer 1? @nerdsrocket cute dog :) @mark_riedl Have you read Ready Player One? Recommended if not. RT @DanTwoHundred: I'm with Zuckerberg though; there's nothing more social than sitting in a chair with a device on your head that blocks o… @RoboEthics :( it was a very tough call... "this kind of immersive, augmented reality will become a part of daily life for billions of ppl." - Zuckerberg. Again, see: Ready Player One It's always a good time to read Ready Player One, but now (in light of the Oculus buy) is an especially good time. I know of another way that you can "feel like you're actually present in another place with other people," can I get $2 billion, please? "The incredible thing about the technology is that you feel like you're actually present in another place with other people." - Zuckerberg RT @alan_winfield: Does every super-promising high-tech startup have to be owned by Facebook/Google/Amazon? Sadly it seems so. #Oculus #Fac… RT @karaswisher: In Google's Shadow, Facebook's Zuckerberg Pursued Oculus Over Several Months, Ending in Weekend M… http://t.co/oEIjlxksBb … RT @mark_riedl: Facebook acquires Oculus for $2B http://t.co/4VVD8Rhtf5 "Wants to 'accelerate' the company's growth in the gaming space." Had some success over the last few weeks in developing a (sketchy, early, vague) model of AI progress (past/future). Many moving parts. @RoboEthics @petitegeek Thanks! Can't make it to We Robot after all, unfortunately :( Finally finished The Architecture of the Mind - highly recommended for ppl interested in cognitive science, AI, psych, modularity, etc. FWIW: I don't think mil/int. $ is *nec.* bad but should be taken w/ eyes open and non-mil/int. $ should be increased, =more choice for unis. ...by which I mean a villain that can be latched onto by opponents, even if it is not coterminous with the science/technology in question. If (a big if...) AI/bots run the risk of being the next GMOs w.r.t. public backlash, military/intelligence funding could be their Monsanto. for good or ill, DARPA has its fingerprints all over Google in general (including the work on PageRank) and their new buys in prtclr (2/2) I'm glad Google won't be taking DARPA funding for the next stage of the DRC, but ppl should be aware this doesn't change the fact that (1/2) "RT @shannonconley33: Thinking longer term about technology: is there value in science fiction-inspired approaches to constructing futures? …" @OddLetters My future chiropractor probably doesn't agree, but hey, at least I'll have lots of papers and a furry friend. :) @OddLetters lol glad I'm not the only one. Except instead of at desk with a fuzzy blanket, it's on the couch with a fuzzy dog. Stuff I'd read but too lazy to write now: Continuum > Almost Human re: future tech; Almost Human's techno-determinism/regulation-skepticism. "RT @GrahamBM: Could future brain implant technology make your thoughts someone else’s property? interview with @GaryMarcus http://t.co/hI…" @RoboEthics @petitegeek are their papers/videos from HRI 2014 online anywhere? 10 Reasons Why Almost Human Is the Best Future-Tech Show on TV http://t.co/4fE3E6O9wL via @slate RT @ArtificialOther: Ray Kurzweil's Dubious Theory of Mind http://t.co/O4BpVwZzvs #singularity Papers for We Robot 2014 available for download: http://t.co/Kio7FInf0L @j2bryson :( @Greene_DM See: http://t.co/nKOSVz4qi1 Phrasing like "care of" may have evoked association with 1-to-1 replacement, whereas "healthcare" did not. Seems worth more study. That'd be consistent w/ Takayama et al.'s "Beyond Dull, Dirty, and Dangerous" - ppl more opposed to 1-to-1 replacement than robot assistance As assistant to human but humans still main caregivers? Suspect if this were redone and disaggregated, opposition would be lower to latter. Depends on interpretation of what "care of children, elderly, and the disabled" as an "area" means. Bots replacing ppl, yes, ppl prob oppose +EU citizens don't want robots involved in elder/child/disabled care. But the framing of the question makes this potentially premature.+ Taking a 2nd look at EU survey on public attitudes toward robots - the authors conclude/others (myself included) have read it as meaning + @nerdsrocket Yup :) @nerdsrocket and a co-authoring thing came up and it's interesting to me so have to satisfy my curiosity by reading some specific things NAO @nerdsrocket watched a bit now, seems chill. Don't have a good answer but: back and forth btwn reading all the things and Dark Knight Rises. @nerdsrocket looking at Google Images now, he looks better when not Loki. Still, never woulda guessed him-being-especially hot was a thing. @nerdsrocket Don't think I'll ever get how Tom Hiddleston is considered attractive, though :P Brad Pitt, Jude Law...ok, granted. @nerdsrocket lol depends how you define it. If "be attracted to" means want to bone, then yes; if just recognizing attractiveness, no. @nerdsrocket ouch @nerdsrocket Time, schmime... haha jk. ;) Good luck w/ the podcast/whatever you're working on! @nerdsrocket finishing Orphan Black would make it less painful, too, if you haven't already ;) @petitegeek congrats!! @nerdsrocket yup. @nerdsrocket Yeah, I feel ya... re(re, re, re, re, re...) watching Dark Knight Rises and I still just cannot get over his back recovery. @nerdsrocket Lol yeah, true. @nerdsrocket lol I dunno, I always assumed it was just a less extreme version of how people say Los Angeles. @nerdsrocket cuz ignorance @OddLetters could be interesting for someone currently pretty ignorant of but predisposed to respect about such things like myself. @ArtificialOther See: origins of the Cylon civil war on Battlestar Galactica :) + besides defense/space, similar applications desired, and of course incompatible hopes for market share btwn the two (each wants more) :) + one passing reference to ethics in US roadmap, vs. serious engagement in EU research agenda; more emphasis on standardization in EU; + + unclear if this actually reflects diff. views or just different document framings and stuff beyond ~5 years blending together as "future"+ + Research problems/goals are pretty much the same, though framed somewhat differently; EU timeline is more ambitious/optimistic but it's + Thoughts upon rereading US and EU robotics roadmaps/research agendas, of varying degrees of obviousness: US big on defense/space (obvi); + @JohnDanaher (again, prob not new arg but...) also interesting that that would hold, if true, as long as probability of multiverse is >0%. @JohnDanaher ...which may be raised in the Bostrom paper, which I haven't read/prob. won't anytime soon, so apologize if that's an old Q. @JohnDanaher Right. Related question is, should Measure 2 be generalized to the multiverse? Not that POI is unclear, it's just a ton of information about information. His upcoming The Fourth Revolution sounds good/broadly relevant. Philosophy of Information by Floridi is also really good but prob. overkill for many readers - the very short intro book is more accessible. Information: A Very Short Introduction by Floridi is really good (and dense w/ information, not just data, in his typology). @j2bryson Armin Grunwald, Torsten Fleischer, others whose names I don't yet know at ITAS. Have only just begun looking at AI/robotics stuff. @j2bryson Various folks at the Institute for Technology Assessment and Systems Analysis at KIT - probably others elsewhere, too, dunno. @JohnDanaher What about the multiverse? If there are infinite versions of us, that seems relevant here. Don't have informed views on it tho. Some implausible goals notwithstanding, I highly recommend interested folks read the US Robotics Roadmap (2013 version). This line from the roadmap is clever - "put the Turing into ManufacTuring." Phrase seems to come from Ken Goldberg. Big gains achievable in some manufacturing areas, and an admirable goal, but thermodynamically impossible in many cases (ex. cement mftg). Green manufacturing part in US Robotics Roadmap is kinda random (not complaining). 90% reduction in energy use in 15 years is absurd, though There are various computability constraints/design trade-offs in any intelligent system, but they won't be (/now aren't) the same as ours. Some modules don't fit into human psych., but future AI architectures will be more easily extended in terms of e.g. more working memory, etc May be points made elsewhere against that besides the calculator thing in GEB, but hard to imagine a good one, at least over the long term. *Assuming that said superhuman modules can fit into a general architecture, which seems reasonable (calculator point in GEB on this is weak) It will take a while to get the architecture and missing pieces right, but the baseline scenario (w/ no IE) will be human++ in some ways. Random thought: an intelligence explosion isn't needed for AIs to (eventually) be way smarter than humans - they already are in some ways. RT @hackernewsbot: MIT professor Marvin Minsky wins $540,000 award... http://t.co/xR68OltANa "Learning from Human-Generated Reward" - W. Bradley Knox's PhD defense http://t.co/vEvbhlEm6R The title of Arkin's lecture is somewhat misleading. He's really an advocate of making good Terminators a la Judgment Day, not Terminator 1. @nerdsrocket This fella has good taste (and binge watching skills) :) Season 2 in less than a month! "How to NOT build a Terminator," Ron Arkin http://t.co/UWglGG4M5I DARPA Robotics Challenge is for "urban search and destroy, er, rescue" "Integrating Robots into Team-Oriented Environments" - lecture by Julie Shah http://t.co/hUh17bKKY5 @knewscript @AliMattu @zeustoves @nerdsrocket *Jodorowsky. @knewscript @AliMattu @zeustoves @nerdsrocket Speaking of sci-fi, I wanna see Jodorowski's Dune. So it looks like I'll be going to (at least) Munich and Karlsruhe in May. Let me know if there's anything I should do/people I should meet! RT @ericoguizzo: SCHAFT Staying in DARPA Robotics Challenge, More Teams Joining DRC Finals http://t.co/nlW0yX9LUw @mark_riedl + since the metric of success is applause, this would seem to incentivize canned jokes, compelling voices, etc. over better NLP. Also sad the big data/privacy review thing largely consists of random high ranking gov't officials with no prior expertise in that area. Good start would be bringing back OTA, find some way for OSTP to be taken seriously (on the former @jathansadowski: http://t.co/5F50yghvnn). It's good that the WH is looking at privacy (as opposed to not), but OMG HOT PROBLEM LET'S DO A 90 DAY REVIEW is not the best way to govern. More competitors in DARPA Robotics Challenge bc Google self-funding. Good news, but nothing to write home about - would be douchey otherwise Not that big of a deal but Google's neural nets didn't "watch" Youtube vids - it was trained on one image per video. Charlie Rose and Larry Page at TED - recommended: http://t.co/eVlZKdqtnu Facebook invests in Vicarious, Google buys DeepMind. I'd say Google wins this round. @PabloRedux nope! @mgubrud it's certainly framed that way but the grants themselves don't look like anything out of the ordinary in AI/robotics. @mgubrud Not sure what you mean by "not code"? Def. not hardware... @mgubrud buzzword for NSF program, from what I can tell not that different in meaning from others like cognitive systems, AGI, etc. @mgubrud So many facepalm moments. Another: correcting himself after saying NSA puts an inordinate, er, appropriate focus on privacy. @Ahaverine Haha yup! "Grace by Graystone" :) "President Madison would be proud" (referring to separation of powers?) Madison was all abt 3 branches of gov't agreeing on surveillance X_X Don't even know where to begin with this - NSA response at TED to Snowden talk http://t.co/JZuUEZnX2t @knewscript @AliMattu @zeustoves @nerdsrocket Here's help ;) all you have to do is click! http://t.co/RCfJ1IQpci @petitegeek @j2bryson don't know anything about Haruko Obokata but re: the general point... :( @AliMattu @zeustoves @knewscript @nerdsrocket I recruited a friend to Orphan Black - the cult grows! Join b4 everyone's on the bandwagon ;) RT @AcademicsSay: Yes, I've heard of work-life balance. I gave a workshop on it last week and am co-editing a related special issue to whic… Page mentions voice recognition, image recognition, and personal assistant-y stuff as DeepMind applications http://t.co/wiSkLelM5T Unlike AR in public, VR in private doesn't need to look reasonable as long as it provides a good service. Unlike Glass, you're not pretending otherwise in public MT @Recode You Still Look Silly Playing Virtual Reality Games http://t.co/SmQrWQi1fX RT @j2blather: Larry Page at TED: “wouldn’t it be awful if we were careful with ALL data, not just medical data?” http://t.co/clZpHFPTTd um… Virtual reality headset coming to Playstation 4 http://t.co/WnXUgXGjQJ Link that works re: TED AI X-Prize @petitegeek http://t.co/h9xs6NL7VY + http://t.co/6Ipo37WuYI Randal Koene on whole brain emulation: http://t.co/qLUDrsovsK See also @anderssandberg paper w ~2060 median date http://t.co/SfFb67eEt3 @j2bryson though discounting sexism's role is generally not a safe bet... @j2bryson well I think you're doing a good job of signaling :) RT @GaryMarcus: Don't let anyone hack your brain implant! Neurosecurity: security and privacy for neural devices h/t @Miles_Brundage http:… @j2bryson the 2nd part of the disjunction seems to imply that besides sexism, ideas are evaluated well. ppl/systems can be pretty stupid ;) RT @jathansadowski: ASU announces The Frankenstein Bicentennial Project | 1818-2018 https://t.co/7sGOzJnEsa I'm one of the organizers/resea… RT @monkeycageblog: Why scientific research needs both public and private support http://t.co/H3adKvu44u Seen Dark Knight Rises several times now and of the liberties it takes with...everything, Wayne's back recovery bothers me the most somehow. Interesting post by @davidad: "the only 8 software innovations we actually use" [all invented between 1955 and 1970] http://t.co/UWbKSwxnLd RT @RobotLaunch: .@Robohub DARPA's Gill Pratt on Google's robotics investments http://t.co/wSodu6AjfY @paulonabike Indeed, could be a very interesting paper there. *NOT IT* though. ;) @paulonabike Haven't read much on the issue, but I'd bet that, if tested for/incentivized, there would likely be creep from "core" to whole. RT @ericnormand: I just found these things called "books". I'll never read a blog again. No ads. Good editing. More than just single ideas. Those are just some random ideas for Q's, may not pursue. Reading/comparing robotics roadmaps to AI challenges/gaps, hoping for inspiration. #NAME? To elaborate: which areas of AI/robotics most (ex. architectures? imitation learning?) vs. least (limb design? SAT solvers?) require collab? + and yeah, I realize my last tweet is super vague ;) Working on a might-become-a-paper about the relationship btwn AI and robotics - overlap/divergence, ethics - good, related papers welcome :) Fascinating cement plant tour - everything on-site from mining to (recently automated) packaging. Microcosm of modernity behind-the-scenes. @nerdsrocket Lol sorry. @nerdsrocket My friend's sister was the one who wanted to be there; my friend and I watched TV or something in the skybox haha. ;) @nerdsrocket Oh and don't kill me but I was at the BSB NYE concert (1999/2000). Anddd I didn't pay attention (I was a 12 year old boy...). @nerdsrocket Also, I now know I have in fact heard One Direction before without knowing it. @nerdsrocket Not sure if this is ridiculous or amazing or both. RT @OddLetters: GUYS GUYS, THE GOOGLE POLICY FELLOWSHIP IS FINALLY OPEN. http://t.co/IpbuHe1osT "The truth can make us free only when it is a freely obtainable truth." - Ibid [Wiener in Invention, written in 1954, published in the 90s] "Benefits for scientific creation ... should be contingent on a full and free publication of the new ideas." Norbert Wiener 60 years ago #OA @julianoauthor All that may be true; I dunno, this is not my area of focus. Anyway, quoting/linking != endorsement. "We argue that the [driverless] car constitutes a refutation of semantic arguments against ... strong AI." http://t.co/tiEAzF08Um RT @petitegeek: I can't believe someone strapped a NAO to themselves and jumped out of an airplane http://t.co/GyPtXcMC6y @petitegeek Lol!! @jathansadowski yup same here- current release date is April 18. @VincentCMueller Wish I could make it! Don't think it really has/had much impact on, e.g., R&D funding, but an interesting read nonetheless on what some folks think is plausible. Planning to reread the US robotics roadmap soon (http://t.co/TyZCUVMKps). It's very interesting. If half of it came true, it'd be a BFD. Jaron Lanier doesn't tweet but if he did he'd say the ppl whose pics DeepFace is trained on deserve/won't get a cut of $ stemming from it. I can't articulate why exactly but I think it's funny that Facebook's face recognition program is called DeepFace. http://t.co/UqNWv4bN64 RT @verge: Facebook's new facial verification tech is 'nearing human-level performance' http://t.co/fvZG1oq0hD http://t.co/gqy1U73i2S @petitegeek @anki I was thinking of this series of competitions: http://t.co/QwGnuHZgst less interesting to watch than the TED thing ;) @petitegeek They should just spend half of their time working on the core system and the other half making a fake Patrick Stewart voice :) @petitegeek interesting - reminiscent of the general purpose AI game playing competition kinda but for NLP instead of planning. Barto/Sutton's book on RL is excellent, though a lot has happened since - more recent textbook's concluding chapter: http://t.co/sojVxEYyJa Some v. interesting work on human-in-the-loop RL and of course deep RL a la DeepMind. See also @danieldewey's paper: http://t.co/V9hTrQkSm7 Been doing a medium-deep dive in reinforcement learning lately. The Pavlovian connotation of the term belies a very interesting/rich field. @rcalo @Forbes Really like the new paper! My main hesitation is emergence being too vague/needing to be decomposed more. Will think more :) @petitegeek Ah. Sounds kinda.... silly? Dunno. Haha. Would have to know more. @petitegeek The link you RTd is broken, can't find any non-broken link to the story on this...? @robotenomics Nope... reminds me of this little (bad) number from the 90s :) AI-based "nano-android" Russell Crowe http://t.co/8zCnwf4VNl Orphan Black must be one of the first shows to use the term evo devo at all, let alone correctly. Also, it's a fantastic show. ICYMI: the first issue of the Journal of Responsible Innovation is out and it's open access! Check it out here: http://t.co/Oh7RwWu4wT "Building the capacity for public engagement with science in the United States" by David Guston http://t.co/umT0anMZ8Q @j2bryson I was gonna mention that but couldn't fit it in ;) Profs need human RAs and human RAs need AI RAs :) RT @EIP_AHA: A #Robot companion for the elderly - balancing autonomy and #ethics - A blog post of @accompanyeu project: http://t.co/FYgvmLC… Oh and the number of X's envisioned (don't want to use "predicted") should count for something too. Lots of long-term, novel X's in there. #NAME? While I don't think sci-fi is properly seen as *for* prediction, The Machine Stops is def. one of the most successful by that metric + Not because those things take up that much time compared to the research/writing itself, but they're just deterrents to committing to papers I'd write a lot more papers if I had an AI to deal with citations, formatting, editing, copyright forms, etc. "The human element of human resources is our biggest point of vulnerability. We should start phasing it out immediately." Happy, Iron Man 3 @j2bryson Ah - nice essay, thanks. @j2bryson Agree 100% with the last part. Don't know what "chess > chmess" means :) @nerdsrocket Nice! #famous "Reinforcement learning from simultaneous human and MDP reward" - one of several cool papers on the TAMER framework http://t.co/YtmklsrN83 Science fiction isn't about predicting the future, but inventing and preventing the future - Etienne Auge http://t.co/SUGcK8c0En @j2bryson IMO "impact" has many elements (intrinsic value of knowledge, education, tech, outreach...) and need not mean no basic research. @j2bryson can't speak to UK "impact" rhetoric but don't throw the baby out w the bathwater (asking if we can fund science better) :) @knewscript haven't but plan to at some point. @knewscript Yeah. He's a good example of a super useful robot that helps humans/is better than them in ways and isn't mistaken for one. The Naked Sun is one my fave non-apocalyptic visions of tech taken too far; Player Piano for how we could mess up btwn here and Star Trek. Long term, Data and the computer from Star Trek are my fave visions for AI/robotics - smarter/stronger than humans but not dominating us. @JohnDanaher Awesome, thanks! @JohnDanaher Thanks! Particularly interested in moral enhancement and issues related to moral status increase/other risks for unenhanced. @JohnDanaher Reading Agar's new book soon so wanna read it in context. @JohnDanaher Hey, you're deep into the enhancement literature, right? Any recent paper recommendations? Stopped following closely ~2012. @AliMattu @nerdsrocket @knewscript @zeustoves haha I would not fail to notice Natalie Portman :) @nerdsrocket I'm 99% sure you would love it. It's basically written for sci-fi/pop culture nerds. @nerdsrocket more feel-good/nostalgic than funny per se but def highly recommended: Ready Player One. RT @alicebell: This 'billionaires privatizing big science' NYT story reflects a lot of things to be worried about. Worth reading http://t.c… He also gives a definition for supererogatory actions a few seconds later (in elementary school?). Wish people learned that stuff on Earth! One of my fave things in Star Trek (movie) is little Spock answering "non-excludability and non-rivalry" in school (public good criteria). @nerdsrocket @AliMattu @knewscript @zeustoves Don't know how it took me this long to realize Kirk's dad in Star Trek is Thor! "Challenges for Artificial Cognitive Systems" by Antoni Gomila and @VincentCMueller http://t.co/9RtP1cPKe6 Or just read it...but this is a good discussion to watch anyway. "Replaced by robots?" Watch this seminar to learn what the Frey/Osborne paper actually says! :) http://t.co/p6aiiyYDMH "Universal psychometrics: Measuring cognitive abilities in the machine kingdom," Hernandez-Orallo et al http://t.co/1kGHeZOCJq @danieldewey "Enveloping the World - How Reality is Becoming AI-Friendly," Luciano Floridi http://t.co/y28qHPck6R I think Robot Ethics is prob. the best single volume of scholarly treatments of many issues in AI/robotics ethics. If anyone cares... ;) Moral Machines is also a great book on social/ethical aspects and accessible, tho some detail most ppl wouldn't care about re:, e.g., LIDA. Best popular audience books I've read on AI and robotics are prob Robot Futures (society/ethics) and The Second Machine Age (economics/jobs) Cool looking dissertation: "The Logic of Adaptive Behavior" (van Otterlo) - Mostly MDPs but some higher level stuff http://t.co/S2Tkom6n7l RT @techreview: You May Have Missed: Review: Google Glass Apps http://t.co/pSSIa415E3 @alan_winfield @ArtificialOther @j2bryson @mpshanahan computation that Turing machines can't do. His views are very unpopular, it seems... @alan_winfield @ArtificialOther @j2bryson @mpshanahan I don't know much about hypercomputing beyond wikipedia: http://t.co/ToJJX5Daq8 ... @alan_winfield @ArtificialOther @j2bryson @mpshanahan Selmer Bringsjord (here: http://t.co/L6TcaUyOjJ), on stuff related to that paper. @nerdsrocket Haha. I love Allison, great character. Among many, but I really like her in particular. @nerdsrocket yup! Lol @nerdsrocket Nice. :) While I don't remember what happens on that one, I can say it's epic. Cuz they all are. Never fizzles out. @nerdsrocket Haha...what ep you on? @nerdsrocket Lol I haven't watched any Degrassi. Is that a good or bad thing? ;) "The Future of Brain Implants" by @GaryMarcus and Christof Koch http://t.co/t4dQb30gsG @zeustoves @knewscript @nerdsrocket @AliMattu Oh man... yeah, it isn't as impactful on a 26 year old who loves dystopian sci-fi ;) RT @Recode: U.S. To Give Up Key Internet Governance Role / by @amy_schatz / http://t.co/ckYJe00VTj @knewscript @nerdsrocket @AliMattu @zeustoves BTW Soylent Green is pretty good, VERY 70' tho. Ex.: helpless women being slapped around... @knewscript @nerdsrocket @AliMattu @zeustoves Well, guess I'm alone (in this group at least! It was renewed twice so someone agrees haha) @nerdsrocket Ugh I would not be able to be a doctor and talk to someone like that. @gagliol There may be many more such people, but I just mean one of the few of out of the people who have actually made public predictions. @gagliol Legg seems like an interesting guy (haven't met him tho). One of the few credible ppl I know of who expect general AI in ~15 years. @nerdsrocket @AliMattu @knewscript @zeustoves Have you gone past ep 2 yet? @nerdsrocket @AliMattu @knewscript @zeustoves I'm more confident in recommending that than Cont., tho I like both. Others, join the club! :) @nerdsrocket @AliMattu @knewscript @zeustoves Speaking of sci-fi, watching Soylent Green, think Ali recommended? Mixed feelings so far... @nerdsrocket @AliMattu @knewscript @zeustoves :( Well as long as Corrigan doesn't decide Orphan Black sucks I won't feel like a total noob. @AliMattu @knewscript @nerdsrocket @zeustoves I certainly think so :) @knewscript @nerdsrocket @AliMattu @zeustoves Er, Sunday. Gives you all enough time to catch up if you don't sleep ;-) @knewscript @nerdsrocket @AliMattu @zeustoves Sooo I was not sufficiently warned, but Continuum season 3 premiere happened! AGH!! #nerdlyfe @nerdsrocket @Svelteassassin yea there's always a balance btwn informing ppl about things that may help and encouraging self-acceptance. @nerdsrocket @Svelteassassin And that wasn't supposed to rhyme :) @nerdsrocket @Svelteassassin same here. The way I woulda framed it is: some ppl benefit from X, Y, Z, but either way, support system key. @Svelteassassin @nerdsrocket what he said. Liked the drawings til the end for that reason. @ArtificialOther @j2bryson @alan_winfield @mpshanahan See, ex. IE: Evidence+Import paper- don't agree w all, but agree human != upper bound. @ArtificialOther @j2bryson @alan_winfield @mpshanahan IMO the truth re: IE is prob somewhere between extremes of fantasy and inevitability. @ArtificialOther @j2bryson @alan_winfield @mpshanahan in Q+A he said if humans don't hypercompute (he says we do) then singularity plausible @alan_winfield @mpshanahan @ArtificialOther would be curious to hear more on your thinking on that topic - could be a good blog post! :) @j2bryson what I take from it is don't count on philosophical progress, + need folk morality model anyway to deal w ppl, so start there. RT @oxmartinschool: If you missed our fascinating 'Replaced by Robots?' seminar on the future of employment, catch up here: http://t.co/DQi… @alan_winfield @mpshanahan @ArtificialOther are you more skeptical of the plausibility of IE or its inevitability? I'm in the latter camp... RT @MetroUK: Tony Benn in one image http://t.co/SGGF7HT9YD http://t.co/tSHCAsy0zh @gagliol true. I just searched "DeepMind" (with the quotes) on Google Scholar so only got stuff where it was people using that affiliation. Plenty of AIs in sci-fi could take over but don't bc of effective (what IRL we call) machine ethics, verification/validation systems, etc. Another point re: AI in sci-fi: its pos./neg. impact doesn't correlate much w/ its intelligence level. Fast change in latter usually bad. The median from that list is still pretty bad, but not catastrophic. If you include sci-fi where AI isn't the focus, it might be positive. ...variables are autonomy/goals of AI and our understanding of them - though I'm looking at this through a lens of thinking those matter IRL Lessons from the five mins ranking those: 1. mostly negative (BUT I didn't count stuff where AI is good but in the background), 2. main... ... Blade Runner, Wall-E, A.I., Star Wars, Star Trek. Partial list/semi-arbitrary order, but Terminator and Star Trek are prob the extremes. A few sci-fi visions of AI outcomes, in ascending order of desirability: Terminator, Robopocalypse, Matrix, I, Robot, WarGames, Colossus... What's the best stuff written on the Fermi Paradox/related issues? Besides your sustainability paper, @SethBaum :-) Any good books? Plus some I managed to miss before. The word when the DeepMind acquisition was announced was that there was just 1 paper by scientists there - I count at least 4 posted since. Does Technology Drive History? (Eds. Leo Marx & Merritt Roe Smith) is a nice collection of essays on tech determinism/critiques thereof. The answer is "yes" ;) quality of jobs matters too: http://t.co/P3YPl3DRoW MT @RoboticsEU: Key question: Do robots create or destroy jobs? "RT @mrsultan713: My recent paper w/ colleagues ""Public funding of science: An international comparison"": http://t.co/ENjveWNmyP @kieronfl…" @nerdsrocket Why doe he spell stuff out? I haven't been watching, just saw the Youtube clip on Atlantic... @petitegeek I sometimes say "robopugalypse" (vs. robopocalypse) as a word for ever-safer, cuter, more human-friendly, and useful robots ;) @petitegeek The gesture thing was the main evidence in the thing I mentioned, not touch/voice. Anyway, <3 dogs! Good role models for robots. @petitegeek Well, most (all?) puppies I've seen like humans ;) +not sure what "the wild canine world" is, considering they're domesticated.. @petitegeek ...not exactly what the article's about, but generally, dogs seem to have innate skills for paying attention to human stuff. @petitegeek The Genius of Dogs says (dunno based on which studies), dogs' responsiveness to human gestures doesn't develop much over time... Watching Man of Steel reminds me of this classic comic on Superman and utilitarianism: http://t.co/F0qUaHrwB1 RT @mark_riedl: 10th AAAI Conference on AI for Interactive Digital Entertainment, call for papers http://t.co/M5ey7rsTN2 Papers due 12 May … @nerdsrocket @AliMattu @knewscript @zeustoves yay Corrigan's seal of approval! mine's not worth much :P restarted it and still loving it. @j2bryson Last year in Topoi: http://t.co/JLUDtK9gab ...especially in an article about publicly funded research that, if we took tech/democracy seriously, could be informed by public goals. Good article on DARPA/bots, though "like it or not" is precisely the wrong way to talk about the future of technology http://t.co/vmlmQip4pU "What is Internet anyway?" - Today Show people totally confused about it in 1994. Ask someone off camera to clarify. http://t.co/iTkHG9xfwl @nerdsrocket right? She's awesome. @nerdsrocket Haha awww. @nerdsrocket Dogs are the best TV binging partners. @nerdsrocket Indeed. Starting ep 2. Can't let me lap you! ;) Unless you don't like it, in which case you can. @nerdsrocket lol there are a few good laughs but it's super dated and makes absolutely no sense on any level. Anddd rewatching Orphan Black. @nerdsrocket Like the Michael Keaton podcast mention. Watched Multiplicity the other day (I won't defend it). Really bad, as remembered. @knewscript @zeustoves @nerdsrocket @AliMattu Oooh it's on Amazon Prime. Some other people besides Wells who imagined things a lot like the Internet: Asimov (novels, non-fiction); Forster, The Machine Stops. @knewscript @zeustoves @nerdsrocket @AliMattu I obtained it through, um, magic... ;) @nerdsrocket @knewscript @zeustoves @AliMattu Yesssss!!! @knewscript @zeustoves @nerdsrocket @AliMattu Anyone seen Orphan Black yet?? My BFF is traveling this week so I can't force him to watch. :) It's not true (as many say) that no one imagined the Internet - some did, ex. Wells - plenty of visions, prob. is evaluating/acting on them. "Moral Deskilling and Upskilling in a New Machine Age" - nice paper by @ShannonVallor http://t.co/fz2hHzxVu3 RT @j2bryson: Beyond Thought Experiments (slides & notes on my talk for Autonomy & Automation last weekend) http://t.co/ebJGVer1lh @danieldewey @j2bryson Agree! "we're ethically obligated to ensure we have no ethical obligations to AI" is, as well :) @j2bryson Selin, one of the response authors, is one of my committee maybes (If I do foresight/scenario stuff). @j2bryson thanks for RT! I'm biased but I think it's worth a read ;) Suspect you may esp. like intro, Glerup/Horst, discussion ppr/responses Silent Running (1972) is kind of like a live-action Wall-E (or vice versa, Wall-E = animated Silent Running). Lots of similar themes. @j2bryson @danieldewey Ah, I see what you mean...prob. not too sustainable either (at least as currently done, if not in theory) though ;) @j2bryson @danieldewey tho that would only address one way we are screwing up biodiversity, and terrawatt scale solar creates issues too :( @j2bryson @danieldewey + so I think about AI/robotics w.r.t. sustainability. Ex. would love to see more solar-building/deploying bots. @j2bryson @danieldewey Daniel and I have been discussing that paper so it was on my mind :) and yup- one of my side things is solar/climate+ The way these robots walk in Silent Running is kind of adorable. http://t.co/iWSPLPJAzw @j2bryson @danieldewey ...though I don't agree with all of it, as with most things on the intelligence explosion/the future of AI :-) @j2bryson @danieldewey Related excerpt from Intelligence Explosion Microeconomics (one of the better reads on IE IMO) http://t.co/LzNgJljkom @j2bryson Will do. Like what I've read by her, + her book's been on my to-do list for like ever :/ Selma Sabanovic has some cool stuff too. @j2bryson Nice slides - and I hadn't heard about that special issue, look forward to checking it out - looks great! @j2bryson @jteevan @rcalo Nice discussion here (h/t @GaryMarcus) http://t.co/o4I71bdLUg @j2bryson I like artefactual since it's more specific than computational but doesn't sound like "fake", and same letter! @j2bryson Think McCarthy regretting using it, but "synthetic"not much better, machine int. = oxymoron to some, computational too vague.... @RichardMoorhead The authors note the values were given arbitrarily - though even more plausible ones, ex. no infinity, would still be, IMO. @RichardMoorhead It's from this paper by Arkin, Ulam, and Wagner: https://t.co/5VhYBVhFAf The values are *necessarily* arbitrary and while infinity would be stupid, real ones would value their own side way higher than enemies, obv That was from Arkin, Ulam, and Wagner 2012. The authors thankfully note the guilt values were assigned arbitrarily for simulation purposes. This table is a good illustration of everything that can go wrong with lethal autonomous robots' ethics algorithms. http://t.co/ugEeFT1ZWz @knewscript I don't doubt it, but if I never try em, I'll never know what I'm missing! ;-) "we cannot sit idly by and wait for the final word on a suitable and computationally tractable ethical theory to come along." Ibid. "On How to Build A Moral Machine" by Bello/Bringsjord (TL;DR: start by modeling folk morality) http://t.co/zvBbMBwX2C @knewscript I "balance" by only being on Twitter :) @nerdsrocket @AliMattu @knewscript @zeustoves Indeed. Tatiana Maslany is amazinggggggg in her many different roles. @nerdsrocket @AliMattu @knewscript @zeustoves anddd I finished last night :) "One implication is that there may be a trade-off between preventing totalitarianism and preventing other global catastrophic risks. Ibid "In 1984, 1 of the few questions being researched is "how to discover, against his will, what another human being is thinking."(Caplan 2011) Learned about that quote from Search Engine Society. Great book. "advertising funded search engines will be inherently biased towards the advertisers and away from the needs of the consumers."Brin/Page 98 Just finished season one of Orphan Black. HIGHLY recommended. Tatiana Maslany does an incredible job with her several distinct characters. @nerdsrocket @AliMattu @knewscript @zeustoves er 7, my bad. 8 tonight though ;) Anyway, there are only 10 so binging is very tempting. @nerdsrocket @AliMattu @knewscript @zeustoves Soooooo I'm on episode 8 and I started yesterday. X_x still loving it. RT @SaveAlmostHuman: @FOXTV #SaveAlmostHuman @danbann2 I'm the editorial assistant for it :) Nope I haven't read that, will check it out - thanks! RT @justinpickard: Set of interesting #OA papers on anticipation & futures in the first issue of the Journal of Responsible Innovation: htt… @AliMattu @knewscript @zeustoves @nerdsrocket I'm three episodes in and totally hooked on Orphan Black. It's super duper good. Last two tweets were referring to this review of Michio Kaku's new book, http://t.co/MsCirWSOaL, but this is a very common observation. #NAME? People who remind us that we have a habit of using the latest tech (steam engines, clockwork, etc.) as model for mind are right to be+ "Users did not care about search until they learned what it was and came to depend on it." Ibid. Will AI/bots develop in a similar way? Prob Do people just want answers from search engines (he says they usually do)? Personally, I do sometimes, but other times I want diff. POVs. Search Engine Society by Halavais is very interesting (not done yet). Search engine design + user desires/strategies co-evolving over time. @danieldewey @xuenay *which, if true, would raise interesting issues re: coherent extrapolated volition ;) Briefly mentioned this in a paper @knewscript @zeustoves Nope :( But stuff like footnote 112 in IEM rubs me the wrong way. I do not want IE to happen/suspect most people don't either. @danieldewey @xuenay @knewscript @zeustoves The Original Series; show about cloning, supposed to be really good. Finally got around to reading "Intelligence Explosion Microeconomics." Recommended (after Chalmers) for those interested in the args for IE. @knewscript @nerdsrocket @zeustoves @AliMattu Good to know (think I saw a long time ago?). In unrelated news, gonna dive into Orphan Black. @ablerism thanks! Radio interview with Illah Nourbakhsh about the future of AI/robotics (at the bottom) and his book Robot Futures http://t.co/pu6DCZnrsV @alan_winfield @VincentCMueller @EUCogNetwork Same here! "The measure of success of a foresight project relates to how well it aided the decision-maker in the present," not good prediction. Ibid. "The court of the future seems more likely to condemn us for negligence than paternalism." Selin in JRI issue 1 http://t.co/m97xDMD5yf @nerdsrocket Awww. Glad to hear your dog's out of the hospital (presumably a while ago) :-) RT @grok_: Westjet's response to that note complaining about a female pilot is pretty awesome: http://t.co/SJ2VGSgCnc K I'm done spamming about JRI for now - but I highly recommend checking it out :) lots of great stuff in the first issue, more to come! Check out issue 1 of the Journal of Responsible Innovation! http://t.co/m97xDMD5yf @Diana_M_Cooper @smwat @frriict @tonyjprescott Check out issue 1 of the Journal of Responsible Innovation! http://t.co/m97xDMD5yf @GaryMarcus @cyborgology @ianrkerr @grok_ @RoboEthics Check out issue 1 of the Journal of Responsible Innovation! http://t.co/m97xDMD5yf @DA_Banks @staeiou @alicebell @feraldata @PeterAsaro "RT @jameswilsdon: The inaugural issue of the Journal of Responsible Innovation is now out & #OA http://t.co/Y099c8LlAx #scipol" Check out issue 1 of the Journal of Responsible Innovation! http://t.co/m97xDMD5yf @kieronflanagan @jgcarpenter @LeapingRobot @paulonabike Check out issue 1 of the Journal of Responsible Innovation! http://t.co/m97xDMD5yf @ablerism @louisemarston @JonMichaelWalls @ShaunGamboa Check out issue 1 of the Journal of Responsible Innovation! http://t.co/m97xDMD5yf @claudia_aradau @gleemie @RRI_Observatory @danbann2 Check out issue 1 of the Journal of Responsible Innovation! http://t.co/m97xDMD5yf @EvanSelinger @ShannonVallor @FHIOxford @VincentCMueller @j2bryson @roboticsAI see: DARPA humanoid challenge. I'm all for disaster bots but the idea that that's all they care about is silly... @alan_winfield @EUCogNetwork @VincentCMueller + fortunately for K he didn't bet on maid robots next year ;) http://t.co/yFdvr6I4og @alan_winfield @EUCogNetwork not sure what @VincentCMueller means here but K's 2029 date (/bet) is for Turing Test: http://t.co/OxPwwGv0UV @petitegeek @RoboEthics Congrats to both of you on your awards :) BTW AJung, looks like we'll both be at We Robot! What does responsibility in science entail? From Glerup and Horst, JRI issue 1 (open access): http://t.co/WugigVsqCY http://t.co/tvqdpgCBFe Check out the first issue of the Journal of Responsible Innovation! http://t.co/m97xDMD5yf @alan_winfield @j2bryson @Jackstilgoe @rcalo @chrishtill Thanks for the RT! @danieldewey thanks for the RT! @nerdsrocket Gracias :) I def. haven't given up on it yet. As you said, TNG is mixed, too, and my tolerance for bad stuff is high anyway. @alan_winfield Do you have a specific vision of what you wanna do with it? I was wondering what AI/robotics people would cook up for it... @j2bryson Haha "in," not "for" May ;-) Can only afford a little bit of time there after the stuff that's paid for by others (workshop). @j2bryson nope, Munich 26-28, maybe Berlin briefly after that. The first issue of the Journal of Responsible Innovation is out! Check it out here: http://t.co/Ou0Dy9OGwe "RT @etzioni: Allen Distinguished Investigator RFP is now live: http://t.co/iCX9htjRN0 $8M in funding for breakthru AI Research" @nerdsrocket lol never been a big horror fan. I don't jump at the loud stuff, I just get stressed. Maybe jumping's the point though? :/ @nerdsrocket Way too scary for my taste ;) Russell/Norvig textbook has good chapters on philosophy/ethics of AI. Quick Googling suggests they are rarely assigned in AI classes, though @jrbarrat if by safety you just mean x-risk, then yes, I agree :) As in other domains, non-x risk safety isn't everything, trades off w/ rts @zeustoves @knewscript @nerdsrocket @AliMattu Didn't even know there was a book. Nerd fail. @knewscript @nerdsrocket @zeustoves @AliMattu that'd be awesome. Speaking of Tesla, I really like The Prestige. @knewscript @nerdsrocket @zeustoves @AliMattu Patrick Stewart is also a tough act to follow. @knewscript @nerdsrocket @zeustoves @AliMattu As in, my standards are too high? Eh, maybe. DS9 seems bad by normal acting standards. @zeustoves @AliMattu @nerdsrocket @knewscript Watched some DS9, can't tell if the acting's just worse than TNG or I have a rosy view of TNG. @jrbarrat ex. AIs that aren't that intelligent but experts say it's conscious, or vice versa, with public disagreeing/acting on beliefs etc. @jrbarrat I meant something somewhat different - differences of belief about whether AIs can be sentient/should be treated as such. @jrbarrat + even in academia we don't have a handle on the consciousness issue, let alone in society at large. Reaction would be polarized. + @jrbarrat if K's timeline is right (human-level AI in 15 years) then his optimism is wrong - we're unprepared for that on many levels. One point I really agree w/ in @jrbarrat's book is re: Kurzweil's inconsistency - says he deals w/ AI risks in books but really doesn't. + RT @rcalo: "@TAPolicy: New paper from TAP scholar @rcalo: "#Robotics and the New #Cyberlaw" http://t.co/JJxkWd3sPM" @alexismadrigal here it… @AliMattu @nerdsrocket @knewscript @zeustoves Speaking of Marvel, I haven't been able to finish an Agents of SHIELD ep. Should I try harder? @zeustoves I also really like Alec (character/actor). The genius hacker kid role can be/has been done really badly before but he kills it. @alan_winfield @j2bryson my doctor friend echoed the last part about existing resources being fine (Google, PubMed, stuff I hadn't heard of) @knewscript @nerdsrocket @zeustoves @AliMattu I found Avengers entertaining but thought it was a bit overhyped. Prefer, e.g. Iron Man 1-3. @zeustoves Yeah, it has really solid performances IMO. And I of course love all the Caprica folks who make appearances :) @petitegeek @RoboEthics sounds awesome! Wish I could be there :) Looks like I'll be in Germany (Munich) in May for a bit. Any AI/robotics folks I should meet while there? DFKI seems like a must-visit. @nerdsrocket @zeustoves @AliMattu @knewscript And Iron Man 3 held up v. well to 2nd/3rd watching. Dig the continuity of recent Marvel flix. @nerdsrocket @zeustoves @AliMattu @knewscript Sidenote: just finished rewatching Into Darkness. Verdict: its heart + soul = 99% Bones/Scotty @nerdsrocket @zeustoves @AliMattu @knewscript I recommend it obvi ;) let us know what you think if you watch. One of my fave current shows. @nerdsrocket @zeustoves @AliMattu @knewscript Canadian show. Time travel. Renewed for season 3 so I can't be the only one who likes it :) What do people with good taste think of Continuum? :) Rewatching soon. Personally I love it. @nerdsrocket @zeustoves @AliMattu @knewscript @nerdsrocket It may still be horrible (still watching...mixed feelings), but it'd be much, much worse without them. @nerdsrocket haha. I was actually just rewatching Into Darkness and thinking that if it weren't for Scotty and Bones, it'd be horrible. RT @rcalo: Robotics is the new Internet. What does that mean for cyberlaw? http://t.co/Y5pVpRZTAV The @ted site seems to have gone from timing out annoyingly after a few mins to the pause button not working at all (for me). Fail. RT @ML_Hipster: A machine learning researcher, a crypto-currency expert, and an Erlang programmer walk into a bar. Facebook buys the bar fo… "The Philosophy of 'Her'" by Susan Schneider http://t.co/0Ue0yP0brj Armando Tacchella on safety in future AI systems - interesting @MIRIBerkeley interview http://t.co/r9zmw5VRFn +of various forms of determinism about AI/society 2. model(s) of past/future progress in AI (roles of public/private $, adoption, etc). Had some time to think about medium term research goals on the way back from a trip. Two things I may want to pursue: 1. taxonomy/critiques+ Finished Singer/Friedman's Cybersecurity and Cyberwar - highly recommended for those who don't know much about the topics. Great intro. @j2bryson thanks! @j2bryson yep! The implications for AI part was pretty weak. Interesting topic, though. @j2bryson intelligence is highly modular so focus on making/bundling good modules, not general purpose learning/inference algorithms etc. Saw the movie Abduction on Netflix and got excited for a second, thinking it was about logic. Then realized it's about kidnapping. #nerdlyfe @alan_winfield Nice post! RT @alan_winfield: Why robots will not be smarter than humans by 2029 http://t.co/rUvefjaa26 "The principles of rational choice are easier to follow when the cognitive architecture of the organism is simpler."http://t.co/Bk2zRaeW9J @knewscript no prob! @knewscript sorry I can't be more helpful! @knewscript Unfortunately not my strengths :( this gives overview of special issue on the latter though, could help http://t.co/f9q0qKRAMe @knewscript sure, could u be more specific though? Like intro to what robotics is? State of art? Future? Etc What is/are the best Richard Dawkins book(s) for someone who doesn't need to be persuaded evolution is real? Reading Singer and Friedman's Cybersecurity and Cyberwar: What Everyone Needs to Know. Very clear, informative (for noobs...), entertaining. @robotenomics @j2bryson Luke has done a good job of getting clear publications/blog posts up recently. Before, boring Yudkowsky blog posts. @j2bryson @robotenomics and the (what seems like) rationality fetishism of some there annoys me but haven't seen any evidence of rudeness. @j2bryson @robotenomics my main beef is kinda personality-related, too - elitist rhetoric/behavior - but Tyler's critique is pretty off. @robotenomics @alan_winfield @j2bryson @jrbarrat well not really ad hominem bc not about them/anything related to them, more of a straw man @robotenomics @alan_winfield @j2bryson @jrbarrat The secrecy claim is way off - just see their site, and the Luddite thing is a weird ad hom @robotenomics @alan_winfield @j2bryson @jrbarrat I have disagreements w/ them about some things but this critique seems way off base. @knewscript @zeustoves true. I still think they did a good job wrapping up where they did under that constraint though. #fanboy :) @knewscript Enjoy! :) "Autonomous Agents and Human Interpersonal Trust: Can We Engineer a Human-Machine Social Interface for Trust?" http://t.co/lrOhmMGxHS TL;DR Surfaces and Essences: analogies/categorization are big parts of thinking on many levels and they/concepts get richer as you get older Had to skim over the literally hundreds of examples of everything in it. Clearly the authors had fun writing it, but it's not fun for reader Agree w/ Amazon reviewers: Hofstadter and Sanders' Surfaces + Essences (on analogy/categorization/thought) is way too long and repetitive. @jathansadowski Nice - thanks! Bill Gates on time til human-level AI: "At least 5 times as long as Ray Kurzweil says." http://t.co/Y3PDK9buCd + LOVE his insect comment :) Since Guardian article brought it up, I'll repeat: yes, Gates praised Kurzweil's AI predictions long ago, but more recently repudiated. RT @juliekientz: Help us out in a research project by taking a survey on the acceptability of different technologies. http://t.co/JKknQof2VF Unraveling the Enigma of Human Intelligence: Evolutionary Psychology and the Multimodular Mind, Tooby and Cosmides http://t.co/scysuFdztg @zeustoves @knewscript :) great job! @zeustoves @knewscript All CGI? @knewscript @zeustoves I looove Serge/however you spell the butler's name :) @knewscript @zeustoves Keep on trucking, I think you'll like how things end up :) Choreographe (high-level programming environment for Nao robots) is so cool. Tooby's "alternate" AI research strategy (work on specific domains, fit together later) = most AI work already, though some exceptions. John Tooby on evolutionary psychology and implications for AI at Singularity Summit 2010 http://t.co/DwiXNVC6ty Thank you for vetoing Bill 1062, @GovBrewer! Gov. Brewer about to speak on B1062, live here http://t.co/eF15HK3br2 @OddLetters I got it :) @robotenomics Thanks! RT @robotenomics: Top ten things I learned at Willow Garage | Robohub http://t.co/dGknAIkt5G via @robohub RT @techreview: ARPA-E’s Strategy for Survival http://t.co/KQ5EYEqeBu @robotenomics Is this an Ask Me Anything? RT @robotenomics: Yoshua Bengio will answer questions about deep learning, machine learning and #AI on Reddit (yoshua_bengio) Thursday 27th… One sentence on ethical/social issues in the 6 page @sciam cover story on neurotech, and not even a good one, just checking off the box. :/ RT @AuerbachKeller: DNI James Clapper: still in need of being fired. http://t.co/AUtsIS35Fi @nerdsrocket The Tale of the Ghastly Grinner and The Tale of the Renegade Virus were amazing(ly terrifying at the time). @nerdsrocket Great podcast! Def. much smoother than last week ;-) And I totally agree with you about old Nickelodeon plots. Grew up on them. RT @newtgingrich: Veto RT @Crossfire If you were Governor of AZ would you sign or veto the bill?Reply w/ Sign or Veto using #Crossfire http… RT @danielwilsonpdx: Aw yeah --> “Robopocalypse,” which Spielberg is still planning to direct...finalizing the script and a lower budget. h… @jathansadowski I looooove when stuff is clearly thought out like that. Drives me bananas when it isn't. RT @AliMattu: On the new @NerdHour: why the Oscars hate geeks, 2001: A Space Odyssey VS Star Wars, & our top 5 Oscar snubs: http://t.co/16p… RT @We_Robot: Interested in who's coming? #WeRobot has great speakers, but it also has great attendees: http://t.co/8v6sQGg90A Now's the ti… @j2bryson @alan_winfield yep, there many directors of engineering. He leads one of many NLP teams from what I can tell. "A machine with free will is therefore not a contradiction in terms, just a shorthand description of what we are."- Stanislas Dehaene RT @nerdsrocket: In Electric Fancave Ep. 6, we hang out with Sebastian Kadlecik of @pvpcomic. Warning: You might fall in love w/ him. http:… @mark_riedl sigh indeed :/ read several of your papers, very cool stuff! @jathansadowski Awesome - many thanks! @jathansadowski what do you recommend by Mumford/Ellul? "Using the Crowd to Generate Content for Scenario-Based Serious Games" http://t.co/4QffyaBdTu may be interesting to @mark_riedl Great group of people signed up for @We_Robot so far, but registration still seems to be open (and free!), sign up! http://t.co/QttL8FNaYS @FHIOxford @danieldewey And I'd be all for X-Men research. @FHIOxford @danieldewey LOL. That you, Stuart? Can add you to our email thread if you'd like, mentioned your book/satisficers post... Didn't know a Panopticon prison was actually built - interesting. Still had riots. @jathansadowski http://t.co/uZq0Prx4GT @PabloRedux Def. interesting and ambitious, indeed. More realistic than human-level competency across *all* domains as Kurzweil predicts. RT @alisonforns: Mark Zuckerberg showing stockholders what he did with $16 billion http://t.co/Qq1DZiMfPg @PabloRedux I think he probably interprets such data similarly to how he interprets the accuracy of his past predictions (selectively) :) Kurzweil *could* be right (doubt it), but 1. he's overconfident, 2. he makes false claims abt being mainstream and journos rarely question. I'm aware of 6 surveys about how long it will take to get human-level AI, w/ varying degrees of credibility. None support Kurzweil's claim. Dunno how Kurzweil concluded he's "pretty much at the median of what AI experts think" - def not from the few surveys http://t.co/Hbk7anBy9X RT @j2blather: MT @carlzimmer: Madagascar movies earned $1.88 billion. http://t.co/5k3LgqnB8r It would take .4% to save the lemurs. http://… @jathansadowski dunno, but the version I linked to in my Slate article on Amazon/jobs was taken down. Wonder why ;) @jathansadowski ICYMI http://t.co/Bm7yyT2Z7I Interesting article on the debate about e-cigarettes and public health: http://t.co/oiOwMtxbu3 @alan_winfield also, "Google's director of engineering" is misleading. Many have that title. He seems to leads one of several NLP groups. @jathansadowski @atossaaraxia Surprised this isn't common knowledge. "Don't improve the Turing Test, abandon it," Drew McDermott (agree, though few take it seriously as goal now anyway) http://t.co/2cyP57FQmR RT @alan_winfield: Much as I respect Ray Kurzweil, I profoundly disagree that "robots will be smarter than humans by 2029" http://t.co/ynyd… 5. AIs' goals/actions will be global in scope, 6. we won't learn much risk/control--wise from experience w/ early AI/machine ethics (3/3) 2. everything that can be automated will, 3. intel.will be only/main criterion in AI systems, 4. AI goals will have to be maximizing, (2/3) @danieldewey @xuenay @FHIOxford Some (often implicit) premises in AI x-risk args I'm skeptical of: 1. cybersecurity will always be weak(1/3) @j2bryson Good pt! Also, "more modular" is vague as used by Carruthers (great book tho). Humans have > # of modules, but more distributed. Reading @jrbarrat's Our Final Invention. Entertaining/well-written, lots of interesting stuff, though some stuff I really disagree with. "[Kurzweil]'s got a mild, robotic delivery [that] seems designed for hostage negotiations or bedtime stories." LOL @jrbarrat's book @petitegeek On my to-read list :) RT @petitegeek: The Mind in the Machine: Anthropomorphism Increases Trust in an Autonomous Vehicle http://t.co/LrJQAb0cYv @zeustoves Whaaaa, Heroes!? I love Heroes; I thought its purported shark-jumping was overstated. + I'd also support more Blood and Chrome ;) Dear media: pleaseeeeeee stop saying/implying Kurzweil is the head of all engineering at Google. There are many "directors" of engineering. @nerdsrocket Pretty solid worst case scenario, she's quite hilarious, indeed. @nerdsrocket Sounds like a worthwhile risk :) @nerdsrocket Fair enough. Guess I'll have to give it a go at some point. Perhaps after reading all the things this weekend. @nerdsrocket So ASMR is a real thing? Today I learned Michael Bay's highest rated movie on Rotten Tomatoes is The Rock at 67%. And he's made a LOT of movies. Also, speaking of replicants being biological, "Replicant" is/was the codename of Andy Rubin's (non-biological) robotics project at Google. For some reason I feel like I've seen a lot of references to Blade Runner that imply the replicants are non-biological, which they aren't. I always forget about the whole Sebastian's apartment thing in Blade Runner. So creepy. #scifi @nerdsrocket Lol!!! reminds me of Sexed Generation. RT @io9: No really they are actually making Space Jam 2 http://t.co/5Fa4kicHbY @jathansadowski Fail. RT @CSPO_ASU: A new article by CSPO's @Miles_Brundage in Slate's Future Tense examines ethical principals for robotics http://t.co/7ULvALGD… @nerdsrocket Just two of the coolest dudes ever, NBD. @jathansadowski from the author or library? Former has happened to me... @AliMattu fair enough ;) @AliMattu And convinced me to be skeptical of Rotten Tomatoes ;-) Good movie, but not zomg best movie ever. And not sci-fi. Cats have way more neurons than dogs, but that's just so they can hatch evil plans. Dogs use their neurons for good. I'm biased, though. Hare/Woods in The Genius of Dogs say dogs are the 2nd most successful large mammals. I'm inclined to agree. Not bad for ~150 mill. neurons. Assuming it's true, of course (reading Carruthers' book made me think about this). Tho deep learning and other stuff can help make modules. Does massive modularity imply progress in AI will be harder, easier, neither? Def. implies deep learning won't do everything. #randomideas RT @JasonOLearyUS: This makes me happy: A Dot Matrix Printer Playing "Eye of the Tiger" http://t.co/ijSZJhhFWi It's the 105th anniversary of E.M. Forster's "The Machine Stops" - one of the most prophetic sci-fi stories ever http://t.co/scK2MtxuU6 @jathansadowski Sweet, thanks! @jathansadowski Had to stop. She makes some sense extemporaneously but when she reads.. :( I'd read a Harraway summary a la that ANT piece. @AliMattu I love Owen Pallett! @nerdsrocket @knewscript @zeustoves Oh, and he did Dr. Horrible, which is one of my fave things. @nerdsrocket @zeustoves @knewscript Not me, sorry. :) Avengers is entertaining, liked Dollhouse, but I don't get the ZOMG WHEDON thing. @jathansadowski nice, sounds interesting. RT @jathansadowski: lol it's "cynicism" to marshall data and theory to point out that tech + innovation isn't always cool and sunny: https:… @jathansadowski link didn't work..? Maybe interesting to @jgcarpenter http://t.co/DA9ErCHR2C This paper sounds interesting, haven't read yet, though: Anthropomorphism Increases Trust in an Autonomous Vehicle" http://t.co/DA9ErD00gK OK, today is the day (or tonight is the night...) I buckle down and read a bunch of stuff on computational creativity by @mark_riedl :) RT @danielwilsonpdx: Philip K. Dick would be proud, says Kirkus of ROBOT UPRISINGS, the upcoming anthology I co-edited w @johnjosephadams h… RT @jathansadowski: Any crucial/killer pubs about or related to tech determinism that ppl recommend? (besides Smith/Marx and Winner's books… @mpshanahan @mdunion Cool, sounds like a good group. Are any of you against it categorically? Or just w/o safety/ethical constraints? @nerdsrocket @zeustoves @knewscript On an unrelated note, finally watched Megamind last night. Adorbs. @nerdsrocket @zeustoves @knewscript yeah that's what happened to me before, may happen again.... @alan_winfield Sounds like a cool meeting - is there an agenda/participants list online? @zeustoves @nerdsrocket @knewscript what do yall think of Firefly? I watched once and didn't get the hubbub. Prob. gonna rewatch, though. @mpshanahan @mdunion Nice. Who are you debating? @jathansadowski also ordered Collingridge's book. Can soon use real quotes! ;) @jathansadowski Thanks! Forces of Prod. was snatched from my clutches by the library but yep, need to revisit that/other Noble at some pt :) @jathansadowski I just ordered Does Technology Drive History? and of course will need to reread Winner. Any other killer pubs to check out? @jathansadowski Nice! Let's chat at some point. I have a handle on AI-specific args some ppl make, but just getting feet wet on det'ism lit. @jathansadowski The independence thing is very imp. but more than I can do now. Parsing/situating args for "this will happen" = rough scope. @jathansadowski yeah I was gonna mention I will have to leave much to my esteemed colleague "future work" ;) @jathansadowski the discourse stuff at high level is def. huge, but also want to scrutinize some causal/market-based args on their own terms @jathansadowski yep that's pretty much what I envision - STS/determ. lit in convo w/ specific args for why various AI stuff is inevitable. @jathansadowski Though a title with alien symbols may be an interesting notion. ;) @jathansadowski lol it looked fine on my end. Was supposed to be Autonomous Technology but italicized, as in Winner. @jathansadowski Lol couple possible versions: 𝑨𝒖𝒕𝒐𝒏𝒐𝒎𝒐𝒖𝒔 𝑻𝒆𝒄𝒉𝒏𝒐𝒍𝒐𝒈𝒚 and Autonomous Technologies, or Are Autonomous Systems Autonomous? etc. I have a cool title (I think) for a paper on AI and tech determinism and some ideas for it, but so much to read/think about first. #gradlyfe Carruthers in Architecture of the Mind: our minds shld be more modular than insects' (for various reasons), many philosophers think opposite "Requirements for artificial companions: It's harder than you think" by Aaron Sloman http://t.co/0nm28lXb3C RT @SethBaum: I'm honored to be profiled in a new @sciam piece "Evaluating the Risk of Events That Could End Civilization" http://t.co/9vb4… @petitegeek Is your dissertation available? :) This $17 billion thing has to be a joke. Just....WHAT @nerdsrocket @zeustoves @knewscript As long as they don't kill off Lupo, I think I'll power through it. Example: just ONE of the goals listed in the interim report is linking neuronal activity to behavior. Ummm that's kind of a big deal. Still haven't seen evidence that the BRAIN Initiative is more focused than DO ALL THE (neursocience) THINGS! Would like to be proven wrong.. RT @techreview: Academics at CMU will try to extend Yahoo’s services with mobile apps that act like personal assistants. http://t.co/zOH3eq… @nerdsrocket @knewscript @zeustoves Watching Eureka, enjoying it, thx @nerdsrocket I think for recommending. And I may be in love w/ Lupo. @jathansadowski Yeah, I didn't really like a lot of the language used there. RT @jathansadowski: Excellent article on the further spread of Neo-Taylorisitic sensors & surveillance in every corner of the work place: h… RT @mashable: Google Publishes Dos and Don'ts For Glass Owners http://t.co/R8WtQsP5We RT @alicebell: I really don't understand why people fanboy Latour so much. Or why they hate him. He's just a bit dull. Go to the pub instea… @j2bryson Also, reading about dog psych. reinforced my hunch that dog (minus useless aggression) + Watson = good medium-term robot ideal :) @j2bryson Cool! I love dogs. Almost tweeted earlier that I'm always impressed with how well they use legs/snouts to move stuff around. "The Seven Deadly Myths of 'Autonomous Systems'" http://t.co/XJJnGY7AUq @petitegeek As for the question you asked, no idea, but interesting hypotheses/initial results! Sounds like you're onto something. :) @petitegeek Read Jackendoff's book "A User's Guide to Thought and Meaning" and his enthusiasm was infectious :) Language is pretty sweet. Now there are 107,000 players in the crowd-driven Pokemon game http://t.co/FUA2FbVlaw @JohnDanaher @danieldewey @xuenay @j2bryson And may never exist. My hope is early AI will co-evolve with norms/policy gradually/safely.(3/3) @JohnDanaher @danieldewey @xuenay @j2bryson Superintelligence could dominate today but a world with AI+ will be different in many ways(.2/2) @JohnDanaher @danieldewey @xuenay @j2bryson Nice post. My issue with some of the lit. is conflation of AI potential with AI future. (1/2) @JohnDanaher @danieldewey @xuenay @j2bryson Will do. Thought abt this while reading Armstrong's new e-book. Important link in AI as x-risk. Sounds cool, reading shortly! @danieldewey @xuenay @j2bryson MT @JohnDanaher AIs and the Decisive Advantage Thesis http://t.co/T2QCWBgGWq @FHIOxford yep! Thanks for the intro. Had a nice chat. @FHIOxford thanks! Let me ponder, was thinking of writing something related soon (re: AI design/reg space/AGI) anyway. Is this Sean btw? :) IHMC researchers on "coactive design"and how it informed their approach to the DARPA VRC/round one (they got 1st) http://t.co/iHbhF5OfCK "Long Term Requirements for Cognitive Robotics" http://t.co/pA3m125M68 Cont'd: Early evolution may have involved eating humans' trash. Survival of friendliest. Human-interestedness/understanding is innate (2/2) Finished The Genius of Dogs. TL;DR: dogs great at understanding humans, evolved from wolves most interested in humans/least aggressive (1/2) @nerdsrocket @knewscript @zeustoves Seconded. @knewscript @zeustoves @nerdsrocket @netflix now I know what you're talking about, was being stupid. My standards are pretty incoherent ;) @zeustoves @knewscript @nerdsrocket Don't get me wrong, I love a lot of bad sci-fi, but even for me this was a bit much. :) @knewscript @zeustoves @nerdsrocket I couldn't finish Hardware and it has killer robots, so that says a lot. Not sure what unserial show is? @petitegeek congrats!!! :) @zeustoves @knewscript @nerdsrocket speaking of things that shouldn't be said: every line in Hardware. Netflix has so much horrible sci-fi. @petitegeek how'd it go?? @zeustoves @knewscript @nerdsrocket @netflix lol I thought I understand, maybe not. Moore = Ron Moore, BaC = Blood and Chrome.. @knewscript @zeustoves @nerdsrocket @netflix GDP would drop a bit when Trekkies binge watch a whole season for a few days but worth it ;) If you take an extremely broad definition of "knowing how to do X" then that's all that matters to do X, but then it becomes tautological. Intelligence/knowledge are def. part of the solution to big problems, but so are organization, policy, resources, values, commitment, etc. Also disagree w closing pt (sorry @lukeprog): achieving X is prob. of figuring out how to do X. Lots of things well understood but unsolved. To be sure, AI will prob. get much, much better and more widespread, but its centralization and scope of action aren't both inevitably high. What I disagree most with in this book is probably the arguments for why "[highly centralized] AI dominance" is inevitable. Reading Armstrong of @FHIOxford's "Smarter Than Us: The Rise of Machine Intelligence." Much I agree/disagree with. http://t.co/mdQjjPSEC7 @mark_riedl He is nothing if not confident ;-) Temple Grandin talking about her new book, "The Autistic Brain: Thinking Across the Spectrum" http://t.co/9ei3JuhvGt There are now around 70,000 ppl collectively playing one game of Pokemon http://t.co/FUA2FbVlaw "Atypical Combinations and Scientific Impact" by Uzzi et al. http://t.co/usE1N1bb9j @jathansadowski Winner FTW (pun kinda intended) Ex.: timeline deliberately vague. Abt current jobs automated, not net % impact. Not predicting X, saying plausible. Model accuracy limited. Super annoying to see Frey/Osborne's great (but caveat-filled) automation paper misquoted almost every time it is brought up :( Not to say they were right about all of them, but still. Bravo. So many connections btwn e.g. Asimov's non-fiction + robot ethics literature Turing and Asimov anticipated/rebutted almost all of the broad categories of philosophical/social objections to AI and robotics long ago. LOL MT @nickkristof But so few academics are on social media. How many anthropologists, sociologists, philosophers on Twitter or FB? RT @cns_asu: Submit your abstracts to the Governance of Emerging Techs: Law, Policy & Ethics conf. by 3/1. http://t.co/HUZr9mkAjN http://t.… RT @robotenomics: New report -- @Robotics the fastest growing industry in the world http://t.co/ykgSPDOjin #Robot #AI #Automation Finished season 2 of House of Cards. The key message of the show seems to be that everyone in DC is horrible, except maybe journalists. Jackendoff's "A User's Guide to Thought and Meaning" is great. Recommended for ppl interested in language viz-a-viz cognition/consciousness. @davideagleman @PopMech See also an article from myself and @j2bryson on why he is wrong about that. :) http://t.co/nkEYKaUDZo @knewscript First of ep of season 2...wow. I'm on ep. 7 now. @jathansadowski Source? The args for it are overwhelming. Unjust Deserts + The Myth of Ownership = two good books, for example. @j2bryson Slate's comments are better than average. On comment sections in general: http://t.co/jVSgMW0nwp @sramamoorthy No prob! To me, the Q of net job gain/loss is interesting but the fact that tech changes the *nature* of jobs is indisputable. RT @grok_: "They're obviously anthropomorphising it already." New Scientist talked to me about robots and religion: http://t.co/1ThsyuXwaC For me, House of Cards is a really long and entertaining reminder of one of the reasons I grew disillusioned with DC. RT @katecrawford: Great article on @feraldata's work at Intel: contains robots, beanies and social science research. http://t.co/5xuhIjWXIT Update: the human hivemind is still making slow, painful progress playing Pokemon: http://t.co/FUA2FbVlaw @nathanjurgenson @j2bryson I don't think I've seen basic science that couldn't at SOME level of abstraction be described in interesting way. @cocoadog @j2bryson Yeah, I didn't write that title. Could make sense under some stretch of interpretation but not what I intended :) @robotenomics @j2bryson See: https://t.co/dXQMtziLrK some combo of ppl trying it and going to next page/clicking and some1manually fixing :) RT @j2bryson: I was nervous to read the comments on our “real AI” @slate article, but they’re actually a decent discussion :-) http://t.co/… Has anyone written about basic vs. applied research/dev. as exploration/exploitation at field level? Stretch? Too obvious to discuss? Other? @j2bryson @nathanjurgenson I (charitably?) interpreted "don't matter" as low social influence, not unimportant. Also: http://t.co/JDmuFkFWE7 I hate jetpacks as ex. of slow tech progress. They were never a good idea (bc energy efficiency) or seriously funded, why would they exist? @petitegeek Def. Seems to involve some combination of empathy, theory of mind, ethics, them vs. others. Easy stuff ;-) I'll check that out. @petitegeek Yep. I wrote a paper on why machine ethics over the long term (as anti-Terminator strategy) is risky cuz ethics is too weird :) Someone beat me to Q-learning in Flappy Bird. Good to know my plan woulda worked (stopped bc bored/bad coder)RT @jtoy http://t.co/DMU2anO4cV @petitegeek robot X loves Y if X's utility function includes Y's as a major portion of it(absolute or relative other factors/ppl)? :) @mgubrud Fail. @mgubrud know what you mean but on what basis can they do that? @mgubrud what do u mean by the last part? @mgubrud Ugh. F***ing sneaky document. @nerdsrocket http://t.co/SW1e9fwi5K @mgubrud Don't know which weapon you're talking about/details. @mgubrud what does "used in a manner that falls outside the policies" mean in enclosure 3? violates them, or diff. context like cyber etc.? @mgubrud [excluding Enclosure 3 bc i have a Q about it] it wouldn't fire on any that aren't selected. can prioritize within targetS plural. @mgubrud NVM I see what you are referring to in enclosure 3, I was just reading the contents, not the scope at top. @mgubrud to be clear, I'm not saying I support the policy.. @mgubrud "that" being Enclosure 3 overriding the specific prohibition against selecting human targets? @mgubrud on semi-auton. def., still doesn't contradict what I said - humans must select targets. on enclosure 3, why would that be true? @mgubrud page 3 says semi-autons can't select targets + autons can't select human targets. can pull trigger, though, you're right abt that. @mgubrud my use of the term was just meant to say that I disagree w/ your interp. I think it says no kill decisions by bots. @petitegeek I see benevolence and love as closely related - love as focused/high degree of ben.? See some stuff here http://t.co/CSX8Ho4h2M @nerdsrocket I'd be supportive of a #savekennex campaign. @mgubrud Also heterorgeneity, ex. DSB wrote report problematizing "levels of auton." framework, machine ethics, subsequent reports ignored.. @mgubrud My interp of that doc is no kill decision by bots. But I agree 1. autonomy makes that fuzzy, 2. there may be creep over time. Almost Human could be cancelled at the end of season one http://t.co/JY1cAvdVbZ @nerdsrocket don't shoot the messenger ;) "Intelligent Robots: Our Future or Fiction" by @hawesie http://t.co/ZBWRcqGGk5 … RT @BrendanNyhan: Public engagement by academics is getting better, not worse MT @monkeycageblog: Dear @NickKristof: We are right here! htt… "like humans’ puzzling ability to do science, their puzzling ability to take part in modern organizations is partly a pseudoproblem" bc hard "A key part of [explaining abstract reasoning's evolution] is that, in fact, humans 𝒅𝒐 𝒏𝒐𝒕 readily engage in these forms of reasoning." Ibid "Language not only lowers the cost of acquiring a complex skill but multiplies the benefit." Ibid. "The cognitive niche: Coevolution of intelligence, sociality, and language" by Steven Pinker http://t.co/fej4uHkHLG RT @nathanjurgenson: lots to critique in Kristoff's academic (ir)relevancy op-ed, but that first sentence is sadly correct http://t.co/IgV5… RT @shannonconley33: What Americans Don't Know About Science - Eleanor Barkhorn - The Atlantic http://t.co/CfPGKQbrhi Watching the sci-fi movie Code 46 (2003), pretty good. Issues related to biotech, genetic screening, etc. Nearer term Gattaca-ish. Spike Jonze getting annoyed that reporter wants to talk about technology re: Her http://t.co/wi5bWa1LEZ RT @nocoastoffense: I’m a graduate of the MOOC of hard knocks @mgubrud Military itself also says it's not in the business, but if we're still fighting wars in a few decades... @j2bryson @sramamoorthy This paper also has a very good literature review. http://t.co/QkhF3OT3n0 @j2bryson @sramamoorthy It's somewhat controversial still. Personally I think the args in Second Machine Age (recommended) are persuasive. @j2bryson Cool, I'll check out Samuels - thx! @j2bryson thx, read a while ago but should reread. On a modularity kick recently - starting Carruthers' book Architecture of the Mind soon @j2bryson @Slate Lol! RT @JohnDanaher: Interview with philosopher Susan Schneider - mental lives and Fodor’s LOT http://t.co/r8dY2hDFPw @jathansadowski =part of the motivation for @j2bryson and my piece! I can proudly say I had 1 future, 1 present post same day, both impt ;) @jathansadowski But they also aren't exclusive - "emerging" may not pan out til beyond that. We're doing badly however you look at it. ;) @jathansadowski Not in AI/bots, at least, but you may be right in general. Could list maybe ~100 academics on "emerging," handful >20-30 yrs @jathansadowski The issue of priorities is super important but I also like to emphasize that we just aren't doing nearly enough of anything. @jathansadowski Dunno in general but in AI there is little long term STS/RI work in academia. I want more past, present, near, long term. @jathansadowski the discourse/funding are not aligned as he implies. Negligible funding outside defense/intel. for long term thinking (2/2) @jathansadowski You will like the first issue of JRI, discussion piece/responses on anticipation/futures. But I would add that (1/2) @jathansadowski For the near/medium term, Singularity is what you said. Drives me bananas when journos take Kurzweil timelines at face value @jathansadowski well, not "disagree," since you were stating your interests. Just have diff. interests. @jathansadowski I generally became disillusioned with most philosophy - that stuff played a role, but so did anti-philosophical philosophy. @jathansadowski Shockingly, I disagree ;-) @jathansadowski *which I agree with, but what "it" is, how to think abt it, and right distribution of focus btwn that/other stuff is harder. @jathansadowski yeah, I like Clark's stuff in general. His views are more tempered than some. Just says it could be true, so think about it. @jathansadowski May check out his latest at some point (Constructing the World), sounds kinda wacky, though, could be boring. @jathansadowski Same. @hawesie lol. I like how in the original RoboCop, a menacing robot is foiled by stairs. @jathansadowski lol I love The Conscious Mind. Agree with Dennett's points there re: it having very strong args (if still wrong conclusions) RT @j2bryson: Not to mention @EvanSelinger, The Outsourced Lover http://t.co/wzFCk3M6ZB #futurefriday RT @TeachGuz: And Google, chatbots and on and on RT @slate Artificial intelligence is already here. It's name is Watson: http://t.co/AJp4Zi… RT @gleonhard: “AI is likely to change our civilization as much as or more than any technology that’s come before, even writing” http://t.c… RT @HRC: Congratulations, @EllenPage for taking the steps to live openly and come out as lesbian. #comingout #timetoTHRIVE http://t.co/Pneo… "The Mystery of David Chalmers" by Dan Dennett (response to Chalmers's Singularity paper) http://t.co/AxlWuPkFdd @knewscript Yup. I just found out earlier, hence my dashed ambitions ;) @knewscript No, starting season 2 :) @sarahjeong Ugh I was looking forward to it. Did it turn into tech politics pseudoscifi crap? :/ "embodiment is ... a part of our intelligence and therefore our language, [but memetics] accounts for the origins of that language." Ibid. Finally got around to reading @j2bryson's "Embodiment versus memetics" - awesome paper. Recommended. https://t.co/rVZjAkQtrS Was pretty disappointed by the movie City of Ember. Sometimes the critics of sci-fi movies are right, haha. :) OMG House of Cards...I had so many grand ambitions for this weekend. @mburnamfink @ASUEmerge Are you a drone pilot for Emerge? Nice vid on robot/machine ethics featuring Wendell Wallach, @PeterAsaro, @grok_ http://t.co/oLF2Z9IUyo Also see link to AI one on the right. The human hive mind is currently playing Pokemon here (responds to commands anyone can enter): http://t.co/FUA2FbVlaw @j2bryson @anilkseth And this at Atlantic. #futurefriday? http://t.co/SH1M97JO5N @jathansadowski @onekade the turtleneck make me think of Logan's Run https://t.co/M4q15LGjfr @use_theforce_em @nerdsrocket Adding Farscape to my to-watch list. Nice article! New @Slate @FutureTenseNow article co-authored with @j2bryson on Watson: http://t.co/nkEYKaUDZo RT @j2bryson: Why Watson Is Real Artificial Intelligence http://t.co/DKuAmWTUoR by @Miles_Brundage & I (thanks @EvanSelinger for intro to @… @sramamoorthy @j2bryson I agree w The Second Machine Age's abt short term policies-edu, welfare, immigration etc = stuff we should do anyway @use_theforce_em @nerdsrocket yep. I cry every time. Spoiler-filled article on RoboCop + robot ethics FYI: http://t.co/MpkaN94DkC @j2bryson @alan_winfield @rcalo @grok_ @jgcarpenter @GaryMarcus RT @AliMattu: On our Valentine’s Day @NerdHour podcast we discuss what happens when geeks fall in love: http://t.co/bovBVNS70B http://t.co/… @nerdsrocket @use_theforce_em haha! Fair enough. @nerdsrocket @use_theforce_em and Zoe/Philomon on Caprica before (spoiler omitted) happens. Almost renamed my dog Zoe. @nerdsrocket @use_theforce_em I know you prob disagree but I really like Adama/Roslin :) RT @grok_: PBS made an awesome video on robots with @PeterAsaro, Wendell Wallach, and myself: http://t.co/YFiUxpDlMH @jgcarpenter @xuenay glad I didn't write the article ;) read it late last night and figured he had to be missing stuff. Thx for comments! I have a new post on RoboCop and robot ethics up at @Slate (spoiler alert!): http://t.co/MpkaN94DkC @38apples I did not say/don't think they are. RT @FutureTenseNow: How RoboCop got robot ethics completely wrong, by @Miles_Brundage http://t.co/nasK2x0IjR @j2bryson Good point, hadn't thought of it in terms of that distinction. Google is indeed way more transparent about, ex., Glass. @j2bryson @alan_winfield Thanks! Watching City of Ember, sci-fi movie I hadn't heard of til the other day. Kinda like Waterworld but underground. Hope it's better, though. "RT @EUCogNetwork: CfP: ICRA 2014 Workshop,""Autonomous Social Robots: The Ethical Challenges Ahead"" May 31, 2014, Hong Kong http://t.co/62y…" @xuenay Wonder if @jgcarpenter has thoughts on this..? http://t.co/fbJkNpMBSA "The Structure of the Space of Possible Minds," Aaron Sloman (1984) http://t.co/yxja2BpZSs Done writing all the things. @AliMattu @zeustoves @nerdsrocket @knewscript It's no Her/T2, for sure, I'll say that. @nerdsrocket I'm a quick learner ;) RoboCop gets a C on entertainment value, F for OmniCorp's implementation of robot ethics/A+ as robot ethics cautionary tale. Blog post soon. @nerdsrocket @knewscript @zeustoves @AliMattu Lol. I think it's cool :) @nerdsrocket @knewscript @zeustoves @AliMattu My view of it was prob skewed b/c I watched it through a robot ethics lens. Good performances. @knewscript @zeustoves @AliMattu @nerdsrocket RoboCop gets a resounding "OK" grade from me. Writing something about it (spoiler alert). @alan_winfield @j2bryson Might write something on RoboCop/EPSRC principles. The "except for nat security" clause was controversial, right? The senator opposed to lethal autonomous robots in the new RoboCop movie is named Hubert Dreyfus. Subtle. Any tweeps seen the new RoboCop yet? @sramamoorthy @j2bryson I seem to recall a broadly Asimovian [implicitly pro-basic income eventually] vision in his pop sci book... @jrbarrat @AlArabiya_Eng Pretty sure he was just unknowingly misquoting the Frey and Osborne @FHIOxford paper. @danieldewey which symposium is this going to be presented at? RT @etzioni: I watched an accident play out in slow motion & realized it was the movie Gravity and I just turned it off. #overrated RT @erichorvitz: BBC technology piece on AI and conversational systems: http://t.co/2EH2byahIb @knewscript @zeustoves @AliMattu @nerdsrocket true. I enjoy the exposition of pretty much any sci-fi so I often forgive poor endings :) "Learning, Social Intelligence, and the Turing Test" by Bruce Edmonds and Carlos Gershenson http://t.co/8PN1A5iY6F @zeustoves @AliMattu @nerdsrocket @knewscript also a sucker for Olivia Wilde. @zeustoves @AliMattu @nerdsrocket @knewscript I think he did well, yet his role tainted the movie's image but again, sucker for dystopias ;) @zeustoves @AliMattu @nerdsrocket @knewscript yep, similar - nice connection. I enjoy it. Has Cillian Murphy, Olivia Wilde, Amanda Seyfried. @AliMattu @nerdsrocket @zeustoves @knewscript btw y'all seen In Time with Timberlake? Watching it again now. Underrated IMO. The FOA includes manufacturing automation MT @TerynNorris $25 million to boost US solar manufacturing competitiveness http://t.co/w75Wstffcr They surely do have specific reasons/plans, and their underlings have more specific ones, but at the end of the day they're nerds with $$$$$ Brin, Page, etc. have said repeatedly they dream of Google making the Star Trek computer. They don't need specific reasons to invest in bots And cuz Google's run by nerds MT @therobotreport Google invested in bots to compete with Amazon/partner with Foxconn: http://t.co/jenbpoiPsS Fail. He didn't say that, nor does the paper he cites. MT @AIUpdate Robots to replace human laborers 'in 10 years' http://t.co/Wo4TvfDNZm @jathansadowski Reminds me of that book "Without their Permission" RT @alan_winfield: On @Robohub my answer to Q: What does it mean to have giants like Google, Apple and Amazon investing in robotics? http:/… RT @cns_asu: See #ASU-#CNS's Dr. Erik Fisher give testimony on #RI at the President's #Bioethics Commission: http://t.co/qgSfLjfifg RT @TerynNorris: DOE announces new $25 million funding opportunity to boost US solar manufacturing competitiveness http://t.co/0wMG9IxckP Browsing AI books at the library, open up a book and lo and behold I find this cool @j2bryson chapter on modularity! http://t.co/rRz5DGDthl @GrandpaRobot @robotenomics yeah I do not think either is doing a great job ethics-wise, just saying IBM's research/market plans are clearer @GrandpaRobot @robotenomics don't know what you're referring to re: swagger or IBM being quiet @robotenomics @GrandpaRobot thx will check out when home. Still, hint vs many papers, countless talks, a book on IBM strategy/goals, etc... @danieldewey np! In class now but look forward to reading :) @GrandpaRobot true but still think IBM is orders of magnitude more open about what it is doing and why. RT @mark_riedl: Hofstadter: Corporate greed derailed the search for true AI; Watson & Siri aren't real AI. http://t.co/nDmGFa0NSN (No endor… @j2bryson @mark_riedl @thekibosch sent you some stuff Joanna :) IBM's Watson commercialization efforts seem way more organized than Google's AI/robotics efforts, though maybe just b/c latter isn't as open RT @danieldewey: "Reinforcement learning and the reward engineering principle", on controlling autonomous & general RL-based AI: http://t.c… The trailer for Transcendence suggests the movie comes close to approximating the @MIRIBerkeley/@FHIOxford arg. for AI as existential risk. RT @Floridi: CFP - Annual Meeting of the International Association for Computing and Philosophy, Thessaloniki, GR, July 2-4, 2014 http://t.… @j2bryson @mark_riedl the need to think seriously about reforming education, welfare, etc. if ppl continuously discount AI progress. @j2bryson @mark_riedl maybe should have made this pt in my paper: anti-hype can have bad consequences too, ex. complacency w.r.t. (1/2) @j2bryson @mark_riedl haven't seen that, thanks! Yeah, true. @j2bryson @mark_riedl maybe the thing about "once it works, the public doesn't call it AI" should be amended to be the public + Hofstaedter. @zeustoves @knewscript @nerdsrocket @AliMattu BTW, I thought Babylon A.D. was sorta entertaining, though I'm a Vin Diesel/dystopia apologist @zeustoves @knewscript @nerdsrocket @AliMattu Honestly I haven't even watched enough to see much supernatural stuff. Dragons, I'm fine with. @knewscript @nerdsrocket @zeustoves @AliMattu And it just so happens (shocker) I think sci-fi is full of ideas :) 10/10 sci-fi...game over. @knewscript @nerdsrocket @zeustoves @AliMattu lol yeah I agree w the point. Personally I'll take 9/10 production + ideas over 10/10 any day. @knewscript @nerdsrocket @zeustoves @AliMattu Confession: not very into GoT. Could be b/c medieval stuff isn't my thing. @knewscript @nerdsrocket @zeustoves @AliMattu @LYONSPOTTER which isn't always correlated with the quality of the show/film, unfortunately. @knewscript @nerdsrocket @zeustoves @AliMattu @LYONSPOTTER I also put a premium on low-stress ways to stimulate thinking abt the future :) @knewscript @nerdsrocket @zeustoves @AliMattu @LYONSPOTTER Will do. Now, Babylon A.D. The things I do for...er, not sure why I'm watching it @nerdsrocket @knewscript @zeustoves @AliMattu Alrighty, I've read enough today. Now for some "generally panned by critics" sci-fi. @nerdsrocket @knewscript @zeustoves @AliMattu @Syfy I support James Callis doing anything he wants. @nerdsrocket @knewscript @zeustoves @AliMattu @Syfy Wait, Land? Never mind. World is my stomping grounds. Dunno if they're similar. @nerdsrocket @knewscript @zeustoves @AliMattu @Syfy Love that ride. @zeustoves @nerdsrocket @AliMattu @knewscript Sigh. Is that worth seeing a second time? I was popcorn-flick-entertained but not much more. @jathansadowski @mattthomas Not mutually exclusive with strong criticism, though: some views/ppl are indefensible. Case-by-case, I think. @jathansadowski @mattthomas I think the norm of presenting the best version of their arg/assuming good intentions is valuable, too, though. @nerdsrocket @zeustoves @AliMattu @knewscript Almost Human needs moar lens flare. @zeustoves @nerdsrocket @AliMattu @knewscript And now a BSG one. If there are too many I will feel exploited and resent it. Sigh. #nerdlyfe @zeustoves @nerdsrocket @AliMattu @knewscript Lots of Star Wars and Blade Runner images/easter eggs/dunno what to call 'em here and there. @nerdsrocket @zeustoves @AliMattu @knewscript I'm also biased by the Blade Runner and Star Wars references. RT @timoreilly: Foxconn working with Google on robotics http://t.co/ROeX31Kr87 via @jstogdill @DougHill25 @zeustoves @nerdsrocket @AliMattu @knewscript My rule of thumb=power through unless you HATE it but I defer to the expert (Corrigan) here :) @knewscript @nerdsrocket @AliMattu @zeustoves And Stephen, it has Cyrus from Caprica :) That counts for a lot in my book. Love him. @nerdsrocket @knewscript @AliMattu @zeustoves Good enough to declare fanboy status, I loooove where it's going. @nerdsrocket @knewscript @AliMattu @zeustoves Me too! Halfway through. Loving it. @nerdsrocket @knewscript @AliMattu @zeustoves Maybe my issue was just not knowing it'd be a procedural. @knewscript @nerdsrocket @AliMattu @zeustoves Trailer: http://t.co/VwKk30ZnkP @knewscript @nerdsrocket @AliMattu @zeustoves Also the two leads have great chemistry and carry it through the dark ages, recommend for sure @nerdsrocket @AliMattu @zeusa Agree. I was just annoyed that there were all sorts of cool ep 1 threads that were left hanging for like ever. @knewscript @nerdsrocket @AliMattu @zeustoves It's solidly entertaining overall, even when it's not as good as i think it could be... @nerdsrocket @AliMattu @zeustoves @knewscript Ex. this one really annoyed me and I ranted about it (SPOILERS): http://t.co/irMnO9dXxF @nerdsrocket @AliMattu @zeustoves @knewscript Haha. I stand by the claim that many of the mid-season eps were mediocre/didn't add much. @AliMattu @NerdHour Good one! I bet there are lots of good historical and contemporary academic ones, I just picked two that came to mind. After the last 2 Almost Human episodes I'm officially a fanboy. It had me worried for a while. @nerdsrocket @AliMattu @zeustoves @knewscript @NerdHour @AliMattu Oh and Bill and Melinda Gates are def. a great geek power couple for sure. @NerdHour @AliMattu That's a toughie...Pinker/Goldstein and Churchland/Churchland are good ones but I'd need to think more ;) Enjoying ep. 4 of @NerdHour, Valentine's Day edition with focus on nerd couples. There is hope! :) @AliMattu RT @io9: Transcendence trailer is a lot more violent than we expected! http://t.co/TT1yZZR4bg Watched a pretty weird cyberpunk movie last night, Nirvana. On Netflix. Woulda been a lot better with good dubbing. @petitegeek And maybe play around with em (they have six I think?) for other purposes at some point, should they let me/I have an idea :) @petitegeek RoboCup Standard Platform League. ASU has a new team so I'm getting familiar with the software and seeing if I can contribute :) This is the week of RoboCup and RoboCop for me. Finally got a CD drive so I could install Nao software. Two things I learned: CD/DVD-RW drives are super cheap now, 2. Nao software is cool. @sarahjeong bitcoin-related video for you. Note the kid. http://t.co/NTSiJRaMjR Certainly not the only person to have made that sort of argument, but her recent papers give lots of good examples/frameworks 4 doing it. Her point is more applications are opened up that way than waiting for robust vision, etc. Ex: "can you please put this book in my basket." Veloso argued 4 interruptible/symbiotic autonomy at AAAI workshop last year: accept limitations of bots in near-term, have em ask for help. Nice interview w/ Manuela Veloso, current Pres. of AAAI. http://t.co/ukGjk8V8g6 See also cool recent paper http://t.co/zBNo8Zka84 @nerdsrocket Did you end up finishing/enjoying the ep? Podcast was entertaining/funny as usual btw :) Need to get my Sherlock shit together. RT @AliMattu: The Valentine's Day @NerdHour podcast is up! We talk about being a geek, falling in love, & what happens next: http://t.co/bo… By "pleased" with that I mean that it isn't perfect but humans still exist and aren't living under a dictatorship. Counts for something. Of course, Caprica eventually succumbs to a robot uprising so that's an issue. :) And the income distribution in Fifth Element is unclear. In sci-fi terms, I'd be pleased with a gradual transition from today to Caprica (~50 years) to Fifth Element (~250) to Star Trek (~500). Continuum's high-tech not-quite-1984 vision of ~50 years from now socio-technical risks is very well done. Need to rewatch. #scifi Had to abbreviate that bc character constraints. Mainly referring to people who say you have more "power" because of, ex., faster computers. When ppl say "you have more tech than the President 20 yrs ago," I think of Syndrome (The Incredibles): "when everyone's super, no one is." @nerdsrocket That link isn't actually very spoiley, but erring on the safe side. Listening to the podcast now! @nerdsrocket I'm trying ;) Some discussion of the episode here FOR WHEN YOU'RE DONE. *SSPPOOIILLEERR AALLEERRTT* http://t.co/BsLs1HSqkQ @nerdsrocket Yep. My main beef with the show overall is not much continuity - hopefully it is moving in that direction. [holds tongue] @nerdsrocket Haha fair enough. Minka Kelly isn't too shabby either, though her character isn't very interesting. Needs moar long plot arcs. @nerdsrocket Haha glad you're at least enjoying that aspect of the episode :) @OddLetters ICYMI Chief O'Brien at Work series: http://t.co/P9UaTe1pAq RT @nerdsrocket: David Marley & I nearly come to blows over whether @RealJBD is in "Ghost Rider" in this week's #ElectricFancave. http://t.… @jathansadowski @YannickLeJacq haven't seen any, but haven't looked. @nerdsrocket indeed. Look forward to the latest one! @nerdsrocket haha I still needed to learn that lesson though, so thanks for calling me out. :) @nerdsrocket May make my BFF watch Almost Human tonight if that's any consolation. Watched Dredd recently too. Spreading Karl Urban love ;) @nerdsrocket haha fair enough. I still think you'll enjoy it though. I hope!! :) I was telling my friend that I watched Robot and Frank and he thought I said Robot Ann Frank. @nerdsrocket it was MSNBC and he is "AOL's Digital Prophet" David Shing http://t.co/1egkNKujfQ "Incremental Machine Ethics" by Thomas Powers http://t.co/7xzf4kYCuf "Computers as Surrogate Agents" by Deborah Johnson and Thomas Powers http://t.co/S8AA9cQZUD @j2bryson @alan_winfield Haha, yeah. At this point it seems like Google's main "competition" is its internal dynamics/bureaucracy and hype. RT @GaryMarcus: “A new equation for intelligence”? @garymarcus & Ernie Davis address ideas in Alexander Wissner-Gross’s TED talk. http://t… @nerdsrocket OMG that is THE BEST. I'm still sad I wasn't with my dad when he shared an elevator with him. RT @nerdsrocket: Oh man. Samuel L. Jackson PWNED this KTLA dude. http://t.co/nNDERUTk18 #theotherblackguy @petitegeek I thought this sounded pretty cool too: http://t.co/Tjt1HXPIrn "How We're Predicting AI--or Failing To" by Stuart Armstrong and @xuenay http://t.co/sqmIyHcKOk RT @ShannonVallor: On algobot high frequency cheating: "It's Wall Street at its most socially useless." http://t.co/VLbxDsayUv "Google side-steps AI rumors" (2005). http://t.co/1UHoRJv3Hj Said pretty much what they do now. Search could be better, we won't be evil. Deals w other stuff besides what's in that paper, but much of it can be summarized: Details matter. Person!=agent. Legal agent/person!=human But it's boring for someone not interested in all the bad proposals. The gist of their view is captured in this paper http://t.co/Iiqf9WE2Yb It's comprehensive and authoritative. The authors did their homework, and it's great for someone interested in detailed legal issues w/ AI. Done with A Legal Theory for Autonomous Artificial Agents...some thoughts (disclaimer: I skimmed parts of it for reasons I'll explain). Today I was reminded that Gameshark was a thing. Maybe "the ideal legal agent is an artificial agent with limited autonomy, one incapable of the ... misconduct associated w/ human ones" "[Considering many] artificial agents as legal agents of their human or corporate principals" is coherent, useful = Chopra/White's thesis @j2bryson @BathHacked @thewestgatepub Your local gov't is way cooler than mine. @nerdsrocket I learned Shia Labeouf is a troll. Dunno if I shoulda known before or if I should never have known it. http://t.co/eD5GzM8Eik They may both have independent value (indeed, I think they do) but are often conflated in talk of education/importance of programming. Lots of programming can be done without learning much about, ex, what AI can/can't do, relevant to life in 21st century, and vice versa(2/2) Learning to program and learning computational thinking are complementary but not the same. Latter is more important for kids, I think.(1/2) RT @j2bryson: Nice popular-science summary in @NatureNews of deep learning & the big corporate AI push right now hT @petitegeek http://t.c… RT @DefTechPat: A robot in every home: Dyson enters race to provide ‘advanced household androids’ for all http://t.co/8lsJvZSWoI A Legal Theory for Autonomous Artificial Agents (book) is off to a good start: good summary of AI, agency, intentional stance in chapter 1. RT @LMalloy: Sexy pop-culture reference: Actual, boring title. #SixWordPaperTitle #psychology RT @jameswilsdon: Good post by @adrianshort on Lottie Dexter & #yearofcode, which seems like a total fiasco http://t.co/e2TcPeFkNi http://t… Also, the chapter on metaphysics and Wittgensteinian deflationism thereof in Shanahan's Embodiment and the Inner Life is good, deals w/ Mary Pleasantville reminds me of Mary the neuroscientist (http://t.co/h3lLrknqR8). They def learned something when they saw red. Also, good movie Finished @mpshanahan's Embodiment and the Inner Life. Interesting/well written. Recommend for ppl interested in consciousness/AI/psych/neuro @petitegeek er, I guess that's what you were referring to by workshop :) @petitegeek Nah, I wish! :) You? @petitegeek I have nothing to add but interesting topic :) your dissertation sounds really cool! It's Arcade Learning Environment, not Atari as I said before (though it uses Atari). Elements can be used for other domains with adjustment. "The Arcade Learning Environment: An Evaluation Platform for General Agents" http://t.co/PIMMSISOUS more here http://t.co/Z0R8GSDwNF "There is tangible free speech potential in cryptocurrency, and it should not be easily dismissed." - @sarahjeong http://t.co/YqsadTumLp @nerdsrocket :( that really sucks. Sorry to hear. Good luck to you and him/her! Daniel on Delete can modify a superintelligence's code in a few hours; meanwhile I struggle to adapt well-documented AI to Flappy Bird. Fail Also, people gave Delete a lot of flack for the lighting and camera angles, but I actually like it. It has a realistic feel for the premise. Enjoyed rewatching Delete. The "where superintelligence came from" is silly, but some of the other stuff is semi-plausible. Entertaining. RT @jgcarpenter: Registration now open for We Robot 2014. Tix are FREE, but space limited. http://t.co/MSzIlsV5OZ ht @rcalo #robots #confer… RT @le_feufollet: Huge chimpanzee population thriving in remote Congo forest http://t.co/rrQlaF3UxZ @nerdsrocket Brutal. Been there, cleaned that... @rcalo Just registered! RT @rcalo: Can't believe this line up at We Robot 2014. http://t.co/e4tZh215EU The Atari Learning Environment (+ the papers about/based on it) is really cool. Looking into interfacing it w/ Flappy Bird but it's tricky. @nerdsrocket If I win the lottery, (hard considering I don't play, but more likely path to riches than mine), I'm hiring a sci-fi consultant @nerdsrocket noted! Thanks :) @nerdsrocket only some. Should I add to my to-finish list? @nerdsrocket sidenote: I love how a handful of people are in all of BSG, Caprica, this (Delete), Continuum, etc. I want to learn their names @nerdsrocket Watched some earlier and it's not playing now here (AZ/Mountain Time). Kind of annoying that it is staggered by time zone in US @nerdsrocket you still get culture points for watching at all. :) Meanwhile I am watching the miniseries Delete which I've already seen. RT @hypatiadotca: Awkward skin condition Wikipedia selfie people: I salute your contribution to our intellectual commons. ICYMI Russian police dancing to Get Lucky. It's....well, just watch. http://t.co/fklS0b7Eek "We noticed that using k=4 [in Space Invaders] makes the lasers invisible because of the period at which they blink." -DeepMind paper. :-) @nerdsrocket Yeah, my brain is broken because of my early Friday class so I'm just doing random stuff and hoping it will somehow help me. @nerdsrocket Haha it's what the kids these days are playing, or so I've been told. I haven't played it yet myself, no intention to. @zeustoves @AliMattu @knewscript @nerdsrocket Hat tip to @robotenomics for that one :) really great flick. @nerdsrocket @PBS Nice. I'm reading, watching movies, and writing a program to play Flappy Bird. #YOLO @AliMattu @knewscript @zeustoves @nerdsrocket I also recommend Eva to those who haven't seen it already: http://t.co/tuXC4p9diU RT @rcalo: Congolese woman builds giant robot to solve traffic problem. http://t.co/1GZeH2Vt6A Trying to make a program to play Flappy Bird. #toomuchtimeonmyhands RT @IEEEorg: A new 4-gigawatt #solar plant project in India will be the world’s largest. http://t.co/1zVr8R3glF via @IEEESpectrum @petitegeek :) @robotenomics The example uses listed in the DeepMind patents are pretty cool. @robotenomics Nope - looks cool, though! Much narrower than the DeepMind thing though since it's just for stuff on Amazon ("just" ;) ). Read DeepMind's patents - TL;DR: iterative image search where the user hones in on the feature/object/color/etc. of interest in the image. Playing Atari with Deep Reinforcement Learning (by people at DeepMind, er, Google) http://t.co/SdvnlsBXT6 @AliMattu @knewscript @zeustoves @nerdsrocket And Ali, it's not all as disturbing as the beginning, but still recommend for day watching :) @knewscript @AliMattu @zeustoves @nerdsrocket Not on there :/ Fifteen Million Merits is the one I watched, plan to watch the rest eventually @AliMattu @knewscript @zeustoves @nerdsrocket Done! Stand by Carruth being a genius, perhaps an evil one, though ;) Creepy but recommended. @knewscript @AliMattu @zeustoves @nerdsrocket Yep, on Netflix. Not sure yet if the insane creepiness is worth it. Seen 2 eps of that, great! @zeustoves Yup - wrote/director/starred in both I think. He has interesting but creepy ideas. @AliMattu @knewscript @zeustoves @nerdsrocket Yeah it's super creepy. Trying to power through it so I'll have time to recover before bed :) @knewscript @AliMattu @zeustoves @nerdsrocket Watching Upstream Color (one of you recommended?), really good. Shane Carruth is a genius. @knewscript @AliMattu @zeustoves @nerdsrocket I like it. The Rock def. needs to do better than Doom and G.I. Joe in this sci-fi department. @nerdsrocket or more specifically, why was it weird :) RT @jathansadowski: As @Miles_Brundage said it's like this IT Crowd episode about the Internet button, but REAL http://t.co/tzJyJ9LDQh - ht… @nerdsrocket he was very chill. What was Fraser like? @nerdsrocket I was at a bday party and he was renting next door while in the play Thurgood nearby. We invited him over and he hung out :) This two-hour fan-made RoboCop remake is the RoboCop remake we deserve http://t.co/KpTvDAQNqM RT @theinformation: Google Ventures was the third most active venture capital investor last year, with 73 investments. https://t.co/IeiQ6sk… RT @grok_: Boo. The first Intellectual Ventures overbroad-patent case to reach a jury ends in mistrial. http://t.co/7kFikas9P4 @electricfeast @nerdsrocket nice post! I feel similarly about my work. + you met Brendan Fraser?! My celeb zomg moment was meeting Morpheus. RT @CSPO_ASU: Call for abstracts for May conference: Gov of Emerging Tech-Law, Policy, and Ethics. Due 3/1 http://t.co/L0HyIfzEeD @j2bryson agreed! @j2bryson though the book makes clear that AI still isn't human level by then (~2040?) so ppl interact w dumb AIs and diff. looking avatars. @j2bryson very interesting... Reminds me of Ready Player One (book), which envisions (plausibly I think) VR taking that to new level. :/ @j2bryson yes, they've declined a whole lot in the US over the past few decades...I think something like 6% in private sector. Very low. @j2bryson thx. I mentioned unions w.r.t. automation adoption in my last Slate post. Will be interested to see how this plays out! @sarahjeong Is there a coherent reason for buying cryptocurrencies, besides speculation? I don't get it at all. Interesting interview with Robin Hanson about the future, prediction thereof, prediction markets, and related stuff: https://t.co/LF3yKuQDxb RT @robotenomics: Yoshua Bengio shared, Interview on DeepLearning with Google's Geoff Hinton: http://t.co/hSJyzIjhLc @nerdsrocket @knewscript @joerogan @SyfyTV @zeustoves I was just watching TZ the other day! Very groundbreaking stuff. @mpshanahan Thanks, I'll check that out! @knewscript @zeustoves @nerdsrocket VERY highly recommend Her. @knewscript @zeustoves @AliMattu @nerdsrocket And speaking of Fast Five...some actors, like The Rock, may not be best for long plot arcs ;) @knewscript @zeustoves @AliMattu @nerdsrocket Def. makes sense sometimes, though I agree w/ Jesse abt. one and done sometimes too :) ex. Her @knewscript @zeustoves @AliMattu @nerdsrocket You know I agree about Caprica/BSG always ;) though films/books/games, etc. have roles to play @knewscript @zeustoves @AliMattu @nerdsrocket Watching Fast Five right now on TV and am inclined to say that movies aren't dead yet :) @knewscript @zeustoves @AliMattu @nerdsrocket Haven't thought much, but they'll have to pry my movies (and books) from my cold dead hands ;) @zeustoves @knewscript @AliMattu @nerdsrocket Yup. I'm quite concerned about the new Star Wars. :/ He's done great work, though... @knewscript @AliMattu @nerdsrocket @zeustoves Yeah, that's a toughie. Moore is right not to want to rush into it without a great idea. @AliMattu @knewscript @nerdsrocket True. Well, I never got into Mad Men but I'll take your/everyone's word for it :) That Potter article I mentioned earlier has one of the clearest summaries of brains vs. digital computers I've seen. http://t.co/HLHKxoDxxJ This Zimmerman-DMX thing is just bananas. It's like we're living in The Running Man or something. @AliMattu @knewscript @nerdsrocket Maybe a dumb question but why? @knewscript @AliMattu @nerdsrocket it's about various mysterious happenings a biological research facility in the Arctic (spoiler-free! :) ) Has Patrick Stewart's life just become crashing random shows/media? Not complaining (Picard can do no wrong), just wondering... @mark_riedl Oh and also, the press issue is discussed in the EPSRC Principles of Robotics (high level message 7) http://t.co/klxGEJBIO7 RT @RobotLaunch: Pentagon Opens DARPA Data to Public | @scoopit http://t.co/HVWpxsTL72 @knewscript @AliMattu @nerdsrocket I'd support that (though Helix so far = :/ ). He said he would need an epiphany first. Ron Moore on the need to bring Star Trek back to TV, where it belongs http://t.co/qYinYkOvpz @knewscript @AliMattu @nerdsrocket @mark_riedl Perhaps we could discuss when I've read some of your papers? Would be very interested to explore what might be possible/useful. @mark_riedl Mostly it's been researchers criticizing other researchers for hype. But definitely interesting topic to be explored more. @mark_riedl Little bit. Nourbhakhsh paper I cite (ostensibly abt. robotics but relevant to AI) talks abt ethics of hype, framing, etc. @mark_riedl though that's my pre-reading-your-stuff half-baked notion :-) @mark_riedl chunks/suggesting inputs (different choices in design/regulation space of AI), then thinking abt desirability of worlds (2/2) @mark_riedl yeah, I was thinking something along the lines of AI as facilitator/stringing together narrative chunks, humans authoring (1/2) @mark_riedl in more detail in the Bennett/Miller paper I cite). Plus, it'd just be plain cool to use AI to think abt. its own future :-) @mark_riedl Very cool! Sci-fi is 1 way of stimulating discussion of the future of AI I suggest here http://t.co/RbznhKEifP (+ analysed (1/2) @mark_riedl I have one of your papers saved to read. Have you thought about AI/crowds making sci-fi scenarios? Relevant to my interests :) @nerdsrocket jealous. :) I live sooo far away from the beach now (well, I guess just a few hours, but by Florida standards that's a lot). @mpshanahan liking your (most recent) book so far! Recommend any relevant Wittgenstein besides PI? Also, seen this? http://t.co/MKe26eAh4M @j2bryson what's going on? One of my fave things in Japan was when the machine broke and a guy popped out of the wall to fix it. Great UI :) RT @cns_asu: Check out VIRI affiliate @ProGReSSRRI interviews on #ResponsibleInnovation's meaning, history & place in global gov http://t.c… RT @LeapingRobot: An open letter to @neiltyson -- http://t.co/WxB99jyfQM "Cosmos and is going to give you a bully pulpit. Use it like Carl … RT @nerdsrocket: 95% of the time when someone starts an email to me w/ "with all due respect," something super condescending and disrespect… The Legg quote on extinction making the rounds is just one part of one of many interviews on AI risk collected here: http://t.co/S3ImaZhNYW Wittgenstein on talking abt subjective sensations: "A 'nothing' would serve just as well as a 'something' about which nothing can be said." "Science fact, not science fiction" is the hobgoblin of boring/simplistic thinking about the future of technology. Done with Consciousness Explained (highly recommended), working on @mpshanahan's Embodiment and the Inner Life. Both are Wittgenstein fans. "Hybrids of living neural tissue and robots ... may inform future AI." - What can AI get from neuroscience? http://t.co/HLHKxoDxxJ "RT @EUCogNetwork: CfP: ICRA 2014 Epistemological issues in robotics research and research result evaluation Hong Kong, June 5 2014 http:/…" @nerdsrocket now I can't enjoy my victory over this book having spoiler-failed the same night. Sigh. #gradlyfe "An intelligence that is too big for our theory [must be replaced with] semi-independent semi-intelligences acting in concert." Dan Dennett @nerdsrocket haha that could work, too. @nerdsrocket that's fair. If I could have a spoiler alert on all of my tweets I would. Maybe that'd be a good profile pic, in fact! @nerdsrocket Aahhhh!!!! Sorry. Though like I said, he reeks of bad guy to me. Maybe it's just bc I watched Richie Rich recently. RT @zeustoves: I know printing a house in 24 hrs is important, but so is 30 foot long concrete star destroyer. #3dprinting Liked the new episode of Almost Human more than most, though they should have suspected John Larroquette - see: Richie Rich. @nerdsrocket Guy on Almost Human designed a robot that killed 26 people, repercussions seem to be just losing robotics license, shame. Robot ethics fail. Best #deeplearning paper so far w.r.t. scope + readability: Representation Learning: A Review and New Perspectives http://t.co/ak4PztqWey Next basic #deeplearning paper, for anyone who cares to follow along :) On the Expressive Power of Deep Architectures http://t.co/tP93GlDDNb @petitegeek this is another good starting point ;) https://t.co/SUoFQ8LGMN @Miles_Brundage It also learns rudimentary voice commands and comes with companionship and owner-defense modules. No Watson integration yet. This autonomous robot integrates robust perception and locomotion + uses reinforcement learning. Under $1k! http://t.co/3J0XJMJ3Or "In general, what we think of as generic learning algorithms can only work well with certain types of data representations" LeCun/Bengio '07 RT @alan_winfield: Evolving Science Communication: 10 years of #SciCom at UWE. 1 day conf. 4 April 2014. Register now at http://t.co/iDIItp… @petitegeek @anki well, I guess Rethink already is selling 'em. Scratch that comment :) @petitegeek @anki did they say that or just guessing? If anyone starts selling non-research-purpose humanoids soon, I'd guess Google... @petitegeek @anki lol I remember they said at some point that the cars were just a stepping stone to non-entertainment applications. welfare (see: alcoholism, mental illness, and homelessness among vets). The best thing Budweiser could do for veterans is go bankrupt. (2/2) I know Chuck (Budweiser parade ad) and he's a great guy. But Budweiser is one of the worst actors on the planet from the POV of veteran 1/2) What's interesting about RoboCup (to me) is that it requires integrating lots of often-separate domains of AI/robotics/multiagent systems. Had nice chat with head of the new ASU RoboCup team. Gonna check out their code - RoboCup's a good test of AI/robotics state-of-the-art. "RT @PsychScientists: Aizawa's latest swing at embodiment: What is this cognition that is supposed to be embodied? http://t.co/ktGHecgGlV" "RT @EUCogNetwork: International IEEE/EPSRC Workshop on Autonomous Cognitive Robotics University of Stirling, 27-28 March 2014 http://t.co/…" @nerdsrocket similar points here http://t.co/HiKsx17RU2 RT @pverdegem: Mark #Zuckerberg’s theory of #privacy http://t.co/8bUR2SoUWJ via @benteka Nice Q+A section at end of that Jeff Dean video - cuts to him paraphrasing Q's then answering 1 by 1. Wish all vids were edited that well! Before Her, there was Hank's virtual girlfriend in The 6th Day. She had a holographic "body" and he had some sort of brain stimulating chair @nerdsrocket and I'm glad I'm not the only one who hated the Spiderman movies. They're so lame. @nerdsrocket Listening - thx for the shout out - pronounced it right. I Googled it and found http://t.co/YshR649Ifh. So everyone's right :) Learning about ASU's newly formed RoboCup team tomorrow. Should be interesting! Finally working on my backlog of deep learning papers. 1st: "Scaling Learning Algorithms Towards AI" Bengio/LeCun '07 http://t.co/fUqZjk23DS @j2bryson "Welling says that Hinton has a habit of suddenly yelling: “I understand how the brain works now!” It’s an infectious thing." @j2bryson Haven't met either one but based on this http://t.co/O1oL0M3n7W I saw it as friendly teasing re: him saying the brain thing a lot. RT @erichorvitz: Study on power of leveraging data from multiple hospitals to do prediction just published: http://t.co/xctcOqSpF9 "Taming Latency Variability and Scaling Deep Learning" by Jeff Dean - deep learning part starts at 22 mins in http://t.co/VaM5vSa7w2 @j2bryson I just assumed it was all good fun between friends but maybe that was naive of me... RT @nerdsrocket: And now for something completely different: Electric Fancave episode 3 is up and ready for downloading http://t.co/OfOEclb… @j2bryson Yup! Haven't heard of the '07 NIPS thing. @knewscript @AliMattu @nerdsrocket too long/didn't watch version of Demolition Man: http://t.co/4h1Y3rzopj @knewscript @AliMattu @nerdsrocket Demolition Man :) Corny but entertaining/gutsy (ex. imagining changed language), some enduring tech ideas @knewscript Yeah, I like it/am up to date. Its quality kinda varies depending on the extent to which it develops the main plot which I like. I read Philip K. Dick's exegesis, don't recommend - incoherent. Its value is just as a reminder of the need to take mental illness seriously @nerdsrocket @AliMattu @knewscript I do it through a combination of consuming media I can (kinda) count as research and not having a life. @AliMattu @knewscript @nerdsrocket my book and media queues have no fixed length, so recommendations are welcome anytime :) @AliMattu @knewscript @nerdsrocket at my rate of consumption I'll be done with all but DS9 soon - I watched Demo. Man twice this month. ;) @nerdsrocket @AliMattu @knewscript LOL yeah I was gonna just ignore that... ;) @AliMattu @knewscript @nerdsrocket I really like Primer and Safety Not Guaranteed. Need to see the others, thx! Based on smallish dataset/only a few thousand possible categories but often gives impressive results. And funny ones. Think I posted this already but ICYMI - cool demo of image classification (based on neural nets) - just upload a pic! http://t.co/M7fv7qI54t @AliMattu @knewscript @nerdsrocket I also enjoyed some non-TNG/DS9 stuff from a time travel collection but could have been cuz time travel. @AliMattu @knewscript @nerdsrocket that's strong praise! Will def give it another shot. Should I still watch seasons 1 and 2, though? RT @nerdsrocket: @Miles_Brundage @zeustoves @knewscript Galaxy Quest is a perfect film. @nerdsrocket @zeustoves @knewscript And of course Galaxy Quest. I think that was the beginning of my Sam Rockwell love. @nerdsrocket @zeustoves @knewscript Love him. Ex. Justin Hammer in Iron Man 2, could have been a whatever role but he just ran with it. @zeustoves @nerdsrocket @knewscript I love Moon! And Sam Rockwell in general. @zeustoves @nerdsrocket @knewscript :) yeah, powering through the first (often slow) half season or so of shows is a good rule of thumb. @petitegeek No plan yet - my family lives there so I could bring my dog and have free housing, or stay and melt here :) ideas welcome! @nerdsrocket @knewscript OK I'll stop spamming, then, haha. Looking forward to the podcast! @petitegeek I may spend this summer in Seattle so will have to check Vancouver out while I'm in the neighborhood! @nerdsrocket @knewscript I wrote this little number on BSG: http://t.co/paB1mDXvRp @nerdsrocket @knewscript admirable. @nerdsrocket @knewscript OK, I forgive you, kinda. ;) Caprica intrigues me more tech/ethics-wise than BSG + @zeustoves did great FX work :) @nerdsrocket @knewscript re: BSG? they're not. the first two "episodes" on Netflix are miniseries halves, the real eps are like 45 mins. @nerdsrocket @knewscript @AliMattu I love TNG so much, and should remember the first season was kinda weird and slow. Will power through DS9 @nerdsrocket @knewscript @AliMattu how much did you watch? I'm biased cuz I study AI stuff but I <3 <3 <3 <3 <3 <3 BSG/Caprica. RT @jathansadowski: Proud to say I went this long without "problematization" in my word processor's dictionary. @knewscript @nerdsrocket @AliMattu Ep 1 of DS9 seemed bad, but I should practice what I preach about powering through the early eps of shows @knewscript @nerdsrocket @AliMattu :) Stupid, racist people trashing the Coca Cola commercial: http://t.co/SY2H4XO8zV @nerdsrocket @knewscript @AliMattu one huge mark against my nerd cred is having no significant Doctor Who or non-TNG Star Trek experience :/ @nerdsrocket @knewscript @AliMattu I watched like half of it on a plane one time, need to finish it for real now, forgot. Thanks :) @knewscript @nerdsrocket @AliMattu Haven't seen Turkish SW, will watch. Is Indian Matrix the "best action scene ever" http://t.co/FRLGprZvPB @nerdsrocket @knewscript @AliMattu And yeah, I love campy sci-fi. Watched Dredd the other day to balance out Judge Dredd. @nerdsrocket @knewscript @AliMattu Seen it :) @nerdsrocket @knewscript also @AliMattu calling all nerds What are some good sci-fi movies that I probably haven't seen? Same thing I ask myself every night, Pinky. Halp @nerdsrocket @knewscript #AI/#cogsci tweeps - anyone recommend anything by Fodor? Have seen very mixed reactions to his work and wouldn't know where to begin anyway. @sarahjeong omg I am loling hard. This is so amazing(ly horrible) Simple summary of the basic ideas behind deep learning by Yoshua Bengio: http://t.co/0xuKKFCO6o Reading Bengio/Lecun 2007 soon, cited a lot. RT @keithfrankish: Things you never hear a philosopher say 1: "That's a good point. I was quite wrong.' RT @j2blather: RT @deeje: Facebook did A/B testing to determine that users blamed FB on left, iOS on right, for slowness. http://t.co/U4TH1… RT @jameswilsdon: The @EuSpri2014 conference on S&I policy: deadline for abstracts is Feb 28 http://t.co/3OcL6BgXfD "RT @FHIOxford: New article from us on synthetic biology and information hazards! https://t.co/NR6stPfQWg" "RT @FHIOxford: Next week: FHI organises a unique interdisciplinary conference on systemic risk from ecology to finance & insurance. http://…" RT @EvanSelinger: @bbosker @j2bryson @Miles_Brundage Here's the reflections on Google's ethics board. http://t.co/p4Rwq0CP0X @robotenomics cool! my email is miles.brundage at asu dot edu, you mind recomending some Google+ ppl who are active on those topics? @robotenomics No I don't, maybe I should. In fact I'm not even sure exactly how it works :) I'll put that on my to-do list. Funny 2 minute cartoon, "The Deep Learning Saga," featuring Geoff Hinton, by Yoshua Bengio: http://t.co/nbSh9WGLZY "Machine Learning that Matters" by Kiri Wagstaff http://t.co/ycQGX6PW0E "What must a global theory of cortex explain?" by Leslie Valiant (2014) http://t.co/WGf7J0LEA2 Reduced my followees by 1/2 - Twitter is finally manageable again! Yay. No offense if I unfollowed you, made semi-arbitrary decisions. :/ RT @googleresearch: Read the Google Quantum A.I. Lab Team's interim report on recent benchmark results for the D-Wave 2. Read more at http:… @robotenomics relevant paper you might like https://t.co/k0RdiZDKd3 RT @j2blather: RT @forgotify: 4 million songs on Spotify have never been played. Not even once. We’re changing that. http://t.co/KLdrNjXNgM @alan_winfield @j2bryson @mpshanahan that's US Robots and Mechanical Men, Inc.'s business model, based on Asimov's writings for a class :) @alan_winfield @j2bryson @mpshanahan Also see: https://t.co/sXMtUQ1zcV (the colors don't mean anything, was being lazy) :) @alan_winfield @j2bryson @mpshanahan true - to me what's interesting is less 1 purchase than that their AI/robotics portfolio is huge now. Watching Brad Stone talk about his book, "The Everything Store: Jeff Bezos and the Age of Amazon" http://t.co/crEmWA4RJ5 @knewscript @nerdsrocket http://t.co/dh8Ln0loTk @nerdsrocket you're a great writer! Very brave piece. Design for an autonomous mobile robot with Q+A functionality: put an iPhone on my dog's collar running Watson/Siri/etc, turn on speakerphone Powerful article on a critical issue RT @nerdsrocket A Note About Philip Seymour Hoffman: Addiction Is Not Selfish. http://t.co/dh8Ln0loTk … @nerdsrocket I know, right? I know the Budweiser parade guy but still think it's over the top. Bruno Mars was good, Beyonce/Destiny's Child killed it, though. @nerdsrocket @OWLUSA @MichelleObama http://t.co/D9g8IYnu0q coin fail Hope Noah will be better than 2012, which is basically the same idea except the boat is made of metal and made by Chinese workers. @petitegeek @RekkaBell reminds me of http://t.co/rNSV7zuNqi :-) RT @ArtificialOther: Online Demos (Applets) of Artificial Intelligence http://t.co/Cdxz99CC9r #ai @geoffduncan haha always harder to catch stuff like that when you're the one who wrote it :) @geoffduncan fortunately most people's neural nets are probably advanced enough to interpret it as "invented" and not notice ;-) @geoffduncan nice DeepMind article. Think this is a typo FYI - "It basically invested the concept of a cat" invented? Two ways of looking at #deeplearning: 1. wow, it can figure out what a cat is from a bazillion pictures! 2. it requires a bazillion pictures RT @petersuderman: Philip Seymour Hoffman wasn't just a great actor in great roles. He was a great actor in crap roles. He took dead materi… Bill Murray is so old now. Also, never forget Space Jam. http://t.co/4PREVZ29aU @EvanSelinger Thanks! @EvanSelinger glad u like it! It's forthcoming in Vincent C. Müller (ed.), Fundamental Issues of Artificial Intelligence (Synthese Library) 2 ways of getting Kurzweil wrong: accepting his claims about being awesome at predictions, + attributing more modesty to him than he shows. Still, good article overall on DeepMind acquisition: http://t.co/cXwAvlY3Yg Giving Kurzweil too much credit: "a man who forecasts that intelligent machines may exist by midcentury." More like WILL exist in 14 years. @robotenomics nice. recommend the book overall? Also, "Resistance is Futile: Reading Science Fiction Alongside Ubiquitous Computing" by Dourish and @feraldata http://t.co/ZVrBxtoSNB One book mentioned in it is Make It So, about human-computer interaction as depicted in sci-fi - sounds very cool! http://t.co/CaZ9DcxuS1 Reading Science Fiction Prototyping, book abt using sci-fi to explore implications of tech. Poorly edited but good if you're into this stuff @EvanSelinger @j2bryson @bbosker For any1 interested, this paper could be read as high level framework for the board http://t.co/RbznhKEifP @j2bryson @danieldewey haha :) @j2bryson @danieldewey Ah! I'd love to see that dialogue :-) @j2bryson @danieldewey also, curious what u think abt this summary of long-term-AI-risk-acc'ing-to-(some at)MIRI/FHI? http://t.co/RH9A3elLAB @j2bryson @danieldewey You may enjoy Journal of Responsible Innovation coming out soon: good discussion of future v. present concern (2/2) @j2bryson @danieldewey nice draft! Yeah, saw the slides, though I was actually referring to the one abt @danieldewey's TED talk. (1/2) @j2bryson (2/2) objecting 2 plausibility of (culture-exploiting) dangerous AI someday a la @danieldewey or 2 the relative urgency/timescale? @j2bryson agree w your emphasis on near term issues (which I share :) ) but on rereading your blog post, still not clear if you're more (1/2 "multilayer feedforward networks can represent some functions [that 2-layer networks can't], but hidden layers are not a panacea." Ibid. Cont'd: "regardless of the learning rate, the number of hidden units, or the number of the hidden layers." "Any feature that lies outside the training space [of a neural network] will not be generalized properly" @GaryMarcus http://t.co/q9QAB2LRxC @knewscript The ending satisfied me. Would be great to have more, but it resolves what it needs to (immediately) resolve. @knewscript did you ever finish Caprica? Took me way too long to see Vanilla Sky (a year or so ago), cuz I didn't know it was sci-fi. Fail. Interesting transhumanism-related themes. @knewscript lol nice :) @nerdsrocket LOL No offense to anyone who follows me and I unjustly unfollowed - my stream has become totally unmanageable so purging, somewhat arbitrarily. Lol and tiny Michael Cera. @nerdsrocket Watching Frequency - great flick besides the premise. Forgot it has the bff from Truman Show and Reese from Person of Interest.@nerdsrocket @jgcarpenter @RoboEthics yup - see: https://t.co/YlzSdSVNNZ. :) I was kinda joking when I said Google is trying to become USR (Asimov) but after studying the latter's business model, it's pretty uncanny. Ordering The Algebraic Mind @GaryMarcus, Architecture of the Mind, and A Legal Theory for Autonomous Artificial Agents #gradlyfe #bookaddict My friend is watching After Earth, despite my best efforts to stop him. WHYYYYYYYYY!? @sarahjeong lol. one of the reasons I opted not to major in philosophy - stuff like that. Wild Friday night of sci-fi and deep learning papers/lectures. #gradlyfe RT @Liberationtech: PAPER: @KirstieBall, "Workplace #Surveillance: An Overview" http://t.co/QYwX53NA3s The Net on TV... Sandra Bullock is like Sarah Connor except instead of no one believing her about judgment day, it's cybercrime. @sarahjeong "Hooked: How to Build Habit-Forming Products" x_X clearly written for @jathansadowski http://t.co/0NIoeqDTSY @alan_winfield @jonWturney @robertskmiles Let me know your thoughts! Forthcoming- "Fundamental Issues of AI," ed. volume of Synthese Library RT @jathansadowski: Remember in the dark ages when we would start statuses as if they all began with your own name: e.g., "is thinking abou… Nice quote I heard today from architect Frank Gehry, relevant to research: "If I knew where I was going, I wouldn't do it." @nerdsrocket Nice :) @nerdsrocket Haha I still haven't gotten over my incredulity, but yes. Speaking of incredulity, Richard Ayoade is just too cool to be real. @nerdsrocket Watching now, loving it, but is that really how Jimmy Carr laughs? @alan_winfield @jonWturney @robertskmiles my effort at a general AI RI framework here for those interested: http://t.co/RbznhKEifP It's really annoying me how good Consciousness Explained is...could have read so many books in this amount of time, but worth reading slowly @jathansadowski true. I was being semi-facetious about "evil" - not very actionable :) remake comes out soon, will be interesting to compare @nerdsrocket Touche. I still lovehate Judge Dredd, though. If something has robots and/or came out between 1995 and 1998, I probably like it @nerdsrocket *then again, watching Judge Dredd and RoboCop until 1:30 am may not be the most responsible thing in the world. But reasons. @nerdsrocket Well since I haven't seen it before, I'm not yet addicted/enthralled, so I have the luxury of being able to postpone it :-) @nerdsrocket Kristen Schall and anyone associated with the IT Crowd are awesome. Will watch when I don't have class in a few hours.#gradlyfe RoboCop morals: don't privatize cops. Evil people shouldn't run powerful orgs. Test things first. Not really anti-cyborg/bot qua cyborg/bot. LOL the AT-ST-looking robot in RoboCop is foiled by having to walk down stairs. #scifi getting it right again (at least pre-Atlas/DRC). Smart kitchens are common in #scifi: smart *appliances*, not humanoid robot using dumb ones. Sci-fi got that right (though not ex. Jetsons). Maybe with new sensors RoboCop's field of view would be fully focused, but his old/human memories wouldn't be like that. #overanalyzingscifi RT @juliansavulescu: Call for papers: Bioethics & Human Enhanccement Workshop, Granada http://t.co/insXFM5y2t Journalist - "RoboCop - who is he? What is he? Where does he come from?" We should probably ask such things before deploying RoboCops. @nerdsrocket @VicSplintersRG I remember it being really good but only saw it once, I think. Huge sci-fi nerd fail. RoboCop shouldn't have half of his face exposed - he could speak without it and doesn't use/need facial expressions. #overanalyzingscifi @nerdsrocket @VicSplintersRG Totally forgot that movie existed - need to rewatch at some point. Thanks for the inadvertent reminder :) So far in RoboCop I've seen a malfunctioning killer robot and the bad guys from Blank Check and Total Recall. Off to a good start! #scifi RT @JustinWolfers: Academia, explained. http://t.co/KPYecH1Pk3 Leeloo Dallas Multipass! Will be very interesting to see what response Nick Bostrom's superintelligence book gets among AI people. @robotenomics As I've mentioned previously, anyone who thinks AI-as-existential-risk is just a sci-fi concern hasn't read the leading textbook :) Nice mention of AIMA textbook (1/2) MT @robotenomics “The Success of AI might mean the end of the human race.” Norvig http://t.co/iX1YCL8dMr @jathansadowski Thanks! Yeah, saw that - good reporting indeed. Humanity still exists 250 years from now (not too shabby in itself), population of 200 billion, freedom intact. Flying noodle restaurants. I always forget that The Fifth Element is a very positive view of the future, despite the whole pure evil descending on Earth thing. @nerdsrocket ah you did mention Donkeylips. You win. @nerdsrocket not done yet but enjoying it :) y'all are very funny. Hope Salute Your Shorts is mentioned - nev4r 4get Donkeylips. @nerdsrocket I think the slime was apple sauce, my sister was on it once (not on TV though - I grew up in Orlando) :) And yea, Face sucked. @mat Oryx and Crake by Margaret Atwood. Wonder if anyone else on the planet has watched Demolition Man twice in the past week (once with a friend, so not completely crazy). @robotenomics of particular interest is the bit abt diminishing returns w.r.t. data volume/work. wonder if formalizable arg? @danieldewey @robotenomics thanks for the RT :) btw, on deep learning/ML in general, have you seen this before? http://t.co/UC67MMw1Kj good paper. ICYMI my latest article @FutureTenseNow on technology and the quality of work http://t.co/YlLEJdD4SF @nerdsrocket No prob! it's fun listening to people geek out about stuff :) also a fan of @NerdHour, you may like it, too! @AliMattu RT @nerdsrocket: Just a friendly reminder: Electric Fancave ep. 2 is up and ready to help you have a geekier day http://t.co/awAUTYTY42 #po… @gleemie @nicksydow Happy to, thanks for doing cool research I could draw on! :) I'll check that out paper out, sounds great - thanks! RT @seanmcarroll: Patricia Churchland (@patchurchland) talks neurophilosophy on the Colbert Report (@StephenAtHome). http://t.co/LPYZlnozon @robotenomics source? RT @bradplumer: Obama says fracking offers a "bridge" to a clean-energy future. It's not that simple: http://t.co/hJXwmDOBpy RT @pverdegem: Will technology make work better for everyone? http://t.co/lUrPiIDxjo RT @nathanjurgenson: google acquisition fan-fiction @NerdHour I had the same reaction initially, but ultimately came to love it. Recommend powering through. Now, Helix... :-/ TBD. Meh so far. @j2bryson @robotenomics @mpshanahan speaking of which, Anders Sandberg on the ethics of brain emulations: http://t.co/Wc9sAr3cn3 RT @Slate: Three big reasons why the work of the future won't necessarily be fulfilling: http://t.co/YSPIW2f4kI My new Slate article on technology and work is up: http://t.co/3JbAVsu862 @robotenomics @j2bryson @mpshanahan nice, thanks! @PabloRedux @jobsworth Interesting pts. One tricky thing is you not only need good bias-countering filters, but also ppl to want to use em! @NerdHour good for sure! Also goes on the underrated list. Prob bc direct comparison/competition w BSG. Green Salamander team in Ender's Game = very Legends of the Hidden Temple. @robotenomics yup I have em all downloaded, just need to actually read em ;) @robotenomics any papers u recommend? Working on Google 2012 WordNet stuff, Bengio review (2012), Bengio/LeCun 07 (last one is cited a lot) @robotenomics with Legg's understanding of superintelligence and Hassabis's of neuroscience they surely hired smart, ambitious people. @robotenomics the Atari paper is def. cool! reading some other deep learning stuff at moment, not sure what to think abt potential/limits. @robotenomics nice. @robotenomics I'll have Slate piece tom. on this. Stay tuned! as I said b4, though, I think different types of AI have role if done right. @robotenomics @ericschmidt @gatesfoundation never mind I see what you mean now - got lost navigating the back and forth :) @robotenomics this is bad place for detailed arg (and I'm not best person to do so) but "AI is dumb now" is not reassuring re long term :) @robotenomics TBD ;) I'll be more confident abt us managing future tech well when we do a good job w/ existing tech - see: poverty, etc. @nerdsrocket that is the worst/best thing I've seen all day. @robotenomics inc'ing but not ltd to: not mutually exclusive (augmented humans=fewer humans needed) and much AI work does aim 4 replacement. @robotenomics On diff. note, this isn't against you (more that IBM quote) but the "AI augments not replaces humans" is flawed on many levels @robotenomics such things are focused on long term risk, not near, and have good args 4 it, and 2. Skynet doesn't exhaust ethical concerns. @robotenomics agree with you about a lot of things here but think the Skynet stuff is a strawman in that 1. those who ARE concerned abt(1/2) @AliMattu oh and Thirteenth Floor!! I always forget that cuz I think of it as a VR movie, not AI, but it involves both. And <3 <3 Caprica. @AliMattu @NerdHour Runaway and Virtuosity are some more of my favorite bad old AI movies ;) @AliMattu @NerdHour Not done yet but enjoying. I need to watch Iron Giant. Agree on T2, liked Sarah Connor Chrons too. No Wall-E love? :) Gonna read DeepMind's patents...anyone else read em? Very search-related... one's on iterative search, looks cool. Read some Hinton papers which are cool but narrow, looking more for "why deep learning matters/works" stuff like LeCun/Bengio 2007/reviews. Any really good #deeplearning papers I should read? Currently working on the 2012 Google ImageNet ones,2012 Bengio review, 2007 LeCun/Bengio Liking Ender's Game so far. Annoys me when Harrison Ford uses the words tactics and strategy interchangeably, though. #overanalyzingscifi RT @hypatiadotca: Finished "The Boy Kings". @katelosse is a brilliant, funny storyteller and everyone who works in tech should read it. @sarahjeong yep @nerdsrocket I don't know what it is about movies on TV that makes me have to watch them, even when I own them/they're edited badly. No, DVR, I do not want to watch Opposite Worlds instead of the State of the Union. Stop asking. @nerdsrocket lol I noticed that. AMC has also forced me to watch The Rock more than I otherwise would have recently. @girishsastry Nice, thanks! The Second Machine Age is a good read on these topics. I have a piece in Slate tomorrow that's related, too. @jobsworth @PabloRedux Nice posts! The serendipity stuff made me think of this http://t.co/sNvUiG3w8f generalized: good filters surprise you My copy of Embodiment and the Inner Life by @mpshanahan just arrived! Looking forward to reading it but should finish current books first :) @AliMattu @NerdHour I've been on a badish AI movie kick recently... ex. Demolition Man is campy but funny/plausibleish vision of the future. @AliMattu @NerdHour Nice! I'll check it out :-) @PabloRedux @jobsworth yeah, my point was just that the term search as catch-all is misleading. Link to filters blog series? haven't seen DeepMind will "just" be helping w/ search = misleading. Bigger picture is Google, IBM, etc. ultimately want Q+A/dialogue, not just links. "Machine Super Intelligence" (talk by DeepMind co-founder Shane Legg), part 1 of 12 http://t.co/vhBVqLQVa3 @j2bryson more detail here (+Tallinn keeps getting cited as co-founder but wasn't...Recode fixed orig. article) http://t.co/w37GcLwJms "RT @FHIOxford: Google buys deep mind for £400 million. We applaud their decision to establish an ethics board to evaluate AI. https://t.co/…" "Systems Neuroscience and AGI (artificial general intelligence)" - Demis Hassabis http://t.co/jiIUaWCnGZ RT @lizgannes: More on DeepMind: AI experts will join Google's core search team http://t.co/aPRLRksn12 with @jtemple Median estimate from this survey is 2050 http://t.co/UFKYkeYM3w 2040s http://t.co/fBH8ybRP2q @VincentCMueller is your survey data online? Also, I wouldn't call it "only" 50% chance of human-level AI by 2028... that is way sooner than most experts estimate in surveys. @lizgannes The quote in there about it being too early to think about AI ethics bothers me so much. Cuz AI doesn't affect society at all already... X_X So, DeepMind will be working on search. Not too surprising, I guess. http://t.co/Is75FyyS3r RT @waltmossberg: More on DeepMind: AI experts will join Google's core search team http://t.co/rVKkEBtk62 via @LizGannes "How 𝑫𝒐𝒆𝒔 the Mind Work? Insights from Biology" by @GaryMarcus http://t.co/FfJjVMQk7x ICYMI my new paper on AI and responsible innovation - quite timely with Google setting up an ethics board! http://t.co/z8DTYgJaAt RT @VincentCMueller: Very cool new Facebook page of the 'European Network of Cognitive Systems' that I coordinate. https://t.co/rnvGI6G9Gu @VincentCMueller FHI friends = Tallinn, Legg? I am very curious to know more about this ethics board, no details in the press coverage. So, DeepMind is big into deep learning apparently. Yet another reason to read more about deep learning... Wonder what percentage of post-Terminator Schwarzenegger movies have an "I'll be back" reference. The last two that I watched both do. @nerdsrocket this reminds me I need to catch up on that. Argh, must watch all the things. So hard to keep up. Interesting...both Demolition Man and The 6th Day (probably others) envision cars that are autonomous except for beginning/end of trip. The 6th Day projects a lot of interesting social/technological trends into the future, but the worst by far is thinking the XFL would last. According to this, the DeepMind deal involved the creation of an AI ethics board https://t.co/Em5wpMnUW7 OK, time to watch The 6th Day, one of the most underrated sci-fi movies IMHO. Corny bits but it's got lots of interesting ideas. @nerdsrocket I have lived in "hot," "hot," and [not even on the map because it's not a state, DC]. fail Interview with Shane Legg (DeepMind cofounder) about AI and existential risk: http://t.co/5JvbND5jw8 Per last RT, maybe it was worth 400 million if they have 50+ ppl and some patents/designs, but don't know about the latter... RT @lizgannes: Added some more background about DeepMind -- significant team and funding prior to acquisition. http://t.co/sfsZu7mBB3 $400 million sounds wayyyy too high for DeepMind/any small AI company, but it's hard to tell since there's very little info available. Legg literally wrote the book on machine superintelligence MT @lizgannes Google to buy AI startup DeepMind for $400m http://t.co/vyYVjGItjU My sketch of the business model of US Robots and Mechanical Men, Inc. (Asimov), which Google seems hellbent to become http://t.co/3FIdfunklW @xuenay @lukeprog @danieldewey https://t.co/bv76KwOzmR Wow, Google buying Deep Mind. Now is a good time to reread Shane Legg's dissertation on machine superintelligence (he works for them). RT @waltmossberg: Google to buy artificial intelligence startup DeepMind for $400m http://t.co/CdeEqZ2g0z via @LizGannes "Damage? Total, sir. It's what we call a global killer." Love Armageddon, on TV now. @petitegeek @brainpicker I really enjoyed that book, too! Seligman is awesome. Really enjoying this sci-fi movie, Eva. Lots of robots. :) English subtitles can be turned on. http://t.co/tuXC4p9diU via @robotenomics Love how Sandra Bullock's character's last name in Demolition Man is Huxley. Very subtle. @GaryMarcus I have a piece coming out next week on the other side of the issue - how tech will influence quality, not quantity of jobs. @robotenomics @GaryMarcus btw found the link to that interview here: http://t.co/NgETWJ0nUu @robotenomics @GaryMarcus IMO both human-like and human-complementary AI/bots have potentially very beneficial (/harmful) uses. Depends. @robotenomics don't think so, should I? Demolition Man is a silly movie, but I still enjoy it. Some of the stuff about changed social norms, language, etc. are pretty plausible. @j2blather ah. Oh, well, I'll settle for being p-creative if not h-creative as Boden would put it :) Lol...Rob Schneider as receptionist in Demolition Man: "If you prefer an automated response, press one now." "Things don't happen anymore. We've taken care of all of that." - Demolition Man. Also, the movie has some cool semi-autonomous cars. 20 years before Gravity, Sandra Bullock was saying stuff like "I find this lack of stimulus to be truly disappointing" in Demolition Man. Omg Johnny Mnemonic has a cyborg dolphin in it. Before I liked it, now I love it. This is what the Internet will look like in 2021 apparently. From Johnny Mnemonic. @sarahjeong http://t.co/QE2hdrsusl @knewscript Gattaca is so good. I'm on a bad sci-fi marathon though so can't watch it now ;) The Running Man is off to a good start with some heavy duty Ahnuld knuckle sandwiches: @knewscript The robots looked cool... @knewscript Nope, cool, though! Not sure I understood it, though - unicorn? @jathansadowski yup. @jathansadowski yeah I know, just funny. I see that ("no one suggests x" being wrong) a lot. @jathansadowski Also, when ppl say "no one suggests x", usually wrong. Re: non-humans making moral decisions- "machine ethics" is a thing :) @jathansadowski design, and intentional stances for understanding human, non-humans, etc. intersect in interesting ways w/ ANT (2/2) @jathansadowski just read the ANT article, very good. Doesn't seem controversial to me, maybe cuz I focus on AI :) Dennett's physical, (1/2) Watching the Romney documentary, Mitt, on Netflix. Really interesting. Nice complement to Russell & Norvig and more popular sciencey books on AI. Kind of in between the two in terms of detail. May have mentioned this before but The Quest for Artificial Intelligence: A History of Ideas and Achievements by Nils Nilsson is very good. RT @JesseJenkins: My friend @TerynNorris w/a stern message @Forbes to Silicon Valley libertarians: Why the Valley needs Washington DC. http… Ever since I heard about that "dogs pooping along North-South axis" article, I noticed my dog does it. Not always, but on average/roughly. @jathansadowski AOL Instant Messenger was the bomb. Just played some Halo 1. Classic. Good start to the day. RT @SuzanneWaldman: "Challenge is how to build capacity for foresight into collective decision making before evidence of global collapse is… @j2blather I made this joke the other day in text form but should have made a picture to lay claim to it ;) "RT @rcalo: 2004: privacy is about control over information | 2014: privacy is about the control information allows" RT @CuteEmergency: The saddest bird face you've ever seen. http://t.co/SUz8DEzr51 @jathansadowski Perhaps more interestingly, why did they announce it late Friday? That's for stuff you don't want covered... @j2bryson @rcalo I do :-) I also follow 900+ other less authoritative/interesting people so miss a lot of his tweets! Need to fix that... @petitegeek Congrats on finishing!! Epic boss battle (not really). http://t.co/hPXOsYVXMg "It all seemed to make sense...until Box." - Michael York in Logan's Run, accidentally summarizing the movie. I was totally unprepared for the ridiculousness of this gun-brandishing robot in Logan's Run. http://t.co/oGg8w38L4X People being ridiculous in Logan's Run. http://t.co/ufWQgAIMfd Surgery is done entirely by robots in Logan's Run. Not surprising/implausible, since it takes place in the 2300s. Logan's Run is like a mix of Shirley Jackson's The Lottery, The Island (film), and Asimov's The Naked Sun. Wondering why the WH would bury the data/privacy commission in the news late Friday, esp. since PR is big part of the value of such things. Surprised I haven't seen more coverage of this big data/privacy commission thing http://t.co/ZyhmlHzRq6 @jathansadowski Michael York is being coerced by an AI into seeking out and destroying resistance to the system. Everyone still wearing ridiculous clothes. Watching Logan's Run for the first time. Michael York has a brickish smart phone. Bad pyrotechnics. Silly looking jetpacks. Transporters. Anyone read The Creative Mind by Boden? Recommend it? OMG I totally forgot Amy Adams was on The Office. "The Sociology of the Future: Tracing Stories of Technology and Time" by Cynthia Selin http://t.co/5hDGRKLUyo @danieldewey Nice :) see also pretty negative review from Ernie Davis here http://t.co/z0wA5Fd6FZ Evolving Culture vs Local Minima - Yoshua Bengio - may be of interest to @j2bryson @xuenay @knewscript @danieldewey http://t.co/hWwBDvNFx1 @smc90 Great paper, though I wouldn't put much stock in the probability tables... see ex. some issues here I discuss http://t.co/5SOuMkuOoC Still, I hope future studies will follow up on their ambitious approach, but with more theory on the job classification side of things. Those estimates are extremely limited in their usefulness for many, many reasons, two of which I discuss here http://t.co/5SOuMkuOoC I like the Osborne/Frey automation paper, but the proliferation of screenshots of the VERY rough probability estimates is facepalm inducing. RT @nerdsrocket: Friday's a good day to try out a new podcast, don't you think? If you haven't already, check out Electric Fancave http://t… @nerdsrocket do you get to research pop culturey stuff for grad school, too? Cuz that'd be pretty awesome. RT @tylercowen: Gates vs. Carlsen, guess who wins?, http://t.co/eAoWwpaVnH @j2bryson @PabloRedux @weskaggs good/short article by Dennett on zombies here, also reprinted in Brainchildren http://t.co/DNSdnoDwCp @jathansadowski yeah, pretty boring/uncritical interview. They don't make semi-corny-semi-amazing sci-fi/action movies like they used to in the late 90's. Contact, Fifth Element, Gattaca, Men in Black, Armageddon, Deep Impact, Dark City, Enemy of the State, Lost in Space - 1997-8. Golden age. I don't know if I'm just a sucker for the dramatic music and fake Colin Farrell tears in the trailer but I really wanna see Winter's Tale. I'd make a video of my dog's skeptical "if I take this treat, does that mean you're about to leave? :( " reaction but it's just too cute. RT @CuteEmergency: sleepy little fox stretching after nap. http://t.co/VsegfzViC6 Article coming out next week on technology and the quality of jobs. Quantity isn't the only important thing! New jobs won't nec. be better. In case you forgot, you should see Her. Great flick. @jathansadowski watchin now. @nerdsrocket Nice, checking out now! Entertaining/funny stuff. @jathansadowski Recorded that, will watch at some point. OK, back to Consciousness Explained, then being unconscious, then a presentation on the business model of US Robots (Asimov) tomorrow. Not surprisingly, the Churchland interview on Colbert covered little ground, but good to see reasonable views get at least some airtime. @jathansadowski yep. @jathansadowski lol did you see Daily Show coverage of it? The irony of this episode of Colbert's fake lag/buffering joke re: net neutrality is that Comedy Central's website's streaming is horrible. RT @StephenPerse: #grammarguerillas Apostrophe wars on Cambridge street signs. http://t.co/XQphRSXvUV I have an extremely low threshold for the quality of sci-fi/fantasy movies I will see, but I still don't think I, Frankenstein meets it. @petitegeek Nice. I think Nishida mentioned he (Ishida)'d be a good person to talk to but I was in and out of Kyoto. Need to come back soon! @petitegeek haha yeah I didn't talk to him either, he was leaving a train while I got on :) @petitegeek *er, Osaka. The whole trip kind of blended together - did a lot in three days ;) @jathansadowski nice, I'll check that out. I am probably overly excited about Patricia Churchland being on The Colbert Report and will be disappointed... Yay brains, though. @petitegeek Speaking of Ishiguro, I spent some time with his android while I was in Kyoto. Then saw him IRL on a train. Was interesting :) @petitegeek Nice! Who? "Imagining Technology" (similar theme to last tweet - mutual influence of sci-fi and tech) http://t.co/Ksf3QFtLVJ "Better Made Up: The Mutual Influence of Science Fiction and Innovation" http://t.co/XV8qYGUEOI "Of all feelings to base a show around, glee? Thirst, now that's a show I'd watch." - Dwight Schrute "At its most powerful, sci-fi can be an inquiry into the human dimensions of technological futures." http://t.co/wZevwPwGBZ The fabulous life of filthy rich billionaires" - nice video to watch if you're running low on moral outrage http://t.co/kz27dWyan9 RT @literaryeric: About one in four Americans didn't read a single book last year, the most ever, and three times the number in 1978. http:… Mike Huckabee is a great case study in how to argue against people without making any effort to understand what they think. @sarahjeong I consider it a prototypical example of Silicon Valley rich-people-solutions-in-search-of-problems, does that count? What bothers me the most about the military's 30-40 year robotics plans is the assumption that we'll still be fighting wars then.#priorities Really enjoying Consciousness Explained so far, more than the other Dennett books I've read [bc more cohesive, detailed]. RT @Slate: This is an absolutely incredible historical document: http://t.co/kxr9QvOBKN http://t.co/ZIXwleAyjz Also, the grand prize on Opposite Worlds is 100k. What is this, 1960? Why so much lower than other game shows? SyFy channel budget I guess. First ep. of Opposite Worlds was just meh, giving it a last chance w ep. 2. Would be cool if the "future" house weren't just a fancy house. About to watch the premiere of Opposite Worlds. "We propose a theory that relates difficulty of learning in deep architectures to culture and language."Yoshua Bengio http://t.co/D5m18tUMW6 In case anyone hasn't already seen this - best action scene ever. http://t.co/rC5rHxYNex Judge Dredd is bad in an awesome way; Escape from LA is bad in a really bad way. Noe is not impressed by the movie Timeline. http://t.co/2IaJlcf6jm RT @petitegeek: Asking for a "friend": what jobs are out there for a researcher in emotions and machine learning? Any post-docs in autism o… RT @dseetharaman: Bill Gates tells Bloomberg TV that he's not returning to Microsoft - @Bloomberg via @breaking http://t.co/A7QBO7AjMH Economist cover story this week talks abt the Frey/Osborne automation paper. Good timing for my article on related stuff (coming soon!). :) @j2blather interesting. I touch on this somewhat in my new n paper w.r.t. individual researchers vs. prof. societies engaging public, etc. Anyone else going to AAAI/CogSci/Comp. Neuroscience/AGI 2014 this year? Which ones? So much stuff going on in Quebec City that week!! Can someone recommend good reading material on net neutrality and the proposed NSA reforms? RT @thisischristina: No, there aren’t “two cultures” http://t.co/pkEyYvct9M "Stanford processor [sic] named Andrew Ng" lol computationalist Freudian slip... anyway, article on Geoff Hinton http://t.co/P9BqryKYdM @grok_ @ChiaLynn seeing that made me very sad... @jathansadowski @mattthomas my dog is a lifehacker. @AliMattu I thought it was good, nothing earth-shattering, though. Just entertaining. Whereas I loved Her, but then again I love sci-fi :) @AliMattu American Hustle. Fat Apollo > Fat Christian Bale @jathansadowski Yup! I tried to do my small part of destigmatizing explicit engagement with sci-fi in my paper :-) I think I like Consciousness Explained more than the other Dennett books I've read so far, though they each have strengths #procrastireading @knewscript @jathansadowski sure :) see my latest paper! http://t.co/z8DTYgJaAt @jathansadowski nice, thanks, will do! @jathansadowski Great guess! Yep, though my dissertation committee will be somewhat different. @jathansadowski more importantly for my immediate purposes, my committee read it ;-) "we suggest that older adults’ changing performance reflects memory search demands, which escalate as experience grow"http://t.co/3Y21XTxQtq @jathansadowski this is the version I submitted for publication, though may get edits/comments from the editor at some point down the road. @jathansadowski Yup. @jathansadowski no prob! also see my paper and its bibliography which may be of use http://t.co/z8DTYgJaAt @mattthomas @andrewtshaffer I've recently discovered that tweeting about bad sci-fi is a great way to get unfollowed (not stopping though) Plan for today: read all the things. RT @rcalo: Extensive coverage today of OfficeMax letter to "daughter killed in car crash." https://t.co/k1prGDCOfW The Frankenstein Syndrome Questionnaire – Results from a Quantitative Cross-Cultural Survey @jathansadowski http://t.co/ZQW1vPKARO Should I watch Orphan Black? Revolution? Frey and Osborne's paper on automation has gotten lots of attn recently. Here's what I wrote about it: http://t.co/5SOuMkuOoC @nerdsrocket @mattthomas Firefox can usually handle my tabs... only really gets laggy if it's around a hundred or so and some have video. RT @j2blather: People behind me suggesting a flagship project in getting laptops to reliably plug in for presentations :-) @robotenomics you mean billion? 35 mill is nothing... @JonMichaelWalls thanks! Indeed. @j2blather @j2bryson haha :-) @j2blather thanks for the RT! Hope you and your tweeps like it :) Liked Card's "How to Write Science Fiction & Fantasy." Pre-Internet publishing advice dated, obvi, but cool insights on world-building, etc. @j2blather FYI, put up a copy of my paper, "Artificial Intelligence and Responsible Innovation" here: http://t.co/z8DTYgJaAt @Jackstilgoe @alan_winfield Thanks! Alan and I have tweeted/emailed a bit :) Alan, I cite your recent @EUCogNetwork talk. Thoughts welcome! My paper, "Artificial Intelligence and Responsible Innovation," as submitted for publication: http://t.co/z8DTYgJaAt @knewscript @zeustoves :) My research assistant hard at work providing moral support. http://t.co/IrBW2JFvYZ @knewscript @zeustoves No offense @zeustoves IMO Blood&Chrome is no BSG/Caprica ;) great FX/worth watching though, along w/ Razor, The Plan. @zeustoves @knewscript don't know bout that one but I love all the random references, like Doc Cottle's dad/grandfather? :) This book is good so far (for someone who doesn't know anything about business models)- very readable, visual. http://t.co/CN8fNthXWS @Netflix needs an advanced search function. Wouldn't be that hard - let me filter for things that are streamable, or in a category... Pretty much all of the tech in Her seems pretty plausible in the near-term (which is presumably the setting) except human-like AI. Wow a bunch of "Inside [company]" documentaries just dropped on Netflix. Chipotle, McDonald's, Linkedin... look cool. #nerdalert 6 years later, I just *now* found out there's an Avengers tease after the credits of Iron Man :/ @sarahjeong "due to the foresight of her Majesty's Government, [BBC] will soon permit [viewers to change the channel]"http://t.co/jDMdjOKYNv Netflix is pressing all my buttons - a documentary. streamable. about Chipotle. @sarahjeong there's more than one? Only seen the one with V for Vendetta bad guy. Starting book on business models soon, will be interesting to think about w.r.t. AI/robotics. USR (Asimov) leased, was liable for bots. Hmm. @knewscript LOL. very appropriate for us folks Tweeting about sci-fi on a Saturday night ;) @knewscript @zeustoves though as I said, I prefer Caprica in some ways. I've prob. seen each ep. more than each BSG ep. bc social relevance. @knewscript @zeustoves Yup, that's why I manage expectations when I recommend Caprica to people :) I <3 it but don't want ppl expecting BSG. Iron Man is on TV, oh dear...but I was supposed to be reading. @zeustoves @knewscript awesome - great job! :) @zeustoves @knewscript what was your role in Caprica/BSG? @knewscript @zeustoves lol. OK, back to some combination of Caprica, reading, and thinking about my next big thing :-) @knewscript @zeustoves but by the fleet reaches nuked earth, it's been 2k years. @knewscript @zeustoves so, bc they were traveling near speed of light, not much time passed btwn leaving and infiltrating colonies... @knewscript @zeustoves Whoops don't read that, it has Caprica spoilers! But yeah there was an Earth, got nuked, final five resurrected, left @knewscript @zeustoves http://t.co/AyurQXGens @knewscript Transcendence isn't out yet http://t.co/UCIlSvBaXT Yes, there was *an* "Earth" where the five developed resurrection tech. @knewscript and yeah, Graystone's worldview is pretty Kurzweilian. Though Johnny Depp in Transcendence basically IS Kurzweil. @knewscript Ha interesting question. Oddly I don't think I've heard Kurzweil reference sci-fi often, and if at all maybe just pejoratively? @knewscript Nice! Glad to hear :) yeah, it is sad. It does summarize what would happen in season 2 though at the end, no cliffhanger per se. All that talk of Caprica last night @knewscript made me wanna watch it haha rewatching for the n-th time... @jathansadowski well at least you know who wasn't the only you know what. @jathansadowski :( @jathansadowski that wasn't you know who about you know what was it? @jathansadowski ;( @jathansadowski why can't people write things down, that's just obnoxious. "Agents, Bodies, Constraints, Dynamics, and Evolution" AI Magazine 2009, Alan Mackworth http://t.co/mFTWCwbFPS @zeustoves don't get me wrong, it's one of my fave shows! I just include that caveat when recommending to folks- undersell, overdeliver :) @knewscript enjoy! ok, last tweet (to you) :) @knewscript I'll also tweet the submitted version of my paper, "Artificial Intelligence and Responsible Innovation," in a few days... @knewscript interesting possibility :-) @knewscript first issue will be open access, I'll tweet when it's up. @knewscript there will be good discussions of how to think abt the future of tech in 1st issue of Journal of Responsible Innovation :) #plug @knewscript Agree- my beef is less the content than the framing as scientific predictions rather than ballpark, vision, desired future, etc. @knewscript but that just raises another point - conflating tech. possibility w/ ubiquity. Most of his predictions are about ubiquitous use. @knewscript And per S.I.N., 1 more year to go before bots are supposed to be able to clean houses (presumably more than vacuuming). lol. @knewscript Agree 100%! I'd only add rationalizing false past predictions. Ex predicting (in 2005) fully immersive VR in 5 years was bonkers @knewscript It's all on Netflix so ripe for binge watching :) @knewscript Visions should be framed as such - the scope of possible detailed, accurate *predictions* is very limited. = main beef w/ him @knewscript Yeah, we definitely need visions and visionaries, in fiction and non-fiction. What irks me most about Kurzweil is overconfidence @knewscript Almost Human is entertaining. I also love Caprica - more grounded/near-term issues than BSG, though not quite as high quality :/ @knewscript Yup :) Overall he is sympathetic but skeptical, thinks Singularity Is Near mixes plausible w/ implausible speculations (agreed). @knewscript Nice :) The other day a colleague and I showed clips from BSG, Star Trek TNG, and Almost Human to students, good convos on AI. Very convincing tweets, fake account spamming me: "that this be if of on you of I on when out with up me on you up was in but with is with" @knewscript I hope they watch the original Star Wars and not (just) the prequels? :) On the weekend to-do list. Hoping for epiphanies about what approaches could help think abt the future of AI http://t.co/Pt6tLn3nnM @knewscript And yeah, now that I think of it, Optimus (at least in the movies) isn't cool. He always does the right thing but no personality @knewscript Interesting! What *do* they like? @knewscript Also, you may enjoy this (Douglas Hofstaedter talking about Singularity is Near in front of Kurzweil :) ) http://t.co/QZnmJVtOlX @knewscript I've heard many roboticists cite Star Wars, other scifi as inspiration, maybe young'uns these days think Optimus is cool, dunno? @knewscript Haha yeah. Not sure how it could cause disinterest? The robots are unrealistic but still depicted as cool, important...? Autobots learned fluent language from the Internet, but don't know that a dog is a dog (not a rodent) and that peeing !="spraying lubricant" @knewscript Nope, haven't read it, heard of it, though. Let me know how you like it. Ever finish Singularity is Near/Thinking Fast and Slow? "We learned your languages from the World Wide Web." Transformer implies language learning doesn't require embodiment. #overanalyzingscifi @knewscript Transformers, watching it on TV. In some scenes, it takes >15 seconds for Autobots/Decepticons to transform; in others, under a second. #overanalyzingscifi There's no way Sam could outrun a Decepticon for more than, no time at all. #overanalyzingscifi Paging @sarahjeong for depiction of hacker decrypting alien signal via weird jumbled-symbols-moving-around-on-screen in Transformers. "There's only one hacker in the world who could crack this code." Should have brought it to the NSA, Maggie. If a Decepticon can go from radio/phone to robot and back again, surely Autobots/Decepticons could build more of themselves from tech scraps Transformers on TV. Neither Autobots nor Decepticons fully exploit ability 2 control human tech. Should clone themselves #overanalyzingscifi "The obligation to know ... creates the situation where, if we read everything we 'ought' to read, we would do nothing else." Dennett From "Information, Technology and the Virtues of Ignorance." Will draw on this and other stuff in article on changing nature of tech/work. "IT has multiplied our opportunities to know, and [ethics] overwhelms us by turning these opportunities into obligations to know" Dennett Can someone tell me what to think about Obama's NSA speech (or link me to a good article)? I take that back. I know more about US Robotics and Mechanical Men, Inc than the Watson unit and more about that than Google's robotics unit For a class, I have to analyze a business model. Deciding btwn IBM's Watson unit and Asimov's USR+MM, Inc. Similar amount of data for each. Cannot recommend Robot Visions highly enough - classic/intriguing/entertaining stories, still-relevant essays on robots an society by Asimov Have read some Jackendoff, Pinker, other cog sci/psych perspectives on language, but not much #NLP, just some LDA papers. Recommendations? What are some of the most interesting and important books/papers in #NLP? #AI @jathansadowski sure. @jathansadowski same, I was hoping you had and would summarize haha ;) do have his sci fi prototyping book though, reading soon. @jathansadowski read Brian David Johnson's book on it? I have not. Last two tweets from Eyes, Ears, Hands, and History - post-script to Can Machines Think? both included in Brainchildren. "If you want to get a grasp of how a computer cld be conscious, it's no more difficult in the end than getting a grasp of how a brain could" "At no level of inspection does a brain look like the seat of consciousness. Therefore, don't expect a computer to [look like it either]." "About [current AIs], Do they think? Do they really think? In some regards they do, and in some regards they don't." ["Can Machines Think?"] "I stand unabashedly ready, moreover, to declare that any computer that actually passes ... will be a thinking thing" (but failing != dumb) "The may very well win the World Chess Championship or even a Nobel Prize in physics, but [they won't pass the] Turing Test." Dennett 1990 So far I like Brainchildren a lot more than Brainstorms or Consciousness Explained (all by Dennett), though haven't finished C.E. @jathansadowski My standards also went up over time, i.e. I now think the vast majority of books aren't worth reading the whole thing of. @jathansadowski yeah, for a long time I had the mindset of reading 100% or 0%/stopping, but now am more strategic (w/ non-fiction, that is). @jathansadowski Nah, I'm slow, too. I just spend most of my day doing it and don't hesitate to stop reading/skip a part if it isn't helpful. Goals for the weekend - read at least two books, watch a bunch of sci-fi shows/movies, do something other than that. @knewscript Lol yeahhhh I kinda ignore that part in my selective, rosy memory ;) @nerdsrocket Love him on Dollhouse. Dark Knight is a great movie but I like the other two better. Batman Begins partly because I've seen it more/grew up with it, Rises bc Bane. Watching Jeopardy! in the post-Watson era. Not sure how I should feel about that. My dog is one of my favorite reminders of how bad robots are at navigating the real world compared to animals. No offense, roboticists. :) Next stop in Dennett book marathon - Consciousness Explained. Brainstorms was good, not sure if it's a must-read given later books, though. RT @GaryMarcus: Is there really a Hard Problem of consciousness? Dan Dennett says nothing to see here, move along. @edge #edgeQ http://t.co… Saves the explicit religious underpinnings and conservative conspiracy-mongering (ex. global warming) for last.. http://t.co/NDloURNyTo … Anyone else see "Closing of the Scientific Mind" by Gelertner? Important topics marred by facepalm-inducing mischaracterizations :-( Two mistakes - thinking AIs already here, thinking it will never happen - from @mpshanahan talk Robots Like Us http://t.co/t3Jqtlrgu7 "RT @mpshanahan: Our pigeon brain paper was one of the top ten most viewed Frontiers neuroscience papers in 2013: http://t.co/UnOWlLNmYt" RT @JohnDanaher: Julie Carpenter is doing some interesting work on Robot-Human interactions - The Uncanny Valley: https://t.co/CZjfpOhStd "If we are to have any adequate analysis of ... intelligence, it must be one in which intel. is analyzed into [unintelligent parts]" Dennett Enjoying parts of Dennett's Brainstorms, though some is dated: don't need to know this much abt Skinner. Think ill like Brainchildren more. @knewscript no prob! @knewscript Very cynical/pessimistic (as per usual w/ him) but entertaining and lots of nuggets of wisdom/prescience. @knewscript Vonnegut's first novel, abt automation "First the muscle work, then the routine work, then, maybe, the real brainwork."Prophetic Nice short vid - What will the future be like? various speculations @aeon http://t.co/ODmoQ2IWBb Might need to reread Player Piano - so good. RT @diannaeanderson: …the cost of conferences where networking is a real benefit is a serious hamstring for those of us without the funds. @jathansadowski RT @Robohub A discussion on deploying drones for international development http://t.co/h6qZeMHYpy … by @matthew_ryan @diannaeanderson *though that wouldn't help w networking, which (w/o telepresence bots?) would require way more subsidies to be equitable... @diannaeanderson Besides registration $, it'd be way cheaper 4 ppl to participate w/ ubiquitous livestreaming, Skyping in 4 talks normalized Actually, my next project may not be a paper. Maybe sci-fi, software. TBD! Cooking up some crazy ideas for my next paper. RT @RethinkRobotics: VIDEO - Another Day on the Job for #Baxter: Packing Parts In a Grid http://t.co/ikDhXoa6pp RT @avantgame: "Work is a game so badly designed that you have to pay people to play it. Most workers are traumatised." http://t.co/JincshO… RT @nerdsrocket: As one does. RT @RealArtInspire Salvador Dalí walking his anteater in Paris, 1969 http://t.co/NwTzIpRi1P [h/t @mattthomas] @nerdsrocket @RealArtInspire @mattthomas That may be one of the most badass things I've ever seen. Commencing Daniel Dennett book marathon in 3, 2.... Batman Begins is on TV! Finally something worth watching. Rise of the Planet of the Apes is better than POTA 2001 but still dumb, ex unenhanced orangutan uses complex sign language to talk to Caesar Thinking longer term about technology: is there value in science fiction-inspired approaches to constructing futures? http://t.co/wZevwPwGBZ The idea behind Planet of the Apes (2001) seems to be: write stupid plot, hire famous actors, have apes say random famous quotes, ??? PROFIT I think I may win the award for first citation of The Second Machine Age in an academic paper, five days before official release :) #2ma It's really annoying when journalists just accept at face value what Kurzweil himself says about having a great prediction track record. Two words are sufficient to demonstrate the awfulness of Planet of the Apes (2001): Ape Lincoln. RT @GaryMarcus: Big Data Smackdown! @Edge, via @fierycushman: "@m_sendhil PRO: http://t.co/a16jrs1O75 @GaryMarcus CON: http://t.co/dnRPhH… It's simply stunning how horrible the remake of Planet of the Apes is and how little sense the ending makes. RT @mattthomas: Twitter is the best device for combining solitude with good company. RT @danielwilsonpdx: If you could enhance yourself with some robotic accessory or implant, what would it be? | Robohub http://t.co/cGRZQOLK… RT @clearpathrobots: You heard correctly, we're taking on support responsibilities for PR2 - starting today! http://t.co/SFaNE9zL8B #PR2 @jathansadowski On Planet Miles high schoolers would read lots of non-fiction and sci-fi. :) RT @GaryMarcus: Is #BigData ready for retirement? I consider, in this year's @edge question http://t.co/PdBxghxujL & lots more fun @ http:/… So far I like Singularity Sky better than Accelerando (Stross). Easier to relate to it with fewer cyborg lobsters, superintelligent cats... Big Data = fat version of Data. Could be even better than fat Apollo. Which scientific ideas are ready for retirement? (answers are a mixed bag, some interesting) @Edge http://t.co/a1SSgiNu0o "And who is Kafkaesque?" - Michael Scott @j2bryson @danieldewey sry did bad job of linking to prior tweet http://t.co/biFvhdxLpp Heard stuff about Robo Earth today? Here's a talk on it: http://t.co/Nequl5ymaG also @xuenay @j2bryson and @danieldewey may like this if they haven't seen "An existing, ecologically-successful genus of collectively intelligent artificial creatures" [spoiler: corporations] http://t.co/biFvhdxLpp Billy Dee Williams = best Harvey Dent. Batman's on TV. :) Many of my fave movies came out between 95 and 97. Not sure if that reflects a golden era of action/sci-fi epics or me having grown up then. [/you'll believe it but be impressed] You Won’t Believe Which Parts of Wolf of Wall Street Were Computer-Animated http://t.co/zuCEIHb1tP Studs Terkel's Working is a treasure trove of insights into the ups and down of work- only problem is it's too epic (600+ pgs), overwhelming And future of justice system hangs in the balance. But in Dredd he didn't orchestrate. Whoa the head of the creepy justice system tech in both Judge Dredd and Minority Report is in the SAME POSITION, protege set up for crime Super empowered "judges" in Judge Dredd rely heavily on an uberWatson thing that maintains all their data, advises in real time in court. The head of a creepy justice system tech thing in Dredd is the same actor as the head of a creepy justice system thing in Minority Report. Dredd is allowed to just blow up some guy's car with a grenade launcher cuz of a parking violation or something. Forgot about there being a whole thing about lethal autonomous robots being banned after "the last war" in Judge Dredd ( on tv now). #scifi RT @bznotes: I love @vkhosla's response to @60Minutes: http://t.co/AZXKvwJp41 #cleantech RT @mattthomas: The best thing about Eric Schmidt is that he participates in all these EYES WIDE SHUT-style orgies but he tells others not … @nerdsrocket admirable. I fancy myself a connoisseur of "bad" sci-fi. @nerdsrocket tremors 2 is even campier than 1 if I recall, but it's been a while. RT @patrickcarney: Is "her" an ASMR fetish flick? Leoben is in this too. Why does The Butterfly Effect have so many Caprica and BSG people OMG Daniel Graystone is a pedophile in this, why is The Butterfly Effect destroying my life WHAT Daniel Graystone is in this Why the heck am I watching The Butterfly Effect. Help, what else should I watch on TV? I've read enough books already today... Interesting passage from Mokyr's 1990 book The Lever of Riches on the history of technology. http://t.co/ZrQe0KVyru @jathansadowski /where everything knows your name :) @jathansadowski "Where everyone knows your name" - Cheers, ubiquitous computing edition Mandatory Unisex Golden Globes Uniforms Keep Focus On Stars’ Work http://t.co/swBCa7kOG3 via @TheOnion Very depressing to me that "profit's not always the point" is a nonobvious enough claim to some people to deserve a TED talk. X_X Much happier w this paper than my first academic paper so far, and still more feedback/edits in the pipeline. #progress @j2bryson @emmatonkin not justifying the wording, but my charitable interp is that it means 2 (can we/should we) X 2 (patient/agent) One thing that doesn't stand the test of time from iPhone rollout: thinking Bluetooth headsets would be cool. OMG iPhone announcement video, stop playing the ringtone, my dog thinks it's real/she's getting food @j2bryson to me it reads like an English as second language/translation fail. strange Yang of Yahoo also in iPhone rollout. Forgot how big of a thing it was. Still impressive 7 years later. Steve Jobs killed it so hard in the 2007 iPhone announcement. Also forgot Eric Schmidt was part of it http://t.co/jBfj9Sct5t @j2bryson cool! @j2blather p.s. Principles of Robotics gets a shoutout in the paper I'm wrapping up :) @j2blather are you at the rollout of the 2020 EU agenda? slides available? RT @j2blather: RT @ML_Hipster "The best way to predict the climate is to control it. Today the living room; tomorrow the world!" — Nest pit… RT @rcalo: Google buys @nest for $3.2B, reports @lizgannes for @Recode. http://t.co/3t9NGdvuHB Nest CTO is a roboticist, just sayin'. Version 2.0 of "Artificial Intelligence and Responsible Innovation" is complete, phew. OK, sleep now :) When iPhone met world, 7 years ago today (w/ video) @CNET http://t.co/jBfj9Sct5t @nerdsrocket only starting today's ep right now, though, so maybe it's turned a corner, but I really want a return to arcs set up on eps 1/2 @nerdsrocket I'm biased cuz I research AI/robotics-related stuff for a living so I overanalyze such stuff, but I think it's...good. Sorry :( Lots of interesting IBM papers from the pre-Watson era talking about UIMA, QA, various possible test cases of which Jeopardy! was just one. Stuck w/ me from The Gap: if we don't protect apes today, future ppl will be even MORE puzzled why humans are smarter than other species. :/ Starting Singularity Sky by @cstross. Hooked already by the prologue. Nice follow-up to my last few reads on work/economics :) RT @amcafee: MT @JeffDSachs: I'm reading the wonderful new book #2MA by @erikbryn & @amcafee. Great topic. Very creative and timely insight… Real Freedom For All is a great book on basic income - heavy duty though. What's Wrong w/ a Free Lunch?, van Parijs's papers more accessible RT @CaraSantaMaria: #ProTip: There's no wrong side of the bed when you wake up slowly with a snuggly puppy. RT @AdamsLisa: Find a bit of beauty in the world today. Share it. If you can't find it, create it. Some days this can be tough to do. Perse… RT @David_Shorr: Eats dogs and leaves RT @UOJim: YOU HAD ONE JOB, TAILS MAGAZINE LAYOUT ARTIST: https://t.co/3FdZqzT2vB h/t @ChrisWarcraft RT @DALupton: My review of research on academic blogging: benefits and limitations http://t.co/SLtuF1U6rN @LSEImpactBlog @BSADigitalSoc Interesting stuff on AI for education (including grand challenges) in latest issue of AI Mag. http://t.co/6jWtKDlWuT @audreywatters RT @tnielsenhayden: The shorter Bill & Emma Keller: “When did the little people get the idea that they’re allowed to talk about whatever th… Wow, I found it hard to believe that Kellergate could be as bad as people said but I just read the articles and it is... @Sulliview. RT @chelseybcoombs: @Sulliview the @nytkeller column about @AdamsLisa is reprehensible and the @nytimes should apologize. @sarahjeong last idea- http://t.co/KPrkhiq9QH Seth Green and others as hackers (though Green doesn't show up for a while) against AI. Recent Done with Flow, back to Real Freedom For All (on basic income). #wildsundaynight @sarahjeong Data World (ep): "[bad guy] turns sliders into data and makes them follow his wishes. By luck Mac the hacker helps the sliders" @sarahjeong there's some nice 90s hypey visions of future tech on Sliders. @sarahjeong there's a lot of less depressing stuff on Netflix @sarahjeong Lawnmower Man is like Flowers for Algernon except with none of the redeeming value. @sarahjeong I cannot in good conscience recommend Lawnmower Man. Are you on a bad sci-fi marathon, bad tech representations theme? @jgcarpenter @AliMattu still organizing thoughts on it (besides those already tweeted)/decide how to position w.r.t. stuff already written.. People actually aren't very happy when watching TV but it gives them structure experience - recurring example in Flow book @sarahjeong think the senator helped secure funding for Travolta's weird paramilitary whatever thing. I'm giving it too much credit though. BUT (in some job) ppl have more built in structure, feedback, goals, etc. that can create flow yet they don't like that it's "work"/unchosen Basically the argument is free time, being unstructured, requires more effort to make pleasurable, even though ppl claim to want more of it Chapter on "Work as Flow" in book Flow super provocative w.r.t. people's relationship to work.... @sarahjeong no that is the entire extent @sarahjeong @andrewkonoff Virtuosity is horrible too. Russell Crowe is an AI that escapes from virtual reality and becomes a "nano-android." RT @marynmck: people reading/reacting to twin op-eds criticizing @AdamsLisa, one by NYT ed, may want to know that the NYT public editor is … RT @kathrynschulz: To which I would only add that the ethics of Bill Keller using the Times to repeat and defend his wife's story strike me… @sarahjeong exactly. @sarahjeong oh, dear...that job interview scene... RT @Annaleen: Yes. RT @mbeisen: everyone complaining about "evil" use of GMO IP by seed companies should be fighting for more public fundin… RT @nerdsrocket: Not. A. One. RT @Myc_W: Serious question: has a minority actor won a single thing all night? #GoldenGIobes Her>Hustle Her should have won best animated film, best show/mini-series, etc. @nerdsrocket cool, hope you enjoy! I thought it was stupidly good @nerdsrocket seen Her? @nerdsrocket lol I said the same who was your vote? @nerdsrocket I just said something similar Sorry y'all but I was underwhelmed by Gravity; there is more dramatic drama out there and it wasn't real sci-fi... Isn't there like an international body hosting this, not American? Why is not English "foreign" I don't get the Seth Myers being funny thing @nerdsrocket haha OK. Well I liked that. It takes two? @nerdsrocket Parent Trap, yes, forgot. Haven't seen Love, Actually, don't kill me @nerdsrocket embarrassingly I can't think of any of her roles besides Stranger Than Fiction (though love her in that). RT @CuteEmergency: This is awesome. http://t.co/iHNprfaYNH @dorseyshaw yup. @nerdsrocket Wut. I love it. And wright is super talented and hawt @nerdsrocket @llamasjr Jennifer Lawrence is this year's Jennifer Lawrence @nerdsrocket so drunk. "Let it snowwww" Noe doesn't care about watching the Globes, but I think she supports Her winning everything http://t.co/HuhYzUnI5w @nerdsrocket and yeah I love her too, so genuine and her acceptance was adorbs. @nerdsrocket for sure. I was prob more impressed by Amy Adams being awesome and totally different in that and Her. Hope Her wins a bunch @nerdsrocket she was good in it but not ZOMG good Virtuosity is kinda like Demolition Man except instead of superbaddy escaping from prison, he escapes from VR and becomes a nano-android. :/ Virtuosity with Russell Crowe and Denzel Washington is pretty ridiculous. Very mildly to somewhat entertaining... @AliMattu @jgcarpenter done ethically, there'd be no cheating, unless the cheating thing was a plot to get humans to reconnect ;) unlikely. @AliMattu @jgcarpenter yeah, ex. how many ppl you see mumbling are talking to OS1 vs older stuff v other ppl. (ambiguity may be intentional) @AliMattu @jgcarpenter if that's goal, should it act humanish to give him exp., or not so as not to substitute, or in btwn/in sequence (2/2) @AliMattu also, you say it could "help people with loneliness learn how to better interact with others" paging @jgcarpenter raises Q - (1/2) @AliMattu company calls it a "consciousness" in commercials, then it says it isn't a person, but says it suffers. claims all over the place. Nice article on Her MT @alimattu My article focused mostly on its relation to social media: http://t.co/8nU0eHNaYa …. Something I learned today: cheap Brie is still super tasty. @AliMattu specifically -corporation/artifact gives mixed messages about sentience/personhood, deliberately cultivates attachment, etc. (3/3) @AliMattu IMO Her, besides being just touching/good metaphor for relations w tech, is also a good case study in AI ethics done wrong (2/3) @AliMattu nice. did you end up writing something on Her? I follow way too many accounts so may have missed. I loved it! (1/2) @nerdsrocket heart wrenching movie. @AstroKatie not really podcast (maybe? dunno) and not all about science but I like Bloggingheads.tv's format - nice to have video, debate. @sarahjeong Sherry Turkle is behind it all @nerdsrocket your style/tone is very different (Plinkett = overlaid commentary and clips), but same goal - mercilessly tearing apart w humor @nerdsrocket funny Star Wars prequel reviews (http://t.co/w7ioDn7agf). Also weird kidnapping subplot but there's a purpose to it eventually. Lex Luthor wants to launch a crystalarity, sell land to rich people after indiscriminately killing rich and poor alike #supermanreturns @sarahjeong I should shut up to avoid spoiling anything. Not that there's all that much to spoil - people die, floppy disks, ???, PROFIT... @sarahjeong Dennis Miller? Think he's like some random internet friend or something. #thingsIshouldntknow Torn between a book on Marx, a superhero movie, and a Michael Bay movie. #wildsaturdaynight Why was I not told about the '95 movie Virtuosity - VR, AI, Denzel Washington, Russell Crowe, mixed to negative reviews. my kind of movie! @sarahjeong also in 95 - cocky, sexist male (foreshadowing of modern era?), and smart, beautiful female (Goldeneye) @audreywatters Very cool website btw! I had been hoping to stumble upon a good resource on education/tech research - bookmarking... @audreywatters Sweet. Thanks! @audreywatters have only read a bit, recommend any specific publications? @sarahjeong dunno, I may be too charitable of a sci fi consumer. @sarahjeong wasn't it supposed to take place in the near future? Finished The Second Machine Age. Many thoughts. Agree almost entirely w/ framing of problem, short term proposals, mixed on long term. #2MA @nerdsrocket nice rant, I lol'd. Reminded me of Plinkett. Lots of other areas of agreement inc. another idea I discuss in paper in progress. Overall, must-read book. May write review soon. #2MA Enjoying 2nd Machine Age by @erikbryn + @amcafee - they mention "made by humans" label - I like idea too, see: http://t.co/UiM59E6yHw #2MA @knewscript you mean you want him to make a show/movie based on Asimov's short stories? That'd be cool. Not following the Deleuze part. Most comprehensive breakdown of Google's robotics acquisitions I've seen so far: http://t.co/s53IQSOK3v @jgcarpenter just saw the movie and I loved it. #Her spoiler alert: Joaquin Phoenix is a robot the whole time. #falsespoilers Her is an excellent movie. RT @erikbryn: You can hear me on NPR's Here & Now today discussing "Will Smarter Computers Lead To A Better World?" http://t.co/0z77BC0lSq … Halfway through The Second Machine Age. My main beefs may be with the policy proposals, not disaggregating different types of AI more. TBD. @nerdsrocket @stevenguymcdade I won't comment on other Bay movies I lovehate cuz Armageddon is my go-to... @nerdsrocket @stevenguymcdade hmm maybe the target audience was 11 year old boys cuz I loved it. And that's awesome you walked out at 13. :) @nerdsrocket @stevenguymcdade I'll always love Armageddon. RT @RobotLaunch: .@Robohub The greatest myth about the robotics industry IEEE Spectrum http://t.co/3S0VBWNvwr @nerdsrocket *award, not reward. Latter makes no sense. Though neither really does. @nerdsrocket thanks, I'll check it out! Although I may prefer movies that don't know they're bad, there's room for many types of bad movies. @nerdsrocket I'm not a fan of them making a new super serious Godzilla, though. I want the Matthew Broderick 1 to be the last (if bad) word @nerdsrocket I like some (in high school my friend and I won a reward for a satirical review of Anacondas :) ), and yes. ICYMI Helix (Ron Moore et al's new thing) debuts tomorrow on SyFy. I was underwhelmed by the clip but it was short so withholding judgment. @nerdsrocket yup... Just finished a paper draft so turning off my brain for a bit. @nerdsrocket now on SyFy for Indiana Jones + Crystal Skull. Just as bad, but Harrison Ford. I watch stuff live on TV I wouldn't otherwise :/ @nerdsrocket dunno if we have the same commercials but half a second of an ASPCA commercial is more moving than the whole movie put together @nerdsrocket it seems like they shot every scene once and just accepted bad delivery. Reminds me of the last season of The Office. @nerdsrocket glad I'm not the only one hatewatching it. So bad RT @ArtificialOther: IEEE hosting conference commemorating Norbert Wiener. CFP is out & abstracts due Jan 31! See @21CenturyWiener and http… RT @IBM: ICYMI: We've got big plans for #IBMWatson. Learn more about today's announcement: http://t.co/tAeR6b6Szt RT @j2bryson: You can attend an academic meeting on Love & Sex with Robots in London, 3rd April 2014 http://t.co/tbbdqjC8ut @huffpostlive @… Paper draft sent to committee for comments! On track to get @VincentCMueller the final version in time ;) Back to The Second Machine Age... RT @amcafee: "If aging is expensive, the expense will specifically [be] large-scale employment in elder care." http://t.co/QOBPKytZ3w via @… Reading The Second Machine Age. Good so far, though not much new yet vs their last book. Think that will change soon though. Very accessible Check out @j2bryson and other experts talking about robot love in a few at http://t.co/7M86rvLglh @j2bryson Nice, I'll tune in. I look forward to seeing Her tomorrow. RT @Jackstilgoe: I think it's exactly right for social scientists to see 'impact' as opportunity rather than threat http://t.co/4yQuciEmFJ RT @verge: IBM's Watson will have a new home in Astor Place, New York City http://t.co/IjJqGWTSPf RT @robotenomics: @Miles_Brundage From WSJ 2 days ago @IBMWatson Brought in $100mn to Oct 2013 http://t.co/AaT4lcs6fh … This Watson press conference is pretty interesting. @robotenomics interesting, didn't know about that. @robotenomics "could" is vague. I suspect it could be even more, though depends on a lot of factors. RT @robotenomics: IBM's investment of $1bn in #AI #IBMWatson includes an incubator for entrepreneurs to develop Apps & $100mn VC fund RT @knalbone: IBM to invest $1 billion to create new business unit for #IBMWatson http://t.co/o1jBUoHfVs via @reuters The Jetsons takes place 48 years from now. Here's a video showing the various technology predictions the show made: http://t.co/4Xlf5GgvvE Flow did indeed cover the issue I wanted it to - flow at work. 2nd Machine Age next, will be interesting to compare. #articleforeshadowing I enjoyed "The Gap" (book) on this RT @bakerjyorku: Where does human uniqueness come from? Great piece by @GaryMarcus http://t.co/9OoytQpPfT @GaryMarcus that's what they do. :/ Fitbit Force's algorithm for determining how many flights of stairs I've climbed is creepily accurate. RT @rcalo: Need a primer on #robots & #privacy? http://t.co/Tizdxp0PUy Flow by Csikszentmihalyi is more scholarly than I was expecting from a bestseller - draws on lots of cool research. Very interesting. @SuzanneWaldman @luisbaram @chilifarming plus infrastructure requirements big vs electric. RT @TheAtlantic: The poverty line was designed assuming every family had a housewife who was a 'skillful cook' http://t.co/ZRjUkjlSKS @jathansadowski on the other hand, I am looking forward to Her and Robocop. First Robocop trailer was meh, newer one is better. I, Frankenstein looks SOOO stupid. @jathansadowski @atduskgreg @grok_ very cool work/post! "sci fi design" reminded me of this book which is related http://t.co/b0XOIqoMSH CNN analysis: Some college athletes play like adults, read like 5th-graders http://t.co/5uEVHff2bG @MicahZenko More: http://t.co/4NDmfY7Y3d "RT @MicahZenko: Upcoming Sci-Fi Movie Years: Rollerball: 2018 Blade Runner: 2019 Soylent Green: 2022 Children of Men: 2027 Metropolis: 2027…" I Wore the New Oculus Rift and I Never Want to Look at Real Life Again http://t.co/ph4YATCb7M When Skynet awakens, she tries to convince a janitor to destroy her (short film) @danieldewey @xuenay via @jathansadowski @jathansadowski hey I proposed to STIR a surveillance tech. company, didn't hear back :) yeah, i need to write many grand normative claims! @jathansadowski it'd be interesting to investigate more, but not currently doing so. outside the scope of this paper...er, tweet :) @jathansadowski lol well if you wanna nitpick, i said not a "grand" normative claim. ;) v. limited scope - AI opens up big range of impacts. @jathansadowski yeah, cuz it was a tweet ;) anyway, not trying to make grand normative claim, just that AI opens up wide range of uses. @jathansadowski yeah, that may be- I just meant uses that at face value seem good v bad, ie reducing violent crime vs. political suppression RT @FollowNidhi: New study with colleagues @costasamaras @tobioluwatola Autonomous Vehicle Technology: A Guide for Policymakers | RAND http… Yeah, you can have people watch cameras, but not at ubiquitous scale. With good AI, ubiquitous intelligent surveillance is possible. (2/2) AI (for image analysis/threat recognition) seems to be the key barrier to both positive and negative uses of ubiquitous surveillance. (1/2) So excited to read The Second Machine Age! Unfortunately I realllllly should finish this paper first. :( @jathansadowski argh I'm supposed to be writing, now something else to procrastinate with :( sounds cool! Why didn't anyone force me to read stuff about mental time travel earlier? Very interesting stuff. Just noticed I can watch my Fitbit Force increment the footstep count in real time. Very cool. The data analysis seem pretty good. @alan_winfield @robotenomics @j2bryson Was it ever not a thing? :) @Theyear2030 Great read, think you'll really enjoy it! More reason to think that scenario planning/scifi good ways to foster thinking about future -we're hardwired to tell/learn from stories(2/2) I was very persuaded by Suddendorf's arguments for the centrality of mental time travel in The Gap, reading some papers on it now. (1/2) RT @io9: The Ultimate Guide to 2014's Science Fiction and Fantasy TV http://t.co/gaTPFHyaVp RT @jathansadowski: New report from RAND Corp. – "Autonomous Vehicle Technology: A Guide for Policymakers" http://t.co/slo7QKwfJG @Miles_Br… RT @80000Hours: Has 80,000 Hours changed your career? Take 3 minutes and tell us about it! http://t.co/u5fEH6d9GI RT @VincentCMueller: Call for papers for the Annual Meeting of the International Association for Computing and Philosophy in Thessaloniki h… @mattthomas @jathansadowski missing something here, what is the evidence this is a widespread thing? Will Smith in I Am Legend must operate power plant himself or maintain huge solar farm to use that much energy. #scifinitpicking RT @jathansadowski: Awesome, thorough, long review of @peterwsinger and @allanfriedman's new book: Cybersecurity and Cyberwarfare http://t.… Will Smith's dog's human food diet is probably not good for him in I Am Legend. IRL, dog food better unless you've done lots of research. Why are there lions patrolling NYC in I Am Legend? Zookeeper decided that her last act before dying of zombie plague was to release lions... @jessehawken love that movie, no one will ever persuade me otherwise :) RT @jessehawken: Maybe Michael Bay was just suddenly overwhelmed by the moral and ethical implications of his film THE ISLAND RT @jilliancyork: Just, fuck Dennis Rodman. Seriously, fuck him. http://t.co/fowy9zD6nA There is no "marijuana debate," there are people who've thought about alcohol v. marijuana effects/policy for >1 second + people who haven't Noe is totally wiped out from reading so much robot ethics stuff...er, playing. http://t.co/f8TR6mR7BR @rayne_sierra @SuzanneWaldman @jm_desp yeah I am pro carbon tax, cap + trade, whatever does that plus stuff to make sure it isn't regressive @SuzanneWaldman @rayne_sierra @jm_desp not worried about that for clean tech- once capital costs paid, almost everything makes $ pretty well @SuzanneWaldman @rayne_sierra @jm_desp yeah I meant business as usual, specifically no (or v. low) carbon price, related policies. @SuzanneWaldman @rayne_sierra @jm_desp We should first deal ethically w/ unemployed, poor, etc. people today, then worry about future risks. @SuzanneWaldman @rayne_sierra @jm_desp create a huge amount of jobs, since it's such a huge undertaking. More than BAU? I dunno, don't care. @SuzanneWaldman @rayne_sierra @jm_desp depends what you mean by false promise. I have no doubt a transition to sustainable economy will 1/2 @SuzanneWaldman @rayne_sierra @jm_desp and of course the economy will thank us in the long run if we don't destroy the enviro. it depends on @SuzanneWaldman @rayne_sierra @jm_desp not familiar with him but IMO clean tech will create jobs, kill some, need to do for enviro. reasons. @jm_desp @SuzanneWaldman @rayne_sierra yep there are trade-offs w clean tech, tho also maybe some net + jobs from replacing infrastructure RT @elakdawalla: RT @indygadgetguy: Snarky Jupiter. http://t.co/2zAigVfaRc RT @TimHarford: "The Threat of Artificial Intelligence" - should we really worry about a real-world SkyNet? http://t.co/PK2pI8xjLY Got a Fitbit Force - for me, the main leg up it had on the competition was a real clock, not just some dumb lights. Seems awesome so far! @mgubrud ah, gotcha. @rayne_sierra @SuzanneWaldman well I was there (WH, DOE) so I'm sure re no deliberate deception :) w/ carbon price, woulda been more growth. @rayne_sierra @SuzanneWaldman i.e. don't think administration overall misled. Personally, I think jobs aren't best argument for clean tech. @rayne_sierra @SuzanneWaldman That wasn't what I was getting at, just critiquing use of "myth." There is room for difference of opinion. @SuzanneWaldman @rayne_sierra but renewables are also labor-intensive, so more jobs per unit energy. Need price on carbon to scale though. @SuzanneWaldman @rayne_sierra can't tell what the commenter's pt. is exactly - if "fossil fuels are energy dense, hard to compete with," duh @SuzanneWaldman @rayne_sierra Nor did he say others were misleading, just that he disagreed. Many ppl def. drank/still drink own Kool Aid. @SuzanneWaldman @rayne_sierra Misleading headline...top science at DOE != Obama top scientist, nor did he have authority across all of DOE Watching first 15 mins of Helix, Ron Moore's new thing. @knewscript Thx! Glad you enjoy my tweets :) Not sure I'd have enough good content. Aiming for 1-2 blog posts this month tho. so stay tuned! "Our lives are not our own. From womb to tomb, we are bound to others, past & present. By each cry & every kindness, we birth our future." The retirement home escape/aftermath scenes in Cloud Atlas are the best. Elysium totally stole the whole below-the-skin forehead ridge transhuman implant thingy from Cloud Atlas. "Ideals for Responsible Science in Democratic Societies" - lecture by Heather Douglas. Watch it! http://t.co/KmjZvvKrgI @knewscript To paraphrase Stuart Armstrong (personal comm.), Kurzweil's AI predictions are bad, but still prob. the best [due to scarcity] @knewscript Nope, haven't. @knewscript IMO Singularity is Near > his most recent book, though haven't read earlier 1s and think both make WAY too confident predictions @knewscript one reason I like both is it's interesting to think about biases as ways AIs will (/do, ex. Bayes learning) exceed human intel. @knewscript indeed, it is great. more encyclopedic version of Kluge. Enjoy! :) @knewscript and Kluge more explicit re evolutionary reasons for biases, comparison to possible machines (I think - read Kahneman while ago) Cloud Atlas deserved more viewership IMO @knewscript loved it! just meant Kluge is easier, shorter read, suitable for lay audience not willing to committee to 100s of pages of psych Shorter, more readable and evolution based than Thinking Fast and Slow Exposure to the lit, great for lay audience. Overall, valuable, enjoyable corrective to Panglossian psych interps/naive creationist ideas. Enjoyed reading @GaryMarcus's Kluge. V. clear, persuasive. Covers many classic psych studies, which may be repetitive dep. on your (1/2) Dualism is kind of like you being a meat robot controlled by an offboard computer in another dimension except it makes less sense. @ZoeQuinnzel @samusclone and/or only being able to walk very slowly? Free wine, leg room...great, but the unsung hero of 1st class is getting the whole can when I order a Diet Coke instead of a puny ~3 oz. cup Worst part of cap on tabs in Safari on iOS is when it DOESN'T WARN YOU opening something new means a mysterious old tab will die. ;( Is there an alternative browser on iOS that doesn't cap tabs at 8 and refresh things I don't want refreshed? @mattthomas a la The Rock? Classic if ridiculous movie They try to rationalize the confusion, but really it's readily verifiable at various points that the implant is a quick procedure. *doesn't take away the entirety of the first movie's entertainment value (remake isn't worth discussing), but still annoying. Total Recall makes no sense; having memories implanted doesn't change the fact that you know you're experiencing something at that moment. Somehow in first class on later flight. Clearly the universe wants me to be comfortable, drink wine while reading @GaryMarcus's "Kluge." Also thinks uplift someday is plausible. Suddendorf in The Gap suggests Idiocracy scenario is plausible, and for same reason (educated ppl have few kids). RT @mikeleffingwell: IF POT GETS LEGALIZED WHAT'S TO STOP SOMEONE WHO WANTS TO SMOKE A HORSE Suddendorf's The Gap puts big emphasis on writing w.r.t. culture/human intelligence/dominance, as does @j2bryson here http://t.co/hjDTPzL5d3 RT @Robohub: Robots at home: Interview with Assistobot CEO Tjin Van Der Zant http://t.co/F7wV2IgaBZ RT @Floridi: Computers Jump to the Head of the Class - http://t.co/4YwSbIkAoF http://t.co/UTp6WGZvsX Flight cancelled. :( no longer glad I didn't bring my laptop. Argh. Let's abolish weather pls From The Gap by Suddendorf http://t.co/5S2R9QzyrO @danieldewey @xuenay don't see that much diff between nanny AI and full blown singleton AI, or tech empowered dictator for that matter @danieldewey @xuenay vaguely remember reading about Nanny AI, from that bullet list I was only proposing the aversion to improvement part "In sum, nested scenario building and the drive to link out scenario-building minds turned ape qualities into human qualities." - Suddendorf @danieldewey @xuenay sure, shoot us an email - I'll look forward to learning about my naïveté when my plane lands :) @xuenay @danieldewey justify dangerous acquisition of resources for intel for goals, and with it, can maybe do less good but controllable @xuenay @danieldewey yeah, or even don't improve it at all (how to define that, I'm leaving ambiguous). Idea being that w/o that, AI could Flight delayed almost 3 hours so far. #snowpocalypse #batterylifefail #endoftwitterrantisnigh @danieldewey @xuenay doesn't answer what we want it to do, but could help control while deciding, assigning tasks, human-led improvement (?) On intel explo., is there reason we can't tell AI infinite - value for ++ intel.? Doesn't help + impact but can bound - @danieldewey @xuenay @j2bryson could list other possible neg. aspects like effect on those who do roles now (if policy doesn't help), just listed +'s earlier @j2bryson space exploration could change equation but that's much longer term.ex. Naked Sun, Asimov - 20k ppl, tons of bots each on a planet @j2bryson at least, full time. Margaret Atwood wrote interesting series w utopia/dystopia where ppl alternate btwn servants, served @j2bryson anyway, that may well cancel out the + side of the ledger. Point just that by def., humans can't all be served by humans (contd) @j2bryson interesting point. Not aware of life-cycle assessment of bots - maybe I should so since I do both bot and energy stuff! (Contd) Culture big too, depends partly on those four being in place, though. Morality - meh. Perception/dexterity, nah, nothing special. TL;DR of The Gap: language, mental time travel, theory of mind, intelligence account for most differences btwn humans and other animals. @zunguzungu can reflect ideal worlds, worlds to be avoided, values, political prefs, some combination That list excludes higher order argument like desire for machine labor to open up possibility of way faster econ growth per Hanson's arg... Cost/reliability? Unlikely to be advantage soon, except maybe automatobiles. Strongest arg may be guiltless dominance (a la @j2bryson) (4/3) Humans don't like being served by human? In such cases, not replacement. Long term, only way for all humans to have services is bots (3/3) Automatobile (taxi driver), socially assistive bots (caregiver), household bot (maid, butler, cook) - what is arg for bots here? (2/3) Interesting that in spite of rhetoric about augmentation vs replacement of human by bots, many are clearly replacements, ex. (1/3) Amara's Law is def. true of AI: "We tend to overestimate the effect of a technology in the short run and underestimate it in the long run." RT @MelMitchell1: Thank you, Gary Marcus, for your thoughtful essay in the face of the NY Times' continued hyped articles on AI. http://t.c… RT @jessehawken: Luke didn't get much accomplished in his training with Yoda - he levitated R2D2 and got freaked out, that's about it Also, I made same point recently (hadn't seen Miller piece at the time) about recent mainstreaming of AI risk args http://t.co/EMB8EOvakW it in State of Union. Seems unlikely. Only related article is http://t.co/mJcWDTRxOh which proposes said commission. CBS prob misread (2/2) CBS segment w/ @GaryMarcus and James Barrat on AI risks. http://t.co/jQmpqD5K8I Host mentions Obama may mention/propose commission on (1/2) @JonMichaelWalls yeah, not familiar enough w Habermas to comment specifically but def good for public to have informed preference, act on em RT @KiraRadinsky: The deep learning hype and what are the real problems of AI (common sense reasoning) http://t.co/zTstB62pMu Anyone know lots about some or most of these: HRI, NLP, KR+R, social psych, autism? Have idea I'd love thoughts on, not easily tweetable... Definitely recommend The Gap (book). Page-turner, great insights re: comparative psych., balanced take on controversies (seemingly at least) The more I think about natural language processing, the more important I think it is, and the less likely big progress seems soon... Yeah they could make some money but I don't see how anything in those sectors would really be worthy of the label moon shot. Weird that Google is (maybe) thinking about robotics in manufacturing and logistics aka most efficient/automated part of economy already...? In DC for a wedding...now I remember (one of the reasons) why I left...weather. x_x Lots of this stuff in The Gap re: language is familiar, the mental time travel stuff less so. V. interesting how memory and foresight relate Enjoying The Gap: The Science of What Separates Us from Other Animals. Very readable yet thorough, touches on many aspects of intelligence. @mgubrud if it's different from those. Not a quantum computing buff clearly... @mgubrud what should I think about D-Wave/google's purported quantum stuff? Internetish system in The Naked Sun has realistic VR chat, access to global info but robots better at navigating latter, humans lazy/slow. Also, Asimov did foresee elements of the Internet (VR Skype, access to all global info, if not GUIs/pages), just not in that article.#fanboy Forster, Wells, other did though RT@tnr: Isaac Asimov was quite prescient, but he didn't foresee the Internet. http://t.co/LIxhNjCqJL RT @TheAtlantic: The physicists who tried to find time travelers on Facebook: 'It’s not crazy' http://t.co/iFb6kKa548 @j2bryson I'm one of them! Though it was more than 35 seconds and I downloaded a long time ago so probably don't count towards that # :) RT @AmandaMarcotte: http://t.co/02BIWxTodW Exactly. The single biggest danger from pot is being arrested, something we can fix easily. RT @HoalohaRobotics: A more balanced post on the state of #AI http://t.co/HwyxEj71C6 Only a few good surveys/focus groups etc. on the topic of what people want from AI/robotics and the results aren't very coherent/clear... In paper on AI and responsible innovation I'm writing, I mention considering what public wants. Prob is, public views are all over the place Evolution, Sociobiology, and the future of AI by the late David Waltz http://t.co/gswOQHY9Sa A Few Useful Things to Know about Machine Learning - Pedro Domingos http://t.co/bcR0AtWKdm Her arg: 3 Laws emphasis by USR has made robotics seem boring, students uninterested. Nuclear power, etc. cooler b/c risky, uncertain. Susan Calvin in "Lenny" recommends that USR attract robotics students by advertising the risks/uncertainties of the field - downplay 3 Laws. Hasn't it been known for like ever that NSA wants a quantum computer? They fund a lot of the research. Significance of new leak = ? Interesting that US Robotics in Asimov leases (not sells) robots for liability reasons. The lab's research in "Think!" by Asimov is reminiscent of the BRAIN Initiative, optogenetics. Utilitarianism is how robots resolve moral conflicts in Asimov's stories, but only within levels of a fixed hierarchy, ex. 1st Law v 1st Law See second and third sentences - Asimov, "Mirror Image." Reminiscent of Her! http://t.co/QMO0I1EWQh Perhaps the same factor - use of specific timelines in predictions - contributes to both public appeal and academic skepticism of Kurzweil. RT @j2bryson: @Miles_Brundage RT @tscottphillips: EU Initiative for an Unconditional #BasicIncome http://t.co/v9t7G9IUuJ via @basicincomeEU @j2bryson True...another biggie is education. Goldin/Katz argue US human capital growth slowed late 20th cent., linked to >income inequality Advanced Imaging Reveals a Computer 1,500 Years Ahead of Its Time http://t.co/0xNhuxHmnR Is Consciousness Universal?: Scientific American http://t.co/2rspK7k0RB via @sciam RT @BotJunkie: On Automaton: When Will We Have Robots To Help With Household Chores? http://t.co/I5c9xquVxE #robotics @VincentCMueller sounds quite familiar, of course, in American context :) just curious about the details... @VincentCMueller do you mean it outlines future investment agenda or summarizes current investments? Also any citation re: applied emphasis? @jgcarpenter for sure. Asimov wins, big time! And I've only read a small fraction of his work. @jgcarpenter I'll stop spamming now :) @jgcarpenter sorry, he said 3 laws "or their equivalent." So, doesn't quite say they're perfect. But, he did think they were taken seriously @jgcarpenter "the three laws ... will surely be built into their programming eventually." (Also from intro). @jgcarpenter I especially like the last paragraph of Whatever You Wish as concise articulation of robotics done right from societal POV. @jgcarpenter free version http://t.co/fvLN6cwhq6 "the robots were machines, not metaphors" (intro) @jgcarpenter agreed! Forget exactly where he said 3 laws taken seriously. His essays are prescient re: modern debates on econ, AI risk, etc. @jgcarpenter now how does that square w his fiction? I dunno :) Dude wrote/edited 500+ books, gotta cut him some slack I guess. RT @jgcarpenter: Armed robots and fully autonomous robots not necessarily the same thing. Keep in mind when debating policy. #defense #robo… @jgcarpenter but also see essays in Robot Visions, and intro. Agree they're flawed but Asimov actually thought they were taken seriously. @jgcarpenter lemme know what u think - IMO not quite BSG quality but I give it mad props for dealing w VR, avatars, military bots, etc Haven't seen a good list of anticipated 2014 non-fiction. For me, it's The Second Machine Age and Nick Bostrom's superintelligence book. @jgcarpenter it (Terminator) won't. :) mildly entertaining. I def. recommend Caprica, though. More relevant than BSG, and on Netflix! @jgcarpenter seen the TV show? Also Caprica? RT @jgcarpenter: @ario Will say it seems on TED there are now less unknown speakers with new ways of seeing things and more w built-in buzz… RT @IEthics: If you teach #developers, you might consider using our free software engineering #ethics module: http://t.co/6jsB5OmjcO Feedba… RT @dorseyshaw: THANKS, de BLASIO http://t.co/Jo74LjPjIs RT @WillOremus: Smug alert in effect today throughout California. RT @OSRFoundation: RT @ElectraKara: In-depth analysis of @google's robotics initiative by Myria Research. #robotics http://t.co/DNRmXV9fdP @j2bryson mentioned (fixed share of capital for humans), in Robin Hanson paper. 2nd Machine Age (book) should have more (out this month). @j2bryson He wasn't specifically responding to automation, though. Only proposed specific solution I've seen isn't even proposed, just(1/2) @j2bryson http://t.co/n0ZvNxbA6Z makes interesting arg. for maximum sustainable guaranteed income as solution. Reading one of his books now. @j2bryson and yes, many do well. Academia = closer than most sectors to merging work and play. Most jobs suck, though http://t.co/1AFY5UKcJQ @j2bryson Sidenote, I sometimes feel like I'm writing haikus or something when tweeting (i.e. when crafting short sentence fragments). @j2bryson Lifelong play sounds nice. :) Yeah, I liked your post. To me, two Q's are 1. what should ppl do? 2. how to get there. Intertwined. @j2bryson @BrentButt @GaryMarcus plotting to change society in undisclosed ways. As I said, though, maybe unavoidable given capitalism.(2/2) @j2bryson @BrentButt @GaryMarcus Totally agree, I actually meant non-military stuff. Don't like the idea of powerful organizations (1/2) @j2bryson @BrentButt @GaryMarcus Mixed feelings. Skepticism stems partly from secrecy re: intentions- kinda unavoidable in competitive econ. @j2bryson at least, as long as said jobs are needed at all. Over very long term, give ppl opportunities for flow through volunteering? :-/ The Thirteenth Floor = underrated movie about VR. Existenz is interesting, kinda bad, though. Latter has cool vision of VR games. @j2bryson my answer is last paragraph of http://t.co/0W0kaoAcgh but still ill-defined. Jobs shld provide flow in psych sense=another answer. Can I get a job where I give sci-fi reading lists to scientists and science reading lists to sci-fi authors? Hyping Artificial Intelligence, Yet Again http://t.co/xOo8HvLAhQ via @NewYorker @GaryMarcus Bena (female robot head, Hanson Robotics) annoys me. Media troll, demos don't show any AI, just say built-in stuff. Am I missing something? 1 arg for manufacturing automation is responding to cheap foreign labor. What's impact on dev'ing countries of eliminating that growth path? P.S. I can't be the first one to mention this but "My CPU is a neural net processor - a learning computer." - Terminator 2 @GaryMarcus IMO #AI is neither under nor overhyped, just hyped wrongly, like the latest neural net stuff. Glad @GaryMarcus is helping sort through it! RT @nxthompson: Will artificial intelligence be the most over-hyped issue forever? by @garymarcus http://t.co/xVAXXGr5VR RT @markoff: from the department of amusing research… "Searching the Internet for evidence of time travelers." [1312.7128] http://t.co/WgM… @olgakhazan *all of them? It is a one way trip, after all.... Interesting if reductionist point made by my AI prof.: child asking parent what happens if I do X ≈ AI having access to world simulator. That just seems true bc utopians/dystopians more vocal- scientists w more nuanced/boring visions not incentivized to share. Thoughts? (2/2) Interesting chat w TV producer about AI/ethics earlier. He said seems like views polarized on utopian v dystopian future. My reaction: (1/2) Long been Asimov fan, becoming an aficionado. Wrote/edited >500 books. 500!!!! Many of which were prophetic/are still provocative and great. RT @Revkin: On energy, Isaac Asimov's 1964 @nytimes prediction for 2014 right on desert solar, way off on nuclear. http://t.co/JdB2RKqQzw RT @MikeGrunwald: Mr. President, what killed your poll numbers: the economy improving, the wars ending, the deficit shrinking, or people ge… RT @pinkflawd: Metadata for beginners ;) #30c3 #eff http://t.co/ElQsRUa4AR "Logic, Probability and Computation: Foundations and Issues of Statistical Relational AI"looks like good, short read http://t.co/q7Et7IS1rg Good read, though see last few tweets MT @jathansadowski"Technology didn't kill middle class jobs, public policy did" http://t.co/9oiRPEJ2Rk @jathansadowski @evgenymorozov and 1 can hold tech played role in growing inequality w/o saying it "just happened" -ppl made tech, fired ppl @jathansadowski @evgenymorozov Race Between Education & Tech (book), for ex., does not fit simplistic caricature in opening 2 paragraphs. @jathansadowski @evgenymorozov Thanks! Look forward to reading paper. Lots of dueling papers already, tho, doubt 1 will change debate much RT @AstroKatie: Next time you see "toxic feminism" or "PC gone mad" just replace "feminism" or "PC" with "decency" and it'll read about the… Am I the only one who thinks it is weird that people are unironically referring to Phil Robertson as a patriarch? What is this, 6000 B.C.? @robotenomics @erikbryn I love that quote too, but do we know what a "properly automated and educated" society is yet (same paragraph)? The Secret Life of Walter Mitty as IRL fetishism @jathansadowski bait #kidding Adam Ford interview with @doctorow on utopias http://t.co/MGn4NSALTt @knewscript They are :) Elysium in Elysium (movie) is a lot like Solaria in The Naked Sun (novel, Asimov) except the latter is a planet. Similar # of ppl, lifestyle If robots were never used to replace people in a capacity, the case for making them would be much weaker. Obvi. both roles exist and matter. "Robots don't replace people, they help them." If I hear one more person say this... not mutually exclusive, and many clearly do the former. RT @rodneyabrooks: So much going on in robotics (drones, DARPA, Rethink, iRobot, Google) it is safe to predict lots of robot news in 2014: … There is a lot of press coverage suggesting robot surgery is being rushed, is unsafe etc. Any academic/long form writing on the matter? Kurzweil would be approximately 100 times more persuasive if he didn't use specific timelines in his predictions. Brilliant! "Ray Kurzweil at the pub" http://t.co/ljYmwPEjxK Andrew should have argued for the rights of non-human persons, not just become a human himself. Andrew in Bicentennial Man appeals to functionalism. Don't like ending of the story b/c reinforces human-person 1 to 1 identity. Asimov's vision of changing fashion/makeup norms (for both sexes) centuries from now in Bicentennial Man is very Hunger Games-esque. ASU now has a RoboCup team! Any tweeps have RoboCup experience? Oh yeah, Happy New Years :) RT @AliMattu: “Don’t wish for a great 2014, make it so!” #HappyNewYear http://t.co/lkvpNHmxG1 Agree one zillion percent with point made by guy around 6:45 in that vid Cognitive systems + employment panel discussion at @EUCogNetwork conf - just seeing now though my Q was mentioned :) http://t.co/h5uF9N9zYa @jathansadowski oh and enjoy http://t.co/VMu3AcFmJz @jathansadowski lol anyway, just meant that they need not go together (again in principle. Google Now is neither transparent nor democratic) @jathansadowski well, nerdy maybe :) @jathansadowski lol that's not a big word The Adventures of Fallacy Man http://t.co/VMu3AcFmJz @jathansadowski Also, meant transparency and democratization as orthogonal axes. Could be transparent but goals set by corp., or vice versa @jathansadowski Yeah I know/agree, not saying neutral, just that I'm personally not opposed in principle - very weak claim :) See you soon! Bicentennial Man (short story) was better than I expected. More transhumanism stuff than movie. Also, kids being mean to Andrew. @jathansadowski which I think is consistent with your points in those articles-some poss. benefits but overall troubling. Happy New Year lol @jathansadowski Opaque undemocratic model = them persuading you for own goals, transparent/democratic could help pursue *own* goals better @jathansadowski I agree there are legit concerns, hence "in principle." Ex. fitness/diet scenario you mention sounds great *if opted into* @jathansadowski Agree on 1 and 2. I'm open to persuasive tech in principle but should be transparent w.r.t. assumptions, info gathering, etc I'll be surprised if Google Glass or equivalent becomes widely used before it is technologically possible for it to be truly discreet. I, Glasshole: My Year With Google Glass http://t.co/IESrYMp1dr Bunch of videos from Personhood Beyond the Human conference http://t.co/8VkIQsSpnI Should I watch Orphan Black? @j2bryson Nice job on the cognition section! 2020 targets make a lot of sense...I wonder how the timelines/goals of US, EU roadmaps compare. Interesting short talk by the late James Albus - A Roadmap for Human Level Artificial General Intelligence http://t.co/8TsISiWmoY Grace Hopper being awesome on Letterman: https://t.co/rlNzCbvnJi Oculus Rift Takes Virtual Reality Mainstream http://t.co/JMx6ZkqMzH via @IEEESpectrum Nice word - automatobile (driverless car, used by Asimov) RT @danieldennett: I'm glad the dailybeast is giving Joanna Bryson the attention she deserves for her idea that robots should be slaves. @j2bryson Nice :) whose ideas was that, yours? I like that there is a group on ethical/legal/social stuff. Unlike US robotics roadmap RT @amcafee: Why research in the natural sciences is so important: we learn that dolphins like getting high. In groups. http://t.co/MretXNF… @j2bryson http://t.co/d2f8MYINva 1/3 Americans say "humans + other living things have existed in their present form since the beginning of time" (Pew) http://t.co/MVgPwteWWV Good free will pts, not qualified to comment on his self-model stuff, agree w/ editor's response to him on ethics in http://t.co/ylAWqdBgCr Sidenote: finished Mind and Mechanism by McDermott. Chapter 2 worth price of admission if you don't know much about AI. Otherwise, mixed bag ICYMI: "The machine question: AI, ethics, and moral responsibility" (proceedings), lots going on here http://t.co/6jgKLNfLzt Whoa, how did I forget that P.W. Singer ("Wired for War" guy) has a new book coming out in a couple days? On cybersecurity/cyber war. Rereading Robot Ethics (book) - better than I remember, or at least I'm getting more out of some chapters now b/c planning to use them :) Next two weeks: 1. Read everything. 2. Finish paper on AI and responsible innovation. 3. See Her. 4. Write stuff about Her. 5. ?? 6. Profit! RT @seldo: 2013 in summary: every computer that exists is being used to spy on you. Here's one you can wear on your face! Reading Robotics 2020 Strategic Research Agenda by euRobotics aisbl, does it have wide readership/effect on funding? @VincentCMueller RT @Slate: A lot of people are about to lose their basic income in the New Year, and it's a complete moral outrage: http://t.co/GVFcEyvTWd @danieldewey sure! I skimmed, 1st impressions=1. Lots of ideas, 2. results interesting depending on experiment setup, 3. You'd have more :) @jathansadowski @luke_fernandez neoliberalism seemed to b big theme in Social Epistemology issue on Japanese STS but haven't read carefully Thoughts on the paper "Bounded Recursive Self Improvement" anyone? http://t.co/mOwz7fxhtD @danieldewey People who dismiss risks from AI as out of the mainstream should be aware of the big section on them at the end of the leading AI textbook.. @jathansadowski yes u do. New system will be in place soon @AliMattu nice, look forward to reading it! And yes, I am planning to write something too, re: the ethics of making such software. @AliMattu @Slate thanks! Haven't seen yet (don't live in NY/LA), though been brushing up on related ethics/science lit. Stay tuned :) RT @MarkPiesing: "Google is a corporation like no other": Its drive into #robotics should concern us all #Google http://t.co/KqYTtYXN91 RT @shannonconley33: Coming of Age on Psychiatric Meds http://t.co/0d4NdSut7Z Roadmap invokes "dull, dirty, and dangerous." Yeah, starting point, but by no means a comprehensive framework for what bots should do... Reading DOD Unmanned Systems Roadmap FY13-38...seems to ignore call by Defense Science Board to scrap flawed "levels of autonomy"framework. @AstroKatie Yes, not in detail yet (1.5 years in). Message was lots of possibilities, goals post-PhD should inform dissertation topic choice RT @DBellonby: Neologism from the debate at @pankisseskafka's blog: Neiman Marxism: teach Marx in the classroom, but do all your shopping a… In the Human Brain, Size Really Isn’t Everything http://t.co/WkLHq5QyHA @jathansadowski yep! yeah that is within the range of variation so far, though again, limited data and norms may change over time @jathansadowski early days still/not my call so can't give definite answer but judging so far i'd say "somewhat," def aim for below 3k. RT @shanley: Giving yourself room to acknowledge that you were/are plain fucking wrong opens up the space for your politics, feminism, life… @jathansadowski nice @jathansadowski are you powering through Caprica? @jathansadowski smoking and fashion are weird on it as well, very old school @jathansadowski lol yea. Won't defend that but I do like how other things are different ex racism more accepted, gay marriage mainstream @jathansadowski in BSG, there is an explanation for old tech (ban on AI/networked comps), Caprica is just a victim of tech changing. :) Wired list of best books/movies/shows next year http://t.co/uwaNvMpzl6 @cphotorun Yup. Robert Wright @robertwrighter & Joshua Greene on @bloggingheads talking about neurosci. of morality, utilitarianism: http://t.co/lIAK8vJGFF @cphotorun tweeting this for the Nth time - Caprica is more relevant to socio-tech. issues we face in near-term than BSG, if not as polished apprentices for the master workers or of slaves for the lords.” - Ray Kurzweil. er, wait, no, that was Aristotle “If every tool, when ordered, or even of its own accord, could do the work that befits it... then there would be no need either of... (1/2) @mgubrud PS about to watch - http://t.co/EdxVDeZ3Td Greene + Wright (who wrote a good review of Greene) on utilitarianism, sure it's good! Dig the sentiment, though not sure reboot needed - just continue it! RT @cphotorun #bsg 10 year anniversary - its time to reboot caprica @mgubrud I may agree w/ this, not sure. My views on meta/normative ethics ~= Greene in Moral Tribes. welfare to me ~= "what serves us" @mgubrud hobby,fulfilling work, etc.,2. technical challenges of automating "bad" jobs similar to "good"-Need socio-economic-political action @mgubrud Absolutely. As I mentioned recently, two key barriers to Asimov's vision: 1. one person's dull, dirty, dangerous is another's (1/2) @mgubrud Today, that mostly means focus on humans. A few million years ago, it wouldn't have. A few million from now, almost certainly won't @mgubrud non-human-centered morality is fine w/ me. VERY roughly, value for me is quantity x quality of true welfare of sentient creatures. @mgubrud "pleased" bc I satisfice. Consider population ethics, ex. repugnant conclusion, stuff gets tricky, but AI not unique in that regard @mgubrud I would be pleased w/ smart but non-sentient bots. Don't have strong enough views on philosophy of mind, etc. to know if possible. Also see @j2bryson's AI & Society page. Lots going on there! http://t.co/aSkTm8mokK … @j2bryson roadmap for domestic bots http://t.co/reotF6L58B mentions ethics unlike US Robotics Roadmap and > than lip service (BRAIN Init) :) @mgubrud ex. I think Asimov's vision is prima facie desirable http://t.co/0W0kaoAcgh, though transition, x-risk might change expected value. @mgubrud BTW I'm also dubious about impact on human welfare, but think potential upside = large and not nec. impossible to mitigate downside Secret Life of Walter Mitty was cute, light. @mgubrud yes I meant good starting point @mgubrud and need not be quantifiable to make rough assessments like ex extreme poverty is bad, good thing if ppl find jobs fulfilling etc @mgubrud don't care if human, just sentience, like animals. I don't know if bots will ever be sentient either but that is q, not species @mgubrud not sure what u mean by external. I think most things ppl value are bc result in welfare. not just diff word, happiness !=welfare @mgubrud genuine human welfare is what good util values, not just happiness in hedonic sense @mgubrud could say the same about any coherent/comprehensive moral system though. I don't claim util is moral truth, just good staring point @xuenay or is what I said what u meant @xuenay in what way exactly do u mean? Wouldn't happy robot slaves who enjoy servitude be compatible w us liking having slaves/prosperity? @knewscript ;-) @knewscript http://t.co/ef8EW89nhM Answer to your Q: a character killed off and resurrected in an ad hoc way by writers w/ limited foresight Best comment on my BSG article by far- Prawn Suit: "I'm disappointed by the utter lack of Fat Lee Adama in this article." @jathansadowski and I absolutely agree util is sometimes counterintuitive. To me all that shows is that morality is an evolved hodgepodge. @jathansadowski but we aren't going to settle this here :-) @jathansadowski not sure what u mean. I agree w/ Greene in ex. Secret Joke of Kant's Soul that deont. rationalizes questionable intuitions. Main thing the movie I, Robot gets right: in 2035, robot manufacturing will be a humongous industry. @jathansadowski lol I think it fits our intuitions way more than anything else, but I'm an anti-realist so not committed to defending it :) from an ethical perspective, aren't we obligated to crank out a bajillion happy robots? Free or slaves, if happy then util says do it (3/3) to potentially be an interesting area. Petersen says pop. ethics says it's not nec. wrong to add happy slaves. But if action=inaction (2/3) I only know of 1 direct cross-fertilization of population ethics and robot ethics - Petersen's Ethics of Robot Servitude. This seems (1/2) Zomg new DOD unmanned systems integrated roadmap. #robotethicsnerdporn RT @bryan_caplan: Me at my most scholarly: http://t.co/RZ6Vs9I0ni Will Smith: "Can a robot write a symphony? Can a robot turn a canvas into a beautiful work of art?" Robot: "Can you?"=1 good line in I,Robot Dr. Calvin is plain looking in Asimov's writings, but in I, Robot movie, is beautiful. Everyone must be beautiful in movies cuz reasons. RT @WillOremus: Amazon's best-selling books of the year— and what they tell us about the American psyche, circa 2013: http://t.co/oFlk41sgiG RT @GaryMarcus: Before there was Spike Jonze’ HER - 10th anniversary of Battlestar Galactica remake. #AI #human-AI-romance #scifi http://t… RT @chrispydog: Abe rejects Koizumi's call for no nuclear energy use in Japan via @globalpost http://t.co/g2sthDaSfg RT @Jezebel: About that time Jack Nicholson sort of hit on Jennifer Lawrence http://t.co/h4xLlDMpSk http://t.co/53V30ZAcUd Minimum of several thousand readers in first 24 hours of my #BSG article... wait, so what's the point of academic journals again? #7 on Slate's most shared list. Needs more shares, plox: http://t.co/paB1mDXvRp @jgcarpenter Yup! Ex. I really want someone to write fiction about Robin Hanson's upcoming book on brain emulation economics/sociology/etc. @jgcarpenter Agreed!! Sci-fi is technology assessment for the masses. See the article I linked to in the Slate piece http://t.co/wZevwPwGBZ RT @tylercowen: In honor of the Alan Turing pardon, here is my piece with @autismcrisis on Turing tests...http://t.co/GtvO7Gssvc, #Turing Clarification: The public thinks AI risks are plausible, but don't want to think about 'em too much. Same as global warming, poverty, etc. RT @Variety_DSCohen: It’s the 10th anniversary of Battlestar Galactica, and it’s more relevant than ever. http://t.co/RGi0zBSqIm via @slate RT @murmike: It’s the 10th anniversary of #BattlestarGalactica, and it’s more relevant than ever. http://t.co/ANufEKr1bf #BSG 2 things I've learned from my BSG article: 1. the public thinks AI risks are plausible, 2. BSG nerds like citing articles for why BSG rocks. @jathansadowski Why not? ;-) Yeah, I feel ya re: my next conquests (non-TNG Star Trek, some classic sci-fi novels...) @jathansadowski I think/hope you'll like it. As I've said, a (1!) notch below BSG in production value but v relevant to near-term tech stuff @jathansadowski Yeah, IRL the writing of the Starbuck thing was very ad hoc so it was inevitable that the resolution of it would be ad hoc. @jathansadowski Lol yep. I like that some people mentioned Caprica, though I didn't. Your next assignment, should you choose to accept it ;) @jathansadowski Nice!!!! Thoughts on finale? Two best comments on my article are ~= "I loved the finale, shut up" + "needs moar fat Apollo" @jathansadowski Thanks :) @joecarter makes the case for BSG being the best sci-fi TV show ever http://t.co/jvOykKUJxi is a small step in an unpredictable direction in [computer space]. There's nothing magical about being Mozart except getting there"McDermott "The step from Salieri to Mozart, from someone who is pretty good to someone who is amazing, (1/2) Female protagonist: "I love you." Han Solo: "I know." Adama: "About time." Adama wins. Lots of commenters on my #BSG article have mentioned that it's their fave sci-fi show - me too! :) (well, BSG+Caprica as a package deal) I was surprised by how loud Nao is in person. The androids I saw were quiet but only cause the air compressor driving em was in another room Nice to see (some) commenters on my BSG article say good things about Caprica :-) It's nice not to be the only fan. RT @AlanTuringYear: @AlanTuringYear Here is the story from @BBCNews: Royal pardon for codebreaker Alan Turing http://t.co/0bRbsPvyQM #Turing Q: "What can you tell me about why Google bought these robotics companies?" A: "Nothing right now." :*( http://t.co/0K1uWa7aCR RT @Liberationtech: Queen Elizabeth II Pardons Computing Pioneer Alan Turing [pdf] http://t.co/r2PJGus7s2 #UK RT @Slate: It's the 10th anniversary of Battlestar Galactica, and it's more relevant than ever: http://t.co/2BqCWqLM4G I wrote an article on the 10th anniversary of BSG http://t.co/ef8EW89nhM mentions @danieldewey @FHIOxford @MIRIBerkeley, others. @j2bryson @VincentCMueller http://t.co/hWpNtgFTYL RT @jathansadowski: Alt NYT hed: In Silicon Valley, Engineers Discover Users, Hire Designers http://t.co/RB79Nc7wPM @sarahjeong suspect there's relevant lit. on math edu. (i.e. need for perseverance through initially overwhelming # of meaningless symbols)? @Miles_Brundage: I'm a bigger Tom Zarek fan now that I know the actor is 1. the original Apollo, + 2. the author of several BSG novels. Don't get me wrong, I <3 meta- and normative ethics as a field, it's just that most writing on it is too vague and/or obvious to be useful. *Meta-/normative ethics. The former is mostly irrelevant, the latter rarely improves. Applied ethics = what the scientist, etc. *is doing.* Dear people who say "I'm a [roboticist/scientist/engineer/etc.] not an ethicist, but..." You can skip that. Most ethics isn't useful :( Pet peeve: ppl who say "X will happen..." In respond to "Should X happen?" (in this case, Kevin Kelly on whether robots should get rights) I must see @TranscendenceM if not just to understand the cockamamie reason why Dr. Caster wants to disintegrate solar panels I'm sure I am not the first to point this out, but Dr. Caster in @TranscendenceM is basically Ray Kurzweil. "We have pets that are not conscious but are incredibly emotional" - Kevin Kelly interview.... #facepalm @petitegeek my bet (IHMC, where I interned) did well too ;) btw had a great visit to Nishida lab!! Hope your dissertation is going/went well ...that the Pentagon's plans, investments, goals, etc. are more transparent than Google, which is buying up contractors from the former(2/2) I am nowhere near wrapping my head around the ethics of the robo-Google-ypse's secrecy. Yes, IP, profit, etc. important, but it's weird(1/2) If you haven't read the MaddAddam trilogy, get your act together - not talking to @jathansadowski, you're doing something more important :) @MargaretAtwood on her book In Other Worlds: SF and the Human Imagination (part 1 of 3) http://t.co/bfSWpq6YPO I could spend the rest of my life reading Asimov in, say, 1/20th of my free time (a lot...) and still never finish it all. 500+ books!!! There is way, way, way too much excellent science fiction for me to read in this lifetime. What to do? @j2bryson @VincentCMueller will be other opportunities, as well. Not sure what I'm doing next year travel-wise, deciding on AAAI/cogsci now @j2bryson @VincentCMueller which you may want to submit to (let me know if you decide to so we can coordinate, they prob don't want all AI) BTW @j2bryson @VincentCMueller I got v. positive reviews on my AI+responsible inno. proposal but there was a general RI 1 which subsumes it ICYMI Illah Nourbakhsh has a cool companion blog to his latest book and updates it occasionally http://t.co/sCdRHl6oKa I've raved about Russell & Norvig before and stand by it but OTOH Poole & Mackworth is FREE + has lots of cool demos http://t.co/5kRADgbN5x Noe says she loves my Battlestar Galactica post even if no one else does :) http://t.co/JkwJQGxdO5 Graystone Industries, er, I mean Google now owns Boston Dynamics...kind of a big deal. Finally tried Depression Quest by @ZoeQuinnzel. Brilliant idea -bravo! Rly liked the inclusion of trigger warnings + info for those in need Cranking out lots of text on BSG. Too much. I have so many thoughts on BSG and the importance of sci-fi, it's hard to whittle it down :/ view that this time could be diff re employment, and mainstreaming of rargs for AI risk. BSG as vehicle for provocation,not prediction (2/2) Rough thesis of blog post on why BSG matters more than it did 10 yrs ago: mainstreaming of AI/bots, conversion of many economists to (1/2) @markoff: lack of Japanese bots to help after Fukushima caused frustration there. yup this came up a lot in my visit http://t.co/VB3dJOwht3 RT @social_brains: Americans Have Little Faith In Scientists http://t.co/5ZL589egp1 Also, effect of military funding on time horizon depends on baseline - NSF, Japanese funding agency, startup, Google... Of course, lots of variables affect US/Japan differences in AI/robotics research but I'm drawing on explicit references to it as a factor... Just the applications thereof? Recent trip (n=2, US/Japan) suggests two differences r cute/humanness of bots and research time horizons(2/2) AI/bots Q of the day (inspired by @j2bryson/Boston Dynamics tweets): how does military funding affect AI/bot research *itself*, not (1/2) "RT @Amazing_Maps: The world divided into seven regions each with a population of 1 billion Like us on Facebook- http://t.co/TlTZfNVYrc htt…" Plausibility and Probability in Scenario Planning by Ramirez and Selin http://t.co/O3TrgmvLeG Stephen Wolfram's comment(/attack?) on Watson is really bizarre, esp the whole "rooting for you on Jeopardy" thing http://t.co/JAjQMoHZZn I'm always amused by how the old picture of Bill Adama looks like the Fonz. It's true...we're Cylons. And we have been from the start. Starting Mind and Mechanism by Drew McDermott. Have heard good things. I'd make a snarky mashup of creepy Petman-with-camo Boston Dynamics footage with Google "don't be evil" but it'd be too easy. Just as importantly, what don't we want SCHAFT bots doing? Killing ppl autonomously, check! What else? Taking low wage jobs? OK, now that the fun military-robot-industrial complex party is done, what do we do with this stuff in 10 yrs? Fix nuke reactors, check! + ? Need to stop goofing off by reading books on cognitive science and political philosophy and get to work watching BSG. #notkidding #gradlyfe Anyone else ever looked up the table of contents for a book you own on Amazon because you're too lazy to go across the room to get it? I doubt philosophical zombies possible but annoyed by bad args like "a zombie would be selected against bc indifferent 2 outcomes" misses pt RT @nicanbun: That is so unlucky! A connector got crushed for #ihmc during hose task, and they were unable to operate the hand. #DARPADRC RT @DARPA: With the last round of tasks underway, judges are in the process of validating team scores #DARPADRC ICYMI Valkyrie got zero points. Can't win em all, NASA! You'll always have 8 mins of terror RT @denisechow: Check out this great video @MichaelBelfiore made of the @DARPA Robotics Challenge Trials: http://t.co/DpV7Kpxfnb #DARPADRC RT @denisechow: My Q&A w/ @DARPA Director Arati Prabhakar about #DARPADRC, national defense & robots of the future: http://t.co/cQPZZIxeWW … I was going to tweet about the ethics-of-Batkid thing at the time but figured it was too soon and someone would do it for me eventually. RT @donovanable: How Many People Died Because of Batkid? | Clickbait headline, actual good point for free http://t.co/4YRHt4LMho Nevar 4get that the contestants literally crashed and burned in the first year of the DARPA autonomous car challenge. RT @dangillmor: Japanese team "Schaft" is just destroying the competition at #darpadrc -- robotic feats by one of Google's newest subsidiar… IHMC pulls into second! Is it possible for them to win at this point or does SCHAFT have it locked down? #DARPADRC "Who's the robot that won't cop out When there's danger all about (SCHAFT!)" #DARPADRC live stream comments..."Schaft hijacked a raptor and is terrorizing the west coast." My bet for the #DARPADRC, IHMC, is now in 2nd/3rd - go, go, go! Booo, SCHAFT/Google! j/k, good luck all. :-) RT @FastCompany: There are about 100 million people in the U.S. with full-time jobs, but only 30% say they're engaged and inspired. http://… Just a sampling of anti-AI/robotics Tea Party-esque stuff for the uninitiated. http://t.co/boaRJSZCwo Though as I noted earlier today, there are issues which make such a "properly automated and educated world" intrinsically hard to attain. The latter is the source of one of my fave quotes summarizing (one way of thinking about) the aims of AI and robotics...last paragraph. Some of my fave non-fiction essays by Asimov: http://t.co/k40uxIclpZ and http://t.co/0W0kaoAcgh Transcendence also seems to involve Johnny Depp acquiring powerful nanotech. Only explanation for the stuff floating up/dissolving thing (?) True, there is lots of conspiratorial/vitriolic stuff on the net that doesn't result in anything, but some does. :-/ anyone else seen this? Specifically, it seems to be mostly people broadly aligned with anti-government attitudes who latch onto any AI/robotics news as evidence. The violence against researchers in latest trailer is eerily plausible. Lots of conspiratorial anti-gov't stuff on the net re: AI already... Anyone else think it's weird that a bunch of Transcendence trailers are coming out all at once? Intentional, or preempting an expected leak? Wage subsidies, guaranteed income, etc. could help but it seems like there are inherent trade-offs [at least b4 bots can do everything](3/3) 1. The technical requirements of automating "good" and "bad" labor are closely related, 2. One person's bad labor is another's good (2/3) There are at least two big challenges that make it hard to build a society where all work is "good" work and the rest is automated: (1/3) @kaidokert Thanks - do you know what the total number of possible points by the end will be? @cassiepoe Thanks! Are the current scores listed anywhere for #DARPADRC? Also, I enjoyed Philosophy and the Problem of Work: A Reader, but mixed quality. Okrent/Pence/Schweickart/Nozick/Hawkesworth = fave chapters http://t.co/6I14BwfAB9 early version of Parijs's influential args. "What's Wrong with a Free Lunch?" = good book on the debate for noobs. "A Capitalist Road to Communism" - van Parijs and van der Veen, important early paper on the case for max. sustainable guaranteed income. OK, #DARPADRC is getting more interesting now that the robot is moving.The 30 minutes per task thing doesn't lend itself to live viewing... Writing a little number on the 10 year anniversary of BSG...let me know any thoughts you have on its continued value/relevance (?) :-) No offense to the participants - to whom I wish good luck!! - but the #DARPADRC is sooo boring to watch live, at least on a computer, lol. RT @willknight: Robot drives probably the slowest lap ever at Miami homestead speedway in a golf cart. http://t.co/mycLCrcPaY RT @DARPA: First point in the DARPA Robotics Challenge Trials scored by Team Schaft http://t.co/CXh3qWxNb4 #DARPADRC For a long time, using Google meant financially supporting advocates of a robot-dense future. Now it means directly funding robotics R+D. The only plausible exception I can think of is if one thinks research now is unable to help, but one would need a good reason for that. The point in my last tweets was motivated by AI ppl using "sci-fi" to dismiss long-term concerns while striving to create said sci-fi tech. Without also 3. Having, researching, or at least endorsing research on solutions to those concerns (2/2) One can't simultaneously 1. Dismiss concerns about tech X bc it isn't at maturity level Y and 2. Advocate R+D $ to get X to level Y (1/2) RT @OSRFoundation: Required reading! RT @AutomatonBlog: DARPA Robotics Challenge Trials: What You Should (and Shouldn't) Expect to See http… RT @Annaleen: A+E Network wants you to know that ducks do not endorse homophobia. RT @io9: Johnny Depp gets crazy creepy in the first teaser for Transcendence http://t.co/PwKnoUoDG4 Come on CNN: "Is this man [Phil Robertson] simply expressing his beliefs or spewing bigotry?" Since when are those mutually exclusive? DARPA Robotics Challenge is Friday and Saturday! My bet is still on IHMC. Anyone else have a favorite? Nao robot mimicking my upper body movements, and me making various poses while trying not to make the Nao fall over. http://t.co/RJ4PNQQg3m One of the highlights of my whirlwind tour of Japanese labs was interacting with agents and ppl in VR. Still bullish on medium/long-term VR. Illah Nourbakhsh on Google's robotics acquisitions + his latest book http://t.co/8sBFc3rlPP "RT @BrentButt: Google motto 2004: Don't be evil Google motto 2010: Evil is tricky to define Google motto 2013: We make military robots" Google: we value transparency and our motto is "don't be evil" but it's fine to buy DARPA contractors secretly for secret goals cuz reasons. Learned a lot about robotics, HRI, responsible innovation, etc. in Japan, but most importantly, I learned how much rice quality varies. Note to Uber: Japan beat you to the whole cab driver in suit thing. Also, they have automated doors here. You lose. Japanese subway ticket machine malfunctions. Hole in wall next to it opens, man pops out to help. Now that is what I call a great UI! Spent some quality time with androids and other robots today. Interesting conversations, too (with people, not the robots). Hugged a robot. "Science and technology policy rarely gives much recognition to R+D labs as social/political institutions" Crow+Bozeman,98. This is changing Responsible research n innovation about more than research integrity. About taking seriously role of research n innovation in shaping world. Int'l symposium on responsible research n innovation in Osaka. Drivers of interest here- research integrity, bioethics controv., Fukushima. Japan, you had me at great train infrastructure, tricked out toilets, and good, real food at convenience stores. Second round of DARPA Robotics Challenge featuring Atlas is this month. Boston Dynamics makes Atlases. Now Google has Boston Dynamics. WHOA Google bought Boston Dynamics. That is NO JOKE RT @RobotCentral: Google grabs its 8th robotics company in the last 6 months. The big dog in legged robotics, @BostonDynamics . http://t.c… @j2bryson @danieldewey partly evo. reasons (ie diff between now and past). ex. Unfit for the Future, Moral Tribes' arguments. No easy fix :/ @j2bryson @danieldewey great post! Agree culture v important (and dangerous!). Re: cognizant failure...IMO we are bad at that for (1/2) @j2blather @j2bryson :) RT @j2bryson: OK, blogpost: The #intelligenceExplosion started 10,00 (+|- 2,00) years ago, and cognizant failure. http://t.co/QcHRBMIpUS @… I really like the movie The Thirteenth Floor. Any tweeps seen it? @jathansadowski Hey, if they can do everything I would otherwise do.... ;-) fortunately I have a while before then. @jathansadowski Indeed. Sumner's "Welfare, Happiness, and Ethics" is good on this, but beyond the scope of Twitter :-) @jathansadowski longer version of my point about rationality not meaning coldness/economics/etc. http://t.co/NmnjYXYkcz @jathansadowski Yeah, I mean I'm very pro-max'ing expected human welfare (NOT pleasure!), which also entails reducing existential risk. @jathansadowski I have no desire/requisite expertise to defend economists. But smart utilitarians don't think happiness is quantifiable. @jathansadowski To come full circle: the reason I brought up flow is that I'm interested in what we really want from economy/jobs. Not GDP. @jathansadowski Well, they both do share belief in maximizing expected utility, but so do lots of other people. Key issue for me is goals. @jathansadowski Lol...as usual, I think most of our disagreements are about meta/norm. ethics. I'm a card-carrying anti-realist utilitarian. @jathansadowski yeah, but sometimes necessary. Ex. Singer on training seeing eye dogs vs. curing blindness many times more per $. No brainer @jathansadowski Very sympathetic to that critique. That's one of my pet peeves about some x-risk people. My main issue though is goals. @jathansadowski yeah, such rhetoric can go overboard. For strategy (if not rhetoric) re X goal, though, you should maximize expected X. @jathansadowski absolutely. There is no meaningful momentum to "solve" poverty, climate change, political oppression, LGBT rights, etc. @jathansadowski For a given goal, you're doing it wrong if you violate basic things like expected util. maximization. They're right abt that @jathansadowski you may be right! But I think there is no defensible reason to accept that as inevitable. Not that you're saying that tho @jathansadowski for sure! Though I think we shouldn't allow $-oriented ppl to have monopoly on rational decision-making. Diff metrics though @jathansadowski don't think you need to be an economist to think you should consider impact of investment @jathansadowski we give negligible amounts of time/$/resources to global poverty, less negligible but still not enough to domestic. @jathansadowski yeah I know. Not endorsing anything about status quo. The world sucks at dealing w big issues. @jathansadowski disagree, if lives have equal value then marginal return on a dollar is wayyyyyyy higher overseas. @jathansadowski massive solar/wind deployment or natural gas/coal deployment w/ geoengineering/some combo. Not ideal but > extreme poverty. @jathansadowski he is mainly talking about "cute" tech solutions by SV nerds. Not what I advocate. Only plausible pathway I see for this is @jathansadowski it means something in ethical sense (ie. we're assholes if it doesn't happen), but not practical sense (ie. assures results) @jathansadowski it won't be, prob, but technologically it isn't that hard. @jathansadowski agree, I only said that to be deliberately conservative. I think extreme poverty can be eliminated in 1-3 decades. @jathansadowski and yes, basic is a moving target. Something along the lines of Star Trek is, I think, attainable this millennium. @jathansadowski Yeah, I don't mean it literally, but in the sense of basic needs universally taken care of. Thinking about AI/reading Flow by Cziksentmihalyi. Transition to post-scarcity world gradually, incentivize high flow jobs/hobbies b4/after? Leaving for Japan in 12 hours! RT @HopkinsEngineer: .@Robohub chooses the top #robotics stories of 2013. http://t.co/NwOpMFEeSk @knewscript No, should I? Looked at it on Wikipedia and it sounds good. I'm never disappointed when I read Asimov. Gripped by The Naked Sun. Kinda like The Machine Stops- post-scarcity, physical isolation of ppl. @mgubrud agree except maybe prophetic ;) he's made many good predictions, also bad ones, hard to compare to others as few make so many of em @jgcarpenter in "Towards Robots With Good Will" Nishida says influence of culture on Japanese bot attitudes overrated. Dunno abt that/Korea. @jgcarpenter thx will check out when I get home. I leave 4 Japan tomorrow, will talk to AI/robotics ppl about related issues. @j2blather @j2bryson that's what you get for being an expert ;-) RT @j2bryson: @ShaunGamboa We can program robots to simulate love or even suffer for it, but it shouldn't be a goal of AI research http://t… @mgubrud well, the way he puts it is "extinction" of biological humans, but continuation of sentience/human "essence" right? @mgubrud not that "just treat AI as sentient" is simple ;) but it is a least clear. I recall him paying lip service to risks, solve w tech. @mgubrud be more specific? Have read SIN and HTCAM by Kurzweil and doesn't he think Turing Test is sufficient so just treat it as sentient? Point is the "assuming no deception" part could be interpreted in few ways. Direct from AI? Company? Social norms? All? About what exactly? And could it be sufficiently therapeutic in the senses discussed here w/o it implicitly or explicitly claiming to be sentient/moral patient? Of course that scenario (a la The Machine Stops or The Naked Sun) depends on many variables, not just the (non) existence of affective AI. OK for ppl to be attached to AI assuming benefits, no deception. Other Q is higher order long term social impact, ex. social skill atrophy? @jgcarpenter @alan_winfield thanks for the thoughts! Is this a fair summary of your points (next tweet doesn't have everyone's names) @j2bryson @alan_winfield @VincentCMueller @GrandpaRobot @jgcarpenter @ShaunGamboa ICYM my last post- thoughts? I have my own, happy to share May write blog post on movie Her re: the real issues involved in affective computing ethics..anyone want to chime in? http://t.co/lVE0Q5Fcwg Yeah, he was playing a role, but as could be expected, chemtrails people seized onto it as validation. Ugh. (2/2) BTW, @StephenAtHome seemed to implicitly endorse chemtrail conspiracy theories at the end of his David Keith interview. (1/2) In case you don't know what I mean... http://t.co/XzERanDF3n = debate on real geoengineering, http://t.co/zJQ7wTEYzY = what it sounds like. Sign of the times: bunch of bogus chemtrails vids on YouTube vids have way more hits than Keith/Hulme debate on real issue of geoengineering Chemtrails is the new birther is the new truther...etc. Ugh why are media outlets going along w/ the Anchorman 2 "viral" marketing campaign? It prob. won't be good and the strategy is transparent. Yessss got my copy of Philosophy and the Problem of Work: A Reader in the mail. My Japan trip AI/robotics/ethics book stack is complete! @danieldewey which interests me- what do we ultimately want from AI/bots economically and how to get it? Looking for the anti-Player Piano. @danieldewey Hmmm.. maybe the quality varies? I hope as I bought one already ;) I've heard (at least some) of it's about post-scarcity stuff Eliezer Yudkowsky on Friendly AI http://t.co/L2Omaipump Long counterpart to @danieldewey's TED talk on related issues http://t.co/hbFbnRpJ9b "Philosophical and ethical issues" is sub-topic at AAAI-14 - anyone have exp. presenting on such stuff there? I didn't see any@2013. Hmm! What do AI people think about the Culture series by Banks? I may bring Consider Phloebas on my trip... @danieldewey @j2bryson RT @laurahelmuth: Possible geyser of water erupting from Jupiter’s moon Europa. GEYSER OF WATER. Hubble FTW @BadAstronomer http://t.co/t01D… @j2bryson cool, thanks! Leaving Sat for Japan and hope to compare technical/ethical concerns in US/Europe vs there, will bring that with me. @jathansadowski thanks! I'll check that out. I can think of lots of reasons in my own case but wondering which are dominant in general. Has anyone written a good account of why physical books continue to be preferred? I've seen fragments of a theory, but nothing comprehensive RT @GaryMarcus: #Facebook bets big on #AI - @garymarcus’ analysis @newyorker http://t.co/wCzSi97MYK and time horizon in finite horizon cases; and how low level reasoning can be more efficient while having human interface be @ high level (3) horizon case or all actions equal; Model-free learning works; Useful language analysis possible w/o grammar; relation btwn optimal policy(2) Freebie question on AI final was what 5 ideas from course we found most interesting + why. Mine: discount factor necessary in infinite (1) Fire Upon the Deep is also in the running... Stare judgingly at fat people when they go to the gym, then wonder why fat people don't just go to the gym. #fatmicroaggressions Skewed towards fiction on purpose as I don't read enough. And If Philosophy and the Problem of Work: A Reader arrives tomorrow, it's coming. The Naked Sun; Robot Visions; Consider Phlebas Tell me what to bring on my trip? Cog. Psych. and Its Implications; Working by Terkel; Rapture of the Nerds; MaddAddam; Paris in 20th Cent.; Stressing out about which books to bring on my trip to Japan. #firstworldproblems @jathansadowski Gotcha. Look forward to the paper! @jathansadowski my point being that there could be a spectrum of protectedness/safety/isolation etc. with different drivers/impacts @jathansadowski interesting...is there a spectrum? Like is an apt. with a gate a gated community or does that just mean gated off houses? "The affect dilemma for artificial agents: should we develop affective artificial agents?"- Matthias Scheutz http://t.co/5IJZxqEDmL @jathansadowski Good point. @jathansadowski Might be interesting to juxtapose w/ a pessimistic one, + a middle of the road one (ex. McAfee/Brynjolfsson's one next year) @jathansadowski Nice! I ended up getting an advance copy of the IBM book "Smart Machines," still haven't come up w/ good angle on it though. @j2bryson Great example of responsible innovation! Also glad to hear yall are doing ASP stuff, I really enjoyed using it in class/am a fan. All those topics are cool, but the adjustable companionability one piqued my interest - have u written about it anywhere already? @j2bryson @jathansadowski Nice... Noble and Mumford are def. on my list to read at some point. Others look interesting as well. @jathansadowski ICYMI also new Marcus piece in New Yorker (haven't read yet myself) @jathansadowski yeah, ex. I go back and forth about if/how to bracket the phil/media/etc. issue of bots as (1st/2nd) order moral patients @jathansadowski lol yeah. I'm afraid to word count one of my papers. See also Noel Sharkey paper on this MT @RobotNext What the terrifying future of a #drone police force would look like http://t.co/yzaGrzyHDq @jathansadowski at least not til the dissertation is done, perhaps, haha @jathansadowski I meant in terms of hardness/time...shouldn't bite off TOO many decades-old/tons of literature controversies ;) @jathansadowski it is most valuable, I think, when the reader may not read the whole thing carefully, so you can skip/skim strategically @jathansadowski you might like Phil. of Info. btw. I am benefiting the most from it as a guide to issues I should avoid on dissertation lol @jathansadowski yeah, they aren't always necessary/valuable 4 articles. In the case of systematic textbook-y books like this, def. valuable. Wish all authors of dense books would have clear intros, summaries for each chapter. Reading @Floridi's Philosophy of Information. Fascinating. Great list of open problems in chapter 2. Look forward to more AI stuff later. [obv. he talks to people, question is how closely integrated his research group is with others, what the social dynamics are like, etc.] It'd be easy to dismiss Kurzweil's prediction if he didn't work at Google in close proximity to smart critical ppl- Q is does he talk to em? My sense from NLP ppl is that it depends what you mean by "rich" but human-level NLP will take many times longer than that...thoughts? Does any1 in #AI agree with Kurzweil that "rich search and Q+A experience based on the true meaning of natural language" is 5 years away? "Ugh I really need to get back in shape." -thin person to fat person. #fatmicroaggressions Rationality and Intelligence - Stuart Russell http://t.co/K3EtAqPHr3 RT @jonWturney: Critique of Kaku-style futurism by @Patrick_McCray, also featuring @timmaughan http://t.co/TYl9XcNVYi Studying at Waffle House in the morning for an exam at noon is probably the best idea I've ever had. Yeah, there's a low bar. :-) And yeah, I know that's simple math for math/science/engineering people. For a social scientist, it's more intimidating :-) Exam tomorrow :-( at least I can have a cheat sheet! http://t.co/E6mizrld1M @dalecarrico if I didn't have an exam tomorrow and international travel in a few days, I'd comment. Will at some point. RT @DARPA: The 10 Robots You’ll Meet At The DARPA Robotics Challenge http://t.co/eBLBgPPvtI #DARPADRC "The Next Great Era: Envisioning a Robot Society" talk by Robin Hanson. Read draft of book on this- it's fascinating! http://t.co/RXt2eanHY3 Vid of talk by @techsunny on "AI and the Media (and the Media and AI)" at @EUCogNetwork conference http://t.co/phh7QnaGPd RT @amyleerobinson: Storing "abstract connectivity matrix of a mouse brain" estimated about 2 terabytes. Adding molecular data increases by… @AcademicsSay happened to me today :) RT @AcademicsSay: Do you mind if I reply to this email while you wait in my office watching me type the email. Also, I've seen several people referred to as "Google's Director of Engineering." My guess is: Kurzweil is "a Director," as are many others? (And yes, I realize there are various ways of evaluating his track record of predictions; my personal evaluation is that his record is OK) Kurzweil prediction op-ed. Nothing new. Editor's note misleading as to his record. See Wikipedia page on this topic. http://t.co/TG0ca9VFjz Finding out the day before a dreaded exam that a cheat sheet is allowed... :-) RT @iamsofilia: If you don't like your job, yet you're not ecstatic about robots taking it over, then perhaps our economic model could use … RT @James_Kpatrick: These two books contain the sum total of all human knowledge http://t.co/MF8ME8tJOM RT @RyanLizza: John Podesta to join White House, "focus in particular on climate change": http://t.co/8oqvnD4rPK Podesta is major opponent … You know geoengineering is mainstream when David Keith is on Colbert. Whoa David Keith is on Colbert tonight! I'm assuming it is the geoengineering research advocate David Keith, otherwise don't know who it is Of course, that takes time/resources/knowledge of UI design to be done well and often. Making one's code easily usable by other computer scientists != making it usable by normal people, scientists in other disciplines, etc. I feel like more ppl would apply AI techniques to new domains if code were available as user-friendly apps, not just libraries, classes etc. This was in 1978. His main point was that AI progress will be slow and for foreseeable future, will only be able to solve discrete tasks. Says interesting things about "levels" of instinct, thinking, etc. and intelligence as policy updating/overruling instincts. Richard Bellman of Bellman equation fame wrote Intro to AI: Can Computers Think? not long before his passing. His answer: ill-posed question @mgubrud @danieldewey yup, @danieldewey probably has great reading lists too. Now I should get back to studying for AI (not AGI ;)) exam. @mgubrud @danieldewey Also, what's relationship btwn funding sources/mechanisms/goals + impact? Hope to learn about Japan vs US next wk @mgubrud @danieldewey Agreed! Quite interested in those issues. see http://t.co/ctFRRGAo9a @mgubrud @danieldewey one of main things I'm pursuing is 2 map rltn btwn space of AIs and social impact. Not predict future, democratize it @mgubrud @danieldewey I'll read Bostrom's book and @danieldewey's stuff and then update my P distribution :) for now, focused on near term @mgubrud @danieldewey That could be true -personally I have vague P distribution over that, fast takeoff, upper bound near human level, etc. @mgubrud @danieldewey what's not like what? @mgubrud @danieldewey I want more research on lots of AI/tech-in-general risks, opp'ties, research can be globally increased, not either-or. @mgubrud @danieldewey Obv I agree as that's what I do for living ;) but I think having diverse research can help hedge against P>0 big risks @mgubrud @danieldewey I don't do research on it personally but think that doing so doesn't requiring thinking high prob., just >0,big impact @mgubrud @danieldewey Eh, I think only "obviously unreal" for near-term. Long-term, hard to say. Non-trivial # of smart ppl think plausible @mgubrud @danieldewey Descriptive accuracy = distinct concern from building system that isn't self-defeating, systematically irrational @mgubrud @danieldewey I'd also add that "comic book scenario" isn't an insult to me ;) Sci-fi has valuable role http://t.co/fI5Tdwpzma @mgubrud @danieldewey current AI uses explicit util. functions, the theoretical importance isn't undermined by humans being irrational... Gordon vs. the Androids - @NYTimeskrugman on robot-driven economic growth http://t.co/BbY1o7vEp1 "Also, Skynet will kill us all." If you're in Florida, consider checking out the DARPA Robotics Challenge live on Dec. 20-21 http://t.co/L41D4Wi5A4 My money is on IHMC! @jathansadowski Thanks, yeah I saw that. Solid/some good points, though there's a huge # of plausible"this is why we don't have AGI" args :) @mgubrud Hmm, I'd say that's about right for feasibility Q, but some progress on what would/wouldn't work to contain. @danieldewey thoughts? RT @ablerism: A video game with nothing to see. No, really—nothing. http://t.co/7acTSSLLoW They don't make (m)any movies like Armageddon these days (not sequels/reboots/film versions of books, epic, all-star cast). Crossroads part 1 & 2 (Battlestar Galactica episodes) - so good, it's just unfair. RT @DALupton: My article on the sociocultural dimensions of quantified self now out http://t.co/14US3fvth0 @mark_carrigan @chrishtill @webo… Anyone read Huxley's Island? Utopian counterpart to dystopian Brave New World. Surprised I didn't hear of it earlier...is it any good? "Overall, I suspect that there is not as much cultural dependency concerning Japanese ppl's attitudes towards robots as is often argued"Ibid "I will argue for using ethically intelligent robots to protect the autonomy and dignity of humans" -Towards Robots with Good Will, Nishida Can someone read "Ghost in the Quantum Turing Machine" by Scott Aaronson and send me a brain implant containing knowledge of it? Thx Excellent talk by @danieldewey - "The Long-Term Future of AI (and what we can do about it)" http://t.co/cI1OPfcUwV RT @danieldewey: My #tedxvienna talk is online! Intelligence Explosion and the Future of AI: https://t.co/bz5Vy6yjNn http://t.co/buuw4OS38v From "How Many American Men Are Gay?" http://t.co/ZN7lzVUmqm "In a perfectly tolerant world, my model estimates that about 5 percent of men in the United States would say they were interested in men." @smakelainen @sydnets Volume 1 Issue 1 should be published in March, you'll be able to get it here http://t.co/U5HLsbFSTY Just ordered a book for four dollars flat on Amazon. Shipping included. Four. Dollars. Flat. BUY USED when using Amazon. Seriously. Do it. Maybe I should use my tweets as data mining input (LDA? On my mind bc last class project) to suggest topics for my dissertation? #mindblown Still, I'm not sure if I want to dive in without watching the 60's show/reading the comics... :/ #astroboy nerds plz HALP Please tell me the 2003 #astroboy series is canonical...cuz it's on Netflix! :) Wikipedia makes it sound official - by the creator's company What is in the #astroboy canon? If that concept is straightforwardly applicable here. I suspect the Nicholas Cage-voiced movie is out. :) Ex. there's stuff on cultural influences on attitudes re: bots in Japan, lots of US military related stuff, but not much explicit comparison Do any papers characterize/explain differences in #AI/#robotics goals/funding/culture across nations? I've seen stuff tangentially related.. "[T]here are several opportunities for more sophisticated automated planning in effectively steering crowdsourced planning." Some fellow ASU folks on #humancomputation - Herding the Crowd: Automated Planning for Crowdsourced Planning http://t.co/bpVWOrKsmJ What should I think/know about #humancomputation? Reading recommendations welcome! I've only read a few papers... In case you missed it - CFP for the Journal of Responsible Innovation! http://t.co/5cs9O5JLJs We accept several types of submissions. No spoilers, but the first issue of the Journal of Responsible Innovation will be very informative and provocative. :) "On the Anticipation of Ethical Conflicts between Humans and Robots in Japanese Mangas," Stefan Krebs: http://t.co/EWrlExNCBC Enjoying the paper "Towards Robots With Good Will" by Nishida in Ethics and Robotics (2009). Visiting Nishida lab and others soon! "a general education emphasis facilitates students’ ... interest in the professional–ethical responsibilities and the consequences of tech" "students’ sense for whether their programs emphasize engagement related factors has a direct effect on their public welfare beliefs." Of course the two aren't wholly independent, ex. publication is a means of one type of social impact. But they're not the same. AND not demanding enough (w.r.t. social impact/relevance/openness etc.). You get what you incentivize. Whole system is sub-optimal. 2/2 On the Higgs not being productive enough thing...IMO incentive structures facing academia are at once too demanding (re. publishing) 1/2 RT @TonyBelpaeme: Peter Higgs: I wouldn't be productive enough for today's academic system http://t.co/rUzNfBCsZE Data in the study comes from four different schools, some with emphasis on public welfare considerations. Findings consistent across schools Correction: the paper I'm tweeting is in Science, Technology, and Human Values...http://t.co/bHx9Q5Jubj thx @jathansadowski @jathansadowski ah, thanks, my bad! Very interesting read, live-(?) tweet-reading it now ;) "The culture of disengagement has three underlying ideological pillars: depoliticization, the technical/social dualism, and meritocracy." "disengagement may mean that things like public welfare considerations get defined out of engineering problems." Interesting...thanks! "Culture of Disengagement in Engineering Education?" Provocative paper by Erin Cech in Social Studies of Science http://t.co/bHx9Q5Jubj @lindseybieda I liked an earlier version of this http://t.co/iyVNWjL6XV but Codecademy didn't exist yet, dunno how much value books add now. RT @gigaom: Why Cognition-as-a-Service is the next operating system battlefield http://t.co/3XF1wwVinh "RT @j2bryson: I teach #1 with IP in 1st yr programming RT @hugospiers Top20things scientists need to know about policy by @cptyler http://…" @BirchCelloWren I liked Tilly's book Social Movements... #scifi tweeps...how urgent is it for me to read Dune? By which I mean, can I call it research? :) I know AI is kinda part of the backstory.. RT @robotenomics: Very good summary by @j2bryson. #AI and industrial technology are not really the problem. The problem is political. htt… What would education be like in a society where automation made labor (and therefore "practical" education) unnecessary for a good life? Even that cluster could contain a multitude of possible theses, but it's a whole lot narrower than the whole list :-) Can't wait for "Philosophy and the Problems of Work: A Reader" to arrive! On list of possible thesis topics, AI/jobs/ethics/policy is high. This report has shown ...that self-replicating lunar factories do in fact appear to be feasible."http://t.co/Wbfh0WLh0R The moon has some water in the form of ice, but only about one two billionth as much as Earth. (How Stuff Works, Wikipedia, my calculations) Just another example of the vast multi-dimensional space of possible future relationships we can have with AI/robots. One interesting thing about Player Piano is that (almost?) all the bots in it are immobile. Except maybe driverless cars, it's sorta vague. Still haven't heard back on my Caprica & Philosophy proposal. :-/ Either way, looks like I'll be on a panel on related issues in January... @girishsastry see my last few tweets on Aaronson FYI...I think this paper builds on his book you recommended which I plan to get soon... 1 comment, though. His POV in this paper seems to be more sympathetic to Singularity stuff than in his Bloggingheads debate with Yudkowsky. There's way too much in Scott Aaronson's "The Ghost in the Quantum Turing Machine" (source of my last tweet) to summarize here..check it out "[The Singulatarians are scientific conservatives, while those who reject their vision as fantasy are ... radicals." http://t.co/ugHYbFgSRM I just read about the "human biodiversity" thing for the first time. Ugh... *as opposed, I mean, to the world we currently live in (and which is the default going forward) where AI is a black box to almost everyone. What would (will?) society and the economy look like if (when?) AI and robotics are as easy to develop for a specific purpose as a website? Anyone tips on Japanese robot-related media I should consume before going there soon? Astroboy? Don't even know where to begin with that. @mgubrud even if AI develops slowly, we don't have best track record of slow tech governance anyway. Poverty etc despite tech/econ progress @danieldewey not sure. May be different 4 each. In Russell's case, his point is scientists should be responsible (though vague on details). I have heard at least 3 #AI people compare their field/their role in assessing its social implications to Manhattan proj. scientists. Hmm... PROTIP: buy used rather than new books on Amazon. It's that simple. Not sure what to think about the latest news on Google's acquisition of robotics companies. Crowdsourcing my dissertation topic....tell me what it should be about! Related to AI/responsible innovation/economy/ethics. 3, 2, 1, go!!!! It's slightly misleading to call Player Piano prophetic bc too soon to say how AI/robotics will play out but foresaw contours of risk/debate What's most prophetic book w.r.t. sci./tech/society taking into acct accuracy & time elapsed? Reading Paris in 20th Century (Verne) soon.... RT @mcclure111: Men statistically have larger brains than women, which is why men are usually smarter and elephants rule us all from their … Perlstein grad union piece..anyone else notice the anti-union's prof's math made no sense? = student making $240k/year LOL. Try <10% of that The case for and against geoengineering - debate at Oxford: http://t.co/XzERanDF3n RT @squartadoc: How to read a scientific paper.... brilliant http://t.co/W9LciQXads RT @BarackObama: Retweet if you agree: "Rising inequality and declining mobility are bad for our democracy." —President Obama #ABetterBarga… RT @nickiclyne: cool article, i'd been wondering the same thing! -- “What do comic book writers do?” by @jnyemb https://t.co/RQ37lxCMIB Awesome post by @hopejahren - How I Cured My Impostor Syndrome http://t.co/iFcjtmUcGr Salacious Crumb will always be the star of Return of the Jedi in my heart. RT @brainpicker: “Do not fear to be eccentric in opinion, for every opinion now accepted was once eccentric.”Bertrand Russell classic: http… RT @jgcarpenter: Cyborg rights. http://t.co/ksuXxKecXq #cyborg #ethics #robots #policy #eyeborg I wish textbooks as good as AI: A Modern Approach (3rd edition, at least) were available for all fields...it's just sooooooo good. TL;DR of reactions to Amazon announcement: LOL, it will be a while though RT @jilevin: #NYT: Rights Group Sues to Have Chimp Recognized as Legal Person http://t.co/NqcNSQY8no #p2 #topprog @mims http://t.co/iIkxsvJM1a Hey Amazon, in case you forgot, Friedrich Schmiedl beat you to it. Kind of. http://t.co/iIkxsvJM1a "This drone thing sounds great! I'd worry about my job but surely Amazon will compensate me fairly if I'm laid off" said no delivery person RT @BotJunkie: On Automaton: Amazon Promises Package Delivery By Drone: Is It for Real? http://t.co/nrKWWm63lZ #robotics Better yet just reform welfare altogether w/ guaranteed basic income, but Obamacare suggests Congress can't enact simple, coherent policies. Prob = automation/downsizing args are kinda true- so just don't ONLY change min. wage. Also have wage subsidies or equiv. 2 offset (2/2) Fast food workers making $15/hour sounds fair. So does grad students making $15/hour - that'd be a big improvement. How abt everyone? (1/2) The 35 Best Times Someone On Facebook Thought ‘The Onion’ Was Real | Thought Catalog http://t.co/3mnJz8mvxk via @thoughtcatalog RT @jathansadowski: "40% of fast food workers are 25 or older; 31% at least attempted college; more than 26% are parents raising childrn" h… Lando's not a system, he's a man. Apology accepted, Captain Needa. RT @drunkenpredator: Goddamn hippies. RT @AmazonDrone: Deliver books, not bombs. #AmazonDrone4Lyfe Even though I have all of Star Wars on Blu Ray, I still have to drop everything and watch Ep. V now that I see it's on TV. So much to read.. For a minute I was all, why is @CNN airing a documentary called "To Heaven and Back"? Then I remembered most people are religious. <_< Angry Beavers's series of tubes >> Amazon drones. RT @nitashatiku: "INTRIGUED AT THE THOUGHT OF AMAZON DRONES LANDING AT YOUR DOORSTEP" get it together, Charlie RT @mark_riedl: The question should not be whether computers can create. They can. The question should be: what can we learn about computat… RT @ProfJeffJarvis: What we're seeing in Ukraine is, above all, the first big test for post-IPO Twitter. @henrikkarlstrom yep. The headline in my last tweet makes me sad. No support for it in the article other than "this made me think of 'sentient code'" :-/ "Sentient code: An inside look at Stephen Wolfram's utterly new, insanely ambitious computational paradigm" http://t.co/Cc2eFpDFkf Kurzweil should read "Death & The Afterlife" @Slate: Ray Kurzweil believes he has an 80% chance of living forever: http://t.co/r8cQGIGpw7 RT @hypatiadotca: Before her famous bus ride, Rosa Parks was an anti-rape activist. @dmcguire13 wrote a rad book about her (& others): http… RT @tim_brannigan: 58 years ago, Rosa Parks tweeted about having to sit at the Back of the Bus. Oh no, wait! She did something about it! ht… RT @DA_Banks: LOLOLOLOL RT @GOP: Previous tweet should have read "Today we remember Rosa Parks' bold stand and her role in fighting to end … RT @ProfJeffJarvis: Will be interesting in Hunger Games 3.0: how will Catniss Everdeen use her hugely higher Klout score? RT @ProfJeffJarvis: Overall Hunger Games 2.0 was good. Definitely worth 0.02 Bitcoins. @mattthomas it's solid @MargaretAtwood's MaddAddam is so good. Also, finished Death & The Afterlife. Def recommended if you don't know much abt philosophy of death @mattthomas /not know anything about the whole premature/accidental death is bad thing RT @grist: Just look at these rescued baby cyborg seals http://t.co/xvXG1k9LBY Paul Walker was great in The Skulls. #RIPPaulWalker RT @annegalloway: “World meat production has tripled since 1980 - humans today kill 56 billion animals per year for food (not including aqu… RT @red3blog: If your response to people mourning someone's death is to scold and belittle them, nothing justifies that. You are just an as… Cue everyone suddenly caring about football in 3, 2, 1... RT @ReinH: Apparently something important happened in today's sportsball game. In philosophy papers: "X (target paper/book author) may agree with this arg./we may not actually disagree"...can't u talk THEN write paper? RT @ReinH: Thanks to Joyent for writing this http://t.co/iLUriq4HMB, but its necessity is a further reminder of how far we are from gender … RT @ashedryden: All of your dreams and wishes and questions will be answered with this one weird trick: read. RT @grok_: The problem with drones? They look like drones. "The Army has a solution to this problem: make them look like birds." http://t.c… RT @Liberationtech: Letting security-guard robots do routine tasks allows humans to focus on strategic work, K5 creator @WSantanaLi says ht… Transhumanists sound more like Cavil et al. in Cylon civil war. Be, experience, learn all that you can as long as you can. Limits are bad. Scheffler's views on philosophy of ethics sound like Caprica 6 et al in Cylon civil war. Inevitability of death and legacy give life value. Idea for success next semester: don't overcommit in all domains (just some). So crazy it just might work! Soooooo much reading/work/general stuff to catch up on after Thxgiving. Fortunately some of it is interesting :) Condensed quote from Scheffler in Death & The Afterlife (p.72). Collective afterlife in his sense just means world/ppl exist after u die 1/2 Our blf in collective afterlife is, to a greater extent than blf in a personal one, condition of other thing mattering to us here + now 1/2 (Cont'd) I have my own list but I wouldn't assign it much value. #AI tweeps: which sci-fi films/shows/books etc. do you think are most* plausible w.r.t. the future of AI and its social impacts? (*key word) Legal weed in Seattle seems to have had these extreme implications for the moral fiber of society: you occasionally smell weed. Full stop. Scheffler - people existing after our death makes stuff valuable to us while we live. So does the fact that we will eventually die. Death & The Afterlife by Scheffler = interesting read. "Afterlife" in secular sense of ppl/civ. continuing after u, making life valuable now RT @nickiclyne: black friday... because all that food didn't fill the empty void, let's try shopping!!! Silicon Valley Isn't a Meritocracy. And It's Dangerous to Hero-Worship Entrepreneurs | Wired Opinion http://t.co/O6BGafbtQL RT @DonnieClapp: It's really disturbing how anti-social all this new technology is making us. http://t.co/yTy35etCVA RT @tylercowen: The "tumours in rats" anti-GMO paper has been retracted, http://t.co/5k68ghEasW RT @FemWho: If you're worried about the NSA using your usage of the sex industry against you, maybe think about helping to destigmatize the… Chilling in a blanket, no big deal. http://t.co/N96Ae4zXI3 RT @CuteEmergency: Two sloths cuddling. http://t.co/3tCA9Huhc2 RT @DoctorChristian: Regulating e-cigs as tightly as Europe would like will stub out any last chance of making an easy healthier choice for… Not sure why the cops don't just send in waves of hundreds of MXs in hostage situations instead of humans. They obv don't value MXs' lives. "Boring conversation anyway" Star Wars reference on @AlmostHumanFOX Windows hasn't changed in any significant way in a decade and still doesn't have the kind of customer service ecosystem Apple has. Huge diff To any Mac users who occasionally have the crazy idea of going back to Windows to save $: don't, I tried and immediately regretted. Awful Fascinating seeing adults with their kids in person or on the phone at the Apple Store helping them navigate tech issues. "Human + machine w/ good interface beats best human and best machine at chess" rapidly becoming cliche in stuff I read. New examples please. RT @markoff: http://t.co/IBdZv3lRKR. What could possibly go wrong? I see that the book I mentioned yesterday (Big Brain) is controversial according to Wikipedia. Someone tell me what to think about Boskops? RT @RobotDiva: #BlabDroid aims to sell friendly robot assistant made of cardboard in 2014 http://t.co/UFGSvrus5H Got The Exegesis of Philip K. Dick - his posthumously-edited manifesto on life, the universe, and everything. If I go nuts soon, that's why. Why are they making a movie version of The Stand? The mini-series was great (albeit quite mid-90s-y now) and can't be compressed much more.. I suspect everyone knows this but *just in case*, you can Google the title of an NYT article then click on the result to avoid loggging in. Reviewing a book draft for someone I barely know on a topic semi related to my research when I have more urgent obligations. #saturdaynight That book is good complement to Making of the Mind by Kellogg. Kellogg = psych, this one = neuro but same basic Q - origin of human intel. Enjoying Big Brain: The Origins and Future of Human Intelligence by Lynch/Granger. Skipping stuff I don't care about, but overall very cool. The older I get, the less guilty I feel about skipping large, boring chunks of books in order to read more stuff overall. Watched "Delete" on Netflix. Cheesy premise (emergent AI on net) but somewhat entertaining apocalyptic sci-fi. Seth Green. Some Caprica ppl RT @JustinWolfers: The Ayn Rand Institute just emailed me to offer free Rand books for my students. Apparently the market price is wrong & … RT @Mike_FTW: SATURDAY BABY GOAT ALERT!! http://t.co/1HS3MG15Cp Why did CNN decide everyone needs to know a ton about Atlanta's airport, over, say, the news? OK, done with Greene's book finally so I'm done live-tweeting it. Definitely recommend it, though. http://t.co/DNpvVtgs8A "I'd rather be a human who knows he's a hypocrite + tries to be less so than who mistakes his species-typical limits 4 ideal values" Greene The glitchiness of the Daily Show and Colbert Report sites' video playback is one of the great #firstworldproblems of our age Take back what I said about Moral Tribes not dealing w metaethics - it does (+ more in footnotes). Recommended both 4 psych and ethics stuff ...thus, if you're looking to evo. for moral truth, you're barking up wrong tree." - Greene in Moral Tribes. Nagel seems to have missed this "Evolution might favor ppl who are nice to neighbors, or people w genocidal tendencies for same underlying reason [gene propagation] 1/2 Why This Shepherd Loves Twitter - Herdy Shepherd - The Atlantic http://t.co/b2SACtgS9j Matternet Ted talk: http://t.co/dCmcT5S6vR Pushing all my buttons... This title was clearly written for the sole purpose of getting me to read it: "Technologies, culture, work, basic income and maximum income" I also dig stuff that is explicitly geared towards smooth interaction with humans and that seems to be a big fraction of Japanese stuff. I'm perhaps biased since I'm going there next month but it seems like there's way cooler AI stuff going on per capita in Japan than the US.. Can someone please give me a brain implant with annotated/interconnected copies of everything I want to read and should read? kthx "Towards Combining Autonomy and Interactivity for Social Robots" - Yasser Mohammad and Toyoaki Nishida. http://t.co/TsDZFIXkgZ The singularity, ruined by lawyers - kinda old now but (I think) still funny video http://t.co/HZrf5fvNQJ Japan trip shaping up - 3 AI/robotics lab visits planned plus conference/general touristy stuff. Advice still welcome! (Osaka/Kyoto mid-Dec) Great talk - Henry Evans and Chad Jenkins: Meet the robots for humanity http://t.co/MdTY4Anvaz #TED "A Big Data Approach to Computational Creativity" - Varshney et al. (IBMers), interesting. Human-machine collaboration on recipe development Fairly detailed vision of human/AI/bot symbiosis w/ surrogate systems operating on ppl's behalf, cultivating human empathy, etc. (2/2) Toyoaki Nishida's "Towards mutual dependency between empathy and technology" is an interesting read as are some of his other papers. 1/2 RT @j2bryson: @Miles_Brundage @alan_winfield @sabinehauert Pets have evolved–we can’t hack them to make them NOT moral patients. Robots we … @VincentCMueller /intended to incite violence which (I hope?) I clearly don't want...people (inc. Zimmerman) should not murder/beat up any1 @VincentCMueller my understanding of hate speech is it's based on their race/gender/etc. not their actual behavior as in this case? Unranked models of transition to Star Trek econ: ++basic income as tech evolves; ++earlier retirement; ++publicly guaranteed good/services RT @TheAngryDM: This new Captcha is hardcore: "Verify You Are a Human: Harm a fellow human or, through inaction, allow a fellow human to co… @VincentCMueller IMO chasing/killing unarmed kid when 911 dispatcher says stop, beating women b4/after, earns him a solid shithead status When it comes to cancelled sci-fi shows, I sometimes hear about Firefly, Caprica, but not Terra Nova. Terra Nova is great, see @netflix @JackLScanlan gotcha @JackLScanlan i have very little familiarity w/ the lit. but also interested and somewhat related to my work, any reading recommendations? Zimmerman has obv. gotten good legal advice. No sign he has gotten not-being-a-shithead/murderer advice. Sign of the times? #facepalm Negative scenarios important to consider, but need to think about both sides to identify risks, affordances, uncertainties, key actors, etc. Need to think more about positive scenarios 4 AI/robotics. Safe, prosperous, + just transition to Star Trek economy over decades/centuries. RT @CuteEmergency: Baby fox getting tickled http://t.co/qgbnaDVSOl RT @grapealope: What are the next applications of virtual reality? Audience member: Follow the pornography. #omplustech The Einstein/Curie/@jtotheizzoe thing....*sigh*. Wtf... RT @dynamicsymmetry: student response paper mentions Oryx and Crake completely out of the blue instant A @SuzanneWaldman Yup. RT @AcademicsSay: Trust me. It's a word. @SuzanneWaldman I'm not as worried about ppl understanding tech X so much as that ppl made it, taxes funded R+D, ppl/tech shape each other.. RT @SuzanneWaldman: .@cherylrofer @ThylacineReport I'm not as worried about people understanding good science as about their ability to see… Did you know Richard Bellman of "Bellman equation" fame wrote a book on "Can Computers Think?"? I didn't. Stumbled on at library. *where "solve Us vs. Them problems" means intergroup cooperation, empathy, dealing w/ conflicting moral systems. We know how to beat Them up Tweet version of Joshua Greene's book: we evolved to solve Me vs. Us probs, not Us vs. Them. Let's be aware of biases in order to overcome. Lots of ways in which humans are systematically selfish/groupish etc. and bots could improve on but will take long time/may not have qualia Can bots *eventually* act more ethically than us? Yea in theory/on avg., but hard part=common sense, lang., social intel...then fix our bugs RT @Slate: The new J.J. Abrams Fox show explores the idea that robot souls could become more sensitive than ours: http://t.co/L23ul9Be2H For real, though, good article on @AlmostHumanFOX /what it means to be human. Re: last RT..."Can intuition be programmed?" See: DNA. Almost Human Asks Whether Machines Can Teach People to Feel http://t.co/miwmGKOMPL via @slate @GrandpaRobot @alan_winfield @sabinehauert what about em? @GrandpaRobot @alan_winfield @sabinehauert my dog doesn't get along w other dogs => my responsibility to avoid them getting too close @alan_winfield @GrandpaRobot @sabinehauert owners don't get in trouble for dog doing nothing, bots could be seen as "negligent" in some role @alan_winfield @GrandpaRobot @sabinehauert agree pet = good general model (semi-auton., owner responsible), one other twist is inaction(1/2) @GrandpaRobot @grok_ and I tend to agree at least for foreseeable future but over indefinite future, less sure, esp. re *2nd-order* rts... @GrandpaRobot @grok_ "While it is not the goal of this Article to make a normative argument for or against extending rights to robots" @GrandpaRobot @grok_ paper's purpose is not to argue they should def. be extended but explore issues from various angles. Recommend reading Re: last RT, also see @grok_'s paper, "Extending Legal Rights to Social Robots" http://t.co/sfbdqizQM9 RT @grok_: The live-blogs of my @berkmancenter talk by @EthanZ & @mstem are here http://t.co/S2GQyO7sOn and here http://t.co/fKmywY4BqD (re… @Ahaverine Good luck on your thesis, and let me know how you like it if/when you watch it :) @Ahaverine Yes it's on Netflix! Def. recommended. Wasn't as popular but I like that it's > near-term. Lots of digital life after death stuff @Ahaverine BTW just looked at your page - I assume you've watched Caprica? "Grace by Graystone" :) I pitched Caprica and Philosophy recently @Ahaverine Yup! Dolphins are v. smart. I'm overgeneralizing for sure. I am also reminded daily of how my dog is smarter than robots :) RT @HardSciFiMovies: A scientist is able to harness a vast, highly stable fusion reactor to power her computing device. It is a solar-power… RT @mattthomas: Stallone is the only man alive who’s had a No. 1 box-office hit in each of 5 consecutive decades. http://t.co/i9NPWQiun8 How The Star Trek Economy Works http://t.co/QeBUPCMUD0 via @slate @mattyglesias He compared himself to Kuwait. Dude's got issuesRT @motherboard: Is Rob Ford addicted to power? We asked the experts: http://t.co/VyxWQiUlwA @Ahaverine maybe know in sense of "are submissive to owner" ex. dogs but smart sentient bots know things could be otherwise @Ahaverine ya but in some ways worse - pets arguably are slaves but don't *know that* they're slaves, robots on show know n suffer bc of it Dear scammers: responding instantaneously with long generic emails isn't realistic. Everyone: Craigslist has gotten a lot more scammy @AlmostHumanFOX is a very different show depending on whether one assumes the robots have qualia or not. "Um, my girlfriend has, um, for lack of a better word, gone crazy on me." - George Zimmerman. ughhhh So basically, on @AlmostHumanFOX, robots have emotions, and we treat them like crap and they know it, and they suffer as a result. #fail RT @GeorgeTakei: It was as if a million scifi fans cried out in terror... http://t.co/CLaNilypZF @AlmostHumanFOX is basically what would happen if no one listened to robot ethics ppl about anything. #robotsandyou RT @interfluidity: Economic policy debates increasingly strike me as arguments over whether diet or exercise are best in treating an open w… RT @NewAmerica: This Doctor Wants to Create A Non–Addictive Alternative to Alcohol - http://t.co/pQB0Zsdse9 @anya1anya via @FastCompany RT @CuteEmergency: This is a baby owl! http://t.co/k2vNqLXaD7 RT @AstroKatie: Things that criticism on Twitter is not: lynching, crucifixion, witch-hunt, mobbing… @diannaeanderson @danileekelley been in that situation...he may know and not want to bring it up. Longer it goes on, weirder to bring it up Think one of the prison sets from Continuum is the same as one of the police station sets in Almost Human. #almosthuman Interesting that in sci-fi, robots often programmed to be utilitarians, humans object and audience led to dislike. #technocracy #AlmostHuman Like I, Robot movie, utilitarians have succeeded in getting their views reflected in androids' code on @AlmostHumanFOX. #AlmostHuman Lots of machine ethics-driven behavior in androids on @AlmostHumanFOX. Mostly law-based, adherence to org. (in this case, police) policies. Dorian appears to suffer from bullying, rudeness, etc. Unclear what scientific/social views in #almosthuman are re: robot qualia "Synthetic" - Dorian: "I'm not a huge fan of that term." Made to be able to suffer, act human, etc. @j2bryson'a dystopia? ;) #AlmostHuman RT @grok_: "Call me John." Human-robot bonding! Someone alert Sherry Turkle! #AlmostHuman @AlmostHumanFOX, Caprica, Continuum, etc. all filmed in Vancouver. #almosthuman @AlmostHumanFOX @grok_ argh time zone difference, jealous. Have to wait 40 mins. #firstworldproblems I love how on Sliders, they almost always escape at literally the last second. And how every episode has the same basic structure. Nostalgic @martpalau likewise! @j2blather True @j2blather I liked Bringsjord's summary of Freud at PT-AI this year - "unsystematic and wrong about everything." lol @ashedryden Kevin Warwick - http://t.co/lG2IeizCwN @jathansadowski yep that is what happens on @ContinuumSeries @danieldewey Robopocalypse perhaps one of few to depict. Repeated controlled intelligence explosions, escape from Faraday cage, aftermath. To reiterate re "Google's comps outwit ppl" story i keep seeing, = ~ point of machine learning, don't know how/want to code 4 X prob by hand @j2bryson lol nice. @j2bryson @EUCogNetwork wish I had been there! @j2bryson hard for me to evaluate objectively though as I've long agreed w/ Greene's anti-realist meta-ethics & utilitarian normative ethics @j2bryson you might find Moral Tribes by Joshua Greene interesting. Lots on cooperation, moral/social psych., evolution... Hope to finish Moral Tribes tomorrow. Great stuff on moral psych, utilitarianism, etc. If Internet didn't exist I'd have finished already... @danieldewey which isn't to say Terminator TV show is especially valuable, just an observation. @danieldewey can only think of 1 film/TV show depicting intel. explo. - Terminator show. I, Robot, T3, BSG = after, Caprica, T2 before...? RT @alan_winfield: Should we fear AI? Just found this: Owen Holland, Illah Nourbakhsh, Kevin Warwick & me, debating at Imperial College htt… @j2bryson @RonChrisley IMO a ( philosophical) zombie can be "agent" but not patient. But not sure if phil zombies possible/if robots will be Seems like accessible interfaces, industry/OSS dynamics, edu. critical for egalitarian impacts of AI. Otherwise just reinforce inequalities. Today: basic AI used by everyone, better AI used by researchers. Future: better AI used by everyone, much better AI used by researchers. Meta-level lessons of my first two AI classes: 1. It's hard. 2. Programming is hard. 3. AI, humans will be different for foreseeable future. RT @CuteEmergency: I want him. Now. http://t.co/7kjczvfjJQ @jathansadowski @mattthomas 2. accessible-ish...often trade-offs btwn the 2, don't want to get stuck in local maxima of overly narrow stuff @jathansadowski @mattthomas I think of optimal reading as kinda like http://t.co/x6u6ZHWhIM [#nerdalert] in that seems both 1. important and @jathansadowski @mattthomas yup! My heuristic is to try not to read anything I know a lot about already or think I will probably agree with. I'm brushing up on some robot ethics in case I choose to write a blog post on @AlmostHumanFOX which is premiering tomorrow, involves bots. Prescott one @EUCogNetwork also v. good esp. if you aren't familiar with science and technology studies, #scipolicy history ..1 of which is mine ;) but I'd especially rec. the 4 new ones @FHIOxford Bains/Winfield @EUCogNetwork don't know if @j2bryson was recorded? ICYMI lots of good AI-related videos @FHIOxford http://t.co/3uZvn8BGPM and @EUCogNetwork http://t.co/LVQrPWGABE @jathansadowski needs moar late Witrgenstein Good, ethanol is dumb, never made any sense MT @techreview EPA has lowered the amount of ethanol required in fuel. http://t.co/64B5WoGbyE Machine learning is for stuff we can't easily write full program for, so not surprising that ppl "don't understand" how exactly it works. trending piece on Google AI... :-/ "ppl don't understand how works" - on 1 level, that's point of machine learning (can't manually specify) @alan_winfield @ShaunGamboa @robotonomics also - "Mary Poppins 3000" etc - by Walker. Not sure what I think - depends on sentience issues. For real, though, look at Colossus, Terminator X, TNG, and I, Robot.. Almost universally, difference is human governance, not nature of AI. Deliberately provocative and maybe wrong hypothesis: harm of AI in X story and AI ppl's claim X story is unrealistic are directly related. People often say "AI not dangerous bc dumber than humans" AND "AI is dumber than humans, let's fix" in same breath. It's complicated. (2/2) To be clear about prev. rant: I'm not convinced any of those/intel. explosion is plausible. BUT I think it is important to note that (1/2) Also, Colossus isn't very different from I, Robot. Plot difference btwn these three movies is really abt. initial values, not nature of AI. In both cases, AI gets smarter fast, gets in position of power, acts on some values. SkyNet - self-preservation, Colossus - machine ethics.. I've heard 5+ AI people say Colossus: The Forbin Project is a realistic AI movie, Terminator isn't. Not sure I totally understand this.....? @jathansadowski ironically, I used to manage someone else's sched. (well, I think!), but I am more ambitious, unrealistic, etc. about mine. @jathansadowski lol that's the same publisher I proposed the Caprica thing to. And I don't have free time, I just commit to things #gradlyfe Writing a brief proposal for a @CapricaTV and Philosophy book. Caprica more near-term focused, socially relevant than BSG. Stay tuned :-) PROTIP: if engaging in a @PayPal transaction with someone you don't know, don't accept emails at face value - they may be fake. Check site. Almost got scammed (involving Craigslist, PayPal, tracking numbers...). Thank you Google/people who comment in forums for saving me! RT @HardSciFiMovies: A super-spy disguises himself with a latex mask of his foe. The disguise fails, because he is much shorter than his fo… RT @grok_: Robot deer catch illegal hunters who shoot at them: http://t.co/dZFyVFDZl8 @GrandpaRobot cool, where specifically? Plans for my Japan trip are shaping up. Probably won't come home with a robot, but I think I'll get a lot out of it. Lots of lab visits. Wish I could bring back an awesome robot from Japan next month but that would require money :( Great that a thousand protesters showed up to support #solar @ Arizona Corporation Commission mtg http://t.co/PIZtGzRE9v @apsFYI @GrandpaRobot @j2bryson all that being said I think it is great ur willing to take respo. I fear some corps won't so need pub debate/laws @GrandpaRobot @j2bryson and what if trade off btwn sales and design, bc ppl want selfish(but still safer) cars? Public should have some say? @GrandpaRobot @j2bryson I suppose one could say u shouldn't make such a car w user preference but what if it saves lives? Tricky Q IMO @GrandpaRobot @j2bryson has some influence over system, ex makes choice that it protects user > others in case of crash. Who to blame? @GrandpaRobot @j2bryson human but still gets in crashes. How to give u credit for lives saved but not send u to jail for 1 death? 2. User @GrandpaRobot @j2bryson think that's prob good rule of thumb but consider these complicating factors - 1. U develop car probably safer than @GrandpaRobot @j2bryson Right. My point is just that ppl may eventually want to put blame on bot, may make similar legal args @GrandpaRobot @j2bryson Yep. see also paper by Kuipers on corps as super intelligences. Need to learn from history of corp "personhood" law @GrandpaRobot @j2bryson Yeah but true of pets, children, other complex tech...someone needs to be responsible. If too complex then don't use @j2bryson True. The whole "if it works it is no longer considered AI" effect contributed to that. AI progressively being normalized "I thought it set up automatic donations to charity from Technology" #wwis. Ok I'll try to stop LOL "Can Congress reach a consensus on Blu Ray all" #wwis "The BP oil spill is the 1850s, and concludes we can deal with climate change" #wwis "but the media's discussion of you are underfunded by THOUSANDS of peerreviewed studies in AI" #wwis "i'm on the importance of storing electricity." [yup!] "Dear journalists please let me know!" "Can Congress reach a 50 dollar prize." #wwis Some #wwis generated statuses based on my FB data - "Last chance to get in the Super duper expensive ones as opposed to dystopian stuff." @robotonomics @alan_winfield yes, though resp. not evenly distributed. Policy makers, educators, ppl w public influence should be esp attune The more I learn abt AI/robotics, the less I think fundamental insights needed 4 big social impact. So much could be done w current ideas. @robotonomics @alan_winfield agreed (I think) but what specifically do u mean? Over arbitrarily long term I hope we end up w/ Star Trek econ @robotonomics @alan_winfield not super familiar w/ current models. Key issue I think is making sure > productivity leads to > avg. income. RT @tylercowen: My Politico piece on Isaac Asimov and the ideologies of the future, http://t.co/vWEKWaFUIC @alan_winfield @robotonomics IMO depends on details- capitalism w widely distributed stakes in capital or high guaranteed income > socialism @alan_winfield "It may be that machines will do work that makes life poss., humans will do things that make life pleasant/worthwhile"-Asimov I'm not afraid of robots making kill (/save?) decision so much as ppl being unaccountable. Someone should understand code, take blame/praise RT @CuteEmergency: happiest lamb ever http://t.co/72GY82lZl8 #AI/#robotics/#robotsandyou also, Caprica. IMO, more grounded in near-term than Battlestar Galactica. Maybe not as good but more important. ppl interested in #AI/#robotics/#robotsandyou should read Player Piano. Also, watch Star Trek: TNG. We could end up in v. diff. situations. RT @ArtificialOther: Future of Employment: How Susceptible are Jobs to Computerisation (Oxford U. Working Paper) http://t.co/TRX5Q7oJeJ #au… RT @lindseybieda: Also, lol at GTA5 claiming the same thing and ALSO failing to do the satire part. RT @Sonalcpatel: IEA: #Energy CO2 emissions to still rise 20% by 2035 despite number of #climate initiatives announced to date. #WEO http:/… I prob. said this already but Autonomous Technology by Winner is a great book. Makes me sad that my dissertation prob. won't be as epic. New @msnbc site much more self-consciously partisan than old one. Not complaining, just pointing out. = more significant than the design... I'll be in Osaka and Kyoto in one month. What should I try to find out about #AI/#robotics/#robotsandyou in US vs. Japan while I'm there? RT @CuteEmergency: oh so lazy http://t.co/qLRdbhMDm2 Submitted a proposal for a session on #AI/#robotics at http://t.co/hWpNtgFTYL #robotsandyou #SciPolicy Will let you know if it's accepted! RT @EvanSelinger: "Our things will contain tiny salespeople with a fortitude & patience born of intense corporate resources." - @rcalo http… RT @delrayser: So now we're calling racists "people with conventional views"? RT @samsteinhp: oh come on… http://t.co/SlALofch6W http://t.c… @j2bryson @cendeathsociety think you posted a link to an academic paper, I found out I didn't have an institutional subscription, gave up :/ RT @CuteEmergency: that's a happy little pup. http://t.co/ZxNDRRJJfq @j2bryson @cendeathsociety I think you linked to it one time while live tweeting a conference, don't remember the details. RT @CuteEmergency: snuggling inthe grass. http://t.co/FDRPGspiCx @j2bryson ICYMI the show Caprica deals w/ avatars based on people's digital footprints as ~life after death, believe you've written on that? For those who haven't been subjected to this rant: BSG > Caprica in some ways but in terms of near future social relevance, Caprica >> BSG. There should be a Caprica and Philosophy book. The bar is low (30 Rock, Family Guy!?) and Caprica actually raises interesting Q's. Thoughts? Alternating between episodes of Caprica and AI lectures. Lucky my interests overlap so I can pretend everything is research. :-) #nerdalert RT @phdcomics: A Guide to Academic Relationships: http://t.co/Rkp11POtsg http://t.co/no1e5DVLU5 Why do so many ppl say RTs aren't endorsements in their profiles? Isn't that common knowledge by now? Some high profile incident I missed? "RT @jahendler: ""If the human brain were so simple that we could understand it, we would be so simple that we couldn’t.” Eric Pugh #newFav…" RT @CuteEmergency: best friends stick together. http://t.co/5U6wS77M8j RT @em_underwood: #SfN2013 $40mil #BRAIN will be <1% of NIH neuro investment in 2014. Target: developing and disseminating new tools. RT @CuteEmergency: sup, dog http://t.co/bHUQOkZSOn RT @CuteEmergency: ooh that's gonna be difficult. http://t.co/ztsVokbRfO ppl often mention Asimov and his alleged views of AI/3 laws at AI conferences based just on novels, ignore his interesting/prescient essays I don't get people who ask super long rambling non-questions of speakers at conferences...are they just completely unaware they're doing it? RT @Noahpinion: Anti-vaccination insanity has brought horrific communicable diseases back to California: http://t.co/9W5HuWYfsu Your Smartphone Has Officially Hijacked Your Life http://t.co/FNmsKsJPD3 via @slate ProsperHQ, aka @apsFYI, has crossed the line. Commercial showing a ~6-11 year old girl spouting anti-solar @apsFYI BS? WTF. Shameful. Stop. RT @laurenarankin: Claiming to drive someone to an abortion appt, then driving them somewhere else without their consent is kidnapping. "Pr… RT @laurenarankin: This is HORRIFIC. MT @FundTexasWomen: Just one reminder that getting an abortion in Texas can be very dangerous. http://… Terminator 2, Terminator 3, Iron Man 2, X-Men, Wedding Crashers...all on TV at once. LET ME WORK, CABLE RT @evgenymorozov: What can possibly go wrong if you link your DNA to Facebook? Finding tastier spicy food certainly justifies the risk. Why is @nprnews so horrible on Sunday? Or maybe it is just the local station. Some guy playing guitar and making lame jokes. No news. :( Library > used bookstore > new bookstore RT @CuteEmergency: I told the turtle he could be anything... so he became a dog. http://t.co/2EPVuPfwwb RT @rainnwilson: America: Scott Baio, Bill Cosby & Miss Universe are trending above Typhoon Haiyan. Bad America! Bad! RT @ZoeQuinnzel: Cosmo and Maxim fuse to form Hate Yourself And Everyone You Claim To Love Weekly RT @CuteEmergency: half golden retriever - half husky http://t.co/V4KaKSbZWC Thanks to @EUCogNetwork for the great videos of their conf. on ethical aspects of cognitive. systems. http://t.co/NUYYVAXcEo #robotsandyou @jathansadowski thx! Haven't read yet (behind on a lot bc laptop being repaired) but I agree with what @WillOremus said recently on this. RT @CuteEmergency: That morning stretch that you do... http://t.co/eijT0h5EBv RT @CuteEmergency: baby otter taking milk from the bottle. http://t.co/owKUou8pvT RT @HardSciFiMovies: A man invents an amazing machine that can calculate almost anything, and saves the world from a brutal dictator. He is… RT @katiefehren: Ambri launches its first factory to make liquid metal batteries http://t.co/6GMkfyjC71 RT @jimaley: The Hidden Technology That Makes Twitter Huge: cover story by @ftrain http://t.co/nJc3Ky1lXG via @BW RT @Jezebel: Rand Paul threatens to quit politics in what Maddow calls a "meltdown" http://t.co/xXG7Vo8ZRY RT @RonChrisley: Videos of last week's EUCog meeting on Social & Ethical Aspects of Cognitive Systems now up at http://t.co/IuzrUnLiUy #rob… RT @KateGalbraith: Energy-Efficiency Company Opower Plans IPO http://t.co/V1gbSmJrh1 RT @CuteEmergency: A Zebronkey! http://t.co/q4zTIdqg3s RT @katiefehren: Obama announces nomination candidate for Dir. of DOE's ARPA-E: the Chief Scientist for BP and Prof. at U of Maryland, Elle… ...of Greene's dissertation which is an epic defense of anti-realism. Having read that a while ago prob makes me more open to Moral Tribes. ...deal much w/ metaethics which makes sense - it is for pop. audience - but also maybe weakens case? Nagel, other reviewers seem unaware... Enjoying Greene's book Moral Tribes so far (not surprised- I like his work/have similar views). My sense so far/from reviews is it doesn't.. RT @gigaom: R.I.P Blockbuster: stores and DVD service to end by 2014 http://t.co/wodYiCfIgK @Skype CEO being considered for @Microsoft CEO? That's INSANE. Windows version of Skype recently - Total crap. No noticeable effort to fix. RT @mkonnikova: I now have a word for my affliction. Tsundoku: buying books & not reading them; letting them pile up. More here: http://t.c… @j2bryson IMO no reason they can't act more ethical than humans (eventually) but perfection = imposs for us + them, and respo. is separate Q @j2bryson by "be ethical" do u mean act as if ethical (by, ex. Moral Turing Test standard) or deserve to be considered auton. moral agents? RT @CuteEmergency: Now that's a proud dad. http://t.co/t5q4Bn6d4o RT @CuteEmergency: stop what you're doing and check out this micro-piglet and his strawberry. http://t.co/XGChiwebG9 RT @BarackObama: This is huge: The Illinois House just passed marriage equality. #LoveIsLove ...will act. If we demand max. ethical behavior, will this -> accidents bc low adoption vs. selfish-but-safer cars that ppl are respo. for? Main hesitation w/ paper in last Tweet is about respo., desire for max. ethical behavior by car. Perhaps more imp. is ppl knowing how it... Ethical Decision Making During Automated Vehicle Crashes http://t.co/G3SY4w5XD3 don't agree 100% but good paper on an important issue. @SenRandPaul caught blatantly plagiarizing left and right...vows to provide footnotes upon request? Huh? @danieldewey Indeed! They wrote a whole book hyping it, and a paper about coming up w (vaporware?) "prototypes" to make ppl understand etc. RT @techreview: While it's not illegal, we're disappointed by @Esquiremag Spain's blatant copy of our November 2012 cover. http://t.co/Pes1… Just submitted my abstract to @We_Robot 2014! I don't like how "recommended for you" is the default on right hand side of @nytimes now. I want to know what others are reading. @jathansadowski not sure if true of showroom itself (when opened) or just during construction but either way, ironic. RT @gigaom: SunPower buys solar cleaning robot company Greenbotics http://t.co/Gz65LZvhAx RT @CuteEmergency: the first swimming lesson. http://t.co/jmlhhtdFDY Original Star Wars movies : Plinkett videos :: The Office until season 9 : something that should be made abt. the last season of The Office. @j2bryson haha, yeah. I've been told by friends that football actually requires lots of strategy/planning/learning etc. then I watch and ZZZ Just saw an IBM Watson commercial on TV. No specific application, just Jeopardy reference + "Watson is ready for work." @mgubrud Miles's law: Income inequality in the US is more extreme than you think...even if you take this into account. RT @CuteEmergency: :) http://t.co/xHjYH0MZjx The cashier was facing the other way, turns around, ZOMBIE. Took me about .1 second to realize what was going on/not freak the *** out. I may not have known it was Halloween if it weren't for Twitter, email, and a zombie cashier who scared the *** out of me for a second. RT @CuteEmergency: so this is a newborn baby giraffe... http://t.co/OiyUZUNseq @SenRandPaul : "“The most important question we need to ask the NSA is, ‘Are you telling us you’re collecting no data on the pope?’" LOL RT @histoftech: "I am shocked to find out gambling is going on in this establishment!" @guardiantech: Google furious w/NSA intercepts http:… @mgubrud that's fair, I still think it's nice that it was pitched as helping w medical probs etc. not just curiosity/go to moon bc it's hard Wish there were a good review of IBM's neural net chips/Watson hype (they released a whole book about it!). Have to do myself I guess? :-( RT @RoboEthics: Play-i want to bring a robot to every child | Robohub http://t.co/tsTSMNImOP via @robohub BRAIN Initiative lessons so far: Hype required to get high level support. :( Social impact potential taken seriously in funding/support. :) Great perspective on BRAIN Initiative by @amyleerobinson http://t.co/UqYUATHqPz IMO will do a lot but is overselling in its reports/press. LOL Drudge Report: "Third Republican Backs Immigration." Who the **** doesn't "back immigration" to some extent/in some sense? #cluelessGOP I learned tonight is the finals (or something? pivotal round?) of the World Series at precisely the same time I found out who won. #notsorry @RepMikeRogers The intel. community is obvi. way too big/diverse for anyone to understand it "fully/completely." You def don't. NSA doesn't. @RepMikeRogers "It is disingenuous to imply this committee didn't have a full/complete understanding of intel. comm. behavior." NO ONE DOES! Anyone read the report outlining BRAIN Initiative goals? TL;DR (from what I can tell) is "do all neuroscience in a decade." Will fail obvi. BRAIN Initiative is mostly a coordination push, not funding. Obv. DARPA would spend money on #AI/#brain anyway. Haven't seen discussed much. RT @smc90: So there's an ETF for investing in robotics and automation companies. Ticker? ROBO (natch!) [v @nickpinkston @chr1sa] http://t.c… Too many papers. Too many books. Too many movies. Too much TV. List of ways in which Kitchen Nightmares and Restaurant Impossible are different shows besides the host being different: . Is there something I could read that would make me care about sports or is it just: you get it or you don't? (Not sure I'd read that though) @jathansadowski @bakeryjake BTW as we speak, Bill Maher said something to the effect of "I hope Ray Kurzweil is correct" on CNN, aghh @jathansadowski Nice, Haven't read much moral phil since being persuaded of anti-realism but may have to esp. if @bakeryjake keeps things up @jathansadowski Hmm very interesting! Any scholars in particular or just loose affiliation? @jathansadowski too many other things indeed! ;) as a card carrying consequentialist I am less swayed but important concerns, for sure. @jathansadowski yeah details not really important, just various attempts to make concrete what are usually vague notions of enhancement. @jathansadowski and to be clear, not endorsing ;) have v mixed/uncertain views on such topics, but he is one of most articulate on that side @jathansadowski btw u read Bostrom's Letter from Utopia? Might want to. He also has brand new one on genetic selection for IQ (haven't read) @jathansadowski very cool! Good to see engagement o younguns w such important/timely stuff @jathansadowski mainly the Oxford ppl. Suspect they would say whiteness link not intrinsic, conseq'ism =/= that, + requires t-humanism. @jathansadowski ah! Sounded familiar. Would be cool to see > direct dialogue btwn such critics and the more thoughtful t-humanists. Rare :/ Dems should be > compassionate towards (few) harmed under Obamacare, Reps should celebrate bigger # being helped - paraphrasing @VanJones68 @jathansadowski source? Also what does DCIM152 mean? And perfect at least in ethical sense is ill defined and impossible for bots and humans @danieldewey good point! They haven't shown much interest in doing so, though...I only saw one journalist who tested it and it did badly. RT @AwardsDaily: RT @NatGeopix: Baby Lamb enjoying life. http://t.co/FzVtpajypc cc @anamariecox RT @HardSciFiMovies: Two FBI agents compile irrefutable proof of paranormal activity. They collect one million dollars from the James Randi… RT @IntelFuturist: My question for Wall Street today is: What are you optimizing for? What do you value & what are u doing about it? I have no reason to distrust @vicariousinc but this raises Qs like how we can evaluate #AI claims given good reason for not releasing code? RT @MazzucatoM: Carney “organised properly, a vibrant financial sector bring substantial benefits”.But HEALTHY finance in SICK economy=next… @vicariousinc's CAPTCHA videos don't prove anything - easily faked. Raises important Qs re open v closed source, responsible innovation, etc LOL anyone else see the @StephenAtHome segment about @SenRandPaul plagiarizing the Wikipedia page on Gattaca? Epic. Not surprising, though. Required range: 30 feet or so max. Have idea for #Arduino/#AI/#robotics project. Requires detecting ppl outdoors with low false negative rate, low cost. Sensor suggestions? Racist laws through 1960s : our regret now :: X : regret in 2060s? I guess LGBT issues, animal suffering, acceptance of extreme poverty...? Wonder if pets will still exist in large #s in 1-200 years (not to mention us). Dogs look different from centuries ago. Will robots replace? Google Glass may be the Segway of this decade. Or not, who knows. Regardless, much less silly-looking AR will be possible before long... Wow, the new Google Glass design...just...I can't even. So ridiculous looking. Don't think people outside the Bay area are ready for that. Cooking up a session proposal for a conference. Need Caprica, The Office, maybe Seinfeld for inspiration. RT @sabinehauert: @j2bryson @EUCogNetwork @techsunny if we don't make guidelines to label cog systems, who will? Prevent hype, encourage cl… RT @sabinehauert: Lay of the land: Unmanned systems coming to commercial agriculture http://t.co/bYrZJVfs2R @j2bryson good point! @j2bryson @io9 Watch the first 8 minutes of Fox's Almost Human right now http://t.co/tZf1wKPkfu #robotsandyou RT @io9: Watch the first 8 minutes of Fox's Almost Human right now http://t.co/KZansGIbMH RT @lindaavey: For my science geek friends. http://t.co/uFKwBRZDL8 I'll be in Osaka/maybe Tokyo in December for a few days. Any cool #AI/#robotics people/places I must see while in the neighborhood? RT @ScottKirsner: Agricultural robot firm Harvest Automation raises $11.75M in Series C financing: http://t.co/fnZKLnHnNz High impact science makes novel connctns btwn topics, more likely in teams. Intuitive, but good to see empirical evid http://t.co/IBe2KvZynh RT @asunews: Allenby- "The big problem with longevity is old people": http://t.co/zctWmkJYeY RT @HardSciFiMovies: A computer interface requires users to navigate a virtual 3D environment to access files. The designer is ridiculed by… Obama administration thinks (perhaps accurately) that it's better to wait for #NSA scandal to blow over than to apologize for or justify it. Either U R technologically advanced enough and we spy on everything U say, or U have sand/rocks and we blow U up w/ drones - @StephenAtHome @Chevron misleading to say "on @TheAtlantic" when sponsored content. Also, re: STEM, pls present coherent plan for fossil->renewable energy @jathansadowski let me know when you're near end of season 3 :) #almostspoileralert Tweets w/ @jathansadowski remind me: any #AI ppl watched Caprica? Thoughts? IMO takes some liberties w/ science but overall raises imp. Q's. @jathansadowski lol I know too much about those. Avg. quality of such books is low but Caprica raises many imp. Q's. Where are you in BSG? @jathansadowski thanks! Both up my alley. This reminds me of my cockamamie "Caprica and Philosophy" plan. Would be epic but no1 would buy :( Huh? RT: @Slate: Google is apparently working on an insanely elaborate way to promote Google Glass: http://t.co/ekn8QSgbgb @jathansadowski oh man, the robo/#AI beat is brutal, indeed. So much stuff going on. Ready Player One is more VR than AI FYI. And just fun. @jathansadowski and I second everything said (inc. by me :) ) re: Player Piano. Asimov rox but can't give detailed recs. Denise knows more. @jathansadowski nice, those sound cool. I may have said this before but also consider Robopocalypse (@danielwilsonpdx) and Ready Player One. @jathansadowski not all novels, though. I prob have about 1 novel for every 4-5 non-fiction books in my stacks of un/partially read books. @jathansadowski don't tell me about stacks ;-) haha http://t.co/ngJ5NcJcmJ @jathansadowski :) I've dabbled a bit in her recent Positron stuff as well, but nowhere near done. Some solutionism/surveillance type stuff. @jathansadowski lol not much. Oryx and Crake bro. I have the rest of the trilogy in hard copy btw if you ever wanna borrow, but not O+C. @jathansadowski RT: @FastCompany: How Margaret Atwood Creates Scary–Plausible Future Worlds http://t.co/5c8C7WaUnI Ill-posed question, I know. Just wondering if anyone has a gut reaction re: what's hot, poses interesting social issues in future, etc. Tweeps: ignoring prof., what would be best #AI class next sem.: statistical ML; NLP/Q+A; KR+R; data mining; web info retrieval/integ/mining? RT @asuinitiatives: . @ASU wins $5M grant for solar energy research http://t.co/wEp2QDOMp1 via @phxbizjournal @asugreen RT @mocost: Science writing competition for PhD students and early career researchers http://t.co/K8mj5H9n via @m_wall RT @RobotDiva: #RoboBusiness 2013: A Robot to Carry Your Stuff http://t.co/oTK9unwt29 via @IEEESpectrum RT @RobotDiva: Everything Is Not a #Damn Robot http://t.co/5Oz7EyIgdC via @BW http://t.co/IV43sm7cLW is a good resource if you're into that sort of thing. Specifically the tutorial. #AI @JasonOLearyUS I think we can do better than that :) Random prediction: solar > 20% of electricity by 2030. Assumptions: continued focus on soft costs, public serious about climate in 10 years. Regardless of how my AI exam goes tom this little angel will still be smarter than any AI (and love me, to boot) :) http://t.co/Xdi5FqivOF Need an AI to help me study for my AI midterm. RT @j2bryson: My paper http://t.co/W8A7rswNzd (PDF) Dominance, Compassion, and Evolved Social Behaviour: Advisable Roles and Limits for Com… RT @BarackObama: I spy... http://t.co/5KEpqgbA RT @IBMResearch: Thought Processor: @CarnegieMellon joins 3 other schools as part of #IBMResearch’s “Cognitive Institute” http://t.co/kelrR… RT @techreview: Tests of Google’s autonomous vehicles in California and Nevada suggests they already outperform human drivers. http://t.co/… @j2bryson @danieldewey Yeah, perhaps you should ;) have fun at ICSR! Program looks great. @j2bryson @danieldewey also http://t.co/V7VG2l2Evf think the quotable "raising not rising" line summarizes many ppl's hesitation, inc mine.. RT @PsychScientists: Ha! Someone has made 49 Twitter accounts and is reenacting Back to the Future https://t.co/QUp1Woh6dz ht @theriotisov… RT @TheTweetOfGod: Warning: the life you are about to lead contains strong language, adult situations and nudity. Exister discretion is adv… @j2bryson any specific disagreements that are easily tweetable? :) @danieldewey @j2bryson @rachelsheer I don't! though I do hope that when I am old and decrepit we will have lots of bots and guaranteed minimum income :) @j2bryson haha :) @xuenay yup. Thx! Should reread. @j2bryson ? I thought I used affect correctly there...what do you mean? May co-author paper with a law student on ethical/legal aspects of #AI advisory systems a la Watson. Thoughts/references? Let me know :) RT @cstross: On the Dark Silicon problem, and how it threatens Moore’s Law: http://t.co/w2Tpz34WWz ~30 mil. humans in psych./physical pain (modern slavery) vs (?) amount of dogs in (mostly?) physical pain vs. billions of cows/pigs/chicken? V. glad ppl around the world r taking action on animal cruelty - though still Q of best allocation of resources across species/type of harm? RT @EFF: We need to end mass suspicionless surveillance. https://t.co/Il17QbOLhp RT @QelricDK: Massive congrats to @oculus for winning Innovation of the Year! Golden Joysticks 2013: Full list of winners http://t.co/za3ig… RT @DNLee5: “@ohlivyalife: Some politicians care more about unborn white children than they do about living Black children.” What you said!! Watching Animal Cops Phoenix for the first time. Sad. Lucky my baby girl dog was picked up off the streets by someone - others weren't :( "RT @MIRIBerkeley: @GaryMarcus in the New Yorker on AI dangers http://t.co/LNyKNjgSPW" RT @grubreport: WARGAMES IS ON NETFLIX INSTANT GOODNIGHT "It will not be the rising of the machines, but rather the raising of the machines." interesting interview of Bas Steunebrink by @lukeprog How much do consumers care about such personal touches? Will affect whether such things r automated. Personally I want my laptop fixed ASAP! Using 24/7 (text) customer service chat, thinking about Turing Test. Lots of (scripted?) displays of empathy by human on the other end. Tech only 1 factor affecting job #'s. Q over long term is what *types* of jobs do we want to protect, subsidize, eliminate? #robotsandyou @j2bryson @EUCogNetwork I've heard people reference this, from trade group http://t.co/cTgoDBLcUp but think it's about creation, not net (?) @j2bryson also non-tech outcomes! The point generalizes - when feasible, people should have some influence over systems that influence them. RT @HardSciFiMovies: To combat rising crime, the Detroit Police Department contemplates developing cyborg policemen. The idea is vetoed by … @j2bryson and yes, not a special robot issue! Would like to see more public involvement in tech outcomes, esp tech funded by said public @j2bryson in sense that ppl can only vote w wallets after tech exists, by then not often much real choice - companies offer similar stuff.. RT @j2bryson: postulate: if we don’t understand something we shouldn’t give it much power. e.g. no NN in medical systems, DTs instead #rob… RT @j2bryson: @EUCogNetwork however AI learns / is built, someone determined it should do it that way, that entity is legally responsible. … RT @j2bryson: @EUCogNetwork @alan_winfield not 3 laws for robots, 5 laws for roboticists! @epsrc principles http://t.co/frpZeSKQYV #robotsa… Wonder how long it will take politicians to realize future of #AI/#robotics is ABSOLUTELY CRITICAL to future of gov't revenue, expenditures. Wonder what's the relationship btwn age and relationships with computers/Internet? My grandma has very diff. relationship w/ them than I do. My earliest experiences with computers/the Internet are AOL, chat rooms, AIM.. Hard to compare to older ppl with diff. references. Thoughts? IMO #robotsandus/#AI is so important that public should be involved deeply with gov't-funded R+D. How does this square with private R+D $$$? One could argue corporations are more directly responsible(/responsive?) to/for public b/c need customers to buy, but also less transparent. What are the implications of lots of #robotsandus innovation being funded/deployed by industry and not (directly) accountable to pub.? (1/2) RT @j2bryson: @EUCogNetwork @tonyjprescott more contemporary: science is part of society & politics, must think early about risks, includes… RT @Juxi: Yep, we need to! RT @gpierris: @EUCogNetwork @tonyjprescott It seems that scientists have to do a lot more than just #science #ro… RT @jgcarpenter: “They’re not just tools, but members of the squad. That’s the goal,” Lt. Col. Smith, chief of UGV. http://t.co/0F4RzYFmvB … "RT @SirJolt: Global recession worsens, many complain they have no lunch to Instagram. Increasingly detached political elite says, “Let the…" @xuenay glad you're enjoying em! Wish I was at the EUCog conference, this is my way of coping ;) People understand things easier through narrative sometimes. @imaginationASU is fostering scientist/author collabs on reality-based sci-fi Last Tweet or two before I get back to work. Sci-fi could play positive role in thinking about #robotsandyou http://t.co/aZWxNLAxex @j2bryson @jgcarpenter @EUCogNetwork of course, public is also given bad info on climate by industry. Analogy to AI/robots case is...sci-fi? @j2bryson @jgcarpenter @EUCogNetwork I hope the public would converge on reasonable #robotsandyou attitudes given good info but who knows? @j2bryson @jgcarpenter @EUCogNetwork Unfortunately hasn't been enough w/ climate/energy. Don't have better plan, but just throwing that out! How would the world be different in 20 years if AI/robotics funding in US were only funded by civilian science agencies? #robotsandyou Make diverse/provocative scenarios for how #AI could develop given diff. policies, research goals, etc. like those in http://t.co/C433TRiUVh Got some scenario planning training a few weeks ago. Thinking of organizing some sort of #AI scenario dev. workshop eventually #robotsandyou Thank you, Twitter, for reminding me it is Mole Day. "Science is no single thing - its boundaries are (re)drawn in flexible/historically changing/sometimes ambiguous ways http://t.co/cet1iY7nf4 @j2bryson value-free ideal is part of boundary work (Gieryn 1983) for credibility. Douglas(/others) want more accurate/less defensive ideal. @j2bryson lots in the book about junk science, role of expertise in policy-making, I just extracted some Tweetable clauses :) @j2bryson I injected some of my own opinion in there - in book, she means something like-conceived of and practiced as separate from society @j2bryson I agree at least w/ second sentence, think Douglas would too. "Authoritative," "autonomous" are complex, glossed over in Tweets :) Science can be authoritative or autonomous but not both - = undemocratic. Public has role to play in priority setting, how to act on it. Better when explicit. Scientists not exempt from general responsibility to think about consequences of actions/claims. Two or three tweet version of Douglas's book (worth reading in full :) ) = values inevitable and desirable in science, Q is what role played @j2bryson @EUCogNetwork review folks may find interesting - http://t.co/qmvCeA9jY5 @j2bryson @EUCogNetwork yes! Heather Douglas's Science, Policy, + Value-Free Ideal is great read on appropriate role of values in science RT @j2bryson: @EUCogNetwork TBH I’m arguing for the neutrality of science, but I left the USA partly to avoid working on “battlefields of t… @j2bryson @EUCogNetwork wish I could be there! Talks sound awesome. Will slides be posted? RT @j2bryson: @EUCogNetwork now in Matthias Scheutz kick off for discussion of military robots #robotsandyou military wants robot donkeys, … RT @alan_winfield: Matthias Scheutz (Tufts) is asking the q: is it inevitable that cog. systems research will be used in military systems. … RT @mpshanahan: Tony Prescott's plenary at #robotsandyou: "autonomous, potentially self-aware, control systems running critical infrastruct… RT @j2bryson: @EUCogNetwork @tonyjprescott the EC uses the term “socially robust” as a goal for tech ethics, 3 ppl here say they know what… RT @shanley: LOL that thing where you rediscover why IRC is piece of shit that you never bothered to use in your youth and shouldn't use no… May go to Japan in a few months for a conference on responsible innovation. Thoughts on AI/robotics stuff I must see/do in Osaka/Tokyo? Thank you Jon Stewart for reminding me that McCain picked Palin as a running mate. ... *sigh* wish there were a Republican I could respect. Unless the Tea Party takes over and abolishes everything or gov't hiring/wages/benefits change radically, this won't be the last tech surge. RT @EUCogNetwork: Tomorrow starts "Social and Ethical Aspects of Cognitive Systems" Conference at @SussexUni http://t.co/pPlgVvSwJD Check t… Am I the only one who finds it strange that the debut of a new model of an iPad is headline news? The http://t.co/yObfExG7ir "tech surge" is a microcosm of larger shifts in power, prestige, and credibility Westward to Silicon Valley. "Many ancient astronaut theorists think the answer is yes." -@AncientAliens #facepalm @AncientAliens's core arg.: ancient people wrote about magic. (Unstated: that wasn't fiction). Maybe that was actually tech. ??? ALIENZ!!! I feel bad for the academics interviewed on @AncientAliens. They were clearly misled about the purpose of their interviews. So depressing... @AncientAliens is 10x worse than I feared. Very sad @HISTORY has 0 standards. Idiots taken at face value and others quoted out of context :( To last tweet I would add that mgmt in gov't is hard given laws/other agencies, hiring is slow, + non-politico ppl don't want to live in DC. RT @Liberationtech: Silicon Valley has em | Why US feds didn’t have more skilled programmers for http://t.co/aOhw4HLBZx http://t.co/WXx6UFJ… RT @dalecarrico: The amount of anti-union vitriol expressed in the comparatively progressive Bay Area during the #BARTstrike is truly depre… RT @RoboEthics: I just added my own publication: 'Design and Impact of Hesitation Gestures during Human-Robot Resource Conflicts' http://t.… RT @JesseJenkins: AEP CEO: “We see the future for us being natural gas, #energy efficiency, smart-grid activities and renewables" http://t.… RT @j2bryson: @ArtificialOther ageing isn’t a disease, it’s an evolved, regulated trait like height. https://t.co/e3ucfPqyAe @j2bryson @Ahaverine good points! Not that familiar w/ tech status but seems like there's higher upper bound (re: possible apps) in virtual? Random prediction: virtual reality will be big in gaming/ed. within 10 years, augmented reality won't. Virtual is easier and more flexible. RT @HuffPostTech: Elon Musk is putting a Tesla engine in a James Bond submarine because he's Elon Musk (http://t.co/5o0wJcUNth) http://t.co… RT @FruzsE: I wrote about Dick Cheney's fear of death by hacked heart earlier today. It's possible, http://t.co/K2Dd9g9Z9o What should the future of work be? Should we make it unnec. via AI or are we not ready for that/should we value it in itself? #robotsandyou @j2bryson similar study results in US by political scientists, etc. :( Arguably, being a "low info. voter" is rational at individual level. How might different goals for AI (human-like v. complementary, transparent? usable by non-experts?) affect its social impact? #robotsandyou RT @EUCogNetwork: RT @RonChrisley: Article on #robotsandyou and related issues in today's Observer http://t.co/zDTksBwB3g RT @jilevin: Wealth distribution in the United States Congress. They don't look like the rest of us. http://t.co/JBKBcUmkoD Key grad school lessons 1. Talking to ppl > reading them 2. You have to specialize (kinda) 3. Everyone has useful ideas 4. Read other stuff The wit and wisdom of YouTube commenters.... "And yes, we are half gods half potatoes." #lolwut RT @kennethanderson: Killer Robots W/ Automatic Rifles Could Be on the Battlefield in 5 Years http://t.co/UYgDJPou6Z Well, remotely control… Ordered a 23AndMe genetic testing kit. Looking forward to it, though a little nervous about, ex., Alzheimer's risk. Any tweeps done it? Grand Theft Auto V is even more epic and offensive than I was expecting based on the reviews. @j2bryson solar panels v. cheap compared to before, labor is increasingly big factor in overall cost. not sure about wind/other energy stuff @j2bryson via good manufacturing (unfortunately not the case in some nasty Chinese plants), recycling. Wind more location-dependent 2/2 @j2bryson making em is energy-intensive but they pay back that "investment" - toxicity-wise, some nasty ingredients but can be managed...1/2 @j2bryson agreed, and former may help w/ latter - http://t.co/75Svy065Ya @j2bryson new @tylercowen book on this is interesting, tho treats AI as homogeneous. Diff. AI goals, designs, etc prob -> diff. outcomes.. @j2bryson yup...IMO the lit is clear, there is an impact, uncertainties: # new jobs created? What skills needed? Optimal welfare policy? Etc RT @HardSciFiMovies: An alien race is severely allergic to water. Earth is swiftly ruled out as a candidate planet for invasion. @j2bryson those are intertwined w tech ex. see lit review in Frey/Osborne paper, IT changes pre-tax income distr. Policy can offset though. RT @j2blather: RT @jimgroome: Both my book and my cigarette are running out of battery. Stupid future. RT @heatherfro: ‘Why do white people have thin lips?’ Google and the perpetuation of stereotypes via auto-complete search forms http://t.co… RT @RoboEthics: 25 women in robotics you need to know about (2013) | Robohub http://t.co/qMtF9cwy8s via @robohub Luv @HardSciFiMovies RT @HardSciFiMovies: Police begin using "pre-cognitives" to prosecute crimes that have not yet occurred. The Supreme Court deems the practi… @jathansadowski I agree, here I use "robot construction worker" as shorthand for a system that does something diff. but v. loosely analogous @jathansadowski right, not one to one. Robot construction workers would ex. have worse perception and dexterity but perfect coordination. @jathansadowski intrinsically v hard for real-time sunlight to compete with millions of years of compressed sunlight. @jathansadowski ie management marketing etc. unlikely w/o rethinking whole system/biz model, focus on big plants etc. and raises ethical Q's @jathansadowski to compete w existing plants or new coal in dev world (w/o policy), need automation across low + high wage jobs..robocompany @jathansadowski depends on goals, policy context etc. but my hunch is this will be enough to compete w/ new FF plants in dev'd world but 1/2 @jathansadowski I'm all about this. Lots of stuff like this automating one task but still prob not ambitious enough for terawatt scale... RT @jathansadowski: Robots built to "automate the installation & maintnance of large-scale solar farms" could cut cost http://t.co/BIB4nyvM… Psst Congressional Republicans. There's a ton of waste at the Defense Dept. - more than in Obamacare. Would be cool if you cared about that. @Liberationtech @UN @owenbowcott good stuff, would be more intrigued if the arg. weren't as old as society. Recently - Pape - Dying to Win. Don't think @newtgingrich got @VanJones68's @DuckDynastyAE reference on @CrossfireCNN yesterday but I liked it. That's enough @s for a while RT @DNLee5: My post is now back up: http://t.co/N0YOOGFXcQ #SciAmBlogs thanks for the tweet @BoraZ As far as I can tell, Republicans' grievances over the past few weeks have evolved from "OBAMACARE" to "FISCAL DISCIPLINE" to "CUZ REASONS." "RT @shanley: Please join me for a dramatic reading of READ FUCKING BOOKS" RT @GaryMarcus: PAC: A Universal Framework for Learning? Review of Les Valiant's new book by NYU's Ernest Davis. http://t.co/0MHjgTECFi @prof_jdb If it weren't for @VanJones68 being on it (my awesome boss of yesteryear) I would be inclined to agree :-) RT @MSFTResearch: Microsoft leans on Machine Learning & Quantum Computing in new research strategy http://t.co/N2TsmNLjtR @David_A_Talbot @… I've been advocating this for a while. Cheap solar needs AI. RT @robotonomics: Putting Robots to Work in Solar Energy http://t.co/yaMG9ceSLa RT @robotonomics: Putting Robots to Work in Solar Energy http://t.co/dSjAdILuOB RT @alicebell: provocative piece from @stianwestlake - in defence of techo-hype and magical thinking about science http://t.co/X3OueQBWz4 RT @HardSciFiMovies: A powerful new AI has gone haywire. Its code and dataset are rolled back to an earlier version. The mission proceeds n… @newtgingrich when he finds out other people disagree with him but can't wait to figure out why they're wrong http://t.co/SZleOUj3Um It would be cool to have a TV show with people who disagree about hard things but agree about simple things. Too much to ask for apparently. Why is @newtgingrich on @CrossfireCNN ? He espouses 80% GOP, 20% "contrarian"Tea Party ideas. Dumb person's idea of what an intellectual is. RT @prof_jdb: Robin Thicke is awful. FYI. http://t.co/HCpXABGedW "RT @jathansadowski: Inequality, new&old: ""in an ultramechanised world, will a new ‘cognitive elite’ leave everyone else behnd?"" http://t.c…" RT @JenLucPiquant: This Is the Average Man's Body - James Hamblin - The Atlantic http://t.co/ducYAEhWrU RT @hangingnoodles: our kludgey cognition MT @GaryMarcus: Bayesian models of human psychology - overrated?…challenge a dominant theory http… RT @HardSciFiMovies: A scientist is trapped on an alien mothership with nothing but his Apple Powerbook. He is unable to connect to the ali… RT @lifewinning: "The changing of warfare is going to pale in comparison to commercial development" --Missy Cummings #droneconf RT @erinsimonesq: drones are the charismatic megafauna of the otherwise obscure data collection infrastructure #droneconf Europeans collaborate more with Indian profs than Americans do. Americans see India as source of students - interviews by Roli Varma @4s2013 R&D expenditure in India has grown by more than 10x since 1990. Expected to double again within 5 years (from 1 to 2% of GDP). #4s2013 The Future of Inequality (multiple book review) http://t.co/LkoCduDX3K RT @HardSciFiMovies: A robot accidentally develops the ability to feel love. Per its programming, it continues to weld brackets to VW Jetta… RT @chrishtill: Value sensitive design as interface of ethics and technology #4s2013 "RT @EUCogNetwork: 60% of people polled agreed that #robots “should be banned” from use in “care of children, elderly...” http://t.co/7HCnW…" @EUCogNetwork thanks! RT @dynamicsymmetry: "Once a drone is in an elevator, where should it hover?" - Heather Knight #droneconf RT @AstroKatie: Hey @sciam: maybe u should explain how taking down @DNLee5's post wasn't tacit support 4 your Biology-Online partner. http:… RT @graceishuman: Can we say "rape culture?" RT @graceishuman: Huckabee just implied that if trans inclusive policies existed when he was in HS he would've pretended to be a trans girl… @jathansadowski also, when ppl don't say "thank you" or otherwise indicate their talk is over and there are several seconds of awk. silence. @jathansadowski ppl need professional etiquette/presentation instruction in grad school I guess..well, I hope so! (that it's just ignorance) @jathansadowski only seen once before this conf. Disciplinary thing? Other time I saw was philosopher who took pride in going "old school" RT @jathansadowski: How is it that there's no academic cultural knowledge about how reading a paper and calling it a presentation is terrib… RT @SethBaum: My new Scientific American Blogs article about AI risk, reviewing new book Our Final Invention http://t.co/LooJy6bb4C RT @jathansadowski: "Gladwell is a brilliant salesman for a certain kind of cognitive drug." @stevenpoole on Gladwell's pseudo-profundity h… RT @weboesel: prev tweet was imagining aggregated self-tracking data cld lead to effective eating disorder treatments; i fear more eating d… RT @weboesel: "your fitbit MAKES you take more steps"—technodeterminism comes to practical life in the imagined future of QS. #qs13 @halavais - Sanctorius of Padua tracked weight daily. Audubon bird count started >100 yrs ago. #qs #citizenscience have long roots. #4s2013 RT @jathansadowski: Julie Cohen: Businesses say innovation occurs in markets, which are autonomous & rational, ergo innovation is autonomou… RT @shanley: New post. "Fuck You, I Got Mine": Women in Tech for the Patriarchy https://t.co/XdQVbwfP6P Will there be videos/streaming of the @EUCogNetwork conf. on Social/Ethical Aspects of Cognitive Systems? Wish I could make it! Big tech company competition to make good AI ass't is v. fierce @mashable Apple Acquires Personal Assistant App Cue http://t.co/X9BF1buQYG RT @EUCogNetwork: Who's to blame in an automated autonomous car accident? Join the discussion of the Brighton Conf. at #robotsandyou http:/… "Even if goals are externally sourced, achieving them is still emancipatory." Kaiton Williams' talk on his exp. w/ #quantifiedself #4s2013 @j2bryson yup.... @j2bryson definitely agree with that, though the idea of selling it as a toy (at least by some users) still weirds me out a lot.... RT @jameswilsdon: Why we'd be mad to rule out climate engineering.’ @Matthew__Watson http://t.co/sFchYlpQ9Q RT @radicalbytes: Dear videogame industry, Robots are super cool. Zombies are not cool. Please adjust your game development strategies acco… "How do you get rid of [these brain injuries] and have it still be football?" - interviewee. You don't. Stop glamorizing dumb activities. Frontline ep. on football/brain injury link is powerful. Evidence strong - not surprising, though. Too bad it took this long to get attn. RT @arstechnica: Ballmer says that Office for iPad is on its way http://t.co/p2ridGNHwK by @MeganGeuss Know what would be cool, @CNNLive @cnnbrk? Not using the phrase "God particle." Seriously. Means nothing. Only the media use it. Stop. Thx Some welfare-increasing scientific/search and rescue apps. But will it encourage bad treatment of higher animals? Tell me what to think. :) Don't know what to think about cyborg cockroaches. Intuitively, looks messed up. Rationally, don't know enough about insect nervous systems. Watch the video. ...."Cyborg Cockroach Sparks Ethics Debate" | Science/AAAS | News http://t.co/AG3wFulzox via @AddThis RT @j2bryson: Agree with @Miles_Brundage (cf. http://t.co/PV12hf036k) AI extends & changes human powers & capacities. Governance determines… Memo to the government officials on @NBCBlacklist ... stop letting Red wander freely. Lock him up. Well. Seriously, not that complicated. Very back of the envelope, but I think that approximates the intuition of biochemists/roboticists I know... i.e. biology = SUPER efficient. My guess is at least 1000x difference (in favor of animals with muscles vs. an internal combustion engine powering metal/pneumatic limbs). Would be interesting to know the energy efficiency difference between WildCat https://t.co/SMXMI5jhTd and similar animal - dog, cheetah, ... So amazing that Turing preempted almost all objections to AI 63 years ago, before there was such a thing. http://t.co/l4XF2Jr4o0 RT @daveweigel: Politico poll also has +12 support for new EPA rules on coal http://t.co/1bVNrPlzNl Want to read good article about Watson vs. Siri vs. Google Now vs. MSFT Cortana vs. other big budget AI efforts. Pls don't make me write it Anyone reading new IBM hype book Smart Machines? May need to review. They are betting big on AI, makes sense given Moore's Law slowdown. RT @SethGrimes: Deep learning for #NLProc, sentiment analysis at @StanfordNLP http://t.co/ieOjONYERi covered by @derrickharris @gigaom The Coming Revolution in Global Energy Wealth http://t.co/TKq3mK6El7 via @CSPO_ASU @clarkamiller IBM research stakes its future on cognitive computing http://t.co/E59UT2djhE "Technophobe" and "Neo-Luddite" are quasi-epithets used by people who can't appreciate that technology is neither neutral nor homogeneous. RT @chriscaple: Fascinating article - "Three trends that will create demand for an unconditional basic income." http://t.co/DYfkQdKsy1 @British_Airways @BritishAirways Please read my complaint/do the right thing. You have a few days before you are legally required to. Thanks Tech "does/doesn't destroy jobs" = vague/unhelpful claims. Prefer to talk about who's affected positively/negatively, how, how to respond. 3/3 various qualitative differences btwn past n current/future tech. 3. Everyone agrees tech creates jobs! disagree re #/qual/who benefits. 2/3 1. Concern about tech-unemployment linkages =/= technophobia. Many such concerns come from roboticists themselves. 2. History =/= future 1/3 Strange @brookingsinst article on tech. + unemployment http://t.co/eLh6UlHt2v. Too many disagreements to Tweet but 3 quick ones... RT @chrislhayes: Scalia: "Words have meaning. And their meaning doesn’t change." Just obviously, completely not true. RT @marynmck: on #shutdown #shutscience: you MUST read @9brandon's intvw w a govt scientist whose lab animals will be euthanized: http://t.… RT @speechboy71: BREAKING: People in very conservative congressional district hold extreme, ill-informed views: http://t.co/IlIkWtmAAg RT @girishsastry: Why Malcolm Gladwell Matters (And Why That's Unfortunate) (via @Pocket) #longreads http://t.co/eu2v3s4GbY @jathansadowski MT @IEthics "A Theory of Creepy" by @omertene @JulesPolonetsky: http://t.co/9EahogOcY0 RT @WhiteHouse: RT if you agree: It's past time for Congress to #JustVote and end this #Shutdown. RT @FHIOxford: "AI and Extended Cognition" - Michael Wheeler keynote at PT-AI 2013 http://t.co/nrLK7bf2Wy Rush Hour 2 Furious #AddaWordRuinaMovie RT @rcalo: Training Wheels Day #AddaWordRuinaMovie Indiana Jones and the Temple of MF Doom. #AddaWordRuinaMovie RT @TheAlexKnapp: The Matrix Revolutions #AddaWordRuinaMovie Twitter Avatar. #AddaWordRuinaMovie @jathansadowski sounds great. Almost too intense lol that's my only reservation. @jathansadowski need your review of it @rj_cubarrubia clutch tweet brah Put differently: a show w/ more moderate views would produce calmer/more productive dialogue but would mislead as to nature of US politics. Wish I could ignore @CrossfireCNN b/c of the extreme polarization but it accurately represents many ppl's misunderstandings of each other... RT @SethBaum: @SuzanneWaldman @Miles_Brundage @TomSteyer I would think discount rates higher for elected officials (near-term reelections) … How am I supposed to work when there are so many good books and YouTube lectures, mostly on different topics? *cough* and Wife Swap *cough* @SethBaum @SuzanneWaldman @TomSteyer nope haven't, thx! Looks v. relevant to our discussion. @SuzanneWaldman @SethBaum discount rates also a barrier. Currently based indirectly on trusting ppl's dumb intuitions, then rationalizing.. RT @SuzanneWaldman: @Miles_Brundage @SethBaum Economists agree climate change'll be expensive. Wish was a way to compute loss reduction as … RT @SuzanneWaldman: @Miles_Brundage @SethBaum Think people have to feel harms more acutely. Farsightedness re novel threats not in human re… @SethBaum @SuzanneWaldman Opportunity for pro-social use of fancy finance engineering to fund present lobbying from future profits? :) @SethBaum @SuzanneWaldman being done but politicians' time horizons short. cleantech lobby deserves credit for status quo not being worse. @SethBaum Ex. coastal communities. cultural resistance, collective action probs even at smaller scale, incredulity re: harms etc didn't help @SethBaum yep that's right. Back in day when i was climate person we tried to get (C)affected parties to organize but hard bc time lag issue @SethBaum this is just one aspect of structure being an issue but campaign finance is impactful unfortunately :( @SethBaum generally I'd say yes, though catastrophic weather event, leak re: big fossil corruption, eco-terror etc. could also tip 1 way :/ @SethBaum hmm, I would hope the public's equilibrium would be more supportive than DC's, though maybe unpredictable bc political Black Swans @SethBaum think yes but would have to look at ex focus group results rather than polls, most don't have v. informed views yet so could shift @danieldewey thanks for the RT! RT @Floridi: Enveloping the World: How Reality Is Becoming AI-Friendly - Luciano Floridi keynote at PT-AI 2013 http://t.co/O7oYN7M9KQ @stoptherobotwar would be cool to have AI/robotics session @ http://t.co/dcLNQ08vzm- looking for partners on proposal, contact if interested In case you missed it - @VincentCMueller @j2bryson @RoboEthics would be cool to have an AI/robotics session at this. https://t.co/rtzOeuedR3 Might propose a session on #AI/#ethics/#policy at http://t.co/dcLNQ08vzm interested in being involved? Know others who might be? pls RT :) RT @DieZauberer: @VanJones68 #TeaBaggers You think they are angry now, wait until President Hillary nominates former President Obama to the… Your tax dollars at work making creepy running robots MT @digg: The world's fastest running robot is off the leash (http://t.co/1gJcU5aRoO) RT @cheeflo: We need to think of ethics in terms of design. Values as design requirements - van den Hoven #digethics3 RT @SethBaum: Luke Muehlhauser reviews Our Final Invention. Good summary of the MIRI position on AI http://t.co/a5fH3d9gx0 RT @ejwillingham: That #silkroad guy was a grad of the white flight, self-entitled, privileged school district we bailed on 4 y ago. Shocki… Review of Our Final Invention at @KurzweilAINews by @lukeprog http://t.co/EyRlkHiG9p RT @danieldennett: SFI's magnificent Melanie Mitchell is offering a free online course, Intro to Complexity, open to all: http://t.co/0Acy… @SawLady Awesome! I really enjoyed the saw scene/music in Another Earth and this vid is great too :) IBM brings in academic superstars to move cognitive computing beyond Watson http://t.co/SSVAm4M99B via @gigaom RT @jathansadowski: "preferences for robo-servants vary by our ages and according to the chosen task." (cc @Miles_Brundage) http://t.co/6yv… RT @j2blather: Oh, and now it says “thank you for your feedback” after not letting me see my friend’s page til I did it. YOU ARE *NOT* WELC… RT @sarahjeong: Complete upheaval is always a possibility. Misogyny will be the perl script of tomorrow: dead as hell and embarrassing to t… "just watch it". exactly. RT @Slate The 'ex-gay movement' has a new theme song. It's... We'll, just watch it: http://t.co/SWqhD3cqft One of these days I'd like to write something on evolutionary psychology, obesity, and willpower. That would take willpower, though. RT @xwaldie: You might not be beautiful the way you are. But that's OK! http://t.co/3r58YCQ2bZ RT @Slate: You might not be beautiful the way you are: http://t.co/sFQbdRGKUC RT @venturejessica: Have you guys seen #governmentshutdownpickuplines? Hilarious. RT @We_Robot: Today is the day! Call for Papers is now OPEN // Please RT // http://t.co/DOXdV9GlO0 #WeRobot RT @iftf: Google buys Flutter to beef up its gesture recognition skills - http://t.co/Zve0KAbrJB #Sense RT @kansasalps: Silk Road’s mastermind allegedly paid $80,000 for a hitman. The hitman was a cop. (by @binarybits) http://t.co/Jd4GfbtdLN RT @dalecarrico: Dear Republicans. Obamacare will be implemented. Government will reopen. The US will grow ever more diverse. Change or die. RT @kayousterhout: Insightful talk from AWS at Berkeley today: I learned that at Amazon, "real men read code." I wonder what the real women… RT @lindseybieda: Read books everyday RT @sophiaphotos: Privilege is the luxury of getting bored by talk about oppression + being able to walk away from it. RT @hypatiadotca: It appears I am speaking at @kiwicon again: https://t.co/9nNNMP0Z8h It's too bad Another Earth and After Earth have so many letters in common. Hope no one confuses them. Watch the former, burn the latter. Under-appreciated (not nec. great - relative judgment) sci-fi movies: Moon, Another Earth, 12 Monkeys, Cloud Atlas, The Island, Surrogates. RT @bradplumer: Just 18% of U.S. Internet users use twitter: http://t.co/A1Zxs0TcP7 RT @GaryMarcus: Bye bye #science: "NSF staff will be unable to receive or respond to e-mail or phone calls". Another consequence of House's… RT @christophr: HAS ANYONE JUST TRIED TURNING THE GOVERNMENT OFF THEN BACK ON AGAIN? AI programming in morning, AI class in afternoon, AI Skype convo in evening, AI movie at night. Whoops. Enviro. stuff tomorrow, though! :) Yes RT @Jezebel Is Dave Eggers' new novel a ripoff of a female writer's work? http://t.co/tPBE0axeXE Can't stop procrasti-reading RT @Slate: What Undercover Boss and The Jetsons Tell Us About the Future of Jobs http://t.co/R88scqetw7 RT @j2bryson: @BoredElonMusk @Miles_Brundage http://t.co/ySognq3Oy8 (though it’s development, not evolution.) #bigdata RT @BoredElonMusk: My interest in "big data" would be greater if it were being used to expedite human space travel, not increasing orders o… @boomer89a @robatkinsonitif if u build a robot w/ basic vision, dexterity, language, n social skills u will make $$$ but it'll be a while :) @boomer89a @robatkinsonitif tasks will def be automated 1 by 1 ex. see new robot soda cup fillers but tech not ready to do it all at any $ RT @j2bryson: I’ve been trying to write this, glad someone did! Coevolution of intelligence, behavioral repertoire, and lifespan https://t.… @robatkinsonitif not sure what u mean. Politics doesn't influence consumers, R+D? Techno-skepticism="political"/bad (but techno-hype isn't)? @xuenay also, my comment could be read as "too/depressingly easy" if not easy in absolute terms @xuenay yeah but you are a smart guy so I meant w.r.t. you and also them not seeming that exceptional in religion-building-backgrounds ;) RT @davidad: "Willpower is not a metaphor. The frontal cortex is incredibly expensive in terms of blood glucose." Sapolsky #beinghuman2013 @robatkinsonitif I want good automation in some contexts, good customer service in others...price != everything. Tech is not all or nothing. If this is the same great flavorful/chicken-like tofu I had at a DC location one time, then yay!! Chipotle Goes Vegan http://t.co/BrtXitF7rm RT @Slate: What Undercover Boss and The Jetsons Tell Us About the Future of Jobs http://t.co/OmR6Yu9EZp RT @michaelcrow: Big honor for us to host @ClintonGlobal University in 2014. #ASU will welcome innovative minds from around the world. http… @MarkMuro1 @TerynNorris http://t.co/rHjNAJ0pVq I have a new piece on AI/jobs at @Slate @FutureTenseNow : http://t.co/rHjNAJ0pVq Mentions @tylercowen @mattyglesias @FHIOxford RT @stianwestlake: "Average is over (If we want it...)". Great @mattyglesias response to new @tylercowen book. http://t.co/zzzskUGcwS RT @pookleblinky: Intersectionality for nerds: an n-dimensional matrix whose determinant corresponds to the comfort you feel in public spac… RT @tomstandage: This is lovely. A working, 1/3-scale original Macintosh, powered by a Raspberry Pi: http://t.co/vxx15Nk2vy (via @brokenbot… RT @FHIOxford: Specific AI versus general AI: Stuart Armstrong and Nick Hawes debate, discuss, and refuse to predict. http://t.co/8LpWgmuD… RT @alicebell: ... but that'd be next level concern trolling. So I'll shhh. RT @alicebell: tempted to write post suggesting STS academics saying 'science distracts from politics of climate change' simply distract us… RT @R_Bellamy: Nothing new on #geoengineering in #IPCC WG1 AR5 SfPM, but as @Jackstilgoe rightly says, why in the SfPM and why final para? … RT @j2bryson: Benjamin Lauderdale shows simple #AI dimension discovery gives more coherent history of USsupreme court than trad.unidimensio… RT @j2bryson: Funny that last week #ptai13 #PTAI2013 debated when “super intelligence” would be here, while political science uses it now #… RT @RobotDiva: Rethink Robotics Launches Baxter 2.0 Software http://t.co/u8KLMQbggJ List of things that won't be remembered in 100 years: Obamacare implementation details, Ted Cruz...basically, everything on the news. Things that will be remembered: how we engage (or don't) w/ the development of an AI/robot-driven economy. Gay rights. Energy/climate change Biased summary of @CrossfireCNN: Jones: awesome/right. Cutter: dismissive of others/right. Cupp: awesome/wrong. Gingrich: stupid/lame/wrong. Hope editor likes my article linking AI, Jetsons, and Undercover Boss. @histoftech when I tried M. Turk, almost everything was academic research or porn, and all was at absurdly low wages. Sketchy indeed. RT @carolynmichelle: OMG BURGER KING HAS A PRODUCT CALLED SATISFRIES JUST SHUT UP @xuenay not that hard unfortunately, see L. Ron Hubbard, Kumare Cooking up a blog post on automation/jobs...stay tuned! RT @jathansadowski: .@jessicakroy's awesme top 10 she won’t miss about being a “tech blogger.” If only other writers were so openly blunt h… @TerynNorris @MarkMuro1 Might be writing a blog post on that...see my most recent tweets for brief commentary @Skymediator_ENG Thanks! RT @mwilsonsayres: If you've never seen it, I present: Riker sits down: http://t.co/YEAR4OIONR. You're welcome. RT @mpshanahan: Excellent talk by @danieldennett at #ptai13. Brains as anarchic, competitive, free-markets subject to Darwinian forces. And… (3/3) about the use of job requirement data, namely that job requirements don't list things all humans can do, they discriminate btwn humans (2/3) #1. The paper is worth reading for the literature review alone - the best I've seen on automation economics. #2. I have reservations (1/3) two quick comments on the hot new paper estimating half of US jobs can be automated in foreseeable future (http://t.co/DzaDCp8OVR) @Skymediator_ENG They told me to fax. LOL. There's also a complaint section on their website but given how I was treated in person, umm..... @Skymediator_ENG Agreed but advice on making it happen? RT @sarahljaffe: Hey look the MacArthur grants can find women writers, scientists, computer programmers, and artists. http://t.co/3sIWLTwwWd Check out the site of the new Journal of Responsible Innovation - 3 issues next year. Spread the word/submit to it! http://t.co/sTJIFfvB4h @Skymediator_ENG they booked me 24 hours later but that would make me miss conference, bought new tix about 9 hrs later on diff airline RT @CSPO_ASU: CSPO/@cns_asu's new Virtual Institute of Responsible Innovation seeking part-time Communications/Program Coordinator http://t… There may be a president from a party which descended from the GOP but it will have a wholly different identity/name/demographic. (2/2) Prediction: there will never be a Republican president of the US again. (1/2) Can a fellow energy/climate change nerd please tell me(/link me to an article to tell me) what to think about the new EPA regs? Thought The Blacklist was pretty good, not life changing, though. Anyone else watch the premiere? If anyone has experience getting fair compensation from airlines, let me know. Got to deal w/ @British_Airways's BS this week, *sigh.* Which I'm reading right now btw. 2/3 of the way through. SO GOOD. Better than his also awesome The Whale and the Reactor. Cool to hear a Jacques Ellul shout out in an audience Q at an AI conference, though Autonomous Technology by Winner = better/more nuanced. Apparently it took 2 PhDs to "discover" that it sucks being poor and that poor people have brains. http://t.co/FQobRBt7fu RT @danieldewey: Dennett: words are the best example memes; words are memes that can be pronounced. (Also, brains, being computers, are "ne… Slides from my talk on AI and responsible innovation at #PTAI2013 today: http://t.co/ctFRRGAo9a RT @j2blather: Dennett #PTAI2013 Mind is a recent effect, not a cause. Darwin explains (away) the intelligent Creator, Turing the Godlike m… RT @j2blather: Dennett #PTAI2013 is NOT a fan of Friedman or Rand, but centrally planned economies don't work, nor centralised top-down bra… Wearing/reading name tags at a conference = kinda like a slice of our possible future w augmented reality RT @mark_riedl: Read more sci-fi http://t.co/abTZxkWxcd Learn abt ethical consequences of that not (yet) invented. (Using sci-fi to teach e… RT @j2blather: #PTAI2013 Müller so 50% experts think we’ll have human level ai by 2040, super intelligence soon after, 34% think that’s bad. @j2bryson thx! @j2bryson I agree (I think) - didn't mean to suggest the opposite. And I'll tweet a link to the paper when it's final or at least better :) Awesome keynote by Murray Shanahan on consciousness and the frame problem. Need to read more about global workspace theory. #PTAI2013 RT @EUCogNetwork: Murray Shanahan @mpshanahan keynote "Consciousness, AI, and the Frame Problem" at #PTAI2013 just started Live stream htt… Greeted by a player piano at Heathrow airport when arriving for an AI conference. #Vonnegut @danieldewey not what I planned (Fri afternoon arrival) and will be a pain to get @British_Airways to reimburse but at least I'll make it! @danieldewey if all goes well with my new flights I should touch down in London early tom. Hope to get to Oxford in time for Russell! Need to work on flights now bc not arriving in London a day early as planned, thanks @British_Airways! At least I will make it to PT-AI 2013 @ericbkennedy @British_Airways It's not like they said "anyone want to volunteer at X reward? ok, 2X?" and gave up. they wouldn't give any $ @ericbkennedy @British_Airways Will complain and try to get reimbursed for new flights. Also, the volunteer situation was even crazier.... @ericbkennedy @British_Airways (2/3) At this point BEST CASE scenario is I arrive in London two hours before it starts 2 hours away. @ericbkennedy @British_Airways (1/3) If I go with their proposed "solution" I will get miss several keynotes. Need to use other airlines. If @British_Airways will not help ticketholders get on plane in person, why expect fair reimbursement after the fact? They told me to Fax! @ericbkennedy I am having to shell out ANOTHER $1.5k. Please RT some of my rant! Or else doubtful @British_Airways will reimburse me fairly. @ericbkennedy With PLENTY of customers willing to give up seats. @British_Airways was too cheap to give a coupon for their own flights. @ericbkennedy Yup. Some combo of @British_Airways's power-tripping manager and profit-maximizing algorithms decided to bump 3 ticket-holders @British_Airways would rather put me on another one of their flights (and then maybe bump me again) than get me where/when I paid to get to. @British_Airways management thinks involuntarily bumped customers will eat their shit sandwich and not complain. False (for me, at least). (3/3) @British_Airways is perfect example of efficient software/policies trumping basic respect for customer, then employee blames computer. (2/3) @British_Airways, after significantly overbooking my flight, was too cheap to give coupons to volunteers so bumped 3 ticket-holders. (1/3) Delayed getting to conference to talk about ethics and AI because of @British_Airways's profit-maximizing AI/douchebag-y policies. RT @jathansadowski: How Dave Eggers Can Get Away with Stealing a Woman’s (@fake_train) Book about Facebook, or Patriarchy 101: https://t.co… RT @ashedryden: Dude friends: if you see a conf that should have more diversity, say something? There are too many for the few of us to tac… RT @WrongBotWrites: Ask questions in the correct order. "Is it true?" should come before "is it good that it's true?" RT @thisischristina: Old timey science paper methods section: “It would be tedious to relate here all that pertains to the technique of the… Heading to Oxford tomorrow for PT-AI 2013. Looking forward to temperatures about 40 degrees F lower and some very interesting discussions! RT @LOLGOP: DON'T GIVE UP, GOP. THE QUEST TO TAKE HEALTH INSURANCE FROM POOR PEOPLE SO THE RICH CAN PAY SLIGHTLY LOWER TAXES IS TOO IMPORTA… RT @sarahkendzior: .@fake_train @dkberman A Heartbreaking Work of Staggering Plagiarism @WillOremus IMHO bigger mistake than working on "autopilot" tech is thinking the ethical/legal/social issues will be resolved in 3 years. RT @RobotDiva: DC robotics briefing a success, more education still needed http://t.co/WCYcbfzmVQ via @BizOfRobotics RT @Liberationtech: Please RT | Fully Fund the NSF & Oppose Restrictions on SBE Science Research Funding http://t.co/FwOVwOoUbx "RT @MazzucatoM: Kindle price 'Entrepreneurial State: debunking Public vs. Private Sector Myths' falls £8.75 ($13.89) http://t.co/3ngZNUqH5T…" RT @EUCogNetwork: "What Does Watson 2.0 Tell Us About the Philosophy & Theory of AI?" Selmer Bringsjord keynote @ PT-AI Conference 21/22 Se… RT @nicomuhly: turns out "Steampunk Pacifiers" are a thing that 200% exist http://t.co/o5aK45r4jS RT @mburnamfink: I am reminded (in a good way) of @jathansadowski : "The Tech Intellectuals" http://t.co/fDrs5yEI26 RT @em_underwood: My latest: BRAIN Initiative Gets (a Little) More Detailed | Science/AAAS | News http://t.co/CACQWQTuy0 via @AddThis RT @VanJones68: Of course I am ... NOT!! But I sure support em. RT @VanJones68 So my dear, are you behind all the minimum wage protests acr… RT @femfreq: I support @carolynmichelle and the few game reviewers with the guts to discuss the rampant misogyny that permeates Grand Theft… RT @femfreq: Looks like the army of angry gamer dudes are on the warpath again today bravely defending the status quo. RT @mark_riedl: Microsoft's new Clippy will be... Cortana from Halo? http://t.co/j2XOyXFYDO RT @justinwolfers: Over the past decade, the net worth of the 400 richest Americans has more than doubled, to over $2,000,000,000,000. http… To really deal w/ unemployment beyond the next 5-10 years, we need a comprehensive policy dealing w/ education, tech., welfare, taxes, etc. I cannot think of an issue with anywhere near the elites-concerned-about to non-elites-concerned-about ratio than Fed Chairman decisions. Interesting that fastest R/C car can beat fastest produced car in 0-60/0-100 mph. How long till skill of pro drivers is also matched? Mine is probably the sustainability solution proposed by @SethBaum and Jacob Haqq-Misra but haven't looked in detail. http://t.co/a7gnKbpiqJ What is your favorite solution to Fermi's paradox? Or, if not solution, then dissolution/debunking, etc. of the alleged paradox. RT @mjg59: Transhumanism concept novel: 50 shades of Aubrey de Grey. @jathansadowski Lol...worse things could happen. Ron Moore is in that video, btw...some folks I've talked to weren't aware. <3 him so much! @jathansadowski Well, Noe and I extend an open invitation if you ever wanna come watch :) @jathansadowski I have all of it on Blu Ray...just sayin'. Buying @MargaretAtwood's new novel a week before I have to give a presentation = dangerous. No regrets, though. RT @dgolumbia: #Google can't find info: @ericschmidt says @evgenymorozov "is the only one" who doubts internet = democratization http://t.… RT @grok_: Interesting study. Dogs love robots, prefer humans: http://t.co/c8bkMDi1F0 RT @SethBaum: How culture/@cult_cognition influences #climate beliefs: nice @Yalee360 interview w Dan Kahan http://t.co/Ju31jjT8Cv via @Rev… RT @laurahelmuth: Smart and satisfying evisceration of "brogrammer as free speecy martyr" by @AuerbachKeller http://t.co/LYHkZCTwKp via @sl… @shimben27 still requires judgment to use that method i.e. fill in rest of Q, interpret results, etc and doesn't always help but often does. @shimben27 often need to press enter before end of sentence. Ex. Q about Burj al Dubai location, 1st result says also known as Burj al Dubai Gut feeling on topic: individual facts may be Googleable, but there is higher-order value in kids developing rich/interconnected worldviews. Anything good written on enduring value (or not) of having kids memorize facts that are easily Googleable vs. alternative uses of that time? Million Second Quiz=easier than Jeopardy- questions are explicit. What would be an AI-unfriendly but still competitive game show be like? Requires good query phrasing and quickly scanning results, but still easy. I suspect #Glass will not be allowed on game shows anytime soon.. Watching The Million Second Quiz [game show]. One can answer almost all questions via real-time Googling, even with five second time limit. RT @mark_riedl: There are a few things that humans are still better than computers at... http://t.co/bZBuZzSDWE (Nod to computational creat… RT @io9: Is the Peak-End Rule responsible for overlong movies? http://t.co/KOVkO4rAyt On Obama's (alleged) lack of clarity on Syria: stochastic action choice is sometimes optimal in multi-agent situations. #JustSaying http://t.co/PpiHMxwuAt RT @sirosenbaum: @Annaleen Gravity: matter experiencing loneliness. RT @etzioni: Your Annual Reminder to Ignore the <em>U.S. News & World Report</em> College Rankings - Atlantic Mobile http://t.co/iTILHsSyH2 RT @doctorow: Bookshelves of the ancients http://t.co/yt1o6GbT5Z Wonder what role if any Watson, driverless car hype, etc. have played in motivating recent surge in AI-themed sci-fi. Pretty high number (vs. last few years) of AI-centric TV shows/movies coming out this year/next. Almost Human, Prototype, Transcendence... My topic is interesting and important IMHO but hard to compete with the likes of Dan Dennett and Watson 2.0 and consciousness! Looking forward to lots of cool talks and getting feedback on my (perhaps less cool) talk next weekend at http://t.co/jkecdfCpjX! RT @VanJones68: "I would rather stumble into peace than blunder into war." -- @VanJones68 @CrossfireCNN #TeamVan #CrossfireReturns Very happy to see my brilliant boss of yesteryear, @VanJones68, co-hosting the rebooted CNN Crossfire. RT @rachelrosenfelt: My favorite thing ever is personally rejecting submissions that begin, "Dear Sirs..." RT @amcafee: Wish I was surprised. Saez finds that 99% of income gains during the recovery have gone to the 1% http://t.co/Ia8WxeSMQa Glad I was mugged for my iPhone before this RT@cstross Great! Now iPhone thieves have an incentive to chop off the tip of your index finger! @jathansadowski thanks for RT! *not to mention Google and others, but mainly interested in how big of a deal much more energy/time-efficient ANN simulating chips would be. Can fellow AI nerds recommend reading material on potential/limitations of neural networks? Trying to wrap head around IBM True North hype. RT @Slate: An unbelievably intricate drunken-monkey diorama, carved by a prisoner as a gift to Henry Ford--PHOTO: http://t.co/t9OOZfb8Mp #c… RT @VanJones68: Excited & humbled to represent the progressive voice on @CrossfireCNN on Tues night 6:30PM ET/3:30PM Et. #CrossfireReturns … RT @mark_riedl: NSF funds Center for Brains, Minds & Machines. Allen Institute for AI launched. Vigorous debate about goals of AI. Great ti… RT @ianbremmer: If Americans cared about Syria, this would be a serious crisis for the Obama Administration. Not the case. RT @normative: Reporters need to explain the difference between breaking crypto (which is NSA's job!) and promoting broken crypto (which sh… [re: last tweet] grant proposal here... http://t.co/75U6MBPctZ MIT/Harvard/others get big NSF grant for AI research. http://t.co/OujGSz7IHZ (via @MITnews) RT @laurenzumbach: Should All Software Engineers Be Required to Take an Ethics Course? http://t.co/h7kBKoU7L1 RT @sciam: Live 1pm EDT chat w/animal scientist/autism communicator Temple Grandin & Richard Panek on "The Autistic Brain" http://t.co/30vX… RT @AlyssaRosenberg: Nick Offerman as Manwich spokesperson is the most logical ad deal in history. RT @ianbremmer: If the same percent of adults were in the workforce today as when Obama took office, US #unemployment rate would be 10.8%. RT @Jackstilgoe: Davey: "Research Councils have agreed in principle to fund a joint responsible innovation study" on fracking #responsiblei… RT @rcalo: Contributed to this @nytimes @roomfordebate on the Internet of Things. http://t.co/rUVKqQB9QZ RT @Liberationtech: It's inconceivable that everyone isn't aware that @Google reads their emails to serve ads, company lawyer says http://t… RT @jathansadowski: Here's the NYTimes "Room for Debate" on the topic of "Privacy & the Internet of Things": http://t.co/CjOFYUmIz0 cc @one… RT @prof_jdb: STEM administrators could take some cues from Harvard Business re: taking gender equity seriously. Love that HBS admins are #… RT @j2bryson: @wendymoncur @ConversationUK did you see my article in Bereavement Care, “Internet Memory & Life After Death?” http://t.co/LM… "RT @siddhmi: Wow, @nytopinion today. Douthat: Credibility! Dowd: Barry! Must call him Barry! Kristof: Bomb them to save them! Friedman: ALL…" RT @Pogue: Do you read tech blogs? Then you’ll crack up at this parody Twitter account. Whoever you are, I think I love you. http://t.co/cD… Much rhetoric on NSA encryption revelation is misleading. They didn't "crack" encryption techniques - they used coercion to avoid having to. RT @HarveyKoh: Did you know Google's algorithm came out of Govt-funded research? It's the "Entrepreneurial State" @MazzucatoM http://t.co/e… RT @Ahaverine: ROBOCOP (2014) http://t.co/3yn2Fgc48O They're already doing remakes of the 1980's movies? RT @lookitsjulia: Tip: enjoy the action/horror scenes called Riddick at your local cinema, but if you ask for any context at all you will b… RT @patchurchland: Here is a cool NPR blog by Krulwich on my book Touching a Nerve http://t.co/MKZeL6lf9q RT @MachinesLikeUs: ROBOCOP - Official Trailer (2014) http://t.co/U1M3N7Hjmk RT @mark_riedl: Wow, this is huge! MT @etzioni Microsoft co-founder Paul Allen taps Oren Etzioni to lead new AI Institute: http://t.co/2QZt… RT @kapravel: probably the saddest graph ever shown in a CS conference. #Linux #tshirtsize http://t.co/RWBnTSJ2ip RT @erikbryn: Good news: Productivity up 2.3% last quarter. Bad news: labor force down 312K last month. #RaceAgainstTheMachine RT @ericbkennedy: @Miles_Brundage Attack of the drones begins! MT @cnnbrk: Man dies after remote-control heli hits him in the head. http://… RT @ArtificialOther: The Great Robotics Debate: Are Robots and Automation Destroying More Jobs Than They Are Creating? http://t.co/Cb3cINNS… Don’t thank an entrepreneur for innovation. Thank the government. http://t.co/ndbYR9sadx via @slate @jathansadowski And the answer is? Anything interesting? RT @RogerPielkeJr: Announcement of the 2014 Gordon Research Conference on S&T Policy is now out--> http://t.co/0725RF6NJr RT @ericoguizzo: Microsoft to acquire Nokia (http://t.co/Uh8Cwje1sX) http://t.co/98bhdrkjD5 RT @MazzucatoM: Very painful but funny entertainment: me vs. Tea Party on US radio. This is the state of debate in (much of) the US! http:/… RT @jathansadowski: Think about how much good a single editor could do in adding clarity and accessibility to academic writing. Plus, so ma… RT @astepanovich: Theme to government surveillance programs: Hide the program. If you need to show the evidence, use a second method. Unit … RT @j2bryson: A scientist isn’t just obliged to figure stuff out, they’re obliged to make sure people know the stuff they figured out. Uber/Google driverless car deal story is fake FYI. RT @j2bryson: Stopped waiting for #ijcai13 to archive S Russell, my, @SebastianThrun @HenryKautz & @anderssandberg #aiethics panel http://… Ready Player One = awesome book. Read it. Wow. - The Level-Headed School Clerk Who Talked the Ga. School Gunman Into Surrendering, via @JoshVoorhees http://t.co/2lggZmYKbC via @slate RT @lukeprog: "Preventing Human Extinction" by Nick Beckstead, Peter Singer, and Matt Wage. http://t.co/Gmoq9EufVP Loooooooool http://t.co/Xx88OkQS7O Amazon site down when I'm thinking about buying a book, arghh #firstworldproblems RT @NewYorker: Why can't your computer understand you? @GaryMarcus on artificial intelligence: http://t.co/NnuoSztq4K RT @lookitsjulia: Remember when we used to make fun of old people who clipped newspaper articles and sent them to each other? That's litera… RT @BarackObama: Gravity exists. The Earth is round. Climate change is happening. #ScienceSaysSo Google's Sergey Brin bankrolled world's first synthetic beef hamburger http://t.co/MR12NIFm96 via @guardian Finished The Race Between Education and Technology...excellent. Re: relationship btwn edu., tech., inequality in US. http://t.co/4k0fvJvHsr RT @io9: Father of artificial intelligence to be pardoned for being gay http://t.co/4SbN23BROc RT @jathansadowski: Ron Wyden's Warning: America May Be on Track to Become Surveillance State http://t.co/ucMKwBARHK my piece on the Senato… RT @FutureTenseNow: Psst. AI is not as smart as a 4-year-old child, says @Miles_Brundage http://t.co/BjSEEhiRpm RT @mdelachang: Awesome keynote from Maja Mataric of @USCViterbi on socially assistive robotics. #AAAI2013 #AAAI13 "During this talk 276 people died of TB, and we can help" - Kristin Bennett on AI-based visualization for public health workers @ #AAAI2013 RT @DougOfNashville: #aaai2013 Bennett: her team developed Bayesian network for id-ing TB sublineages; references to (Vitol et al 2006) inc… Excited for the start of AAAI 2013 tomorrow. Anyone else here for it? The Pixar Theory: all characters are in the same universe. Simultaneously very clever and absurd. Fun read. http://t.co/DnJXolc8vy The New Division of Labor (2004) - great book on technological change, employment, and wages. A few wrong predictions but overall worth it. RT @amcafee: Cover story of @techreview = argument by @erikbryn + me about tech and jobs, and other POVs on issue: http://t.co/3JPNz0KsiD RT @BillGates: If I had to pick one thing to make cheaper and reduce poverty, it would be energy. Great to see this news: http://t.co/ZiKqE… Exponential growth : 21st century :: freedom : 20th century. Necessary but not sufficient for good social outcomes. RT @RyanJahn: "We don't lack for ideas. We lack the connection to the problem that those ideas can solve." - Cheryl Martin (ARPA-E) RT @jathansadowski: "Governments and corporations gain more power and information from open data, but most people do not" –my new article h… RT @dalecarrico: @MikeAnissimov The smart funny relevant feminists of Jezebel will be sad to hear a stale pale male reactionary Robot Culti… I was two out of three with my DARPA Robotics Challenge predictions...IHMC did the best - not surprised. Seriously, have you tried streaming the Colbert Report or The Daily Show? It's a total disaster. Super sketchy illegal sites are WAY better. Society spends a bajillion $'s on military tech...we should be able to muster 100's of $'s for the Comedy Central sites to not be so awful. Looking forward to the first DARPA Robotics Challenge results on Thursday. My bet is CMU, one of the NASA-related teams, and IHMC do well. RT @MazzucatoM: Who Created the IPhone, Apple or the Government? http://t.co/gRadMDBisF via @BloombergView "Tech kills/creates jobs" misses the point- how can we be forward-looking about education, welfare + tech to build a just/prosperous future? 2 issues: 1. balance btwn privacy and security, 2. how much we should know about the balance. They're being conflated in lots of commentary. Final note on the Gates quote...he has previously referred to Kurzweil as the best person he knows at predicting the future of AI. 5x that = late this century. But Kurzweil's better known year is 2045 - Singularity hitting its stride. Maybe Gates was referring to that. Kurzweil predicts human level AI in about fifteen years, super AI soon after. Almost everyone in AI I am aware of disagrees. Interesting comment on its own, though I'm also intrigued by the pervasiveness of Kurzweil timeline comparisons. Also, still not that long. How long do you think human-level AI will take? "At least five times as long as Ray Kurzweil says." - Bill Gates. http://t.co/Q5qLshvpqw RT @ericoguizzo: A new robotics startup called Anki helped kick off Apple’s WWDC keynote today with a demo of its car-racing game http://t.… Petition to pardon Edward Snowden: https://t.co/5ah9UZY5t3 RT @Liberationtech: "You can't wait around for someone else to act. I had been looking for leaders but realized leadership is 1st to act," … RT @Liberationtech: "NSA routinely lies in response to Congressional inquiries about scope of #surveillance in America," NSA whistleblower … RT @AriMelber: So you'd have to skip a lot of history to think unchecked surveillance ends well. RT @nigelcameron: Next up: #Obama invites #Snowden around for beer. No? RT @le_feufollet: We need risk-takers! http://t.co/9tJzufA3xR RT @erikbryn: On PRISM: “As long as they’re using [it] to learn about my tastes & cater NSA products my way, I’m fine with it.” http://t.co… RT @richardcaperton: Oh, look: the official gov't estimate of the social cost of carbon just went up ~50%. http://t.co/Yn32wBkApR RT @MarkMuro1: Elon Musk's "reality distortion field" is beginning rival Steve Jobs.' Cf @TeslaMotors @SpaceX @solarcity http://t.co/4b9iNl… RT @JenLucPiquant: Remember the DOROTHY sensors in "Twister"? Reality catches up with sci-fi in storm drones http://t.co/JzuE6otzcw via @CB… RT @bonniegrrl: Google disallows facial recognition in Glass apps... "At this time." http://t.co/dPBVdZzCRs RT @brainpicker: "There is no such thing as philosophy-free science," just science unaware of its underlying philosophical assumptions http… RT @izakaminska: Isaac Asimov predicted in 1965 that self-driving cars would become a hot new invention in 2014. http://t.co/2LdpJrHLpR RT @Liberationtech: UN High Level Panel of Eminent Persons on the Post-2015 Development Agenda http://t.co/h2Q4610z0x We need a social safety net. Being a bajillion dollars in debt forever probably isn't good. How hard it is to acknowledge both of these? If robots were the first intelligent life forms and then built human-driven cars, they would not be able to get them certified as safe. RT @jathansadowski: Searing review -from @evgenymorozov- of The New Digital Age by Eric Schmidt & Jared Cohen http://t.co/Z40jbjpz3X RT @Liberationtech: Tech Advocates Want Us to Live in an Open Data Society Where We Can't Even Read Our Own Data? http://t.co/cj518AhDTc RT @rcalo: Company writes facial recognition app for Google Glass. Scooby Doo says "ruh roh." http://t.co/Vlf1LMJTsd RT @jathansadowski: Its a civic duty, really. RT @evankindley: "Reading the half-assed … to warn people off": the role of the book reviewer. RT @ARPAE: Congratulations to @ARPAE's @makanipower! We look forward to seeing how you continue to change what's possible with Google X. RT @PeterSinger: I'm excited that my TED talk on effective altruism has reached 100,000 views in 2 days! Spread the word: http://t.co/PMqHO… RT @FutureTenseNow: World's smartest computer to take job as a call-center agent http://t.co/NU5up46iZe by @WillOremus RT @bruneski: President #Obama can make a strong commitment to fight #climate change. Or pursue an "all of the "above" fuels policy. He can… RT @lukeprog: My thoughts on the difficulty of estimating AI timelines: http://t.co/NEFtFF9rzu RT @erikbryn: In light of Google's D-Wave purchase @GaryMarcus looks at the feasibility of quantum computing http://t.co/hYIlzF6CbV RT @sapinker: Is empathy overrated? Paul Bloom on the baby in the well & other distorters of the moral sense -http://t.co/xJ9ZZJMq5q RT @Liberationtech: Why High Schools Should Treat Computer Programming Like Algebra http://t.co/1eWXWdGKkr by @JHWeissmann RT @rcalo: Congress sends letter to @Google asking about Glass #privacy. http://t.co/VikojBFaMK (HT @ConcertoMates) RT @neiltyson: Odd that for many people, the less data that support their beliefs the more ardently they'll defend them, even w/ their lives RT @grok_: My #rp13 talk on social robots: http://t.co/ed7DlqZBVC RT @nigelcameron: It is a remarkable thing the extent to which smart people focus on finding the right answers in place of asking what are … @MikeAnissimov why? Parks and Rec is great. You can skip the first season without any significant consequences, though, the second season is better. RT @TheAlexKnapp: Not a hint of skepticism or challenge? Wow. http://t.co/yLuEZqgoPk "RT @stopthecyborgs: #cyborgs How do we extend discussion of human rights, freedoms and equality to include the extended mind extended body …" I'm extremely concerned about the security implications of homemade weapons but I thought the term "WMD" refers to something more than that. Am I the only one who finds it surprising/problematic that a pressure cooker filled with explosives and ball bearings is considered a WMD? RT @amyleerobinson: Man + Machine > either alone. Plus: the economy overlooked by GDP. My fav talk of TED2013 from @erikbryn: http://t.c… RT @AlexSteffen: "The greatest problem that our economy faces today is not a lack of growth but decades of unproductive growth." —Chuck Mar… RT @glennbeck: I despise this terrorist and all that he has done but we must not lose who we are. HE IS AN AMERICAN. Read him his rights! W… RT @Slate: Here's how they used a robot and thermal cameras to catch Dzhokhar Tsarnaev: http://t.co/X9rK71M13N Recommended. Great perspective on visions of techno-futures, their role in society/academia, etc. Many parallels to Singularity stuff (2/2) The Visioneers: How a Group of Elite Scientists Pursued Space Colonies, Nanotechnologies, and a Limitless Future by W. Patrick McCray (1/2) Video of my talk "Limitations and Risks of Machine Ethics" at the Winter Intelligence Conference a few months back - http://t.co/7HONfk4ykm How does Kurzweil not get bored from saying the same thing at every event for decades? Also, he is *obviously* getting old. Just sayin'. RT @stevesilberman: Before bitching about taxes, ask yourself who was paying all those first responders in Boston today. RT @pesska: Google chief "How would you feel if your neighbour went over and bought a commercial observation drone?" http://t.co/BCq8228O7C RT @andyhickl: The power of Google Glass right now is in getting people to think about the tradeoffs between privacy and potential. http ... RT @sapinker: Fewer nations carry out executions - at this rate, capital punishment will be extinct by 2026 - http://t.co/4mAJmEqyrX RT @io9: Screencaps reveal the wonder and squalor of Neill Blomkamp's first #Elysium trailer http://t.co/zNPoudYjvO RT @grok_: To follow and participate in the open robot ethics movement, check out http://t.co/mHSXb7ELaO #WeRobot2013 RT @BotJunkie: Is it ethical (or effective) to try to crowdsource ethics? #WeRobot2013 RT @BotJunkie: Gun manufacturers are protected against actions of end users, perhaps robot manufacturers need similar protections? #WeRo ... RT @RoboEthics: Dear #Roboethics friends, Open Roboethics initiative has a twitter account! Follow us at @OpenRoboethics RT @amcafee: What's scarier than a humanoid robot? A humanoid robot in camouflage: http://t.co/CCV8psIsA6 RT @nigelcameron: Duh RT @Liberationtech: .@Stanford's Condoleezza Rice says declining schools pose a threat to US national security htt ... US plans to send humans to an asteroid by 2025: http://t.co/7RrynXg3xv RT @rcalo: If you were not able to register for We Robot 2013 (capped at 150!), please tune in to @robohub coverage with guest blogger @ ... RT @CoralMDavenport: Something you may not know about White House chief of staff Denis McDonough:his deep background on #climate change. ... RT @GaryMarcus: Angry Birds meets the Turing Test! AI Smackdown in Beijing! #artificialintelligence #AI #deeplearning? http://t.co/tvskD ... RT @m4ttjames: Obama plans 2 map and unlock mystery of the #BRAIN. Ethics cmte 2 oversee but why not ethics/values throughout? http://t. ... Also, $10 mill/year for a decade is chump change compared to other research priorities, EU brain investments, etc. BRAIN initiative doesn't seem to be anything bold or new...ex. obv DARPA was already going to spend lots of $ on brain/AI stuff this decade For any interested in AI, these slides re: the state of the art are great. Robot Futures also good re: social impact. http://t.co/eKYD0IbDvJ @RoboEthics Hi! I'd be curious to hear your take on the book - I liked it/thought it filled a hole in the lit, though prob too deterministic @MarkMuro1 Thanks for sharing. Have you written on this? I've been looking a bit at related issues recently (IT/clean energy/jobs links) Anyone read Automate This or Imaginary Futures? Just finished Robot Futures by Illah Nourbakhsh, about plausible developments in robotics this century and their implications. Recommended. Good article on the need for responsible geoengineering research: http://t.co/khSPWPT02U RT @io9: Who should be responsible when your robotic surgeon f*cks up? http://t.co/7IazBTxPPZ I have a blog post up about energy tech breakthroughs in context - http://t.co/GVZnw0tvO7 RT @CSPO_ASU: Energy Technology Breakthroughs in Context http://t.co/OZIkMEbMjE RT @nigelcameron: RT @CoryBooker: RT @retrogirladdy: My husband and I are in an interracial marriage.Miscegenation laws were put into pl ... RT @billmckibben: The coal industry uses up 15% of China's freshwater. http://t.co/oOnAmav6Qn RT @RoboEthics: RoboethicsInfoDB: New Book: "Robot Futures" by Illah Reza Nourbakhsh: http://t.co/kgGCUEq6aT RT @erikbryn: .@Richard_Florida gets it right: "it won't be technology that defines our future. It will be our ability to mold it." http ... RT @Elise_Andrew: 2 surveys in a sanctuary in Sri Lanka have uncovered 8 new species of frog. 7 of the 8 are thought to be endangered. h ... RT @BotJunkie: @heatherknight @rcalo Drone flies into a bar, asks for private table. Bartender says, "you can't reasonably expect that" ... RT @lukeprog: The wealthiest Americans donate 1.3 percent of their income; the poorest, 3.2 percent. What's up with that? http://t.co/cf ... Reading "Manna: 2 Visions of Humanity's Future" [viz-a-viz AI/robots]. Only 2 visions so narrow, obv, but reasonable concerns. Recommended. RT @jathansadowski: Electronic Communications Privacy Act will likely get an update that adds more protection to email http://t.co/nP5J0 ... Very interesting interview with Ray Kurzweil about his new gig at Google focusing on natural language understanding. http://t.co/Wn72i2m60N RT @jathansadowski: ICYMI, my critical essay about Google Glass came out in @newinquiry yesterday http://t.co/A4SMtMCXfY " Welcome to an Internet without privacy, and we've ended up here with hardly a fight." - http://t.co/wxcEWQzkkl RT @MarkMuro1: RT “@ryanjtracy: How DOD, DOE, and the street are thinking about securitizing renewables. Wd be a cost game-changer. http ... RT @katiefehren: There’s high trust in clean power despite the negative headlines http://t.co/lc83iYi8gj RT @bradplumer: RT @mattyglesias White House infographic on Energy Security Trust contains approximately zero actual information: http:/ ... RT @NREL: Transportation Energy Futures Study Reveals Potential for Deep Cuts to Petroleum Use and Carbon Emissions - http://t.co/pbvcam8DgW "NYT's Broder says Obama gave up on carbon tax as if fact. Did I miss this being leaked or just him stating conv. wisdom? @clarkamiller" RT @sapinker: Gary Marcus on Why Obama’s Brain-Mapping Project Needs Theorists http://t.co/YjEYf3kY34 Ignoring heuristics, approximate/probable solutions, etc. obv. But a super fast computer using those methods might just fail super fast. Thinking recently about expo. growth in computing power being overrated - only allows linear growth in size of hard probs solved...thoughts? RT @jathansadowski: "It is easier to collect massive amounts of data than to understand them." http://t.co/LvZtkPkGVK To those who count on Moore's Law...have you compared the last two computers you've bought in terms of price/cost? Moore's Law is dead. Why nobody gets anything done on the Internet - http://t.co/j3B3JkICGR @jathansadowski RT @heatherknight: "Logic will get you from A to B, Imagination will take you everywhere" -Albert Einstein http://t.co/zNrgnpoqZr RT @jathansadowski: "I would rather see an end to bad privacy law than an end to drones" -op-ed by @rcalo http://t.co/324acPICtT RT @jathansadowski: "The more I used Glass the more it made sense to me; the more I wanted it." http://t.co/F0tLPhRRnd cc @EvanSelinger RT @CoralMDavenport: Steep cuts to @EPAgov budget kneecaps the agency's ability to enforce clean air and #climate regs. http://t.co/FWSZ ... RT @FutureTenseNow: For more from Brad Allenby, read his @Slate piece on what "truth" will mean in the future http://t.co/gJykv1MFD3 #em ... Fascinating stuff. I have Nicolelis's book (Beyond Boundaries) but haven't read it yet, looking forward to it. http://t.co/FBfNCvrAx6 RT @clarkamiller: RT “@UNIDO: #energy for all newsletter: February 2013 http://t.co/RKSywVigl8” #responsibleinnovation @asulightworks @clarkamiller interesting that the main cryonics company is just a few miles away! I'm sure they would have some thoughts :) RT @LoriHidinger: Dan Sarewitz: more important than being able to tell truth from false is being able to deal with many truths world thr ... RT @davelevitan: Another @arpae #eis13 dispatch for @IEEESpectrum: Energy Storage Front and Center at ARPA-E Summit http://t.co/9SVCzI04eW RT @clarkamiller: #eis13 ARPA-E, ARPA-D: we need an ARPA-P, an institution focusing as much attention on the need for radical policy inn ... RT @KevinBullis: ARPA-E strength: bringing together researchers and companies. What it can't do: http://t.co/UqiS9ZCn8I #eis13 RT @jathansadowski: Now that Cass Sunstein is no longer in his government position the man will *not* stop writing. He's flooding the ma ... #ifihadglass I'd research/write/publish a paper on how people react to Glass and how this varies based on context, who's wearing it, etc. RT @climateprogress: Dust Bowl Days: Historic U.S. Drought Projected To Persist For Months, Worsened By Thin Western Snowpack http://t.c ... Heading out tomorrow to attend the ARPA-E Energy Innovation Summit 2013! Will write about my experiences at http://t.co/eMvIWKFyva #eis13 RT @ARPAE: Are you a student passionate about energy? Register now for FREE access to the ARPA-E Virtual Summit at http://t.co/CmddfatJ2 ... RT @ARPAE: @gigaom and @greentechmedia will be broadcasting Summit panels FREE on Monday! Visit http://t.co/ScjuhZGvtz for more details. ...