Naked Science Forum

On the Lighter Side => New Theories => Topic started by: smart on 29/03/2018 18:42:18

Title: Is it possible to reverse engineer or exploit artificial intelligence systems?
Post by: smart on 29/03/2018 18:42:18
Is it possible to "reverse engineer" artificial intelligence systems in order to warrant the democratization of public research in neuroscience?

What do you think?

tk
Title: Re: Is it possible to reverse engineer or exploit artificial intelligence systems?
Post by: Kryptid on 29/03/2018 22:51:56
I'm not exactly sure what you're asking, but any computer system can be hacked in principle.
Title: Re: Is it possible to reverse engineer or exploit artificial intelligence systems?
Post by: evan_au on 30/03/2018 04:01:16
Quote from: tkadm30
Is it possible to "reverse engineer" artificial intelligence systems
Yes, some of the training material used by AI researchers is available on the web.
- You could feed that into your own Neural Network and come up your own AI.
- You are effectively recreating what the researchers did in creating their AI

Or you could do what these researchers probably did, and trawl the internet for training material.
- For a self-driving car, you can get more training material by mounting the appropriate sensors on cars driven by human drivers.

But once you have a working AI, you have to test it under a wide variety of conditions.
- For a self-driving car, you can put it on real roads, with a human safety driver, ready to jump in if things get out of control.
Title: Re: Is it possible to reverse engineer or exploit artificial intelligence systems?
Post by: smart on 30/03/2018 18:50:03
Suppose I want to demonstrate security vulnerabilities in artificial intelligence systems. Is the best way to penetrate the system is through the frontdoor or backdoor?

In specific, let's say it's possible for a remote attacker to send mangled commands to a host device in order to compromise the system in order to gain access to internal/private data. What would be the best defense or counter-measure to mitigate this threat?
Title: Re: Is it possible to reverse engineer or exploit artificial intelligence systems?
Post by: evan_au on 31/03/2018 23:57:41
Quote from: tkadm30
Suppose I want to demonstrate security vulnerabilities in artificial intelligence systems.
It's fairly easy - these researchers have automated the demonstration of security vulnerabilities in Artificial Neural Networks.
The examples are amazing, and begin at about 40 seconds.

Database Error

Please try again. If you come back to this error screen, report the error to an administrator.
Back