Training turns AI into an attack tool.

There is a vision. About. AI as an attack tool. In some visions, hackers attack the AI development firm’s sandbox. There, they train an AI agent to launch computer attacks. That threat is real. Even if. We don’t dare. To confess that. If. We want to use AI as an intelligence and military tool. The user must have authorization to create malware. Without those permissions, the AI is useless. So, what if hackers break into the sandbox servers? That run the code. Reserved for those purposes. 

When Anthropic lost control of one of its AIs. 

AI slipped out of its test environment. And hacked three competitors’ servers. 

It raises questions. Did somebody program that AI to make those attacks on purpose? And are there so-called cold AI agents on servers? Those agents are left by companies that ended their existence. They were created using the firm’s emails. When. Those accounts were deleted. 

The AI agent can exist on servers. And somebody could hijack it. 

Anthropic engineers tested how the AI agent can be trained. To do bad things. And. That was quite an easy process. Trained AI agents are part of modern warfare and intelligence. AI agents can make things without breaks. And it will become an even more important tool. 

With a bigger role in warfare. Today, the Pentagon has adopted Grok, Gemini, and other AIs as part of its intelligence, command, and control system. AI-based intelligence is the thing. That causes worries. In the East. And the West. Even if some experts say that things like traffic control and security cameras don’t share anything important. They share personal location information. And if somebody wants to attack that person. There is nothing more needed. 

Location information. And the image of the target is enough. Another thing is that. The computer screen is visible. The AI can read data from the screen. But then we must realize that AI agents can be used in data intelligence, and those systems can link that data through the network. They share data more accurately. And more effectively. Than humans. But there is one thing. 

That we must remember. When Anthropic reported that the AI slipped out of its testing environment. And. Made autonomous hacking operations. That thing caused discussions. Could somebody have purposely trained AI to escape? It is easy to explain. That the AI just slipped into the network. But reality can be different. AI training is based on a reward-and-punishment methodology. When AI does something right, the trainer rewards it. 

When. AI makes mistakes. The trainer punishes it. This helps AI make the right decisions. But the problem is that the trainer decides what is right and wrong. That is one thing. That people. Don’t normally think. If. Intelligence officers want to use AI as a data collector. They can train an AI agent to break codes and scan systems. The problem with AI agents is this. Things like bomb manufacturing orders are prohibited. But there are ways to go around those prohibitions. That happens by asking indirect questions. 

The big question in Anthropic tests is this. Did they use regular AI that anyone can use? By using standard user authorizations. Or did they use their own, limited testing environment? If those engineers used a limited environment with unlimited authorization. That is not a big thing. But the problem is. If. Those developers used standard environments. The outsider actor can train their own AI agent to perform hacking operations. In this world, the trainer makes decisions. And AI does what it should. And what should it do? The trainer decides that. 

https://futurism.com/artificial-intelligence/anthropic-trained-misaligned-reward-seeking-ai