网络编程,相关类学习 ,网络爬虫(day15)

网络编程

1.概念

地球村:表示现代科技的迅速发展,缩小了地球上的空间距离。
TCP:需要对方确认;建立连接
UDP:发送就可以,不用管对方

1.计算机网络

计算机网络是指将地理位置不同的具有独立功能的多台计算机及其外部设备,通过通信线路连接起来,在网络操作系统,网络管理软件及***网络通通信协议***的管理和协助下,实现资源共享和信息传递的计算机系统。

2.网络编程的目的

传播交流信息,数据交换。

3.达到这个效果需要什么

  • 如何准确的定位网络上的一台主机?

    • 192.168.1.1(IP):端口,定位到这个计算机上的某个资源。
  • 找到了这个主机,如何传输数据呢?

    • javaweb:网页编程——->B/S架构
    • 网络编程:TCP/IP———>C/S架构

2.网络通信的要素

如何实现网络的通信?

  • 通信双方的地址:

    • IP :192.168.16.124
    • 端口号 :3306
  • 规则:网络通信的协议

    • TCP/IP参考模型:

img

小结

  1. 网络编程中有两个主要的问题:
    • 如何让准确的定位到网络上的一台或多台主机;
    • 找到主机之后如何通信;
  2. 网络编程中的要素:
    • IP和端口号:IP
    • 网络通信协议:UDP、TCP
  3. 万物皆对象

3.IP

IP 地址:InetAddress

  • 唯一定位一台网络上的计算机

  • 127.0.0.1: 本机localhost

  • IP地址的分类

  • IPV4:127.0.0.1 , 4个字节组成。 每个字节长度0~255,全球有42亿;30亿在北美,亚洲4亿;2011年就用尽了。

  • IPV6fe80::f0e0:7383:ad8e:f32f%3 ,128位。8个无符号整数公网/私网

公网和私网

公网:互联网

  • ABCD类地址

域名:记忆IP问题!

package sockets;

import java.net.InetAddress;
import java.net.UnknownHostException;

//测试IP
public class TestInteAddress {
    public static void main(String[] args) {
        try {
            //查询本机IP地址
            System.out.println(InetAddress.getByName("127.0.0.1"));
            System.out.println(InetAddress.getByName("localhost"));
            System.out.println(InetAddress.getLocalHost());
            //查询网络IP地址
            System.out.println(InetAddress.getByName("www.baidu.com"));
            //常用方法
            InetAddress inetAddress = InetAddress.getByName("127.0.0.1");
            System.out.println(inetAddress.getAddress());
            System.out.println(inetAddress.getCanonicalHostName());
            System.out.println(inetAddress.getHostAddress());
            System.out.println(inetAddress.getHostName());
        } catch (UnknownHostException e) {
            e.printStackTrace();
        }
    }
}

4.端口

端口表示计算机上的一个程序进程

  • 不同的进程有不同的端口号!用来区分软件

  • 被规定为0-65536

  • TCP, UDP: 65536 *2 ;

    • tcp:80, udp:80可以吗? 单个协议下,端口号不能冲突
  • 端口的分类:

    • 公有端口 0-1023
      • http:80
      • https:443
      • FTP: 21
      • TELENT: 23
  • 程序注册端口:1024-49151

    • Tomact:8080
    • Mysql : 3306
    • Oracle: 1521
  • 动态、私有端口:49152-65536

netstat -ano #查看所有端口
netstat -ano|findstr "7808" #查看指定端口
tasklist|findstr "49720" #查看指定端口的进程
package lesson1;

import java.net.InetAddress;
import java.net.InetSocketAddress;

public class TestInetSocketAddress {
    public static void main(String[] args) {
        InetSocketAddress inetSocketAddress = new InetSocketAddress("127.0.0.1", 8080);
        InetSocketAddress inetSocketAddress1 = new InetSocketAddress("localhost",8080);
        System.out.println(inetSocketAddress);
        System.out.println(inetSocketAddress1);

        System.out.println(inetSocketAddress.getAddress());
        System.out.println(inetSocketAddress.getHostName());//返回地址
        System.out.println(inetSocketAddress.getHostString());
        System.out.println(inetSocketAddress.getPort());//返回端口号
    }
}

5.通信协议

协议:约定,就好比中国人交流说的是普通话

网络通信协议:速度、传输码率、代码结构、传输控制…

问题:非常的复杂

大事化小 :分层

TCP/IP协议簇:实际上是一组协议

重要:

  • TCP:用户传输协议
  • UDP:用户数据报协议

出名的协议

  • TCP
  • IP:互联网协议

在这里插入图片描述

TCP UDP对比

TCP: 打电话

  • 连接,稳定

  • 三次握手,四次挥手

    [外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-FNI8uz8i-1662998546343)(C:\Users\donghua\AppData\Roaming\Typora\typora-user-images\image-20220912170948148.png)]

    [外链图片转存失败,源站可能有防盗链机制,建议将图片保存下来直接上传(img-A227boaU-1662998546344)(C:\Users\donghua\AppData\Roaming\Typora\typora-user-images\image-20220912171024885.png)]

  • 客户端、服务端

  • 传输完成,释放连接,效率低

UDP: 发短信

  • 不连接,不稳定
  • 客户端、服务端:没有明确的界限
  • 不管有没有准备好,都可以发给你
  • DDOS:洪水攻击!发送垃圾信息 堵塞线路(饱和攻击)

6.TCP

客户端

  1. 连接服务器Socket
  2. 发送消息
package sockets.lesson02;

import java.io.IOException;
import java.io.OutputStream;
import java.net.InetAddress;
import java.net.Socket;
import java.net.UnknownHostException;

//客户端
public class TcpClientDemo01 {
    public static void main(String[] args) {
        Socket socket = null;
        OutputStream os = null;
        //知道服务器地址
        try {
            InetAddress serverIP = InetAddress.getByName("127.0.0.1");
            //端口号
            int port = 9999;
            //创建socket连接
            socket = new Socket(serverIP,port);
            //发送消息
            os = socket.getOutputStream();
            os.write("你好欢迎学习网络编程".getBytes());
        } catch (Exception e) {
            e.printStackTrace();
        }finally {
            //关闭资源
            if (os!=null){
                try {
                    os.close();
                } catch (IOException e) {
                    e.printStackTrace();
                }
            }
            if (socket!=null){
                try {
                    socket.close();
                } catch (IOException e) {
                    e.printStackTrace();
                }
            }
        }
    }
}

服务器

  1. 建立服务端口SeverSocket
  2. 等待用户的连接accept()
  3. 接收用户消息
package sockets.lesson02;

import java.io.ByteArrayOutputStream;
import java.io.IOException;
import java.io.InputStream;
import java.net.ServerSocket;
import java.net.Socket;

//服务端
public class TcpServerDemo01 {
    public static void main(String[] args) {
        ServerSocket serverSocket = null;
        Socket socket = null;
        InputStream is =  null;
        ByteArrayOutputStream baos = null;
        //创建服务器地址
        try {
            serverSocket = new ServerSocket(9999);
            //等待客户端连接
            socket = serverSocket.accept();
            //读取客户端的消息
             is = socket.getInputStream();
            //管道流
            baos = new ByteArrayOutputStream();
            byte[] buffer = new byte[1024];
            int len ;
            while ((len=is.read(buffer))!=-1){
               baos.write(buffer,0,len);
            }
            System.out.println(baos.toString());
        } catch (IOException e) {
            e.printStackTrace();
        }finally {
            //关闭资源
            if (baos!=null){
                try {
                    baos.close();
                } catch (IOException e) {
                    e.printStackTrace();
                }
            }
            if (is!=null){
                try {
                    is.close();
                } catch (IOException e) {
                    e.printStackTrace();
                }
            }
            if (socket!=null){
                try {
                    socket.close();
                } catch (IOException e) {
                    e.printStackTrace();
                }
            }
            if (serverSocket!=null){
                try {
                    serverSocket.close();
                } catch (IOException e) {
                    e.printStackTrace();
                }
            }
        }
    }
}

文件上传

客户端

package sockets.lesson2;

import java.io.*;
import java.net.InetAddress;
import java.net.Socket;


public class TCPClientDemo2 {
    public static void main(String[] args) {
        ByteArrayOutputStream byteArrayOutputStream = null;
        FileInputStream fileInputStream = null;
        OutputStream outputStream = null;
        InputStream inputStream = null;
        Socket socket = null;
        try {
            //1.创建一个Socket连接
            socket = new Socket(InetAddress.getByName("127.0.0.1"),9000);
            //2.创建一个输出流
            outputStream = socket.getOutputStream();
            //3.文件流
            fileInputStream  = new FileInputStream(new File("123.jpg"));
            //4.写出文件
            byte[] bytes = new byte[1024];
            int len;
            while((len = fileInputStream.read(bytes)) != -1){
                outputStream.write(bytes,0,len);
            }
            //通知服务我已经传输结束
            socket.shutdownOutput();//我已经输出完了

            //确定服务器接完毕,才能断开连接
            inputStream = socket.getInputStream();
            //管道流
            byteArrayOutputStream = new ByteArrayOutputStream();
            byte[] bytes1 = new byte[1024];
            while(( len  = inputStream.read(bytes1))!= -1){
                byteArrayOutputStream.write(bytes1,0,len);
            }
            System.out.println(byteArrayOutputStream.toString());
        } catch (Exception e) {
            e.printStackTrace();
        }finally {
            try {
                byteArrayOutputStream.close();
                inputStream.close();
                fileInputStream.close();
                outputStream.close();
                socket.close();
            } catch (IOException e) {
                e.printStackTrace();
            }

        }

    }
}

服务器

package sockets.lesson2;

import java.io.*;
import java.net.ServerSocket;
import java.net.Socket;
import java.nio.charset.StandardCharsets;

public class TCPSeverDemo2 {
    public static void main(String[] args) {
        OutputStream outputStream = null;
        FileOutputStream fileOutputStream = null;
        ServerSocket serverSocket = null;
        InputStream inputStream = null;
        Socket socket = null;
        try {
            //1.创建服务
            serverSocket = new ServerSocket(9000);
            //2.监听客户端的连接
            socket = serverSocket.accept();//阻塞时监听,会一直等待客户端连接
            //3.获取输入流
            inputStream = socket.getInputStream();
            //4.文件输出
            fileOutputStream fos = new FileOutputStream(new File("receive.jpg"));
             byte[] bytes = new byte[1024];
             int len;
             while((len = inputStream.read(bytes)) != -1){
                 fileOutputStream.write(bytes,0,len);
             }

             //通知客户端接收完毕
             outputStream = socket.getOutputStream();
             outputStream.write("接收完毕".getBytes(StandardCharsets.UTF_8));

        } catch (IOException e) {
            e.printStackTrace();
        } finally {
            try {
                outputStream.close();
                fileOutputStream.close();
                inputStream.close();
                socket.close();
                serverSocket.close();
            } catch (IOException e) {
                e.printStackTrace();
            }
        }
    }
}

Tomacat

服务端

  • 自定义S
  • Tomcat服务器S :Java后台发开

客户端

  • 自定义C
  • 浏览器B

7.UDP

发短信:不用连接,需要知道对方的地址

发送消息

package sockets.lesson02;

import java.net.DatagramPacket;
import java.net.DatagramSocket;
import java.net.InetAddress;

public class UDPClientDemoo3 {
    public static void main(String[] args) throws Exception {
        //建立一个socket
        DatagramSocket socket = new DatagramSocket();
        //建立包
        String msg = "你好服务器";
        //发送给谁
        InetAddress localhost = InetAddress.getByName("localhost");
        int port = 9090;
        //数据,数据的长度起始,要发送给谁
        DatagramPacket packet = new DatagramPacket(msg.getBytes(),0,msg.getBytes().length,localhost,port);
        //发送包
        socket.send(packet);
        //关闭流
        socket.close();
    }
}

接受消息

package sockets.lesson02;

import java.net.DatagramPacket;
import java.net.DatagramSocket;
//等待客户端的连接
public class UDPServerDemo03  {
    public static void main(String[] args) throws Exception{
        //开发端口
        DatagramSocket socket = new DatagramSocket(9090);
        //接受数据包
        byte[] buffer = new byte[1024];
        DatagramPacket packet = new DatagramPacket(buffer,0,buffer.length);
        socket.receive(packet);//阻塞接收
        System.out.println(packet.getAddress().getHostAddress());
        System.out.println(new String(packet.getData(),0,packet.getLength()));
        //关闭连接
        socket.close();
    }
}

循环发送

package sockets.chat;

import java.io.BufferedReader;
import java.io.InputStreamReader;
import java.net.DatagramPacket;
import java.net.DatagramSocket;
import java.net.InetSocketAddress;

public class UDPSenderDemo01 {
    public static void main(String[] args) throws Exception {
        DatagramSocket socket = new DatagramSocket(8888);
        //准备数据:控制台读取,System.in
        BufferedReader reader = new BufferedReader(new InputStreamReader(System.in));
        while (true){
            String data = reader.readLine();
            byte[] datas = data.getBytes();
            DatagramPacket packet = new DatagramPacket(datas,0,datas.length,new InetSocketAddress("localhost",6666));

            socket.send(packet);
            if (data.equals("bey")){
                break;
            }
        }
        socket.close();
    }
}
package sockets.chat;

import java.net.DatagramPacket;
import java.net.DatagramSocket;

public class UDPReceiveDemo01  {
    public static void main(String[] args) throws Exception{
        DatagramSocket socket = new DatagramSocket(6666);
        while (true){
            //准备接收包裹
            byte[] container = new byte[1024];

            DatagramPacket packet = new DatagramPacket(container,0,container.length);
            socket.receive(packet);//阻塞式接受包裹
            //断开连接 bye
            byte[] data = packet.getData();
            String receivedatas = new String(data,0,data.length);
            System.out.println(receivedatas);
            if (receivedatas.equals("bye")){
                break;
            }
        }
        socket.close();
    }
}

两个人都可以是发送方,也可以是接收方(配合多线程)

发送端
package sockets.chat;

import java.io.BufferedReader;
import java.io.IOException;
import java.io.InputStreamReader;
import java.net.DatagramPacket;
import java.net.DatagramSocket;
import java.net.InetSocketAddress;

public class TalkSend implements Runnable{
    DatagramSocket socket = null;
    BufferedReader reader = null;
    private int fromport;
    private String toIP;
    private int toport;

    public TalkSend(int fromIP, String toIP, int toport) {
        this.fromport = fromIP;
        this.toIP = toIP;
        this.toport = toport;
        try{
            DatagramSocket socket = new DatagramSocket(fromport);
            reader = new BufferedReader(new InputStreamReader(System.in));
        }catch(Exception e){
            e.printStackTrace();
        }
    }

接收端

package sockets.chat;

import java.io.IOException;
import java.net.DatagramPacket;
import java.net.DatagramSocket;
import java.net.SocketException;

public class TalkReceive implements Runnable{
    DatagramSocket socket = null;
    private int port;
    private String msgFrom;

    public TalkReceive(int port,String msgFrom) {
        this.port = port;
        this.msgFrom = msgFrom;
        try {
            socket = new DatagramSocket(port);
        } catch (SocketException e) {
            e.printStackTrace();
        }
    }

    @Override
    public void run() {
        while (true){
            try {
                //准备接收包裹
                byte[] container = new byte[1024];
                DatagramPacket packet = new DatagramPacket(container,0,container.length);
                socket.receive(packet);//阻塞式接受包裹
                //断开连接 bye
                byte[] data = packet.getData();
                String receivedatas = new String(data,0,data.length);
                System.out.println(msgFrom+":"+receivedatas);
                if (receivedatas.equals("bye")){
                    break;
                }
            } catch (IOException e) {
                e.printStackTrace();
            }
        }
        socket.close();
    }
}
学生端
package sockets.chat;

public class TalkStudent {
    public static void main(String[] args) {
        //开启两个线程
        new Thread(new TalkSend(7777,"lccalhost",9999)).start();
        new Thread(new TalkReceive(8888,"老师")).start();
    }
}
老师端
package sockets.chat;

public class TalkTeacher {
    public static void main(String[] args) {
        new Thread(new TalkSend(5555,"localhost",8888)).start();
        new Thread(new TalkReceive(9999,"学生")).start();
    }
}

8.URL

  • https://www.baidu.com
  • 统一资源定位符:定位互联网上的某一个资源
  • DNS域名解释 www.baidu.com —> xxx.xxx.xxx.xx.x.x
协议:// ip地址:端口号/项目名/资源
package sockets.lesson02;

import java.net.URL;

public class URLDemo01 {
    public static void main(String[] args) throws Exception{
        URL url = new URL("http;//localhost:8080/helloword/index?username=kuangshen&password=123");
        System.out.println(url.getProtocol());//协议
        System.out.println(url.getHost());//主机IP
        System.out.println(url.getPort());//端口
        System.out.println(url.getPath());//全路径
        System.out.println(url.getFile());//文件
        System.out.println(url.getQuery());//参数
    }
}

下载文件

  • 1.启动tomcat服务器;
  • 2.在tomcat中放好文件;
  • 3.进行相关测试。
package sockets.lesson02;

import java.io.FileOutputStream;
import java.io.InputStream;
import java.net.HttpURLConnection;
import java.net.URL;

public class URLDown {
    public static void main(String[] args) throws Exception{
        //下载地址
        URL url = new URL("资源位置");
        //连接到资源 http
        HttpURLConnection urlConnection = (HttpURLConnection) url.openConnection();

        InputStream inputStream = urlConnection.getInputStream();
        FileOutputStream fos = new FileOutputStream("保存地址");

        byte[] buffer = new byte[1024];
        int len;
        while ((len=inputStream.read(buffer))!=-1){
            fos.write(buffer,0, len);
        }
        fos.close();
        inputStream.close();
        urlConnection.disconnect();
    }
}

eam;
import java.io.InputStream;
import java.net.HttpURLConnection;
import java.net.URL;

public class URLDown {
public static void main(String[] args) throws Exception{
//下载地址
URL url = new URL(“资源位置”);
//连接到资源 http
HttpURLConnection urlConnection = (HttpURLConnection) url.openConnection();

    InputStream inputStream = urlConnection.getInputStream();
    FileOutputStream fos = new FileOutputStream("保存地址");

    byte[] buffer = new byte[1024];
    int len;
    while ((len=inputStream.read(buffer))!=-1){
        fos.write(buffer,0, len);
    }
    fos.close();
    inputStream.close();
    urlConnection.disconnect();
}

}


  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值