元心科技分享：Gstreamer 初探 (五) (GTK+)

Gstreamer 初探 (五)

（GTK+）

本次教程我们介绍将Gstreamer集成到GTK+中的操作详解，基本上Gstreamer负责媒体流的处理，用户交互的部分留给GTK+来处理，最有趣的部分是Gstreamer如何将视频输出到Gtk+的窗口，而Gtk+将用户操作转发到Gstreamer进行控制

通过这次课程，请留意以下内容：

1. 如何将Gstreamer的视频输出到指定的窗口（而不是让其创建自己的窗口）
2. 如何将Gstreamer的信息在界面上进行刷新
3. 如何从Gstreamer的多个线程中更新界面
4. 如何只获取需要的消息，而不是获取所有的消息

介绍

我们将使用Gtk+和Gstreamer构建一个媒体播放器，对Gtk+有一定了解将有助于理解本教程

主要的一点是让Gstreamer的视频流输出到我们使用Gtk+创建的窗口上，当然，这其中具体的机制是依赖于操作系统的（更确切的说依赖于窗口系统），但GStreamer为平台独立性提供了一个抽象层，通过GstVideoOverlay接口实现，这允许应用程序告诉sink应该接收渲染的窗口处理程序

GObject interfaces

Gstreamer所使用的GObject 接口是通过element所包含的一组函数，如果有这样的函数，就称作它支持这个特定的接口，例如，sinks通常创建自己的窗口来呈现视频，但如果视频流可以被呈现到外部的窗口，sinks就可以实现GstVideoOverlay这个接口提供函数来提供指定一个外部窗口的方法，从开发者的角度讲，如果element支持某个接口，我们不需要考虑具体是哪个element实现的，而可以直接使用这个接口来完成功能，此外，playbin会自动支持实现一些接口函数以供我们使用

我们需要注意GStreamer的多线程问题，GUI工具包通常只允许通过主(或应用程序)线程操作图形“小部件”，而GStreamer通常生成多个线程来处理不同的任务。从回调内部调用GTK+函数通常会失败，因为回调是在调用线程中执行的，而调用线程不需要是主线程。这个问题可以通过在回调中的GStreamer总线上发布消息来解决:主线程接收消息，主线程将相应地做出反应。

在上一次的教程中，我们通过注册handle_message函数，每当总线上出现一条消息时，就会调用这个函数，这使得我们解析每条消息。在本教程中，使用不同的方法为每种类型的消息注册回调，因此解析更少，代码也更少。

basic-tutorial-5.c

#include <string.h>

#include <gtk/gtk.h>
#include <gst/gst.h>
#include <gst/video/videooverlay.h>

#include <gdk/gdk.h>
#if defined (GDK_WINDOWING_X11)
#include <gdk/gdkx.h>
#elif defined (GDK_WINDOWING_WIN32)
#include <gdk/gdkwin32.h>
#elif defined (GDK_WINDOWING_QUARTZ)
#include <gdk/gdkquartz.h>
#endif

/* Structure to contain all our information, so we can pass it around */
typedef struct _CustomData {
   
  GstElement *playbin;           /* Our one and only pipeline */

  GtkWidget *slider;              /* Slider widget to keep track of current position */
  GtkWidget *streams_list;        /* Text widget to display info about the streams */
  gulong slider_update_signal_id; /* Signal ID for the slider update signal */

  GstState state;                 /* Current state of the pipeline */
  gint64 duration;                /* Duration of the clip, in nanoseconds */
} CustomData;

/* This function is called when the GUI toolkit creates the physical window that will hold the video.
 * At this point we can retrieve its handler (which has a different meaning depending on the windowing system)
 * and pass it to GStreamer through the VideoOverlay interface. */
static void realize_cb (GtkWidget *widget, CustomData *data) {
   
  GdkWindow *window = gtk_widget_get_window (widget);
  guintptr window_handle;

  if (!gdk_window_ensure_native (window))
    g_error ("Couldn't create native window needed for GstVideoOverlay!");

  /* Retrieve window handler from GDK */
#if defined (GDK_WINDOWING_WIN32)
  window_handle = (guintptr)GDK_WINDOW_HWND (window);
#elif defined (GDK_WINDOWING_QUARTZ)
  window_handle = gdk_quartz_window_get_nsview (window);
#elif defined (GDK_WINDOWING_X11)
  window_handle = GDK_WINDOW_XID (window);
#endif
  /* Pass it to playbin, which implements VideoOverlay and will forward it to the video sink */
  gst_video_overlay_set_window_handle (GST_VIDEO_OVERLAY (data->playbin), window_handle);
}

/* This function is called when the PLAY button is clicked */
static void play_cb (GtkButton *button, CustomData *data) {
   
  gst_element_set_state (data->playbin, GST_STATE_PLAYING);
}

/* This function is called when the PAUSE button is clicked */
static void pause_cb (GtkButton *button, CustomData *data) {
   
  gst_element_set_state (data->playbin, GST_STATE_PAUSED);
}

/* This function is called when the STOP button is clicked */
static void stop_cb (GtkButton *button, CustomData *data) {
   
  gst_element_set_state (data->playbin, GST_STATE_READY);
}

/* This function is called when the main window is closed */
static void delete_event_cb (GtkWidget *widget, GdkEvent *event, CustomData *data) {
   
  stop_cb (NULL, data);
  gtk_main_quit ();
}

/* This function is called everytime the video window needs to be redrawn (due to damage/exposure,
 * rescaling, etc). GStreamer takes care of this in the PAUSED and PLAYING states, otherwise,
 * we simply draw a black rectangle to avoid garbage showing up. */
static gboolean draw_cb (GtkWidget *widget, cairo_t *cr, CustomData *data) {
   
  if (data->state < GST_STATE_PAUSED) {
   
    GtkAllocation allocation;

    /* Cairo is a 2D graphics library which we use here to clean the video window.
     * It is used by GStreamer for other reasons, so it will always be available to us. */
    gtk_widget_get_allocation (widget, &allocation);
    cairo_set_source_rgb (cr, 0, 0, 0);
    cairo_rectangle (cr, 0, 0, allocation.width, allocation.height);
    cairo_fill (cr);
  }

  return FALSE;
}

/* This function is called when the slider changes its position. We perform a seek to the
 * new position here. */
static void slider_cb (GtkRange *range, CustomData *data) {
   
  gdouble value = gtk_range_get_value (GTK_RANGE (data->slider));
  gst_element_seek_simple (data->playbin, GST_FORMAT_TIME, GST_SEEK_FLAG_FLUSH | GST_SEEK_FLAG_KEY_UNIT,
      (gint64)(value * GST_SECOND));
}

/* This creates all the GTK+ widgets that compose our application, and registers the callbacks */
static void create_ui (CustomData *data) {
   
  GtkWidget *main_window;  /* The uppermost window, containing all other windows */
  GtkWidget *video_window; /* The drawing area where the video will be shown */
  GtkWidget *main_box;     /* VBox to hold main_hbox and the controls */
  GtkWidget *main_hbox;    /* HBox to hold the video_window and the stream info text widget */
  GtkWidget *controls;     /* HBox to hold the buttons and the slider */
  GtkWidget *play_button, *pause_button, *stop_button; /* Buttons */

  main_window = gtk_window_new (GTK_WINDOW_TOPLEVEL);
  g_signal_connect (G_OBJECT (main_window), "delete-event", G_CALLBACK (delete_event_cb), data);

  video_window = gtk_drawing_area_new ();
  gtk_widget_set_double_buffered (video_window, FALSE);
  g_signal_connect (video_window, "realize", G_CALLBACK (realize_cb), data);
  g_signal_connect (video_window, "draw", G_CALLBACK (draw_cb), data);

  play_button = gtk_button_new_from_icon_name ("media-playback-start", GTK_ICON_SIZE_SMALL_TOOLBAR);
  g_signal_connect (G_OBJECT (play_button), "clicked", G_CALLBACK (play_cb), data);

  pause_button = gtk_button_new_from_icon_name ("media-playback-pause", GTK_ICON_SIZE_SMALL_TOOLBAR);
  g_signal_connect (G_OBJECT (pause_button), "clicked", G_CALLBACK (pause_cb), data);

  stop_button = gtk_button_new_from_icon_name ("media-playback-stop", GTK_ICON_SIZE_SMALL_TOOLBAR);
  g_signal_connect (G_OBJECT (stop_button