C#将DataTable写入MongoDB

最新推荐文章于 2024-01-12 14:07:30 发布

清山博客

最新推荐文章于 2024-01-12 14:07:30 发布

阅读量1.4k

点赞数

分类专栏： C#

C# 专栏收录该内容

154 篇文章 5 订阅

订阅专栏

思路：遍历DataTable的Rows，将Row转换为BsonDocument对象，然后批量写入数据库。

var client = new MongoClient("mongodb://localhost:27017");
var database = client.GetDatabase("rc114");
var collection = database.GetCollection<BsonDocument>("IISLog");
var dt = data.DataSource as DataTable;
var count = 0;
var batch = new List<BsonDocument>();
if (dt != null)
{
    foreach (DataRow dr in dt.Rows)
    {
        count++;
        var dictionary = dr.Table.Columns.Cast<DataColumn>().ToDictionary(col => col.ColumnName, col => dr[col.ColumnName]);
        batch.Add(new BsonDocument(dictionary));

        //分批次写入，防止内存溢出
        if (batch.Count == 5000)
        {
            UpdateUI(() => { lblStatus.Text = "已导入 " + count; });
            collection.InsertManyAsync(batch.AsEnumerable());
            batch.Clear();
            ClearMemory();
        }
    }
    if (batch.Count > 0)
    {
        UpdateUI(() => { lblStatus.Text = "已导入 " + count; });
        collection.InsertManyAsync(batch.AsEnumerable());
        batch.Clear();
        ClearMemory();
    }
}

清理程序占用内存方法：

        [DllImport("kernel32.dll", EntryPoint = "SetProcessWorkingSetSize")]
        public static extern int SetProcessWorkingSetSize(IntPtr process, int minSize, int maxSize);

        public static void ClearMemory()
        {
            GC.Collect();
            GC.WaitForPendingFinalizers();
            if (Environment.OSVersion.Platform == PlatformID.Win32NT)
            {
                SetProcessWorkingSetSize(Process.GetCurrentProcess().Handle, -1, -1);
            }
        }

参考：https://stackoverflow.com/questions/37940065/insert-datatable-in-mongo-db-using-c-sharp