Big csv file spliter

# variable used to store the path of the source CSV file

#1) Change line 3 to suit the file path for your CSV file.

#$filepath = "S:\AMS_IT\Application Support\JDEdwards\FSPAllocation\Lighthouse Energy Limited FSP Allocation - Wells.csv"

#2) Change the value for "MaxLines", which is the maximum number of lines in each output file. Preferably, MaxLines < 5000 .

$filepath = "C:\_Staging\==20180430_Supercharged Energy\Supercharged Energy FSP Allocation - Indeserve.csv"
$file = Get-Item $filepath
$content = Get-Content $file
$csvheader = $content[0]
$lines = $content.Count
$MaxLines = 4000
$filepart = 1
$start = 1
Write-Output "test1"
Write-Output "header :"  $csvheader;
Write-Output "lines :"  $lines;
while ($start -lt $lines - 1) {
    #Set minimum $end value (last line)
    if ($start + $minlines -le $lines - 1) { $end = $start + $MaxLines - 1 } else { $end = $lines - 1 }
    Write-Output "end :"  $end;
     
    #Create new csv-part
    $filename = $file.FullName.Replace($file.BaseName, ($file.BaseName + ".part$filepart"))
    @($content[$start..$end]) | Set-Content $filename -Encoding 'UTF8'
    #Fix counters
    $filepart++
    $start = $end + 1
    Write-Output "filepart :"  $filepart;
    Write-Output "start :"  $start;
}
pause;
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值