Posts made by jim9500

@scottalanmiller Really appreciate the input. Didn't know if it was possible for chkdsk to not pick up corruption issues or it was something mid flight. Intel drivers seems to make the most sense.

@jaredbusch From one folder on the share to another folder on the share from a client computer. Was reproducible on specific directories before restart. Copying same files down to a networked computer locally - then back up to the share resulted in legitimate copy.

@jaredbusch said in File Corruption on Copy Issue:

updates get applied and the reboot was pending,

Updates were applied and reboot was pending on the network driver. Starting to think this was the issue, even though I don't understand how or why it would have caused it.

These were the updates installed - after reboot issue went away & hasn't come back

2021-07 Security Monthly Quality Rollup for Windows Server 2012 for x64-based Systems KB5004956
Windows Malicious Software Removal Tool X64 - v5.91 KB890830
2021-07 Security and Quality Rollup for .NET Framework 3.5, 4.5.2, 4.6, 4.6.2, 4.7, 4.7.1, 4.8 for Windows Server 2012 for x64 KB5004230
2021-04 Servicing Stack Update for Windows Server 2012 for x64-based Systems KB5001401
Update for Windows Server 2012 KB3102429
Intel - LAN (Server), Other hardware - Intel(R) 10 Gigabit CX4 Dual Port Server Adapter
2021-01 Security Update for Windows Server 2012 for X64-based Systems KB4535680

@scottalanmiller May spin up Ubuntu VM & try this again, last time I did I ran into issues & got lost down rabbit hole of trying to figure out what the problem was.

@scottalanmiller said in 45TB-60TB / 45-60 mil file volume recommendations?:

use your own hardware and just install Linux on it

I get this - but as stated I spend 10-15% of my time on Hardware. Based on my personal interactions with linux on personal offtime nothing is officially supported and there are 21 different bash scripts needed to run to enable standard stuff while everyone claims it is consumer friendly.

This machine also runs SQL Server w 40GB database so moving to linux for file store would require different hardware for the Windows SQL Server (SQL for Linux I have no interest in doing)

@dashrender Yes - Raid 10 ADM was over cautious / overbuilt. Went from Raid 60 -> Raid 10 ADM after reading some of @scottalanmiller stuff & understanding the tradeoffs of rebuilds for 60 vs 10. After 3 years of not losing a single drive, I'm comfortable moving to simple Raid 10 with a hot swap.

My reason for considering NAS or something like Exablox was because as I understand it some linux filesystems (I'm not familiar with which ones) are safer than NTFS for large volumes with tons of files. This latest hiccup of file corruption is what alarmed me. I bend towards not preferring this as it makes my life more difficult / less flexible have a 40GB SQL Database etc on Windows Server. Only spend about 10-15% of my time on hardware stuff so much more interested in things that just work.

Hope I'm not out of line to create two topics. I have DL360 G8 / 3 D2600s / 36 3TB HP MB3000FBUCN HDs / Raid 10ADM / Windows Server 2012 that hosts about 30 mil files used by 10-12 people daily. As jobs are processed, these files are moved off the server into cold storage.

I need to increase our storage to 45-60TB. My plan was to just migrate to Raid 10 instead of Raid 10 ADM (I haven't lost a 3TB drive since moving off of raid 60 to Raid 10ADM in 3 years). I'm a little alarmed after a recent file corruption issue described here - https://mangolassi.it/topic/23278/file-corruption-on-copy-issue

I've been a hardcore HP fanboy because I've had very very few problems with their stuff even buying used. Their continued aggressiveness at putting drivers behind paywalls + proprietary HD cost has me bent out of shape pretty hard. I'm looking at two possible solutions.

1 - Switch from Raid 10ADM -> Raid 10 / 30TB -> 45TB. Upgrade DL360 Gen8 to Windows Server 2019 (possible new Windows versions make NTFS volume of this size safer?)

2 - Switch to NAS / Exablox - StorageCraft type solution (I know this used to be shilled pretty hard - is it still top notch set & forget type solution? Will speed be comparable to 36 spindles on Raid 10?)

*I currently have a backup solution using VEEAM + DL380 w 12 drives + tapes for offline storage.

I've got an HP DL360 G8 hooked up to 3 D2600s / 30TB Raid 10 / P822 / 30 mil files / Windows Server 2012.

Last week where someone copied TIF images - the source & destination had same file size / counts but the newly made copy was corrupt / not viewable. (Verified this with a binary editor actual files didn't match / but file properties matched.). When I tried to do this exact copy - it reproduced the exact same situation (corrupt copy / file properties matched). 2 people also claimed they had copied directories that had pulled different directories. I have only seen a situation like these once & it had to do with IT staff expanding an array that didn't support expanding live.

I ran a chkdsk that didn't find any issues on the array, monitored files early in the AM to make sure we weren't being ransom wared, dug thru log files to see if I could find anything - everything appeared to be normal. After the Windows Update -> Reboot I could no longer produce the problems. The day people complained to me 4 people had issues, after the windows update / reboot - no one has complained since.

I'm pretty alarmed & have paused our 10 day rolling backups, have additional storage arriving tomorrow to create a snapshot backup restore before resuming. Have any of you ever seen something like this where both the array controller said the array was fine & chkdsk didn't find anything?

@pete-s said in Getting fed up with HP Active Warranty / Support Agreement Requirements:

You could comfort yourself with the fact that it's only small companies that pay the steep markup. Enterprise customers doesn't.

Grumbles well I have been running my entire server stack off of used enterprise equipment via eBay so full circle of life I guess

@marcinozga said in Getting fed up with HP Active Warranty / Support Agreement Requirements:

I'm not sure they won't follow HP in the future.

It's further infuriating because I am in between upgrading a server space & deciding between SSD, HDD or hybrid. Not only does HP mark up their drives 3-6X, the same drive is listed for both $4,400 & $9,000 on CDW. This seems pretty standard on their drives.
https://www.cdw.com/search/Storage-Hard-Drives/Solid-State-Drives/?lfr=1&w=KE&key=P10446-B21

I should dread talking to sales less I guess.

I have some type of issue with a Gen9 380 and the SSA on bootup being corrupted / not loading. I went to update the BIOS firmware and apparently they put this behind the paywall in addition to the SPP packs ... WTF????

HP SSDs are 3X as much as other enterprise drives - in the past for non critical stuff I've used non HP then HP drives for critical stuff - but now it looks like they are trying to move behind a paywall for the actual firmware not just the full SPP handy full server update.

I see dell has their own proprietary drives - are they going the same route of putting updates behind paywalls and intentionally being incompatible with other drives? I've been a huge fan of HP because they never die but has anyone migrated off because of this proprietary + firmware behind paywall crap? What'd you move to?

Much thanks for the replies guys!

@scottalanmiller Interesting - so the SSD tech got rid of the parity calc corruption issue on raid 5 / raid 6 reubuilds?

@scottalanmiller said in New IT update 60TB / 60 mil files / 20 people - HP Equipment:

Some numbers from CDW...

HPE Midline (NL-SAS) 4TB: $1005 https://www.cdw.com/product/hpe-4tb-sas-12g-midline-7200rpm-lff-3.5-lp-digitally-signed-hdd/4972857?pfm=srh

HPE SSD 1.92TB: $1137 https://www.cdw.com/product/hpe-read-intensive-solid-state-drive-1.92-tb-sas-12gb-s/5531989?pfm=srh

Trying to figure out what the difference between the $1005 & the $405 versions are. https://www.cdw.com/product/hpe-midline-hard-drive-4-tb-sas-12gb-s/6424407?pfm=srh - see this on their 8TB too. Would CDW or serversupply.com be selling grey market drives?

Hey guys, thought I'd get your input. Our org has grown and I'm needing to double our internal production server capacity. We are currently running an HP DL360 G8 / Windows Server 2012 Standard / P822 / 3 D2600 + 36 HP 3TB SAS drives (MB3000FBUCN) configured in raid 10ADM (3 drives per set).

I'm getting horrible benchmarks on the random read MB/s access with CrystalDiskMark RND4K Q1T1 (3.73 vs 2780 sequential). This server stores about 30 million files ranging from 50kb - 10MB and the full storage capacity rotates probably 2 - 3 times a year as we process these jobs then move them to cold storage.

I'm thinking
A.) - 2 D3600s + 6TB drives (drop to raid 10) / maybe look into HP smart caching and add D3700 with some SSDs for faster performance
or
B.) - 2 D3700 2.4TB SFF HP drives (higher speed / more spindles = faster)

• Is SmartCaching off of SSDs really going to be significantly faster than just having 48 10K spindles?
• Is SmartCaching by HP in any way going to make the array more likely to fail? I partially picked Raid 10 for robustness / offloading complexity from controller - haven't had to replace a drive in 2 years now - if a SSD goes out in the caching is HP just going to pass thru to main disk / ignore caching?
• May be open to other storage suggestions - we just started with HP, I've had great luck using all used parts except for HDs for 8 years now, spend most of my time head down in development stuff, so vastly prefer set & forget hardware.

@scottalanmiller said in Why Do People Still Text:

Mine is off.

I need to level up

@Obsolesce said in Why Do People Still Text:

This is why I like Slack.

What literally everyone says about their primary pet message platform. Some people want everything encrypted on Signal, some people want to be dudebros with slack, some people want to email me which I never respond to unless it's important (& just hope it goes away), then some people message me on hangouts, some people message me after realizing my voicemail is full (on purpose)

How long until managers decide to use snapchat for the morale boost of being able to use cat ears? My voicemail is full & I leave it that way, I don't respond to emails, I am getting to the point where I just let people walk into my office if they need me.

When everyone picks a method, literally don't care if it's damned messenger pigeons, I will pay attention to on demand communication methods again. Until then I have no doubt we'll go from dozens to hundreds, probably speakers at our computer yelling at us, webcam lights blinking different colors depending on AIs evaluation of importance, geeks preferring morse code via phone vibrations etc

Do I expect an 8 - 24 hour response

email

Do I expect a 5 min - 2hr response

text

Do I need to talk to someone this instant

call

Do I want to see if casual acquaintances want drinks

Social media message

I feel like the platforms are used to communicate unspoken expectations.