{"id":1011,"date":"2006-07-04T12:00:00","date_gmt":"2006-07-04T12:00:00","guid":{"rendered":"http:\/\/orcldoug.com\/blog\/?p=1011"},"modified":"2006-07-04T12:00:00","modified_gmt":"2006-07-04T12:00:00","slug":"whats-a-data-warehouse-dba","status":"publish","type":"post","link":"http:\/\/orcldoug.com\/blog\/2006\/07\/04\/whats-a-data-warehouse-dba\/","title":{"rendered":"What’s a ‘Data Warehouse DBA’?"},"content":{"rendered":"

I’ve seen that question asked often in forums and mail groups. It’s easy to understand why there’s so much confusion because, for most DBAs, if you’ve seen one database, you’ve seen them all. Or rather, you haven’t seen any of them. What I mean is that every database that lands in your hands is new, has it’s own users, it’s own problems, it’s own performance profile. So learning and coping with new situations is an implicit part of being a DBA and if you’re a *good<\/b>* DBA, a data warehouse should be well within your capabilities.<\/p>\n

The very first Oracle database I worked on was a data warehouse, although possibly not in the sense we understand today. It didn’t use a Kimball-style data model, materialised views didn’t exist in Oracle and the volumes of data were tiny compared to current warehouses. However, it did have a fact table for all of our customers, one for all of their accounts, a many-to-many join table between the two and tons of small? reference tables. We used it to run complex, user-defined queries to generate lists of customers for direct marketing mail-shots. <\/p>\n

When recruitment agents started to ask me about my Data Warehouse experience, I was very blas\ufffd in response because I know my skills are up to most jobs and was frustrated when they wanted to see ‘Data Warehouse DBA’ on my cv. To my mind a good DBA is more than capable of looking after Data Warehouses too and it doesn’t help when slightly famous bloggers say things like (and this isn’t<\/b> a direct quote) ‘I do data warehouses – they’re different’. Which is weird, because you don’t see people going around saying ‘I do several thousand user OLTP systems’. My point here is that there is a certain cliqueness or possibly? elitism? about the DW crowd. Now, before I upset everyone (because all of my friends seem to be members of that crowd ;-), let me explain why I think they’re like that.<\/p>\n

I work with the DW development team quite a lot in my current workplace. One of the reasons for that (and I’m going to have to leave my modesty to one side for a moment) is that they could quickly spot that I knew what I was doing. That’s the good thing about the DW crowd – they’re quite demanding. Whilst working with them, I heard horror stories about what previous DBAs had done, so they are very twitchy about the skills of the people who work on their databases. In fact, we had a DBA start here not so long ago and the first bit of advice I gave him was ‘when the DW guys ask you to do something, the chances are that they understand the reasons for it better than you do.’ But that’s because they spend all of their day working on the same couple of databases. They have tons of time to think through the issues. It’s not because they’re party to some mysterious knowledge that takes years to learn (or at least no more mysterious than just being a DBA on big databases).<\/p>\n

To further counter my own argument, here are some things that I think are definite requirements for a DBA to work on Data Warehouses (even if they choose not to glorify themselves with the full title)<\/p>\n

1) Knowledge of Partitioning, Materialised Views, Bitmap Indexes, Parallel Execution and, in fact, most things in the handily-supplied Data Warehousing Guide<\/a><\/p>\n

2) Knowledge of the latest features because DW systems always seem to be on the latest release because they need the features.<\/p>\n

3) Experience of working with big databases. This sounds obvious, but how do you go about backing up a 2Tb warehouse? Maybe it makes more sense to rebuild indexes than backup the tablespaces. Believe it or not, there *might* be good reason for having a tablespace with hundreds of files – just because you haven’t seen one before doesn’t make them bad 😉<\/p>\n

So I’m not saying working with Data Warehouses is easy, just that it’s not some black magic art-form. I repeat – the most important thing is that you’re a good DBA in the first place and that you’re open-minded. <\/p>\n

Actually maybe I’ve argued my way into a corner here and there is<\/strong> a lot to being a Data Warehouse DBA but it just doesn’t seem that big a deal to me. Maybe I’ve got more experience than I think I have and I should start calling myself a Data Warehouse DBA, however …. The other week I had a conversation with a recruitment agent that spread over several phone calls and ultimately degenerated into a series of ‘so how big was that database, then’ questions, going through each of the sites I’d worked at. His client’s requirement was for DBAs who’d worked on Terabyte warehouses and, as some of mine were only six or seven hundred gig, it was proving tricky. Eventually I gave it up as a lost cause but it is disappointing that this job title might be excluding good DBAs from jobs because they don’t see it as being a specialised position and therefore don’t see the need to change the job title on their cvs (or blog!).<\/p>\n

To be honest, I’m feeling pretty depressed about the state of the DBA role this month, so expect this to be one of a series of rants.<\/p>\n","protected":false},"excerpt":{"rendered":"

I’ve seen that question asked often in forums and mail groups. It’s easy to understand why there’s so much confusion because, for most DBAs, if you’ve seen one database, you’ve seen them all. Or rather, you haven’t seen any of them. What I mean is that every database that lands in your hands is new,… Continue reading What’s a ‘Data Warehouse DBA’?<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1011","post","type-post","status-publish","format-standard","hentry","category-uncategorized","entry"],"jetpack_featured_media_url":"","jetpack-related-posts":[{"id":1044,"url":"http:\/\/orcldoug.com\/blog\/2006\/08\/04\/tracing-session-activity-over-a-remote-database-link\/","url_meta":{"origin":1011,"position":0},"title":"Tracing session activity over a remote database link","date":"August 4, 2006","format":false,"excerpt":"Yesterday someone asked me how to trace a session that selects from a view in a remote database via a link. If they activated the trace on the local instance, they wouldn't see the bulk of the work which was happening on the remote instance - just a bunch of\u2026","rel":"","context":"With 2 comments","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1030,"url":"http:\/\/orcldoug.com\/blog\/2006\/07\/21\/monitoring-index-usage\/","url_meta":{"origin":1011,"position":1},"title":"Monitoring Index Usage","date":"July 21, 2006","format":false,"excerpt":"A common requirement cropped up this week. A new Data Warehouse has just gone live and is still in the 'do we have the right indexes here' phase. In this case, the suspicion is that there are too many indexes in a specific schema and that a number of them\u2026","rel":"","context":"With 8 comments","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1028,"url":"http:\/\/orcldoug.com\/blog\/2006\/07\/20\/whats-a-development-dba\/","url_meta":{"origin":1011,"position":2},"title":"What’s a ‘Development DBA’?","date":"July 20, 2006","format":false,"excerpt":"I theory, this should be a much more straightforward, less contentious question than my previous - 'What's a Data Warehouse DBA?'A development DBA looks after the development (and test) databases. It truly is as simple as that, but depends on the nature of the project you're working on and the\u2026","rel":"","context":"With 2 comments","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1042,"url":"http:\/\/orcldoug.com\/blog\/2006\/08\/04\/log-buffer-4\/","url_meta":{"origin":1011,"position":3},"title":"Log Buffer #4","date":"August 4, 2006","format":false,"excerpt":"Welcome to the fourth edition of Log Buffer.Maybe it's the summer holiday season and DBA-land is a little quiet, but navel-gazing seems popular this week. During a conference keynote speech by Ray Lane I attended earlier this year, he highlighted how much the software industry likes to talk about itself\u2026","rel":"","context":"With 7 comments","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1284,"url":"http:\/\/orcldoug.com\/blog\/2007\/06\/10\/non-reusable-space\/","url_meta":{"origin":1011,"position":4},"title":"Non-reusable Space?","date":"June 10, 2007","format":false,"excerpt":"A problem cropped up at work this week and, whilst it wasn't particularly tricky and didn't take long to solve, it struck me that the story of tracking it down might be useful and you might hit the problem yourself one day.A recently-deployed Data Warehouse database at work has a\u2026","rel":"","context":"With 13 comments","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1191,"url":"http:\/\/orcldoug.com\/blog\/2007\/01\/27\/dba-documentation-catalogue\/","url_meta":{"origin":1011,"position":5},"title":"DBA Documentation – Catalogue","date":"January 27, 2007","format":false,"excerpt":"Prompted by Linda's comment on a previous blog, I thought it might be worth writing a couple of postings on DBA documentation.The first thing you need is a Database Catalogue of some kind.Benefits1) Even an experienced DBA arriving on site won't know what servers exist, how to login to them,\u2026","rel":"","context":"With 11 comments","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"_links":{"self":[{"href":"http:\/\/orcldoug.com\/blog\/wp-json\/wp\/v2\/posts\/1011","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/orcldoug.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/orcldoug.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/orcldoug.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/orcldoug.com\/blog\/wp-json\/wp\/v2\/comments?post=1011"}],"version-history":[{"count":0,"href":"http:\/\/orcldoug.com\/blog\/wp-json\/wp\/v2\/posts\/1011\/revisions"}],"wp:attachment":[{"href":"http:\/\/orcldoug.com\/blog\/wp-json\/wp\/v2\/media?parent=1011"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/orcldoug.com\/blog\/wp-json\/wp\/v2\/categories?post=1011"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/orcldoug.com\/blog\/wp-json\/wp\/v2\/tags?post=1011"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}