Comments for Informatics @ Northwestern Weblog http://informatics.northwestern.edu/blog NUBIC is a team dedicated to creating web applications and software tools expressly for clinical and translational research at Northwestern Mon, 16 Jan 2012 18:10:17 +0000 hourly 1 http://wordpress.org/?v=3.3.1 Comment on ETL Assistant – Getting Error Row Description and Column Information Dynamically by Introducing ETL Assistant – A Dynamic, Templated Approach to SSIS | Informatics @ Northwestern Weblog http://informatics.northwestern.edu/blog/edw/2012/01/etl-assistant-getting-error-row-description-and-column-dynamically/#comment-1047 Introducing ETL Assistant – A Dynamic, Templated Approach to SSIS | Informatics @ Northwestern Weblog Mon, 16 Jan 2012 18:10:17 +0000 http://informatics.northwestern.edu/blog/?p=498#comment-1047 [...] Dynamically gather error data (column name, column value, error description, etc.) at runtime in SSIS (no, really – it works) [...] [...] Dynamically gather error data (column name, column value, error description, etc.) at runtime in SSIS (no, really – it works) [...]

]]> Comment on Is Your Mobile Phone a HIPAA Violator? by Jeff Lunt http://informatics.northwestern.edu/blog/cid/2011/12/is-your-mobile-phone-a-hipaa-violator/#comment-716 Jeff Lunt Fri, 09 Dec 2011 22:14:02 +0000 http://informatics.northwestern.edu/blog/?p=560#comment-716 There is more discussion/explanation of the SSL and URL security in the below resource. It adds some information to the questions brought up in the "Remaining Privacy Concerns" section of the EFF article posted by Matt. http://stackoverflow.com/questions/893959/if-you-use-https-will-your-url-params-will-be-safe-from-sniffing There is more discussion/explanation of the SSL and URL security in the below resource. It adds some information to the questions brought up in the “Remaining Privacy Concerns” section of the EFF article posted by Matt.

http://stackoverflow.com/questions/893959/if-you-use-https-will-your-url-params-will-be-safe-from-sniffing

]]> Comment on Is Your Mobile Phone a HIPAA Violator? by Matt S. http://informatics.northwestern.edu/blog/cid/2011/12/is-your-mobile-phone-a-hipaa-violator/#comment-701 Matt S. Wed, 07 Dec 2011 19:50:30 +0000 http://informatics.northwestern.edu/blog/?p=560#comment-701 HTTPS connections from the Kindle Fire do not get proxied by Amazon. They go directly to the origin server. https://www.eff.org/2011/october/amazon-fire%E2%80%99s-new-browser-puts-spotlight-privacy-trade-offs HTTPS connections from the Kindle Fire do not get proxied by Amazon. They go directly to the origin server.

https://www.eff.org/2011/october/amazon-fire%E2%80%99s-new-browser-puts-spotlight-privacy-trade-offs

]]> Comment on Powerform Data Mart Generator by Norman Sillito http://informatics.northwestern.edu/blog/edw/2011/08/powerform-data-mart-generator/#comment-614 Norman Sillito Fri, 25 Nov 2011 19:17:37 +0000 https://rails-staging2.nubic.northwestern.edu/informatics/blog/?p=72#comment-614 I'm interested in your methodology for extracting the data for a given PowerForm as we will need to do so soon. What do you need from me? What can you send me/point me to? Thanks I’m interested in your methodology for extracting the data for a given PowerForm as we will need to do so soon. What do you need from me? What can you send me/point me to? Thanks

]]> Comment on Introducing ETL Assistant – A Dynamic, Templated Approach to SSIS by Eric Whitley http://informatics.northwestern.edu/blog/edw/2011/08/introducing-etl-assistant/#comment-504 Eric Whitley Tue, 08 Nov 2011 21:45:55 +0000 http://informatics.northwestern.edu/blog/?p=197#comment-504 Hi, Tre - Just sent you an email with a sample package. I'm still working on this particular blog post as it gets a bit more complex, but in the mean time I hope the code helps you out. Extra thanks to CozyRoc on this topic as they sent me a very helpful sample on how to attach to the dynamic column binding events - super helpful for querying the internals of the input and output columns when the DFT+ starts up. :) Thank you, Eric Hi, Tre –

Just sent you an email with a sample package. I’m still working on this particular blog post as it gets a bit more complex, but in the mean time I hope the code helps you out. Extra thanks to CozyRoc on this topic as they sent me a very helpful sample on how to attach to the dynamic column binding events – super helpful for querying the internals of the input and output columns when the DFT+ starts up. :)

Thank you,
Eric

]]> Comment on Introducing ETL Assistant – A Dynamic, Templated Approach to SSIS by Tre H http://informatics.northwestern.edu/blog/edw/2011/08/introducing-etl-assistant/#comment-502 Tre H Tue, 08 Nov 2011 17:13:31 +0000 http://informatics.northwestern.edu/blog/?p=197#comment-502 Eric, Great post! I'm in the process of building much the same type of utility (driven by a configuration database and metadata from the source and target databases), but am having difficulties with the DataFlow Plus component when it comes to redirecting error row data. I noticed you posted on the CozyRoc forum about that very issue, but there was no reply in the forum. Do you have any quick pointers you could forward relevant to your task 4 above (4.Dynamically gather error data (column name, column value, error description, etc.) at runtime in SSIS (no, really – it works))? Thanks! Eric,

Great post! I’m in the process of building much the same type of utility (driven by a configuration database and metadata from the source and target databases), but am having difficulties with the DataFlow Plus component when it comes to redirecting error row data. I noticed you posted on the CozyRoc forum about that very issue, but there was no reply in the forum. Do you have any quick pointers you could forward relevant to your task 4 above (4.Dynamically gather error data (column name, column value, error description, etc.) at runtime in SSIS (no, really – it works))? Thanks!

]]> Comment on Head starts are good things. by Nicholas C. Smith http://informatics.northwestern.edu/blog/cid/2011/10/head-starts-are-good-things/#comment-456 Nicholas C. Smith Wed, 02 Nov 2011 18:04:46 +0000 http://informatics.northwestern.edu/blog/?p=447#comment-456 Excellent point, Justin. Having worked for a hospital that had implemented an EHR system over 10 years ago, I can tell you that there were still countless hours devoted and numerous changes implemented for us to achieve "meaningful use" of our EHR to qualify for the Stage 1 Medicare/Medicaid incentive payments. Stage 2 is right around the corner and so are its more difficult requirements. The idea that eligible providers and hospitals should not receive payments because of a pre-existing EHR system is absurd. Especially when those "pre-existing" systems most likely needed upgrades for core measures that required solutions such as eRX and CCD generation/exchange. Excellent point, Justin. Having worked for a hospital that had implemented an EHR system over 10 years ago, I can tell you that there were still countless hours devoted and numerous changes implemented for us to achieve “meaningful use” of our EHR to qualify for the Stage 1 Medicare/Medicaid incentive payments.

Stage 2 is right around the corner and so are its more difficult requirements. The idea that eligible providers and hospitals should not receive payments because of a pre-existing EHR system is absurd. Especially when those “pre-existing” systems most likely needed upgrades for core measures that required solutions such as eRX and CCD generation/exchange.

]]> Comment on Introducing ETL Assistant – A Dynamic, Templated Approach to SSIS by asitabh http://informatics.northwestern.edu/blog/edw/2011/08/introducing-etl-assistant/#comment-403 asitabh Fri, 28 Oct 2011 08:51:07 +0000 http://informatics.northwestern.edu/blog/?p=197#comment-403 i think Paul here is using dynamic query to run only sql dml tasks ( update , delete ,insert ) instead of any data flows.SSIS package till now doesn't support changes to internal metadata automatically unless edited using BIDS i think Paul here is using dynamic query to run only sql dml tasks ( update , delete ,insert ) instead of any data flows.SSIS package till now doesn’t support changes to internal metadata automatically unless edited using BIDS

]]> Comment on Introducing ETL Assistant – A Dynamic, Templated Approach to SSIS by Eric Whitley http://informatics.northwestern.edu/blog/edw/2011/08/introducing-etl-assistant/#comment-399 Eric Whitley Thu, 27 Oct 2011 10:14:42 +0000 http://informatics.northwestern.edu/blog/?p=197#comment-399 Hi, Paul - Thanks for the reply :) Quick question - with your approach, are you still statically mapping the source column to the destination column within each executable task? If not, how did you get by needing to map columns within SSIS's DFT? I'm curious to know if you're still creating static DFT steps with static column mappings per source->destination transformation or you've figured out somewhat to bypass SSIS's design-time-only column mappings. Thank you, Eric Hi, Paul –

Thanks for the reply :)

Quick question – with your approach, are you still statically mapping the source column to the destination column within each executable task? If not, how did you get by needing to map columns within SSIS’s DFT?

I’m curious to know if you’re still creating static DFT steps with static column mappings per source->destination transformation or you’ve figured out somewhat to bypass SSIS’s design-time-only column mappings.

Thank you,
Eric

]]> Comment on Introducing ETL Assistant – A Dynamic, Templated Approach to SSIS by Paul Hutagalung http://informatics.northwestern.edu/blog/edw/2011/08/introducing-etl-assistant/#comment-396 Paul Hutagalung Thu, 27 Oct 2011 01:35:34 +0000 http://informatics.northwestern.edu/blog/?p=197#comment-396 Thats really nice, but as no way my company would buy that then i have to be more creative than before. so i create stored procedures with dynamic query with all those parameters. using this method, the previously lots of packages each task become only single package and even single "sql execution task". i just use SSIS for parallelism purposes then. Thats really nice, but as no way my company would buy that then i have to be more creative than before. so i create stored procedures with dynamic query with all those parameters. using this method, the previously lots of packages each task become only single package and even single “sql execution task”. i just use SSIS for parallelism purposes then.

]]>