Join IIUG
 for   
 

Informix News
18 Nov 13 - ZDNet - Top 20 mobile skills in demand... Read
09 Sep 13 - telecompaper - Shaspa and Tatung have shown a new smart home platform at Ifa in Berlin. Powered by the IBM Informix software... Read
06 Sep 13 - IBM data magazine - Mission Accomplished - Miami, Florida will be the backdrop for the 2014 IIUG Informix Conference... Read
01 Feb 13 - IBM Data Magazine - Are your database backups safe? Lester Knutsen (IBM Champion) writes about database back up safety using "archecker"... Read
14 Nov 12 - IBM - IBM's Big Data For Smart Grid Goes Live In Texas... Read
3 Oct 12 - The Financial - IBM and TransWorks Collaborate to Help Louisiana-Pacific Corporation Achieve Supply Chain Efficiency... Read
28 Aug 12 - techCLOUD9 - Splunk kicks up a SaaS Storm... Read
10 Aug 12 - businessCLOUD9 - Is this the other half of Cloud monitoring?... Read
3 Aug 12 - IBM data management - Supercharging the data warehouse while keeping costs down IBM Informix Warehouse Accelerator (IWA) delivers superior performance for in-memory analytics processing... Read
2 Aug 12 - channelbiz - Oninit Group launches Pay Per Pulse cloud-based service... Read
28 May 12 - Bloor - David Norfolk on the recent Informix benchmark "pretty impressive results"... Read
23 May 12 - DBTA - Informix Genero: A Way to Modernize Informix 4GL Applications... Read
9 Apr 12 - Mastering Data Management - Upping the Informix Ante: Advanced Data Tools... Read
22 Mar 12 - developerWorks - Optimizing Informix database access... Read
14 Mar 12 - BernieSpang.com - International Informix User Group set to meet in San Diego... Read
1 Mar 12 - IBM Data Management - IIUG Heads West for 2012 - Get ready for sun and sand in San Diego... Read
1 Mar 12 - IBM Data Management - Running Informix on Solid-State Drives.Speed Up Database Access... Read
26 Feb 12 - BernieSpan.com - Better results, lower cost for a broad set of new IBM clients and partners... Read
24 Feb 12 - developerWorks - Informix Warehouse Accelerator: Continuous Acceleration during Data Refresh... Read
6 Feb 12 - PRLOG - Informix port delivers unlimited database scalability for popular SaaS application ... Read
2 Feb 12 - developerWorks - Loading data with the IBM Informix TimeSeries Plug-in for Data Studio... Read
1 Feb 12 - developerWorks - 100 Tech Tips, #47: Log-in to Fix Central... Read
13 Jan 12 - MC Press online - Informix Dynamic Server Entices New Users with Free Production Edition ... Read
11 Jan 12 - Computerworld - Ecologic Analytics and Landis+Gyr -- Suitors Decide to Tie the Knot... Read
9 Jan 12 - planetIDS.com - DNS impact on Informix / Impacto do DNS no Informix... Read
8 Sep 11 - TMCnet.com - IBM Offers Database Solution to Enable Smart Meter Data Capture... Read
1 Aug 11 - IBM Data Management Magazine - IIUG user view: Happy 10th anniversary to IBM and Informix... Read
8 Jul 11 - Database Trends and Applications - Managing Time Series Data with Informix... Read
31 May 11 - Smart Grid - The meter data management pitfall utilities are overlooking... Read
27 May 11 - IBM Data Management Magazine - IIUG user view: Big data, big time ( Series data, warehouse acceleration, and 4GLs )... Read
16 May 11 - Business Wire - HiT Software Announces DBMoto for Enterprise Integration, Adds Informix. Log-based Change Data Capture... Read
21 Mar 11 - Yahoo! Finance - IBM and Cable&Wireless Worldwide Announce UK Smart Energy Cloud... Read
14 Mar 11 - MarketWatch - Fuzzy Logix and IBM Unveil In-Database Analytics for IBM Informix... Read
11 Mar 11 - InvestorPlace - It's Time to Give IBM Props: How many tech stocks are up 53% since the dot-com boom?... Read
9 Mar 11 - DBTA - Database Administration and the Goal of Diminishing Downtime... Read
2 Feb 11 - DBTAs - Informix 11.7 Flexible Grid Provides a Different Way of Looking at Database Servers... Read
27 Jan 11 - exactsolutions - Exact to Add Informix Support to Database Replay, SQL Monitoring Solutions... Read
25 Jan 11 - PR Newswire - Bank of China in the UK Works With IBM to Become a Smarter, Greener Bank... Read
12 Oct 10 - Database Trends and Applications - Informix 11.7: The Beginning of the Next Decade of IBM Informix... Read
20 Sep 10 - planetIDS.com - ITG analyst paper: Cost/Benefit case for IBM Informix as compared to Microsoft SQL Server... Read
20 Jul 10 - IBM Announcements - IBM Informix Choice Edition V11.50 helps deploy low-cost scalable and reliable solutions for Apple Macintosh and Microsoft Windows... Read
20 Jul 10 - IBM Announcements - Software withdrawal: Elite Support for Informix Ultimate-C Edition... Read
24 May 10 - eWeek Europe - IBM Supplies Database Tech For EU Smart Grid... Read
23 May 10 - SiliconIndia - IBM's smart metering system allows wise use of energy... Read
21 May 10 - CNET - IBM to help people monitor energy use... Read
20 May 10 - ebiz - IBM Teams With Hildebrand To Bring Smart Metering To Homes Across Britain... Read
19 May 10 - The New Blog Times - Misurare il consumo energetico: DEHEMS è pronto... Read
19 May 10 - ZDNet - IBM software in your home? Pact enables five-city smart meter pilot in Europe... Read
17 March 10 - ZDNet (blog) David Morgenstern - TCO: New research finds Macs in the enterprise easier, cheaper to manage than... Read
17 March 2010 - Virtualization Review - ...key components of Big Blue's platform to the commercial cloud such as its WebSphere suite of application ser vers and its DB2 and Informix databases... Read
10 February 2010 - The Wall Street Journal - International Business Machines is expanding an initiative to win over students and professors on its products. How do they lure the college crowd?... Read


End of Support Dates

IIUG on Facebook IIUG on Twitter

[ View Thread ] [ Post Response ] [ Return to Index ] [ Read Prev Msg ] [ Read Next Msg ]

IDS Forum

RE: LOGBUFF size

Posted By: Andrew Ford
Date: Thursday, 26 May 2016, at 3:30 p.m.

In Response To: Re: LOGBUFF size (Fernando Nunes)

I wrote a little bit about it back in 2010 when I was messing around with an
OLTP benchmark.

http://www.informix-dba.com/2010/05/oltp-benchmark-cheats.html

Setting buffered logging improved my Transactions Per Minute by 10%.

YMMV of course. All of my sessions had buffered logging enabled so I didn't
have any unbuffered logging sessions forcing my partially full log buffers
to disk.

Andrew

-----Original Message-----
From: ids-bounces@iiug.org [mailto:ids-bounces@iiug.org] On Behalf Of
Fernando Nunes
Sent: Thursday, May 26, 2016 2:18 PM
To: ids@iiug.org
Subject: Re: LOGBUFF size [37198]

"irrelevant" may be a too strong work...
But do a teste...run "onstat -l"
Somewhere near the top you'll see on average how many pages were used when
it was flushed... in busy OLTP systems this is often around 1.x... Not even
two pages.
Ceck your values...

Again... for those busy jobs... if you think you could live with a potential
"COMMIT" that is lost... and if the do many COMMITS, try to run them with
"SET BUFFEED LOG".
This would make their COMMITS NOT to force a flush....
I had the idea of writing an article about this... not sure if I did....
Time permitting I must get back to it...
Regards

On Thu, May 26, 2016 at 7:26 PM, FRANK <yunyaoqu@gmail.com> wrote:

> HI, Fernando,
>
> Our database is No HDR and Unbuffered logging.
>
> I think , as you suggested, I can ignore it for now.
>
> This is not happening often. It happens just sometimes with some
> busier update jobs involved , it did not last long in our current
database.
> Yes, no one noticed it.
>
> We will have three times of more volumes of transactions soon, I just
> want to make sure it would not get worse next. By the way, we have lot
> of memory ( hundred of GBs), we can give it as much as it needs :-)
>
> This is the first time I heard the size of LOGBUFF is irrelevant for
> unbuffered logging, interesting ...
>
> Thanks
> Frank
>
> On Thu, May 26, 2016 at 1:27 PM, Fernando Nunes
> <domusonline@gmail.com>
> wrote:
>
> > A couple of questions:
> >
> > 1- Do you have HDR?
> > 2- What is the logmode of your databases? Buffered, Unbuffered?
> >
> > The reasons behind the questions are:
> >
> > - If you hae HDR, when the buffers are flushed in the primary (to
> > disk) they are also copied to the "HDR buffers". We have 12 of these
> > but occasionally if the secondary or the network is dragging they
> > may fill up and cause waits on the primary
> >
> > - If you have unbuffered logging like most customers do, the size of
> > the LOGBUFF becomes rather irrelevant because most of the times it
> > will never get full. Because each time a transaction is closed the
> > buffer is
> flushed.
> > And this may cause some extra contention.... And there's little you
> > can do... the options would be:
> >
> > a) Change your databases to buffered logging -> BAD IDEA as you may
> > cause inconsistencies between the database and external systems
> > b) Change the buffer mode at session level.... sessions that could
> > live with buffered can be set to it. But the other sessions will
> > continue to force flushing
> > c) Put your logs on the fasted disk you have... keepin mind that
> > seek timemay not be very important and the writes are sequential...
> > the number of IOPs is crucial
> >
> > Now... after describing a bad scenario.... what really i your
> > problem? A few sessions with G flag once in a while? If yes, ignore
> > it... no one
> will
> > notice...
> > Keep in mind that the flush occurs many times per second in an
> > heavily
> used
> > systems.... When you see a session in "G" chances are it went htough
> > many other "G" cycles before you process that information...
> >
> > Now... if you want this solved, please vote on this feature:
> >
> >
> http://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=4
> 5166
> >
> > It would help.... The basic idea is simple and in some formi already
> > used in DB2 and Oracle. SQL Server seems to have implemented what we
> > have in
> one
> > of the latest releases:
> >
> > The problem of buffering is that you can tell the application a
> > COMMIT
> was
> > ok, when you still can loose it. So why not BUFFER anyway and delay
> > the answer to the application until you actually flush?
> > The implementation can't be that simple... the worst case scenario
> > would
> be
> > a single application running on a server... the buffer would never
> > fill,
> so
> > it would be stuck... some sort of timer must be implemented to force
> > the flush if meanwhile the buffer hasn't fill up.
> >
> > Regards
> >
> > On Thu, May 26, 2016 at 5:28 PM, FRANK <yunyaoqu@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > We set ,
> > >
> > > LOGBUFF 256
> > >
> > > Occasionally, I still see this sometimes,
> > >
> > > 58087a28 Y--P--- 4082303 saapmgr - 551cf760 0
> > > 1 0 0
> > > 580882e8 G-BPX-- 3671545 saapmgr - 526d0898 0
> > > 2 29 48411
> > > 58088ba8 Y--P--- 2478091 saapmgr - 55a96230 0
> > > 1 116 14986
> > >
> > > So, a session is waiting for the log buffer .
> > >
> > > The doc ( below) seems not to recommend to set it higher or .... .
> > >
> > > What do you think or comments ?
> > >
> > > Thanks
> > > Frank
> > >
> > > LOGBUFF configuration parameter
> > >
> > > Use the LOGBUFF configuration parameter to specify the size in
> kilobytes
> > > for the three logical-log buffers in shared memory.
> > > onconfig.std value LOGBUFF 64 units Kilobytes values An integer in
> > > the range of 32 - (32767 * pagesize / 1024), where pagesize is the
> > > default system page size. The value must be evenly divisible by
> > > the default
> > system
> > > page size. If the value is not evenly divisible by the page size,
> > > the database server rounds down the size to the nearest value that
> > > is
> evenly
> > > divisible by the page size. takes effect After you edit your
> > > onconfig
> > file
> > > and restart the database server.
> > > Usage
> > >
> > > The three logical log buffers permit user threads to write to the
> active
> > > buffer while one of the other buffers is being flushed to disk. If
> > flushing
> > > is not complete by the time the active buffer fills, the user
> > > thread
> > begins
> > > writing to the third buffer.
> > >
> > > If the RTO_SERVER_RESTART configuration parameter is enabled, set
> > > the
> > value
> > > of the LOGBUFF configuration parameter to 256 kilobytes. If the
> > > value
> of
> > > the LOGBUFF configuration parameter is less than 256 kilobytes, a
> warning
> > > message displays when you restart the server.
> > >
> > > Otherwise, set the value of the LOGBUFF configuration parameter to
> > > 32 kilobytes for standard workloads or 64 kilobytes for heavy
workloads.
> The
> > > database server uses the LOGBUFF parameter to set the size of
> > > internal buffers that are used during recovery. If you set LOGBUFF
> > > too high, the database server can run out of memory and shut down
during recovery.
> > >
> > > If you log user data in smart large objects, increase the size of
> > > the
> log
> > > buffer to make the system more efficient. The database server logs
> > > only
> > the
> > > portion of a smart-large-object page that changed.
> > >
> > > You can view information about the logical log buffers by running
> > > the onstat -l command.
> > > *Parent topic:* Database configuration parameters
> > >
> > > <
> > >
> >
> >
>
>
http://www.ibm.com/support/knowledgecenter/SSGU8G_12.1.0/com.ibm.adref.doc/i
ds_adr_0007.htm?lang=en-us
> > > >
> > > *Related reference*:
> > > onstat -l command: Print physical and logical log information
> > >
> > > <
> > >
> >
> >
>
>
http://www.ibm.com/support/knowledgecenter/SSGU8G_12.1.0/com.ibm.adref.doc/i
ds_adr_0598.htm?lang=en-us
> > > >
> > >
> > > --001a11c1728c309b400533c148a4
> > >
> > >
> > >
> > >
> >
> >
>
>
****************************************************************************
***
> > > Forum Note: Use "Reply" to post a response in the discussion forum.
> > >
> > >
> >
> > --
> > Fernando Nunes
> > Portugal
> >
> > http://informix-technology.blogspot.com
> > My email works... but I don't check it frequently...
> >
> > --001a1146d40e5dfa2f0533c21b43
> >
> >
> >
> >
>
>
****************************************************************************
***
> > Forum Note: Use "Reply" to post a response in the discussion forum.
> >
> >
>
> --001a114222c8ddb0220533c2eb82
>
>
>
>
****************************************************************************
***
> Forum Note: Use "Reply" to post a response in the discussion forum.
>
>

--
Fernando Nunes
Portugal

http://informix-technology.blogspot.com
My email works... but I don't check it frequently...

--001a1146d40e07b6be0533c3a634

****************************************************************************
***
Forum Note: Use "Reply" to post a response in the discussion forum.

Messages In This Thread

[ View Thread ] [ Post Response ] [ Return to Index ] [ Read Prev Msg ] [ Read Next Msg ]

IDS Forum is maintained by Administrator with WebBBS 5.12.