wwwsources.list
sources.list 时间:2021-05-05 阅读:()
UsingOpenSourceSoftwaretoTeachMathematicalStatisticsDouglasM.
Batesbates@R-project.
orgUniversityofWisconsin–MadisonUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
1/29OutlineOpenSourceSoftwareforStatisticsWhatisRObtainingandinstallingRAnExample-MLEConclusionsfromtheexampleLinksUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
2/29StatisticalsoftwareinMathStatItiscommontousesomestatisticalsoftwareinappliedcoursestoworkwithrealisticsizeddatasetstcomplicatedmodelsgaininsightfromsimulationSoftwareinMathStatcourseshassimilaruses(especiallysimulation)butwemustprovideasimpleinterfaceforittobeuseful.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
3/29LinkingthecomputingtothetextItisimportantthattheuseofthecomputingsystembeintegratedwiththelecturesandtext.
Twowaysthiscanbeaccomplishedare:Writeatextthatistiedtospecicsoftwareandillustratestheuseofthatsoftware,e.
g.
NolanandSpeed(2000)Adoptaconventionaltextbutprovidetheexamplesfromthetextinthecomputingsystem.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
4/29AdvantagesofOpenSourcesoftwareNolicensefeesormanagementoflicenses.
Wecaninstallthesoftwareonallourdepartmentalcomputers.
Wedonotneedtowaitforacommericalsoftwareprovidertoporttoaparticularoperatingsystemorworryabouttheirdiscontinuingaport.
Itismucheasiertoconvinceothergroups(Computer-AidedEngineeringandtheComputingCenter,inmycase)toinstallthesoftware.
Studentscaninstallthesoftwareontheirowncomputerswithoutcharge(andwithoutviolatinglicenses).
OpenSourceprojectsencouragecontributionsfromuserssoextensionsareeasier.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
5/29TheSlanguageItisalanguageandsystemdevelopedbyJohnChambersandhisco-workersatBellLaboratories(formerlypartofAT&T,nowpartofLucentTechnologies).
TheAssociationforComputingMachinerypresentedits1999SoftwareSystemAwardtoJohnstating,"Shasforeveralteredthewaypeopleanalyze,visualize,andmanipulatedata"ItisthedefactostandardforcomputingintheStatisticsresearchcommunity.
Itisdocumentedinmanybooks,thebestknownofwhicharebyVenablesandRipley(ModernAppliedStatisticswithS-PLUSandSProgramming)andbyChambers(ProgrammingwithData).
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
6/29DesignGoalsforSToprovideanenvironmentforinteractivecomputingwithdata.
Toallowuserstotransitioneasilyintoprogrammersastheneedarises.
Toprovidebothexploratoryandpresentationgraphics.
Toavoidreinventingexistingtools.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
7/29CharacteristicsofSItisaninteractivelanguagebasedonfunctionsandfunctioncalls.
Itprovidesanenvironmentwithpersistent,self-describingobjects.
Inparticular,functionsarerst-classobjects.
Ithasawidevarietyofgraphicsdevicedriversandcontrols.
Itprovidesinterfacestoexistingcodeandsystems.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
8/29ImplementationsofSS-PLUS,soldbyInsightfulCorp.
(formerlyMathSoft,Inc.
)andbasedontheirexclusivelicenseoftheoriginalSsourcefromLucentTechnologies.
R,anOpenSourceprojectconformingforthemostparttothepublisheddescriptionsofS.
InitiallydevelopedbyRossIhakaandRobertGentlemanattheUniversityofAucklandNowdevelopedandmaintainedbyanwidely-dispersed,internationalgroupofvolunteersfromacademiaandindustry.
Operatesthroughwebsites(www.
r-project.
org),archives(cran.
r-project.
org)e-maillists,CVSsites,rsyncsites.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
9/29WhatisRUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLAnembeddableextensionlanguageUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLAnembeddableextensionlanguagePartoftheGNU(GNU'sNotUnix)softwaresystem.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLAnembeddableextensionlanguagePartoftheGNU(GNU'sNotUnix)softwaresystem.
Justinstallitandtryit.
Comeswithamoney-backguarantee.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29HowdoIgetRUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/Mirrorsitesareavailableformanycountries,e.
g.
http://cran.
us.
r-project.
org/.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/Mirrorsitesareavailableformanycountries,e.
g.
http://cran.
us.
r-project.
org/.
CRANsiteshavebinarydistributionsforWindows95,98,ME,NT4and2000onIntel,fortheMacintosh(System8.
6to9.
1andMacOSX),andforseveralLinuxdistributions.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/Mirrorsitesareavailableformanycountries,e.
g.
http://cran.
us.
r-project.
org/.
CRANsiteshavebinarydistributionsforWindows95,98,ME,NT4and2000onIntel,fortheMacintosh(System8.
6to9.
1andMacOSX),andforseveralLinuxdistributions.
Newreleasesoccurfrequently-aboutevery3months.
Bepreparedtore-installfrequently.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29InstallingRUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
MacintoshThedistributionconsistsofonebinhexed(.
hxq)lethatyouexpandusingstandardtools.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
MacintoshThedistributionconsistsofonebinhexed(.
hxq)lethatyouexpandusingstandardtools.
LinuxRPMlesareavailableforRedHat,SuSE,andMandrake.
DeblesareavailableforDebian.
UnderDebianyoucanlistaCRANarchivein/etc/apt/sources.
listforautomaticupdates.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
MacintoshThedistributionconsistsofonebinhexed(.
hxq)lethatyouexpandusingstandardtools.
LinuxRPMlesareavailableforRedHat,SuSE,andMandrake.
DeblesareavailableforDebian.
UnderDebianyoucanlistaCRANarchivein/etc/apt/sources.
listforautomaticupdates.
UnixDownloadandexpandthecompressedtarleofthesources.
Run.
/congurethenmake;makecheck;makeinstallUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29AnExample-maximumlikelihoodExampleisfromaMathematicalStatisticscourseforIndustrialEngineeringstudentsIusethetextProbabilityandStatisticsforEngineeringandtheSciences(5thed)byJayDevore(Duxbury,2000).
OurI.
E.
Departmentrequiresthatstudentslearnmaximumlikelihood.
Studentsarenotatallenthusiastic.
Asiscommon,thetextconvertstheproblemofmaximizingthelikelihoodorlog-likelihoodtotheproblemofsolvingthelikelihoodequations.
Derivingthelikelihoodequationssometimesinvolvestakingpartialderivativesofcomplicatedexpressions.
Thisiserror-prone.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
13/29WeibullexamplefromDevore(2000)LetbearandomsamplefromaWeibullpdf¤§¨¤otherwiseWritingthelikelihoodandln(likelihood),thensettingbothandyieldstheequations¨Thesetwoequationscannotbesolvedexplicitlytogivegeneralformulasforthemle'sand.
Instead,foreachsample,theequationsmustbesolvedusinganiterativenumericalprocedure.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
14/29WeibullexampleinRRegardtheproblemofcalculatingMLEsasanoptimizationproblem.
Usuallyitiseasiertooptimizethelog-likelihoodratherthanthelikelihooditself.
Theparametervaluesthatoptimizethelog-likelihoodarealsotheMLEs.
Probabilitydensityfunctions(probabilityfunctionsfordiscretedistributions)havenamesstartingwithd—dnorm,dbinom,dunif,dweibull.
Alldensityfunctionstakeanoptionalargumentlogwhich,whenTRUEcausesevaluationofthelog-density.
Therecipebecomes:Regardtheparametersasthevariablesandsumthelogdensityforyourdistributionusingyourdata.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
15/29AnRsessionontheWeibullexample>library(Devore5)>data(xmp04.
30)#importthedata>str(xmp04.
30)#examinethestructure'data.
frame':10obs.
of1variable:$lifetime:num2825017418511072.
.
.
>#Reasonablestartingestimatesareshape=1,scale=1000>#Doasimpleevaluationatthissetofparameters>sum(dweibull(xmp04.
30$lifetime,shape=1,scale=1000,log=TRUE))[1]-80.
47655>#Optimizationfunctionsminimizesousenegativelog-likelihood>llfuncmlestr(mle)#structureofthereturnedvalueListof6$minimum:num77.
1$estimate:num[1:2]2.
151289.
34$gradient:num[1:2]-1.
50e-052.
98e-08$hessian:num[1:2,1:2]3.
75e+00-3.
20e-03-3.
20e-032.
78e-05$code:int1$iterations:int20>solve(mle$hessian)#approximatevariance-covariancematrix[,1][,2][1,]0.
295964234.
06422[2,]34.
064220039835.
81998Weseethatthemaximumofthelog-likelihoodis,achievedatand.
Theapproximatestandarderrorsoftheestimatesareand.
Wecanusethestandarderrorstodetermineagridofvaluesforcontouringthelog-likelihoodfunction.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
17/29Plottingthedensityattheestimates>plot(function(x)dweibull(x,shape=2.
15,scale=1289.
34),0,3000,+col="red",xlab="lifetime(hr)",ylab="density",+main="WeibulldensityusingMLEsfromthelifetimedata")>rug(xmp04.
30$lifetime,col="blue")0500100015002000250030000e+003e046e04WeibulldensityusingMLEsfromthelifetimedatalifetime(hr)densityUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
18/29Contouringthelog-likelihoodfunction>gridscvalsshvalsfor(iinseq(along=scvals))+for(jinseq(along=shvals))+grid[i,j]contour(scvals,shvals,grid,levels=77:85)>points(mle$estimate[1],mle$estimate[2],pch="+",cex=1.
5)>title(xlab=expression(alpha),ylab=expression(beta))>#Oruselevelscalculatedfromthechi-squaredistribution>contour(scvals,shvals,grid,+levels=mle$min+qchisq(c(0.
5,0.
8,0.
9,0.
95,0.
99),2),+labels=paste(c(50,80,90,95,99),"%",sep=""))UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
19/29Log-likelihoodcontours-Weibull0.
51.
01.
52.
02.
53.
03.
55001000150020002500+αβ0.
51.
01.
52.
02.
53.
03.
55001000150020002500+αβUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
20/29LessonsfromtheWeibullexampleThelikelihoodfunctionisthesameastheprobabilitydensitybutwiththeparametersvaryingandthedataxed.
Forarandomsample,thelog-likelihoodissum(d(,par1,par2,.
.
.
,log=TRUE))Weminimizethenegativeofthelog-likelihoodllfunc(,par1=x[1],.
.
.
,log=TRUE))mle,hessian=TRUE)Theinverseofthehessianprovidesanestimateofthevariance-covariancematrix.
Fortwo-parametermodelswecanevaluateagridoflog-likelihoodvaluesandgetcontours.
Standarderrorsfromtheinversehessianarenotalwaysrealisticindicationsofthevariabilityintheparameterestimates.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
21/29AMethodofMomentsexampleExample6.
12inDevore(2000)discussedmethodofmomentsestimatesfortheparametersinadistributionusingsomesurvivaldata.
Rprovidesfacilitiesforapackageauthortodocumenteitherfunctionsordatasets.
TheexamplesectionofthedocumentationcanberuninRusingtheexamplefunction.
>example(xmp06.
12)x06.
12>data(xmp06.
12)x06.
12>gamma.
MoMprint(surv.
MoMllsurvmle2mle2$estimate[1]8.
79920312.
893209>solve(mle2$hessian)[,1][,2][1,]7.
513112-11.
01259[2,]-11.
01258517.
08703>shvalsscvalsfor(iinseq(along=shvals))+for(jinseq(along=scvals))+grid[i,j]contour(shvals,scvals,grid,levels=seq(100,110,2))UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
23/29Contoursforthegammalog-likelihood5101520251020304050+αβ5101520251020304050+αUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
24/29ConclusionsfromthegammaexampleGeneralizingtheWeibullexampletootherdistributions(especiallytwo-parameterdistributions)isstraightforward.
Thelog-likelihoodcontoursforthisexamplearebadlynon-elliptical.
Condenceintervalsforandbasedonthestandarderrorwouldhavepoorcoverage.
Ifyouwanttoapproximatethevariabilityintheparameterestimateswithsymmetricintervals,youarebetteroffusingand.
Ifyouwanttoseeareallybadexample,lookatthelog-likelihoodcontoursfortheparametersforthenegativebinomialusingthedatainExample6.
12ofDevore(2000).
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
25/29ProlelikelihoodInhisdescriptionoftheWeibullMLEs,Jayprovidestheexpression¨showingthattheMLEof,conditionalon,canbecalculateddirectly.
Thiscanbeusedtointroduceprolelikelihood>profilellprofilell(2.
15)#negativeprofilelog-likelihoodatestimate[1]77.
0951>mle3unlist(mle3[-3])minimumestimatehessiancodeiterations77.
0950882.
1520013.
3784371.
0000007.
000000UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
26/29ProlelikelihoodingeneralWecannowdiscusstheuseofprolelikelihoodtoobtaincondenceintervalswithbettercoverageproperties.
ForcaseswherethereisnoexplicitexpressionfortheconditionalMLE,nestedoptimizationscanbeused.
ThisworksinRbutisverytricky,ifnotimpossible,todoinS-PLUS.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
27/29WhatdoessoftwareaddtoMathStatArichsetofdistributionsinourstatisticalsoftwareallowsustoillustratedifferentdistributions.
Plottingandexploringdensities,probabilityfunctions,cumulativedistributionfunctions,empiricalcdf's,etc.
canhelptointernalizetheconceptofthesefunctionsaswellasconceptslikeshapeandscaleparameters.
(RecallhoweasyitwastoplottheWeibulldensity.
)WecantreatMLEsasoptimizationproblemsandavoidthepotentiallyconfusingpartialderivatives.
Wecanillustrateexamplesforwhichtherearenoanalyticsolutions.
Wecandiscussmoreadvancedconcepts(condenceregionsbasedoncontoursofthelog-likelihood,prolelikelihood,likelihood-basedcondenceintervalsthatdonothavetobesymmetric)inelementarycourses.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
28/29SourcesofinformationaboutRThewebsitehttp://www.
r-project.
org/andCRANThefrequentlyaskedquestions(FAQ)listathttp://www.
ci.
tuwien.
ac.
at/hornik/R/,mirroredathttp://cran.
r-project.
org/doc/FAQ/,isagreatsourceofinformation,especiallyforusersswitchingfromS-PLUS.
Themanualsinthedocumentationdirectoryhttp://cran.
r-project.
org/doc/manuals.
SeeespeciallyR-intro.
pdfandR-data.
pdf.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
29/29
Batesbates@R-project.
orgUniversityofWisconsin–MadisonUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
1/29OutlineOpenSourceSoftwareforStatisticsWhatisRObtainingandinstallingRAnExample-MLEConclusionsfromtheexampleLinksUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
2/29StatisticalsoftwareinMathStatItiscommontousesomestatisticalsoftwareinappliedcoursestoworkwithrealisticsizeddatasetstcomplicatedmodelsgaininsightfromsimulationSoftwareinMathStatcourseshassimilaruses(especiallysimulation)butwemustprovideasimpleinterfaceforittobeuseful.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
3/29LinkingthecomputingtothetextItisimportantthattheuseofthecomputingsystembeintegratedwiththelecturesandtext.
Twowaysthiscanbeaccomplishedare:Writeatextthatistiedtospecicsoftwareandillustratestheuseofthatsoftware,e.
g.
NolanandSpeed(2000)Adoptaconventionaltextbutprovidetheexamplesfromthetextinthecomputingsystem.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
4/29AdvantagesofOpenSourcesoftwareNolicensefeesormanagementoflicenses.
Wecaninstallthesoftwareonallourdepartmentalcomputers.
Wedonotneedtowaitforacommericalsoftwareprovidertoporttoaparticularoperatingsystemorworryabouttheirdiscontinuingaport.
Itismucheasiertoconvinceothergroups(Computer-AidedEngineeringandtheComputingCenter,inmycase)toinstallthesoftware.
Studentscaninstallthesoftwareontheirowncomputerswithoutcharge(andwithoutviolatinglicenses).
OpenSourceprojectsencouragecontributionsfromuserssoextensionsareeasier.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
5/29TheSlanguageItisalanguageandsystemdevelopedbyJohnChambersandhisco-workersatBellLaboratories(formerlypartofAT&T,nowpartofLucentTechnologies).
TheAssociationforComputingMachinerypresentedits1999SoftwareSystemAwardtoJohnstating,"Shasforeveralteredthewaypeopleanalyze,visualize,andmanipulatedata"ItisthedefactostandardforcomputingintheStatisticsresearchcommunity.
Itisdocumentedinmanybooks,thebestknownofwhicharebyVenablesandRipley(ModernAppliedStatisticswithS-PLUSandSProgramming)andbyChambers(ProgrammingwithData).
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
6/29DesignGoalsforSToprovideanenvironmentforinteractivecomputingwithdata.
Toallowuserstotransitioneasilyintoprogrammersastheneedarises.
Toprovidebothexploratoryandpresentationgraphics.
Toavoidreinventingexistingtools.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
7/29CharacteristicsofSItisaninteractivelanguagebasedonfunctionsandfunctioncalls.
Itprovidesanenvironmentwithpersistent,self-describingobjects.
Inparticular,functionsarerst-classobjects.
Ithasawidevarietyofgraphicsdevicedriversandcontrols.
Itprovidesinterfacestoexistingcodeandsystems.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
8/29ImplementationsofSS-PLUS,soldbyInsightfulCorp.
(formerlyMathSoft,Inc.
)andbasedontheirexclusivelicenseoftheoriginalSsourcefromLucentTechnologies.
R,anOpenSourceprojectconformingforthemostparttothepublisheddescriptionsofS.
InitiallydevelopedbyRossIhakaandRobertGentlemanattheUniversityofAucklandNowdevelopedandmaintainedbyanwidely-dispersed,internationalgroupofvolunteersfromacademiaandindustry.
Operatesthroughwebsites(www.
r-project.
org),archives(cran.
r-project.
org)e-maillists,CVSsites,rsyncsites.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
9/29WhatisRUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLAnembeddableextensionlanguageUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLAnembeddableextensionlanguagePartoftheGNU(GNU'sNotUnix)softwaresystem.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29WhatisRAnOpenSourceimplementationofJohnChambers'award-winningSlanguageAlanguageandenvironmentfordataanalysisandgraphicsAmeansoftechnologytransferthroughpackagesAexibledataexchangemechanismaccessing:textlesandsavedRworkspacesS-PLUSdataobjects,SASXPORTdatasets,SPSSsaveddatasets,Minitabworksheets,relationaldatabases–ODBC,PostgreSQL,MySQLAnembeddableextensionlanguagePartoftheGNU(GNU'sNotUnix)softwaresystem.
Justinstallitandtryit.
Comeswithamoney-backguarantee.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
10/29HowdoIgetRUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/Mirrorsitesareavailableformanycountries,e.
g.
http://cran.
us.
r-project.
org/.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/Mirrorsitesareavailableformanycountries,e.
g.
http://cran.
us.
r-project.
org/.
CRANsiteshavebinarydistributionsforWindows95,98,ME,NT4and2000onIntel,fortheMacintosh(System8.
6to9.
1andMacOSX),andforseveralLinuxdistributions.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29HowdoIgetRTheinformationalwebsitehttp://www.
r-project.
org/CRAN-theComprehensiveRArchiveNetworkTheprimarysiteishttp://cran.
r-project.
org/Mirrorsitesareavailableformanycountries,e.
g.
http://cran.
us.
r-project.
org/.
CRANsiteshavebinarydistributionsforWindows95,98,ME,NT4and2000onIntel,fortheMacintosh(System8.
6to9.
1andMacOSX),andforseveralLinuxdistributions.
Newreleasesoccurfrequently-aboutevery3months.
Bepreparedtore-installfrequently.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
11/29InstallingRUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
MacintoshThedistributionconsistsofonebinhexed(.
hxq)lethatyouexpandusingstandardtools.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
MacintoshThedistributionconsistsofonebinhexed(.
hxq)lethatyouexpandusingstandardtools.
LinuxRPMlesareavailableforRedHat,SuSE,andMandrake.
DeblesareavailableforDebian.
UnderDebianyoucanlistaCRANarchivein/etc/apt/sources.
listforautomaticupdates.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29InstallingRWindowsDownloadandruntheinstaller,SetupR.
exe.
WindowsAlternatively,seetheminiRdirectoryforoppy-sizedimagesandtheirinstaller.
MacintoshThedistributionconsistsofonebinhexed(.
hxq)lethatyouexpandusingstandardtools.
LinuxRPMlesareavailableforRedHat,SuSE,andMandrake.
DeblesareavailableforDebian.
UnderDebianyoucanlistaCRANarchivein/etc/apt/sources.
listforautomaticupdates.
UnixDownloadandexpandthecompressedtarleofthesources.
Run.
/congurethenmake;makecheck;makeinstallUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
12/29AnExample-maximumlikelihoodExampleisfromaMathematicalStatisticscourseforIndustrialEngineeringstudentsIusethetextProbabilityandStatisticsforEngineeringandtheSciences(5thed)byJayDevore(Duxbury,2000).
OurI.
E.
Departmentrequiresthatstudentslearnmaximumlikelihood.
Studentsarenotatallenthusiastic.
Asiscommon,thetextconvertstheproblemofmaximizingthelikelihoodorlog-likelihoodtotheproblemofsolvingthelikelihoodequations.
Derivingthelikelihoodequationssometimesinvolvestakingpartialderivativesofcomplicatedexpressions.
Thisiserror-prone.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
13/29WeibullexamplefromDevore(2000)LetbearandomsamplefromaWeibullpdf¤§¨¤otherwiseWritingthelikelihoodandln(likelihood),thensettingbothandyieldstheequations¨Thesetwoequationscannotbesolvedexplicitlytogivegeneralformulasforthemle'sand.
Instead,foreachsample,theequationsmustbesolvedusinganiterativenumericalprocedure.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
14/29WeibullexampleinRRegardtheproblemofcalculatingMLEsasanoptimizationproblem.
Usuallyitiseasiertooptimizethelog-likelihoodratherthanthelikelihooditself.
Theparametervaluesthatoptimizethelog-likelihoodarealsotheMLEs.
Probabilitydensityfunctions(probabilityfunctionsfordiscretedistributions)havenamesstartingwithd—dnorm,dbinom,dunif,dweibull.
Alldensityfunctionstakeanoptionalargumentlogwhich,whenTRUEcausesevaluationofthelog-density.
Therecipebecomes:Regardtheparametersasthevariablesandsumthelogdensityforyourdistributionusingyourdata.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
15/29AnRsessionontheWeibullexample>library(Devore5)>data(xmp04.
30)#importthedata>str(xmp04.
30)#examinethestructure'data.
frame':10obs.
of1variable:$lifetime:num2825017418511072.
.
.
>#Reasonablestartingestimatesareshape=1,scale=1000>#Doasimpleevaluationatthissetofparameters>sum(dweibull(xmp04.
30$lifetime,shape=1,scale=1000,log=TRUE))[1]-80.
47655>#Optimizationfunctionsminimizesousenegativelog-likelihood>llfuncmlestr(mle)#structureofthereturnedvalueListof6$minimum:num77.
1$estimate:num[1:2]2.
151289.
34$gradient:num[1:2]-1.
50e-052.
98e-08$hessian:num[1:2,1:2]3.
75e+00-3.
20e-03-3.
20e-032.
78e-05$code:int1$iterations:int20>solve(mle$hessian)#approximatevariance-covariancematrix[,1][,2][1,]0.
295964234.
06422[2,]34.
064220039835.
81998Weseethatthemaximumofthelog-likelihoodis,achievedatand.
Theapproximatestandarderrorsoftheestimatesareand.
Wecanusethestandarderrorstodetermineagridofvaluesforcontouringthelog-likelihoodfunction.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
17/29Plottingthedensityattheestimates>plot(function(x)dweibull(x,shape=2.
15,scale=1289.
34),0,3000,+col="red",xlab="lifetime(hr)",ylab="density",+main="WeibulldensityusingMLEsfromthelifetimedata")>rug(xmp04.
30$lifetime,col="blue")0500100015002000250030000e+003e046e04WeibulldensityusingMLEsfromthelifetimedatalifetime(hr)densityUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
18/29Contouringthelog-likelihoodfunction>gridscvalsshvalsfor(iinseq(along=scvals))+for(jinseq(along=shvals))+grid[i,j]contour(scvals,shvals,grid,levels=77:85)>points(mle$estimate[1],mle$estimate[2],pch="+",cex=1.
5)>title(xlab=expression(alpha),ylab=expression(beta))>#Oruselevelscalculatedfromthechi-squaredistribution>contour(scvals,shvals,grid,+levels=mle$min+qchisq(c(0.
5,0.
8,0.
9,0.
95,0.
99),2),+labels=paste(c(50,80,90,95,99),"%",sep=""))UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
19/29Log-likelihoodcontours-Weibull0.
51.
01.
52.
02.
53.
03.
55001000150020002500+αβ0.
51.
01.
52.
02.
53.
03.
55001000150020002500+αβUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
20/29LessonsfromtheWeibullexampleThelikelihoodfunctionisthesameastheprobabilitydensitybutwiththeparametersvaryingandthedataxed.
Forarandomsample,thelog-likelihoodissum(d(,par1,par2,.
.
.
,log=TRUE))Weminimizethenegativeofthelog-likelihoodllfunc(,par1=x[1],.
.
.
,log=TRUE))mle,hessian=TRUE)Theinverseofthehessianprovidesanestimateofthevariance-covariancematrix.
Fortwo-parametermodelswecanevaluateagridoflog-likelihoodvaluesandgetcontours.
Standarderrorsfromtheinversehessianarenotalwaysrealisticindicationsofthevariabilityintheparameterestimates.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
21/29AMethodofMomentsexampleExample6.
12inDevore(2000)discussedmethodofmomentsestimatesfortheparametersinadistributionusingsomesurvivaldata.
Rprovidesfacilitiesforapackageauthortodocumenteitherfunctionsordatasets.
TheexamplesectionofthedocumentationcanberuninRusingtheexamplefunction.
>example(xmp06.
12)x06.
12>data(xmp06.
12)x06.
12>gamma.
MoMprint(surv.
MoMllsurvmle2mle2$estimate[1]8.
79920312.
893209>solve(mle2$hessian)[,1][,2][1,]7.
513112-11.
01259[2,]-11.
01258517.
08703>shvalsscvalsfor(iinseq(along=shvals))+for(jinseq(along=scvals))+grid[i,j]contour(shvals,scvals,grid,levels=seq(100,110,2))UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
23/29Contoursforthegammalog-likelihood5101520251020304050+αβ5101520251020304050+αUsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
24/29ConclusionsfromthegammaexampleGeneralizingtheWeibullexampletootherdistributions(especiallytwo-parameterdistributions)isstraightforward.
Thelog-likelihoodcontoursforthisexamplearebadlynon-elliptical.
Condenceintervalsforandbasedonthestandarderrorwouldhavepoorcoverage.
Ifyouwanttoapproximatethevariabilityintheparameterestimateswithsymmetricintervals,youarebetteroffusingand.
Ifyouwanttoseeareallybadexample,lookatthelog-likelihoodcontoursfortheparametersforthenegativebinomialusingthedatainExample6.
12ofDevore(2000).
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
25/29ProlelikelihoodInhisdescriptionoftheWeibullMLEs,Jayprovidestheexpression¨showingthattheMLEof,conditionalon,canbecalculateddirectly.
Thiscanbeusedtointroduceprolelikelihood>profilellprofilell(2.
15)#negativeprofilelog-likelihoodatestimate[1]77.
0951>mle3unlist(mle3[-3])minimumestimatehessiancodeiterations77.
0950882.
1520013.
3784371.
0000007.
000000UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
26/29ProlelikelihoodingeneralWecannowdiscusstheuseofprolelikelihoodtoobtaincondenceintervalswithbettercoverageproperties.
ForcaseswherethereisnoexplicitexpressionfortheconditionalMLE,nestedoptimizationscanbeused.
ThisworksinRbutisverytricky,ifnotimpossible,todoinS-PLUS.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
27/29WhatdoessoftwareaddtoMathStatArichsetofdistributionsinourstatisticalsoftwareallowsustoillustratedifferentdistributions.
Plottingandexploringdensities,probabilityfunctions,cumulativedistributionfunctions,empiricalcdf's,etc.
canhelptointernalizetheconceptofthesefunctionsaswellasconceptslikeshapeandscaleparameters.
(RecallhoweasyitwastoplottheWeibulldensity.
)WecantreatMLEsasoptimizationproblemsandavoidthepotentiallyconfusingpartialderivatives.
Wecanillustrateexamplesforwhichtherearenoanalyticsolutions.
Wecandiscussmoreadvancedconcepts(condenceregionsbasedoncontoursofthelog-likelihood,prolelikelihood,likelihood-basedcondenceintervalsthatdonothavetobesymmetric)inelementarycourses.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
28/29SourcesofinformationaboutRThewebsitehttp://www.
r-project.
org/andCRANThefrequentlyaskedquestions(FAQ)listathttp://www.
ci.
tuwien.
ac.
at/hornik/R/,mirroredathttp://cran.
r-project.
org/doc/FAQ/,isagreatsourceofinformation,especiallyforusersswitchingfromS-PLUS.
Themanualsinthedocumentationdirectoryhttp://cran.
r-project.
org/doc/manuals.
SeeespeciallyR-intro.
pdfandR-data.
pdf.
UsingOpenSourceSoftwaretoTeachMathematicalStatistics–p.
29/29
- wwwsources.list相关文档
- citysources.list
- Centersources.list
- Commesources.list
- ensuringsources.list
- filessources.list
- shortlysources.list
RackNerd 黑色星期五5款年付套餐
RackNerd 商家从2019年上线以来争议也是比较大的，一直低价促销很多网友都认为坚持时间不长可能会跑路。不过，目前看到RackNerd还是在坚持且这次黑五活动也有发布，且活动促销也是比较多的，不过对于我们用户来说选择这些低价服务商尽量的不要将长远项目放在上面，低价年付套餐服务商一般都是用来临时业务的。RackNerd商家这次发布黑五促销活动，一共有五款年付套餐，涉及到多个机房。最低年付的套餐...
tmhhost：全场VPS低至6.4折，香港BGP200M日本软银美国cn2 gia 200G高防美国三网cn2 gia韩国CN2
tmhhost放出了2021年的端午佳节+618年中大促的优惠活动：日本软银、洛杉矶200G高防cn2 gia、洛杉矶三网cn2 gia、香港200M直连BGP、韩国cn2，全都是高端优化线路，所有这些VPS直接8折，部分已经做了季付8折然后再在此基础上继续8折（也就是6.4折）。 官方网站：https://www.tmhhost.com 香港BGP线路VPS ，200M带宽 200M带...
陆零（￥25）云端专用的高性能、安全隔离的物理集群六折起
陆零网络是正规的IDC公司，我们采用优质硬件和网络，为客户提供高速、稳定的云计算服务。公司拥有一流的技术团队，提供7*24小时1对1售后服务，让您无后顾之忧。我们目前提供高防空间、云服务器、物理服务器，高防IP等众多产品，为您提供轻松上云、安全防护 为核心数据库、关键应用系统、高性能计算业务提供云端专用的高性能、安全隔离的物理集群。分钟级交付周期助你的企业获得实时的业务响应能力，助力核心业务飞速成...
sources.list为你推荐
-
操作httplinux防火墙设置LINUX系统怎么关闭防火墙新iphone也将禁售苹果手机现在在中国是不是不能卖了360防火墙在哪里电脑或电脑360有联网防火墙吗，在哪里设置银花珠树晓来看关于下雪景的诗句碧海银沙网怎样在碧海银沙网里发布图片？科创板首批名单2019年房产税试点城市名单佛山海虹海虹好吃吗，我从来没吃过网络u盘你们谁知道网络硬盘怎么用如何发帖子怎么发表贴子?